-- Logs begin at Mon 2022-10-24 08:03:12 UTC, end at Mon 2022-10-24 10:34:17 UTC. -- Oct 24 08:34:47.451463 n-d-master-1 systemd[1]: Starting Devstack devstack@keystone.service... Oct 24 08:34:47.464653 n-d-master-1 devstack@keystone.service[88300]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Oct 24 08:34:47 2022] *** Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: nodename: n-d-master-1 Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: machine: x86_64 Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: clock source: unix Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: pcre jit disabled Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: detected number of CPU cores: 4 Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: current working directory: / Oct 24 08:34:47.467842 n-d-master-1 devstack@keystone.service[88300]: detected binary path: /usr/bin/uwsgi-core Oct 24 08:34:47.468462 n-d-master-1 devstack@keystone.service[88300]: your processes number limit is 47680 Oct 24 08:34:47.468462 n-d-master-1 devstack@keystone.service[88300]: your memory page size is 4096 bytes Oct 24 08:34:47.468462 n-d-master-1 devstack@keystone.service[88300]: detected max file descriptor number: 2048 Oct 24 08:34:47.468462 n-d-master-1 devstack@keystone.service[88300]: lock engine: pthread robust mutexes Oct 24 08:34:47.468462 n-d-master-1 devstack@keystone.service[88300]: thunder lock: enabled Oct 24 08:34:47.468462 n-d-master-1 devstack@keystone.service[88300]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 24 08:34:47.468751 n-d-master-1 devstack@keystone.service[88300]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 24 08:34:47.510354 n-d-master-1 devstack@keystone.service[88300]: Python main interpreter initialized at 0x55fbeb3fa9c0 Oct 24 08:34:47.510354 n-d-master-1 devstack@keystone.service[88300]: python threads support enabled Oct 24 08:34:47.510354 n-d-master-1 devstack@keystone.service[88300]: your server socket listen backlog is limited to 100 connections Oct 24 08:34:47.510354 n-d-master-1 devstack@keystone.service[88300]: your mercy for graceful operations on workers is 90 seconds Oct 24 08:34:47.510890 n-d-master-1 devstack@keystone.service[88300]: mapped 403077 bytes (393 KB) for 2 cores Oct 24 08:34:47.510890 n-d-master-1 devstack@keystone.service[88300]: *** Operational MODE: preforking *** Oct 24 08:34:47.511267 n-d-master-1 devstack@keystone.service[88300]: *** uWSGI is running in multiple interpreter mode *** Oct 24 08:34:47.511267 n-d-master-1 devstack@keystone.service[88300]: spawned uWSGI master process (pid: 88300) Oct 24 08:34:47.511524 n-d-master-1 systemd[1]: Started Devstack devstack@keystone.service. Oct 24 08:34:47.513118 n-d-master-1 devstack@keystone.service[88300]: spawned uWSGI worker 1 (pid: 88311, cores: 1) Oct 24 08:34:47.513118 n-d-master-1 devstack@keystone.service[88300]: spawned uWSGI worker 2 (pid: 88312, cores: 1) Oct 24 08:34:47.513118 n-d-master-1 devstack@keystone.service[88300]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 24 08:34:52.353025 n-d-master-1 devstack@keystone.service[88311]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:34:52.353025 n-d-master-1 devstack@keystone.service[88311]: from cryptography.utils import int_from_bytes Oct 24 08:34:52.354101 n-d-master-1 devstack@keystone.service[88312]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:34:52.354101 n-d-master-1 devstack@keystone.service[88312]: from cryptography.utils import int_from_bytes Oct 24 08:34:52.354696 n-d-master-1 devstack@keystone.service[88311]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:34:52.354696 n-d-master-1 devstack@keystone.service[88311]: from cryptography.utils import int_from_bytes Oct 24 08:34:52.354878 n-d-master-1 devstack@keystone.service[88312]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 24 08:34:52.354878 n-d-master-1 devstack@keystone.service[88312]: from cryptography.utils import int_from_bytes Oct 24 08:34:52.405087 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:34:52.405334 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 24 08:34:52.405458 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:34:52.405622 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 24 08:34:52.405760 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] command line args: [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:34:52.405891 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] command line args: [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 24 08:34:52.405891 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:34:52.406099 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 24 08:34:52.406195 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ================================================================================ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:34:52.406292 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ================================================================================ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 24 08:34:52.406386 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] admin_token = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.406480 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] admin_token = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.406572 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] config_dir = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.406664 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] config_dir = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.406759 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.406865 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.406955 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] config_source = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.407041 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] config_source = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.407134 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] debug = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.407221 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] debug = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.407319 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.407800 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.407800 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.408096 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.408248 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.408382 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.408546 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.408721 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.408906 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.409078 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.409248 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.409434 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.409597 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] log_config_append = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.409792 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] log_config_append = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.409994 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.410169 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.410169 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] log_dir = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.410497 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] log_dir = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.410657 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] log_file = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.410819 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] log_file = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.410941 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.411114 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.411256 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.411440 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.411440 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.411699 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.411874 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.412599 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.412797 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.412927 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.413101 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.413228 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.413422 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.413558 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.413723 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.413854 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.414025 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.414148 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.414324 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.414459 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.414639 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.414757 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.414924 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.415063 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.415199 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.415331 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.415454 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.415636 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.415752 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.415921 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.416032 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.416212 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.416331 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] publish_errors = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.416502 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] publish_errors = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.416632 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.416815 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.416952 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.417125 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.417264 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.417462 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.417572 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.417698 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.417803 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.417919 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.418031 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] standard_threads = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.418133 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] standard_threads = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.418289 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.418396 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.418499 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.418692 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.418800 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.418910 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.419013 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] use_journal = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.419114 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] use_journal = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.419232 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] use_json = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.419351 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] use_json = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.419463 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] use_stderr = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.419574 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] use_stderr = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.419677 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] use_syslog = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.419785 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] use_syslog = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.419891 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.420004 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 24 08:34:52.420111 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.420213 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.420322 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.420433 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.420536 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.420656 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.420766 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.420881 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.420991 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.421095 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.421203 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.421359 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.421473 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.421588 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.421692 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.421793 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.421900 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422016 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422125 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422230 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422319 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422425 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422528 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422642 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422750 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422852 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.422962 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.423073 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.423193 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.423325 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.423460 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.423602 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.423733 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.423855 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.423963 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.424186 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.424303 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.424418 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.424531 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.424639 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.424756 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.424880 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.424991 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.425098 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.425213 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.425398 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.425541 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.425677 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.425800 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.425925 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.425925 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.426149 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.426269 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.426402 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.426522 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.426631 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.426741 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.426849 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.426967 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.427077 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.427188 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.427323 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.427453 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.427698 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.427844 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.427973 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.428100 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.428232 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.428371 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.428497 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.428635 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.428765 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.428902 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.429041 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.429167 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.429322 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.429479 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.429610 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.429741 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.429865 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.430080 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.430211 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.430439 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.430555 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.430663 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.430772 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.430900 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.431030 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.431173 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.431302 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.431433 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.431548 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.431662 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.431785 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.431923 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.432043 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.432164 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.432272 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.432272 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.432481 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.432618 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.432749 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.432878 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.433011 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.433128 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.433248 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.433469 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.433588 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.433702 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.433816 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.433936 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.434101 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.434233 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.434355 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.434472 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.434591 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.434771 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.434889 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.435021 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.435147 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.435254 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.435364 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.435467 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.435579 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.435685 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.435828 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.435958 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.436074 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.436178 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.436282 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.436384 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.436487 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.436603 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.436714 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.436819 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.436922 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.437012 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.437128 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.437251 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.437463 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.437600 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.437731 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.437864 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.438016 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.438150 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.438282 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.438427 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.438568 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.438701 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.438833 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.438952 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.439074 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.439195 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.439315 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.439424 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.439529 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.439629 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.439726 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.439837 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.439954 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.440074 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.440206 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.440324 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.440437 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.440540 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.440646 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.440751 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.440878 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.440978 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.441079 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.441193 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.441393 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.441526 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.441644 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.441753 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.441859 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.441958 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.442054 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.442175 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.442403 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.442518 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.442631 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.442742 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.442848 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.442951 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.443056 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.443177 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.443807 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.443939 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.444056 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.444171 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.444285 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.444394 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.444525 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.444643 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.444760 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.444871 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.444981 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.445096 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.445225 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.445370 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.445486 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.445596 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.445707 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.445823 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.445958 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.446070 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.446180 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.446291 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.446415 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.446551 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.446669 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.446784 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.446938 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.447087 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.external = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.447234 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.external = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.447366 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.447496 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.447616 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.447765 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.447900 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.448030 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.448161 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.password = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.448294 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.password = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.448439 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] auth.token = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.448569 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] auth.token = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.448702 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.448834 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.448966 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.449110 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.449243 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.449390 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.449509 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.449625 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.449727 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.449828 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.449968 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.450095 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.450216 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.450341 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.450451 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.450555 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.450673 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.450778 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.450882 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.450994 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.451098 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.451211 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.451356 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.451490 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.451635 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.451765 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.451889 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.452007 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.452146 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.452282 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.452384 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.452496 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.452629 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.452764 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.452912 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.453033 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.453155 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.453272 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.453438 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.453556 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.453693 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.453828 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.453946 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454070 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454189 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454282 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454382 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454475 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454576 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454682 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454772 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454863 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.454967 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.455073 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.455175 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.455295 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.455420 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.455556 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.455704 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.455837 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.455969 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.456096 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.456215 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.456332 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.456469 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.456592 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.456716 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.456825 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.456943 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.457068 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.457335 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.457482 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.457615 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.457735 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.457858 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.458062 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.458188 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.458303 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.458431 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.458563 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.458695 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.458901 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.459538 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.459671 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.459802 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.459936 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.460072 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.460215 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.460401 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.460525 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.460642 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.460759 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.460880 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.461016 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.461145 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.461252 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.461455 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.461567 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.461676 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.461795 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.461940 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.462073 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.462203 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.462334 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.462460 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.462597 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.462724 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.462857 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.462990 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.463123 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.463256 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.463405 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.463537 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.463663 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.463789 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.463909 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.464028 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.464165 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.464288 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.464408 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.464516 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.464627 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.464742 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.464869 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.464975 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.465100 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.465229 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.465379 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.465500 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.465647 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.465777 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.465907 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.466037 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.466163 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.466277 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.466406 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.466523 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.466642 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.466760 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.466875 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.466984 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.467113 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.467235 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.467364 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.467495 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.467626 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.467759 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.467906 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.468041 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.468172 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.468304 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.468434 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.468566 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.468711 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.468845 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.468977 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.469111 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.469244 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.469500 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.469650 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.469775 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.469897 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.470022 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.470148 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.470274 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.470415 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.470542 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.470682 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.470809 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.470933 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.471072 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.471200 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.471325 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.471452 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.471582 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.471711 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.471854 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.471986 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.472115 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.472242 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.472373 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.472503 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.472647 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.472776 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.472916 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.473047 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.473179 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.473371 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.473531 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.473659 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.473785 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.473913 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.474041 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.474172 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.474311 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.474466 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.474597 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.474723 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.474847 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.474975 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.475096 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.475225 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.475356 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.475483 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.475611 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.475741 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.475886 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476011 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476127 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476251 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476381 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476508 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476651 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476755 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476820 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476904 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.476978 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477040 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477109 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477170 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477229 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477362 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477467 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477531 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477606 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477681 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477743 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477802 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477860 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.477918 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478013 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478086 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478165 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478282 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478367 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478430 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478498 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478560 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478619 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478678 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478753 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478822 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.478940 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479026 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479088 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479148 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479221 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479295 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479365 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479438 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479499 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479558 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479616 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479693 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479693 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.479916 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480015 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480129 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480207 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480269 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480408 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480484 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480545 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480605 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480664 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480723 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480790 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] role.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480862 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] role.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480923 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] role.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.480983 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] role.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481086 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481192 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481265 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481359 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481421 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481481 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481540 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481599 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481671 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481733 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481792 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481851 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481910 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.481976 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482036 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482096 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482155 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482214 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482272 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482339 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482414 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482487 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482548 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482607 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482665 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482732 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482793 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482853 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482911 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.482970 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.483312 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.483428 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.483511 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.483574 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.483635 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.483694 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.483791 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.483944 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.484075 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.484206 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.484334 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.484466 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.484612 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.484758 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.484857 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.484985 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.485114 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.485207 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.485361 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.485508 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.485637 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.485764 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.485894 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.486018 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.486160 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.486293 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.486434 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.486569 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.486704 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.486839 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.486970 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.487087 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.487205 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.487335 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.487466 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.487595 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.487735 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] token.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.487867 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] token.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.487994 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.488123 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.488257 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.488388 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.488535 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.488666 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.488800 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.488940 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.489069 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.489205 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.489443 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.489574 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.489697 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.489825 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.489960 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.490128 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.490258 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.490372 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.490501 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.490627 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.490754 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.490886 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.491026 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.491156 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.491289 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.491419 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.491548 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.491679 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.491820 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.491967 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.492124 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.492273 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.492404 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.492531 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.492658 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.492791 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.492921 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.493065 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.493223 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.493367 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.493496 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.493624 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.493757 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.493908 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.494041 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.494170 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.494297 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.494297 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.494565 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.494708 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.494708 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.494934 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.495063 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.495197 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.495314 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.495453 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.495582 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.495712 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.495843 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.495976 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.496108 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.496253 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.496387 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.496522 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.496654 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.496785 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.496913 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.497052 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.497183 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.497183 n-d-master-1 devstack@keystone.service[88312]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88312) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:34:52.497427 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.497427 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.497427 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 24 08:34:52.497427 n-d-master-1 devstack@keystone.service[88311]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88311) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 24 08:34:52.522860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.523092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.523238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.523368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.523602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.523730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.532257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.532517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.564551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.564863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.564996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.565123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.622823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.623067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.675531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.675716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.675798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.675865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.838919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.839257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.839483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.839676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.839869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.840098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.840296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.840502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.840696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.840889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.841076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.841076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.865178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.865588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.865799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.866009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.866241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.866448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.866674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.866880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.867083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.867289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.867491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.867687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.867868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.867868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.878352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.878625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.891968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.892235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.892373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.892514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.892645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.892799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.892929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.893058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.893184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.893353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.893485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.893586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88311) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.893753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.893753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88312) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 24 08:34:52.911114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.911415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.911606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 08:34:52.911792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 08:34:52.911988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.912222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.912418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 08:34:52.912555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 24 08:34:52.912753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.912941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.913126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.913349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.913550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.913751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.913935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.914128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.922773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.923070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.923262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.923452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.923642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.923838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.924040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.924225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.931423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.931651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.934410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.934656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.934879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.935090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.935282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.935480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.935670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.935876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.936065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.936272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.936466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.936644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.936792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.936964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.937162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.937373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.937561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.937748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.937941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.938143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.938332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.938517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.960581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.960973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.962132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.962420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.962566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.962769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.969263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.969557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.969728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.969860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.969992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.970124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.976881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.977140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.977281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.977445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.981354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.981552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:52.981688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.981838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.981967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.982094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.982225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.982352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.982501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.982631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.982755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.982884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.983011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.983397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.983524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.983651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.999307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.999620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:52.999875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.000128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.003585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.003862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.006945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.007209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.007209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.007594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.011606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.011849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.014819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.015030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.018206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.018431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.018576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.018743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.018912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.019043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.019171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.019320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.019465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.019623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.019814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.020002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.036120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.036448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.036616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.036751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.036925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.037104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.037238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.037413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.044139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.044568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.045772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.046005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.047383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.047643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.047877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.048085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.050627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.050859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.051089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.051350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.051552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.051754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.051960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.052176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.052386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.052597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.063439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.063767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.064022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.064235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.064235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.064520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.064652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.064797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.064949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.065135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.065362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.065556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.065741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.065960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.081796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.082130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.085208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.085507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.088337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.088650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.089867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.090089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.091540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.091804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.091804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.092142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.092306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.092469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.098656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.098966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.100767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.100942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.104036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.104383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.104383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.104835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.105040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.105245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.105473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.105682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.113363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.113676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.113676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.113991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.114152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.114331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.122932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88312) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.123253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88311) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 24 08:34:53.123438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.123628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.123628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.124023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.124023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.124378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.124554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.124731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.124922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.125140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.125362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.125527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.125728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.125898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.126083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.126235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.126384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.126542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.126717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.126924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.126924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.127270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.127469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.127659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.127659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88312) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.128014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88311) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 24 08:34:53.160490 n-d-master-1 devstack@keystone.service[88312]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fbeb3fa9c0 pid: 88312 (default app) Oct 24 08:34:53.160783 n-d-master-1 devstack@keystone.service[88311]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55fbeb3fa9c0 pid: 88311 (default app) Oct 24 08:34:53.164709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f8f9-28e3-4c1a-87e5-f2e4940dda35 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:34:53.164993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f8f9-28e3-4c1a-87e5-f2e4940dda35 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:34:53.165272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7f8f9-28e3-4c1a-87e5-f2e4940dda35 None None] PATH_INFO: `/v3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:34:53.169760 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Mon Oct 24 08:34:53 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:00.487621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ccf6-ea9a-4a3a-8f83-aaff29444a19 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:00.488359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ccf6-ea9a-4a3a-8f83-aaff29444a19 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:00.488359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5ccf6-ea9a-4a3a-8f83-aaff29444a19 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:00.493091 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:00.499670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:00.500361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:00.500361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:00.572828 n-d-master-1 devstack@keystone.service[88311]: INFO dbcounter [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] Registered counter for database keystone Oct 24 08:35:00.594774 n-d-master-1 devstack@keystone.service[88311]: DEBUG oslo_db.sqlalchemy.engines [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88311) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:35:00.602245 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writer thread running {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:35:00.796469 n-d-master-1 devstack@keystone.service[88311]: DEBUG passlib.handlers.bcrypt [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88311) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 08:35:00.796757 n-d-master-1 devstack@keystone.service[88311]: DEBUG passlib.handlers.bcrypt [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88311) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 08:35:00.857730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:00.859642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:00.999938 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 501 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 24 08:35:01.443985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ccf6-ea9a-4a3a-8f83-aaff29444a19 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:01.514974 n-d-master-1 devstack@keystone.service[88312]: INFO dbcounter [None req-e0a5ccf6-ea9a-4a3a-8f83-aaff29444a19 None None] Registered counter for database keystone Oct 24 08:35:01.536975 n-d-master-1 devstack@keystone.service[88312]: DEBUG oslo_db.sqlalchemy.engines [None req-e0a5ccf6-ea9a-4a3a-8f83-aaff29444a19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88312) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 24 08:35:01.544540 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writer thread running {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 24 08:35:01.666927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5ccf6-ea9a-4a3a-8f83-aaff29444a19 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:01.671304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbfd0b3-c5b2-4eb9-9adb-28323b009be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:01.671938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfd0b3-c5b2-4eb9-9adb-28323b009be9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:01.672221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfd0b3-c5b2-4eb9-9adb-28323b009be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:01.672500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbfd0b3-c5b2-4eb9-9adb-28323b009be9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:01.682130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfd0b3-c5b2-4eb9-9adb-28323b009be9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:01.736096 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1bbfd0b3-c5b2-4eb9-9adb-28323b009be9 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 08:35:01.736442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbfd0b3-c5b2-4eb9-9adb-28323b009be9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:01.746878 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Mon Oct 24 08:35:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 08:35:01.753114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:01.770520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7a55c-a4e9-4635-8265-5e1c3292ca9a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:01.775632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677dc27-3283-4e7d-ac8c-802fb982f029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:01.776801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677dc27-3283-4e7d-ac8c-802fb982f029 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:01.777083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677dc27-3283-4e7d-ac8c-802fb982f029 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:01.777402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677dc27-3283-4e7d-ac8c-802fb982f029 admin admin] PATH_INFO: `/v3/projects/d5d57fb385334787a7547e0f12982788` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:01.781907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677dc27-3283-4e7d-ac8c-802fb982f029 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5d57fb385334787a7547e0f12982788)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:01.838149 n-d-master-1 devstack@keystone.service[88311]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6677dc27-3283-4e7d-ac8c-802fb982f029 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 24 08:35:01.838497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677dc27-3283-4e7d-ac8c-802fb982f029 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:01.843279 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Mon Oct 24 08:35:01 2022] GET /identity/v3/projects/d5d57fb385334787a7547e0f12982788 => generated 344 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:04.031639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a893d-b941-4880-9c10-ac473464ebf6 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:04.032478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a893d-b941-4880-9c10-ac473464ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:04.032478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46a893d-b941-4880-9c10-ac473464ebf6 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:04.036306 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:04.042961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b195325-ea7b-4178-8aad-91ea96bd81dc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:04.043463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b195325-ea7b-4178-8aad-91ea96bd81dc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:04.043606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b195325-ea7b-4178-8aad-91ea96bd81dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:04.064260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9b195325-ea7b-4178-8aad-91ea96bd81dc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:04.065825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9b195325-ea7b-4178-8aad-91ea96bd81dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:04.073923 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:35:04.435105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a893d-b941-4880-9c10-ac473464ebf6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:04.447980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46a893d-b941-4880-9c10-ac473464ebf6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:04.452137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c9c72-1054-4b2f-8956-35def8ccf72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:04.452743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c9c72-1054-4b2f-8956-35def8ccf72e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:04.453020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c9c72-1054-4b2f-8956-35def8ccf72e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:04.453287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c9c72-1054-4b2f-8956-35def8ccf72e admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:04.462343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c9c72-1054-4b2f-8956-35def8ccf72e admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:04.464136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c9c72-1054-4b2f-8956-35def8ccf72e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:04.473468 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Mon Oct 24 08:35:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:35:04.479378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b195325-ea7b-4178-8aad-91ea96bd81dc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:04.489114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b195325-ea7b-4178-8aad-91ea96bd81dc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:04.493769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde08565-9834-4266-a87a-b12891cc5deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:04.494398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08565-9834-4266-a87a-b12891cc5deb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:04.494674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08565-9834-4266-a87a-b12891cc5deb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:04.494948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde08565-9834-4266-a87a-b12891cc5deb admin admin] PATH_INFO: `/v3/users/382bba280be9494c8775eed19488896e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:04.496285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde08565-9834-4266-a87a-b12891cc5deb admin admin] RBAC: Authorizing `identity:get_user(user_id=382bba280be9494c8775eed19488896e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:04.498156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde08565-9834-4266-a87a-b12891cc5deb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:04.499717 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Mon Oct 24 08:35:04 2022] GET /identity/v3/users/382bba280be9494c8775eed19488896e => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:07.101934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241b291-82e0-408a-b6a0-bdcfa73082b2 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:07.102742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241b291-82e0-408a-b6a0-bdcfa73082b2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:07.102742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1241b291-82e0-408a-b6a0-bdcfa73082b2 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:07.103802 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:07.110841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac417f5-96e5-401b-b590-436de9eded8d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:07.111389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac417f5-96e5-401b-b590-436de9eded8d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:07.111823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac417f5-96e5-401b-b590-436de9eded8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:07.142664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dac417f5-96e5-401b-b590-436de9eded8d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:07.144733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dac417f5-96e5-401b-b590-436de9eded8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:07.168978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5017b-4213-4cc4-b6b7-bcc3502680e4 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:07.169536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5017b-4213-4cc4-b6b7-bcc3502680e4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:07.170048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5017b-4213-4cc4-b6b7-bcc3502680e4 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:07.172479 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:07.180635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6527b7-1543-4a2d-b385-c674f6a44d29 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:07.181125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6527b7-1543-4a2d-b385-c674f6a44d29 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:07.181629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6527b7-1543-4a2d-b385-c674f6a44d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:07.247674 n-d-master-1 devstack@keystone.service[88312]: DEBUG passlib.handlers.bcrypt [None req-fa6527b7-1543-4a2d-b385-c674f6a44d29 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88312) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 24 08:35:07.248056 n-d-master-1 devstack@keystone.service[88312]: DEBUG passlib.handlers.bcrypt [None req-fa6527b7-1543-4a2d-b385-c674f6a44d29 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88312) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 24 08:35:07.293822 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:07.297646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fa6527b7-1543-4a2d-b385-c674f6a44d29 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:07.299263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa6527b7-1543-4a2d-b385-c674f6a44d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:07.417495 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:07.572513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac417f5-96e5-401b-b590-436de9eded8d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:07.610232 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:07.706401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac417f5-96e5-401b-b590-436de9eded8d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:07.725086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6527b7-1543-4a2d-b385-c674f6a44d29 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:07.743926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf199fe0-282e-45c5-8e70-7363e3725a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:07.744565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf199fe0-282e-45c5-8e70-7363e3725a2b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:07.744842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf199fe0-282e-45c5-8e70-7363e3725a2b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:07.745118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf199fe0-282e-45c5-8e70-7363e3725a2b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:07.757421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf199fe0-282e-45c5-8e70-7363e3725a2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-cf199fe0-282e-45c5-8e70-7363e3725a2b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:07.767891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:07.769843 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:07.774699 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:07.777336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf199fe0-282e-45c5-8e70-7363e3725a2b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:07.846896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6527b7-1543-4a2d-b385-c674f6a44d29 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:07.849943 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:07.883107 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:07.904475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:07.906055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:07.906254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf199fe0-282e-45c5-8e70-7363e3725a2b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:07.906549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:07.907028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:07.908975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:07.911840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:07.930521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:35:07.930521 n-d-master-1 devstack@keystone.service[88312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:35:07.930521 n-d-master-1 devstack@keystone.service[88312]: [parameters: {'id': 'bf802cb08dab4edfa026b835f6a8b38e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 08:35:07.930521 n-d-master-1 devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:35:07.945228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2386a76-0022-4eec-a094-b3e53124fa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:07.945885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2386a76-0022-4eec-a094-b3e53124fa3a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:07.946165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2386a76-0022-4eec-a094-b3e53124fa3a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:07.946441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2386a76-0022-4eec-a094-b3e53124fa3a None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:07.947121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2386a76-0022-4eec-a094-b3e53124fa3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:07.947430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2386a76-0022-4eec-a094-b3e53124fa3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:07.948832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2386a76-0022-4eec-a094-b3e53124fa3a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:07.962731 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:35:07.966271 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 08:35:07.967643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:35:07.968758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:35:07.971275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:35:07.973238 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:35:07.974953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'id': 'bf802cb08dab4edfa026b835f6a8b38e', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 08:35:07.976782 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:07.978268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:07.979885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 8/16] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Oct 24 08:35:07 2022] POST /identity/v3/domains => generated 190 bytes in 244 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:07.981113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2386a76-0022-4eec-a094-b3e53124fa3a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:07.981232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:08.116270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeaebd-24bd-4c83-b3a5-fb5dde8efc36 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:08.134435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2386a76-0022-4eec-a094-b3e53124fa3a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:08.162199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a47e0-4c37-4350-93cc-9aa388f1a845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:08.163789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a47e0-4c37-4350-93cc-9aa388f1a845 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:08.164072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a47e0-4c37-4350-93cc-9aa388f1a845 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:08.164352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885a47e0-4c37-4350-93cc-9aa388f1a845 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:08.185191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a47e0-4c37-4350-93cc-9aa388f1a845 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:08.186764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885a47e0-4c37-4350-93cc-9aa388f1a845 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:08.191224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad2177-6643-4321-ba88-ab235c2112f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:08.192289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad2177-6643-4321-ba88-ab235c2112f7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:08.192780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad2177-6643-4321-ba88-ab235c2112f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:08.193269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad2177-6643-4321-ba88-ab235c2112f7 None admin] PATH_INFO: `/v3/users/382bba280be9494c8775eed19488896e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:08.195998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad2177-6643-4321-ba88-ab235c2112f7 None admin] RBAC: Authorizing `identity:get_user(user_id=382bba280be9494c8775eed19488896e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:08.198843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad2177-6643-4321-ba88-ab235c2112f7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:08.201921 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:07 2022] GET /identity/v3/users/382bba280be9494c8775eed19488896e => generated 247 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-885a47e0-4c37-4350-93cc-9aa388f1a845 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:08.205704 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:08.207980 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:08.210037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:08.210037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:08.210037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:08.210037 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:08.210592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad2177-6643-4321-ba88-ab235c2112f7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:08.216929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a47e0-4c37-4350-93cc-9aa388f1a845 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:08.228568 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:08.255721 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:08.323080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad2177-6643-4321-ba88-ab235c2112f7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:08.363660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd32c0-d4e0-46e2-aa88-c59cfceb540e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:08.364649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd32c0-d4e0-46e2-aa88-c59cfceb540e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:08.365109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd32c0-d4e0-46e2-aa88-c59cfceb540e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:08.365589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcd32c0-d4e0-46e2-aa88-c59cfceb540e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:08.367486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd32c0-d4e0-46e2-aa88-c59cfceb540e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:08.369766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcd32c0-d4e0-46e2-aa88-c59cfceb540e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:08.372373 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:08.380492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd32c0-d4e0-46e2-aa88-c59cfceb540e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:08.390653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885a47e0-4c37-4350-93cc-9aa388f1a845 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:08.433576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961d706a-87fc-41f7-ab1c-281c94f9de4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:08.434527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d706a-87fc-41f7-ab1c-281c94f9de4f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:08.434987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d706a-87fc-41f7-ab1c-281c94f9de4f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:08.435439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d706a-87fc-41f7-ab1c-281c94f9de4f None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:08.436450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d706a-87fc-41f7-ab1c-281c94f9de4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:08.436964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d706a-87fc-41f7-ab1c-281c94f9de4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:08.439375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961d706a-87fc-41f7-ab1c-281c94f9de4f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:08.467220 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:08.489332 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:08.513424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcd32c0-d4e0-46e2-aa88-c59cfceb540e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:08.554581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c134ae8f-c76d-457e-80cf-c939aa123cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:08.555358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ae8f-c76d-457e-80cf-c939aa123cb7 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:08.555706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ae8f-c76d-457e-80cf-c939aa123cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:08.556057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c134ae8f-c76d-457e-80cf-c939aa123cb7 None admin] PATH_INFO: `/v3/domains/default/users/382bba280be9494c8775eed19488896e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:08.558416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134ae8f-c76d-457e-80cf-c939aa123cb7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=382bba280be9494c8775eed19488896e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:08.559996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c134ae8f-c76d-457e-80cf-c939aa123cb7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:08.681632 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 11/21] 10.222.0.25 () {58 vars in 1361 bytes} [Mon Oct 24 08:35:08 2022] PUT /identity/v3/domains/default/users/382bba280be9494c8775eed19488896e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:35:10.883434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e526-5545-470c-838e-026a942b5fe5 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.884237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e526-5545-470c-838e-026a942b5fe5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.884237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb83e526-5545-470c-838e-026a942b5fe5 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.885327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:10.897075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688fbe-7daf-4e8c-a89a-2154eb07bd8d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:10.898946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688fbe-7daf-4e8c-a89a-2154eb07bd8d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:10.899622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf688fbe-7daf-4e8c-a89a-2154eb07bd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:10.937430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cf688fbe-7daf-4e8c-a89a-2154eb07bd8d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:10.940349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cf688fbe-7daf-4e8c-a89a-2154eb07bd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:11.113284 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:11.663476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83e526-5545-470c-838e-026a942b5fe5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:11.852161 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:11.887066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb83e526-5545-470c-838e-026a942b5fe5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:11.938201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98c28-bafe-4b47-a1fa-e20318eea5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:11.938797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98c28-bafe-4b47-a1fa-e20318eea5f7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:11.939089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98c28-bafe-4b47-a1fa-e20318eea5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:11.939369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf98c28-bafe-4b47-a1fa-e20318eea5f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:11.951952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98c28-bafe-4b47-a1fa-e20318eea5f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:11.953498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf98c28-bafe-4b47-a1fa-e20318eea5f7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-edf98c28-bafe-4b47-a1fa-e20318eea5f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:35:11.973182 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:11.974911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:35:11.977064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:35:11.977064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:35:11.977064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:11.981347 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 12/24] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:11.985659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688fbe-7daf-4e8c-a89a-2154eb07bd8d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:12.161875 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:12.235970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf688fbe-7daf-4e8c-a89a-2154eb07bd8d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:12.302120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1682478-431f-4dd0-85a1-a86e5d69f8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:12.302746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1682478-431f-4dd0-85a1-a86e5d69f8f5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.303088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1682478-431f-4dd0-85a1-a86e5d69f8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.303328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1682478-431f-4dd0-85a1-a86e5d69f8f5 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.304508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1682478-431f-4dd0-85a1-a86e5d69f8f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:12.304818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1682478-431f-4dd0-85a1-a86e5d69f8f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:12.306483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1682478-431f-4dd0-85a1-a86e5d69f8f5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:12.340365 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 13/25] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:12.350478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98c28-bafe-4b47-a1fa-e20318eea5f7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:12.556444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf98c28-bafe-4b47-a1fa-e20318eea5f7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:12.606567 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:12.613242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5d5c6-6749-494c-a5cb-d2ffd1b4d176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:12.613921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5d5c6-6749-494c-a5cb-d2ffd1b4d176 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.614824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5d5c6-6749-494c-a5cb-d2ffd1b4d176 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.615100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5d5c6-6749-494c-a5cb-d2ffd1b4d176 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.615775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5d5c6-6749-494c-a5cb-d2ffd1b4d176 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:12.617368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5d5c6-6749-494c-a5cb-d2ffd1b4d176 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:12.773411 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 13/26] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:35:12 2022] POST /identity/v3/projects => generated 301 bytes in 418 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:12.895522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3bba6-9c9e-48ed-a904-b4d59874ca39 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.895824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3bba6-9c9e-48ed-a904-b4d59874ca39 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.896168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3bba6-9c9e-48ed-a904-b4d59874ca39 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.897929 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:12.903758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322cfed-cdb8-4788-a401-070da449aa05 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.904500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322cfed-cdb8-4788-a401-070da449aa05 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.904500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f322cfed-cdb8-4788-a401-070da449aa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:12.927817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f322cfed-cdb8-4788-a401-070da449aa05 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:12.933774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f322cfed-cdb8-4788-a401-070da449aa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:12.998898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da19a09-0b02-45a8-9dd5-79ab6204141d None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:12.999709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da19a09-0b02-45a8-9dd5-79ab6204141d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:12.999709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da19a09-0b02-45a8-9dd5-79ab6204141d None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.001424 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 15/28] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:13.007711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1daebb-d4f3-416e-972c-96128feb7704 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.008128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1daebb-d4f3-416e-972c-96128feb7704 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.008299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1daebb-d4f3-416e-972c-96128feb7704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.041562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1f1daebb-d4f3-416e-972c-96128feb7704 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:13.042832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f1daebb-d4f3-416e-972c-96128feb7704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:13.065516 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 14/29] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:13.217262 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 16/30] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:13.394250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3fd06-0a6b-4a6d-abcf-789bf24267c1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.394957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3fd06-0a6b-4a6d-abcf-789bf24267c1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.395571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3fd06-0a6b-4a6d-abcf-789bf24267c1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.398558 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 15/31] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:13.405758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51beea-4169-41c1-9013-056d27938123 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.406384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51beea-4169-41c1-9013-056d27938123 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.406879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51beea-4169-41c1-9013-056d27938123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.444986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ee51beea-4169-41c1-9013-056d27938123 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:13.446935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ee51beea-4169-41c1-9013-056d27938123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:13.542579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3fd06-0a6b-4a6d-abcf-789bf24267c1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:13.609188 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:13.631717 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 17/32] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:13.689150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6198652-5403-47a6-8a3f-be16cb36593d None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.689542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6198652-5403-47a6-8a3f-be16cb36593d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.689998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6198652-5403-47a6-8a3f-be16cb36593d None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.692344 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 18/33] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:13.698661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfe8bb-c579-4377-a289-6c62e24696ba None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.699133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfe8bb-c579-4377-a289-6c62e24696ba None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.700464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdfe8bb-c579-4377-a289-6c62e24696ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.757761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-acdfe8bb-c579-4377-a289-6c62e24696ba None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:13.759768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-acdfe8bb-c579-4377-a289-6c62e24696ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:13.769639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3fd06-0a6b-4a6d-abcf-789bf24267c1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:13.798173 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:13.839342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e20a5-9c2f-4fd8-b8f3-83d82b8a9f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:13.840396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e20a5-9c2f-4fd8-b8f3-83d82b8a9f53 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:13.840880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e20a5-9c2f-4fd8-b8f3-83d82b8a9f53 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:13.841409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e20a5-9c2f-4fd8-b8f3-83d82b8a9f53 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:13.863854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e20a5-9c2f-4fd8-b8f3-83d82b8a9f53 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-377e20a5-9c2f-4fd8-b8f3-83d82b8a9f53 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:13.876572 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:13.878297 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:13.879834 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 16/34] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:13.881070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e20a5-9c2f-4fd8-b8f3-83d82b8a9f53 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:13.902774 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 19/35] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:13.904607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfe8bb-c579-4377-a289-6c62e24696ba None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.085134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e20a5-9c2f-4fd8-b8f3-83d82b8a9f53 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.116751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdfe8bb-c579-4377-a289-6c62e24696ba None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.146124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c676a1a-43a7-475f-a445-2f8972650276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.147124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c676a1a-43a7-475f-a445-2f8972650276 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.147694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c676a1a-43a7-475f-a445-2f8972650276 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.148198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c676a1a-43a7-475f-a445-2f8972650276 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.149430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c676a1a-43a7-475f-a445-2f8972650276 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.152221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c676a1a-43a7-475f-a445-2f8972650276 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.167990 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:14.183450 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 17/36] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Oct 24 08:35:13 2022] POST /identity/v3/roles => generated 219 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:14.184963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c676a1a-43a7-475f-a445-2f8972650276 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.198687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf1fa7-b43b-4f1d-93fc-2886eacd1fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.200461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf1fa7-b43b-4f1d-93fc-2886eacd1fd1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.201326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf1fa7-b43b-4f1d-93fc-2886eacd1fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.202075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf1fa7-b43b-4f1d-93fc-2886eacd1fd1 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.203667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf1fa7-b43b-4f1d-93fc-2886eacd1fd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:14.204721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf1fa7-b43b-4f1d-93fc-2886eacd1fd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.207910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cf1fa7-b43b-4f1d-93fc-2886eacd1fd1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.226572 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 20/37] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:14.228729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf1fa7-b43b-4f1d-93fc-2886eacd1fd1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.267742 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:14.352954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c676a1a-43a7-475f-a445-2f8972650276 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.396433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ac9cc-6bbc-4839-a103-598563b05ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.397163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac9cc-6bbc-4839-a103-598563b05ac3 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.397484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac9cc-6bbc-4839-a103-598563b05ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.397840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ac9cc-6bbc-4839-a103-598563b05ac3 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.398544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ac9cc-6bbc-4839-a103-598563b05ac3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.399994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ac9cc-6bbc-4839-a103-598563b05ac3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.419382 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 18/38] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Oct 24 08:35:14 2022] POST /identity/v3/roles => generated 223 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:14.420072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ac9cc-6bbc-4839-a103-598563b05ac3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.453678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf1fa7-b43b-4f1d-93fc-2886eacd1fd1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.516491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bcfe60-8c14-44d2-9899-1a221c89f4fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.518284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcfe60-8c14-44d2-9899-1a221c89f4fa None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.519116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcfe60-8c14-44d2-9899-1a221c89f4fa None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.520371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bcfe60-8c14-44d2-9899-1a221c89f4fa None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.521500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcfe60-8c14-44d2-9899-1a221c89f4fa None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.524213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bcfe60-8c14-44d2-9899-1a221c89f4fa None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.550159 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 21/39] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Oct 24 08:35:14 2022] POST /identity/v3/roles => generated 225 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:14.552299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68a593-4ef7-4434-8f72-829416b26c59 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.552299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68a593-4ef7-4434-8f72-829416b26c59 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.552752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc68a593-4ef7-4434-8f72-829416b26c59 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.560341 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 22/40] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:14.562875 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:14.573352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dda8b-96eb-452a-9736-7317a48248d7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.573352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dda8b-96eb-452a-9736-7317a48248d7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.573352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355dda8b-96eb-452a-9736-7317a48248d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.575945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ac9cc-6bbc-4839-a103-598563b05ac3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.607571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-355dda8b-96eb-452a-9736-7317a48248d7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:14.608757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-355dda8b-96eb-452a-9736-7317a48248d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:14.642150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf6e8-046b-4750-bde6-f87b31695162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.642852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf6e8-046b-4750-bde6-f87b31695162 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.643144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf6e8-046b-4750-bde6-f87b31695162 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.643429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ebf6e8-046b-4750-bde6-f87b31695162 None admin] PATH_INFO: `/v3/users/382bba280be9494c8775eed19488896e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.648152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebf6e8-046b-4750-bde6-f87b31695162 None admin] RBAC: Authorizing `identity:get_user(user_id=382bba280be9494c8775eed19488896e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.649765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ebf6e8-046b-4750-bde6-f87b31695162 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.651708 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 19/41] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/users/382bba280be9494c8775eed19488896e => generated 247 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:14.658574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf6e8-046b-4750-bde6-f87b31695162 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:14.686172 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:14.746891 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 23/42] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:14.814283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ebf6e8-046b-4750-bde6-f87b31695162 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:14.865243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd49751-0011-4a65-b982-21e2879c8629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:14.866610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd49751-0011-4a65-b982-21e2879c8629 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:14.867317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd49751-0011-4a65-b982-21e2879c8629 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:14.868054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd49751-0011-4a65-b982-21e2879c8629 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:14.870098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd49751-0011-4a65-b982-21e2879c8629 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:14.872594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd49751-0011-4a65-b982-21e2879c8629 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:14.875304 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 20/43] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:14.882625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dda8b-96eb-452a-9736-7317a48248d7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.025767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd49751-0011-4a65-b982-21e2879c8629 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.081496 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:15.105610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355dda8b-96eb-452a-9736-7317a48248d7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.165320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd49751-0011-4a65-b982-21e2879c8629 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.169253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e652412-550f-4171-9af0-0c27e394256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.170150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e652412-550f-4171-9af0-0c27e394256c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.170439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e652412-550f-4171-9af0-0c27e394256c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.170791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e652412-550f-4171-9af0-0c27e394256c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.171826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e652412-550f-4171-9af0-0c27e394256c None admin] RBAC: Adding query filter params (role.id=d266f03406d94df8bb9cad19b577978f, scope.domain.id=default, user.id=382bba280be9494c8775eed19488896e) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:15.172177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e652412-550f-4171-9af0-0c27e394256c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:15.174007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e652412-550f-4171-9af0-0c27e394256c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:15.181975 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 24/44] 10.222.0.25 () {56 vars in 1322 bytes} [Mon Oct 24 08:35:14 2022] GET /identity/v3/role_assignments?user.id=382bba280be9494c8775eed19488896e&scope.domain.id=default&role.id=d266f03406d94df8bb9cad19b577978f => generated 530 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:15.201885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb05fb14-981a-4557-ad29-869d81b2bc90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.202562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05fb14-981a-4557-ad29-869d81b2bc90 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.202847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05fb14-981a-4557-ad29-869d81b2bc90 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.203128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb05fb14-981a-4557-ad29-869d81b2bc90 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.204409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05fb14-981a-4557-ad29-869d81b2bc90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:15.205974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb05fb14-981a-4557-ad29-869d81b2bc90 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:15.207782 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 21/45] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:15.214729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e652412-550f-4171-9af0-0c27e394256c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:15.257936 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:15.336707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e652412-550f-4171-9af0-0c27e394256c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:15.379709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74ae214-5c2a-41f8-b1da-f9608cc3d571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:15.380339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ae214-5c2a-41f8-b1da-f9608cc3d571 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:15.380619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ae214-5c2a-41f8-b1da-f9608cc3d571 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:15.380893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74ae214-5c2a-41f8-b1da-f9608cc3d571 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:15.381603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ae214-5c2a-41f8-b1da-f9608cc3d571 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:15.383121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74ae214-5c2a-41f8-b1da-f9608cc3d571 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:15.417509 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 25/46] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:35:15 2022] POST /identity/v3/projects => generated 312 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:17.640971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024efa85-0bce-4dbc-9bcb-f1a537058e01 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:17.641693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024efa85-0bce-4dbc-9bcb-f1a537058e01 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:17.641693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024efa85-0bce-4dbc-9bcb-f1a537058e01 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:17.643165 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 22/47] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:17.649758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb502629-8938-4d91-ab04-701bb14157fb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:17.650533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb502629-8938-4d91-ab04-701bb14157fb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:17.650676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb502629-8938-4d91-ab04-701bb14157fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:17.670591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fb502629-8938-4d91-ab04-701bb14157fb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:17.671878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb502629-8938-4d91-ab04-701bb14157fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:17.746829 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 26/48] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:18.017582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024efa85-0bce-4dbc-9bcb-f1a537058e01 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:18.126393 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:18.132778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024efa85-0bce-4dbc-9bcb-f1a537058e01 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:18.169960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9151e-d3a6-4819-a004-70661c23a455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:18.170652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9151e-d3a6-4819-a004-70661c23a455 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:18.170992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9151e-d3a6-4819-a004-70661c23a455 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:18.171311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9151e-d3a6-4819-a004-70661c23a455 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:18.172499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9151e-d3a6-4819-a004-70661c23a455 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:18.174063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9151e-d3a6-4819-a004-70661c23a455 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:18.175722 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 23/49] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:18.182216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb502629-8938-4d91-ab04-701bb14157fb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:18.201619 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:18.294899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb502629-8938-4d91-ab04-701bb14157fb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:18.331892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dd5c7b-425f-43c6-8bc1-8808cec535c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:18.332560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd5c7b-425f-43c6-8bc1-8808cec535c6 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:18.332886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd5c7b-425f-43c6-8bc1-8808cec535c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:18.333205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dd5c7b-425f-43c6-8bc1-8808cec535c6 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:18.333948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd5c7b-425f-43c6-8bc1-8808cec535c6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:18.335997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dd5c7b-425f-43c6-8bc1-8808cec535c6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:18.366061 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 27/50] 10.222.0.25 () {60 vars in 1140 bytes} [Mon Oct 24 08:35:18 2022] POST /identity/v3/projects => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:35:20.613093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254754b3-dd70-4b8c-862d-8f5568134bd6 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:20.613709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254754b3-dd70-4b8c-862d-8f5568134bd6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:20.613709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254754b3-dd70-4b8c-862d-8f5568134bd6 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:20.615122 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 24/51] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:20.625156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92b170-4330-4283-adca-9f3b2a453772 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:20.625731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92b170-4330-4283-adca-9f3b2a453772 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:20.626098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92b170-4330-4283-adca-9f3b2a453772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:20.647426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8c92b170-4330-4283-adca-9f3b2a453772 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:20.649190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c92b170-4330-4283-adca-9f3b2a453772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:20.752293 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:20.758490 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 28/52] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:21.033059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254754b3-dd70-4b8c-862d-8f5568134bd6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:21.167851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254754b3-dd70-4b8c-862d-8f5568134bd6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:21.201726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409640b5-15aa-447a-80c5-e2bb39932ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:21.202357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409640b5-15aa-447a-80c5-e2bb39932ca9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.202634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409640b5-15aa-447a-80c5-e2bb39932ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.202907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409640b5-15aa-447a-80c5-e2bb39932ca9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.204028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409640b5-15aa-447a-80c5-e2bb39932ca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:21.205510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409640b5-15aa-447a-80c5-e2bb39932ca9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:21.207101 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 25/53] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:21.217538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92b170-4330-4283-adca-9f3b2a453772 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:21.329608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92b170-4330-4283-adca-9f3b2a453772 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:21.365532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30189c06-05cd-4c0d-9e7c-b8222fa0abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:21.366195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30189c06-05cd-4c0d-9e7c-b8222fa0abd7 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:21.366518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30189c06-05cd-4c0d-9e7c-b8222fa0abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:21.367355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30189c06-05cd-4c0d-9e7c-b8222fa0abd7 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:21.368051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30189c06-05cd-4c0d-9e7c-b8222fa0abd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:21.369591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30189c06-05cd-4c0d-9e7c-b8222fa0abd7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:21.399097 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 29/54] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:21 2022] POST /identity/v3/users => generated 275 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:26.377354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183510c7-1823-44c6-a88f-71f9493553b7 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.377354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183510c7-1823-44c6-a88f-71f9493553b7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.377354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183510c7-1823-44c6-a88f-71f9493553b7 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.381009 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 26/55] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:26.390918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b31a-b8c2-454a-8d98-485044ea22cd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.392474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b31a-b8c2-454a-8d98-485044ea22cd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.393290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c758b31a-b8c2-454a-8d98-485044ea22cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.432905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c758b31a-b8c2-454a-8d98-485044ea22cd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:26.435570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c758b31a-b8c2-454a-8d98-485044ea22cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:26.570467 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:26.609180 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 30/56] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:26.706969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5063-d7f1-44e0-94eb-04f57a4c8717 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.707885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5063-d7f1-44e0-94eb-04f57a4c8717 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.708641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb5063-d7f1-44e0-94eb-04f57a4c8717 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.711502 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 27/57] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:26.720394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d2820-8e72-498d-86c5-114c0e2d7ed9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.720797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d2820-8e72-498d-86c5-114c0e2d7ed9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.721235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d2820-8e72-498d-86c5-114c0e2d7ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.751480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-791d2820-8e72-498d-86c5-114c0e2d7ed9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:26.753267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-791d2820-8e72-498d-86c5-114c0e2d7ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:26.867747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710c4d-85bd-47ab-99ec-0a7d66e73099 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.868666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710c4d-85bd-47ab-99ec-0a7d66e73099 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.869461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f710c4d-85bd-47ab-99ec-0a7d66e73099 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.872310 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 28/58] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:26.899051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dbf13-e6a7-44db-bca8-e39b9a0b8474 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.899977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dbf13-e6a7-44db-bca8-e39b9a0b8474 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.900755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5dbf13-e6a7-44db-bca8-e39b9a0b8474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.928271 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 31/59] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:26.930340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa85af-b673-472d-8808-f96e44d73698 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.930907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa85af-b673-472d-8808-f96e44d73698 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.931390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaa85af-b673-472d-8808-f96e44d73698 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.933816 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 32/60] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:26.942520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d9a2-60f1-4a4f-b687-0ee8839544e1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:26.943011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d9a2-60f1-4a4f-b687-0ee8839544e1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:26.943494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a868d9a2-60f1-4a4f-b687-0ee8839544e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:26.950731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ea5dbf13-e6a7-44db-bca8-e39b9a0b8474 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:26.952746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ea5dbf13-e6a7-44db-bca8-e39b9a0b8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:27.004479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a868d9a2-60f1-4a4f-b687-0ee8839544e1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:27.006397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a868d9a2-60f1-4a4f-b687-0ee8839544e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:27.062166 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.219559 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 29/61] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:27.224741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dbf13-e6a7-44db-bca8-e39b9a0b8474 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.257972 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 33/62] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:27.470045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5dbf13-e6a7-44db-bca8-e39b9a0b8474 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.537538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d9a2-60f1-4a4f-b687-0ee8839544e1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.658686 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.689132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51211932-da5f-495f-a361-3b6da3111674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.690197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51211932-da5f-495f-a361-3b6da3111674 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.690673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51211932-da5f-495f-a361-3b6da3111674 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.691143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51211932-da5f-495f-a361-3b6da3111674 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.710551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51211932-da5f-495f-a361-3b6da3111674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-51211932-da5f-495f-a361-3b6da3111674 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:27.719466 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:27.721143 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:27.723119 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 30/63] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 501 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:27.724393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d83e71-c7b3-4355-8fa6-6b7e8da838a9 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.724393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d83e71-c7b3-4355-8fa6-6b7e8da838a9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.725367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d83e71-c7b3-4355-8fa6-6b7e8da838a9 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.727783 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 31/64] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:27.735120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d83e71-c7b3-4355-8fa6-6b7e8da838a9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.778854 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:27.781788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a868d9a2-60f1-4a4f-b687-0ee8839544e1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.839978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8170f825-9708-4913-856a-0f64446efc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.840528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170f825-9708-4913-856a-0f64446efc6c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.840807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170f825-9708-4913-856a-0f64446efc6c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.841080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8170f825-9708-4913-856a-0f64446efc6c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.853267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8170f825-9708-4913-856a-0f64446efc6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-8170f825-9708-4913-856a-0f64446efc6c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:27.858296 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:27.859285 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:27.860633 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 34/65] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:27.862132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fc74f-c221-4622-ac33-476c431dbc5e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.862132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fc74f-c221-4622-ac33-476c431dbc5e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.862132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0fc74f-c221-4622-ac33-476c431dbc5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.880146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1a0fc74f-c221-4622-ac33-476c431dbc5e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:27.881425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a0fc74f-c221-4622-ac33-476c431dbc5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:27.917693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d83e71-c7b3-4355-8fa6-6b7e8da838a9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:27.963340 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 35/66] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:27.964445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fc74f-c221-4622-ac33-476c431dbc5e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:27.971014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f091970-20f5-4256-b5fa-e2b723704353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:27.972057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f091970-20f5-4256-b5fa-e2b723704353 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:27.972532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f091970-20f5-4256-b5fa-e2b723704353 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:27.973071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f091970-20f5-4256-b5fa-e2b723704353 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:27.974284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f091970-20f5-4256-b5fa-e2b723704353 None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:27.974830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f091970-20f5-4256-b5fa-e2b723704353 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:27.978010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f091970-20f5-4256-b5fa-e2b723704353 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.000411 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 32/67] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.001876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f091970-20f5-4256-b5fa-e2b723704353 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.012749 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.131238 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.142579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0fc74f-c221-4622-ac33-476c431dbc5e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.159688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f091970-20f5-4256-b5fa-e2b723704353 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.194011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe704c-6482-4175-9066-dbc4a52594e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.194770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe704c-6482-4175-9066-dbc4a52594e5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.195110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe704c-6482-4175-9066-dbc4a52594e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.195389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe704c-6482-4175-9066-dbc4a52594e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.208201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe704c-6482-4175-9066-dbc4a52594e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1dbe704c-6482-4175-9066-dbc4a52594e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:28.215617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:28.217237 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 36/68] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:28.218724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe704c-6482-4175-9066-dbc4a52594e5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.241372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb33751-27a1-416b-966a-ac42e5bbe732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.243414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb33751-27a1-416b-966a-ac42e5bbe732 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.243985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb33751-27a1-416b-966a-ac42e5bbe732 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.244522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb33751-27a1-416b-966a-ac42e5bbe732 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.265637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb33751-27a1-416b-966a-ac42e5bbe732 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-8cb33751-27a1-416b-966a-ac42e5bbe732 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:28.275501 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:28.277224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:28.278843 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 33/69] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:28.280120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb33751-27a1-416b-966a-ac42e5bbe732 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.350249 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.358970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe704c-6482-4175-9066-dbc4a52594e5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.415975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42559eb-3f18-42f7-98d8-f88a2344b50b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.416951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42559eb-3f18-42f7-98d8-f88a2344b50b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.417513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42559eb-3f18-42f7-98d8-f88a2344b50b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.418004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42559eb-3f18-42f7-98d8-f88a2344b50b None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.419230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42559eb-3f18-42f7-98d8-f88a2344b50b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:28.419784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42559eb-3f18-42f7-98d8-f88a2344b50b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.422462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42559eb-3f18-42f7-98d8-f88a2344b50b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.436451 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 37/70] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.437932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42559eb-3f18-42f7-98d8-f88a2344b50b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.449910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb33751-27a1-416b-966a-ac42e5bbe732 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.500631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149921e-589f-401a-846a-d98114e63b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.501676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149921e-589f-401a-846a-d98114e63b2e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.502031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149921e-589f-401a-846a-d98114e63b2e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.502390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2149921e-589f-401a-846a-d98114e63b2e None admin] PATH_INFO: `/v3/users/fbcdd02eda2945e1b299f07489044358` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.522154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149921e-589f-401a-846a-d98114e63b2e None admin] RBAC: Authorizing `identity:get_user(user_id=fbcdd02eda2945e1b299f07489044358)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.524220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2149921e-589f-401a-846a-d98114e63b2e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.526070 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 34/71] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/users/fbcdd02eda2945e1b299f07489044358 => generated 275 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.526984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149921e-589f-401a-846a-d98114e63b2e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.531448 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.593099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42559eb-3f18-42f7-98d8-f88a2344b50b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.637334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2de5-14a0-4fc3-b48b-217f3b611470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.638080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2de5-14a0-4fc3-b48b-217f3b611470 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.638444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2de5-14a0-4fc3-b48b-217f3b611470 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.638819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242b2de5-14a0-4fc3-b48b-217f3b611470 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.639662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2de5-14a0-4fc3-b48b-217f3b611470 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:28.640081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2de5-14a0-4fc3-b48b-217f3b611470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.641753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242b2de5-14a0-4fc3-b48b-217f3b611470 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.647077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2149921e-589f-401a-846a-d98114e63b2e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.651703 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 38/72] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.653093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2de5-14a0-4fc3-b48b-217f3b611470 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.683650 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.689856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef949f-ab8d-411e-a14b-8dd436fb3784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.691108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef949f-ab8d-411e-a14b-8dd436fb3784 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.691531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef949f-ab8d-411e-a14b-8dd436fb3784 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.691916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfef949f-ab8d-411e-a14b-8dd436fb3784 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.692732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef949f-ab8d-411e-a14b-8dd436fb3784 None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:28.693161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef949f-ab8d-411e-a14b-8dd436fb3784 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.694907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfef949f-ab8d-411e-a14b-8dd436fb3784 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.704769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 35/73] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.705675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef949f-ab8d-411e-a14b-8dd436fb3784 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.782317 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.803756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242b2de5-14a0-4fc3-b48b-217f3b611470 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.830008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfef949f-ab8d-411e-a14b-8dd436fb3784 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:28.851773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20970-6bdb-4d2b-b418-16b8f2600af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.852464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20970-6bdb-4d2b-b418-16b8f2600af4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.852823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20970-6bdb-4d2b-b418-16b8f2600af4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.853179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20970-6bdb-4d2b-b418-16b8f2600af4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.854649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc20970-6bdb-4d2b-b418-16b8f2600af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.856167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc20970-6bdb-4d2b-b418-16b8f2600af4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.858226 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 39/74] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.859109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20970-6bdb-4d2b-b418-16b8f2600af4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.878113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1074756-0057-49c2-ae3c-e092e6328110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:28.878869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1074756-0057-49c2-ae3c-e092e6328110 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:28.879225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1074756-0057-49c2-ae3c-e092e6328110 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:28.879670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1074756-0057-49c2-ae3c-e092e6328110 None admin] PATH_INFO: `/v3/users/fbcdd02eda2945e1b299f07489044358` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:28.881167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1074756-0057-49c2-ae3c-e092e6328110 None admin] RBAC: Authorizing `identity:get_user(user_id=fbcdd02eda2945e1b299f07489044358)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:28.883110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1074756-0057-49c2-ae3c-e092e6328110 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:28.885114 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 36/75] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/users/fbcdd02eda2945e1b299f07489044358 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:28.889503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1074756-0057-49c2-ae3c-e092e6328110 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:28.965799 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:28.980496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20970-6bdb-4d2b-b418-16b8f2600af4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.022947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac953ac-3c2a-431d-930f-fca3885041b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.024514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac953ac-3c2a-431d-930f-fca3885041b5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.025017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac953ac-3c2a-431d-930f-fca3885041b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.025547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac953ac-3c2a-431d-930f-fca3885041b5 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.027517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac953ac-3c2a-431d-930f-fca3885041b5 None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.030277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac953ac-3c2a-431d-930f-fca3885041b5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.031267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1074756-0057-49c2-ae3c-e092e6328110 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.033361 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 40/76] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.034788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac953ac-3c2a-431d-930f-fca3885041b5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.076805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367811b-3c1e-4159-9f66-2a8a165f8165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.077640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367811b-3c1e-4159-9f66-2a8a165f8165 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.078029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367811b-3c1e-4159-9f66-2a8a165f8165 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.078457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3367811b-3c1e-4159-9f66-2a8a165f8165 None admin] PATH_INFO: `/v3/users/382bba280be9494c8775eed19488896e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.079883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367811b-3c1e-4159-9f66-2a8a165f8165 None admin] RBAC: Authorizing `identity:get_user(user_id=382bba280be9494c8775eed19488896e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.081586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3367811b-3c1e-4159-9f66-2a8a165f8165 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.083496 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 37/77] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:28 2022] GET /identity/v3/users/382bba280be9494c8775eed19488896e => generated 247 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.086478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367811b-3c1e-4159-9f66-2a8a165f8165 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.091923 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.169993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac953ac-3c2a-431d-930f-fca3885041b5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.217939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b7ddf-f042-4e25-b60e-1d4a1250c424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.218663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b7ddf-f042-4e25-b60e-1d4a1250c424 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.219047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b7ddf-f042-4e25-b60e-1d4a1250c424 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.219438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b7ddf-f042-4e25-b60e-1d4a1250c424 None admin] PATH_INFO: `/v3/users/fbcdd02eda2945e1b299f07489044358` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.219685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3367811b-3c1e-4159-9f66-2a8a165f8165 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.220923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b7ddf-f042-4e25-b60e-1d4a1250c424 None admin] RBAC: Authorizing `identity:get_user(user_id=fbcdd02eda2945e1b299f07489044358)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.222725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b7ddf-f042-4e25-b60e-1d4a1250c424 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.230576 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 41/78] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/users/fbcdd02eda2945e1b299f07489044358 => generated 275 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.230576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b7ddf-f042-4e25-b60e-1d4a1250c424 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.265120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb52c49-733f-44ad-a0ed-3c9e7021a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.266062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb52c49-733f-44ad-a0ed-3c9e7021a9b4 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.266382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb52c49-733f-44ad-a0ed-3c9e7021a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.266540 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.266770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb52c49-733f-44ad-a0ed-3c9e7021a9b4 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.267856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb52c49-733f-44ad-a0ed-3c9e7021a9b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.270482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb52c49-733f-44ad-a0ed-3c9e7021a9b4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.311095 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 38/79] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:29 2022] POST /identity/v3/users => generated 289 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:29.312027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb52c49-733f-44ad-a0ed-3c9e7021a9b4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.396489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b7ddf-f042-4e25-b60e-1d4a1250c424 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.426612 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.457018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d450e35-a467-4ff6-8abf-a88bc65914d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.458080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d450e35-a467-4ff6-8abf-a88bc65914d3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.458553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d450e35-a467-4ff6-8abf-a88bc65914d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.459034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d450e35-a467-4ff6-8abf-a88bc65914d3 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.461776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d450e35-a467-4ff6-8abf-a88bc65914d3 None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.464237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d450e35-a467-4ff6-8abf-a88bc65914d3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.473696 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 42/80] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.473696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d450e35-a467-4ff6-8abf-a88bc65914d3 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.514462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb52c49-733f-44ad-a0ed-3c9e7021a9b4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.578120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7f72-b9c7-4155-ac98-4d71b4017590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.578917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7f72-b9c7-4155-ac98-4d71b4017590 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.579203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7f72-b9c7-4155-ac98-4d71b4017590 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.579485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a7f72-b9c7-4155-ac98-4d71b4017590 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48/users/fbcdd02eda2945e1b299f07489044358/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.582843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a7f72-b9c7-4155-ac98-4d71b4017590 None admin] RBAC: Authorizing `identity:create_grant(project_id=72848f2689d249be87482e72ba48db48, user_id=fbcdd02eda2945e1b299f07489044358, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.587083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a7f72-b9c7-4155-ac98-4d71b4017590 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.615079 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 39/81] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:29 2022] PUT /identity/v3/projects/72848f2689d249be87482e72ba48db48/users/fbcdd02eda2945e1b299f07489044358/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:29.617985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7f72-b9c7-4155-ac98-4d71b4017590 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.622393 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.637413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d450e35-a467-4ff6-8abf-a88bc65914d3 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.715530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48bcee-1baa-4229-ac5c-8f752fd0e5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.716648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48bcee-1baa-4229-ac5c-8f752fd0e5ff None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.717156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48bcee-1baa-4229-ac5c-8f752fd0e5ff None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.719299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a48bcee-1baa-4229-ac5c-8f752fd0e5ff None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.721664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48bcee-1baa-4229-ac5c-8f752fd0e5ff None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.729840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a48bcee-1baa-4229-ac5c-8f752fd0e5ff None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.729840 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 43/82] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.730451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48bcee-1baa-4229-ac5c-8f752fd0e5ff None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.833952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a7f72-b9c7-4155-ac98-4d71b4017590 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:29.860036 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:29.883840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5e04e-0b09-4312-ae3e-9079aaa06db3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:29.884503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e04e-0b09-4312-ae3e-9079aaa06db3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:29.884790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e04e-0b09-4312-ae3e-9079aaa06db3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:29.885067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5e04e-0b09-4312-ae3e-9079aaa06db3 None admin] PATH_INFO: `/v3/projects/ab7d00511dcd45448200caf27bf86224` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:29.887992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5e04e-0b09-4312-ae3e-9079aaa06db3 None admin] RBAC: Authorizing `identity:get_project(project_id=ab7d00511dcd45448200caf27bf86224)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:29.889536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5e04e-0b09-4312-ae3e-9079aaa06db3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:29.891945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 40/83] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:29 2022] GET /identity/v3/projects/ab7d00511dcd45448200caf27bf86224 => generated 312 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:29.892737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5e04e-0b09-4312-ae3e-9079aaa06db3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:29.975060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a48bcee-1baa-4229-ac5c-8f752fd0e5ff None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:30.026681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbf45-0283-43f7-a69d-800ec6c12791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:30.027320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbf45-0283-43f7-a69d-800ec6c12791 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:30.027682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbf45-0283-43f7-a69d-800ec6c12791 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:30.027962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23dbf45-0283-43f7-a69d-800ec6c12791 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48/users/fbcdd02eda2945e1b299f07489044358/roles/09faee4fb963419e9d5409d109523f73` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:30.030883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbf45-0283-43f7-a69d-800ec6c12791 None admin] RBAC: Authorizing `identity:create_grant(project_id=72848f2689d249be87482e72ba48db48, user_id=fbcdd02eda2945e1b299f07489044358, role_id=09faee4fb963419e9d5409d109523f73)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:30.032447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23dbf45-0283-43f7-a69d-800ec6c12791 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:30.062316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5e04e-0b09-4312-ae3e-9079aaa06db3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:30.062550 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 44/84] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:29 2022] PUT /identity/v3/projects/72848f2689d249be87482e72ba48db48/users/fbcdd02eda2945e1b299f07489044358/roles/09faee4fb963419e9d5409d109523f73 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:30.063406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbf45-0283-43f7-a69d-800ec6c12791 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:30.120627 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:30.187053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b3dd7d-1150-4203-8a18-15d26d3da567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:30.188282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3dd7d-1150-4203-8a18-15d26d3da567 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:30.188787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3dd7d-1150-4203-8a18-15d26d3da567 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:30.189289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b3dd7d-1150-4203-8a18-15d26d3da567 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48/users/382bba280be9494c8775eed19488896e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:30.192953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3dd7d-1150-4203-8a18-15d26d3da567 None admin] RBAC: Authorizing `identity:create_grant(project_id=72848f2689d249be87482e72ba48db48, user_id=382bba280be9494c8775eed19488896e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:30.201914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b3dd7d-1150-4203-8a18-15d26d3da567 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:30.246030 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 41/85] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:29 2022] PUT /identity/v3/projects/72848f2689d249be87482e72ba48db48/users/382bba280be9494c8775eed19488896e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:30.331305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23dbf45-0283-43f7-a69d-800ec6c12791 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:30.393286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c54f58-e20f-47a0-bda5-4b9019d72064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:30.394516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c54f58-e20f-47a0-bda5-4b9019d72064 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:30.395035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c54f58-e20f-47a0-bda5-4b9019d72064 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:30.395633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c54f58-e20f-47a0-bda5-4b9019d72064 None admin] PATH_INFO: `/v3/projects/ab7d00511dcd45448200caf27bf86224/users/fbcdd02eda2945e1b299f07489044358/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:30.399970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c54f58-e20f-47a0-bda5-4b9019d72064 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7d00511dcd45448200caf27bf86224, user_id=fbcdd02eda2945e1b299f07489044358, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:30.407263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c54f58-e20f-47a0-bda5-4b9019d72064 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:30.443155 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 45/86] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:30 2022] PUT /identity/v3/projects/ab7d00511dcd45448200caf27bf86224/users/fbcdd02eda2945e1b299f07489044358/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:32.774759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649a71-143c-4e6c-9fe8-132f1435c83a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.775529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649a71-143c-4e6c-9fe8-132f1435c83a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.775529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70649a71-143c-4e6c-9fe8-132f1435c83a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.776674 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 42/87] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:32.782555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79022-fb02-433c-b128-05f055c382e1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:32.783295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79022-fb02-433c-b128-05f055c382e1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:32.783295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b79022-fb02-433c-b128-05f055c382e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:32.803253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b3b79022-fb02-433c-b128-05f055c382e1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:32.804469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b3b79022-fb02-433c-b128-05f055c382e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:32.880131 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 46/88] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:33.187872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649a71-143c-4e6c-9fe8-132f1435c83a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.267093 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.366534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70649a71-143c-4e6c-9fe8-132f1435c83a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.452225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38887de-c09a-4bc0-9827-02b507326875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.453188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38887de-c09a-4bc0-9827-02b507326875 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.453722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38887de-c09a-4bc0-9827-02b507326875 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.454217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38887de-c09a-4bc0-9827-02b507326875 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.482726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38887de-c09a-4bc0-9827-02b507326875 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a38887de-c09a-4bc0-9827-02b507326875 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:33.494202 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:33.495956 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:33.497577 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 43/89] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:33.502266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79022-fb02-433c-b128-05f055c382e1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.533889 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.745333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b79022-fb02-433c-b128-05f055c382e1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.800792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59260d7a-5da2-4763-8665-b74b7a11ede9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:33.801781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59260d7a-5da2-4763-8665-b74b7a11ede9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.801781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59260d7a-5da2-4763-8665-b74b7a11ede9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.802057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59260d7a-5da2-4763-8665-b74b7a11ede9 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.802621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59260d7a-5da2-4763-8665-b74b7a11ede9 None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:33.802925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59260d7a-5da2-4763-8665-b74b7a11ede9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:33.804323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59260d7a-5da2-4763-8665-b74b7a11ede9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:33.817012 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 47/90] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:33.823489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38887de-c09a-4bc0-9827-02b507326875 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:33.965866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38887de-c09a-4bc0-9827-02b507326875 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:33.973519 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:33.992970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694caba-2abc-4d8d-8c1b-17fef7a40f80 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:33.993243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694caba-2abc-4d8d-8c1b-17fef7a40f80 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:33.993405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e694caba-2abc-4d8d-8c1b-17fef7a40f80 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:33.995232 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 48/91] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:34.001815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69428f81-a98a-4f2f-a22d-c7be3a279be9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.002034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69428f81-a98a-4f2f-a22d-c7be3a279be9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.002340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69428f81-a98a-4f2f-a22d-c7be3a279be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.031988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-69428f81-a98a-4f2f-a22d-c7be3a279be9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:34.033190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-69428f81-a98a-4f2f-a22d-c7be3a279be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:34.038702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d477c-66cc-4d74-aded-f523b2486f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.039485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d477c-66cc-4d74-aded-f523b2486f2a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.039770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d477c-66cc-4d74-aded-f523b2486f2a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.040050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6d477c-66cc-4d74-aded-f523b2486f2a None admin] PATH_INFO: `/v3/users/fbcdd02eda2945e1b299f07489044358` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.043071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d477c-66cc-4d74-aded-f523b2486f2a None admin] RBAC: Authorizing `identity:get_user(user_id=fbcdd02eda2945e1b299f07489044358)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.044665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6d477c-66cc-4d74-aded-f523b2486f2a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.049548 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 44/92] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:33 2022] GET /identity/v3/users/fbcdd02eda2945e1b299f07489044358 => generated 275 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:34.059070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d477c-66cc-4d74-aded-f523b2486f2a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.197832 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 49/93] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:34.270827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6d477c-66cc-4d74-aded-f523b2486f2a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.324781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab909f7d-1f27-48c2-a586-7b492bd8c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.325442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab909f7d-1f27-48c2-a586-7b492bd8c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.325729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab909f7d-1f27-48c2-a586-7b492bd8c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.326006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab909f7d-1f27-48c2-a586-7b492bd8c0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.389843 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.425076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab909f7d-1f27-48c2-a586-7b492bd8c0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.426702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab909f7d-1f27-48c2-a586-7b492bd8c0d7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.571079 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 45/94] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:34.575240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69531e06-4aad-4557-9251-d22a10d933a6 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.575603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69531e06-4aad-4557-9251-d22a10d933a6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.575842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69531e06-4aad-4557-9251-d22a10d933a6 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.577494 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 50/95] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:34.582450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118792-9bf8-49ba-8f84-18798ff4f318 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.582800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118792-9bf8-49ba-8f84-18798ff4f318 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.583089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b118792-9bf8-49ba-8f84-18798ff4f318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.586264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab909f7d-1f27-48c2-a586-7b492bd8c0d7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.592330 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.617787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1b118792-9bf8-49ba-8f84-18798ff4f318 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:34.619829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b118792-9bf8-49ba-8f84-18798ff4f318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:34.725994 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:34.799659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab909f7d-1f27-48c2-a586-7b492bd8c0d7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:34.835507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 51/96] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:34.893007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec47a4-3f46-4c24-8a5a-71fd6ef942be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:34.893785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec47a4-3f46-4c24-8a5a-71fd6ef942be None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:34.894094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec47a4-3f46-4c24-8a5a-71fd6ef942be None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:34.894226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec47a4-3f46-4c24-8a5a-71fd6ef942be None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:34.898127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec47a4-3f46-4c24-8a5a-71fd6ef942be None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:34.899766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec47a4-3f46-4c24-8a5a-71fd6ef942be None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:34.901530 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 46/97] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:34.907918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118792-9bf8-49ba-8f84-18798ff4f318 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:34.979888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec47a4-3f46-4c24-8a5a-71fd6ef942be None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.124219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b118792-9bf8-49ba-8f84-18798ff4f318 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.130581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec47a4-3f46-4c24-8a5a-71fd6ef942be None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.182765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c4472c-aed8-4b8d-b4be-94ba90cf598d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.184260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4472c-aed8-4b8d-b4be-94ba90cf598d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.184788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4472c-aed8-4b8d-b4be-94ba90cf598d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.185945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c4472c-aed8-4b8d-b4be-94ba90cf598d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.192748 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.202595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f83fa3d-74e9-439f-89fc-d8ef037e76cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.203647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83fa3d-74e9-439f-89fc-d8ef037e76cc None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.204103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c4472c-aed8-4b8d-b4be-94ba90cf598d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:35.204210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83fa3d-74e9-439f-89fc-d8ef037e76cc None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.204620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f83fa3d-74e9-439f-89fc-d8ef037e76cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.206129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83fa3d-74e9-439f-89fc-d8ef037e76cc None admin] RBAC: Adding query filter params (role.id=62bc91fd2a7048c3ad90e2802bdc487f, scope.project.id=72848f2689d249be87482e72ba48db48, user.id=fbcdd02eda2945e1b299f07489044358) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:35.206688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83fa3d-74e9-439f-89fc-d8ef037e76cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.209572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f83fa3d-74e9-439f-89fc-d8ef037e76cc None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-75c4472c-aed8-4b8d-b4be-94ba90cf598d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:35.210661 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:35.212230 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:35.212995 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:35.215917 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 47/98] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:35.217954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f1f72-60e9-42c1-bfd8-0d3c33b4bdcb None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.218484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f1f72-60e9-42c1-bfd8-0d3c33b4bdcb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.219092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f1f72-60e9-42c1-bfd8-0d3c33b4bdcb None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.220871 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 48/99] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:35.227074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab9e1-3b1d-46f1-9cd4-529eabef57ba None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.227575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab9e1-3b1d-46f1-9cd4-529eabef57ba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.228073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15ab9e1-3b1d-46f1-9cd4-529eabef57ba None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.232009 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 49/100] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:35.233388 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 52/101] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:34 2022] GET /identity/v3/role_assignments?user.id=fbcdd02eda2945e1b299f07489044358&scope.project.id=72848f2689d249be87482e72ba48db48&role.id=62bc91fd2a7048c3ad90e2802bdc487f => generated 608 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:35.233781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ab9e1-3b1d-46f1-9cd4-529eabef57ba None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.245149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9730489-c353-4ccb-9f89-701240b18c54 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.245713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9730489-c353-4ccb-9f89-701240b18c54 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.246173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9730489-c353-4ccb-9f89-701240b18c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.249278 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.288362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c9730489-c353-4ccb-9f89-701240b18c54 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:35.289781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c9730489-c353-4ccb-9f89-701240b18c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:35.382464 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 53/102] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:35.385090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a81fe8-162c-42d8-bf27-c63294af3ed3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.385611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a81fe8-162c-42d8-bf27-c63294af3ed3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.386438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a81fe8-162c-42d8-bf27-c63294af3ed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.415053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-11a81fe8-162c-42d8-bf27-c63294af3ed3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:35.418229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11a81fe8-162c-42d8-bf27-c63294af3ed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:35.499322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15ab9e1-3b1d-46f1-9cd4-529eabef57ba None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.539314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed9d9-f0ab-4764-a459-a77d8b0326ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.539996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed9d9-f0ab-4764-a459-a77d8b0326ea None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.540381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed9d9-f0ab-4764-a459-a77d8b0326ea None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.540675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600ed9d9-f0ab-4764-a459-a77d8b0326ea None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.541463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed9d9-f0ab-4764-a459-a77d8b0326ea None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:35.541776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed9d9-f0ab-4764-a459-a77d8b0326ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.543250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600ed9d9-f0ab-4764-a459-a77d8b0326ea None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.557351 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 50/103] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:35.557351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed9d9-f0ab-4764-a459-a77d8b0326ea None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.594107 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 54/104] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:35.595770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a81fe8-162c-42d8-bf27-c63294af3ed3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.636988 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.688090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600ed9d9-f0ab-4764-a459-a77d8b0326ea None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.736183 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:35.747822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ea3a8e-e790-48cf-803b-0ba16778ec82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.748474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea3a8e-e790-48cf-803b-0ba16778ec82 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.748751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea3a8e-e790-48cf-803b-0ba16778ec82 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.749022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ea3a8e-e790-48cf-803b-0ba16778ec82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.750286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea3a8e-e790-48cf-803b-0ba16778ec82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.752132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ea3a8e-e790-48cf-803b-0ba16778ec82 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.757927 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 51/105] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:35.757927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3e79-2d72-4f0c-9cf0-ab36e40d6901 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.757927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3e79-2d72-4f0c-9cf0-ab36e40d6901 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.757927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d3e79-2d72-4f0c-9cf0-ab36e40d6901 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.757927 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 52/106] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:35.771141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec5958-67b7-4ce3-ba52-107198540f28 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.771590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec5958-67b7-4ce3-ba52-107198540f28 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.772031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ec5958-67b7-4ce3-ba52-107198540f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.800992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-51ec5958-67b7-4ce3-ba52-107198540f28 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:35.803053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-51ec5958-67b7-4ce3-ba52-107198540f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:35.826903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a81fe8-162c-42d8-bf27-c63294af3ed3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:35.868515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841f8e-aaf4-4114-9d4b-993dd0047022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:35.869537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841f8e-aaf4-4114-9d4b-993dd0047022 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:35.869867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841f8e-aaf4-4114-9d4b-993dd0047022 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:35.870024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17841f8e-aaf4-4114-9d4b-993dd0047022 None admin] PATH_INFO: `/v3/users/fbcdd02eda2945e1b299f07489044358` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:35.871410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17841f8e-aaf4-4114-9d4b-993dd0047022 None admin] RBAC: Authorizing `identity:get_user(user_id=fbcdd02eda2945e1b299f07489044358)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:35.873240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17841f8e-aaf4-4114-9d4b-993dd0047022 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:35.882083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 55/107] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/users/fbcdd02eda2945e1b299f07489044358 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:35.882083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841f8e-aaf4-4114-9d4b-993dd0047022 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.895027 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 53/108] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:35.896280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec5958-67b7-4ce3-ba52-107198540f28 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:35.984525 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.036323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17841f8e-aaf4-4114-9d4b-993dd0047022 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.050126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ec5958-67b7-4ce3-ba52-107198540f28 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.084954 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.105585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaca0a-ebbb-4c47-8f1b-101f7c77d67c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.106476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaca0a-ebbb-4c47-8f1b-101f7c77d67c None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.106935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaca0a-ebbb-4c47-8f1b-101f7c77d67c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.107392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84aaca0a-ebbb-4c47-8f1b-101f7c77d67c None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.108540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aaca0a-ebbb-4c47-8f1b-101f7c77d67c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.109128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63697406-49bc-4c15-973f-3acc2657e6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.110154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63697406-49bc-4c15-973f-3acc2657e6c3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.110608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63697406-49bc-4c15-973f-3acc2657e6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.111050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63697406-49bc-4c15-973f-3acc2657e6c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.111194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84aaca0a-ebbb-4c47-8f1b-101f7c77d67c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.129535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63697406-49bc-4c15-973f-3acc2657e6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-63697406-49bc-4c15-973f-3acc2657e6c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:36.135654 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:36.137394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 54/109] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:36.139611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63697406-49bc-4c15-973f-3acc2657e6c3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.163063 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 56/110] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:35:35 2022] POST /identity/v3/projects => generated 302 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:36.165617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaca0a-ebbb-4c47-8f1b-101f7c77d67c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.310995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63697406-49bc-4c15-973f-3acc2657e6c3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.330621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84aaca0a-ebbb-4c47-8f1b-101f7c77d67c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.344041 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.360583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c22bb-a0c1-4a85-89c7-35c909e3ef77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.361213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c22bb-a0c1-4a85-89c7-35c909e3ef77 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.361783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c22bb-a0c1-4a85-89c7-35c909e3ef77 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.362054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44c22bb-a0c1-4a85-89c7-35c909e3ef77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.379870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf2393-d1b4-4142-a8da-f68f261cd988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.380523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf2393-d1b4-4142-a8da-f68f261cd988 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.380799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf2393-d1b4-4142-a8da-f68f261cd988 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.381135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbf2393-d1b4-4142-a8da-f68f261cd988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.393941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbf2393-d1b4-4142-a8da-f68f261cd988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-fcbf2393-d1b4-4142-a8da-f68f261cd988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:36.400153 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:36.401129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 57/111] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:36.402600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf2393-d1b4-4142-a8da-f68f261cd988 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.458438 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.475341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c22bb-a0c1-4a85-89c7-35c909e3ef77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.477811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44c22bb-a0c1-4a85-89c7-35c909e3ef77 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.561659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbf2393-d1b4-4142-a8da-f68f261cd988 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.616421 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 55/112] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:36.616421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c22bb-a0c1-4a85-89c7-35c909e3ef77 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.636677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d925b-1fc5-412b-b488-77ba4bf311a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.637765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d925b-1fc5-412b-b488-77ba4bf311a7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.638265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d925b-1fc5-412b-b488-77ba4bf311a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.638756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d925b-1fc5-412b-b488-77ba4bf311a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.639759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d925b-1fc5-412b-b488-77ba4bf311a7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:36.640216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d925b-1fc5-412b-b488-77ba4bf311a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.642463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d925b-1fc5-412b-b488-77ba4bf311a7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.645290 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.657974 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 58/113] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:36.659305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d925b-1fc5-412b-b488-77ba4bf311a7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.769895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44c22bb-a0c1-4a85-89c7-35c909e3ef77 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.816432 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:36.817556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccd61f-a442-4322-a2ad-330f794d8a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.817987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd61f-a442-4322-a2ad-330f794d8a0b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.818308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd61f-a442-4322-a2ad-330f794d8a0b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.818798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd61f-a442-4322-a2ad-330f794d8a0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.824533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d925b-1fc5-412b-b488-77ba4bf311a7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:36.834889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccd61f-a442-4322-a2ad-330f794d8a0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-baccd61f-a442-4322-a2ad-330f794d8a0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:36.845725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:36.847382 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:36.848937 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 56/114] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:36.855048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccd61f-a442-4322-a2ad-330f794d8a0b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:36.872093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af18a6-0409-47fe-9dc6-e6a104a0df80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:36.872900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af18a6-0409-47fe-9dc6-e6a104a0df80 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:36.873037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af18a6-0409-47fe-9dc6-e6a104a0df80 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:36.873440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6af18a6-0409-47fe-9dc6-e6a104a0df80 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:36.873943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af18a6-0409-47fe-9dc6-e6a104a0df80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:36.874243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af18a6-0409-47fe-9dc6-e6a104a0df80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:36.875644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6af18a6-0409-47fe-9dc6-e6a104a0df80 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:36.886081 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 59/115] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:36.886725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af18a6-0409-47fe-9dc6-e6a104a0df80 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.005649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6af18a6-0409-47fe-9dc6-e6a104a0df80 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.022083 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.046966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc685d3-62d9-4ca2-af18-f45bd57968c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.047604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc685d3-62d9-4ca2-af18-f45bd57968c6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.047885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc685d3-62d9-4ca2-af18-f45bd57968c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.048160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc685d3-62d9-4ca2-af18-f45bd57968c6 None admin] PATH_INFO: `/v3/users/fbcdd02eda2945e1b299f07489044358` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.049339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc685d3-62d9-4ca2-af18-f45bd57968c6 None admin] RBAC: Authorizing `identity:get_user(user_id=fbcdd02eda2945e1b299f07489044358)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.050782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc685d3-62d9-4ca2-af18-f45bd57968c6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.052362 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 60/116] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/users/fbcdd02eda2945e1b299f07489044358 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:37.060699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc685d3-62d9-4ca2-af18-f45bd57968c6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.067096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccd61f-a442-4322-a2ad-330f794d8a0b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.108794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2fd0b-0809-4847-a86b-60cfb3224845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.109466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2fd0b-0809-4847-a86b-60cfb3224845 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.109860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2fd0b-0809-4847-a86b-60cfb3224845 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.110012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2fd0b-0809-4847-a86b-60cfb3224845 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.111214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2fd0b-0809-4847-a86b-60cfb3224845 None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.113000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba2fd0b-0809-4847-a86b-60cfb3224845 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.114434 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.120562 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 57/117] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:36 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:37.121937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2fd0b-0809-4847-a86b-60cfb3224845 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.247554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2fd0b-0809-4847-a86b-60cfb3224845 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.266726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc685d3-62d9-4ca2-af18-f45bd57968c6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.288996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88725993-c18a-4a5a-b7a3-90a674e8fc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.289790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725993-c18a-4a5a-b7a3-90a674e8fc9b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.290080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725993-c18a-4a5a-b7a3-90a674e8fc9b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.290361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88725993-c18a-4a5a-b7a3-90a674e8fc9b None admin] PATH_INFO: `/v3/users/382bba280be9494c8775eed19488896e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.291556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88725993-c18a-4a5a-b7a3-90a674e8fc9b None admin] RBAC: Authorizing `identity:get_user(user_id=382bba280be9494c8775eed19488896e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.293011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88725993-c18a-4a5a-b7a3-90a674e8fc9b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.294936 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 58/118] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/users/382bba280be9494c8775eed19488896e => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:37.295533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88725993-c18a-4a5a-b7a3-90a674e8fc9b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.322764 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.339537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602ff90-f304-4f68-9696-829e8cacbe6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.340392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602ff90-f304-4f68-9696-829e8cacbe6c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.340552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602ff90-f304-4f68-9696-829e8cacbe6c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.340798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602ff90-f304-4f68-9696-829e8cacbe6c None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.341448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602ff90-f304-4f68-9696-829e8cacbe6c None admin] RBAC: Adding query filter params (name=reader) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:37.341725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602ff90-f304-4f68-9696-829e8cacbe6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.343102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602ff90-f304-4f68-9696-829e8cacbe6c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.360654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 61/119] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:37.360654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602ff90-f304-4f68-9696-829e8cacbe6c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.478908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88725993-c18a-4a5a-b7a3-90a674e8fc9b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.495260 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.513475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602ff90-f304-4f68-9696-829e8cacbe6c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.525839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918daf24-44ac-4aa0-9b5e-07084fe7b58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.526569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918daf24-44ac-4aa0-9b5e-07084fe7b58c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.526968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918daf24-44ac-4aa0-9b5e-07084fe7b58c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.527375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918daf24-44ac-4aa0-9b5e-07084fe7b58c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.567119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bb832-f763-4d6e-afe6-f84ca1ba21f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.567892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bb832-f763-4d6e-afe6-f84ca1ba21f4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.568353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bb832-f763-4d6e-afe6-f84ca1ba21f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.568823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949bb832-f763-4d6e-afe6-f84ca1ba21f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.569740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bb832-f763-4d6e-afe6-f84ca1ba21f4 None admin] RBAC: Adding query filter params (role.id=09faee4fb963419e9d5409d109523f73, scope.project.id=72848f2689d249be87482e72ba48db48, user.id=fbcdd02eda2945e1b299f07489044358) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:37.570181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bb832-f763-4d6e-afe6-f84ca1ba21f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.572577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949bb832-f763-4d6e-afe6-f84ca1ba21f4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.581665 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 62/120] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/role_assignments?user.id=fbcdd02eda2945e1b299f07489044358&scope.project.id=72848f2689d249be87482e72ba48db48&role.id=09faee4fb963419e9d5409d109523f73 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:37.590942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bb832-f763-4d6e-afe6-f84ca1ba21f4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.668458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918daf24-44ac-4aa0-9b5e-07084fe7b58c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:37.673135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918daf24-44ac-4aa0-9b5e-07084fe7b58c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:37.712982 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.825954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949bb832-f763-4d6e-afe6-f84ca1ba21f4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:37.854962 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 59/121] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:37.854962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918daf24-44ac-4aa0-9b5e-07084fe7b58c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:37.899987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e20da-c036-482e-a58c-9e7c714ef396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:37.901156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e20da-c036-482e-a58c-9e7c714ef396 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:37.901816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e20da-c036-482e-a58c-9e7c714ef396 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:37.902366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3e20da-c036-482e-a58c-9e7c714ef396 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:37.955312 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:37.984764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918daf24-44ac-4aa0-9b5e-07084fe7b58c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.007319 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:38.030260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff25c9b-8d51-42b1-8414-d5393a396dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.031477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff25c9b-8d51-42b1-8414-d5393a396dc5 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.032096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff25c9b-8d51-42b1-8414-d5393a396dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.032611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff25c9b-8d51-42b1-8414-d5393a396dc5 None admin] PATH_INFO: `/v3/users/f3549895b7b24d41ab0dc5e4f0db2f98` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.034727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e20da-c036-482e-a58c-9e7c714ef396 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.036500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3e20da-c036-482e-a58c-9e7c714ef396 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.066978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff25c9b-8d51-42b1-8414-d5393a396dc5 None admin] RBAC: Authorizing `identity:get_user(user_id=f3549895b7b24d41ab0dc5e4f0db2f98)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.069885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff25c9b-8d51-42b1-8414-d5393a396dc5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.073650 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 60/122] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/users/f3549895b7b24d41ab0dc5e4f0db2f98 => generated 289 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:38.075093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff25c9b-8d51-42b1-8414-d5393a396dc5 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.181969 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 63/123] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:38.183898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e20da-c036-482e-a58c-9e7c714ef396 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.237077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff25c9b-8d51-42b1-8414-d5393a396dc5 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.278689 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:38.280000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ecb85-5eea-47ee-827e-f001cdc23913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.280950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ecb85-5eea-47ee-827e-f001cdc23913 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.281709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ecb85-5eea-47ee-827e-f001cdc23913 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.282013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-489ecb85-5eea-47ee-827e-f001cdc23913 None admin] PATH_INFO: `/v3/projects/ab7d00511dcd45448200caf27bf86224` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.283874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ecb85-5eea-47ee-827e-f001cdc23913 None admin] RBAC: Authorizing `identity:get_project(project_id=ab7d00511dcd45448200caf27bf86224)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.286006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-489ecb85-5eea-47ee-827e-f001cdc23913 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.288425 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 61/124] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/projects/ab7d00511dcd45448200caf27bf86224 => generated 312 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:38.294833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ecb85-5eea-47ee-827e-f001cdc23913 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.357478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3e20da-c036-482e-a58c-9e7c714ef396 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.366541 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:38.403330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81a736-1a65-4c4f-959f-e7a757cfcc56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.404633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81a736-1a65-4c4f-959f-e7a757cfcc56 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.405023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81a736-1a65-4c4f-959f-e7a757cfcc56 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.405437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e81a736-1a65-4c4f-959f-e7a757cfcc56 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.407271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81a736-1a65-4c4f-959f-e7a757cfcc56 None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.409731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e81a736-1a65-4c4f-959f-e7a757cfcc56 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.412869 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 64/125] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:38.414835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81a736-1a65-4c4f-959f-e7a757cfcc56 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.465502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-489ecb85-5eea-47ee-827e-f001cdc23913 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.518884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82e47d-a3fc-44c5-bf93-9df9b655f85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.519783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e47d-a3fc-44c5-bf93-9df9b655f85a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.520244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e47d-a3fc-44c5-bf93-9df9b655f85a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.520667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a82e47d-a3fc-44c5-bf93-9df9b655f85a None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.522247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82e47d-a3fc-44c5-bf93-9df9b655f85a None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.524719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a82e47d-a3fc-44c5-bf93-9df9b655f85a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.532534 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 62/126] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:38.532534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82e47d-a3fc-44c5-bf93-9df9b655f85a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.601820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e81a736-1a65-4c4f-959f-e7a757cfcc56 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.644589 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:38.663572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6328f-9d65-45f5-b559-6c3ff6c69106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.664584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6328f-9d65-45f5-b559-6c3ff6c69106 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.665095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6328f-9d65-45f5-b559-6c3ff6c69106 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.665717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b6328f-9d65-45f5-b559-6c3ff6c69106 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.667066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6328f-9d65-45f5-b559-6c3ff6c69106 None admin] RBAC: Adding query filter params (role.id=62bc91fd2a7048c3ad90e2802bdc487f, scope.project.id=ab7d00511dcd45448200caf27bf86224, user.id=fbcdd02eda2945e1b299f07489044358) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:38.667633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6328f-9d65-45f5-b559-6c3ff6c69106 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.670306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b6328f-9d65-45f5-b559-6c3ff6c69106 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.670561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a82e47d-a3fc-44c5-bf93-9df9b655f85a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.681950 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 65/127] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/role_assignments?user.id=fbcdd02eda2945e1b299f07489044358&scope.project.id=ab7d00511dcd45448200caf27bf86224&role.id=62bc91fd2a7048c3ad90e2802bdc487f => generated 608 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:38.683224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6328f-9d65-45f5-b559-6c3ff6c69106 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:38.701797 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:38.736145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323aaf53-5ff0-4ca7-ba7f-edc0b27cc0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.737108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aaf53-5ff0-4ca7-ba7f-edc0b27cc0d5 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.737438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aaf53-5ff0-4ca7-ba7f-edc0b27cc0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.737699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323aaf53-5ff0-4ca7-ba7f-edc0b27cc0d5 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48/users/f3549895b7b24d41ab0dc5e4f0db2f98/roles/423640baf20c4b9dacb6d83f8428b6e6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.739952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323aaf53-5ff0-4ca7-ba7f-edc0b27cc0d5 None admin] RBAC: Authorizing `identity:create_grant(project_id=72848f2689d249be87482e72ba48db48, user_id=f3549895b7b24d41ab0dc5e4f0db2f98, role_id=423640baf20c4b9dacb6d83f8428b6e6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.741500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323aaf53-5ff0-4ca7-ba7f-edc0b27cc0d5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.760425 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 63/128] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:38 2022] PUT /identity/v3/projects/72848f2689d249be87482e72ba48db48/users/f3549895b7b24d41ab0dc5e4f0db2f98/roles/423640baf20c4b9dacb6d83f8428b6e6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:38.761678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361998-3b90-44fd-95ab-2140e49ddfdc None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.762030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361998-3b90-44fd-95ab-2140e49ddfdc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.762315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8361998-3b90-44fd-95ab-2140e49ddfdc None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.763866 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 64/129] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:38.770134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d0a9-35c8-4cca-b131-8caddb35e521 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.770419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d0a9-35c8-4cca-b131-8caddb35e521 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.770711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c69d0a9-35c8-4cca-b131-8caddb35e521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.804696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8c69d0a9-35c8-4cca-b131-8caddb35e521 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:38.807032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8c69d0a9-35c8-4cca-b131-8caddb35e521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:38.898757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b6328f-9d65-45f5-b559-6c3ff6c69106 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:38.965603 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 65/130] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:38.972585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a45ad-4b99-41a8-9396-5f9b9d5afe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:38.975371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a45ad-4b99-41a8-9396-5f9b9d5afe57 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:38.975371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a45ad-4b99-41a8-9396-5f9b9d5afe57 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:38.975371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13a45ad-4b99-41a8-9396-5f9b9d5afe57 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:38.975371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a45ad-4b99-41a8-9396-5f9b9d5afe57 None admin] RBAC: Adding query filter params (role.id=d266f03406d94df8bb9cad19b577978f, scope.project.id=72848f2689d249be87482e72ba48db48, user.id=382bba280be9494c8775eed19488896e) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:38.975886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a45ad-4b99-41a8-9396-5f9b9d5afe57 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:38.979850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13a45ad-4b99-41a8-9396-5f9b9d5afe57 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:38.998690 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 66/131] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:38 2022] GET /identity/v3/role_assignments?user.id=382bba280be9494c8775eed19488896e&scope.project.id=72848f2689d249be87482e72ba48db48&role.id=d266f03406d94df8bb9cad19b577978f => generated 608 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:39.289378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d0a9-35c8-4cca-b131-8caddb35e521 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.407171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c69d0a9-35c8-4cca-b131-8caddb35e521 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:39.408953 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:39.445606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6a82b-2fa6-41ff-b119-e10369c6f45e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:39.446252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a82b-2fa6-41ff-b119-e10369c6f45e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:39.446534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a82b-2fa6-41ff-b119-e10369c6f45e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:39.446807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6a82b-2fa6-41ff-b119-e10369c6f45e None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.447979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6a82b-2fa6-41ff-b119-e10369c6f45e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:39.449555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc6a82b-2fa6-41ff-b119-e10369c6f45e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:39.455855 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 66/132] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:39.456849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a45ad-4b99-41a8-9396-5f9b9d5afe57 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:39.517249 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:39.572614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13a45ad-4b99-41a8-9396-5f9b9d5afe57 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:39.609092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793bdeae-8677-4cc4-9916-689e2710bf8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:39.609751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bdeae-8677-4cc4-9916-689e2710bf8b None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:39.610035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bdeae-8677-4cc4-9916-689e2710bf8b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:39.610311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793bdeae-8677-4cc4-9916-689e2710bf8b None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:39.610980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bdeae-8677-4cc4-9916-689e2710bf8b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:39.612711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793bdeae-8677-4cc4-9916-689e2710bf8b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:39.636605 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 67/133] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:39 2022] POST /identity/v3/users => generated 283 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:41.270386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01661f9e-524a-46d3-8521-d636e1dfac4d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.270929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01661f9e-524a-46d3-8521-d636e1dfac4d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.270929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01661f9e-524a-46d3-8521-d636e1dfac4d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.272513 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 67/134] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:41.278700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9906a-3c5c-4e1b-abfd-da48fc13e46b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.279188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9906a-3c5c-4e1b-abfd-da48fc13e46b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.279287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f9906a-3c5c-4e1b-abfd-da48fc13e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.299877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-82f9906a-3c5c-4e1b-abfd-da48fc13e46b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:41.301101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82f9906a-3c5c-4e1b-abfd-da48fc13e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:41.381459 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 68/135] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:41.652369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01661f9e-524a-46d3-8521-d636e1dfac4d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:41.762833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01661f9e-524a-46d3-8521-d636e1dfac4d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:41.800583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88992d31-bdf3-49e9-b413-c852d252f38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:41.801235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992d31-bdf3-49e9-b413-c852d252f38d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.801559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992d31-bdf3-49e9-b413-c852d252f38d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.801978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88992d31-bdf3-49e9-b413-c852d252f38d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.813904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88992d31-bdf3-49e9-b413-c852d252f38d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-88992d31-bdf3-49e9-b413-c852d252f38d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:41.819687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:41.821112 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:41.821932 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 68/136] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:41.827336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9906a-3c5c-4e1b-abfd-da48fc13e46b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:41.877723 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:41.942787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f9906a-3c5c-4e1b-abfd-da48fc13e46b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:41.982197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c600c-56c2-41b1-be6a-93356924678f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:41.982825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c600c-56c2-41b1-be6a-93356924678f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.983109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c600c-56c2-41b1-be6a-93356924678f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.983388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5c600c-56c2-41b1-be6a-93356924678f None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.984068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c600c-56c2-41b1-be6a-93356924678f None admin] RBAC: Adding query filter params (name=reader) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:41.984381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c600c-56c2-41b1-be6a-93356924678f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:41.985833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5c600c-56c2-41b1-be6a-93356924678f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:41.990631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0c38b-2639-464e-9f36-afe82b2b2975 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.990926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0c38b-2639-464e-9f36-afe82b2b2975 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.991211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea0c38b-2639-464e-9f36-afe82b2b2975 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.992764 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 69/137] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:41.998352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209f75-d739-474f-872c-8558151b7575 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:41.998933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209f75-d739-474f-872c-8558151b7575 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:41.999406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209f75-d739-474f-872c-8558151b7575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:41.999575 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 69/138] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:42.005456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c600c-56c2-41b1-be6a-93356924678f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.021008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5d209f75-d739-474f-872c-8558151b7575 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:42.022578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5d209f75-d739-474f-872c-8558151b7575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:42.049660 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.102975 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 70/139] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:42.130202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5c600c-56c2-41b1-be6a-93356924678f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.133954 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.172543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e2b8d-4995-4c49-8d35-44fa67f829b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.173212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e2b8d-4995-4c49-8d35-44fa67f829b3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.173608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e2b8d-4995-4c49-8d35-44fa67f829b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.173889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e2b8d-4995-4c49-8d35-44fa67f829b3 None admin] PATH_INFO: `/v3/users/f3549895b7b24d41ab0dc5e4f0db2f98` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.175203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e2b8d-4995-4c49-8d35-44fa67f829b3 None admin] RBAC: Authorizing `identity:get_user(user_id=f3549895b7b24d41ab0dc5e4f0db2f98)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:42.176720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e2b8d-4995-4c49-8d35-44fa67f829b3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:42.178706 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 70/140] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/users/f3549895b7b24d41ab0dc5e4f0db2f98 => generated 289 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:42.184594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209f75-d739-474f-872c-8558151b7575 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.278472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ce5ab-42e8-477b-b89f-d74c9a93f60c None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.278817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ce5ab-42e8-477b-b89f-d74c9a93f60c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.279337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ce5ab-42e8-477b-b89f-d74c9a93f60c None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.280786 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 71/141] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:42.286822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bed65-bbad-4ce1-98e4-abcd275dcb2a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.287260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bed65-bbad-4ce1-98e4-abcd275dcb2a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.287421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bed65-bbad-4ce1-98e4-abcd275dcb2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.303565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d209f75-d739-474f-872c-8558151b7575 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.308160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b35bed65-bbad-4ce1-98e4-abcd275dcb2a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:42.309411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b35bed65-bbad-4ce1-98e4-abcd275dcb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:42.357972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc723c3-c682-47d7-a68e-bb3d6a4c387a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.358790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc723c3-c682-47d7-a68e-bb3d6a4c387a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.359087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc723c3-c682-47d7-a68e-bb3d6a4c387a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.359374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc723c3-c682-47d7-a68e-bb3d6a4c387a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.394639 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 72/142] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:42.395241 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.405595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bed65-bbad-4ce1-98e4-abcd275dcb2a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.442489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc723c3-c682-47d7-a68e-bb3d6a4c387a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:42.443964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc723c3-c682-47d7-a68e-bb3d6a4c387a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:42.534317 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.542519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bed65-bbad-4ce1-98e4-abcd275dcb2a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.548972 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 71/143] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:42.550645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd867c4-098a-4fde-a946-50724efe8c7d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.550933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd867c4-098a-4fde-a946-50724efe8c7d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.551208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd867c4-098a-4fde-a946-50724efe8c7d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.552644 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 72/144] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:42.557450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd867c4-098a-4fde-a946-50724efe8c7d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.585313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859e7f1-995e-4006-beb8-4d58daae32b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.585971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e7f1-995e-4006-beb8-4d58daae32b6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.586368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e7f1-995e-4006-beb8-4d58daae32b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.586640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859e7f1-995e-4006-beb8-4d58daae32b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.597330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859e7f1-995e-4006-beb8-4d58daae32b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c859e7f1-995e-4006-beb8-4d58daae32b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:42.602785 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:42.603650 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:42.604444 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 73/145] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:42.606028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4aaa3-36b0-4bc2-acb0-f91a750b6775 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.606398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4aaa3-36b0-4bc2-acb0-f91a750b6775 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.606651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de4aaa3-36b0-4bc2-acb0-f91a750b6775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.625200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8de4aaa3-36b0-4bc2-acb0-f91a750b6775 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:42.626410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8de4aaa3-36b0-4bc2-acb0-f91a750b6775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:42.630219 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.676563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd867c4-098a-4fde-a946-50724efe8c7d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.698891 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 74/146] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:42.699759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4aaa3-36b0-4bc2-acb0-f91a750b6775 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.713231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdbca-1810-4114-a490-c7d821d67601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.713911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdbca-1810-4114-a490-c7d821d67601 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.714192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdbca-1810-4114-a490-c7d821d67601 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.714467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdbca-1810-4114-a490-c7d821d67601 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.715626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcdbca-1810-4114-a490-c7d821d67601 None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:42.717087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcdbca-1810-4114-a490-c7d821d67601 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:42.718831 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 73/147] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:42.719694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdbca-1810-4114-a490-c7d821d67601 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.795874 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.816116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de4aaa3-36b0-4bc2-acb0-f91a750b6775 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.838378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdbca-1810-4114-a490-c7d821d67601 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:42.854049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776171c-e829-41f1-859d-d41e962e03f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.854671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776171c-e829-41f1-859d-d41e962e03f4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.854950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776171c-e829-41f1-859d-d41e962e03f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.855219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0776171c-e829-41f1-859d-d41e962e03f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.855893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776171c-e829-41f1-859d-d41e962e03f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:42.856196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776171c-e829-41f1-859d-d41e962e03f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:42.857627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0776171c-e829-41f1-859d-d41e962e03f4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:42.869588 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 75/148] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:42.870156 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:42.870415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776171c-e829-41f1-859d-d41e962e03f4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.883710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98101fa-5448-436b-9e53-2a354dcad430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:42.884502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98101fa-5448-436b-9e53-2a354dcad430 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:42.884852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98101fa-5448-436b-9e53-2a354dcad430 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:42.885194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98101fa-5448-436b-9e53-2a354dcad430 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:42.897458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98101fa-5448-436b-9e53-2a354dcad430 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d98101fa-5448-436b-9e53-2a354dcad430 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:42.902627 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:42.903563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:42.904368 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 74/149] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:42.909743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98101fa-5448-436b-9e53-2a354dcad430 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:42.986105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0776171c-e829-41f1-859d-d41e962e03f4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.021412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f9b44-6202-4c33-a8c4-7093fd8d16c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.021972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98101fa-5448-436b-9e53-2a354dcad430 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.022072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f9b44-6202-4c33-a8c4-7093fd8d16c4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.022285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f9b44-6202-4c33-a8c4-7093fd8d16c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.022556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f9b44-6202-4c33-a8c4-7093fd8d16c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.023283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f9b44-6202-4c33-a8c4-7093fd8d16c4 None admin] RBAC: Adding query filter params (role.id=423640baf20c4b9dacb6d83f8428b6e6, scope.project.id=72848f2689d249be87482e72ba48db48, user.id=f3549895b7b24d41ab0dc5e4f0db2f98) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:43.023590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f9b44-6202-4c33-a8c4-7093fd8d16c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.025621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f9b44-6202-4c33-a8c4-7093fd8d16c4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.031726 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 76/150] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/role_assignments?user.id=f3549895b7b24d41ab0dc5e4f0db2f98&scope.project.id=72848f2689d249be87482e72ba48db48&role.id=423640baf20c4b9dacb6d83f8428b6e6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:43.031726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f9b44-6202-4c33-a8c4-7093fd8d16c4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.050672 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.075541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d958c10-37dc-4da9-aa41-cdcf6a6534cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.076599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d958c10-37dc-4da9-aa41-cdcf6a6534cd None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.076884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d958c10-37dc-4da9-aa41-cdcf6a6534cd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.077166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d958c10-37dc-4da9-aa41-cdcf6a6534cd None admin] PATH_INFO: `/v3/users/0bcfc91b7fd34fc4b8d78ff3d38c6229` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.095701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d958c10-37dc-4da9-aa41-cdcf6a6534cd None admin] RBAC: Authorizing `identity:get_user(user_id=0bcfc91b7fd34fc4b8d78ff3d38c6229)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.097256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d958c10-37dc-4da9-aa41-cdcf6a6534cd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.103765 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 75/151] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:42 2022] GET /identity/v3/users/0bcfc91b7fd34fc4b8d78ff3d38c6229 => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:43.103765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d958c10-37dc-4da9-aa41-cdcf6a6534cd None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.159970 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.163826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f9b44-6202-4c33-a8c4-7093fd8d16c4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.204958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a3c7e-ad29-4b44-b817-a0f5682fcd35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.205627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a3c7e-ad29-4b44-b817-a0f5682fcd35 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.205910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a3c7e-ad29-4b44-b817-a0f5682fcd35 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.206186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a3c7e-ad29-4b44-b817-a0f5682fcd35 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.206885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a3c7e-ad29-4b44-b817-a0f5682fcd35 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:43.207192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a3c7e-ad29-4b44-b817-a0f5682fcd35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.208619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44a3c7e-ad29-4b44-b817-a0f5682fcd35 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.219178 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 77/152] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:43.221382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a3c7e-ad29-4b44-b817-a0f5682fcd35 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.231566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d958c10-37dc-4da9-aa41-cdcf6a6534cd None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.274915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a0266-bf63-4cab-897c-762f62769c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.275564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a0266-bf63-4cab-897c-762f62769c3c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.275851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a0266-bf63-4cab-897c-762f62769c3c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.276126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7a0266-bf63-4cab-897c-762f62769c3c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.277375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a0266-bf63-4cab-897c-762f62769c3c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.278779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7a0266-bf63-4cab-897c-762f62769c3c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.280954 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 76/153] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:43.281796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a0266-bf63-4cab-897c-762f62769c3c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.310138 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.337144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a3c7e-ad29-4b44-b817-a0f5682fcd35 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.371174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee51bd-a74a-4b75-9b85-0a3bc3efda4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.371802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee51bd-a74a-4b75-9b85-0a3bc3efda4c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.372079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee51bd-a74a-4b75-9b85-0a3bc3efda4c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.372352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee51bd-a74a-4b75-9b85-0a3bc3efda4c None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.373519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee51bd-a74a-4b75-9b85-0a3bc3efda4c None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.374958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee51bd-a74a-4b75-9b85-0a3bc3efda4c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.376570 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 78/154] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:43.377329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee51bd-a74a-4b75-9b85-0a3bc3efda4c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.384167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7a0266-bf63-4cab-897c-762f62769c3c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.398476 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.419911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd1e1-4ce3-4994-bbdc-3ee00c0cd61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.420542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd1e1-4ce3-4994-bbdc-3ee00c0cd61e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.421058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd1e1-4ce3-4994-bbdc-3ee00c0cd61e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.421167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52cd1e1-4ce3-4994-bbdc-3ee00c0cd61e None admin] PATH_INFO: `/v3/users/0bcfc91b7fd34fc4b8d78ff3d38c6229` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.422244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cd1e1-4ce3-4994-bbdc-3ee00c0cd61e None admin] RBAC: Authorizing `identity:get_user(user_id=0bcfc91b7fd34fc4b8d78ff3d38c6229)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.423680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52cd1e1-4ce3-4994-bbdc-3ee00c0cd61e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.425267 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 77/155] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/users/0bcfc91b7fd34fc4b8d78ff3d38c6229 => generated 283 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:43.426057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd1e1-4ce3-4994-bbdc-3ee00c0cd61e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.478984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee51bd-a74a-4b75-9b85-0a3bc3efda4c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.513916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e12539-ad5f-46fe-8e99-01927bb40bab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.514520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e12539-ad5f-46fe-8e99-01927bb40bab None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.514801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e12539-ad5f-46fe-8e99-01927bb40bab None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.515078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e12539-ad5f-46fe-8e99-01927bb40bab None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.515731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e12539-ad5f-46fe-8e99-01927bb40bab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.517186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e12539-ad5f-46fe-8e99-01927bb40bab None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.526656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52cd1e1-4ce3-4994-bbdc-3ee00c0cd61e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.533905 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.549327 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 79/156] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:43 2022] POST /identity/v3/users => generated 297 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:43.549327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e12539-ad5f-46fe-8e99-01927bb40bab None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.572279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f6332-4126-46ca-be91-7b150d0e2b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.572954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6332-4126-46ca-be91-7b150d0e2b0f None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.573495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6332-4126-46ca-be91-7b150d0e2b0f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.573784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f6332-4126-46ca-be91-7b150d0e2b0f None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/users/0bcfc91b7fd34fc4b8d78ff3d38c6229/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.576043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f6332-4126-46ca-be91-7b150d0e2b0f None admin] RBAC: Authorizing `identity:create_grant(project_id=d847baf7ffdf4cee844beb6e1c188d1b, user_id=0bcfc91b7fd34fc4b8d78ff3d38c6229, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.577707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f6332-4126-46ca-be91-7b150d0e2b0f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.595247 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 78/157] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:43 2022] PUT /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/users/0bcfc91b7fd34fc4b8d78ff3d38c6229/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:43.676889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e12539-ad5f-46fe-8e99-01927bb40bab None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.719337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a906b80-3c39-48a2-9209-c25e1cf553bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.720337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a906b80-3c39-48a2-9209-c25e1cf553bc None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.720813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a906b80-3c39-48a2-9209-c25e1cf553bc None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.721329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a906b80-3c39-48a2-9209-c25e1cf553bc None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.722854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a906b80-3c39-48a2-9209-c25e1cf553bc None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.724696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a906b80-3c39-48a2-9209-c25e1cf553bc None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.726811 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 80/158] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:43 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:43.733261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f6332-4126-46ca-be91-7b150d0e2b0f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:43.787388 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:43.887164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f6332-4126-46ca-be91-7b150d0e2b0f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:43.940006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19096b-49b2-4c58-a407-14f486fae3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:43.940840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19096b-49b2-4c58-a407-14f486fae3e8 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:43.941235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19096b-49b2-4c58-a407-14f486fae3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:43.941692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19096b-49b2-4c58-a407-14f486fae3e8 None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/users/0bcfc91b7fd34fc4b8d78ff3d38c6229/roles/09faee4fb963419e9d5409d109523f73` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:43.944207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19096b-49b2-4c58-a407-14f486fae3e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d847baf7ffdf4cee844beb6e1c188d1b, user_id=0bcfc91b7fd34fc4b8d78ff3d38c6229, role_id=09faee4fb963419e9d5409d109523f73)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:43.946613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19096b-49b2-4c58-a407-14f486fae3e8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:43.967599 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 79/159] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:43 2022] PUT /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/users/0bcfc91b7fd34fc4b8d78ff3d38c6229/roles/09faee4fb963419e9d5409d109523f73 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:46.127376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d599bb2-f6b8-4f07-b537-72fa899ef289 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.127887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d599bb2-f6b8-4f07-b537-72fa899ef289 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.127887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d599bb2-f6b8-4f07-b537-72fa899ef289 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.129279 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 81/160] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:46.135024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b5569-8f86-4b93-b631-eae1a0787a60 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.135845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b5569-8f86-4b93-b631-eae1a0787a60 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.136270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b5569-8f86-4b93-b631-eae1a0787a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.157274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-197b5569-8f86-4b93-b631-eae1a0787a60 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:46.158863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-197b5569-8f86-4b93-b631-eae1a0787a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:46.241278 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 80/161] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:46.370608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f65d-7d7a-4541-a5af-21096ae3ca55 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.371110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f65d-7d7a-4541-a5af-21096ae3ca55 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.371601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5f65d-7d7a-4541-a5af-21096ae3ca55 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.373704 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 82/162] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:46.380817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9854-b919-4b11-b3e3-4d8b4869cf4c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.381177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9854-b919-4b11-b3e3-4d8b4869cf4c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.381585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004a9854-b919-4b11-b3e3-4d8b4869cf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.402283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-004a9854-b919-4b11-b3e3-4d8b4869cf4c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:46.403515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-004a9854-b919-4b11-b3e3-4d8b4869cf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:46.422300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1f0f4-5171-494c-8bfb-2a994e984e2b None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.422601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1f0f4-5171-494c-8bfb-2a994e984e2b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.422850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c1f0f4-5171-494c-8bfb-2a994e984e2b None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.424213 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 83/163] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:46.431139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b54e7-0022-492b-a821-d66a33496cf5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.431682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b54e7-0022-492b-a821-d66a33496cf5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.432063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14b54e7-0022-492b-a821-d66a33496cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.443771 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:46.452604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f14b54e7-0022-492b-a821-d66a33496cf5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:46.454078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f14b54e7-0022-492b-a821-d66a33496cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:46.521191 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 81/164] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:46.546019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9854-b919-4b11-b3e3-4d8b4869cf4c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:46.570040 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:46.586798 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 84/165] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:46.660997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004a9854-b919-4b11-b3e3-4d8b4869cf4c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:46.702051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6806a3-75be-493d-a2db-8968f71d17fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:46.702713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6806a3-75be-493d-a2db-8968f71d17fc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.703005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6806a3-75be-493d-a2db-8968f71d17fc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.703285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6806a3-75be-493d-a2db-8968f71d17fc None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.704519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6806a3-75be-493d-a2db-8968f71d17fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:46.706058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6806a3-75be-493d-a2db-8968f71d17fc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:46.707785 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 82/166] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:46.715378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b54e7-0022-492b-a821-d66a33496cf5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:46.880051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14b54e7-0022-492b-a821-d66a33496cf5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:46.884018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6806a3-75be-493d-a2db-8968f71d17fc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:46.918244 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:46.949947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116d08a-9113-455e-9682-d0b8ffbf2048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:46.950884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116d08a-9113-455e-9682-d0b8ffbf2048 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:46.951302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116d08a-9113-455e-9682-d0b8ffbf2048 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:46.951741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7116d08a-9113-455e-9682-d0b8ffbf2048 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:46.952786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116d08a-9113-455e-9682-d0b8ffbf2048 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:46.955263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7116d08a-9113-455e-9682-d0b8ffbf2048 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:46.993766 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 85/167] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:46 2022] POST /identity/v3/users => generated 297 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:46.993766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116d08a-9113-455e-9682-d0b8ffbf2048 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.011000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6806a3-75be-493d-a2db-8968f71d17fc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.091944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b6f59-92a0-47f1-9557-1686325fbc1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.092833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b6f59-92a0-47f1-9557-1686325fbc1d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.093249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b6f59-92a0-47f1-9557-1686325fbc1d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.093697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b6f59-92a0-47f1-9557-1686325fbc1d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.119128 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:47.121279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b6f59-92a0-47f1-9557-1686325fbc1d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-cd1b6f59-92a0-47f1-9557-1686325fbc1d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:47.133643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:47.135765 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:35:47.136569 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:47.140753 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 83/168] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:35:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:47.151570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b6f59-92a0-47f1-9557-1686325fbc1d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.223077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7116d08a-9113-455e-9682-d0b8ffbf2048 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.291661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e253d-415f-4de8-8a01-cccd93bf1e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.292490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e253d-415f-4de8-8a01-cccd93bf1e4f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.292849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e253d-415f-4de8-8a01-cccd93bf1e4f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.293660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1e253d-415f-4de8-8a01-cccd93bf1e4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.313025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1e253d-415f-4de8-8a01-cccd93bf1e4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:47.319061 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1d1e253d-415f-4de8-8a01-cccd93bf1e4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:47.321356 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:47.322276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:47.323648 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 86/169] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:47.330874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e253d-415f-4de8-8a01-cccd93bf1e4f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.341810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b6f59-92a0-47f1-9557-1686325fbc1d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.405938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dc6b0f-4ffb-41b9-8bc5-f11fa47593ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.407301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc6b0f-4ffb-41b9-8bc5-f11fa47593ef None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.407777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc6b0f-4ffb-41b9-8bc5-f11fa47593ef None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.408224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dc6b0f-4ffb-41b9-8bc5-f11fa47593ef None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.409412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc6b0f-4ffb-41b9-8bc5-f11fa47593ef None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:47.409937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc6b0f-4ffb-41b9-8bc5-f11fa47593ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:47.412495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dc6b0f-4ffb-41b9-8bc5-f11fa47593ef None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:47.430598 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 84/170] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:47.432938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02410a-e782-42c2-8653-8d7bb188bd86 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.433321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02410a-e782-42c2-8653-8d7bb188bd86 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.437629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab02410a-e782-42c2-8653-8d7bb188bd86 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.439077 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 85/171] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:47.442281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02410a-e782-42c2-8653-8d7bb188bd86 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.478341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1e253d-415f-4de8-8a01-cccd93bf1e4f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.505033 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:47.547278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa63c71-0cc0-4da9-9e3b-96fc61127e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.547939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa63c71-0cc0-4da9-9e3b-96fc61127e87 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.548720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa63c71-0cc0-4da9-9e3b-96fc61127e87 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.548999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa63c71-0cc0-4da9-9e3b-96fc61127e87 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.550282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa63c71-0cc0-4da9-9e3b-96fc61127e87 None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:47.550608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa63c71-0cc0-4da9-9e3b-96fc61127e87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:47.552378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa63c71-0cc0-4da9-9e3b-96fc61127e87 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:47.565371 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 87/172] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:47.567070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e2b4e-f51e-4f2d-8304-c4c963b04771 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.567873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e2b4e-f51e-4f2d-8304-c4c963b04771 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.568182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0e2b4e-f51e-4f2d-8304-c4c963b04771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.579590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab02410a-e782-42c2-8653-8d7bb188bd86 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.593883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5f0e2b4e-f51e-4f2d-8304-c4c963b04771 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:47.595146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5f0e2b4e-f51e-4f2d-8304-c4c963b04771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:47.627243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840d559-7636-4f7b-80bf-4f9f8f317e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.628174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840d559-7636-4f7b-80bf-4f9f8f317e65 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.628461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840d559-7636-4f7b-80bf-4f9f8f317e65 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.628739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8840d559-7636-4f7b-80bf-4f9f8f317e65 None admin] PATH_INFO: `/v3/users/0bcfc91b7fd34fc4b8d78ff3d38c6229` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.630710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840d559-7636-4f7b-80bf-4f9f8f317e65 None admin] RBAC: Authorizing `identity:get_user(user_id=0bcfc91b7fd34fc4b8d78ff3d38c6229)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:47.632742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8840d559-7636-4f7b-80bf-4f9f8f317e65 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:47.635259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 86/173] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/users/0bcfc91b7fd34fc4b8d78ff3d38c6229 => generated 283 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:47.636146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840d559-7636-4f7b-80bf-4f9f8f317e65 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.666628 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:47.696596 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 88/174] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:47.698179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e2b4e-f51e-4f2d-8304-c4c963b04771 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.774725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8840d559-7636-4f7b-80bf-4f9f8f317e65 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.835620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0e2b4e-f51e-4f2d-8304-c4c963b04771 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:47.838823 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:47.860599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a662f5c-510f-4cb1-933c-b34215b0aeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.861311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a662f5c-510f-4cb1-933c-b34215b0aeb0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.861597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a662f5c-510f-4cb1-933c-b34215b0aeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.861870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a662f5c-510f-4cb1-933c-b34215b0aeb0 None admin] PATH_INFO: `/v3/users/5b3b4784787c4a4290d9555c4ec687e1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.890395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d055bd3-06c5-46fc-aedf-6712faa1ce80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:47.891962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055bd3-06c5-46fc-aedf-6712faa1ce80 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:47.892175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055bd3-06c5-46fc-aedf-6712faa1ce80 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:47.892460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055bd3-06c5-46fc-aedf-6712faa1ce80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:47.895872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a662f5c-510f-4cb1-933c-b34215b0aeb0 None admin] RBAC: Authorizing `identity:get_user(user_id=5b3b4784787c4a4290d9555c4ec687e1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:47.899178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a662f5c-510f-4cb1-933c-b34215b0aeb0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:47.905359 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 87/175] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/users/5b3b4784787c4a4290d9555c4ec687e1 => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:47.908855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a662f5c-510f-4cb1-933c-b34215b0aeb0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:47.992215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d055bd3-06c5-46fc-aedf-6712faa1ce80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:47.994282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d055bd3-06c5-46fc-aedf-6712faa1ce80 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:48.094171 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:48.132980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a662f5c-510f-4cb1-933c-b34215b0aeb0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.153542 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 89/176] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:48.155267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d055bd3-06c5-46fc-aedf-6712faa1ce80 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.159345 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:48.212381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb495df0-38b4-4dbd-b724-2850dcc76f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.214515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb495df0-38b4-4dbd-b724-2850dcc76f3a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.215200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb495df0-38b4-4dbd-b724-2850dcc76f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.215873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb495df0-38b4-4dbd-b724-2850dcc76f3a None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.218527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb495df0-38b4-4dbd-b724-2850dcc76f3a None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:48.222666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb495df0-38b4-4dbd-b724-2850dcc76f3a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:48.226538 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 88/177] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:47 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:48.228242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb495df0-38b4-4dbd-b724-2850dcc76f3a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.345201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d055bd3-06c5-46fc-aedf-6712faa1ce80 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.382086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb495df0-38b4-4dbd-b724-2850dcc76f3a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.392297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63874b7a-66fd-4e2c-90b4-b5a663c8c927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.393064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63874b7a-66fd-4e2c-90b4-b5a663c8c927 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.393430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63874b7a-66fd-4e2c-90b4-b5a663c8c927 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.393829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63874b7a-66fd-4e2c-90b4-b5a663c8c927 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.406970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63874b7a-66fd-4e2c-90b4-b5a663c8c927 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-63874b7a-66fd-4e2c-90b4-b5a663c8c927 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:48.412031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:48.413422 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:35:48.415248 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:48.420201 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 90/178] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:35:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:48.421127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63874b7a-66fd-4e2c-90b4-b5a663c8c927 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.465372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f796e1a-20cc-4c0a-9055-45f1f206c1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.466738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f796e1a-20cc-4c0a-9055-45f1f206c1f6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.467251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f796e1a-20cc-4c0a-9055-45f1f206c1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.467940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f796e1a-20cc-4c0a-9055-45f1f206c1f6 None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.472487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f796e1a-20cc-4c0a-9055-45f1f206c1f6 None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:48.474011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f796e1a-20cc-4c0a-9055-45f1f206c1f6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:48.481638 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 89/179] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:48 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:48.482595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f796e1a-20cc-4c0a-9055-45f1f206c1f6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.505001 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:48.526568 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:48.614325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63874b7a-66fd-4e2c-90b4-b5a663c8c927 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.628487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f796e1a-20cc-4c0a-9055-45f1f206c1f6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.669529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c267a-01f4-4665-8ae2-e7b4a5b567fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.670152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c267a-01f4-4665-8ae2-e7b4a5b567fe None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.670569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c267a-01f4-4665-8ae2-e7b4a5b567fe None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.670842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93c267a-01f4-4665-8ae2-e7b4a5b567fe None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.671660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c267a-01f4-4665-8ae2-e7b4a5b567fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:48.671957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c267a-01f4-4665-8ae2-e7b4a5b567fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:48.673365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93c267a-01f4-4665-8ae2-e7b4a5b567fe None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:48.682537 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 90/180] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:35:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:48.683386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c267a-01f4-4665-8ae2-e7b4a5b567fe None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.690085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455832e-52aa-4fa6-a379-c9d28a02d668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.691854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455832e-52aa-4fa6-a379-c9d28a02d668 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.692742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455832e-52aa-4fa6-a379-c9d28a02d668 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.693535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a455832e-52aa-4fa6-a379-c9d28a02d668 None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/users/5b3b4784787c4a4290d9555c4ec687e1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.698054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455832e-52aa-4fa6-a379-c9d28a02d668 None admin] RBAC: Authorizing `identity:create_grant(project_id=d847baf7ffdf4cee844beb6e1c188d1b, user_id=5b3b4784787c4a4290d9555c4ec687e1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:48.701062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a455832e-52aa-4fa6-a379-c9d28a02d668 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:48.731653 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 91/181] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:48 2022] PUT /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/users/5b3b4784787c4a4290d9555c4ec687e1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:48.734215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455832e-52aa-4fa6-a379-c9d28a02d668 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:48.821256 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:48.885119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93c267a-01f4-4665-8ae2-e7b4a5b567fe None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:48.959190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0c9bc-564d-4a71-a871-cb955144d91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:48.959658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0c9bc-564d-4a71-a871-cb955144d91d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:48.959807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0c9bc-564d-4a71-a871-cb955144d91d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:48.960077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d0c9bc-564d-4a71-a871-cb955144d91d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:48.960826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0c9bc-564d-4a71-a871-cb955144d91d None admin] RBAC: Adding query filter params (role.id=d266f03406d94df8bb9cad19b577978f, scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b, user.id=0bcfc91b7fd34fc4b8d78ff3d38c6229) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:48.961136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0c9bc-564d-4a71-a871-cb955144d91d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:48.963152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d0c9bc-564d-4a71-a871-cb955144d91d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:48.972470 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 91/182] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:48 2022] GET /identity/v3/role_assignments?user.id=0bcfc91b7fd34fc4b8d78ff3d38c6229&scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b&role.id=d266f03406d94df8bb9cad19b577978f => generated 608 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:48.996408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a455832e-52aa-4fa6-a379-c9d28a02d668 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:49.048295 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:49.071274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3da8b-3257-4ce2-b738-88f8a9609c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:49.072371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3da8b-3257-4ce2-b738-88f8a9609c50 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.073592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3da8b-3257-4ce2-b738-88f8a9609c50 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.074477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3da8b-3257-4ce2-b738-88f8a9609c50 None admin] PATH_INFO: `/v3/users/0bcfc91b7fd34fc4b8d78ff3d38c6229` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.076758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3da8b-3257-4ce2-b738-88f8a9609c50 None admin] RBAC: Authorizing `identity:get_user(user_id=0bcfc91b7fd34fc4b8d78ff3d38c6229)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:49.079758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef3da8b-3257-4ce2-b738-88f8a9609c50 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:49.087302 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 92/183] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:48 2022] GET /identity/v3/users/0bcfc91b7fd34fc4b8d78ff3d38c6229 => generated 283 bytes in 355 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:49.093907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0c9bc-564d-4a71-a871-cb955144d91d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:49.317695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d0c9bc-564d-4a71-a871-cb955144d91d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:49.388540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4f4934-06b6-4aed-a531-e3f276308a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:49.389606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f4934-06b6-4aed-a531-e3f276308a63 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.390068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f4934-06b6-4aed-a531-e3f276308a63 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.390560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4f4934-06b6-4aed-a531-e3f276308a63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.412962 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:49.545333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f4934-06b6-4aed-a531-e3f276308a63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:49.548182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4f4934-06b6-4aed-a531-e3f276308a63 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:49.753049 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 92/184] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:49.761969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3da8b-3257-4ce2-b738-88f8a9609c50 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:49.915738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92502d-616f-4615-881c-bc7c006dd87d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.916214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92502d-616f-4615-881c-bc7c006dd87d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.916701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd92502d-616f-4615-881c-bc7c006dd87d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.920406 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 93/185] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:49.926815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905116c-5af5-4f68-a352-ae2743dc9c6f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:49.927203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905116c-5af5-4f68-a352-ae2743dc9c6f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:49.927494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a905116c-5af5-4f68-a352-ae2743dc9c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:49.948957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a905116c-5af5-4f68-a352-ae2743dc9c6f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:49.950404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a905116c-5af5-4f68-a352-ae2743dc9c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:49.981752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3da8b-3257-4ce2-b738-88f8a9609c50 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.007084 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.031071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd1f28-f251-41fc-a589-f7fbfec0bb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.031813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd1f28-f251-41fc-a589-f7fbfec0bb83 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.032095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd1f28-f251-41fc-a589-f7fbfec0bb83 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.032372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dd1f28-f251-41fc-a589-f7fbfec0bb83 None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.033726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd1f28-f251-41fc-a589-f7fbfec0bb83 None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.035228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dd1f28-f251-41fc-a589-f7fbfec0bb83 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.041483 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 93/186] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:49 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:50.043877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd1f28-f251-41fc-a589-f7fbfec0bb83 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.089997 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 94/187] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:35:50.123613 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.174987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dd1f28-f251-41fc-a589-f7fbfec0bb83 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.181543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838f5b-dedc-401c-b7e7-ca21d668ab06 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.181833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838f5b-dedc-401c-b7e7-ca21d668ab06 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.182102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8838f5b-dedc-401c-b7e7-ca21d668ab06 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.183685 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 95/188] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:50.189238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0f97-4eeb-467d-9dcc-69270a3c4b52 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.189547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0f97-4eeb-467d-9dcc-69270a3c4b52 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.189829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0f97-4eeb-467d-9dcc-69270a3c4b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.210431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-947d0f97-4eeb-467d-9dcc-69270a3c4b52 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:50.211875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-947d0f97-4eeb-467d-9dcc-69270a3c4b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:50.241359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efa97b-19c7-4c4c-9b60-16acb90c2f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.243750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa97b-19c7-4c4c-9b60-16acb90c2f45 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.244837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa97b-19c7-4c4c-9b60-16acb90c2f45 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.245802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01efa97b-19c7-4c4c-9b60-16acb90c2f45 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.248237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efa97b-19c7-4c4c-9b60-16acb90c2f45 None admin] RBAC: Adding query filter params (role.id=09faee4fb963419e9d5409d109523f73, scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b, user.id=0bcfc91b7fd34fc4b8d78ff3d38c6229) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:50.249282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efa97b-19c7-4c4c-9b60-16acb90c2f45 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.253182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01efa97b-19c7-4c4c-9b60-16acb90c2f45 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.268577 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 94/189] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/role_assignments?user.id=0bcfc91b7fd34fc4b8d78ff3d38c6229&scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b&role.id=09faee4fb963419e9d5409d109523f73 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:50.319568 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 96/190] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:50.425200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efa97b-19c7-4c4c-9b60-16acb90c2f45 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.569834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01efa97b-19c7-4c4c-9b60-16acb90c2f45 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.602619 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.616841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa77fc-71f5-4dac-880d-d52e5ca46efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.618110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa77fc-71f5-4dac-880d-d52e5ca46efd None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.618409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa77fc-71f5-4dac-880d-d52e5ca46efd None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.618683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fa77fc-71f5-4dac-880d-d52e5ca46efd None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.619953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa77fc-71f5-4dac-880d-d52e5ca46efd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.621505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fa77fc-71f5-4dac-880d-d52e5ca46efd None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.625346 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 95/191] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:50.631798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0f97-4eeb-467d-9dcc-69270a3c4b52 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.647633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa77fc-71f5-4dac-880d-d52e5ca46efd None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:50.775143 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:50.780806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0f97-4eeb-467d-9dcc-69270a3c4b52 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.788796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fa77fc-71f5-4dac-880d-d52e5ca46efd None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:50.824598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004f20c-0391-4af9-a7b7-0c2ddf6e2fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.825192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004f20c-0391-4af9-a7b7-0c2ddf6e2fab None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.825419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004f20c-0391-4af9-a7b7-0c2ddf6e2fab None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.825707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004f20c-0391-4af9-a7b7-0c2ddf6e2fab None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.826376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004f20c-0391-4af9-a7b7-0c2ddf6e2fab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:50.827836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004f20c-0391-4af9-a7b7-0c2ddf6e2fab None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:50.851002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb25409-420b-42dd-8766-7bc2ad331024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:50.852621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb25409-420b-42dd-8766-7bc2ad331024 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:50.853421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb25409-420b-42dd-8766-7bc2ad331024 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:50.853599 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 97/192] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:50 2022] POST /identity/v3/users => generated 293 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:35:50.853733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb25409-420b-42dd-8766-7bc2ad331024 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:50.879641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb25409-420b-42dd-8766-7bc2ad331024 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-5fb25409-420b-42dd-8766-7bc2ad331024 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:50.890031 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:50.891824 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:50.893498 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 96/193] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:50.904943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004f20c-0391-4af9-a7b7-0c2ddf6e2fab None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.108881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004f20c-0391-4af9-a7b7-0c2ddf6e2fab None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.171993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdb04c3-bb49-461b-a1e6-706966b3f736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.172641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb04c3-bb49-461b-a1e6-706966b3f736 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.173056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb04c3-bb49-461b-a1e6-706966b3f736 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.173546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdb04c3-bb49-461b-a1e6-706966b3f736 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.174431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb04c3-bb49-461b-a1e6-706966b3f736 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:51.174869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb04c3-bb49-461b-a1e6-706966b3f736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.177252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdb04c3-bb49-461b-a1e6-706966b3f736 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.194665 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 98/194] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:51.204341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb25409-420b-42dd-8766-7bc2ad331024 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.286360 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:51.302241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d241-48a5-44b6-955a-699c0c9d58fe None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.302557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d241-48a5-44b6-955a-699c0c9d58fe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.303276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe0d241-48a5-44b6-955a-699c0c9d58fe None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.304379 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 99/195] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:51.315834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7f22-7107-4892-a837-b6d5afbd82c5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.315834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7f22-7107-4892-a837-b6d5afbd82c5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.316116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c7f22-7107-4892-a837-b6d5afbd82c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.352727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-682c7f22-7107-4892-a837-b6d5afbd82c5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:51.354599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-682c7f22-7107-4892-a837-b6d5afbd82c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:51.360383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb25409-420b-42dd-8766-7bc2ad331024 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.384274 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:51.421029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c596-14b6-4c3b-82dc-0d915183df42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.422138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c596-14b6-4c3b-82dc-0d915183df42 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.422648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c596-14b6-4c3b-82dc-0d915183df42 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.423145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9492c596-14b6-4c3b-82dc-0d915183df42 None admin] PATH_INFO: `/v3/users/eca662f5fc9a4efea3c81872d55095fa` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.446648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492c596-14b6-4c3b-82dc-0d915183df42 None admin] RBAC: Authorizing `identity:get_user(user_id=eca662f5fc9a4efea3c81872d55095fa)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.449395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9492c596-14b6-4c3b-82dc-0d915183df42 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.453483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 100/197] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:51.460151 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 97/197] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/users/eca662f5fc9a4efea3c81872d55095fa => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:51.466398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c7f22-7107-4892-a837-b6d5afbd82c5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.650844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c7f22-7107-4892-a837-b6d5afbd82c5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.713829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49643c2c-2021-47e5-8e15-298af272cf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:51.715339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49643c2c-2021-47e5-8e15-298af272cf13 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:51.716056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49643c2c-2021-47e5-8e15-298af272cf13 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:51.716765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49643c2c-2021-47e5-8e15-298af272cf13 None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:51.719079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49643c2c-2021-47e5-8e15-298af272cf13 None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:51.722244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49643c2c-2021-47e5-8e15-298af272cf13 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:51.725985 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 101/198] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:51.727575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c596-14b6-4c3b-82dc-0d915183df42 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.732084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49643c2c-2021-47e5-8e15-298af272cf13 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:51.754413 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:51.945048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49643c2c-2021-47e5-8e15-298af272cf13 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.947856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9492c596-14b6-4c3b-82dc-0d915183df42 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:51.971488 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:52.015342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ba60c-2c72-49c5-8f14-4c54c39cdef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.016830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba60c-2c72-49c5-8f14-4c54c39cdef1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.017534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba60c-2c72-49c5-8f14-4c54c39cdef1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.017910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a41aa3-802a-4e3a-a9b1-8b238583e08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.018453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2ba60c-2c72-49c5-8f14-4c54c39cdef1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.018977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a41aa3-802a-4e3a-a9b1-8b238583e08c None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.019460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a41aa3-802a-4e3a-a9b1-8b238583e08c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.019944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a41aa3-802a-4e3a-a9b1-8b238583e08c None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/users/eca662f5fc9a4efea3c81872d55095fa/roles/423640baf20c4b9dacb6d83f8428b6e6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.023709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a41aa3-802a-4e3a-a9b1-8b238583e08c None admin] RBAC: Authorizing `identity:create_grant(project_id=d847baf7ffdf4cee844beb6e1c188d1b, user_id=eca662f5fc9a4efea3c81872d55095fa, role_id=423640baf20c4b9dacb6d83f8428b6e6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:52.027007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a41aa3-802a-4e3a-a9b1-8b238583e08c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:52.041165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2ba60c-2c72-49c5-8f14-4c54c39cdef1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-fc2ba60c-2c72-49c5-8f14-4c54c39cdef1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:52.051651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:52.053926 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:52.056310 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:52.057627 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 102/199] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:35:51 2022] PUT /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/users/eca662f5fc9a4efea3c81872d55095fa/roles/423640baf20c4b9dacb6d83f8428b6e6 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:52.060747 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 98/200] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:52.072454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a41aa3-802a-4e3a-a9b1-8b238583e08c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:52.198092 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:52.246416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a41aa3-802a-4e3a-a9b1-8b238583e08c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:52.311236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31908c10-7a52-4117-87f2-43da9a58dec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.311849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31908c10-7a52-4117-87f2-43da9a58dec0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.312124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31908c10-7a52-4117-87f2-43da9a58dec0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.312393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31908c10-7a52-4117-87f2-43da9a58dec0 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.313060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31908c10-7a52-4117-87f2-43da9a58dec0 None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:52.314885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31908c10-7a52-4117-87f2-43da9a58dec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:52.314885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31908c10-7a52-4117-87f2-43da9a58dec0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:52.325353 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 103/201] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:52.331023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ba60c-2c72-49c5-8f14-4c54c39cdef1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:52.494284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2ba60c-2c72-49c5-8f14-4c54c39cdef1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:52.553466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444e30f-7239-4e55-83b5-78c09e96b55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.554517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444e30f-7239-4e55-83b5-78c09e96b55b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.555014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444e30f-7239-4e55-83b5-78c09e96b55b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.555570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444e30f-7239-4e55-83b5-78c09e96b55b None admin] PATH_INFO: `/v3/users/5b3b4784787c4a4290d9555c4ec687e1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.557666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444e30f-7239-4e55-83b5-78c09e96b55b None admin] RBAC: Authorizing `identity:get_user(user_id=5b3b4784787c4a4290d9555c4ec687e1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:52.560330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b444e30f-7239-4e55-83b5-78c09e96b55b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:52.563400 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 99/202] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:52 2022] GET /identity/v3/users/5b3b4784787c4a4290d9555c4ec687e1 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:52.569278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31908c10-7a52-4117-87f2-43da9a58dec0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:52.679177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31908c10-7a52-4117-87f2-43da9a58dec0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:52.715706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d62d3-4cbf-42e2-a163-b0807412ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:52.716319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d62d3-4cbf-42e2-a163-b0807412ba60 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:52.716594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d62d3-4cbf-42e2-a163-b0807412ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:52.716939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d62d3-4cbf-42e2-a163-b0807412ba60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:52.732545 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:52.830444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d62d3-4cbf-42e2-a163-b0807412ba60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:52.831828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47d62d3-4cbf-42e2-a163-b0807412ba60 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:52.949615 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 104/203] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:35:52.958410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444e30f-7239-4e55-83b5-78c09e96b55b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.040001 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:53.163880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b444e30f-7239-4e55-83b5-78c09e96b55b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:53.236009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962ef82-9925-4503-b91f-f05e452e7af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:53.237121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962ef82-9925-4503-b91f-f05e452e7af2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.237919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962ef82-9925-4503-b91f-f05e452e7af2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.238409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962ef82-9925-4503-b91f-f05e452e7af2 None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.240708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962ef82-9925-4503-b91f-f05e452e7af2 None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:53.243799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962ef82-9925-4503-b91f-f05e452e7af2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:53.247789 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 100/204] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:52 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:53.257402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d62d3-4cbf-42e2-a163-b0807412ba60 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:53.319476 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:53.391180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47d62d3-4cbf-42e2-a163-b0807412ba60 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:53.427951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299ec03-6cb0-4854-89c4-2cd6ba605968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:53.428476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299ec03-6cb0-4854-89c4-2cd6ba605968 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.428744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299ec03-6cb0-4854-89c4-2cd6ba605968 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.429015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299ec03-6cb0-4854-89c4-2cd6ba605968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.429805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299ec03-6cb0-4854-89c4-2cd6ba605968 None admin] RBAC: Adding query filter params (role.id=62bc91fd2a7048c3ad90e2802bdc487f, scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b, user.id=5b3b4784787c4a4290d9555c4ec687e1) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:53.430110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299ec03-6cb0-4854-89c4-2cd6ba605968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:53.431780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299ec03-6cb0-4854-89c4-2cd6ba605968 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:53.439056 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 105/205] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:53 2022] GET /identity/v3/role_assignments?user.id=5b3b4784787c4a4290d9555c4ec687e1&scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b&role.id=62bc91fd2a7048c3ad90e2802bdc487f => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:53.972188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26815a-319e-48ac-8e33-3f92f31b9222 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.972964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26815a-319e-48ac-8e33-3f92f31b9222 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.972964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26815a-319e-48ac-8e33-3f92f31b9222 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:53.974116 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 101/206] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:53.980602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481c704-f81f-4d79-a833-9a49d3b3dbb5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:53.981106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481c704-f81f-4d79-a833-9a49d3b3dbb5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:53.981181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481c704-f81f-4d79-a833-9a49d3b3dbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.000965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f481c704-f81f-4d79-a833-9a49d3b3dbb5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:54.002208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f481c704-f81f-4d79-a833-9a49d3b3dbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:54.080710 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 106/207] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:54.356446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a59a92-14c8-419f-bac9-f9229c34002f None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.357009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a59a92-14c8-419f-bac9-f9229c34002f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.357466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a59a92-14c8-419f-bac9-f9229c34002f None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.360431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481c704-f81f-4d79-a833-9a49d3b3dbb5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.360696 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 102/208] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:54.370351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1009-0ac3-4bc2-b85a-34a5950c4d95 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.370852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1009-0ac3-4bc2-b85a-34a5950c4d95 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.371347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c1009-0ac3-4bc2-b85a-34a5950c4d95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.401951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dc2c1009-0ac3-4bc2-b85a-34a5950c4d95 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:54.403165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dc2c1009-0ac3-4bc2-b85a-34a5950c4d95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:54.404202 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.506689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481c704-f81f-4d79-a833-9a49d3b3dbb5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.509333 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 103/209] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:54.570678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f3f54-0794-4297-81fe-84b8653a5dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.572337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f3f54-0794-4297-81fe-84b8653a5dd1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.572787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f3f54-0794-4297-81fe-84b8653a5dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.573274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f3f54-0794-4297-81fe-84b8653a5dd1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.591762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f3f54-0794-4297-81fe-84b8653a5dd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-981f3f54-0794-4297-81fe-84b8653a5dd1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:54.601552 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:54.603050 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:54.603941 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:54.606123 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 107/210] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:54.610550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c1009-0ac3-4bc2-b85a-34a5950c4d95 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.651377 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.729139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c1009-0ac3-4bc2-b85a-34a5950c4d95 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:54.769101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09331550-12ca-4996-957f-3196f63a5f3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:54.769734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09331550-12ca-4996-957f-3196f63a5f3f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:54.770001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09331550-12ca-4996-957f-3196f63a5f3f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:54.770275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09331550-12ca-4996-957f-3196f63a5f3f None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:54.770945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09331550-12ca-4996-957f-3196f63a5f3f None admin] RBAC: Adding query filter params (name=member) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:54.771243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09331550-12ca-4996-957f-3196f63a5f3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:54.772645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09331550-12ca-4996-957f-3196f63a5f3f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:54.782624 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 104/211] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:54.789120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f3f54-0794-4297-81fe-84b8653a5dd1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:54.956330 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:54.969898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f3f54-0794-4297-81fe-84b8653a5dd1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:55.006512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09331550-12ca-4996-957f-3196f63a5f3f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.019440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9566-abd4-4990-993d-76edef4b658c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:55.021072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9566-abd4-4990-993d-76edef4b658c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.021604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9566-abd4-4990-993d-76edef4b658c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.022555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9566-abd4-4990-993d-76edef4b658c None admin] PATH_INFO: `/v3/users/5eb1df81aeee4577ac06c0522fd15276` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.046860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db9566-abd4-4990-993d-76edef4b658c None admin] RBAC: Authorizing `identity:get_user(user_id=5eb1df81aeee4577ac06c0522fd15276)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:55.048429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db9566-abd4-4990-993d-76edef4b658c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:55.053544 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 108/212] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:54 2022] GET /identity/v3/users/5eb1df81aeee4577ac06c0522fd15276 => generated 293 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:55.059457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9566-abd4-4990-993d-76edef4b658c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.166332 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:55.170284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09331550-12ca-4996-957f-3196f63a5f3f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:55.214573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c1974-0735-42ee-b4c4-72a928105ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:55.215561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c1974-0735-42ee-b4c4-72a928105ece None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.216049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c1974-0735-42ee-b4c4-72a928105ece None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.216524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4c1974-0735-42ee-b4c4-72a928105ece None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.218752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c1974-0735-42ee-b4c4-72a928105ece None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:55.221615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4c1974-0735-42ee-b4c4-72a928105ece None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:55.225042 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 105/213] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:55.234133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c1974-0735-42ee-b4c4-72a928105ece None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.243779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9566-abd4-4990-993d-76edef4b658c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:55.284483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4de0a32-1c37-4707-8e0e-314638d3b477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:55.285079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de0a32-1c37-4707-8e0e-314638d3b477 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.285380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de0a32-1c37-4707-8e0e-314638d3b477 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.285650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4de0a32-1c37-4707-8e0e-314638d3b477 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.286371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de0a32-1c37-4707-8e0e-314638d3b477 None admin] RBAC: Adding query filter params (role.id=62bc91fd2a7048c3ad90e2802bdc487f, user.id=5eb1df81aeee4577ac06c0522fd15276, scope.system=all) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:55.286676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de0a32-1c37-4707-8e0e-314638d3b477 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:55.288139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4de0a32-1c37-4707-8e0e-314638d3b477 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:55.293556 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 109/214] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Oct 24 08:35:55 2022] GET /identity/v3/role_assignments?user.id=5eb1df81aeee4577ac06c0522fd15276&scope.system=all&role.id=62bc91fd2a7048c3ad90e2802bdc487f => generated 226 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:55.439431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4c1974-0735-42ee-b4c4-72a928105ece None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:55.505257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62a6028-9521-474b-a67c-50dc5644a366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:55.506200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6028-9521-474b-a67c-50dc5644a366 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.506645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6028-9521-474b-a67c-50dc5644a366 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.507095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62a6028-9521-474b-a67c-50dc5644a366 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.508234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a6028-9521-474b-a67c-50dc5644a366 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:55.511342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62a6028-9521-474b-a67c-50dc5644a366 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:55.546282 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 106/215] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:35:55 2022] POST /identity/v3/users => generated 293 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:35:55.566149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d64096-75c0-405c-ba19-8f30c9232cab None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.566526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d64096-75c0-405c-ba19-8f30c9232cab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.566874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d64096-75c0-405c-ba19-8f30c9232cab None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.568535 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 110/216] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:55.574967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e7dea-0b4f-4f54-88b4-1fc7c8331d9a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:55.575264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e7dea-0b4f-4f54-88b4-1fc7c8331d9a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:55.575523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339e7dea-0b4f-4f54-88b4-1fc7c8331d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:55.597195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-339e7dea-0b4f-4f54-88b4-1fc7c8331d9a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:55.598465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-339e7dea-0b4f-4f54-88b4-1fc7c8331d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:55.619994 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:55.682426 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 107/217] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:55.954898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d64096-75c0-405c-ba19-8f30c9232cab None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:55.984062 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:56.151657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d64096-75c0-405c-ba19-8f30c9232cab None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.219650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371f2e7-9e29-488a-b15c-67c9f1caf39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.220663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371f2e7-9e29-488a-b15c-67c9f1caf39a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.221171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371f2e7-9e29-488a-b15c-67c9f1caf39a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.221794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371f2e7-9e29-488a-b15c-67c9f1caf39a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.243687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371f2e7-9e29-488a-b15c-67c9f1caf39a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a371f2e7-9e29-488a-b15c-67c9f1caf39a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:56.253887 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:56.254808 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:56.255589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:56.257329 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 111/218] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:56.267980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e7dea-0b4f-4f54-88b4-1fc7c8331d9a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:56.456500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339e7dea-0b4f-4f54-88b4-1fc7c8331d9a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.519410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7a4d1-3604-42bf-97a5-54a592c4ec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.520841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7a4d1-3604-42bf-97a5-54a592c4ec08 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.521626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7a4d1-3604-42bf-97a5-54a592c4ec08 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.522370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7a4d1-3604-42bf-97a5-54a592c4ec08 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.524533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7a4d1-3604-42bf-97a5-54a592c4ec08 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:56.525461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7a4d1-3604-42bf-97a5-54a592c4ec08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:56.528379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a7a4d1-3604-42bf-97a5-54a592c4ec08 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:56.544739 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 108/219] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:56.553266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371f2e7-9e29-488a-b15c-67c9f1caf39a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:56.698489 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:56.741888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371f2e7-9e29-488a-b15c-67c9f1caf39a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:56.810758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253ff36-910f-4218-823a-dc250aeac31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:56.811695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ff36-910f-4218-823a-dc250aeac31f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:56.812169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ff36-910f-4218-823a-dc250aeac31f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:56.812658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2253ff36-910f-4218-823a-dc250aeac31f None admin] PATH_INFO: `/v3/users/eca662f5fc9a4efea3c81872d55095fa` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:56.814946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253ff36-910f-4218-823a-dc250aeac31f None admin] RBAC: Authorizing `identity:get_user(user_id=eca662f5fc9a4efea3c81872d55095fa)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:56.817836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2253ff36-910f-4218-823a-dc250aeac31f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:56.821538 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 112/220] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:56 2022] GET /identity/v3/users/eca662f5fc9a4efea3c81872d55095fa => generated 297 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:56.830111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7a4d1-3604-42bf-97a5-54a592c4ec08 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:56.860676 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:57.009774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7a4d1-3604-42bf-97a5-54a592c4ec08 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:57.048424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22976e-0c7a-45a9-a265-961cd73f5131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:57.049048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22976e-0c7a-45a9-a265-961cd73f5131 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.049351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22976e-0c7a-45a9-a265-961cd73f5131 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.049630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b22976e-0c7a-45a9-a265-961cd73f5131 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.175741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22976e-0c7a-45a9-a265-961cd73f5131 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:57.178548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b22976e-0c7a-45a9-a265-961cd73f5131 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:57.206887 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:57.324613 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 109/221] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:35:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 08:35:57.330785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253ff36-910f-4218-823a-dc250aeac31f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:57.450028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2253ff36-910f-4218-823a-dc250aeac31f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:57.490885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d05a732-ce24-40fa-942a-cb6370661ba1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:57.491540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05a732-ce24-40fa-942a-cb6370661ba1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.491816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05a732-ce24-40fa-942a-cb6370661ba1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.492090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d05a732-ce24-40fa-942a-cb6370661ba1 None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.493891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05a732-ce24-40fa-942a-cb6370661ba1 None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:57.495368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d05a732-ce24-40fa-942a-cb6370661ba1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:57.501619 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 113/222] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:35:57 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:57.504804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22976e-0c7a-45a9-a265-961cd73f5131 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:57.678503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b22976e-0c7a-45a9-a265-961cd73f5131 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:57.702532 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:57.728852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa698cc0-92c7-4630-a711-c5b120d90310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:57.729557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa698cc0-92c7-4630-a711-c5b120d90310 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.729836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa698cc0-92c7-4630-a711-c5b120d90310 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.730112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa698cc0-92c7-4630-a711-c5b120d90310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.730856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa698cc0-92c7-4630-a711-c5b120d90310 None admin] RBAC: Adding query filter params (role.id=423640baf20c4b9dacb6d83f8428b6e6, scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b, user.id=eca662f5fc9a4efea3c81872d55095fa) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:57.731169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa698cc0-92c7-4630-a711-c5b120d90310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:57.732647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa698cc0-92c7-4630-a711-c5b120d90310 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:57.741638 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 110/223] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:35:57 2022] GET /identity/v3/role_assignments?user.id=eca662f5fc9a4efea3c81872d55095fa&scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b&role.id=423640baf20c4b9dacb6d83f8428b6e6 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:57.986086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041975-1d0a-43d3-a222-90a8202c3fa0 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.986280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041975-1d0a-43d3-a222-90a8202c3fa0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.986540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b041975-1d0a-43d3-a222-90a8202c3fa0 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:57.990061 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 114/224] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:35:57.997709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e0179-0a23-48a4-8875-2d9669bd5c4c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:57.998004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e0179-0a23-48a4-8875-2d9669bd5c4c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:57.998266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e0179-0a23-48a4-8875-2d9669bd5c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.018555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f70e0179-0a23-48a4-8875-2d9669bd5c4c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:58.019773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f70e0179-0a23-48a4-8875-2d9669bd5c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:58.111104 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 111/225] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:58.203931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447aa7d-81d0-4b01-9e21-9accfb83a430 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.204236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447aa7d-81d0-4b01-9e21-9accfb83a430 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.204739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8447aa7d-81d0-4b01-9e21-9accfb83a430 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.206504 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 115/226] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:58.212825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364ce86-0b0c-42d8-8db7-f11e1642d6f4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.213358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364ce86-0b0c-42d8-8db7-f11e1642d6f4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.213810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0364ce86-0b0c-42d8-8db7-f11e1642d6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.234941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0364ce86-0b0c-42d8-8db7-f11e1642d6f4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:58.236524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0364ce86-0b0c-42d8-8db7-f11e1642d6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:58.322345 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 112/227] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:58.405677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447aa7d-81d0-4b01-9e21-9accfb83a430 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.423571 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:58.530077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8447aa7d-81d0-4b01-9e21-9accfb83a430 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.570527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc788a1-51ce-4f2d-ac07-13bf41a4a23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.571738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc788a1-51ce-4f2d-ac07-13bf41a4a23a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.572016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc788a1-51ce-4f2d-ac07-13bf41a4a23a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.572284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc788a1-51ce-4f2d-ac07-13bf41a4a23a None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.584415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc788a1-51ce-4f2d-ac07-13bf41a4a23a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-cdc788a1-51ce-4f2d-ac07-13bf41a4a23a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:58.589442 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:58.591074 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:35:58.593010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:35:58.594240 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 116/228] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:35:58.599617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc788a1-51ce-4f2d-ac07-13bf41a4a23a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.599889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364ce86-0b0c-42d8-8db7-f11e1642d6f4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.655825 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:58.702669 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:58.732209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0364ce86-0b0c-42d8-8db7-f11e1642d6f4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.741586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc788a1-51ce-4f2d-ac07-13bf41a4a23a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.776242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeaab1-4d16-4bfc-9ea9-d62f152f7337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.776878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeaab1-4d16-4bfc-9ea9-d62f152f7337 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.777156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeaab1-4d16-4bfc-9ea9-d62f152f7337 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.777460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebeaab1-4d16-4bfc-9ea9-d62f152f7337 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.789417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebeaab1-4d16-4bfc-9ea9-d62f152f7337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-cebeaab1-4d16-4bfc-9ea9-d62f152f7337 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:35:58.794459 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:35:58.795412 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:35:58.796216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:35:58.796860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013477-8dbb-4cfa-a572-00518188484e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.796947 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 113/229] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:35:58.797014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013477-8dbb-4cfa-a572-00518188484e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.797014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013477-8dbb-4cfa-a572-00518188484e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.797014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a013477-8dbb-4cfa-a572-00518188484e None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.798204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013477-8dbb-4cfa-a572-00518188484e None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:58.798787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013477-8dbb-4cfa-a572-00518188484e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:58.801120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a013477-8dbb-4cfa-a572-00518188484e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:58.803276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeaab1-4d16-4bfc-9ea9-d62f152f7337 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.824333 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 117/230] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:58.826004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013477-8dbb-4cfa-a572-00518188484e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:58.936765 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:58.942158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebeaab1-4d16-4bfc-9ea9-d62f152f7337 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.980370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a013477-8dbb-4cfa-a572-00518188484e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:58.984803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660fb4-ae55-4c5e-9af3-0b72beb25093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:58.985509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660fb4-ae55-4c5e-9af3-0b72beb25093 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:58.985858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660fb4-ae55-4c5e-9af3-0b72beb25093 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:58.986144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22660fb4-ae55-4c5e-9af3-0b72beb25093 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:58.986885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22660fb4-ae55-4c5e-9af3-0b72beb25093 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:58.987201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22660fb4-ae55-4c5e-9af3-0b72beb25093 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:58.988912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22660fb4-ae55-4c5e-9af3-0b72beb25093 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:58.999410 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 114/231] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:59.005198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660fb4-ae55-4c5e-9af3-0b72beb25093 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.032692 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:59.040786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292d4e3-fbdc-4943-8eac-7150fa50d502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.041710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292d4e3-fbdc-4943-8eac-7150fa50d502 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.042138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292d4e3-fbdc-4943-8eac-7150fa50d502 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.042567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292d4e3-fbdc-4943-8eac-7150fa50d502 None admin] PATH_INFO: `/v3/users/5eb1df81aeee4577ac06c0522fd15276` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.044473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292d4e3-fbdc-4943-8eac-7150fa50d502 None admin] RBAC: Authorizing `identity:get_user(user_id=5eb1df81aeee4577ac06c0522fd15276)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.046986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7292d4e3-fbdc-4943-8eac-7150fa50d502 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.049777 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 118/232] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:58 2022] GET /identity/v3/users/5eb1df81aeee4577ac06c0522fd15276 => generated 293 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:59.051908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0626-6d39-4e42-b42c-ff7968ddcd93 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.052351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0626-6d39-4e42-b42c-ff7968ddcd93 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.052777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17d0626-6d39-4e42-b42c-ff7968ddcd93 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.055442 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 119/233] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:35:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:35:59.056656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d0626-6d39-4e42-b42c-ff7968ddcd93 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.148295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22660fb4-ae55-4c5e-9af3-0b72beb25093 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.188595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17d0626-6d39-4e42-b42c-ff7968ddcd93 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.189836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e0c6d3-cffc-4e22-ae4e-d47dbd9675a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.190620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0c6d3-cffc-4e22-ae4e-d47dbd9675a3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.191076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0c6d3-cffc-4e22-ae4e-d47dbd9675a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.191505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e0c6d3-cffc-4e22-ae4e-d47dbd9675a3 None admin] PATH_INFO: `/v3/users/695e80b22e304a7781fa7cf68d5517fa` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.207727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0c6d3-cffc-4e22-ae4e-d47dbd9675a3 None admin] RBAC: Authorizing `identity:get_user(user_id=695e80b22e304a7781fa7cf68d5517fa)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.209204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e0c6d3-cffc-4e22-ae4e-d47dbd9675a3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.210938 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 115/234] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:35:59 2022] GET /identity/v3/users/695e80b22e304a7781fa7cf68d5517fa => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:59.212194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9110ae-093e-4e5e-976f-c923a89c5613 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.212475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9110ae-093e-4e5e-976f-c923a89c5613 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.212738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9110ae-093e-4e5e-976f-c923a89c5613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.230627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41b965-895b-49bb-b5be-0fcfb1518af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.231279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41b965-895b-49bb-b5be-0fcfb1518af1 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.231552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41b965-895b-49bb-b5be-0fcfb1518af1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.231644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2d9110ae-093e-4e5e-976f-c923a89c5613 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:35:59.231827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa41b965-895b-49bb-b5be-0fcfb1518af1 None admin] PATH_INFO: `/v3/system/users/5eb1df81aeee4577ac06c0522fd15276/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.232783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2d9110ae-093e-4e5e-976f-c923a89c5613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:35:59.233270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41b965-895b-49bb-b5be-0fcfb1518af1 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5eb1df81aeee4577ac06c0522fd15276, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.234663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa41b965-895b-49bb-b5be-0fcfb1518af1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.246117 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 120/235] 10.222.0.25 () {58 vars in 1334 bytes} [Mon Oct 24 08:35:59 2022] PUT /identity/v3/system/users/5eb1df81aeee4577ac06c0522fd15276/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:35:59.247603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41b965-895b-49bb-b5be-0fcfb1518af1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.258375 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:59.342898 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 116/236] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:35:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:35:59.364305 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:59.435023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa41b965-895b-49bb-b5be-0fcfb1518af1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.474751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccfc2a-4f0a-4b43-a18a-011f0b7653be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.475411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccfc2a-4f0a-4b43-a18a-011f0b7653be None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.475687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccfc2a-4f0a-4b43-a18a-011f0b7653be None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.475960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccfc2a-4f0a-4b43-a18a-011f0b7653be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.476687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccfc2a-4f0a-4b43-a18a-011f0b7653be None admin] RBAC: Adding query filter params (role.id=423640baf20c4b9dacb6d83f8428b6e6, user.id=695e80b22e304a7781fa7cf68d5517fa, scope.system=all) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:35:59.476992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccfc2a-4f0a-4b43-a18a-011f0b7653be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.478545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccfc2a-4f0a-4b43-a18a-011f0b7653be None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.484696 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 121/237] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Oct 24 08:35:59 2022] GET /identity/v3/role_assignments?user.id=695e80b22e304a7781fa7cf68d5517fa&scope.system=all&role.id=423640baf20c4b9dacb6d83f8428b6e6 => generated 226 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:35:59.668543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9110ae-093e-4e5e-976f-c923a89c5613 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.776136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9110ae-093e-4e5e-976f-c923a89c5613 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.810819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ecfa1f-9a73-4d25-ba99-3558040e6b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.811458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfa1f-9a73-4d25-ba99-3558040e6b93 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.811734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfa1f-9a73-4d25-ba99-3558040e6b93 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.812005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ecfa1f-9a73-4d25-ba99-3558040e6b93 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.813099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecfa1f-9a73-4d25-ba99-3558040e6b93 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.814594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ecfa1f-9a73-4d25-ba99-3558040e6b93 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.816333 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 117/238] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:35:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:35:59.822218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccfc2a-4f0a-4b43-a18a-011f0b7653be None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:35:59.925972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccfc2a-4f0a-4b43-a18a-011f0b7653be None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:35:59.953413 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:35:59.962232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e45a123-5013-40ce-b9d1-26785d875730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:35:59.962857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45a123-5013-40ce-b9d1-26785d875730 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:35:59.963135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45a123-5013-40ce-b9d1-26785d875730 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:35:59.963405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e45a123-5013-40ce-b9d1-26785d875730 None admin] PATH_INFO: `/v3/groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:35:59.964059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45a123-5013-40ce-b9d1-26785d875730 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:35:59.966767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e45a123-5013-40ce-b9d1-26785d875730 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:35:59.991420 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 122/239] 10.222.0.25 () {60 vars in 1134 bytes} [Mon Oct 24 08:35:59 2022] POST /identity/v3/groups => generated 229 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:01.494354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bb6aa-782b-4241-aa4e-550146913ad0 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:01.494882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bb6aa-782b-4241-aa4e-550146913ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:01.494882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361bb6aa-782b-4241-aa4e-550146913ad0 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:01.496183 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 118/240] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:01.501964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb73a4-aba2-42ce-b8cd-da5d122c1bf6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:01.502448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb73a4-aba2-42ce-b8cd-da5d122c1bf6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:01.502535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fb73a4-aba2-42ce-b8cd-da5d122c1bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:01.522077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-84fb73a4-aba2-42ce-b8cd-da5d122c1bf6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:01.523260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-84fb73a4-aba2-42ce-b8cd-da5d122c1bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:01.599009 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 123/241] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:01.838116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950cef-8cf8-460c-8e5d-4565f2767330 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:01.838356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950cef-8cf8-460c-8e5d-4565f2767330 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:01.838737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87950cef-8cf8-460c-8e5d-4565f2767330 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:01.840078 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 119/242] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:01.845499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24c6a-cca9-4baa-84b0-d481f2264d2d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:01.845859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24c6a-cca9-4baa-84b0-d481f2264d2d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:01.846144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d24c6a-cca9-4baa-84b0-d481f2264d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:01.869309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b6d24c6a-cca9-4baa-84b0-d481f2264d2d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:01.871322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6d24c6a-cca9-4baa-84b0-d481f2264d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:01.871457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950cef-8cf8-460c-8e5d-4565f2767330 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:01.897714 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:01.976627 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 124/243] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:36:02.048173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87950cef-8cf8-460c-8e5d-4565f2767330 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.097644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d738ec-6c47-443e-911d-c9250db5589f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.098835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d738ec-6c47-443e-911d-c9250db5589f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.099322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d738ec-6c47-443e-911d-c9250db5589f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.099788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d738ec-6c47-443e-911d-c9250db5589f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.114754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d738ec-6c47-443e-911d-c9250db5589f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c7d738ec-6c47-443e-911d-c9250db5589f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:02.120395 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:02.121559 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:02.122461 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:02.124417 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 120/244] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:02.131339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d24c6a-cca9-4baa-84b0-d481f2264d2d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.213849 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:02.251112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96768b-0087-4f42-b53c-e07aa16e6cec None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.251655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96768b-0087-4f42-b53c-e07aa16e6cec None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.252342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d96768b-0087-4f42-b53c-e07aa16e6cec None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.255285 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 121/245] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:02.256616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96768b-0087-4f42-b53c-e07aa16e6cec None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.288594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d24c6a-cca9-4baa-84b0-d481f2264d2d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.344924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ab9e3-d2b0-45bb-80f0-b311cac2396b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.345965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab9e3-d2b0-45bb-80f0-b311cac2396b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.346452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab9e3-d2b0-45bb-80f0-b311cac2396b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.346892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ab9e3-d2b0-45bb-80f0-b311cac2396b None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.348086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab9e3-d2b0-45bb-80f0-b311cac2396b None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:02.348545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab9e3-d2b0-45bb-80f0-b311cac2396b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:02.350546 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:02.351056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2ab9e3-d2b0-45bb-80f0-b311cac2396b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:02.366443 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 125/246] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:02.366443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d4e19-847b-4d09-87d7-10734c73dafc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.366443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d4e19-847b-4d09-87d7-10734c73dafc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.366443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084d4e19-847b-4d09-87d7-10734c73dafc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.384199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d96768b-0087-4f42-b53c-e07aa16e6cec None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.387270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-084d4e19-847b-4d09-87d7-10734c73dafc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:02.388501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-084d4e19-847b-4d09-87d7-10734c73dafc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:02.423393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe37658-37fd-47d4-953b-93e1759ffb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.424024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe37658-37fd-47d4-953b-93e1759ffb0a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.424309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe37658-37fd-47d4-953b-93e1759ffb0a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.424582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe37658-37fd-47d4-953b-93e1759ffb0a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.437030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe37658-37fd-47d4-953b-93e1759ffb0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1fe37658-37fd-47d4-953b-93e1759ffb0a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:02.442137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:02.443244 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 122/247] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:02.444328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe37658-37fd-47d4-953b-93e1759ffb0a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.467807 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 126/248] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:02.469515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d4e19-847b-4d09-87d7-10734c73dafc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.541764 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:02.573684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe37658-37fd-47d4-953b-93e1759ffb0a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.612184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dd342-7041-42ce-98dc-024a709fedc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.612818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd342-7041-42ce-98dc-024a709fedc2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.613363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd342-7041-42ce-98dc-024a709fedc2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.613634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972dd342-7041-42ce-98dc-024a709fedc2 None admin] PATH_INFO: `/v3/users/5eb1df81aeee4577ac06c0522fd15276` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.614854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972dd342-7041-42ce-98dc-024a709fedc2 None admin] RBAC: Authorizing `identity:get_user(user_id=5eb1df81aeee4577ac06c0522fd15276)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:02.616310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972dd342-7041-42ce-98dc-024a709fedc2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:02.618758 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 123/249] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/users/5eb1df81aeee4577ac06c0522fd15276 => generated 293 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:02.624679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dd342-7041-42ce-98dc-024a709fedc2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.628771 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:02.635275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084d4e19-847b-4d09-87d7-10734c73dafc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.675863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c272a3-7a0f-4775-8d69-64df843ae268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.676392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c272a3-7a0f-4775-8d69-64df843ae268 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.676666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c272a3-7a0f-4775-8d69-64df843ae268 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.676944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c272a3-7a0f-4775-8d69-64df843ae268 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.677694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c272a3-7a0f-4775-8d69-64df843ae268 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:02.677962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c272a3-7a0f-4775-8d69-64df843ae268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:02.679360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c272a3-7a0f-4775-8d69-64df843ae268 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:02.690229 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 127/250] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:02.695540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c272a3-7a0f-4775-8d69-64df843ae268 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.791342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972dd342-7041-42ce-98dc-024a709fedc2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.832130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c7232-a2e4-4fa5-a11f-08497dc73473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.832548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c272a3-7a0f-4775-8d69-64df843ae268 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:02.832862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c7232-a2e4-4fa5-a11f-08497dc73473 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.833194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c7232-a2e4-4fa5-a11f-08497dc73473 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.833560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c7232-a2e4-4fa5-a11f-08497dc73473 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.834398 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:02.834631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c7232-a2e4-4fa5-a11f-08497dc73473 None admin] RBAC: Adding query filter params (role.id=62bc91fd2a7048c3ad90e2802bdc487f, user.id=5eb1df81aeee4577ac06c0522fd15276, scope.system=all) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:02.835001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c7232-a2e4-4fa5-a11f-08497dc73473 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:02.837551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c7232-a2e4-4fa5-a11f-08497dc73473 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:02.861371 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 124/251] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/role_assignments?user.id=5eb1df81aeee4577ac06c0522fd15276&scope.system=all&role.id=62bc91fd2a7048c3ad90e2802bdc487f => generated 510 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:02.861371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c7232-a2e4-4fa5-a11f-08497dc73473 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.886997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdcd0d-9226-416f-9c19-bb53d6638508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:02.887825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdcd0d-9226-416f-9c19-bb53d6638508 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:02.888284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdcd0d-9226-416f-9c19-bb53d6638508 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:02.888721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fdcd0d-9226-416f-9c19-bb53d6638508 None admin] PATH_INFO: `/v3/users/695e80b22e304a7781fa7cf68d5517fa` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:02.890931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdcd0d-9226-416f-9c19-bb53d6638508 None admin] RBAC: Authorizing `identity:get_user(user_id=695e80b22e304a7781fa7cf68d5517fa)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:02.893599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fdcd0d-9226-416f-9c19-bb53d6638508 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:02.896452 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 128/252] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/users/695e80b22e304a7781fa7cf68d5517fa => generated 293 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:02.903406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdcd0d-9226-416f-9c19-bb53d6638508 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:02.959127 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:03.017275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c7232-a2e4-4fa5-a11f-08497dc73473 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:03.044695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fdcd0d-9226-416f-9c19-bb53d6638508 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:03.074714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c666ef-f762-4145-b190-ed52bf9c1bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:03.076485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c666ef-f762-4145-b190-ed52bf9c1bce None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.076771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c666ef-f762-4145-b190-ed52bf9c1bce None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.077077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c666ef-f762-4145-b190-ed52bf9c1bce None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.078657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c666ef-f762-4145-b190-ed52bf9c1bce None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:03.080767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c666ef-f762-4145-b190-ed52bf9c1bce None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:03.085352 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 125/253] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:03.089318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c666ef-f762-4145-b190-ed52bf9c1bce None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:03.096296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8288660-85eb-44ea-ab6c-13e14e86f541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:03.096296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8288660-85eb-44ea-ab6c-13e14e86f541 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.096558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8288660-85eb-44ea-ab6c-13e14e86f541 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.096807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8288660-85eb-44ea-ab6c-13e14e86f541 None admin] PATH_INFO: `/v3/system/users/695e80b22e304a7781fa7cf68d5517fa/roles/423640baf20c4b9dacb6d83f8428b6e6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.098323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8288660-85eb-44ea-ab6c-13e14e86f541 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=695e80b22e304a7781fa7cf68d5517fa, role_id=423640baf20c4b9dacb6d83f8428b6e6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:03.099731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8288660-85eb-44ea-ab6c-13e14e86f541 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:03.109105 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 129/254] 10.222.0.25 () {58 vars in 1334 bytes} [Mon Oct 24 08:36:02 2022] PUT /identity/v3/system/users/695e80b22e304a7781fa7cf68d5517fa/roles/423640baf20c4b9dacb6d83f8428b6e6 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:36:03.229567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c666ef-f762-4145-b190-ed52bf9c1bce None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:03.263410 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:03.269843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed9b60-e0ef-4181-b332-9c198549bbd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:03.270465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed9b60-e0ef-4181-b332-9c198549bbd0 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:03.270743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed9b60-e0ef-4181-b332-9c198549bbd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:03.271017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed9b60-e0ef-4181-b332-9c198549bbd0 None admin] PATH_INFO: `/v3/groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:03.271659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed9b60-e0ef-4181-b332-9c198549bbd0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:03.273127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed9b60-e0ef-4181-b332-9c198549bbd0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:03.291708 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 126/255] 10.222.0.25 () {60 vars in 1134 bytes} [Mon Oct 24 08:36:03 2022] POST /identity/v3/groups => generated 226 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:05.859489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc406f08-e61a-471c-b001-e219e407ba65 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:05.860030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc406f08-e61a-471c-b001-e219e407ba65 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:05.860467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc406f08-e61a-471c-b001-e219e407ba65 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:05.863852 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 130/256] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:05.869211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fc27-68f1-46e1-858e-d88cd9040ce7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:05.869945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fc27-68f1-46e1-858e-d88cd9040ce7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:05.869945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf8fc27-68f1-46e1-858e-d88cd9040ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:05.898881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-aaf8fc27-68f1-46e1-858e-d88cd9040ce7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:05.900140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aaf8fc27-68f1-46e1-858e-d88cd9040ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:05.984654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 127/257] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:36:06.532435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc406f08-e61a-471c-b001-e219e407ba65 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:06.572134 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:06.663597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc406f08-e61a-471c-b001-e219e407ba65 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:06.706236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036316e1-584b-4c57-89dd-cb49deaf36d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:06.706874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036316e1-584b-4c57-89dd-cb49deaf36d6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:06.707151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036316e1-584b-4c57-89dd-cb49deaf36d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:06.707421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036316e1-584b-4c57-89dd-cb49deaf36d6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:06.720990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036316e1-584b-4c57-89dd-cb49deaf36d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-036316e1-584b-4c57-89dd-cb49deaf36d6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:06.726507 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:06.728736 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:06.731249 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 131/258] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:06 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:06.734186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fc27-68f1-46e1-858e-d88cd9040ce7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:06.876957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf8fc27-68f1-46e1-858e-d88cd9040ce7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:06.906712 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:06.925793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804b2fc-7eef-4752-9006-4a1874998f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:06.926412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b2fc-7eef-4752-9006-4a1874998f4a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:06.926690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b2fc-7eef-4752-9006-4a1874998f4a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:06.926964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804b2fc-7eef-4752-9006-4a1874998f4a None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:06.927646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b2fc-7eef-4752-9006-4a1874998f4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:06.927947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b2fc-7eef-4752-9006-4a1874998f4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:06.929381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804b2fc-7eef-4752-9006-4a1874998f4a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:06.940381 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 128/259] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:36:06 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:06.945924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036316e1-584b-4c57-89dd-cb49deaf36d6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.071874 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:07.080413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036316e1-584b-4c57-89dd-cb49deaf36d6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.127881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af02d4-6d94-427e-99b5-9bd596430909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.128439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af02d4-6d94-427e-99b5-9bd596430909 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.128717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af02d4-6d94-427e-99b5-9bd596430909 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.128991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9af02d4-6d94-427e-99b5-9bd596430909 None admin] PATH_INFO: `/v3/users/695e80b22e304a7781fa7cf68d5517fa` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.130211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af02d4-6d94-427e-99b5-9bd596430909 None admin] RBAC: Authorizing `identity:get_user(user_id=695e80b22e304a7781fa7cf68d5517fa)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.131687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9af02d4-6d94-427e-99b5-9bd596430909 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.133734 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 132/260] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:36:06 2022] GET /identity/v3/users/695e80b22e304a7781fa7cf68d5517fa => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:07.139175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29b035-9ccf-4b0b-aa1d-f52565473b78 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.139451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af02d4-6d94-427e-99b5-9bd596430909 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.139563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29b035-9ccf-4b0b-aa1d-f52565473b78 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.139733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f29b035-9ccf-4b0b-aa1d-f52565473b78 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.141215 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 129/261] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:07.152470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee893cd8-ebd2-476c-8d96-ce9f96df57fd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.152763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee893cd8-ebd2-476c-8d96-ce9f96df57fd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.153028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee893cd8-ebd2-476c-8d96-ce9f96df57fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.192045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ee893cd8-ebd2-476c-8d96-ce9f96df57fd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:07.193593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ee893cd8-ebd2-476c-8d96-ce9f96df57fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:07.327857 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 130/262] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:36:07.361498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9af02d4-6d94-427e-99b5-9bd596430909 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.423633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa39563-42ab-4984-a321-8240275b4d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.424182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39563-42ab-4984-a321-8240275b4d1f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.424460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39563-42ab-4984-a321-8240275b4d1f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.424731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa39563-42ab-4984-a321-8240275b4d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.425512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39563-42ab-4984-a321-8240275b4d1f None admin] RBAC: Adding query filter params (role.id=423640baf20c4b9dacb6d83f8428b6e6, user.id=695e80b22e304a7781fa7cf68d5517fa, scope.system=all) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:07.425823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39563-42ab-4984-a321-8240275b4d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.427309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa39563-42ab-4984-a321-8240275b4d1f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.449717 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 133/263] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/role_assignments?user.id=695e80b22e304a7781fa7cf68d5517fa&scope.system=all&role.id=423640baf20c4b9dacb6d83f8428b6e6 => generated 510 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:07.472735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5a3c8-d072-4679-b7e4-a5f9c771dfdc None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.473062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5a3c8-d072-4679-b7e4-a5f9c771dfdc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.473288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad5a3c8-d072-4679-b7e4-a5f9c771dfdc None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.474763 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 131/264] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:07.481425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e068-2ccc-46bb-a3ba-2fd69d2deba1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.481740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e068-2ccc-46bb-a3ba-2fd69d2deba1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.481978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd7e068-2ccc-46bb-a3ba-2fd69d2deba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.506902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bfd7e068-2ccc-46bb-a3ba-2fd69d2deba1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:07.508255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bfd7e068-2ccc-46bb-a3ba-2fd69d2deba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:07.525434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 134/265] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:36:07.545757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31e47d-0d72-4bf4-9e32-e767deb76ac8 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.546105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31e47d-0d72-4bf4-9e32-e767deb76ac8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.546315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e31e47d-0d72-4bf4-9e32-e767deb76ac8 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.548061 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 132/266] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:07.554098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89ffb-236f-4ac5-8aaf-b3fb956b69bf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.554430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89ffb-236f-4ac5-8aaf-b3fb956b69bf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.554654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d89ffb-236f-4ac5-8aaf-b3fb956b69bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.575844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d5d89ffb-236f-4ac5-8aaf-b3fb956b69bf None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:07.577065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d5d89ffb-236f-4ac5-8aaf-b3fb956b69bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:07.587685 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 135/267] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:07 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:36:07.839130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31e47d-0d72-4bf4-9e32-e767deb76ac8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.855858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e31e47d-0d72-4bf4-9e32-e767deb76ac8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.860383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab502bcf-e829-4c48-912a-4cc7b5d3d0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.861016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab502bcf-e829-4c48-912a-4cc7b5d3d0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.861314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab502bcf-e829-4c48-912a-4cc7b5d3d0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.861593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab502bcf-e829-4c48-912a-4cc7b5d3d0c6 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.877012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab502bcf-e829-4c48-912a-4cc7b5d3d0c6 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-ab502bcf-e829-4c48-912a-4cc7b5d3d0c6 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:07.882129 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:07.884409 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:07.886323 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 133/268] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:07.889387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d89ffb-236f-4ac5-8aaf-b3fb956b69bf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.905057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d89ffb-236f-4ac5-8aaf-b3fb956b69bf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.913587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.914223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.914503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.914910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.915519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:07.915821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.921784 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:36:07.921784 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 08:36:07.921784 n-d-master-1 devstack@keystone.service[88312]: Oct 24 08:36:07.922752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.925599 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:07.937035 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 136/269] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:07.942950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab502bcf-e829-4c48-912a-4cc7b5d3d0c6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.955018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab502bcf-e829-4c48-912a-4cc7b5d3d0c6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.958885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:07.966313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649e413-be80-46d6-a28c-b35782a55483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.967013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649e413-be80-46d6-a28c-b35782a55483 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.967294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649e413-be80-46d6-a28c-b35782a55483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.967573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a649e413-be80-46d6-a28c-b35782a55483 admin admin] PATH_INFO: `/v3/groups/b0b4fb159a1744d88059b3f132db998a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.974020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9f3bf-adad-440e-ab5e-34626cb2f7e8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:07.980672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649e413-be80-46d6-a28c-b35782a55483 admin admin] RBAC: Authorizing `identity:get_group(group_id=b0b4fb159a1744d88059b3f132db998a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:07.982552 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-a649e413-be80-46d6-a28c-b35782a55483 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:36:07.982552 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 08:36:07.982552 n-d-master-1 devstack@keystone.service[88311]: Oct 24 08:36:07.983817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a649e413-be80-46d6-a28c-b35782a55483 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:07.989130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c5c4-e61b-4fc5-bcc5-f8da9982ea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:07.989813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c5c4-e61b-4fc5-bcc5-f8da9982ea7a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:07.990091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c5c4-e61b-4fc5-bcc5-f8da9982ea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:07.990365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c613c5c4-e61b-4fc5-bcc5-f8da9982ea7a admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:07.991045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 134/270] 10.222.0.25 () {56 vars in 1201 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/groups/b0b4fb159a1744d88059b3f132db998a => generated 226 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:07.998150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649e413-be80-46d6-a28c-b35782a55483 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.019049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c613c5c4-e61b-4fc5-bcc5-f8da9982ea7a admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-c613c5c4-e61b-4fc5-bcc5-f8da9982ea7a admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:08.025068 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:08.028639 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:08.030613 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 137/271] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:08.032172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a649e413-be80-46d6-a28c-b35782a55483 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.038284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007437-7629-45a9-8ca2-9fcef4afb887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.038940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007437-7629-45a9-8ca2-9fcef4afb887 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.039218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007437-7629-45a9-8ca2-9fcef4afb887 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.039493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74007437-7629-45a9-8ca2-9fcef4afb887 admin admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.042014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74007437-7629-45a9-8ca2-9fcef4afb887 admin admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.044141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74007437-7629-45a9-8ca2-9fcef4afb887 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.045890 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 135/272] 10.222.0.25 () {56 vars in 1207 bytes} [Mon Oct 24 08:36:07 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:08.046894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c5c4-e61b-4fc5-bcc5-f8da9982ea7a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.060039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007437-7629-45a9-8ca2-9fcef4afb887 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.068276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c613c5c4-e61b-4fc5-bcc5-f8da9982ea7a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.077394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74007437-7629-45a9-8ca2-9fcef4afb887 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.081767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135c9a-4e80-4f91-b032-5899a4d3e429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.082395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135c9a-4e80-4f91-b032-5899a4d3e429 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.082675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135c9a-4e80-4f91-b032-5899a4d3e429 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.082952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd135c9a-4e80-4f91-b032-5899a4d3e429 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.083626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd135c9a-4e80-4f91-b032-5899a4d3e429 admin admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:08.083929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd135c9a-4e80-4f91-b032-5899a4d3e429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.085603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd135c9a-4e80-4f91-b032-5899a4d3e429 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.090502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af89e-0020-4807-a39f-93845996bb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.091104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af89e-0020-4807-a39f-93845996bb28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.091383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af89e-0020-4807-a39f-93845996bb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.091654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1af89e-0020-4807-a39f-93845996bb28 admin admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48/groups/b0b4fb159a1744d88059b3f132db998a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.093783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1af89e-0020-4807-a39f-93845996bb28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72848f2689d249be87482e72ba48db48, group_id=b0b4fb159a1744d88059b3f132db998a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.094830 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-4f1af89e-0020-4807-a39f-93845996bb28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:36:08.094830 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 08:36:08.094830 n-d-master-1 devstack@keystone.service[88311]: Oct 24 08:36:08.096829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1af89e-0020-4807-a39f-93845996bb28 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.108211 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 138/273] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:08.109313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135c9a-4e80-4f91-b032-5899a4d3e429 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.123616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd135c9a-4e80-4f91-b032-5899a4d3e429 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.131651 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 136/274] 10.222.0.25 () {58 vars in 1463 bytes} [Mon Oct 24 08:36:08 2022] PUT /identity/v3/projects/72848f2689d249be87482e72ba48db48/groups/b0b4fb159a1744d88059b3f132db998a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:08.132503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af89e-0020-4807-a39f-93845996bb28 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.248832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94cf3c-d78c-4074-8b6e-85d56c47f025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.249985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94cf3c-d78c-4074-8b6e-85d56c47f025 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.250493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94cf3c-d78c-4074-8b6e-85d56c47f025 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.250968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b94cf3c-d78c-4074-8b6e-85d56c47f025 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.276780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b94cf3c-d78c-4074-8b6e-85d56c47f025 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-8b94cf3c-d78c-4074-8b6e-85d56c47f025 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:08.283347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:08.284325 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:08.285121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:08.294187 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 139/275] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:08.303153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1af89e-0020-4807-a39f-93845996bb28 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.304521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94cf3c-d78c-4074-8b6e-85d56c47f025 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.319167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c360e2-05fa-4dd6-a363-d1cecc1584b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.320370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c360e2-05fa-4dd6-a363-d1cecc1584b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.322661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c360e2-05fa-4dd6-a363-d1cecc1584b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.323166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c360e2-05fa-4dd6-a363-d1cecc1584b6 admin admin] PATH_INFO: `/v3/groups/b0b4fb159a1744d88059b3f132db998a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.324759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c360e2-05fa-4dd6-a363-d1cecc1584b6 admin admin] RBAC: Authorizing `identity:get_group(group_id=b0b4fb159a1744d88059b3f132db998a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.328364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c360e2-05fa-4dd6-a363-d1cecc1584b6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.329997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b94cf3c-d78c-4074-8b6e-85d56c47f025 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.332727 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 137/276] 10.222.0.25 () {56 vars in 1201 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/groups/b0b4fb159a1744d88059b3f132db998a => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:08.339033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c360e2-05fa-4dd6-a363-d1cecc1584b6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.343144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fad35-4273-4390-a42f-8c6c438cfd20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.344159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fad35-4273-4390-a42f-8c6c438cfd20 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.344645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fad35-4273-4390-a42f-8c6c438cfd20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.345112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884fad35-4273-4390-a42f-8c6c438cfd20 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.346063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fad35-4273-4390-a42f-8c6c438cfd20 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:08.346582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fad35-4273-4390-a42f-8c6c438cfd20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.348495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884fad35-4273-4390-a42f-8c6c438cfd20 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.362175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c360e2-05fa-4dd6-a363-d1cecc1584b6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.367657 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 140/277] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:08.374416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fad35-4273-4390-a42f-8c6c438cfd20 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.382167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875dd05-4e14-4378-84a3-7169bd59daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.383197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875dd05-4e14-4378-84a3-7169bd59daa0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.384269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875dd05-4e14-4378-84a3-7169bd59daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.384775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d875dd05-4e14-4378-84a3-7169bd59daa0 admin admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.387663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875dd05-4e14-4378-84a3-7169bd59daa0 admin admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.390166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d875dd05-4e14-4378-84a3-7169bd59daa0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.396101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884fad35-4273-4390-a42f-8c6c438cfd20 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.397145 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 138/278] 10.222.0.25 () {56 vars in 1207 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:08.402344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875dd05-4e14-4378-84a3-7169bd59daa0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.407971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73508d13-5360-4039-b0d1-a9637ec6271a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.408628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73508d13-5360-4039-b0d1-a9637ec6271a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.408905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73508d13-5360-4039-b0d1-a9637ec6271a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.409176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73508d13-5360-4039-b0d1-a9637ec6271a admin admin] PATH_INFO: `/v3/groups/b0b4fb159a1744d88059b3f132db998a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.413459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73508d13-5360-4039-b0d1-a9637ec6271a admin admin] RBAC: Authorizing `identity:get_group(group_id=b0b4fb159a1744d88059b3f132db998a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.414521 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-73508d13-5360-4039-b0d1-a9637ec6271a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:36:08.414521 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 08:36:08.414521 n-d-master-1 devstack@keystone.service[88312]: Oct 24 08:36:08.416372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73508d13-5360-4039-b0d1-a9637ec6271a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.418411 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 141/279] 10.222.0.25 () {56 vars in 1201 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/groups/b0b4fb159a1744d88059b3f132db998a => generated 226 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:08.422993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d875dd05-4e14-4378-84a3-7169bd59daa0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.427495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73508d13-5360-4039-b0d1-a9637ec6271a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.436094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571f5e73-d66d-4739-a36b-fba148658e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.436779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5e73-d66d-4739-a36b-fba148658e95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.437057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5e73-d66d-4739-a36b-fba148658e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.437357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571f5e73-d66d-4739-a36b-fba148658e95 admin admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/groups/b0b4fb159a1744d88059b3f132db998a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.440850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73508d13-5360-4039-b0d1-a9637ec6271a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.442615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f5e73-d66d-4739-a36b-fba148658e95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d847baf7ffdf4cee844beb6e1c188d1b, group_id=b0b4fb159a1744d88059b3f132db998a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.445503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571f5e73-d66d-4739-a36b-fba148658e95 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.449098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef357dff-7736-4677-92c7-65bb07401140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.449831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef357dff-7736-4677-92c7-65bb07401140 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.450349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef357dff-7736-4677-92c7-65bb07401140 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.450670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef357dff-7736-4677-92c7-65bb07401140 admin admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.452493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef357dff-7736-4677-92c7-65bb07401140 admin admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.456239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef357dff-7736-4677-92c7-65bb07401140 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.459045 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 142/280] 10.222.0.25 () {56 vars in 1207 bytes} [Mon Oct 24 08:36:08 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:08.469404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef357dff-7736-4677-92c7-65bb07401140 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:08.471275 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 139/281] 10.222.0.25 () {58 vars in 1463 bytes} [Mon Oct 24 08:36:08 2022] PUT /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/groups/b0b4fb159a1744d88059b3f132db998a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:08.482774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef357dff-7736-4677-92c7-65bb07401140 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:08.589022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f549d803-92bd-499f-805d-8ddd68668b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:08.589753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549d803-92bd-499f-805d-8ddd68668b9e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.590030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549d803-92bd-499f-805d-8ddd68668b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.590303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f549d803-92bd-499f-805d-8ddd68668b9e admin admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48/groups/b0b4fb159a1744d88059b3f132db998a/roles/09faee4fb963419e9d5409d109523f73` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.592787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549d803-92bd-499f-805d-8ddd68668b9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=72848f2689d249be87482e72ba48db48, group_id=b0b4fb159a1744d88059b3f132db998a, role_id=09faee4fb963419e9d5409d109523f73)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:08.593930 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-f549d803-92bd-499f-805d-8ddd68668b9e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:36:08.593930 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 08:36:08.593930 n-d-master-1 devstack@keystone.service[88312]: Oct 24 08:36:08.595893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f549d803-92bd-499f-805d-8ddd68668b9e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:08.616280 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 143/282] 10.222.0.25 () {58 vars in 1463 bytes} [Mon Oct 24 08:36:08 2022] PUT /identity/v3/projects/72848f2689d249be87482e72ba48db48/groups/b0b4fb159a1744d88059b3f132db998a/roles/09faee4fb963419e9d5409d109523f73 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:36:08.639645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75605f6b-15d0-48b6-abe9-9b635e63bc40 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.639973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75605f6b-15d0-48b6-abe9-9b635e63bc40 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.640204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75605f6b-15d0-48b6-abe9-9b635e63bc40 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.641743 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 140/283] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:08.649057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130fb2c-1a13-42d6-b89d-5f8f4b23fd79 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.650134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130fb2c-1a13-42d6-b89d-5f8f4b23fd79 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.650591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130fb2c-1a13-42d6-b89d-5f8f4b23fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:08.688688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a130fb2c-1a13-42d6-b89d-5f8f4b23fd79 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:08.691651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a130fb2c-1a13-42d6-b89d-5f8f4b23fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:08.773790 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:08.814440 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 144/284] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:36:08.996442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6343c-bf15-4220-b0ba-3d162bc313cc None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:08.997493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6343c-bf15-4220-b0ba-3d162bc313cc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:08.998034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb6343c-bf15-4220-b0ba-3d162bc313cc None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.000118 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 141/285] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:08 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:09.005844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618cd9-dfb1-4721-b843-fd4d9155636c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.006841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618cd9-dfb1-4721-b843-fd4d9155636c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.007340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64618cd9-dfb1-4721-b843-fd4d9155636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.032912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-64618cd9-dfb1-4721-b843-fd4d9155636c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:09.034702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-64618cd9-dfb1-4721-b843-fd4d9155636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:09.045363 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 145/286] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:09 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 24 08:36:09.264993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6343c-bf15-4220-b0ba-3d162bc313cc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.283318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb6343c-bf15-4220-b0ba-3d162bc313cc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.293348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db01b9e-1bbb-4395-81b6-adf8e53e16c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.294000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db01b9e-1bbb-4395-81b6-adf8e53e16c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.294278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db01b9e-1bbb-4395-81b6-adf8e53e16c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.294549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db01b9e-1bbb-4395-81b6-adf8e53e16c3 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.312856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db01b9e-1bbb-4395-81b6-adf8e53e16c3 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-3db01b9e-1bbb-4395-81b6-adf8e53e16c3 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:09.318446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:09.320205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:09.321835 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 142/287] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 56 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:09.327946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64618cd9-dfb1-4721-b843-fd4d9155636c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.352842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64618cd9-dfb1-4721-b843-fd4d9155636c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.361983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734f362-addc-4e2f-ba48-80bfefe79b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.363106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734f362-addc-4e2f-ba48-80bfefe79b9b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.364024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734f362-addc-4e2f-ba48-80bfefe79b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.364529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734f362-addc-4e2f-ba48-80bfefe79b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.365677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734f362-addc-4e2f-ba48-80bfefe79b9b admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:09.366244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734f362-addc-4e2f-ba48-80bfefe79b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.369135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1734f362-addc-4e2f-ba48-80bfefe79b9b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.385677 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 146/288] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:09.391552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db01b9e-1bbb-4395-81b6-adf8e53e16c3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.415085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db01b9e-1bbb-4395-81b6-adf8e53e16c3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.425634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cf3a7-b8bf-4bf3-b8bd-4e43e5d1b186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.426286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cf3a7-b8bf-4bf3-b8bd-4e43e5d1b186 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.426562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cf3a7-b8bf-4bf3-b8bd-4e43e5d1b186 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.426832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391cf3a7-b8bf-4bf3-b8bd-4e43e5d1b186 admin admin] PATH_INFO: `/v3/groups/b0b4fb159a1744d88059b3f132db998a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.434366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cf3a7-b8bf-4bf3-b8bd-4e43e5d1b186 admin admin] RBAC: Authorizing `identity:get_group(group_id=b0b4fb159a1744d88059b3f132db998a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.436348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391cf3a7-b8bf-4bf3-b8bd-4e43e5d1b186 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.438067 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 143/289] 10.222.0.25 () {56 vars in 1201 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/groups/b0b4fb159a1744d88059b3f132db998a => generated 226 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:09.444043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cf3a7-b8bf-4bf3-b8bd-4e43e5d1b186 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.444513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734f362-addc-4e2f-ba48-80bfefe79b9b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.454559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391cf3a7-b8bf-4bf3-b8bd-4e43e5d1b186 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.463886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d86e2-4058-4d6e-a194-ed9abaf1c5c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.465041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d86e2-4058-4d6e-a194-ed9abaf1c5c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.468228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1734f362-addc-4e2f-ba48-80bfefe79b9b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.469912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d86e2-4058-4d6e-a194-ed9abaf1c5c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.472770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255d86e2-4058-4d6e-a194-ed9abaf1c5c1 admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.477591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45cf61-913a-4e3d-8902-9e4aceb439ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.480771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cf61-913a-4e3d-8902-9e4aceb439ac admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.481403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cf61-913a-4e3d-8902-9e4aceb439ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.481663 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:09.481948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45cf61-913a-4e3d-8902-9e4aceb439ac admin admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.484694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45cf61-913a-4e3d-8902-9e4aceb439ac admin admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.491320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45cf61-913a-4e3d-8902-9e4aceb439ac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.496078 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 147/290] 10.222.0.25 () {56 vars in 1207 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:09.501249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45cf61-913a-4e3d-8902-9e4aceb439ac admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.503402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255d86e2-4058-4d6e-a194-ed9abaf1c5c1 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-255d86e2-4058-4d6e-a194-ed9abaf1c5c1 admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:09.513603 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:09.514565 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:09.515407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:09.517823 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 144/291] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:09.525391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d86e2-4058-4d6e-a194-ed9abaf1c5c1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.529103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45cf61-913a-4e3d-8902-9e4aceb439ac admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.536138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0d43d-24dc-4ca7-84a4-7e01ca3c11ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.537481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0d43d-24dc-4ca7-84a4-7e01ca3c11ec admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.539049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0d43d-24dc-4ca7-84a4-7e01ca3c11ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.539594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0d43d-24dc-4ca7-84a4-7e01ca3c11ec admin admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/groups/b0b4fb159a1744d88059b3f132db998a/roles/09faee4fb963419e9d5409d109523f73` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.543540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255d86e2-4058-4d6e-a194-ed9abaf1c5c1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.544094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0d43d-24dc-4ca7-84a4-7e01ca3c11ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=d847baf7ffdf4cee844beb6e1c188d1b, group_id=b0b4fb159a1744d88059b3f132db998a, role_id=09faee4fb963419e9d5409d109523f73)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.552434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a0d43d-24dc-4ca7-84a4-7e01ca3c11ec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.558132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.559176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.559673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.560158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.561081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:09.561625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.562890 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:36:09.562890 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 08:36:09.562890 n-d-master-1 devstack@keystone.service[88311]: Oct 24 08:36:09.564156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.575682 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 145/292] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:09.583704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.588030 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 148/293] 10.222.0.25 () {58 vars in 1463 bytes} [Mon Oct 24 08:36:09 2022] PUT /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b/groups/b0b4fb159a1744d88059b3f132db998a/roles/09faee4fb963419e9d5409d109523f73 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:09.613976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe8afbd-dca0-41f7-8deb-6cded17aa2c0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.722728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9438-aae1-4618-ab73-26963997eed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.723654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9438-aae1-4618-ab73-26963997eed4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.724018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9438-aae1-4618-ab73-26963997eed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.724351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ea9438-aae1-4618-ab73-26963997eed4 admin admin] PATH_INFO: `/v3/groups/bcb46bc8ff06441f8256ef22e8727cec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.734680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9438-aae1-4618-ab73-26963997eed4 admin admin] RBAC: Authorizing `identity:get_group(group_id=bcb46bc8ff06441f8256ef22e8727cec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.737663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ea9438-aae1-4618-ab73-26963997eed4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.740258 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 146/294] 10.222.0.25 () {56 vars in 1201 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/groups/bcb46bc8ff06441f8256ef22e8727cec => generated 229 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:09.746619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0d43d-24dc-4ca7-84a4-7e01ca3c11ec admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.762744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0d43d-24dc-4ca7-84a4-7e01ca3c11ec admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.768615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bd51d-ba0c-4282-aa83-0e9a4e04d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.769440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd51d-ba0c-4282-aa83-0e9a4e04d4c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.769728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd51d-ba0c-4282-aa83-0e9a4e04d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.770007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bd51d-ba0c-4282-aa83-0e9a4e04d4c2 admin admin] PATH_INFO: `/v3/projects/d5d57fb385334787a7547e0f12982788` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.771610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bd51d-ba0c-4282-aa83-0e9a4e04d4c2 admin admin] RBAC: Authorizing `identity:get_project(project_id=d5d57fb385334787a7547e0f12982788)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.774137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bd51d-ba0c-4282-aa83-0e9a4e04d4c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.776297 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 149/295] 10.222.0.25 () {56 vars in 1207 bytes} [Mon Oct 24 08:36:09 2022] GET /identity/v3/projects/d5d57fb385334787a7547e0f12982788 => generated 344 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:09.782238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9438-aae1-4618-ab73-26963997eed4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:09.795745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ea9438-aae1-4618-ab73-26963997eed4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:09.805927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f6c094-46f1-46a8-a20b-42405f1201fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:09.806881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6c094-46f1-46a8-a20b-42405f1201fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:09.807205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6c094-46f1-46a8-a20b-42405f1201fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:09.807489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f6c094-46f1-46a8-a20b-42405f1201fa admin admin] PATH_INFO: `/v3/projects/d5d57fb385334787a7547e0f12982788/groups/bcb46bc8ff06441f8256ef22e8727cec/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:09.809796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6c094-46f1-46a8-a20b-42405f1201fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5d57fb385334787a7547e0f12982788, group_id=bcb46bc8ff06441f8256ef22e8727cec, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:09.813280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f6c094-46f1-46a8-a20b-42405f1201fa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:09.846370 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 147/296] 10.222.0.25 () {58 vars in 1463 bytes} [Mon Oct 24 08:36:09 2022] PUT /identity/v3/projects/d5d57fb385334787a7547e0f12982788/groups/bcb46bc8ff06441f8256ef22e8727cec/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:11.444802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab23fa-e91a-45e2-8d74-5a87df073d0a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.445317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab23fa-e91a-45e2-8d74-5a87df073d0a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.445317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fab23fa-e91a-45e2-8d74-5a87df073d0a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.446699 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 150/297] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:11.453200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d54e9-a369-4f2c-92c0-d01b30fd70ce None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.453727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d54e9-a369-4f2c-92c0-d01b30fd70ce None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.453832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163d54e9-a369-4f2c-92c0-d01b30fd70ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.479050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-163d54e9-a369-4f2c-92c0-d01b30fd70ce None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:11.480356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-163d54e9-a369-4f2c-92c0-d01b30fd70ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:11.578659 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 148/298] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:11.579369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3b722-ba75-41d4-ac3b-5c7c63def55b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.579662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3b722-ba75-41d4-ac3b-5c7c63def55b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.579934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3b722-ba75-41d4-ac3b-5c7c63def55b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.582510 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 151/299] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:11.607279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b375-1cd5-4b7d-bd29-b0f35a8c8417 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.607889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b375-1cd5-4b7d-bd29-b0f35a8c8417 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.608361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c537b375-1cd5-4b7d-bd29-b0f35a8c8417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.634361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c537b375-1cd5-4b7d-bd29-b0f35a8c8417 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:11.635980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c537b375-1cd5-4b7d-bd29-b0f35a8c8417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:11.702779 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:11.735185 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 149/300] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:11.853869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a2f6-25bb-4a1a-b663-6e6cde224712 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.854252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a2f6-25bb-4a1a-b663-6e6cde224712 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.854428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7a2f6-25bb-4a1a-b663-6e6cde224712 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.855765 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 152/301] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:11.861249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbbc6b-bf89-4706-9a7f-d9d92f4ba0e6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:11.861558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbbc6b-bf89-4706-9a7f-d9d92f4ba0e6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:11.861837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffbbc6b-bf89-4706-9a7f-d9d92f4ba0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:11.886348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8ffbbc6b-bf89-4706-9a7f-d9d92f4ba0e6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:11.887746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8ffbbc6b-bf89-4706-9a7f-d9d92f4ba0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:11.975587 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 150/302] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:36:12.008156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7a2f6-25bb-4a1a-b663-6e6cde224712 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.113840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbbc6b-bf89-4706-9a7f-d9d92f4ba0e6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.174854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7a2f6-25bb-4a1a-b663-6e6cde224712 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.250955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb5a8-cbd5-4553-a22c-9510884142c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.251649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb5a8-cbd5-4553-a22c-9510884142c1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.251931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb5a8-cbd5-4553-a22c-9510884142c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.252274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fb5a8-cbd5-4553-a22c-9510884142c1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.267483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffbbc6b-bf89-4706-9a7f-d9d92f4ba0e6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.281729 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:12.283594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fb5a8-cbd5-4553-a22c-9510884142c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-300fb5a8-cbd5-4553-a22c-9510884142c1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:12.291864 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:12.293078 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:12.294110 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 153/303] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:12.301579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb5a8-cbd5-4553-a22c-9510884142c1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.319335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bf138-966e-46d6-940b-54f3c238a38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.321011 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:12.321603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bf138-966e-46d6-940b-54f3c238a38f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.322140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bf138-966e-46d6-940b-54f3c238a38f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.322638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17bf138-966e-46d6-940b-54f3c238a38f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.346813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17bf138-966e-46d6-940b-54f3c238a38f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-a17bf138-966e-46d6-940b-54f3c238a38f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:12.354414 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:12.355400 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 24 08:36:12.356401 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:12.359303 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 151/304] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:12.360983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bf138-966e-46d6-940b-54f3c238a38f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.462920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fb5a8-cbd5-4553-a22c-9510884142c1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.506568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07459e-605f-46ba-bf6a-7f77101125de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.507431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07459e-605f-46ba-bf6a-7f77101125de None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.507861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07459e-605f-46ba-bf6a-7f77101125de None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.508282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee07459e-605f-46ba-bf6a-7f77101125de None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.509151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07459e-605f-46ba-bf6a-7f77101125de None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:12.509832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07459e-605f-46ba-bf6a-7f77101125de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:12.511824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee07459e-605f-46ba-bf6a-7f77101125de None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:12.523821 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 154/305] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:12.525034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07459e-605f-46ba-bf6a-7f77101125de None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.535540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17bf138-966e-46d6-940b-54f3c238a38f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.588930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50754c-a0f1-4015-9f1f-768c456f9dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.589601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50754c-a0f1-4015-9f1f-768c456f9dba None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.589876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50754c-a0f1-4015-9f1f-768c456f9dba None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.590144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50754c-a0f1-4015-9f1f-768c456f9dba None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.601240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50754c-a0f1-4015-9f1f-768c456f9dba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-9f50754c-a0f1-4015-9f1f-768c456f9dba None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:12.608551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:12.609686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:12.610646 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:12.611849 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 152/306] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:12.612319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50754c-a0f1-4015-9f1f-768c456f9dba None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.615818 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:12.648987 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:12.666932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee07459e-605f-46ba-bf6a-7f77101125de None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.716437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299844a1-575b-494c-94e8-a0077558ee28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.717218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299844a1-575b-494c-94e8-a0077558ee28 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.717658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299844a1-575b-494c-94e8-a0077558ee28 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.718028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299844a1-575b-494c-94e8-a0077558ee28 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.719323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299844a1-575b-494c-94e8-a0077558ee28 None admin] RBAC: Adding query filter params (name=member) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:12.719928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299844a1-575b-494c-94e8-a0077558ee28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:12.721617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299844a1-575b-494c-94e8-a0077558ee28 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:12.737404 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 155/307] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:12.739120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299844a1-575b-494c-94e8-a0077558ee28 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.754659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50754c-a0f1-4015-9f1f-768c456f9dba None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.800244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec625385-123c-4daa-afa0-2b50543100a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.800983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec625385-123c-4daa-afa0-2b50543100a8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.801165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec625385-123c-4daa-afa0-2b50543100a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.801441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec625385-123c-4daa-afa0-2b50543100a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.880732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299844a1-575b-494c-94e8-a0077558ee28 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:12.903627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec625385-123c-4daa-afa0-2b50543100a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:12.908636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec625385-123c-4daa-afa0-2b50543100a8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:12.921438 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:12.928143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c487c6f-52da-48b2-a2ec-8824b8c4451a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:12.929456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c487c6f-52da-48b2-a2ec-8824b8c4451a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:12.929974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c487c6f-52da-48b2-a2ec-8824b8c4451a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:12.931095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c487c6f-52da-48b2-a2ec-8824b8c4451a None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:12.932323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c487c6f-52da-48b2-a2ec-8824b8c4451a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:12.932839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c487c6f-52da-48b2-a2ec-8824b8c4451a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:12.934604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c487c6f-52da-48b2-a2ec-8824b8c4451a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:12.944913 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 156/308] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:12.946333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c487c6f-52da-48b2-a2ec-8824b8c4451a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:12.956194 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:13.071074 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 153/309] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:13.071672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec625385-123c-4daa-afa0-2b50543100a8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:13.117316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c487c6f-52da-48b2-a2ec-8824b8c4451a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:13.172800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f126a-b148-4030-9a14-4a361079b541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:13.173477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f126a-b148-4030-9a14-4a361079b541 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.173776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f126a-b148-4030-9a14-4a361079b541 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.174050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f126a-b148-4030-9a14-4a361079b541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.241342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec625385-123c-4daa-afa0-2b50543100a8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:13.262802 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:13.274380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f126a-b148-4030-9a14-4a361079b541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:13.275905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f126a-b148-4030-9a14-4a361079b541 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:13.285139 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:13.298279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a123f1b-3ae8-47fb-9919-e09b57022ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:13.299050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a123f1b-3ae8-47fb-9919-e09b57022ac7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.299435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a123f1b-3ae8-47fb-9919-e09b57022ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.299623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a123f1b-3ae8-47fb-9919-e09b57022ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.407596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a123f1b-3ae8-47fb-9919-e09b57022ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:13.409097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a123f1b-3ae8-47fb-9919-e09b57022ac7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:13.413083 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 157/310] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:13.418807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b5058-bd1f-466a-9046-9b302742f9b2 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.419106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b5058-bd1f-466a-9046-9b302742f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.419389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375b5058-bd1f-466a-9046-9b302742f9b2 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.420780 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 158/311] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:13.423151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b5058-bd1f-466a-9046-9b302742f9b2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:13.538551 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 154/312] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:13.539827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6436f-4a02-4d49-b2af-a0bb429df5d3 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.540101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6436f-4a02-4d49-b2af-a0bb429df5d3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.540374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a6436f-4a02-4d49-b2af-a0bb429df5d3 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.549350 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 155/313] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:13.549350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6436f-4a02-4d49-b2af-a0bb429df5d3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:13.557268 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:13.567897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375b5058-bd1f-466a-9046-9b302742f9b2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:13.584289 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:13.611520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f10b51-f9c0-4810-bfc9-d9209431bbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:13.612217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f10b51-f9c0-4810-bfc9-d9209431bbc3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.612542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f10b51-f9c0-4810-bfc9-d9209431bbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.612711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f10b51-f9c0-4810-bfc9-d9209431bbc3 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.614224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f10b51-f9c0-4810-bfc9-d9209431bbc3 None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:13.615659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f10b51-f9c0-4810-bfc9-d9209431bbc3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:13.617343 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 159/314] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:13 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:13.618558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0b1bb-6497-4955-8887-f99f62a30cd7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.618833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0b1bb-6497-4955-8887-f99f62a30cd7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.619102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0b1bb-6497-4955-8887-f99f62a30cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.637895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7bd0b1bb-6497-4955-8887-f99f62a30cd7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:13.639109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7bd0b1bb-6497-4955-8887-f99f62a30cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:13.668794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a6436f-4a02-4d49-b2af-a0bb429df5d3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:13.704753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f0c5d1-3b23-43d4-aa65-441c0096a4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:13.705412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0c5d1-3b23-43d4-aa65-441c0096a4a9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.705691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0c5d1-3b23-43d4-aa65-441c0096a4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.705964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f0c5d1-3b23-43d4-aa65-441c0096a4a9 None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.707113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0c5d1-3b23-43d4-aa65-441c0096a4a9 None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:13.708575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f0c5d1-3b23-43d4-aa65-441c0096a4a9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:13.715271 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 160/315] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:13.715447 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 156/316] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:13 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:13.715447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126005-7687-46f5-82ad-6d672564d83d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.715447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126005-7687-46f5-82ad-6d672564d83d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.715447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a126005-7687-46f5-82ad-6d672564d83d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.715707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0b1bb-6497-4955-8887-f99f62a30cd7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:13.731920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1a126005-7687-46f5-82ad-6d672564d83d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:13.733261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a126005-7687-46f5-82ad-6d672564d83d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:13.825335 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 157/317] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:13.825335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126005-7687-46f5-82ad-6d672564d83d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:13.831813 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:13.842198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0b1bb-6497-4955-8887-f99f62a30cd7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:13.885207 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:13.886459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438ad86-65aa-4360-9b89-481dce2bccd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:13.887257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438ad86-65aa-4360-9b89-481dce2bccd2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:13.887544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438ad86-65aa-4360-9b89-481dce2bccd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:13.887814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7438ad86-65aa-4360-9b89-481dce2bccd2 None admin] PATH_INFO: `/v3/projects/72848f2689d249be87482e72ba48db48` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:13.889921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438ad86-65aa-4360-9b89-481dce2bccd2 None admin] RBAC: Authorizing `identity:get_project(project_id=72848f2689d249be87482e72ba48db48)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:13.891453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7438ad86-65aa-4360-9b89-481dce2bccd2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:13.893458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 161/318] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:13 2022] GET /identity/v3/projects/72848f2689d249be87482e72ba48db48 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:13.894204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438ad86-65aa-4360-9b89-481dce2bccd2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:13.979925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a126005-7687-46f5-82ad-6d672564d83d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.026266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20319885-91b3-4275-a020-cf5cd37c9812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.027299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319885-91b3-4275-a020-cf5cd37c9812 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.027793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319885-91b3-4275-a020-cf5cd37c9812 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.028285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20319885-91b3-4275-a020-cf5cd37c9812 None admin] PATH_INFO: `/v3/groups/b0b4fb159a1744d88059b3f132db998a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.030218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20319885-91b3-4275-a020-cf5cd37c9812 None admin] RBAC: Authorizing `identity:get_group(group_id=b0b4fb159a1744d88059b3f132db998a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.032603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20319885-91b3-4275-a020-cf5cd37c9812 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.040238 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 158/319] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Oct 24 08:36:13 2022] GET /identity/v3/groups/b0b4fb159a1744d88059b3f132db998a => generated 226 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.040238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20319885-91b3-4275-a020-cf5cd37c9812 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.056650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7438ad86-65aa-4360-9b89-481dce2bccd2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.098905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c748a6a-2548-4d58-823f-f8201f45780c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.099570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c748a6a-2548-4d58-823f-f8201f45780c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.099852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c748a6a-2548-4d58-823f-f8201f45780c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.100124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c748a6a-2548-4d58-823f-f8201f45780c None admin] PATH_INFO: `/v3/groups/b0b4fb159a1744d88059b3f132db998a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.101340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c748a6a-2548-4d58-823f-f8201f45780c None admin] RBAC: Authorizing `identity:get_group(group_id=b0b4fb159a1744d88059b3f132db998a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.103347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c748a6a-2548-4d58-823f-f8201f45780c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.110103 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 162/320] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Oct 24 08:36:13 2022] GET /identity/v3/groups/b0b4fb159a1744d88059b3f132db998a => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.110103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c748a6a-2548-4d58-823f-f8201f45780c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.144576 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.186724 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.194415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20319885-91b3-4275-a020-cf5cd37c9812 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.230888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c748a6a-2548-4d58-823f-f8201f45780c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.231807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990616-a39a-4ef3-9846-c1c1046c7290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.232504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990616-a39a-4ef3-9846-c1c1046c7290 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.232796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990616-a39a-4ef3-9846-c1c1046c7290 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.233075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1990616-a39a-4ef3-9846-c1c1046c7290 None admin] PATH_INFO: `/v3/groups/b0b4fb159a1744d88059b3f132db998a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.234317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990616-a39a-4ef3-9846-c1c1046c7290 None admin] RBAC: Authorizing `identity:get_group(group_id=b0b4fb159a1744d88059b3f132db998a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.235779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1990616-a39a-4ef3-9846-c1c1046c7290 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.237415 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 159/321] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/groups/b0b4fb159a1744d88059b3f132db998a => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.238249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990616-a39a-4ef3-9846-c1c1046c7290 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.271602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e0456-e530-4941-af99-bbf5fc218af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.272228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e0456-e530-4941-af99-bbf5fc218af2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.272514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e0456-e530-4941-af99-bbf5fc218af2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.272788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395e0456-e530-4941-af99-bbf5fc218af2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.285266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395e0456-e530-4941-af99-bbf5fc218af2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-395e0456-e530-4941-af99-bbf5fc218af2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:14.290868 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:14.292092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 163/322] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:14.293469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e0456-e530-4941-af99-bbf5fc218af2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.348966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1990616-a39a-4ef3-9846-c1c1046c7290 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.385288 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.385513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ce28-f132-4819-952e-e4c9f0896ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.385714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ce28-f132-4819-952e-e4c9f0896ff4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.385971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ce28-f132-4819-952e-e4c9f0896ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.386263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ce28-f132-4819-952e-e4c9f0896ff4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.386976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2ce28-f132-4819-952e-e4c9f0896ff4 None admin] RBAC: Adding query filter params (group.id=b0b4fb159a1744d88059b3f132db998a, role.id=62bc91fd2a7048c3ad90e2802bdc487f, scope.project.id=72848f2689d249be87482e72ba48db48) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:14.387295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2ce28-f132-4819-952e-e4c9f0896ff4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.388746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2ce28-f132-4819-952e-e4c9f0896ff4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.395168 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 160/323] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/role_assignments?group.id=b0b4fb159a1744d88059b3f132db998a&scope.project.id=72848f2689d249be87482e72ba48db48&role.id=62bc91fd2a7048c3ad90e2802bdc487f => generated 611 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.396106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ce28-f132-4819-952e-e4c9f0896ff4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.399124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395e0456-e530-4941-af99-bbf5fc218af2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.432041 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.446267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf14e0c-ee61-4e6f-bf69-7a5c11f75e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.447302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf14e0c-ee61-4e6f-bf69-7a5c11f75e59 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.447741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf14e0c-ee61-4e6f-bf69-7a5c11f75e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.448019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf14e0c-ee61-4e6f-bf69-7a5c11f75e59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.452647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf14e0c-ee61-4e6f-bf69-7a5c11f75e59 None admin] RBAC: Adding query filter params (group.id=b0b4fb159a1744d88059b3f132db998a, role.id=62bc91fd2a7048c3ad90e2802bdc487f, scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:14.452647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf14e0c-ee61-4e6f-bf69-7a5c11f75e59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.452647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf14e0c-ee61-4e6f-bf69-7a5c11f75e59 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.459700 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 164/324] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/role_assignments?group.id=b0b4fb159a1744d88059b3f132db998a&scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b&role.id=62bc91fd2a7048c3ad90e2802bdc487f => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.460384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf14e0c-ee61-4e6f-bf69-7a5c11f75e59 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.547889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ce28-f132-4819-952e-e4c9f0896ff4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.595285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9363-d7f7-44fa-bb1d-1e9466453cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.598129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9363-d7f7-44fa-bb1d-1e9466453cad None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.598481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9363-d7f7-44fa-bb1d-1e9466453cad None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.598767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8db9363-d7f7-44fa-bb1d-1e9466453cad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.615986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8db9363-d7f7-44fa-bb1d-1e9466453cad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:14.620569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf14e0c-ee61-4e6f-bf69-7a5c11f75e59 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c8db9363-d7f7-44fa-bb1d-1e9466453cad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:14.623384 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:14.625124 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 161/325] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:14.626973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9363-d7f7-44fa-bb1d-1e9466453cad None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.687576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420efa31-ef3b-49a4-b8e8-0fb1ca7799f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.688195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420efa31-ef3b-49a4-b8e8-0fb1ca7799f2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.688478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420efa31-ef3b-49a4-b8e8-0fb1ca7799f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.688757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420efa31-ef3b-49a4-b8e8-0fb1ca7799f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.689546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420efa31-ef3b-49a4-b8e8-0fb1ca7799f2 None admin] RBAC: Adding query filter params (group.id=b0b4fb159a1744d88059b3f132db998a, role.id=09faee4fb963419e9d5409d109523f73, scope.project.id=72848f2689d249be87482e72ba48db48) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:14.689860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420efa31-ef3b-49a4-b8e8-0fb1ca7799f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.691317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420efa31-ef3b-49a4-b8e8-0fb1ca7799f2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.703082 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 165/326] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/role_assignments?group.id=b0b4fb159a1744d88059b3f132db998a&scope.project.id=72848f2689d249be87482e72ba48db48&role.id=09faee4fb963419e9d5409d109523f73 => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.704286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420efa31-ef3b-49a4-b8e8-0fb1ca7799f2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.745245 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.773703 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:14.808668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8db9363-d7f7-44fa-bb1d-1e9466453cad None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.865208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c7927-230b-4700-8f0e-e6e6afe667f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.866004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7927-230b-4700-8f0e-e6e6afe667f0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.866287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7927-230b-4700-8f0e-e6e6afe667f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.866648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c7927-230b-4700-8f0e-e6e6afe667f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.867354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c7927-230b-4700-8f0e-e6e6afe667f0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:14.867663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c7927-230b-4700-8f0e-e6e6afe667f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.869277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c7927-230b-4700-8f0e-e6e6afe667f0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.876366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420efa31-ef3b-49a4-b8e8-0fb1ca7799f2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:14.883404 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 162/327] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.890756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c7927-230b-4700-8f0e-e6e6afe667f0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:14.925009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ade7e4-3aed-445f-b8ea-d52b43890407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:14.925660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ade7e4-3aed-445f-b8ea-d52b43890407 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:14.925927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ade7e4-3aed-445f-b8ea-d52b43890407 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:14.926201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ade7e4-3aed-445f-b8ea-d52b43890407 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:14.926871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ade7e4-3aed-445f-b8ea-d52b43890407 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:14.928007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ade7e4-3aed-445f-b8ea-d52b43890407 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:14.928573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ade7e4-3aed-445f-b8ea-d52b43890407 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:14.941901 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 166/328] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:14.948335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ade7e4-3aed-445f-b8ea-d52b43890407 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.034037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c7927-230b-4700-8f0e-e6e6afe667f0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.046848 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.075543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ade7e4-3aed-445f-b8ea-d52b43890407 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.082409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e70e-9376-4163-8022-01c449861395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.083047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e70e-9376-4163-8022-01c449861395 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.083330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e70e-9376-4163-8022-01c449861395 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.083612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a5e70e-9376-4163-8022-01c449861395 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.109483 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.125037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12672-36ee-41ae-be6d-5dfe41f7c6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.125724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12672-36ee-41ae-be6d-5dfe41f7c6c8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.126009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12672-36ee-41ae-be6d-5dfe41f7c6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.126286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd12672-36ee-41ae-be6d-5dfe41f7c6c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.181865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5e70e-9376-4163-8022-01c449861395 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.183459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a5e70e-9376-4163-8022-01c449861395 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.221135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd12672-36ee-41ae-be6d-5dfe41f7c6c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.222682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd12672-36ee-41ae-be6d-5dfe41f7c6c8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.324929 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.327489 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 163/329] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:15.333378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e70e-9376-4163-8022-01c449861395 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.364974 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 167/330] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 24 08:36:15.371745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12672-36ee-41ae-be6d-5dfe41f7c6c8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.390887 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.447505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a5e70e-9376-4163-8022-01c449861395 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.486443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd12672-36ee-41ae-be6d-5dfe41f7c6c8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.488927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1df83-964b-4503-8fe2-9b6c9acb5e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.489593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1df83-964b-4503-8fe2-9b6c9acb5e8b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.489884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1df83-964b-4503-8fe2-9b6c9acb5e8b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.490148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c1df83-964b-4503-8fe2-9b6c9acb5e8b None admin] PATH_INFO: `/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.491302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1df83-964b-4503-8fe2-9b6c9acb5e8b None admin] RBAC: Authorizing `identity:get_project(project_id=d847baf7ffdf4cee844beb6e1c188d1b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.492761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c1df83-964b-4503-8fe2-9b6c9acb5e8b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.494480 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 164/331] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:15 2022] GET /identity/v3/projects/d847baf7ffdf4cee844beb6e1c188d1b => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:15.500090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1df83-964b-4503-8fe2-9b6c9acb5e8b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.523050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6b78-5ac2-46f3-864b-c60c134838cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.523701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6b78-5ac2-46f3-864b-c60c134838cf None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.523972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6b78-5ac2-46f3-864b-c60c134838cf None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.524245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ab6b78-5ac2-46f3-864b-c60c134838cf None admin] PATH_INFO: `/v3/projects/d5d57fb385334787a7547e0f12982788` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.525947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6b78-5ac2-46f3-864b-c60c134838cf None admin] RBAC: Authorizing `identity:get_project(project_id=d5d57fb385334787a7547e0f12982788)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.527403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ab6b78-5ac2-46f3-864b-c60c134838cf None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.529046 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 168/332] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:36:15 2022] GET /identity/v3/projects/d5d57fb385334787a7547e0f12982788 => generated 344 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:15.534662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6b78-5ac2-46f3-864b-c60c134838cf None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.583215 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.619494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c1df83-964b-4503-8fe2-9b6c9acb5e8b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.637697 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.649072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ab6b78-5ac2-46f3-864b-c60c134838cf None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.657943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342d82a-1f3d-42bf-ad8c-b7b3dd7fd88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.658575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342d82a-1f3d-42bf-ad8c-b7b3dd7fd88c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.658857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342d82a-1f3d-42bf-ad8c-b7b3dd7fd88c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.659132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342d82a-1f3d-42bf-ad8c-b7b3dd7fd88c None admin] PATH_INFO: `/v3/groups/b0b4fb159a1744d88059b3f132db998a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.660253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342d82a-1f3d-42bf-ad8c-b7b3dd7fd88c None admin] RBAC: Authorizing `identity:get_group(group_id=b0b4fb159a1744d88059b3f132db998a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.661748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342d82a-1f3d-42bf-ad8c-b7b3dd7fd88c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.663337 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 165/333] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Oct 24 08:36:15 2022] GET /identity/v3/groups/b0b4fb159a1744d88059b3f132db998a => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:15.669709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342d82a-1f3d-42bf-ad8c-b7b3dd7fd88c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.689688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b56af-04d9-4a16-ba2d-1b794b984459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.690366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b56af-04d9-4a16-ba2d-1b794b984459 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.690648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b56af-04d9-4a16-ba2d-1b794b984459 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.690927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b56af-04d9-4a16-ba2d-1b794b984459 None admin] PATH_INFO: `/v3/groups/bcb46bc8ff06441f8256ef22e8727cec` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.692113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b56af-04d9-4a16-ba2d-1b794b984459 None admin] RBAC: Authorizing `identity:get_group(group_id=bcb46bc8ff06441f8256ef22e8727cec)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.693649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b56af-04d9-4a16-ba2d-1b794b984459 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.695455 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 169/334] 10.222.0.25 () {56 vars in 1180 bytes} [Mon Oct 24 08:36:15 2022] GET /identity/v3/groups/bcb46bc8ff06441f8256ef22e8727cec => generated 229 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:15.707945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b56af-04d9-4a16-ba2d-1b794b984459 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:15.784160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342d82a-1f3d-42bf-ad8c-b7b3dd7fd88c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.822175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc29090-43ab-4b67-a1da-b2956be8dcd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.822826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc29090-43ab-4b67-a1da-b2956be8dcd5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.823101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc29090-43ab-4b67-a1da-b2956be8dcd5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.823371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc29090-43ab-4b67-a1da-b2956be8dcd5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.824113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc29090-43ab-4b67-a1da-b2956be8dcd5 None admin] RBAC: Adding query filter params (group.id=b0b4fb159a1744d88059b3f132db998a, role.id=09faee4fb963419e9d5409d109523f73, scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:15.824417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc29090-43ab-4b67-a1da-b2956be8dcd5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.825939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc29090-43ab-4b67-a1da-b2956be8dcd5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.832235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b56af-04d9-4a16-ba2d-1b794b984459 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:15.832520 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 166/335] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Oct 24 08:36:15 2022] GET /identity/v3/role_assignments?group.id=b0b4fb159a1744d88059b3f132db998a&scope.project.id=d847baf7ffdf4cee844beb6e1c188d1b&role.id=09faee4fb963419e9d5409d109523f73 => generated 611 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:15.850879 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:15.884213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff3220-68eb-4ab9-be5a-594793d04012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:15.884985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3220-68eb-4ab9-be5a-594793d04012 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:15.885411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3220-68eb-4ab9-be5a-594793d04012 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:15.885776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff3220-68eb-4ab9-be5a-594793d04012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:15.886639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff3220-68eb-4ab9-be5a-594793d04012 None admin] RBAC: Adding query filter params (group.id=bcb46bc8ff06441f8256ef22e8727cec, role.id=d266f03406d94df8bb9cad19b577978f, scope.project.id=d5d57fb385334787a7547e0f12982788) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:15.887124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff3220-68eb-4ab9-be5a-594793d04012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:15.888754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff3220-68eb-4ab9-be5a-594793d04012 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:15.896064 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 170/336] 10.222.0.25 () {56 vars in 1376 bytes} [Mon Oct 24 08:36:15 2022] GET /identity/v3/role_assignments?group.id=bcb46bc8ff06441f8256ef22e8727cec&scope.project.id=d5d57fb385334787a7547e0f12982788&role.id=d266f03406d94df8bb9cad19b577978f => generated 611 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:18.853865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307b56-2a8a-4516-874d-a3b684e5ebc8 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.854379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307b56-2a8a-4516-874d-a3b684e5ebc8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.854379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1307b56-2a8a-4516-874d-a3b684e5ebc8 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.856016 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 167/337] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:18.861326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21fed4-7607-413b-9f65-1f8c449cfdfd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:18.862139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21fed4-7607-413b-9f65-1f8c449cfdfd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:18.862570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e21fed4-7607-413b-9f65-1f8c449cfdfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:18.888365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1e21fed4-7607-413b-9f65-1f8c449cfdfd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:18.889881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1e21fed4-7607-413b-9f65-1f8c449cfdfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:18.983413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 171/338] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:19.000282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b248261-637b-467e-bb12-a57f26b71d1b None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.000703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b248261-637b-467e-bb12-a57f26b71d1b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.001082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b248261-637b-467e-bb12-a57f26b71d1b None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.002860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 168/339] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:19.008309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753b1e9-a0db-4e4a-aad3-3d3635d2ddc2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.008713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753b1e9-a0db-4e4a-aad3-3d3635d2ddc2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.009517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5753b1e9-a0db-4e4a-aad3-3d3635d2ddc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.035353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5753b1e9-a0db-4e4a-aad3-3d3635d2ddc2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:19.036574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5753b1e9-a0db-4e4a-aad3-3d3635d2ddc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:19.127213 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 172/340] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:19.278640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b248261-637b-467e-bb12-a57f26b71d1b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.322391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90047a-1fc5-4844-92aa-40820d84e9e1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.322681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90047a-1fc5-4844-92aa-40820d84e9e1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.322957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed90047a-1fc5-4844-92aa-40820d84e9e1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.324470 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 173/341] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:19.329729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f58bc-1c91-4c1d-85c9-496f8d9b9d19 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.330006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f58bc-1c91-4c1d-85c9-496f8d9b9d19 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.330282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7f58bc-1c91-4c1d-85c9-496f8d9b9d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.342938 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.366335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ff7f58bc-1c91-4c1d-85c9-496f8d9b9d19 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:19.368625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff7f58bc-1c91-4c1d-85c9-496f8d9b9d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:19.434729 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.442790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b248261-637b-467e-bb12-a57f26b71d1b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.510200 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 174/342] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:36:19.511530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a12a39-3ffb-444f-8a2f-c66636c1ca50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.512163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12a39-3ffb-444f-8a2f-c66636c1ca50 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.512441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12a39-3ffb-444f-8a2f-c66636c1ca50 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.512713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a12a39-3ffb-444f-8a2f-c66636c1ca50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.524044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a12a39-3ffb-444f-8a2f-c66636c1ca50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.526081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a12a39-3ffb-444f-8a2f-c66636c1ca50 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.530440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f58bc-1c91-4c1d-85c9-496f8d9b9d19 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-06a12a39-3ffb-444f-8a2f-c66636c1ca50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:19.545932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:19.546939 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:19.547807 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:19.547807 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:19.547807 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:19.547807 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 169/343] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:19.548495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9f948-6ee5-4f94-9cf5-cd524710b0e3 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.548668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9f948-6ee5-4f94-9cf5-cd524710b0e3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.548967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae9f948-6ee5-4f94-9cf5-cd524710b0e3 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.550210 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 170/344] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:19.554244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9f948-6ee5-4f94-9cf5-cd524710b0e3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.668766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7f58bc-1c91-4c1d-85c9-496f8d9b9d19 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.704959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9ac8d-0fbe-4f10-aa27-1aaaf498bb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.705581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ac8d-0fbe-4f10-aa27-1aaaf498bb7a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.705860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ac8d-0fbe-4f10-aa27-1aaaf498bb7a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.706133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9ac8d-0fbe-4f10-aa27-1aaaf498bb7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.706800 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.712586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae9f948-6ee5-4f94-9cf5-cd524710b0e3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.719220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9ac8d-0fbe-4f10-aa27-1aaaf498bb7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.720786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9ac8d-0fbe-4f10-aa27-1aaaf498bb7a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-0cd9ac8d-0fbe-4f10-aa27-1aaaf498bb7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:19.736813 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:19.738026 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:19.739377 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:19.739377 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:19.739377 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:19.741328 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 175/345] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:19.741328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b89105-a85e-45e6-99c0-66fe1a87d133 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.741768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b89105-a85e-45e6-99c0-66fe1a87d133 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.742114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b89105-a85e-45e6-99c0-66fe1a87d133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.757911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7bf19-c13f-4bf0-be13-7f133c18faa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.758527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7bf19-c13f-4bf0-be13-7f133c18faa1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.759460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7bf19-c13f-4bf0-be13-7f133c18faa1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.759714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c7bf19-c13f-4bf0-be13-7f133c18faa1 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.760399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7bf19-c13f-4bf0-be13-7f133c18faa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:19.760697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7bf19-c13f-4bf0-be13-7f133c18faa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.762179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c7bf19-c13f-4bf0-be13-7f133c18faa1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.764532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-92b89105-a85e-45e6-99c0-66fe1a87d133 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:19.765852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-92b89105-a85e-45e6-99c0-66fe1a87d133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:19.776776 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 171/346] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:19.777822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7bf19-c13f-4bf0-be13-7f133c18faa1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.782907 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:19.842224 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 176/347] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:19.845840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b89105-a85e-45e6-99c0-66fe1a87d133 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.914145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c7bf19-c13f-4bf0-be13-7f133c18faa1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.952880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b89105-a85e-45e6-99c0-66fe1a87d133 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:19.965387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff013-fa1f-4168-bfd5-48db997db4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.966279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff013-fa1f-4168-bfd5-48db997db4be None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.966756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff013-fa1f-4168-bfd5-48db997db4be None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.967293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538ff013-fa1f-4168-bfd5-48db997db4be None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.968221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ff013-fa1f-4168-bfd5-48db997db4be None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:19.968716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ff013-fa1f-4168-bfd5-48db997db4be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.970316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538ff013-fa1f-4168-bfd5-48db997db4be None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:19.986262 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 172/348] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:19.987800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff013-fa1f-4168-bfd5-48db997db4be None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:19.989915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4863c3e-e50b-4227-b89b-9d4f0b210354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:19.990594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4863c3e-e50b-4227-b89b-9d4f0b210354 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:19.990879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4863c3e-e50b-4227-b89b-9d4f0b210354 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:19.991150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4863c3e-e50b-4227-b89b-9d4f0b210354 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:19.991804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4863c3e-e50b-4227-b89b-9d4f0b210354 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:19.993905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4863c3e-e50b-4227-b89b-9d4f0b210354 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.021993 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:20.023055 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 177/349] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:36:19 2022] POST /identity/v3/users => generated 246 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:20.029578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4863c3e-e50b-4227-b89b-9d4f0b210354 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:20.050035 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:20.179789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538ff013-fa1f-4168-bfd5-48db997db4be None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:20.219295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4863c3e-e50b-4227-b89b-9d4f0b210354 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:20.221243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa2a5e-a848-4b09-a8e6-36768b79e111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:20.221926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa2a5e-a848-4b09-a8e6-36768b79e111 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.222208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa2a5e-a848-4b09-a8e6-36768b79e111 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.222478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa2a5e-a848-4b09-a8e6-36768b79e111 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.234263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa2a5e-a848-4b09-a8e6-36768b79e111 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:20.235742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa2a5e-a848-4b09-a8e6-36768b79e111 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-5aaa2a5e-a848-4b09-a8e6-36768b79e111 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:20.254679 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:20.255651 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:20.256498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:20.256498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:20.256498 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:20.256498 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 173/350] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:20.257588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa2a5e-a848-4b09-a8e6-36768b79e111 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:20.273750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26d0c99-c9e1-4487-9a03-5d211b1e8bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:20.275031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0c99-c9e1-4487-9a03-5d211b1e8bc4 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.275198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0c99-c9e1-4487-9a03-5d211b1e8bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.276232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26d0c99-c9e1-4487-9a03-5d211b1e8bc4 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.276232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d0c99-c9e1-4487-9a03-5d211b1e8bc4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:20.278295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26d0c99-c9e1-4487-9a03-5d211b1e8bc4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.302835 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 178/351] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:36:20 2022] POST /identity/v3/users => generated 248 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:20.309610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42776e-2439-4458-9ee7-1f63391c7948 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.309610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42776e-2439-4458-9ee7-1f63391c7948 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.309610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af42776e-2439-4458-9ee7-1f63391c7948 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.313506 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 179/352] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:20.315303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42776e-2439-4458-9ee7-1f63391c7948 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:20.361700 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:20.401015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa2a5e-a848-4b09-a8e6-36768b79e111 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:20.411079 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:20.445274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d163c1e-2056-41cb-9c08-17771bd79963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:20.446016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d163c1e-2056-41cb-9c08-17771bd79963 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.446318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d163c1e-2056-41cb-9c08-17771bd79963 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.446839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d163c1e-2056-41cb-9c08-17771bd79963 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.459958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d163c1e-2056-41cb-9c08-17771bd79963 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:20.461586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d163c1e-2056-41cb-9c08-17771bd79963 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.471374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af42776e-2439-4458-9ee7-1f63391c7948 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-4d163c1e-2056-41cb-9c08-17771bd79963 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:20.478909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:20.479893 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:20.480796 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:20.480796 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:20.480796 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:20.480796 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 174/353] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:20.481498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11da30-3946-4dd2-b3b2-c924e2201d7c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.481609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11da30-3946-4dd2-b3b2-c924e2201d7c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.481825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e11da30-3946-4dd2-b3b2-c924e2201d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.507993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3e11da30-3946-4dd2-b3b2-c924e2201d7c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:20.509933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3e11da30-3946-4dd2-b3b2-c924e2201d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:20.523994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf54c9a-ab57-4cd6-b457-bf3c73f3f4e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:20.525039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf54c9a-ab57-4cd6-b457-bf3c73f3f4e8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.525406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf54c9a-ab57-4cd6-b457-bf3c73f3f4e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.525690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf54c9a-ab57-4cd6-b457-bf3c73f3f4e8 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.526331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf54c9a-ab57-4cd6-b457-bf3c73f3f4e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:20.526631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf54c9a-ab57-4cd6-b457-bf3c73f3f4e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:20.528098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf54c9a-ab57-4cd6-b457-bf3c73f3f4e8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.543349 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 180/354] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:20.544475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf54c9a-ab57-4cd6-b457-bf3c73f3f4e8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:20.592905 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 175/355] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:20.600214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11da30-3946-4dd2-b3b2-c924e2201d7c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:20.659614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf54c9a-ab57-4cd6-b457-bf3c73f3f4e8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:20.686700 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:20.701349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e3dca-670a-44c8-8104-bc064a717cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:20.701972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3dca-670a-44c8-8104-bc064a717cc7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.702404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3dca-670a-44c8-8104-bc064a717cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.702688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8e3dca-670a-44c8-8104-bc064a717cc7 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.703329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e3dca-670a-44c8-8104-bc064a717cc7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:20.703628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e3dca-670a-44c8-8104-bc064a717cc7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:20.705178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8e3dca-670a-44c8-8104-bc064a717cc7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.723565 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 181/356] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:20.724710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e3dca-670a-44c8-8104-bc064a717cc7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:20.742897 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:20.839880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8e3dca-670a-44c8-8104-bc064a717cc7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:20.865867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e11da30-3946-4dd2-b3b2-c924e2201d7c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:20.877691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3870-3338-4be7-b12c-04bc8802ab30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:20.878302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3870-3338-4be7-b12c-04bc8802ab30 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.878580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3870-3338-4be7-b12c-04bc8802ab30 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.878853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edd3870-3338-4be7-b12c-04bc8802ab30 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.879498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd3870-3338-4be7-b12c-04bc8802ab30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:20.880937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edd3870-3338-4be7-b12c-04bc8802ab30 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.916247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d5212-1841-4b49-ab14-0fd48d43077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:20.916906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d5212-1841-4b49-ab14-0fd48d43077b None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:20.917235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d5212-1841-4b49-ab14-0fd48d43077b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:20.917582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6d5212-1841-4b49-ab14-0fd48d43077b None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:20.918270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d5212-1841-4b49-ab14-0fd48d43077b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:20.919876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6d5212-1841-4b49-ab14-0fd48d43077b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:20.922922 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 182/357] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:36:20 2022] POST /identity/v3/users => generated 249 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:20.944761 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 176/358] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:36:20 2022] POST /identity/v3/users => generated 248 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:21.105411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3870-3338-4be7-b12c-04bc8802ab30 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:21.156817 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:21.238085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edd3870-3338-4be7-b12c-04bc8802ab30 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:21.277199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:21.277848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:21.278127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:21.278400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:21.279084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:21.280465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:21.289187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 08:36:21.289187 n-d-master-1 devstack@keystone.service[88312]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 08:36:21.289187 n-d-master-1 devstack@keystone.service[88312]: [parameters: {'id': '2125672a78f24855ae4df5cba11ea8f1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 08:36:21.289187 n-d-master-1 devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 08:36:21.297180 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return ref.to_dict() Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:36:21.298094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:36:21.299228 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:36:21.300067 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:36:21.300905 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:36:21.302669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'id': '2125672a78f24855ae4df5cba11ea8f1', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:21.304390 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Oct 24 08:36:21.306687 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:21.313084 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 183/359] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Oct 24 08:36:21 2022] POST /identity/v3/roles => generated 144 bytes in 194 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:21.316137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d5212-1841-4b49-ab14-0fd48d43077b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:21.428370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6d5212-1841-4b49-ab14-0fd48d43077b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:21.445891 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:21.470760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74901f6a-0809-4478-8da9-64ffcd04b485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:21.471393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901f6a-0809-4478-8da9-64ffcd04b485 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:21.471671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901f6a-0809-4478-8da9-64ffcd04b485 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:21.471945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74901f6a-0809-4478-8da9-64ffcd04b485 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:21.482959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74901f6a-0809-4478-8da9-64ffcd04b485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-74901f6a-0809-4478-8da9-64ffcd04b485 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:21.489502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:21.490457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:21.491457 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 177/360] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:21.498765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:21.626779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20c998-eea8-4972-b643-ec3ed29d182f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:21.628763 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:21.664011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a322f18-4dad-4b29-80cf-145cd5d7cf70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:21.664988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a322f18-4dad-4b29-80cf-145cd5d7cf70 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:21.665994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a322f18-4dad-4b29-80cf-145cd5d7cf70 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:21.666461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a322f18-4dad-4b29-80cf-145cd5d7cf70 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:21.667310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a322f18-4dad-4b29-80cf-145cd5d7cf70 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:21.667805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a322f18-4dad-4b29-80cf-145cd5d7cf70 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:21.669426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a322f18-4dad-4b29-80cf-145cd5d7cf70 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:21.685531 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 184/361] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:22.618538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091709ec-97db-47cc-982f-c45e2ef80813 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.619043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091709ec-97db-47cc-982f-c45e2ef80813 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.619581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091709ec-97db-47cc-982f-c45e2ef80813 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.622344 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 178/362] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:22.631411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415b33-3de7-42bf-aa3c-246336523903 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:22.632251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415b33-3de7-42bf-aa3c-246336523903 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:22.632721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1415b33-3de7-42bf-aa3c-246336523903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:22.656881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a1415b33-3de7-42bf-aa3c-246336523903 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:22.658452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a1415b33-3de7-42bf-aa3c-246336523903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:22.727272 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 185/363] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:36:23.215449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8dc60-ca30-4028-89e4-df104ddd2de1 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.215912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8dc60-ca30-4028-89e4-df104ddd2de1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.216360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa8dc60-ca30-4028-89e4-df104ddd2de1 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.218818 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 179/364] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:23.226980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68bfa-203a-4674-aa5f-0943690f8e7a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.227469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68bfa-203a-4674-aa5f-0943690f8e7a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.227966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe68bfa-203a-4674-aa5f-0943690f8e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.256054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cbe68bfa-203a-4674-aa5f-0943690f8e7a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:23.258072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cbe68bfa-203a-4674-aa5f-0943690f8e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:23.324346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8dc60-ca30-4028-89e4-df104ddd2de1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.374453 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 186/365] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:23.486698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa8dc60-ca30-4028-89e4-df104ddd2de1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.538544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf20d35-e422-4ca9-b3d1-ae26874651fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.539527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf20d35-e422-4ca9-b3d1-ae26874651fb None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.540003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf20d35-e422-4ca9-b3d1-ae26874651fb None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.541020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf20d35-e422-4ca9-b3d1-ae26874651fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.552622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf20d35-e422-4ca9-b3d1-ae26874651fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-4cf20d35-e422-4ca9-b3d1-ae26874651fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:23.558300 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:23.559218 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:23.560041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:23.563619 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 180/366] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:23.569054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68bfa-203a-4674-aa5f-0943690f8e7a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.620672 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:23.722267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe68bfa-203a-4674-aa5f-0943690f8e7a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.767361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448c4c9-613d-42e9-9a85-bf998ee7422e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.768010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448c4c9-613d-42e9-9a85-bf998ee7422e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.768295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448c4c9-613d-42e9-9a85-bf998ee7422e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.768566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6448c4c9-613d-42e9-9a85-bf998ee7422e None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.769227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448c4c9-613d-42e9-9a85-bf998ee7422e None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:23.769635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448c4c9-613d-42e9-9a85-bf998ee7422e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:23.771025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6448c4c9-613d-42e9-9a85-bf998ee7422e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:23.786232 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 187/367] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:23.793020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf20d35-e422-4ca9-b3d1-ae26874651fb None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.796416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448c4c9-613d-42e9-9a85-bf998ee7422e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:23.835331 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:23.914001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf20d35-e422-4ca9-b3d1-ae26874651fb None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.966672 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:23.972098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bb59f7-1195-433c-8fd8-fe481e37180f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:23.973327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb59f7-1195-433c-8fd8-fe481e37180f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:23.974168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb59f7-1195-433c-8fd8-fe481e37180f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:23.974595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bb59f7-1195-433c-8fd8-fe481e37180f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:23.984024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6448c4c9-613d-42e9-9a85-bf998ee7422e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:23.987411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb59f7-1195-433c-8fd8-fe481e37180f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:23.989423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1bb59f7-1195-433c-8fd8-fe481e37180f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c1bb59f7-1195-433c-8fd8-fe481e37180f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:24.006442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:24.007577 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:24.008660 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:24.008660 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:24.008660 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:24.010556 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 181/368] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:24.016521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7832e0a-7f25-44f5-a862-16b239115d20 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.017010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7832e0a-7f25-44f5-a862-16b239115d20 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.017526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7832e0a-7f25-44f5-a862-16b239115d20 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.019015 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 182/369] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:24.019879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7832e0a-7f25-44f5-a862-16b239115d20 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.025454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5553eac-5ef0-4612-9fa2-4b2b9c427c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.026974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553eac-5ef0-4612-9fa2-4b2b9c427c4e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.029668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553eac-5ef0-4612-9fa2-4b2b9c427c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.030054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5553eac-5ef0-4612-9fa2-4b2b9c427c4e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.044422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5553eac-5ef0-4612-9fa2-4b2b9c427c4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d5553eac-5ef0-4612-9fa2-4b2b9c427c4e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:24.051113 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:24.052044 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:24.052955 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 188/370] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:24.054463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43255e-013d-45e3-b22f-4e5a05e3bcd1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.054732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43255e-013d-45e3-b22f-4e5a05e3bcd1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.055013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d43255e-013d-45e3-b22f-4e5a05e3bcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.076074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9d43255e-013d-45e3-b22f-4e5a05e3bcd1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:24.077275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9d43255e-013d-45e3-b22f-4e5a05e3bcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:24.114819 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:24.135760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7832e0a-7f25-44f5-a862-16b239115d20 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:24.150935 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 189/371] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:24.154683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b11df-7260-4c95-bedf-fc6b19cf4d1d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.155195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b11df-7260-4c95-bedf-fc6b19cf4d1d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.155665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686b11df-7260-4c95-bedf-fc6b19cf4d1d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.157164 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 190/372] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:24.158333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b11df-7260-4c95-bedf-fc6b19cf4d1d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.184415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4214f452-7b26-433e-bc6e-f0d53daabf68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.184858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214f452-7b26-433e-bc6e-f0d53daabf68 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.185139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214f452-7b26-433e-bc6e-f0d53daabf68 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.185448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4214f452-7b26-433e-bc6e-f0d53daabf68 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.186097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214f452-7b26-433e-bc6e-f0d53daabf68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:24.186401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214f452-7b26-433e-bc6e-f0d53daabf68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:24.187771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4214f452-7b26-433e-bc6e-f0d53daabf68 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:24.205234 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 183/373] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:24.206595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd518305-1a90-4464-869d-872e87655098 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.206880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd518305-1a90-4464-869d-872e87655098 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.207161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd518305-1a90-4464-869d-872e87655098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.226076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dd518305-1a90-4464-869d-872e87655098 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:24.227273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dd518305-1a90-4464-869d-872e87655098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:24.272674 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:24.305171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686b11df-7260-4c95-bedf-fc6b19cf4d1d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:24.319915 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 184/374] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:24.321009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd518305-1a90-4464-869d-872e87655098 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.345905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ffe39-867e-4c6b-babc-b3710d8d0e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.347106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ffe39-867e-4c6b-babc-b3710d8d0e55 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.347529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ffe39-867e-4c6b-babc-b3710d8d0e55 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.347970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55ffe39-867e-4c6b-babc-b3710d8d0e55 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.349221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ffe39-867e-4c6b-babc-b3710d8d0e55 None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:24.349931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ffe39-867e-4c6b-babc-b3710d8d0e55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:24.351832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55ffe39-867e-4c6b-babc-b3710d8d0e55 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:24.361735 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 191/375] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:24.369438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ffe39-867e-4c6b-babc-b3710d8d0e55 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.445231 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:24.478295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd518305-1a90-4464-869d-872e87655098 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:24.479258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55ffe39-867e-4c6b-babc-b3710d8d0e55 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:24.515727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb6c54-f29e-4aa9-9644-95a590e2ff9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.516461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb6c54-f29e-4aa9-9644-95a590e2ff9c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.516744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb6c54-f29e-4aa9-9644-95a590e2ff9c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.517125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb6c54-f29e-4aa9-9644-95a590e2ff9c None admin] PATH_INFO: `/v3/users/nova` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.518320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216bcfe-ec3b-48e9-9aac-25363b423a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.519106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216bcfe-ec3b-48e9-9aac-25363b423a80 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.519549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216bcfe-ec3b-48e9-9aac-25363b423a80 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.519964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216bcfe-ec3b-48e9-9aac-25363b423a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.524899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb6c54-f29e-4aa9-9644-95a590e2ff9c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:24.526309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb6c54-f29e-4aa9-9644-95a590e2ff9c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:24.532212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216bcfe-ec3b-48e9-9aac-25363b423a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:24.534379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216bcfe-ec3b-48e9-9aac-25363b423a80 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-53cb6c54-f29e-4aa9-9644-95a590e2ff9c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:24.539631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:24.541078 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:24.542126 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 185/376] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:24.542687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb6c54-f29e-4aa9-9644-95a590e2ff9c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.552215 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-1216bcfe-ec3b-48e9-9aac-25363b423a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:24.553436 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:24.554304 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:24.555159 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:24.555159 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:24.555159 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:24.562293 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 192/377] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:24.563448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216bcfe-ec3b-48e9-9aac-25363b423a80 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.657373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb6c54-f29e-4aa9-9644-95a590e2ff9c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:24.676254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216bcfe-ec3b-48e9-9aac-25363b423a80 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:24.690277 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:24.695607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b5a2d-0d93-4397-91d6-33cb52292409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.696243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b5a2d-0d93-4397-91d6-33cb52292409 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.697035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b5a2d-0d93-4397-91d6-33cb52292409 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.697603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769b5a2d-0d93-4397-91d6-33cb52292409 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.708022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769b5a2d-0d93-4397-91d6-33cb52292409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-769b5a2d-0d93-4397-91d6-33cb52292409 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:24.713944 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:24.715053 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:24.715862 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 186/378] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:24.716536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b5a2d-0d93-4397-91d6-33cb52292409 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.718879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6899ee2-5416-4bb8-adfb-36d82dc14180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.719722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899ee2-5416-4bb8-adfb-36d82dc14180 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.720260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899ee2-5416-4bb8-adfb-36d82dc14180 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.720677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6899ee2-5416-4bb8-adfb-36d82dc14180 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.721750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6899ee2-5416-4bb8-adfb-36d82dc14180 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:24.722200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6899ee2-5416-4bb8-adfb-36d82dc14180 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:24.723957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6899ee2-5416-4bb8-adfb-36d82dc14180 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:24.767578 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 193/379] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:24.768696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6899ee2-5416-4bb8-adfb-36d82dc14180 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.823862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769b5a2d-0d93-4397-91d6-33cb52292409 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:24.827050 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:24.861771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d8bb-3ae3-4ddb-b70e-b019da78c86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.862961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d8bb-3ae3-4ddb-b70e-b019da78c86f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.863427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d8bb-3ae3-4ddb-b70e-b019da78c86f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.863863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a79d8bb-3ae3-4ddb-b70e-b019da78c86f None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.865392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d8bb-3ae3-4ddb-b70e-b019da78c86f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:24.865835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d8bb-3ae3-4ddb-b70e-b019da78c86f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:24.867226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a79d8bb-3ae3-4ddb-b70e-b019da78c86f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:24.879058 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 187/380] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:24.879856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d8bb-3ae3-4ddb-b70e-b019da78c86f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.890454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6899ee2-5416-4bb8-adfb-36d82dc14180 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:24.923970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac36a6-ae67-47c5-abca-d3e0b9f7a362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:24.924604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac36a6-ae67-47c5-abca-d3e0b9f7a362 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:24.924884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac36a6-ae67-47c5-abca-d3e0b9f7a362 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:24.925156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac36a6-ae67-47c5-abca-d3e0b9f7a362 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:24.932271 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:24.936351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ac36a6-ae67-47c5-abca-d3e0b9f7a362 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-94ac36a6-ae67-47c5-abca-d3e0b9f7a362 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:24.941276 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:24.942190 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:24.943076 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 194/381] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:24.943755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac36a6-ae67-47c5-abca-d3e0b9f7a362 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:24.982495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a79d8bb-3ae3-4ddb-b70e-b019da78c86f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.017619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26993e92-34dd-463a-84cb-69e66e4494e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.018230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26993e92-34dd-463a-84cb-69e66e4494e8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.018506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26993e92-34dd-463a-84cb-69e66e4494e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.018778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26993e92-34dd-463a-84cb-69e66e4494e8 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.019435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26993e92-34dd-463a-84cb-69e66e4494e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:25.019736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26993e92-34dd-463a-84cb-69e66e4494e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.021106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26993e92-34dd-463a-84cb-69e66e4494e8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.029114 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 188/382] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:25.030329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cacbd-07ce-41a5-b3e3-fa30f07b7dda None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.030610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cacbd-07ce-41a5-b3e3-fa30f07b7dda None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.030882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984cacbd-07ce-41a5-b3e3-fa30f07b7dda None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.032233 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 189/383] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:25.032746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cacbd-07ce-41a5-b3e3-fa30f07b7dda None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.050088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac36a6-ae67-47c5-abca-d3e0b9f7a362 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.059893 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:25.084899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7dba6-4fb6-47ee-aca2-4b2668698127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.085478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7dba6-4fb6-47ee-aca2-4b2668698127 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.085753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7dba6-4fb6-47ee-aca2-4b2668698127 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.086011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b7dba6-4fb6-47ee-aca2-4b2668698127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.096245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7dba6-4fb6-47ee-aca2-4b2668698127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.097741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b7dba6-4fb6-47ee-aca2-4b2668698127 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-29b7dba6-4fb6-47ee-aca2-4b2668698127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:25.111589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:25.112618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:25.113866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:25.113866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:25.113866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:25.113866 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 195/384] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:25.113866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7dba6-4fb6-47ee-aca2-4b2668698127 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.138960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984cacbd-07ce-41a5-b3e3-fa30f07b7dda None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.153100 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:25.173735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a983409-603d-4e99-81c1-36c01f824fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.174390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a983409-603d-4e99-81c1-36c01f824fd6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.174665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a983409-603d-4e99-81c1-36c01f824fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.174933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a983409-603d-4e99-81c1-36c01f824fd6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.182403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a983409-603d-4e99-81c1-36c01f824fd6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.183866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a983409-603d-4e99-81c1-36c01f824fd6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-5a983409-603d-4e99-81c1-36c01f824fd6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:25.195029 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:25.195971 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:25.196909 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 190/385] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:25.197551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a983409-603d-4e99-81c1-36c01f824fd6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.219357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b7dba6-4fb6-47ee-aca2-4b2668698127 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.254765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b897c39f-8832-49df-bdb1-cc84f19bed35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.255372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897c39f-8832-49df-bdb1-cc84f19bed35 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.255654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897c39f-8832-49df-bdb1-cc84f19bed35 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.255931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b897c39f-8832-49df-bdb1-cc84f19bed35 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.256588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897c39f-8832-49df-bdb1-cc84f19bed35 None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:25.256889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897c39f-8832-49df-bdb1-cc84f19bed35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.258304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b897c39f-8832-49df-bdb1-cc84f19bed35 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.270506 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 196/386] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:25.270506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9575a4-0368-4a35-a11e-bc42014b1700 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.270506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9575a4-0368-4a35-a11e-bc42014b1700 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.270506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9575a4-0368-4a35-a11e-bc42014b1700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.286142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fb9575a4-0368-4a35-a11e-bc42014b1700 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:25.287383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb9575a4-0368-4a35-a11e-bc42014b1700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:25.304302 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:25.307344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a983409-603d-4e99-81c1-36c01f824fd6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.341524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3628c-ca38-424b-92ec-335e7f0799d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.342074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3628c-ca38-424b-92ec-335e7f0799d7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.342359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3628c-ca38-424b-92ec-335e7f0799d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.342652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f3628c-ca38-424b-92ec-335e7f0799d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.353479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3628c-ca38-424b-92ec-335e7f0799d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.354938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f3628c-ca38-424b-92ec-335e7f0799d7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.355039 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 197/387] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:25.355869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9575a4-0368-4a35-a11e-bc42014b1700 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-38f3628c-ca38-424b-92ec-335e7f0799d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:25.369544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:25.370502 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:25.371338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:25.371338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:25.371338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:25.371338 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 191/388] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:25.371569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3628c-ca38-424b-92ec-335e7f0799d7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.400356 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:25.481367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9575a4-0368-4a35-a11e-bc42014b1700 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.481884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f3628c-ca38-424b-92ec-335e7f0799d7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.516028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cdc55-920b-471d-8755-bcd2c9061be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.516769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cdc55-920b-471d-8755-bcd2c9061be3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.517150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cdc55-920b-471d-8755-bcd2c9061be3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.517459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898cdc55-920b-471d-8755-bcd2c9061be3 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.517971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243a4ad-a43e-4f86-a121-16678840dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.518189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cdc55-920b-471d-8755-bcd2c9061be3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:25.518493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cdc55-920b-471d-8755-bcd2c9061be3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.518587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243a4ad-a43e-4f86-a121-16678840dd06 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.518846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243a4ad-a43e-4f86-a121-16678840dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.519121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243a4ad-a43e-4f86-a121-16678840dd06 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.519762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243a4ad-a43e-4f86-a121-16678840dd06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:25.519927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898cdc55-920b-471d-8755-bcd2c9061be3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.520077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243a4ad-a43e-4f86-a121-16678840dd06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.521460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243a4ad-a43e-4f86-a121-16678840dd06 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.538715 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 198/389] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:25.538715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243a4ad-a43e-4f86-a121-16678840dd06 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.554070 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:25.565888 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 192/390] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:25.565888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cdc55-920b-471d-8755-bcd2c9061be3 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.655838 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:25.659842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243a4ad-a43e-4f86-a121-16678840dd06 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.673242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898cdc55-920b-471d-8755-bcd2c9061be3 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.695119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15aad3-af48-471d-a382-5a133ec09938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.695748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15aad3-af48-471d-a382-5a133ec09938 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.696027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15aad3-af48-471d-a382-5a133ec09938 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.696335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc15aad3-af48-471d-a382-5a133ec09938 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.706787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15aad3-af48-471d-a382-5a133ec09938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.708234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc15aad3-af48-471d-a382-5a133ec09938 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.709018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631685a-a2e5-45fe-9e4b-06cf0abbf0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.709647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631685a-a2e5-45fe-9e4b-06cf0abbf0e1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.709976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631685a-a2e5-45fe-9e4b-06cf0abbf0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.710238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b631685a-a2e5-45fe-9e4b-06cf0abbf0e1 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.710890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631685a-a2e5-45fe-9e4b-06cf0abbf0e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:25.711182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631685a-a2e5-45fe-9e4b-06cf0abbf0e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.713807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b631685a-a2e5-45fe-9e4b-06cf0abbf0e1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-cc15aad3-af48-471d-a382-5a133ec09938 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:25.722974 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:25.724022 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:25.725540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:25.725540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:25.725540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:25.725540 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 199/391] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:25.725540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15aad3-af48-471d-a382-5a133ec09938 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.725955 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 193/392] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:25.726631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631685a-a2e5-45fe-9e4b-06cf0abbf0e1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.788633 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:25.825623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc15aad3-af48-471d-a382-5a133ec09938 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.827655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b631685a-a2e5-45fe-9e4b-06cf0abbf0e1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.859683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430248e-265b-4988-adc1-c850c4560aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.860284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36313ab-98ed-4e59-820b-c7286344ceb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:25.860399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430248e-265b-4988-adc1-c850c4560aab None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.860576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430248e-265b-4988-adc1-c850c4560aab None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.860850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4430248e-265b-4988-adc1-c850c4560aab None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.860949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36313ab-98ed-4e59-820b-c7286344ceb1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:25.861160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36313ab-98ed-4e59-820b-c7286344ceb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:25.861463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36313ab-98ed-4e59-820b-c7286344ceb1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:25.867611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430248e-265b-4988-adc1-c850c4560aab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.869629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4430248e-265b-4988-adc1-c850c4560aab None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.872482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36313ab-98ed-4e59-820b-c7286344ceb1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:25.873955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36313ab-98ed-4e59-820b-c7286344ceb1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:25.876452 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4430248e-265b-4988-adc1-c850c4560aab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:25.881500 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:25.882486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:25.883375 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:25.883375 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:25.883375 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:25.883375 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:25.883375 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:25.883375 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:25.883375 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:25.883375 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:25.887458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 200/393] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:25.888086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430248e-265b-4988-adc1-c850c4560aab None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-f36313ab-98ed-4e59-820b-c7286344ceb1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:25.888753 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:25.889642 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:25.890499 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:25.890499 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:25.890499 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:25.892302 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 194/394] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:25.892915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36313ab-98ed-4e59-820b-c7286344ceb1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:25.992332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4430248e-265b-4988-adc1-c850c4560aab None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:25.994542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36313ab-98ed-4e59-820b-c7286344ceb1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.019043 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.031012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112791cb-c4f3-4baf-801d-b7738fbf5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.031238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7908d-43fb-43f1-beb7-ec94061a92ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.031609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112791cb-c4f3-4baf-801d-b7738fbf5767 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.031751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7908d-43fb-43f1-beb7-ec94061a92ae None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.031882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112791cb-c4f3-4baf-801d-b7738fbf5767 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.032029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7908d-43fb-43f1-beb7-ec94061a92ae None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.032131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112791cb-c4f3-4baf-801d-b7738fbf5767 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.032301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe7908d-43fb-43f1-beb7-ec94061a92ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.032752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112791cb-c4f3-4baf-801d-b7738fbf5767 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:26.033056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112791cb-c4f3-4baf-801d-b7738fbf5767 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.034449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112791cb-c4f3-4baf-801d-b7738fbf5767 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.044125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7908d-43fb-43f1-beb7-ec94061a92ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.045616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe7908d-43fb-43f1-beb7-ec94061a92ae None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.047924 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 195/395] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:26.048597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112791cb-c4f3-4baf-801d-b7738fbf5767 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6fe7908d-43fb-43f1-beb7-ec94061a92ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:26.061332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:26.062424 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:26.063295 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:26.063295 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:26.063295 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:26.063295 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 201/396] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:26.063295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7908d-43fb-43f1-beb7-ec94061a92ae None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.112424 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.168217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112791cb-c4f3-4baf-801d-b7738fbf5767 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.174796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe7908d-43fb-43f1-beb7-ec94061a92ae None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.202370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822a99-55c2-415b-81e0-348b577a104f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.202997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822a99-55c2-415b-81e0-348b577a104f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.203265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822a99-55c2-415b-81e0-348b577a104f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.203531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3822a99-55c2-415b-81e0-348b577a104f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.209424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579b5a-c3a5-45e3-9146-555079b67f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.210026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579b5a-c3a5-45e3-9146-555079b67f2b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.210304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579b5a-c3a5-45e3-9146-555079b67f2b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.210576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb579b5a-c3a5-45e3-9146-555079b67f2b None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.210968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3822a99-55c2-415b-81e0-348b577a104f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.211264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579b5a-c3a5-45e3-9146-555079b67f2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:26.211568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579b5a-c3a5-45e3-9146-555079b67f2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.213094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3822a99-55c2-415b-81e0-348b577a104f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.213623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb579b5a-c3a5-45e3-9146-555079b67f2b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d3822a99-55c2-415b-81e0-348b577a104f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:26.226841 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:26.227919 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 196/397] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:26.228846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822a99-55c2-415b-81e0-348b577a104f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.234236 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 202/398] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:26.235194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579b5a-c3a5-45e3-9146-555079b67f2b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.271079 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.334547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3822a99-55c2-415b-81e0-348b577a104f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.336723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb579b5a-c3a5-45e3-9146-555079b67f2b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.351616 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.369642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0478bb-28d9-4458-a21c-4d5a8b51f3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.370241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0478bb-28d9-4458-a21c-4d5a8b51f3c8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.370518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0478bb-28d9-4458-a21c-4d5a8b51f3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.370788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0478bb-28d9-4458-a21c-4d5a8b51f3c8 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.371427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0478bb-28d9-4458-a21c-4d5a8b51f3c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:26.371554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac82063-b10c-4596-aefb-9c3583f55d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.371724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0478bb-28d9-4458-a21c-4d5a8b51f3c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.372186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac82063-b10c-4596-aefb-9c3583f55d53 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.372465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac82063-b10c-4596-aefb-9c3583f55d53 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.372954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac82063-b10c-4596-aefb-9c3583f55d53 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.373101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0478bb-28d9-4458-a21c-4d5a8b51f3c8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.380154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac82063-b10c-4596-aefb-9c3583f55d53 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.381640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac82063-b10c-4596-aefb-9c3583f55d53 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.386051 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 197/399] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:26.386877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0478bb-28d9-4458-a21c-4d5a8b51f3c8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-dac82063-b10c-4596-aefb-9c3583f55d53 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:26.395739 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:26.396931 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 203/400] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:26.398018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac82063-b10c-4596-aefb-9c3583f55d53 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.503327 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.504726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0478bb-28d9-4458-a21c-4d5a8b51f3c8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.510937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac82063-b10c-4596-aefb-9c3583f55d53 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.540458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dc56b-31ce-442a-9718-afc135d626fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.540921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc56b-31ce-442a-9718-afc135d626fa None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.541194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc56b-31ce-442a-9718-afc135d626fa None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.541493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512dc56b-31ce-442a-9718-afc135d626fa None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.542121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dc56b-31ce-442a-9718-afc135d626fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:26.542420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dc56b-31ce-442a-9718-afc135d626fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.543779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512dc56b-31ce-442a-9718-afc135d626fa None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.544194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62019f2f-65c0-4603-867b-0ea88d1d1305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.544799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62019f2f-65c0-4603-867b-0ea88d1d1305 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.545087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62019f2f-65c0-4603-867b-0ea88d1d1305 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.545388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62019f2f-65c0-4603-867b-0ea88d1d1305 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.546116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62019f2f-65c0-4603-867b-0ea88d1d1305 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:26.546425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62019f2f-65c0-4603-867b-0ea88d1d1305 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.547850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62019f2f-65c0-4603-867b-0ea88d1d1305 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.554909 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 198/401] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:26.556236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dc56b-31ce-442a-9718-afc135d626fa None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.566487 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 204/402] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:26.567333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62019f2f-65c0-4603-867b-0ea88d1d1305 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.592095 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.663949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512dc56b-31ce-442a-9718-afc135d626fa None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.671273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62019f2f-65c0-4603-867b-0ea88d1d1305 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.698894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d92e0-3753-4e59-a7e5-cbba30679fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.699547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d92e0-3753-4e59-a7e5-cbba30679fd0 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.699825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d92e0-3753-4e59-a7e5-cbba30679fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.700097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d92e0-3753-4e59-a7e5-cbba30679fd0 None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/b31aac6142684a039f9de2051fe42989/roles/9f1d8ee2ec724d0cbb41c537a7d38406` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.706968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba441b8-cb4f-41ff-a6b8-e0040ad08e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.707605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba441b8-cb4f-41ff-a6b8-e0040ad08e1b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.707892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba441b8-cb4f-41ff-a6b8-e0040ad08e1b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.708169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba441b8-cb4f-41ff-a6b8-e0040ad08e1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.715276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d92e0-3753-4e59-a7e5-cbba30679fd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=b31aac6142684a039f9de2051fe42989, role_id=9f1d8ee2ec724d0cbb41c537a7d38406)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.715481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba441b8-cb4f-41ff-a6b8-e0040ad08e1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.716715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d92e0-3753-4e59-a7e5-cbba30679fd0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.716842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba441b8-cb4f-41ff-a6b8-e0040ad08e1b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-dba441b8-cb4f-41ff-a6b8-e0040ad08e1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:26.728484 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:26.730106 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:26.731115 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:26.731115 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:26.731115 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:26.731115 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:26.731115 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:26.731115 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:26.731115 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:26.731115 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:26.731115 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 205/403] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:26.731661 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 199/404] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:26 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/b31aac6142684a039f9de2051fe42989/roles/9f1d8ee2ec724d0cbb41c537a7d38406 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:26.731661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d92e0-3753-4e59-a7e5-cbba30679fd0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.731783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba441b8-cb4f-41ff-a6b8-e0040ad08e1b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.750170 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.848058 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:26.866786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d92e0-3753-4e59-a7e5-cbba30679fd0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.869447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba441b8-cb4f-41ff-a6b8-e0040ad08e1b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:26.906803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75008d5f-2f5f-4a87-91d8-924041e24448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.907705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008d5f-2f5f-4a87-91d8-924041e24448 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.907970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008d5f-2f5f-4a87-91d8-924041e24448 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.908240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75008d5f-2f5f-4a87-91d8-924041e24448 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.908896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75008d5f-2f5f-4a87-91d8-924041e24448 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.910411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75008d5f-2f5f-4a87-91d8-924041e24448 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.914559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4909f-de13-4d15-b73b-f3a00d8b7e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:26.915347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4909f-de13-4d15-b73b-f3a00d8b7e6c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:26.915718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4909f-de13-4d15-b73b-f3a00d8b7e6c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:26.916092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf4909f-de13-4d15-b73b-f3a00d8b7e6c None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:26.916925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4909f-de13-4d15-b73b-f3a00d8b7e6c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:26.917377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4909f-de13-4d15-b73b-f3a00d8b7e6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:26.918947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf4909f-de13-4d15-b73b-f3a00d8b7e6c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:26.935318 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 200/405] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:36:26 2022] POST /identity/v3/users => generated 247 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:26.936151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75008d5f-2f5f-4a87-91d8-924041e24448 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:26.942483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 206/406] 10.222.0.25 () {56 vars in 1139 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:26.943455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4909f-de13-4d15-b73b-f3a00d8b7e6c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.035853 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.074931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf4909f-de13-4d15-b73b-f3a00d8b7e6c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.111437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75008d5f-2f5f-4a87-91d8-924041e24448 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.118979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cac326-83c6-4603-9cda-a9b6be4736a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.119952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cac326-83c6-4603-9cda-a9b6be4736a8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.120413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cac326-83c6-4603-9cda-a9b6be4736a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.120842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cac326-83c6-4603-9cda-a9b6be4736a8 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.121763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cac326-83c6-4603-9cda-a9b6be4736a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:27.122233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cac326-83c6-4603-9cda-a9b6be4736a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.123959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cac326-83c6-4603-9cda-a9b6be4736a8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.139029 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 207/407] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:27.140265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cac326-83c6-4603-9cda-a9b6be4736a8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.165654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d43784-0108-4e63-8bb1-752fbae872e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.166391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d43784-0108-4e63-8bb1-752fbae872e0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.166729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d43784-0108-4e63-8bb1-752fbae872e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.167064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d43784-0108-4e63-8bb1-752fbae872e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.189972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d43784-0108-4e63-8bb1-752fbae872e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.191527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d43784-0108-4e63-8bb1-752fbae872e0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.195384 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-b5d43784-0108-4e63-8bb1-752fbae872e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:27.213613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:27.214588 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:27.215727 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:27.215727 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:27.215727 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:27.216839 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 201/408] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:27.217853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d43784-0108-4e63-8bb1-752fbae872e0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.280095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cac326-83c6-4603-9cda-a9b6be4736a8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.321833 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.329966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2386bf3-cd8b-4a59-aac1-564485ef1977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.330790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d43784-0108-4e63-8bb1-752fbae872e0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.331023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2386bf3-cd8b-4a59-aac1-564485ef1977 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.331450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2386bf3-cd8b-4a59-aac1-564485ef1977 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.331872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2386bf3-cd8b-4a59-aac1-564485ef1977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.347718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2386bf3-cd8b-4a59-aac1-564485ef1977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.349978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2386bf3-cd8b-4a59-aac1-564485ef1977 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.369374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbfb38-83c2-45e1-a07b-7303ebe89e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.370104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbfb38-83c2-45e1-a07b-7303ebe89e93 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.370475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbfb38-83c2-45e1-a07b-7303ebe89e93 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.370843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fbfb38-83c2-45e1-a07b-7303ebe89e93 None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/3a1cba9ba74946de8c58da91e59ddcfc/roles/9f1d8ee2ec724d0cbb41c537a7d38406` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a2386bf3-cd8b-4a59-aac1-564485ef1977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:27.371088 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:27.371994 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:27.372848 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:27.372848 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:27.372848 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:27.374672 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 208/409] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:27.375921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2386bf3-cd8b-4a59-aac1-564485ef1977 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.397894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbfb38-83c2-45e1-a07b-7303ebe89e93 None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=3a1cba9ba74946de8c58da91e59ddcfc, role_id=9f1d8ee2ec724d0cbb41c537a7d38406)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.399356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fbfb38-83c2-45e1-a07b-7303ebe89e93 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.417436 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 202/410] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:27 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/3a1cba9ba74946de8c58da91e59ddcfc/roles/9f1d8ee2ec724d0cbb41c537a7d38406 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:27.418745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbfb38-83c2-45e1-a07b-7303ebe89e93 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.530600 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.604448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2386bf3-cd8b-4a59-aac1-564485ef1977 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.652790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fbfb38-83c2-45e1-a07b-7303ebe89e93 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.668241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eacdd0-7964-4156-a421-6582d9b18209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.668838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eacdd0-7964-4156-a421-6582d9b18209 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.669129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eacdd0-7964-4156-a421-6582d9b18209 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.669431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eacdd0-7964-4156-a421-6582d9b18209 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.670091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eacdd0-7964-4156-a421-6582d9b18209 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:27.670501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eacdd0-7964-4156-a421-6582d9b18209 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.671898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eacdd0-7964-4156-a421-6582d9b18209 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.689383 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 209/411] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:27.693857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3cd57-5d6f-4d90-a901-a5f58af77c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.694670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eacdd0-7964-4156-a421-6582d9b18209 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.694810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3cd57-5d6f-4d90-a901-a5f58af77c08 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.695301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3cd57-5d6f-4d90-a901-a5f58af77c08 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.695710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3cd57-5d6f-4d90-a901-a5f58af77c08 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.697173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3cd57-5d6f-4d90-a901-a5f58af77c08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:27.697692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3cd57-5d6f-4d90-a901-a5f58af77c08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.699552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a3cd57-5d6f-4d90-a901-a5f58af77c08 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.716761 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 203/412] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:27.722720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3cd57-5d6f-4d90-a901-a5f58af77c08 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.753871 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.815274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eacdd0-7964-4156-a421-6582d9b18209 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.857123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3cd57-5d6f-4d90-a901-a5f58af77c08 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:27.857666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797950f-bc98-4d6c-a8aa-cf2c39c314fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.858265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797950f-bc98-4d6c-a8aa-cf2c39c314fc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.858540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797950f-bc98-4d6c-a8aa-cf2c39c314fc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.858808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d797950f-bc98-4d6c-a8aa-cf2c39c314fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.862164 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:27.866377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797950f-bc98-4d6c-a8aa-cf2c39c314fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.867840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d797950f-bc98-4d6c-a8aa-cf2c39c314fc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d797950f-bc98-4d6c-a8aa-cf2c39c314fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:27.880710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:27.881918 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:27.882826 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:27.882826 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:27.882826 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:27.882826 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:27.882826 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:27.882826 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:27.882826 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:27.882826 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:27.882826 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 210/413] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:27.888122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797950f-bc98-4d6c-a8aa-cf2c39c314fc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:27.916398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96826299-9e74-4b9b-acaf-f6d2a18cda8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:27.916992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96826299-9e74-4b9b-acaf-f6d2a18cda8b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:27.917207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96826299-9e74-4b9b-acaf-f6d2a18cda8b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:27.917509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96826299-9e74-4b9b-acaf-f6d2a18cda8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:27.925003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96826299-9e74-4b9b-acaf-f6d2a18cda8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:27.926374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96826299-9e74-4b9b-acaf-f6d2a18cda8b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-96826299-9e74-4b9b-acaf-f6d2a18cda8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:27.939423 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:27.940336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:27.941188 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:27.941188 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:27.941188 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:27.941188 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:27.941188 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:27.941188 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:27.941188 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:27.941188 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:27.944843 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 204/414] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:27.946515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96826299-9e74-4b9b-acaf-f6d2a18cda8b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:28.020097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d797950f-bc98-4d6c-a8aa-cf2c39c314fc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.022921 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:28.050415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96826299-9e74-4b9b-acaf-f6d2a18cda8b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.063106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0b4d-bb75-43f3-bef6-513d0bac3a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.064554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0b4d-bb75-43f3-bef6-513d0bac3a9c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.065056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0b4d-bb75-43f3-bef6-513d0bac3a9c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.065562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947d0b4d-bb75-43f3-bef6-513d0bac3a9c None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.066819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d0b4d-bb75-43f3-bef6-513d0bac3a9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:28.067639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d0b4d-bb75-43f3-bef6-513d0bac3a9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.069619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947d0b4d-bb75-43f3-bef6-513d0bac3a9c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.086178 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 211/415] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:28.093834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0b4d-bb75-43f3-bef6-513d0bac3a9c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:28.106398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d88713-e01f-4bed-be8e-dd8bc2f17b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.107002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d88713-e01f-4bed-be8e-dd8bc2f17b9e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.107326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d88713-e01f-4bed-be8e-dd8bc2f17b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.107597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d88713-e01f-4bed-be8e-dd8bc2f17b9e None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.108289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d88713-e01f-4bed-be8e-dd8bc2f17b9e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:28.108589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d88713-e01f-4bed-be8e-dd8bc2f17b9e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.110148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d88713-e01f-4bed-be8e-dd8bc2f17b9e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.141348 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 205/416] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:28.141348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d88713-e01f-4bed-be8e-dd8bc2f17b9e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:28.202532 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:28.247159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947d0b4d-bb75-43f3-bef6-513d0bac3a9c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.285960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca7e21-c542-424a-9b60-f9f6156a23bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.286616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca7e21-c542-424a-9b60-f9f6156a23bd None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.286890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca7e21-c542-424a-9b60-f9f6156a23bd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.287162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca7e21-c542-424a-9b60-f9f6156a23bd None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/ed628f1d565e440792f530dd97512cf7/roles/9f1d8ee2ec724d0cbb41c537a7d38406` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.303496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca7e21-c542-424a-9b60-f9f6156a23bd None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=ed628f1d565e440792f530dd97512cf7, role_id=9f1d8ee2ec724d0cbb41c537a7d38406)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.305057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ca7e21-c542-424a-9b60-f9f6156a23bd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.320953 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 212/417] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:28 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/ed628f1d565e440792f530dd97512cf7/roles/9f1d8ee2ec724d0cbb41c537a7d38406 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:36:28.376198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d88713-e01f-4bed-be8e-dd8bc2f17b9e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:28.434937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8488edb-f2ee-42c4-9ad3-5e4de0325207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:28.435618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8488edb-f2ee-42c4-9ad3-5e4de0325207 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:28.435900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8488edb-f2ee-42c4-9ad3-5e4de0325207 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:28.436178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8488edb-f2ee-42c4-9ad3-5e4de0325207 None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/9ea1478025654b729f707edbaeff4e2b/roles/9f1d8ee2ec724d0cbb41c537a7d38406` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:28.452798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8488edb-f2ee-42c4-9ad3-5e4de0325207 None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=9ea1478025654b729f707edbaeff4e2b, role_id=9f1d8ee2ec724d0cbb41c537a7d38406)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:28.454225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8488edb-f2ee-42c4-9ad3-5e4de0325207 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:28.470904 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 206/418] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:28 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/9ea1478025654b729f707edbaeff4e2b/roles/9f1d8ee2ec724d0cbb41c537a7d38406 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:36:29.388052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7df52-7355-4534-a9dd-ae6839810d17 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:29.389084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7df52-7355-4534-a9dd-ae6839810d17 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:29.389585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d7df52-7355-4534-a9dd-ae6839810d17 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:29.391385 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 213/419] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:29.397263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edadf43-6efe-4586-a631-68b144c1991d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:29.398105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edadf43-6efe-4586-a631-68b144c1991d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:29.398572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edadf43-6efe-4586-a631-68b144c1991d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:29.418624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9edadf43-6efe-4586-a631-68b144c1991d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:29.420139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9edadf43-6efe-4586-a631-68b144c1991d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:29.493847 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 207/420] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:36:29.646091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91c0fe-83df-4305-b860-6d238b91db97 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:29.646735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91c0fe-83df-4305-b860-6d238b91db97 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:29.647203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac91c0fe-83df-4305-b860-6d238b91db97 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:29.648879 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 214/421] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:29.654751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441beeee-4fb4-4d11-9511-c55ff6e303b6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:29.655287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441beeee-4fb4-4d11-9511-c55ff6e303b6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:29.655781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441beeee-4fb4-4d11-9511-c55ff6e303b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:29.668665 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:29.686449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-441beeee-4fb4-4d11-9511-c55ff6e303b6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:29.687646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-441beeee-4fb4-4d11-9511-c55ff6e303b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:29.780133 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 208/422] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:29.858687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91c0fe-83df-4305-b860-6d238b91db97 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:29.876923 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:29.990160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac91c0fe-83df-4305-b860-6d238b91db97 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:30.048850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b99f2-03b6-44ac-a9c1-fa5dcc58483f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:30.049576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b99f2-03b6-44ac-a9c1-fa5dcc58483f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.049865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b99f2-03b6-44ac-a9c1-fa5dcc58483f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.050143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2b99f2-03b6-44ac-a9c1-fa5dcc58483f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.074492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2b99f2-03b6-44ac-a9c1-fa5dcc58483f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-7f2b99f2-03b6-44ac-a9c1-fa5dcc58483f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:30.079655 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:30.080617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:30.081472 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 215/423] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:30.087566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441beeee-4fb4-4d11-9511-c55ff6e303b6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:30.156717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b99f2-03b6-44ac-a9c1-fa5dcc58483f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:30.246057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441beeee-4fb4-4d11-9511-c55ff6e303b6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:30.253633 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:30.288087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2b99f2-03b6-44ac-a9c1-fa5dcc58483f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:30.292899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa489de-50e8-495f-a308-7a3193dc97f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:30.293799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa489de-50e8-495f-a308-7a3193dc97f8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.294300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa489de-50e8-495f-a308-7a3193dc97f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.294791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa489de-50e8-495f-a308-7a3193dc97f8 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.295738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa489de-50e8-495f-a308-7a3193dc97f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:30.296272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa489de-50e8-495f-a308-7a3193dc97f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:30.298445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa489de-50e8-495f-a308-7a3193dc97f8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:30.301119 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:30.312124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 209/424] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:30.313781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c51930-d659-4b67-b573-dbaa7801f603 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.314266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c51930-d659-4b67-b573-dbaa7801f603 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.314731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c51930-d659-4b67-b573-dbaa7801f603 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.320935 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 210/425] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:30.322682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c51930-d659-4b67-b573-dbaa7801f603 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:30.335923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322b369-544b-4331-b59f-ddcda2402563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:30.336611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b369-544b-4331-b59f-ddcda2402563 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.336890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b369-544b-4331-b59f-ddcda2402563 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.337800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322b369-544b-4331-b59f-ddcda2402563 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.349379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322b369-544b-4331-b59f-ddcda2402563 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a322b369-544b-4331-b59f-ddcda2402563 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:30.354474 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:30.355366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:30.356149 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 216/426] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:30.361799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f782d22-7c75-400e-9d23-78a1fbba2d86 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.361799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f782d22-7c75-400e-9d23-78a1fbba2d86 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.361799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f782d22-7c75-400e-9d23-78a1fbba2d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.377979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7f782d22-7c75-400e-9d23-78a1fbba2d86 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:30.379167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7f782d22-7c75-400e-9d23-78a1fbba2d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:30.465476 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 217/427] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:30.466507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f782d22-7c75-400e-9d23-78a1fbba2d86 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:30.470075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c51930-d659-4b67-b573-dbaa7801f603 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:30.510370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65678b9b-0b4b-4c31-a8ed-e5e3cce6ac5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:30.511333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65678b9b-0b4b-4c31-a8ed-e5e3cce6ac5a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.511827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65678b9b-0b4b-4c31-a8ed-e5e3cce6ac5a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.512311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65678b9b-0b4b-4c31-a8ed-e5e3cce6ac5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.526388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65678b9b-0b4b-4c31-a8ed-e5e3cce6ac5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:30.528569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65678b9b-0b4b-4c31-a8ed-e5e3cce6ac5a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-65678b9b-0b4b-4c31-a8ed-e5e3cce6ac5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:30.545899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:30.546845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:30.547686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:30.547686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:30.547686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:30.550252 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 211/428] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:30.559969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65678b9b-0b4b-4c31-a8ed-e5e3cce6ac5a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:30.591662 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:30.663104 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:30.671514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f782d22-7c75-400e-9d23-78a1fbba2d86 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:30.729234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65678b9b-0b4b-4c31-a8ed-e5e3cce6ac5a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:30.741797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4965af-5c21-4b57-a3e3-a67c8c1ce8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:30.744757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4965af-5c21-4b57-a3e3-a67c8c1ce8cc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.745033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4965af-5c21-4b57-a3e3-a67c8c1ce8cc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.745331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4965af-5c21-4b57-a3e3-a67c8c1ce8cc None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.746945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4965af-5c21-4b57-a3e3-a67c8c1ce8cc None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:30.748023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4965af-5c21-4b57-a3e3-a67c8c1ce8cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:30.752214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4965af-5c21-4b57-a3e3-a67c8c1ce8cc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:30.767123 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 218/429] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:30.773428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4965af-5c21-4b57-a3e3-a67c8c1ce8cc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:30.804571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9db86-99d0-4f43-b3eb-4a4dc6b0a424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:30.805176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9db86-99d0-4f43-b3eb-4a4dc6b0a424 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.805479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9db86-99d0-4f43-b3eb-4a4dc6b0a424 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.807217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9db86-99d0-4f43-b3eb-4a4dc6b0a424 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.810870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9db86-99d0-4f43-b3eb-4a4dc6b0a424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:30.810870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9db86-99d0-4f43-b3eb-4a4dc6b0a424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:30.811745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9db86-99d0-4f43-b3eb-4a4dc6b0a424 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:30.833885 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 212/430] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:30.834750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9db86-99d0-4f43-b3eb-4a4dc6b0a424 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:30.932185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4965af-5c21-4b57-a3e3-a67c8c1ce8cc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:30.958254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9db86-99d0-4f43-b3eb-4a4dc6b0a424 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:30.965012 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:30.970395 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:30.977352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d572-6846-4d18-88d1-03f852d40966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:30.978048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d572-6846-4d18-88d1-03f852d40966 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:30.978818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d572-6846-4d18-88d1-03f852d40966 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:30.979096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b9d572-6846-4d18-88d1-03f852d40966 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:30.993031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9d572-6846-4d18-88d1-03f852d40966 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:30.994837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b9d572-6846-4d18-88d1-03f852d40966 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:30.999806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b14503-2bb9-45d6-b1ff-891213202ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.000523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b14503-2bb9-45d6-b1ff-891213202ccf None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.000858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b14503-2bb9-45d6-b1ff-891213202ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.001191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b14503-2bb9-45d6-b1ff-891213202ccf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-63b9d572-6846-4d18-88d1-03f852d40966 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:31.011154 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:31.012254 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:31.013324 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:31.013324 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:31.013324 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:31.013527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b14503-2bb9-45d6-b1ff-891213202ccf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:31.016886 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 219/431] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e1b14503-2bb9-45d6-b1ff-891213202ccf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:31.017524 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:31.018583 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:31.019557 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:31.020310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d572-6846-4d18-88d1-03f852d40966 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.025317 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 213/432] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:31.025317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f128-d129-4b71-9444-78d66e4bda33 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.025317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f128-d129-4b71-9444-78d66e4bda33 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.025317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f9f128-d129-4b71-9444-78d66e4bda33 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.025772 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 214/433] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:31.026478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f128-d129-4b71-9444-78d66e4bda33 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.133490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b9d572-6846-4d18-88d1-03f852d40966 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.136833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f9f128-d129-4b71-9444-78d66e4bda33 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.170889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39277388-f28a-4c62-9987-de89cf265ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.171523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39277388-f28a-4c62-9987-de89cf265ed2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.171809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39277388-f28a-4c62-9987-de89cf265ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.172086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39277388-f28a-4c62-9987-de89cf265ed2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.180120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a210f-5d8a-409e-b3b4-d740d0191adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.180432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39277388-f28a-4c62-9987-de89cf265ed2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.180784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a210f-5d8a-409e-b3b4-d740d0191adb None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.181064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a210f-5d8a-409e-b3b4-d740d0191adb None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.181366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a210f-5d8a-409e-b3b4-d740d0191adb None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.181968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39277388-f28a-4c62-9987-de89cf265ed2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.182076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a210f-5d8a-409e-b3b4-d740d0191adb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:31.182289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a210f-5d8a-409e-b3b4-d740d0191adb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.183648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a210f-5d8a-409e-b3b4-d740d0191adb None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-39277388-f28a-4c62-9987-de89cf265ed2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:31.195152 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:31.201942 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:31.202897 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:31.203438 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 215/434] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:31.203518 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 220/435] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:31.203518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886c286-251b-4e8a-834f-de09ea5eddfc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.203518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886c286-251b-4e8a-834f-de09ea5eddfc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.203518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b886c286-251b-4e8a-834f-de09ea5eddfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.203763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a210f-5d8a-409e-b3b4-d740d0191adb None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.221407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b886c286-251b-4e8a-834f-de09ea5eddfc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:31.222764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b886c286-251b-4e8a-834f-de09ea5eddfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:31.235581 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.258155 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.305786 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 221/436] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:31.306738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886c286-251b-4e8a-834f-de09ea5eddfc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.319277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a210f-5d8a-409e-b3b4-d740d0191adb None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.354265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c880bd-3b5a-4d4a-95d0-3d499735e494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.355015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c880bd-3b5a-4d4a-95d0-3d499735e494 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.355350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c880bd-3b5a-4d4a-95d0-3d499735e494 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.355629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c880bd-3b5a-4d4a-95d0-3d499735e494 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.356330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c880bd-3b5a-4d4a-95d0-3d499735e494 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:31.356633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c880bd-3b5a-4d4a-95d0-3d499735e494 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.358025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c880bd-3b5a-4d4a-95d0-3d499735e494 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.366347 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 216/437] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:31.370147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c880bd-3b5a-4d4a-95d0-3d499735e494 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.422828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b886c286-251b-4e8a-834f-de09ea5eddfc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.460818 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.465312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04bbc07-97ef-486e-b0c7-a4cddb0b880b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.466204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bbc07-97ef-486e-b0c7-a4cddb0b880b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.467173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bbc07-97ef-486e-b0c7-a4cddb0b880b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.467826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04bbc07-97ef-486e-b0c7-a4cddb0b880b None admin] PATH_INFO: `/v3/users/swift` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.471248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c880bd-3b5a-4d4a-95d0-3d499735e494 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.476433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bbc07-97ef-486e-b0c7-a4cddb0b880b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.478840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04bbc07-97ef-486e-b0c7-a4cddb0b880b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d04bbc07-97ef-486e-b0c7-a4cddb0b880b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:31.492316 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:31.493880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:31.494807 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 222/438] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:31.495900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b67add-80f1-4c04-8e24-b847d4bdae4b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.495900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b67add-80f1-4c04-8e24-b847d4bdae4b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.495900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b67add-80f1-4c04-8e24-b847d4bdae4b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.496985 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 223/439] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:31.501511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b67add-80f1-4c04-8e24-b847d4bdae4b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.516872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce999ddd-9812-42fa-ac62-20f7e8cb1ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.517512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce999ddd-9812-42fa-ac62-20f7e8cb1ce1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.517782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce999ddd-9812-42fa-ac62-20f7e8cb1ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.518058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce999ddd-9812-42fa-ac62-20f7e8cb1ce1 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.518777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce999ddd-9812-42fa-ac62-20f7e8cb1ce1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:31.519083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce999ddd-9812-42fa-ac62-20f7e8cb1ce1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.520512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce999ddd-9812-42fa-ac62-20f7e8cb1ce1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.534585 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.539418 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 217/440] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:31.540223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f32912-cf44-4017-91ee-d43ad19afe73 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.540511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f32912-cf44-4017-91ee-d43ad19afe73 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.540777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f32912-cf44-4017-91ee-d43ad19afe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.561517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-44f32912-cf44-4017-91ee-d43ad19afe73 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:31.563489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-44f32912-cf44-4017-91ee-d43ad19afe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:31.617129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b67add-80f1-4c04-8e24-b847d4bdae4b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.633629 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 218/441] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:31.634875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f32912-cf44-4017-91ee-d43ad19afe73 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.657876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc473b-8960-4da8-8443-c3fb75f1e4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.659056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc473b-8960-4da8-8443-c3fb75f1e4f1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.659341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc473b-8960-4da8-8443-c3fb75f1e4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.659948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc473b-8960-4da8-8443-c3fb75f1e4f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.674172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc473b-8960-4da8-8443-c3fb75f1e4f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.675668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc473b-8960-4da8-8443-c3fb75f1e4f1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-2cbc473b-8960-4da8-8443-c3fb75f1e4f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:31.694084 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:31.695083 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:31.695953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:31.695953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:31.695953 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:31.695953 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 224/442] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:31.697168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc473b-8960-4da8-8443-c3fb75f1e4f1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.720874 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.744949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f32912-cf44-4017-91ee-d43ad19afe73 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.782330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e9b5e-c3bc-4347-a133-4448e8ff4cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.782944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e9b5e-c3bc-4347-a133-4448e8ff4cb7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.783348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e9b5e-c3bc-4347-a133-4448e8ff4cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.783625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e9b5e-c3bc-4347-a133-4448e8ff4cb7 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.784357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e9b5e-c3bc-4347-a133-4448e8ff4cb7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:31.784667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e9b5e-c3bc-4347-a133-4448e8ff4cb7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.786143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e9b5e-c3bc-4347-a133-4448e8ff4cb7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.787814 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.809449 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 219/443] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:31.809449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e9b5e-c3bc-4347-a133-4448e8ff4cb7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:31.814823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc473b-8960-4da8-8443-c3fb75f1e4f1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.849942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997ed86-9332-4b88-a2c6-4dca5ceca372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.850560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997ed86-9332-4b88-a2c6-4dca5ceca372 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.850839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997ed86-9332-4b88-a2c6-4dca5ceca372 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.851110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a997ed86-9332-4b88-a2c6-4dca5ceca372 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.915024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e9b5e-c3bc-4347-a133-4448e8ff4cb7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:31.923007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997ed86-9332-4b88-a2c6-4dca5ceca372 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:31.924452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a997ed86-9332-4b88-a2c6-4dca5ceca372 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:31.949602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f8866-e58a-48c4-9e56-2ea06b964b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:31.950221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8866-e58a-48c4-9e56-2ea06b964b62 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:31.950495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8866-e58a-48c4-9e56-2ea06b964b62 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:31.950762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2f8866-e58a-48c4-9e56-2ea06b964b62 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:31.953364 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:31.961473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2f8866-e58a-48c4-9e56-2ea06b964b62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-7b2f8866-e58a-48c4-9e56-2ea06b964b62 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:31.966245 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:31.967203 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:31.968024 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 220/444] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:31.968751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f8866-e58a-48c4-9e56-2ea06b964b62 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.007701 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.028385 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 225/445] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:32.033329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997ed86-9332-4b88-a2c6-4dca5ceca372 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.069704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2f8866-e58a-48c4-9e56-2ea06b964b62 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.106030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b12b2e-027e-41fa-85e5-46057866bf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.106632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b12b2e-027e-41fa-85e5-46057866bf2b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.106898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b12b2e-027e-41fa-85e5-46057866bf2b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.107165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b12b2e-027e-41fa-85e5-46057866bf2b None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.107795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b12b2e-027e-41fa-85e5-46057866bf2b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:32.108093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b12b2e-027e-41fa-85e5-46057866bf2b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.109513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b12b2e-027e-41fa-85e5-46057866bf2b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.120794 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 221/446] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:32.121617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b12b2e-027e-41fa-85e5-46057866bf2b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.140972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a997ed86-9332-4b88-a2c6-4dca5ceca372 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.176978 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.179726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbca31-1bc9-44e9-a22b-c6e22e5bf79c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.180361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbca31-1bc9-44e9-a22b-c6e22e5bf79c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.180641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbca31-1bc9-44e9-a22b-c6e22e5bf79c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.181530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfbca31-1bc9-44e9-a22b-c6e22e5bf79c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.193165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbca31-1bc9-44e9-a22b-c6e22e5bf79c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.194658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfbca31-1bc9-44e9-a22b-c6e22e5bf79c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-bcfbca31-1bc9-44e9-a22b-c6e22e5bf79c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:32.209452 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:32.210486 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:32.211326 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:32.211326 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:32.211326 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:32.211326 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 226/447] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:32.212328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbca31-1bc9-44e9-a22b-c6e22e5bf79c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.225936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b12b2e-027e-41fa-85e5-46057866bf2b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.245184 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.263723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2b6b-d75d-4ec9-b08c-8117a37eaa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.264381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2b6b-d75d-4ec9-b08c-8117a37eaa4a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.264653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2b6b-d75d-4ec9-b08c-8117a37eaa4a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.264926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa2b6b-d75d-4ec9-b08c-8117a37eaa4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.275600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa2b6b-d75d-4ec9-b08c-8117a37eaa4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-48aa2b6b-d75d-4ec9-b08c-8117a37eaa4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:32.280899 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:32.282080 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:32.282883 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 222/448] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:32.284770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2b6b-d75d-4ec9-b08c-8117a37eaa4a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.317170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfbca31-1bc9-44e9-a22b-c6e22e5bf79c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.351089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b9ff-d264-4608-a81e-24c2d96ecaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.351689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b9ff-d264-4608-a81e-24c2d96ecaa7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.351967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b9ff-d264-4608-a81e-24c2d96ecaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.352247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a22b9ff-d264-4608-a81e-24c2d96ecaa7 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.353429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b9ff-d264-4608-a81e-24c2d96ecaa7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:32.353730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b9ff-d264-4608-a81e-24c2d96ecaa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.355104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a22b9ff-d264-4608-a81e-24c2d96ecaa7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.362909 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 227/449] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:32.363737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b9ff-d264-4608-a81e-24c2d96ecaa7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.385617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa2b6b-d75d-4ec9-b08c-8117a37eaa4a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.402535 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.420156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e4a67-b841-4c85-bd1e-6c26e96998db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.420779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e4a67-b841-4c85-bd1e-6c26e96998db None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.421054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e4a67-b841-4c85-bd1e-6c26e96998db None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.421363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e4a67-b841-4c85-bd1e-6c26e96998db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.432296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e4a67-b841-4c85-bd1e-6c26e96998db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.433782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e4a67-b841-4c85-bd1e-6c26e96998db None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-f91e4a67-b841-4c85-bd1e-6c26e96998db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:32.448166 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:32.449088 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:32.449996 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:32.449996 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:32.449996 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:32.449996 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 223/450] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:32.450217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e4a67-b841-4c85-bd1e-6c26e96998db None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.460716 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.467742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a22b9ff-d264-4608-a81e-24c2d96ecaa7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.501578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fde8c-e036-43c0-8f41-6cd48784e7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.502197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fde8c-e036-43c0-8f41-6cd48784e7cf None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.502471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fde8c-e036-43c0-8f41-6cd48784e7cf None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.502739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fde8c-e036-43c0-8f41-6cd48784e7cf None admin] PATH_INFO: `/v3/users/glance` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.510444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fde8c-e036-43c0-8f41-6cd48784e7cf None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.511878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659fde8c-e036-43c0-8f41-6cd48784e7cf None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-659fde8c-e036-43c0-8f41-6cd48784e7cf None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:32.522614 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:32.523669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:32.524612 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 228/451] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:32.525177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fde8c-e036-43c0-8f41-6cd48784e7cf None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.550109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e4a67-b841-4c85-bd1e-6c26e96998db None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.585888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26708ac1-802b-4323-add4-d6c2ff020700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.586489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26708ac1-802b-4323-add4-d6c2ff020700 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.586770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26708ac1-802b-4323-add4-d6c2ff020700 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.587665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26708ac1-802b-4323-add4-d6c2ff020700 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.588303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26708ac1-802b-4323-add4-d6c2ff020700 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:32.588606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26708ac1-802b-4323-add4-d6c2ff020700 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.590009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26708ac1-802b-4323-add4-d6c2ff020700 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.602035 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 224/452] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:32.602862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26708ac1-802b-4323-add4-d6c2ff020700 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.631243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659fde8c-e036-43c0-8f41-6cd48784e7cf None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.633241 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.667414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205f62d-d1cd-4da8-a727-89068aa91909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.668018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205f62d-d1cd-4da8-a727-89068aa91909 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.668916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205f62d-d1cd-4da8-a727-89068aa91909 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.668916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7205f62d-d1cd-4da8-a727-89068aa91909 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.669209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205f62d-d1cd-4da8-a727-89068aa91909 None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:32.669545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205f62d-d1cd-4da8-a727-89068aa91909 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.670914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7205f62d-d1cd-4da8-a727-89068aa91909 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.679049 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 229/453] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:32.679885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205f62d-d1cd-4da8-a727-89068aa91909 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.699812 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.712224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26708ac1-802b-4323-add4-d6c2ff020700 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.748272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ce1a2-ea1f-454e-bd05-208f94bcc736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.748890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ce1a2-ea1f-454e-bd05-208f94bcc736 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.749171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ce1a2-ea1f-454e-bd05-208f94bcc736 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.749471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821ce1a2-ea1f-454e-bd05-208f94bcc736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.760575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ce1a2-ea1f-454e-bd05-208f94bcc736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.762064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821ce1a2-ea1f-454e-bd05-208f94bcc736 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-821ce1a2-ea1f-454e-bd05-208f94bcc736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:32.776957 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:32.778037 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:32.778935 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:32.778935 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:32.778935 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:32.778935 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 225/454] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:32.778935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ce1a2-ea1f-454e-bd05-208f94bcc736 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.795117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7205f62d-d1cd-4da8-a727-89068aa91909 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.830513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be20a28-7d04-465a-ab70-1daa479ce373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.831121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be20a28-7d04-465a-ab70-1daa479ce373 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.831404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be20a28-7d04-465a-ab70-1daa479ce373 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.831678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be20a28-7d04-465a-ab70-1daa479ce373 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.832312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be20a28-7d04-465a-ab70-1daa479ce373 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:32.832617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be20a28-7d04-465a-ab70-1daa479ce373 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.834016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be20a28-7d04-465a-ab70-1daa479ce373 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.846413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 230/455] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:32.847246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be20a28-7d04-465a-ab70-1daa479ce373 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.868597 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.892743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821ce1a2-ea1f-454e-bd05-208f94bcc736 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:32.930018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc1c8d-2a93-4d57-b14a-bdcacc527981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:32.930644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc1c8d-2a93-4d57-b14a-bdcacc527981 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:32.931003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc1c8d-2a93-4d57-b14a-bdcacc527981 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:32.931432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dc1c8d-2a93-4d57-b14a-bdcacc527981 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:32.932771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc1c8d-2a93-4d57-b14a-bdcacc527981 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:32.933273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc1c8d-2a93-4d57-b14a-bdcacc527981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:32.935335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dc1c8d-2a93-4d57-b14a-bdcacc527981 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:32.938268 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:32.956721 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 226/456] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:32.957626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc1c8d-2a93-4d57-b14a-bdcacc527981 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:32.968726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be20a28-7d04-465a-ab70-1daa479ce373 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.005624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664fd29-0d01-4e17-8717-352b718fb8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.006272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664fd29-0d01-4e17-8717-352b718fb8e5 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.006552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664fd29-0d01-4e17-8717-352b718fb8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.006829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3664fd29-0d01-4e17-8717-352b718fb8e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.014661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664fd29-0d01-4e17-8717-352b718fb8e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.016138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3664fd29-0d01-4e17-8717-352b718fb8e5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-3664fd29-0d01-4e17-8717-352b718fb8e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:33.029000 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:33.030132 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 231/457] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:33.035958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664fd29-0d01-4e17-8717-352b718fb8e5 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.066525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dc1c8d-2a93-4d57-b14a-bdcacc527981 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.105549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf50eff-60cb-4560-96c8-64cdac5bced5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.106171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf50eff-60cb-4560-96c8-64cdac5bced5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.106447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf50eff-60cb-4560-96c8-64cdac5bced5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.106715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf50eff-60cb-4560-96c8-64cdac5bced5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.113472 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:33.119043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf50eff-60cb-4560-96c8-64cdac5bced5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.120522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf50eff-60cb-4560-96c8-64cdac5bced5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-daf50eff-60cb-4560-96c8-64cdac5bced5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:33.136789 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:33.137982 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:33.139050 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:33.139050 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:33.139050 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:33.141104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3664fd29-0d01-4e17-8717-352b718fb8e5 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.141628 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 227/458] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:33.142705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf50eff-60cb-4560-96c8-64cdac5bced5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.176376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff44eb3-c66d-4d91-8bfd-7a3de9a6ef8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.176973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff44eb3-c66d-4d91-8bfd-7a3de9a6ef8d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.177247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff44eb3-c66d-4d91-8bfd-7a3de9a6ef8d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.177546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff44eb3-c66d-4d91-8bfd-7a3de9a6ef8d None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.178176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff44eb3-c66d-4d91-8bfd-7a3de9a6ef8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:33.178473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff44eb3-c66d-4d91-8bfd-7a3de9a6ef8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.179831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff44eb3-c66d-4d91-8bfd-7a3de9a6ef8d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.182730 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:33.194041 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 232/459] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:33.195020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff44eb3-c66d-4d91-8bfd-7a3de9a6ef8d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.245409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf50eff-60cb-4560-96c8-64cdac5bced5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.278638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e742-207e-45eb-82a2-7786f9709a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.279266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e742-207e-45eb-82a2-7786f9709a06 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.279547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e742-207e-45eb-82a2-7786f9709a06 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.279821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da5e742-207e-45eb-82a2-7786f9709a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.286525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e742-207e-45eb-82a2-7786f9709a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.288005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da5e742-207e-45eb-82a2-7786f9709a06 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.295375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff44eb3-c66d-4d91-8bfd-7a3de9a6ef8d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-7da5e742-207e-45eb-82a2-7786f9709a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:33.299821 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:33.300837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:33.301953 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:33.301953 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:33.301953 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:33.301953 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:33.301953 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:33.301953 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:33.301953 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:33.301953 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:33.305495 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 228/460] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:33.306472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e742-207e-45eb-82a2-7786f9709a06 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.329111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f084c4b-f022-44cd-8c47-d68961e330b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.329737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f084c4b-f022-44cd-8c47-d68961e330b9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.330013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f084c4b-f022-44cd-8c47-d68961e330b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.330295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f084c4b-f022-44cd-8c47-d68961e330b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.356242 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:33.392154 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:33.399130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f084c4b-f022-44cd-8c47-d68961e330b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.401145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f084c4b-f022-44cd-8c47-d68961e330b9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.406680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da5e742-207e-45eb-82a2-7786f9709a06 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.440535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3e80c-2ea5-4c8a-b2e6-34daf4687bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.441131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3e80c-2ea5-4c8a-b2e6-34daf4687bf0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.441438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3e80c-2ea5-4c8a-b2e6-34daf4687bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.441720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b3e80c-2ea5-4c8a-b2e6-34daf4687bf0 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.442391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3e80c-2ea5-4c8a-b2e6-34daf4687bf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:33.442691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3e80c-2ea5-4c8a-b2e6-34daf4687bf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.444117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b3e80c-2ea5-4c8a-b2e6-34daf4687bf0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.455935 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 229/461] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:33.456720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3e80c-2ea5-4c8a-b2e6-34daf4687bf0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.504231 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 233/462] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:33.505052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f084c4b-f022-44cd-8c47-d68961e330b9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.559017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b3e80c-2ea5-4c8a-b2e6-34daf4687bf0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.569455 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:33.593767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd207a7-86d9-49b3-a421-cb9d371647dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.594361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd207a7-86d9-49b3-a421-cb9d371647dc None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.594643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd207a7-86d9-49b3-a421-cb9d371647dc None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.594909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd207a7-86d9-49b3-a421-cb9d371647dc None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.595534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd207a7-86d9-49b3-a421-cb9d371647dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:33.595831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd207a7-86d9-49b3-a421-cb9d371647dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.597192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd207a7-86d9-49b3-a421-cb9d371647dc None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.599801 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:33.606850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f084c4b-f022-44cd-8c47-d68961e330b9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.609028 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 230/463] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:33.609902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd207a7-86d9-49b3-a421-cb9d371647dc None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.647676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad9ea1-eba2-499d-90be-975c05c5f68b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.648231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad9ea1-eba2-499d-90be-975c05c5f68b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.648512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad9ea1-eba2-499d-90be-975c05c5f68b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.648786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dad9ea1-eba2-499d-90be-975c05c5f68b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.656253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad9ea1-eba2-499d-90be-975c05c5f68b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.657736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dad9ea1-eba2-499d-90be-975c05c5f68b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-2dad9ea1-eba2-499d-90be-975c05c5f68b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:33.669890 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:33.670809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 234/464] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:33.671712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad9ea1-eba2-499d-90be-975c05c5f68b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.711895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd207a7-86d9-49b3-a421-cb9d371647dc None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.746632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e4ea-4d52-48b4-a128-f7af58bfe960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.747236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e4ea-4d52-48b4-a128-f7af58bfe960 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.747516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e4ea-4d52-48b4-a128-f7af58bfe960 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.747788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3475e4ea-4d52-48b4-a128-f7af58bfe960 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.748503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e4ea-4d52-48b4-a128-f7af58bfe960 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:33.748812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e4ea-4d52-48b4-a128-f7af58bfe960 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.750293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3475e4ea-4d52-48b4-a128-f7af58bfe960 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.763017 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 231/465] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:33.763829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e4ea-4d52-48b4-a128-f7af58bfe960 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.779966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dad9ea1-eba2-499d-90be-975c05c5f68b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.793498 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:33.814360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f2a00-ef8c-47a4-b0eb-1a95c4cb1496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.815016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f2a00-ef8c-47a4-b0eb-1a95c4cb1496 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.815290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f2a00-ef8c-47a4-b0eb-1a95c4cb1496 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.815561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f2a00-ef8c-47a4-b0eb-1a95c4cb1496 None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/fc41482005be496f822a3118839674c9/roles/9f1d8ee2ec724d0cbb41c537a7d38406` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.831951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f2a00-ef8c-47a4-b0eb-1a95c4cb1496 None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=fc41482005be496f822a3118839674c9, role_id=9f1d8ee2ec724d0cbb41c537a7d38406)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.833488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902f2a00-ef8c-47a4-b0eb-1a95c4cb1496 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.847140 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 235/466] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:33 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/fc41482005be496f822a3118839674c9/roles/9f1d8ee2ec724d0cbb41c537a7d38406 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:33.847963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f2a00-ef8c-47a4-b0eb-1a95c4cb1496 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.866269 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:33.867639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3475e4ea-4d52-48b4-a128-f7af58bfe960 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:33.909179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754cd7-93e9-4c88-a440-036d5216d2a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:33.909765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754cd7-93e9-4c88-a440-036d5216d2a2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:33.910083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754cd7-93e9-4c88-a440-036d5216d2a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:33.910307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac754cd7-93e9-4c88-a440-036d5216d2a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:33.921972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac754cd7-93e9-4c88-a440-036d5216d2a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:33.923477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac754cd7-93e9-4c88-a440-036d5216d2a2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-ac754cd7-93e9-4c88-a440-036d5216d2a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:33.941041 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:33.942264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:33.943147 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:33.943147 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:33.943147 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:33.947652 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 232/467] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:33.948611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754cd7-93e9-4c88-a440-036d5216d2a2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:33.972189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902f2a00-ef8c-47a4-b0eb-1a95c4cb1496 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.012501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f099b4-7c7b-4493-85f4-0c8586c47326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.013215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f099b4-7c7b-4493-85f4-0c8586c47326 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.013522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f099b4-7c7b-4493-85f4-0c8586c47326 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.013798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f099b4-7c7b-4493-85f4-0c8586c47326 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.023711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f099b4-7c7b-4493-85f4-0c8586c47326 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.024989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f099b4-7c7b-4493-85f4-0c8586c47326 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.037791 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e8f099b4-7c7b-4493-85f4-0c8586c47326 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:34.039742 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:34.040691 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 236/468] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:34.041738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f099b4-7c7b-4493-85f4-0c8586c47326 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:34.067149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac754cd7-93e9-4c88-a440-036d5216d2a2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.102648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8884b-74ca-4a3b-a0d4-968255941e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.103645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8884b-74ca-4a3b-a0d4-968255941e22 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.104642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8884b-74ca-4a3b-a0d4-968255941e22 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.105076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e8884b-74ca-4a3b-a0d4-968255941e22 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.105864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8884b-74ca-4a3b-a0d4-968255941e22 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:34.106172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8884b-74ca-4a3b-a0d4-968255941e22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.107621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e8884b-74ca-4a3b-a0d4-968255941e22 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.119196 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:34.131605 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 233/469] 10.222.0.25 () {56 vars in 1137 bytes} [Mon Oct 24 08:36:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:34.131605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8884b-74ca-4a3b-a0d4-968255941e22 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:34.165931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f099b4-7c7b-4493-85f4-0c8586c47326 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.205803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153736ca-519e-41c5-b1fc-e662b05100b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.206592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153736ca-519e-41c5-b1fc-e662b05100b7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.206991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153736ca-519e-41c5-b1fc-e662b05100b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.207374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153736ca-519e-41c5-b1fc-e662b05100b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.208210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153736ca-519e-41c5-b1fc-e662b05100b7 None admin] RBAC: Adding query filter params (role.id=9f1d8ee2ec724d0cbb41c537a7d38406, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=b31aac6142684a039f9de2051fe42989) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:34.208632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153736ca-519e-41c5-b1fc-e662b05100b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.210192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153736ca-519e-41c5-b1fc-e662b05100b7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.225329 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 237/470] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:34 2022] GET /identity/v3/role_assignments?user.id=b31aac6142684a039f9de2051fe42989&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=9f1d8ee2ec724d0cbb41c537a7d38406 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:34.225329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153736ca-519e-41c5-b1fc-e662b05100b7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:34.250938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e8884b-74ca-4a3b-a0d4-968255941e22 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.292219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80dee3-552b-4e92-aa86-59ed9a7e84b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.292936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80dee3-552b-4e92-aa86-59ed9a7e84b4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.293424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80dee3-552b-4e92-aa86-59ed9a7e84b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.293794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e80dee3-552b-4e92-aa86-59ed9a7e84b4 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.294558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80dee3-552b-4e92-aa86-59ed9a7e84b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:34.294964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80dee3-552b-4e92-aa86-59ed9a7e84b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.296505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e80dee3-552b-4e92-aa86-59ed9a7e84b4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.307010 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:34.310978 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 234/471] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:34.311968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80dee3-552b-4e92-aa86-59ed9a7e84b4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:34.350330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153736ca-519e-41c5-b1fc-e662b05100b7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.387466 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:34.395590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964863c6-c317-4c98-a707-863800d06124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.396353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964863c6-c317-4c98-a707-863800d06124 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.396730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964863c6-c317-4c98-a707-863800d06124 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.397105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964863c6-c317-4c98-a707-863800d06124 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.398106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964863c6-c317-4c98-a707-863800d06124 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:34.398526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964863c6-c317-4c98-a707-863800d06124 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.400190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964863c6-c317-4c98-a707-863800d06124 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.423346 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 238/472] 10.222.0.25 () {56 vars in 1139 bytes} [Mon Oct 24 08:36:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:34.424265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964863c6-c317-4c98-a707-863800d06124 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:34.452207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e80dee3-552b-4e92-aa86-59ed9a7e84b4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.498176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f0ad2-5961-4bd9-8d4d-6abb7086ab85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.498788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f0ad2-5961-4bd9-8d4d-6abb7086ab85 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.499069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f0ad2-5961-4bd9-8d4d-6abb7086ab85 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.499335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993f0ad2-5961-4bd9-8d4d-6abb7086ab85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.551844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964863c6-c317-4c98-a707-863800d06124 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.580192 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:34.582645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f0ad2-5961-4bd9-8d4d-6abb7086ab85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.584798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993f0ad2-5961-4bd9-8d4d-6abb7086ab85 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.604856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb981c8-cea9-46b3-bd60-b16bfe7f9529 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.605867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb981c8-cea9-46b3-bd60-b16bfe7f9529 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.606560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb981c8-cea9-46b3-bd60-b16bfe7f9529 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.606990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb981c8-cea9-46b3-bd60-b16bfe7f9529 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.617203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb981c8-cea9-46b3-bd60-b16bfe7f9529 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.620197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb981c8-cea9-46b3-bd60-b16bfe7f9529 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-5eb981c8-cea9-46b3-bd60-b16bfe7f9529 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:34.636589 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:34.637732 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:34.638798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:34.638798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:34.638798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:34.638798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:34.638798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:34.638798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:34.638798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:34.638798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:34.641795 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 239/473] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:34.642927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb981c8-cea9-46b3-bd60-b16bfe7f9529 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:34.706610 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 235/474] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:34.706610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f0ad2-5961-4bd9-8d4d-6abb7086ab85 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:34.715189 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:34.776295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb981c8-cea9-46b3-bd60-b16bfe7f9529 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.815953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc9071-fdb2-4f6d-a9b1-73a6b895243f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.817081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9071-fdb2-4f6d-a9b1-73a6b895243f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.818019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9071-fdb2-4f6d-a9b1-73a6b895243f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.818479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc9071-fdb2-4f6d-a9b1-73a6b895243f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.830700 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:34.834039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993f0ad2-5961-4bd9-8d4d-6abb7086ab85 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:34.875514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec4ed0-5db3-4bd9-9d73-7116bfaef1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:34.876217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec4ed0-5db3-4bd9-9d73-7116bfaef1b8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:34.876898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec4ed0-5db3-4bd9-9d73-7116bfaef1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:34.876898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ec4ed0-5db3-4bd9-9d73-7116bfaef1b8 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:34.877714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec4ed0-5db3-4bd9-9d73-7116bfaef1b8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:34.878086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec4ed0-5db3-4bd9-9d73-7116bfaef1b8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.879695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ec4ed0-5db3-4bd9-9d73-7116bfaef1b8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.892725 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 236/475] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:34.893832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec4ed0-5db3-4bd9-9d73-7116bfaef1b8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:34.911550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc9071-fdb2-4f6d-a9b1-73a6b895243f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:34.913425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffc9071-fdb2-4f6d-a9b1-73a6b895243f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:34.980161 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:35.030776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ec4ed0-5db3-4bd9-9d73-7116bfaef1b8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:35.046547 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 240/476] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:35.047597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc9071-fdb2-4f6d-a9b1-73a6b895243f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:35.076202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f07955-cc32-498c-a401-85ffa5c7d910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:35.077821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f07955-cc32-498c-a401-85ffa5c7d910 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:35.078313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f07955-cc32-498c-a401-85ffa5c7d910 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:35.079006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f07955-cc32-498c-a401-85ffa5c7d910 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:35.094153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f07955-cc32-498c-a401-85ffa5c7d910 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:35.096388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f07955-cc32-498c-a401-85ffa5c7d910 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-54f07955-cc32-498c-a401-85ffa5c7d910 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:35.119174 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:35.120205 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:35.121067 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:35.121067 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:35.121067 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:35.127626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 237/477] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:35.127626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f07955-cc32-498c-a401-85ffa5c7d910 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:35.165669 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:35.174226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc9071-fdb2-4f6d-a9b1-73a6b895243f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:35.216819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81fa54-b947-4196-81a3-3fbe8a02d6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:35.217679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81fa54-b947-4196-81a3-3fbe8a02d6e4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:35.217964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81fa54-b947-4196-81a3-3fbe8a02d6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:35.218241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e81fa54-b947-4196-81a3-3fbe8a02d6e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:35.219186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81fa54-b947-4196-81a3-3fbe8a02d6e4 None admin] RBAC: Adding query filter params (role.id=9f1d8ee2ec724d0cbb41c537a7d38406, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=3a1cba9ba74946de8c58da91e59ddcfc) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:35.219698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81fa54-b947-4196-81a3-3fbe8a02d6e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:35.221792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e81fa54-b947-4196-81a3-3fbe8a02d6e4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:35.233488 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 241/478] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:35 2022] GET /identity/v3/role_assignments?user.id=3a1cba9ba74946de8c58da91e59ddcfc&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=9f1d8ee2ec724d0cbb41c537a7d38406 => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:35.234697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81fa54-b947-4196-81a3-3fbe8a02d6e4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:35.255744 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:35.299545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f07955-cc32-498c-a401-85ffa5c7d910 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:35.366083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e81fa54-b947-4196-81a3-3fbe8a02d6e4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:35.384791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff396f54-062a-467c-9f23-7c245d064244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:35.385431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396f54-062a-467c-9f23-7c245d064244 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:35.385711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396f54-062a-467c-9f23-7c245d064244 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:35.385981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff396f54-062a-467c-9f23-7c245d064244 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:35.409849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e0c59-e6f1-4029-9d65-1bdfb3894281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:35.411146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e0c59-e6f1-4029-9d65-1bdfb3894281 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:35.411661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff396f54-062a-467c-9f23-7c245d064244 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:35.411783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e0c59-e6f1-4029-9d65-1bdfb3894281 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:35.412266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5e0c59-e6f1-4029-9d65-1bdfb3894281 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:35.413114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e0c59-e6f1-4029-9d65-1bdfb3894281 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:35.413220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff396f54-062a-467c-9f23-7c245d064244 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:35.413838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e0c59-e6f1-4029-9d65-1bdfb3894281 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:35.416004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5e0c59-e6f1-4029-9d65-1bdfb3894281 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:35.431264 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 242/479] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:35.437333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e0c59-e6f1-4029-9d65-1bdfb3894281 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-ff396f54-062a-467c-9f23-7c245d064244 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:35.442282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:35.443195 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:35.444049 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:35.444049 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:35.444049 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:35.444049 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 238/480] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:35.454476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff396f54-062a-467c-9f23-7c245d064244 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:35.530826 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:35.565393 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:35.575110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5e0c59-e6f1-4029-9d65-1bdfb3894281 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:35.622347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff396f54-062a-467c-9f23-7c245d064244 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:35.630318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c9870-9793-4100-aeb7-69e5c7797e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:35.631118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c9870-9793-4100-aeb7-69e5c7797e32 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:35.631402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c9870-9793-4100-aeb7-69e5c7797e32 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:35.631677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c9870-9793-4100-aeb7-69e5c7797e32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:35.641725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c9870-9793-4100-aeb7-69e5c7797e32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:35.643535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5c9870-9793-4100-aeb7-69e5c7797e32 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ba5c9870-9793-4100-aeb7-69e5c7797e32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:35.663611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:35.664517 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:35.665485 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:35.665485 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:35.665485 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:35.665485 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:35.665485 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:35.665485 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:35.665485 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:35.665485 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:35.665485 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 243/481] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:35.670042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c9870-9793-4100-aeb7-69e5c7797e32 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:35.673119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce14efc-d9c7-4027-86dc-e67116e2ca7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:35.673835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce14efc-d9c7-4027-86dc-e67116e2ca7b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:35.674114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce14efc-d9c7-4027-86dc-e67116e2ca7b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:35.674498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce14efc-d9c7-4027-86dc-e67116e2ca7b None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:35.675024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce14efc-d9c7-4027-86dc-e67116e2ca7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:35.675326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce14efc-d9c7-4027-86dc-e67116e2ca7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:35.676793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce14efc-d9c7-4027-86dc-e67116e2ca7b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:35.697756 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 239/482] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:35.699394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce14efc-d9c7-4027-86dc-e67116e2ca7b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:35.810243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5c9870-9793-4100-aeb7-69e5c7797e32 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:35.830240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce14efc-d9c7-4027-86dc-e67116e2ca7b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:35.848545 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:35.855937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d241813-1f60-4477-8b47-a7a65f8974e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:35.856977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d241813-1f60-4477-8b47-a7a65f8974e0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:35.857365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d241813-1f60-4477-8b47-a7a65f8974e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:35.857975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d241813-1f60-4477-8b47-a7a65f8974e0 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:35.858793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d241813-1f60-4477-8b47-a7a65f8974e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:35.859167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d241813-1f60-4477-8b47-a7a65f8974e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:35.860734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d241813-1f60-4477-8b47-a7a65f8974e0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:35.867072 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:35.877554 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 244/483] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:35.880919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738d6b4-f319-4941-8b18-a78b75c0f813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:35.881845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738d6b4-f319-4941-8b18-a78b75c0f813 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:35.882113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d241813-1f60-4477-8b47-a7a65f8974e0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:35.882435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738d6b4-f319-4941-8b18-a78b75c0f813 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:35.882847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0738d6b4-f319-4941-8b18-a78b75c0f813 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:35.893039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738d6b4-f319-4941-8b18-a78b75c0f813 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:35.895400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0738d6b4-f319-4941-8b18-a78b75c0f813 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0738d6b4-f319-4941-8b18-a78b75c0f813 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:35.910200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:35.911434 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:35.912442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:35.912442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:35.912442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:35.912442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:35.912442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:35.912442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:35.912442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:35.912442 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:35.917066 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 240/484] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:35.918367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738d6b4-f319-4941-8b18-a78b75c0f813 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:36.034433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d241813-1f60-4477-8b47-a7a65f8974e0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:36.086287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd99d0a-d68c-478f-a9e6-449a038e8d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:36.089452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99d0a-d68c-478f-a9e6-449a038e8d5f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:36.089937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99d0a-d68c-478f-a9e6-449a038e8d5f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:36.090734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd99d0a-d68c-478f-a9e6-449a038e8d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:36.092823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99d0a-d68c-478f-a9e6-449a038e8d5f None admin] RBAC: Adding query filter params (role.id=9f1d8ee2ec724d0cbb41c537a7d38406, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=ed628f1d565e440792f530dd97512cf7) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:36.095149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0738d6b4-f319-4941-8b18-a78b75c0f813 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:36.095681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99d0a-d68c-478f-a9e6-449a038e8d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:36.097456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd99d0a-d68c-478f-a9e6-449a038e8d5f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:36.105983 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 245/485] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:35 2022] GET /identity/v3/role_assignments?user.id=ed628f1d565e440792f530dd97512cf7&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=9f1d8ee2ec724d0cbb41c537a7d38406 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:36.179369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb429-88b8-4839-9f09-bbfc12517609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:36.180008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb429-88b8-4839-9f09-bbfc12517609 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:36.180293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb429-88b8-4839-9f09-bbfc12517609 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:36.180568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb429-88b8-4839-9f09-bbfc12517609 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:36.181369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb429-88b8-4839-9f09-bbfc12517609 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:36.181681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb429-88b8-4839-9f09-bbfc12517609 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:36.183186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb429-88b8-4839-9f09-bbfc12517609 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:36.207976 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 241/486] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:36.212918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b36da-2442-4141-9355-331e22e4a652 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:36.213217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b36da-2442-4141-9355-331e22e4a652 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:36.213505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783b36da-2442-4141-9355-331e22e4a652 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:36.216130 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 246/487] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:36.219068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb429-88b8-4839-9f09-bbfc12517609 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:36.222952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4c29e-715e-44cc-93f8-4be4f89ecac0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:36.223230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4c29e-715e-44cc-93f8-4be4f89ecac0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:36.223513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4c29e-715e-44cc-93f8-4be4f89ecac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:36.266703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-33a4c29e-715e-44cc-93f8-4be4f89ecac0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:36.269071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-33a4c29e-715e-44cc-93f8-4be4f89ecac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:36.307285 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:36.382016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb429-88b8-4839-9f09-bbfc12517609 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:36.386794 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:36.417081 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 247/488] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:36.442381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeb9728-8059-47a0-8afc-d4e11bbc5670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:36.443014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9728-8059-47a0-8afc-d4e11bbc5670 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:36.443292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9728-8059-47a0-8afc-d4e11bbc5670 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:36.443563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeb9728-8059-47a0-8afc-d4e11bbc5670 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:36.444304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb9728-8059-47a0-8afc-d4e11bbc5670 None admin] RBAC: Adding query filter params (role.id=9f1d8ee2ec724d0cbb41c537a7d38406, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=9ea1478025654b729f707edbaeff4e2b) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:36.444614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb9728-8059-47a0-8afc-d4e11bbc5670 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:36.446135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeb9728-8059-47a0-8afc-d4e11bbc5670 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:36.457261 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 242/489] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:36 2022] GET /identity/v3/role_assignments?user.id=9ea1478025654b729f707edbaeff4e2b&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=9f1d8ee2ec724d0cbb41c537a7d38406 => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:36.659544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942c0fe-5b19-4126-9582-bd195d1ad80f None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:36.660060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942c0fe-5b19-4126-9582-bd195d1ad80f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:36.660060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7942c0fe-5b19-4126-9582-bd195d1ad80f None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:36.661717 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 248/490] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:36.668268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64e95-a611-4ede-b915-6ca407276b5f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:36.668805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64e95-a611-4ede-b915-6ca407276b5f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:36.668805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c64e95-a611-4ede-b915-6ca407276b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:36.687619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e8c64e95-a611-4ede-b915-6ca407276b5f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:36.688861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e8c64e95-a611-4ede-b915-6ca407276b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:36.772463 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 243/491] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:36.782120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942c0fe-5b19-4126-9582-bd195d1ad80f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:36.889941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7942c0fe-5b19-4126-9582-bd195d1ad80f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:36.925581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1b19-83a5-4b29-a08e-b35d08e1507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:36.926144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1b19-83a5-4b29-a08e-b35d08e1507b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:36.926425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1b19-83a5-4b29-a08e-b35d08e1507b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:36.926699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88f1b19-83a5-4b29-a08e-b35d08e1507b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:36.937497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88f1b19-83a5-4b29-a08e-b35d08e1507b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a88f1b19-83a5-4b29-a08e-b35d08e1507b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:36.942832 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:36.943725 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:36.944524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:36.948830 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 249/492] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:36.950218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64e95-a611-4ede-b915-6ca407276b5f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.007819 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:37.097241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c64e95-a611-4ede-b915-6ca407276b5f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:37.101445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1b19-83a5-4b29-a08e-b35d08e1507b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.155315 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:37.162035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b421699-5a24-4bbb-9fde-a719b2c616a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:37.162669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b421699-5a24-4bbb-9fde-a719b2c616a7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:37.162958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b421699-5a24-4bbb-9fde-a719b2c616a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:37.163233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b421699-5a24-4bbb-9fde-a719b2c616a7 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:37.163907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b421699-5a24-4bbb-9fde-a719b2c616a7 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:37.164211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b421699-5a24-4bbb-9fde-a719b2c616a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:37.165799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b421699-5a24-4bbb-9fde-a719b2c616a7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:37.183973 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 244/493] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:37.200278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b421699-5a24-4bbb-9fde-a719b2c616a7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.219456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88f1b19-83a5-4b29-a08e-b35d08e1507b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:37.259250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01614d6-4488-499f-a7b7-8d4fcb3762f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:37.259888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01614d6-4488-499f-a7b7-8d4fcb3762f5 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:37.260169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01614d6-4488-499f-a7b7-8d4fcb3762f5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:37.260446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01614d6-4488-499f-a7b7-8d4fcb3762f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:37.277694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01614d6-4488-499f-a7b7-8d4fcb3762f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-f01614d6-4488-499f-a7b7-8d4fcb3762f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:37.283540 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:37.284688 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:37.285562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:37.288402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 250/494] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:37.294410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01614d6-4488-499f-a7b7-8d4fcb3762f5 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.432692 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:37.439129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01614d6-4488-499f-a7b7-8d4fcb3762f5 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:37.439612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b421699-5a24-4bbb-9fde-a719b2c616a7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:37.458323 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:37.480194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70d2a2-1715-45ef-880c-bcd9ee82553f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:37.481219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70d2a2-1715-45ef-880c-bcd9ee82553f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:37.482074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70d2a2-1715-45ef-880c-bcd9ee82553f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:37.483059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b70d2a2-1715-45ef-880c-bcd9ee82553f None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:37.484554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70d2a2-1715-45ef-880c-bcd9ee82553f None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:37.485352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70d2a2-1715-45ef-880c-bcd9ee82553f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:37.487310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b70d2a2-1715-45ef-880c-bcd9ee82553f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:37.499416 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 251/495] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:37.504742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70d2a2-1715-45ef-880c-bcd9ee82553f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.515410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defabd1-b8e0-4d3b-b340-d936a2503172 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:37.516055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defabd1-b8e0-4d3b-b340-d936a2503172 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:37.516332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defabd1-b8e0-4d3b-b340-d936a2503172 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:37.516605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defabd1-b8e0-4d3b-b340-d936a2503172 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:37.546403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defabd1-b8e0-4d3b-b340-d936a2503172 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:37.547854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defabd1-b8e0-4d3b-b340-d936a2503172 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0defabd1-b8e0-4d3b-b340-d936a2503172 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:37.590617 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:37.591906 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:37.592780 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:37.592780 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:37.592780 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:37.592780 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 245/496] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:37.597571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defabd1-b8e0-4d3b-b340-d936a2503172 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.624961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b70d2a2-1715-45ef-880c-bcd9ee82553f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:37.663631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5cefe-e533-48a5-bb3b-75b0006bbb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:37.665746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5cefe-e533-48a5-bb3b-75b0006bbb31 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:37.666264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5cefe-e533-48a5-bb3b-75b0006bbb31 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:37.666755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc5cefe-e533-48a5-bb3b-75b0006bbb31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:37.678579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5cefe-e533-48a5-bb3b-75b0006bbb31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:37.680468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc5cefe-e533-48a5-bb3b-75b0006bbb31 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6dc5cefe-e533-48a5-bb3b-75b0006bbb31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:37.696600 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:37.697618 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:37.698602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:37.698602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:37.698602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:37.701166 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 252/497] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:37.706950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5cefe-e533-48a5-bb3b-75b0006bbb31 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.741758 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:37.823628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc5cefe-e533-48a5-bb3b-75b0006bbb31 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:37.861693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953a59a-0f61-4a01-b4cb-acf62975df82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:37.862734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953a59a-0f61-4a01-b4cb-acf62975df82 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:37.863232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953a59a-0f61-4a01-b4cb-acf62975df82 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:37.863750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953a59a-0f61-4a01-b4cb-acf62975df82 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:37.864868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953a59a-0f61-4a01-b4cb-acf62975df82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:37.865404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953a59a-0f61-4a01-b4cb-acf62975df82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:37.867058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953a59a-0f61-4a01-b4cb-acf62975df82 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:37.881461 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 253/498] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:37.890710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953a59a-0f61-4a01-b4cb-acf62975df82 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:37.921590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defabd1-b8e0-4d3b-b340-d936a2503172 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.003654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953a59a-0f61-4a01-b4cb-acf62975df82 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.005625 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:38.045533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eea05-8c51-4d3c-8fc2-6c7c6074c123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.046092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff193f-38f9-4292-b51e-850e5db5e7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.046730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff193f-38f9-4292-b51e-850e5db5e7ad None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.047013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff193f-38f9-4292-b51e-850e5db5e7ad None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.047294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff193f-38f9-4292-b51e-850e5db5e7ad None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.047399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eea05-8c51-4d3c-8fc2-6c7c6074c123 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.047867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eea05-8c51-4d3c-8fc2-6c7c6074c123 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.047990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff193f-38f9-4292-b51e-850e5db5e7ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:38.048250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff193f-38f9-4292-b51e-850e5db5e7ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.048670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578eea05-8c51-4d3c-8fc2-6c7c6074c123 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.049716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff193f-38f9-4292-b51e-850e5db5e7ad None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.058149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578eea05-8c51-4d3c-8fc2-6c7c6074c123 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.060613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578eea05-8c51-4d3c-8fc2-6c7c6074c123 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-578eea05-8c51-4d3c-8fc2-6c7c6074c123 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:38.076197 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:38.077212 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:38.078716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:38.079252 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 254/499] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Oct 24 08:36:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:38.084623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eea05-8c51-4d3c-8fc2-6c7c6074c123 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:38.085194 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 246/500] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 488 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:38.091564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff193f-38f9-4292-b51e-850e5db5e7ad None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:38.118886 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:38.237492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff193f-38f9-4292-b51e-850e5db5e7ad None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.259028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578eea05-8c51-4d3c-8fc2-6c7c6074c123 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.279431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db880e2b-976b-42fb-a909-6287e1d4c315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.280089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db880e2b-976b-42fb-a909-6287e1d4c315 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.280370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db880e2b-976b-42fb-a909-6287e1d4c315 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.280647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db880e2b-976b-42fb-a909-6287e1d4c315 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.288559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db880e2b-976b-42fb-a909-6287e1d4c315 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.290812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db880e2b-976b-42fb-a909-6287e1d4c315 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.302699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8808b3d4-619b-4977-be32-a3fbe1498c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.303306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808b3d4-619b-4977-be32-a3fbe1498c62 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-db880e2b-976b-42fb-a909-6287e1d4c315 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:38.303428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:38.304295 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:36:38.305329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:38.306455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808b3d4-619b-4977-be32-a3fbe1498c62 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.306455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8808b3d4-619b-4977-be32-a3fbe1498c62 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.306455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808b3d4-619b-4977-be32-a3fbe1498c62 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:38.306455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808b3d4-619b-4977-be32-a3fbe1498c62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.307201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8808b3d4-619b-4977-be32-a3fbe1498c62 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.309917 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 247/501] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:38.311267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc241510-b503-4706-b1e6-7d3504bf0450 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.311556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc241510-b503-4706-b1e6-7d3504bf0450 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.311840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc241510-b503-4706-b1e6-7d3504bf0450 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.319341 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 248/502] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:38.319752 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:38.320938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc241510-b503-4706-b1e6-7d3504bf0450 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:38.329690 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 255/503] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Oct 24 08:36:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:38.330982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd02946-7aae-42dd-b73c-ba99731296d0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.331286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd02946-7aae-42dd-b73c-ba99731296d0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.331858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd02946-7aae-42dd-b73c-ba99731296d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.354877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fdd02946-7aae-42dd-b73c-ba99731296d0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:38.356757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fdd02946-7aae-42dd-b73c-ba99731296d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:38.410404 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:38.449572 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 256/504] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:38.450947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd02946-7aae-42dd-b73c-ba99731296d0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:38.453737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc241510-b503-4706-b1e6-7d3504bf0450 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.498477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f41b-f50e-4e0f-be66-54d9693003e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.499336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f41b-f50e-4e0f-be66-54d9693003e9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.499691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f41b-f50e-4e0f-be66-54d9693003e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.500050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce29f41b-f50e-4e0f-be66-54d9693003e9 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.500845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f41b-f50e-4e0f-be66-54d9693003e9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:38.501245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f41b-f50e-4e0f-be66-54d9693003e9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.502995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce29f41b-f50e-4e0f-be66-54d9693003e9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.536470 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 249/505] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Oct 24 08:36:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:38.536470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f41b-f50e-4e0f-be66-54d9693003e9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:38.653420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd02946-7aae-42dd-b73c-ba99731296d0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.707493 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:38.724387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4bd26-9174-4608-a06d-66d12eb38d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.725017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4bd26-9174-4608-a06d-66d12eb38d11 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.725324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4bd26-9174-4608-a06d-66d12eb38d11 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.725608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4bd26-9174-4608-a06d-66d12eb38d11 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.742200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce29f41b-f50e-4e0f-be66-54d9693003e9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.747258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4bd26-9174-4608-a06d-66d12eb38d11 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.748729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4bd26-9174-4608-a06d-66d12eb38d11 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e0c4bd26-9174-4608-a06d-66d12eb38d11 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:38.776505 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:38.777587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:38.778495 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:38.778495 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:38.778495 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:38.782392 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 257/506] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:38.789135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4bd26-9174-4608-a06d-66d12eb38d11 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:38.805272 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:38.815701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79eb4f5-dd22-43eb-9345-c05de7799dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.816311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb4f5-dd22-43eb-9345-c05de7799dce None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.816591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb4f5-dd22-43eb-9345-c05de7799dce None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.816861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79eb4f5-dd22-43eb-9345-c05de7799dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.926764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb4f5-dd22-43eb-9345-c05de7799dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.929766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79eb4f5-dd22-43eb-9345-c05de7799dce None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:38.941952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4bd26-9174-4608-a06d-66d12eb38d11 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:38.983156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557e0c4-f909-4cbe-b1a1-7e5d313f1f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:38.983765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e0c4-f909-4cbe-b1a1-7e5d313f1f11 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:38.984049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e0c4-f909-4cbe-b1a1-7e5d313f1f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:38.984322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557e0c4-f909-4cbe-b1a1-7e5d313f1f11 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:38.984967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557e0c4-f909-4cbe-b1a1-7e5d313f1f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:38.985267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557e0c4-f909-4cbe-b1a1-7e5d313f1f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:38.986680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557e0c4-f909-4cbe-b1a1-7e5d313f1f11 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:39.000837 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 258/507] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:39.001675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557e0c4-f909-4cbe-b1a1-7e5d313f1f11 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:39.061893 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 250/508] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:39.063085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c8209-258a-4c90-b831-4062784a4287 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.063365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c8209-258a-4c90-b831-4062784a4287 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.063637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c8209-258a-4c90-b831-4062784a4287 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.069351 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 251/509] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:39.069351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c8209-258a-4c90-b831-4062784a4287 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:39.069677 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:39.110773 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:39.132654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557e0c4-f909-4cbe-b1a1-7e5d313f1f11 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:39.168993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03030510-7c8f-41cf-ba5d-586f084188c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:39.169733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03030510-7c8f-41cf-ba5d-586f084188c8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.170015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03030510-7c8f-41cf-ba5d-586f084188c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.170287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03030510-7c8f-41cf-ba5d-586f084188c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.180315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03030510-7c8f-41cf-ba5d-586f084188c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:39.182449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03030510-7c8f-41cf-ba5d-586f084188c8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-03030510-7c8f-41cf-ba5d-586f084188c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:39.198752 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:39.199777 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:39.200658 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:39.200658 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:39.200658 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:39.200658 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 259/510] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:39.201438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03030510-7c8f-41cf-ba5d-586f084188c8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:39.201679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c8209-258a-4c90-b831-4062784a4287 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:39.238651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6046dfa-0f3b-40f2-ae1c-52c3f370fb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:39.239285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6046dfa-0f3b-40f2-ae1c-52c3f370fb32 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.239823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6046dfa-0f3b-40f2-ae1c-52c3f370fb32 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.240089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6046dfa-0f3b-40f2-ae1c-52c3f370fb32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.247621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6046dfa-0f3b-40f2-ae1c-52c3f370fb32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:39.249087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6046dfa-0f3b-40f2-ae1c-52c3f370fb32 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c6046dfa-0f3b-40f2-ae1c-52c3f370fb32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:39.260814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:39.266536 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 252/511] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22441b3-cea8-4821-bcbd-cb4d088ef98d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.267742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22441b3-cea8-4821-bcbd-cb4d088ef98d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.268477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22441b3-cea8-4821-bcbd-cb4d088ef98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.283361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f22441b3-cea8-4821-bcbd-cb4d088ef98d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:39.284579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f22441b3-cea8-4821-bcbd-cb4d088ef98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:39.307162 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:39.316619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03030510-7c8f-41cf-ba5d-586f084188c8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:39.352116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4c325-f117-4db6-94ec-78c90d4bf045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:39.353359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4c325-f117-4db6-94ec-78c90d4bf045 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.353644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4c325-f117-4db6-94ec-78c90d4bf045 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.353914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4c325-f117-4db6-94ec-78c90d4bf045 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.356378 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 253/512] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:39.357541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124cea5-c62a-409d-82f9-d0b08bd77182 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.357824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124cea5-c62a-409d-82f9-d0b08bd77182 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.358096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b124cea5-c62a-409d-82f9-d0b08bd77182 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.361368 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 254/513] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:39.361368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124cea5-c62a-409d-82f9-d0b08bd77182 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:39.365282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4c325-f117-4db6-94ec-78c90d4bf045 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:39.366746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c4c325-f117-4db6-94ec-78c90d4bf045 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d4c4c325-f117-4db6-94ec-78c90d4bf045 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:39.381602 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:39.387626 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:39.388527 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:39.388527 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:39.388527 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:39.388527 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 260/514] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:39.388527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4c325-f117-4db6-94ec-78c90d4bf045 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:39.400766 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:39.488913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b124cea5-c62a-409d-82f9-d0b08bd77182 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:39.496709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4c325-f117-4db6-94ec-78c90d4bf045 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:39.537315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bdd082-a2e5-4ef1-8318-fda381133304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:39.537951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd082-a2e5-4ef1-8318-fda381133304 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.538239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd082-a2e5-4ef1-8318-fda381133304 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.538553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bdd082-a2e5-4ef1-8318-fda381133304 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.539241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdd082-a2e5-4ef1-8318-fda381133304 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:39.539544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdd082-a2e5-4ef1-8318-fda381133304 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:39.541711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bdd082-a2e5-4ef1-8318-fda381133304 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:39.542048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0951d-f182-422f-9e81-2c1d8c52f15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:39.542865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0951d-f182-422f-9e81-2c1d8c52f15c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.543627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0951d-f182-422f-9e81-2c1d8c52f15c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.544056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec0951d-f182-422f-9e81-2c1d8c52f15c None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.545443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0951d-f182-422f-9e81-2c1d8c52f15c None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:39.545905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0951d-f182-422f-9e81-2c1d8c52f15c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:39.547470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec0951d-f182-422f-9e81-2c1d8c52f15c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:39.573412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 261/515] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:39.573412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac3c37-5e92-4bf9-9804-da3274d6b3bc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.573412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac3c37-5e92-4bf9-9804-da3274d6b3bc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.573412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bac3c37-5e92-4bf9-9804-da3274d6b3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.573868 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 255/516] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:39.573868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0951d-f182-422f-9e81-2c1d8c52f15c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:39.582938 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:39.601332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3bac3c37-5e92-4bf9-9804-da3274d6b3bc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:39.601332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3bac3c37-5e92-4bf9-9804-da3274d6b3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:39.690148 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:39.704105 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 262/517] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:39.704971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac3c37-5e92-4bf9-9804-da3274d6b3bc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:39.729380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec0951d-f182-422f-9e81-2c1d8c52f15c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:39.776974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eae1d-9866-408c-ae76-d75a469f3273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:39.777617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eae1d-9866-408c-ae76-d75a469f3273 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.777902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eae1d-9866-408c-ae76-d75a469f3273 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.778171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358eae1d-9866-408c-ae76-d75a469f3273 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.778821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eae1d-9866-408c-ae76-d75a469f3273 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:39.779122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eae1d-9866-408c-ae76-d75a469f3273 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:39.780495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358eae1d-9866-408c-ae76-d75a469f3273 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:39.802208 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 256/518] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:39.803415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eae1d-9866-408c-ae76-d75a469f3273 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:39.818903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bac3c37-5e92-4bf9-9804-da3274d6b3bc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:39.860834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1029db-ea68-474d-9e4b-942e0eab96cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:39.861583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1029db-ea68-474d-9e4b-942e0eab96cb None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:39.861868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1029db-ea68-474d-9e4b-942e0eab96cb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:39.862148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1029db-ea68-474d-9e4b-942e0eab96cb None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/b31aac6142684a039f9de2051fe42989/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:39.864136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1029db-ea68-474d-9e4b-942e0eab96cb None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=b31aac6142684a039f9de2051fe42989, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:39.866228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1029db-ea68-474d-9e4b-942e0eab96cb None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:39.870173 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:39.893327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 263/519] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:39 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/b31aac6142684a039f9de2051fe42989/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:39.893327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1029db-ea68-474d-9e4b-942e0eab96cb None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:39.973801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358eae1d-9866-408c-ae76-d75a469f3273 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.014105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db83ca0-4a39-4df6-a310-602771de5f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.014715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db83ca0-4a39-4df6-a310-602771de5f4b None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.014995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db83ca0-4a39-4df6-a310-602771de5f4b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.015264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db83ca0-4a39-4df6-a310-602771de5f4b None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.015920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db83ca0-4a39-4df6-a310-602771de5f4b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.017417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db83ca0-4a39-4df6-a310-602771de5f4b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.029946 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:40.044328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 257/520] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:36:39 2022] POST /identity/v3/users => generated 254 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:40.045422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db83ca0-4a39-4df6-a310-602771de5f4b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:40.072931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1029db-ea68-474d-9e4b-942e0eab96cb None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.128772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2bc2b-b062-407a-b83c-385777055dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.129679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2bc2b-b062-407a-b83c-385777055dad None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.130294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2bc2b-b062-407a-b83c-385777055dad None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.130582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac2bc2b-b062-407a-b83c-385777055dad None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.131198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2bc2b-b062-407a-b83c-385777055dad None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.132900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac2bc2b-b062-407a-b83c-385777055dad None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-0ac2bc2b-b062-407a-b83c-385777055dad None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:40.147785 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:40.148973 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:40.150013 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 264/521] 10.222.0.25 () {56 vars in 1129 bytes} [Mon Oct 24 08:36:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:40.150856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2bc2b-b062-407a-b83c-385777055dad None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:40.201910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db83ca0-4a39-4df6-a310-602771de5f4b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.236270 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:40.270336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c52deb-8548-43bf-a621-6025a3dda8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.270795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c52deb-8548-43bf-a621-6025a3dda8d0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.271071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c52deb-8548-43bf-a621-6025a3dda8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.271338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c52deb-8548-43bf-a621-6025a3dda8d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.280230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c52deb-8548-43bf-a621-6025a3dda8d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.282673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c52deb-8548-43bf-a621-6025a3dda8d0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-94c52deb-8548-43bf-a621-6025a3dda8d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:40.298092 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:40.299101 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:40.300017 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:40.300017 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:40.300017 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:40.300017 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:40.300017 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:40.300017 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:40.300017 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:40.300017 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:40.300017 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 258/522] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:40.300525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c52deb-8548-43bf-a621-6025a3dda8d0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:40.304033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac2bc2b-b062-407a-b83c-385777055dad None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.352425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b058d-d97c-4f4a-adfc-a03a7ddcf86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.353985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b058d-d97c-4f4a-adfc-a03a7ddcf86a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.354266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b058d-d97c-4f4a-adfc-a03a7ddcf86a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.354568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6b058d-d97c-4f4a-adfc-a03a7ddcf86a None admin] PATH_INFO: `/v3/services/network` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.355159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b058d-d97c-4f4a-adfc-a03a7ddcf86a None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.356567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6b058d-d97c-4f4a-adfc-a03a7ddcf86a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4d6b058d-d97c-4f4a-adfc-a03a7ddcf86a None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:40.367879 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:40.369017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:40.369940 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 265/523] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/services/network => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:40.371301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b058d-d97c-4f4a-adfc-a03a7ddcf86a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:40.400668 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:40.462513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c52deb-8548-43bf-a621-6025a3dda8d0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.505976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c5f89-b279-47b9-8187-bab9e9b12d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.506754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c5f89-b279-47b9-8187-bab9e9b12d82 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.507128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c5f89-b279-47b9-8187-bab9e9b12d82 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.507511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378c5f89-b279-47b9-8187-bab9e9b12d82 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.509436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c5f89-b279-47b9-8187-bab9e9b12d82 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:40.509854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c5f89-b279-47b9-8187-bab9e9b12d82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.511345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378c5f89-b279-47b9-8187-bab9e9b12d82 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.515107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6b058d-d97c-4f4a-adfc-a03a7ddcf86a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.521176 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 259/524] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:40.522236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c5f89-b279-47b9-8187-bab9e9b12d82 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:40.540961 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:40.554926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ae9e4-5919-473e-880b-8905ba98a0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.555797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ae9e4-5919-473e-880b-8905ba98a0e2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.556256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ae9e4-5919-473e-880b-8905ba98a0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.556677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294ae9e4-5919-473e-880b-8905ba98a0e2 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.557607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ae9e4-5919-473e-880b-8905ba98a0e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:40.558058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ae9e4-5919-473e-880b-8905ba98a0e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.559753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294ae9e4-5919-473e-880b-8905ba98a0e2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.573761 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 266/525] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:40.574816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ae9e4-5919-473e-880b-8905ba98a0e2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:40.660320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378c5f89-b279-47b9-8187-bab9e9b12d82 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.682757 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:40.699268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e97cf-3183-4dac-b4f1-0ebe7c02908b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.699777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e97cf-3183-4dac-b4f1-0ebe7c02908b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.700057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e97cf-3183-4dac-b4f1-0ebe7c02908b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.700335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e97cf-3183-4dac-b4f1-0ebe7c02908b None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.701043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e97cf-3183-4dac-b4f1-0ebe7c02908b None admin] RBAC: Adding query filter params (name=network) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:40.701274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e97cf-3183-4dac-b4f1-0ebe7c02908b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.702707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192e97cf-3183-4dac-b4f1-0ebe7c02908b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.707613 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 260/526] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:40.711543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294ae9e4-5919-473e-880b-8905ba98a0e2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.713595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e97cf-3183-4dac-b4f1-0ebe7c02908b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:40.753908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5ff86-572b-4141-92a0-d8eba4caba85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.754920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5ff86-572b-4141-92a0-d8eba4caba85 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.755415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5ff86-572b-4141-92a0-d8eba4caba85 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.755890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a5ff86-572b-4141-92a0-d8eba4caba85 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.756717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5ff86-572b-4141-92a0-d8eba4caba85 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:40.757341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5ff86-572b-4141-92a0-d8eba4caba85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.758995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a5ff86-572b-4141-92a0-d8eba4caba85 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.771845 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 267/527] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:40.773167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5ff86-572b-4141-92a0-d8eba4caba85 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:40.866055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e97cf-3183-4dac-b4f1-0ebe7c02908b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:40.878588 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:40.942774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b91cc-a7de-4990-b125-5b7abfb0d913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:40.943373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b91cc-a7de-4990-b125-5b7abfb0d913 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:40.943662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b91cc-a7de-4990-b125-5b7abfb0d913 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:40.943939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b91cc-a7de-4990-b125-5b7abfb0d913 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:40.944676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b91cc-a7de-4990-b125-5b7abfb0d913 None admin] RBAC: Adding query filter params (role.id=9f1d8ee2ec724d0cbb41c537a7d38406, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=fc41482005be496f822a3118839674c9) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:40.944987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b91cc-a7de-4990-b125-5b7abfb0d913 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:40.946538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b91cc-a7de-4990-b125-5b7abfb0d913 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:40.963764 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 261/528] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/role_assignments?user.id=fc41482005be496f822a3118839674c9&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=9f1d8ee2ec724d0cbb41c537a7d38406 => generated 608 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:40.985941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a5ff86-572b-4141-92a0-d8eba4caba85 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:41.048303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e72e811-0f6e-471e-81e9-72c61fba611c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:41.048947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e811-0f6e-471e-81e9-72c61fba611c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:41.049230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e811-0f6e-471e-81e9-72c61fba611c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:41.049533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e72e811-0f6e-471e-81e9-72c61fba611c None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:41.050193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72e811-0f6e-471e-81e9-72c61fba611c None admin] RBAC: Adding query filter params (type=network) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:41.050501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72e811-0f6e-471e-81e9-72c61fba611c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:41.051955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e72e811-0f6e-471e-81e9-72c61fba611c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:41.067586 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 268/529] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:42.377461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240a072-6ec5-4c42-b4f7-b7f8cf5c4379 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:42.377972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240a072-6ec5-4c42-b4f7-b7f8cf5c4379 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:42.378083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a240a072-6ec5-4c42-b4f7-b7f8cf5c4379 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:42.379611 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 262/530] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:42.385571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2c526-1554-4900-9394-719ad87c3a6d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:42.386043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2c526-1554-4900-9394-719ad87c3a6d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:42.386142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2c526-1554-4900-9394-719ad87c3a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:42.389951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf0895-322f-44e5-9580-6b7e3eff9796 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:42.390582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf0895-322f-44e5-9580-6b7e3eff9796 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:42.391074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bf0895-322f-44e5-9580-6b7e3eff9796 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:42.392829 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 263/531] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:42.398453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c46d-935c-4996-938a-359038efa160 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:42.399049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c46d-935c-4996-938a-359038efa160 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:42.400070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c817c46d-935c-4996-938a-359038efa160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:42.414380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c8d2c526-1554-4900-9394-719ad87c3a6d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:42.416241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8d2c526-1554-4900-9394-719ad87c3a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:42.426458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c817c46d-935c-4996-938a-359038efa160 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:42.427691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c817c46d-935c-4996-938a-359038efa160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:42.525426 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:42.544115 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 269/532] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:36:42.566149 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 264/533] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 08:36:42.916962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2c526-1554-4900-9394-719ad87c3a6d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:42.919348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817c46d-935c-4996-938a-359038efa160 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:42.994204 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:43.132321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2c526-1554-4900-9394-719ad87c3a6d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:43.152685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c817c46d-935c-4996-938a-359038efa160 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:43.193021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4955-ba1b-42f9-b288-746e3e59f989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:43.193614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4955-ba1b-42f9-b288-746e3e59f989 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.193894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4955-ba1b-42f9-b288-746e3e59f989 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.194167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddc4955-ba1b-42f9-b288-746e3e59f989 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.209323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddc4955-ba1b-42f9-b288-746e3e59f989 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9ddc4955-ba1b-42f9-b288-746e3e59f989 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:43.210674 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:43.211586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:43.213001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 270/534] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:43.218356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4955-ba1b-42f9-b288-746e3e59f989 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:43.238930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c147a5-d135-4ca2-9abe-d209f2a85bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:43.240204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c147a5-d135-4ca2-9abe-d209f2a85bdf None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.240713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c147a5-d135-4ca2-9abe-d209f2a85bdf None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.241209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c147a5-d135-4ca2-9abe-d209f2a85bdf None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.266470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c147a5-d135-4ca2-9abe-d209f2a85bdf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-43c147a5-d135-4ca2-9abe-d209f2a85bdf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:43.277512 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:43.278475 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:43.279319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:43.283950 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 265/535] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:43.290623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c147a5-d135-4ca2-9abe-d209f2a85bdf None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:43.357221 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:43.437642 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:43.442776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddc4955-ba1b-42f9-b288-746e3e59f989 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:43.482382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c147a5-d135-4ca2-9abe-d209f2a85bdf None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:43.504652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d9fd8-78bb-4f9d-95eb-768105068de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:43.505263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d9fd8-78bb-4f9d-95eb-768105068de4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.505570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d9fd8-78bb-4f9d-95eb-768105068de4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.505849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d9fd8-78bb-4f9d-95eb-768105068de4 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.506519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d9fd8-78bb-4f9d-95eb-768105068de4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:43.506822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d9fd8-78bb-4f9d-95eb-768105068de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:43.508216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d9fd8-78bb-4f9d-95eb-768105068de4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:43.521989 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 271/536] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:43.524099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d9fd8-78bb-4f9d-95eb-768105068de4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:43.543075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec09421-0912-4937-80cb-e016209a9cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:43.543751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec09421-0912-4937-80cb-e016209a9cc3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.544032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec09421-0912-4937-80cb-e016209a9cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.544305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec09421-0912-4937-80cb-e016209a9cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.544971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec09421-0912-4937-80cb-e016209a9cc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:43.545274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec09421-0912-4937-80cb-e016209a9cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:43.546689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec09421-0912-4937-80cb-e016209a9cc3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:43.566643 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 266/537] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:43.569637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec09421-0912-4937-80cb-e016209a9cc3 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:43.675421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d9fd8-78bb-4f9d-95eb-768105068de4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:43.702490 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:43.707260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec09421-0912-4937-80cb-e016209a9cc3 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:43.714016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d87bac0-9115-40f1-83e9-38979e577c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:43.714653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87bac0-9115-40f1-83e9-38979e577c25 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.714934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87bac0-9115-40f1-83e9-38979e577c25 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.715209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d87bac0-9115-40f1-83e9-38979e577c25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.727670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87bac0-9115-40f1-83e9-38979e577c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:43.729695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d87bac0-9115-40f1-83e9-38979e577c25 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9d87bac0-9115-40f1-83e9-38979e577c25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:43.744802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:43.745911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:43.746807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:43.746807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:43.746807 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:43.749447 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 272/538] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:43.750738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d663a6c-45cc-4eb1-ac69-c39420de44fe None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.751026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d663a6c-45cc-4eb1-ac69-c39420de44fe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.751306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d663a6c-45cc-4eb1-ac69-c39420de44fe None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.752586 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 273/539] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:43.753151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000520f-0d2b-4886-b478-855cac0b4a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:43.753620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc8036-92fe-43f7-846c-b2b5577a1a0e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.753916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc8036-92fe-43f7-846c-b2b5577a1a0e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.754238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cc8036-92fe-43f7-846c-b2b5577a1a0e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.754520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000520f-0d2b-4886-b478-855cac0b4a50 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.754926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000520f-0d2b-4886-b478-855cac0b4a50 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.755327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000520f-0d2b-4886-b478-855cac0b4a50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.755662 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 274/540] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:43.756369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc8036-92fe-43f7-846c-b2b5577a1a0e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:43.771165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000520f-0d2b-4886-b478-855cac0b4a50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:43.772635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000520f-0d2b-4886-b478-855cac0b4a50 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:43.775410 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-2000520f-0d2b-4886-b478-855cac0b4a50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:43.788911 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:43.789961 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:43.791421 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:43.791421 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:43.791421 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:43.796593 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 267/541] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:43.797659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd41f-30d7-4b0a-b671-deed58e6a7bb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.797947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd41f-30d7-4b0a-b671-deed58e6a7bb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.798225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fd41f-30d7-4b0a-b671-deed58e6a7bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.817450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fc1fd41f-30d7-4b0a-b671-deed58e6a7bb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:43.818705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fc1fd41f-30d7-4b0a-b671-deed58e6a7bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:43.871147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cc8036-92fe-43f7-846c-b2b5577a1a0e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:43.895506 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 268/542] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:43.896932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec669e-db8b-40be-a0f9-a2ff097eee33 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.897223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec669e-db8b-40be-a0f9-a2ff097eee33 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.897529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ec669e-db8b-40be-a0f9-a2ff097eee33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.920731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8a0eb-b9a0-44de-b988-37777f441ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:43.921426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8a0eb-b9a0-44de-b988-37777f441ccd None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:43.921715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8a0eb-b9a0-44de-b988-37777f441ccd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:43.921994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8a0eb-b9a0-44de-b988-37777f441ccd None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:43.922723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8a0eb-b9a0-44de-b988-37777f441ccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:43.923033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8a0eb-b9a0-44de-b988-37777f441ccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:43.924556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8a0eb-b9a0-44de-b988-37777f441ccd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:43.925729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-25ec669e-db8b-40be-a0f9-a2ff097eee33 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:43.927375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-25ec669e-db8b-40be-a0f9-a2ff097eee33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:43.939348 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 275/543] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:43.940681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8a0eb-b9a0-44de-b988-37777f441ccd None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.026539 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:44.041333 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 269/544] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:44.041333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec669e-db8b-40be-a0f9-a2ff097eee33 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.049785 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:44.073548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8a0eb-b9a0-44de-b988-37777f441ccd None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.119577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6001eb5b-6d77-4704-a340-49824640bb59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.120191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001eb5b-6d77-4704-a340-49824640bb59 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.120625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001eb5b-6d77-4704-a340-49824640bb59 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.120902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6001eb5b-6d77-4704-a340-49824640bb59 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.121730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001eb5b-6d77-4704-a340-49824640bb59 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:44.122028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001eb5b-6d77-4704-a340-49824640bb59 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.124024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6001eb5b-6d77-4704-a340-49824640bb59 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.138942 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 276/545] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:44.140402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969d3f5-d62e-4893-904a-797c2fde400e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.140686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969d3f5-d62e-4893-904a-797c2fde400e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.140956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0969d3f5-d62e-4893-904a-797c2fde400e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.141218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ec669e-db8b-40be-a0f9-a2ff097eee33 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.142478 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 277/546] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:44.146314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969d3f5-d62e-4893-904a-797c2fde400e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.183641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e24ff6-8014-45b4-b382-340ccf21f8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.184267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e24ff6-8014-45b4-b382-340ccf21f8cd None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.184543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e24ff6-8014-45b4-b382-340ccf21f8cd None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.184816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e24ff6-8014-45b4-b382-340ccf21f8cd None admin] PATH_INFO: `/v3/users/nova` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.192729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e24ff6-8014-45b4-b382-340ccf21f8cd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.194214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e24ff6-8014-45b4-b382-340ccf21f8cd None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e9e24ff6-8014-45b4-b382-340ccf21f8cd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:44.206446 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:44.207432 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 270/547] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Oct 24 08:36:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be888-d97e-4e74-8b81-fc0e1c58e72a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.213994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be888-d97e-4e74-8b81-fc0e1c58e72a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.214738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3be888-d97e-4e74-8b81-fc0e1c58e72a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.227201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fe3be888-d97e-4e74-8b81-fc0e1c58e72a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:44.228905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fe3be888-d97e-4e74-8b81-fc0e1c58e72a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:44.277586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0969d3f5-d62e-4893-904a-797c2fde400e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.301202 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 271/548] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 08:36:44.302412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3be888-d97e-4e74-8b81-fc0e1c58e72a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.304867 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:44.326500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7f8bf-f76a-4171-932e-a18b3a994659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.328186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7f8bf-f76a-4171-932e-a18b3a994659 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.329687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7f8bf-f76a-4171-932e-a18b3a994659 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.330014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b7f8bf-f76a-4171-932e-a18b3a994659 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.339647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7f8bf-f76a-4171-932e-a18b3a994659 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.341166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b7f8bf-f76a-4171-932e-a18b3a994659 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-80b7f8bf-f76a-4171-932e-a18b3a994659 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:44.354064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:44.355079 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 278/549] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Oct 24 08:36:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:44.356633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7f8bf-f76a-4171-932e-a18b3a994659 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.365343 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:44.422509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3be888-d97e-4e74-8b81-fc0e1c58e72a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.458136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbbb1d-f8f3-422a-9e12-1bcfc5a4539b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.458765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbbb1d-f8f3-422a-9e12-1bcfc5a4539b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.459048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbbb1d-f8f3-422a-9e12-1bcfc5a4539b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.459323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fbbb1d-f8f3-422a-9e12-1bcfc5a4539b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.466950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b7f8bf-f76a-4171-932e-a18b3a994659 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.470418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fbbb1d-f8f3-422a-9e12-1bcfc5a4539b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-07fbbb1d-f8f3-422a-9e12-1bcfc5a4539b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:44.475241 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:44.476167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:44.477001 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 272/550] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:44.478273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbbb1d-f8f3-422a-9e12-1bcfc5a4539b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.512906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b597845-f604-4c86-a773-9cf383d442e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.513548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b597845-f604-4c86-a773-9cf383d442e8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.513836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b597845-f604-4c86-a773-9cf383d442e8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.514108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b597845-f604-4c86-a773-9cf383d442e8 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.515019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b597845-f604-4c86-a773-9cf383d442e8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:44.515128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b597845-f604-4c86-a773-9cf383d442e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.516557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b597845-f604-4c86-a773-9cf383d442e8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.539982 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 279/551] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Oct 24 08:36:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:44.539982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b597845-f604-4c86-a773-9cf383d442e8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.547250 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:44.585945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fbbb1d-f8f3-422a-9e12-1bcfc5a4539b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.597815 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:44.620305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57779b-3759-44d4-9d70-5946a0c460d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.620907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57779b-3759-44d4-9d70-5946a0c460d4 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.621180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57779b-3759-44d4-9d70-5946a0c460d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.621485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e57779b-3759-44d4-9d70-5946a0c460d4 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.622126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57779b-3759-44d4-9d70-5946a0c460d4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.623485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e57779b-3759-44d4-9d70-5946a0c460d4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.639469 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 273/552] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:44 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:44.640298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57779b-3759-44d4-9d70-5946a0c460d4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.648584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b597845-f604-4c86-a773-9cf383d442e8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.704195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8808bc-2917-4384-868e-24794fc917b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.705099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8808bc-2917-4384-868e-24794fc917b4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.705565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8808bc-2917-4384-868e-24794fc917b4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.705913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8808bc-2917-4384-868e-24794fc917b4 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.706688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8808bc-2917-4384-868e-24794fc917b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:44.707000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8808bc-2917-4384-868e-24794fc917b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.708506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8808bc-2917-4384-868e-24794fc917b4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.735216 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 280/553] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Oct 24 08:36:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:44.735216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8808bc-2917-4384-868e-24794fc917b4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.771558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e57779b-3759-44d4-9d70-5946a0c460d4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.798016 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:44.813897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803784fe-659c-4de2-8545-9fb25bd9a7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.814621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803784fe-659c-4de2-8545-9fb25bd9a7de None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.815401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803784fe-659c-4de2-8545-9fb25bd9a7de None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.815401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803784fe-659c-4de2-8545-9fb25bd9a7de None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.815812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803784fe-659c-4de2-8545-9fb25bd9a7de None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:44.816109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803784fe-659c-4de2-8545-9fb25bd9a7de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.817506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803784fe-659c-4de2-8545-9fb25bd9a7de None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.829077 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 274/554] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:44.829077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803784fe-659c-4de2-8545-9fb25bd9a7de None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:44.860335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8808bc-2917-4384-868e-24794fc917b4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.868655 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:44.902760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c41269-c998-402c-b1fd-bb5261acbc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.903369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c41269-c998-402c-b1fd-bb5261acbc44 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.903644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c41269-c998-402c-b1fd-bb5261acbc44 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.903913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c41269-c998-402c-b1fd-bb5261acbc44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.942388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803784fe-659c-4de2-8545-9fb25bd9a7de None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:44.980076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c41269-c998-402c-b1fd-bb5261acbc44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.980309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee620a-79d5-48a4-a210-c5bb9dc55b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:44.980867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee620a-79d5-48a4-a210-c5bb9dc55b24 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:44.981183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee620a-79d5-48a4-a210-c5bb9dc55b24 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:44.981512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fee620a-79d5-48a4-a210-c5bb9dc55b24 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:44.981611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c41269-c998-402c-b1fd-bb5261acbc44 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.982162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee620a-79d5-48a4-a210-c5bb9dc55b24 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:44.983529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fee620a-79d5-48a4-a210-c5bb9dc55b24 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:44.999978 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 275/555] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:44 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:45.000800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee620a-79d5-48a4-a210-c5bb9dc55b24 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:45.088400 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:45.130310 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 281/556] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:44 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 08:36:45.131709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c41269-c998-402c-b1fd-bb5261acbc44 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:45.144699 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:45.168814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fee620a-79d5-48a4-a210-c5bb9dc55b24 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:45.210448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bccf46-c9ee-4a24-8c8b-bc67f1c87a77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:45.211088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bccf46-c9ee-4a24-8c8b-bc67f1c87a77 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:45.211370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bccf46-c9ee-4a24-8c8b-bc67f1c87a77 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:45.211646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bccf46-c9ee-4a24-8c8b-bc67f1c87a77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:45.232588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bccf46-c9ee-4a24-8c8b-bc67f1c87a77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:45.233938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bccf46-c9ee-4a24-8c8b-bc67f1c87a77 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-b5bccf46-c9ee-4a24-8c8b-bc67f1c87a77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:45.251372 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:45.252365 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:45.253250 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:45.253250 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:45.253250 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:45.255655 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 276/557] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:45.256811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bccf46-c9ee-4a24-8c8b-bc67f1c87a77 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:45.275822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c41269-c998-402c-b1fd-bb5261acbc44 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:45.335964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379887-fe7d-471b-a238-6767f9fa6a5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:45.337632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379887-fe7d-471b-a238-6767f9fa6a5d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:45.338491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379887-fe7d-471b-a238-6767f9fa6a5d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:45.339271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39379887-fe7d-471b-a238-6767f9fa6a5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:45.357982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39379887-fe7d-471b-a238-6767f9fa6a5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:45.360462 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:45.362169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39379887-fe7d-471b-a238-6767f9fa6a5d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:45.378767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bccf46-c9ee-4a24-8c8b-bc67f1c87a77 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-39379887-fe7d-471b-a238-6767f9fa6a5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:45.391439 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:45.393395 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:45.395185 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:45.395185 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:45.395185 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:45.405444 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 282/558] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:45.407322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379887-fe7d-471b-a238-6767f9fa6a5d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:45.419055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631badb-512c-4175-a29a-7eab8208446a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:45.419700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631badb-512c-4175-a29a-7eab8208446a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:45.419983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631badb-512c-4175-a29a-7eab8208446a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:45.420259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6631badb-512c-4175-a29a-7eab8208446a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:45.433895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631badb-512c-4175-a29a-7eab8208446a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:45.435712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6631badb-512c-4175-a29a-7eab8208446a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-6631badb-512c-4175-a29a-7eab8208446a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:45.453141 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:45.454264 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:45.455747 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:45.455747 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:45.455747 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:45.455747 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 277/559] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:45.455747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631badb-512c-4175-a29a-7eab8208446a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:45.479040 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:45.536351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39379887-fe7d-471b-a238-6767f9fa6a5d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:45.573371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161b44c-2829-45bd-af3a-5c3615de2bf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:45.574393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161b44c-2829-45bd-af3a-5c3615de2bf4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:45.574877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161b44c-2829-45bd-af3a-5c3615de2bf4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:45.575354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9161b44c-2829-45bd-af3a-5c3615de2bf4 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:45.576227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161b44c-2829-45bd-af3a-5c3615de2bf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:45.576733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161b44c-2829-45bd-af3a-5c3615de2bf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:45.578369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9161b44c-2829-45bd-af3a-5c3615de2bf4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:45.584254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6631badb-512c-4175-a29a-7eab8208446a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:45.592555 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 283/560] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:45.593904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161b44c-2829-45bd-af3a-5c3615de2bf4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:45.628003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a33e40-bf2c-4ce3-a6c8-79a261b29660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:45.628418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a33e40-bf2c-4ce3-a6c8-79a261b29660 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:45.628879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a33e40-bf2c-4ce3-a6c8-79a261b29660 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:45.629160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a33e40-bf2c-4ce3-a6c8-79a261b29660 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:45.629826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a33e40-bf2c-4ce3-a6c8-79a261b29660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:45.630204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a33e40-bf2c-4ce3-a6c8-79a261b29660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:45.631561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a33e40-bf2c-4ce3-a6c8-79a261b29660 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:45.645028 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 278/561] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:45.645771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a33e40-bf2c-4ce3-a6c8-79a261b29660 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:45.649553 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:45.714625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9161b44c-2829-45bd-af3a-5c3615de2bf4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:45.735570 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:45.757719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d641c82-6255-4b49-aad3-4526286e0f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:45.758703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d641c82-6255-4b49-aad3-4526286e0f11 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:45.759262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d641c82-6255-4b49-aad3-4526286e0f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:45.759866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d641c82-6255-4b49-aad3-4526286e0f11 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:45.760329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a33e40-bf2c-4ce3-a6c8-79a261b29660 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:45.760991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d641c82-6255-4b49-aad3-4526286e0f11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:45.761562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d641c82-6255-4b49-aad3-4526286e0f11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:45.763172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d641c82-6255-4b49-aad3-4526286e0f11 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:45.776371 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 284/562] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:45.778342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d641c82-6255-4b49-aad3-4526286e0f11 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:45.800218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac25508-5b4e-4069-9d8e-0bd0b68d5df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:45.800855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac25508-5b4e-4069-9d8e-0bd0b68d5df2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:45.801139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac25508-5b4e-4069-9d8e-0bd0b68d5df2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:45.801492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac25508-5b4e-4069-9d8e-0bd0b68d5df2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:45.809619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac25508-5b4e-4069-9d8e-0bd0b68d5df2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:45.811048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac25508-5b4e-4069-9d8e-0bd0b68d5df2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1ac25508-5b4e-4069-9d8e-0bd0b68d5df2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:45.824350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:45.825338 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:45.826918 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:45.826918 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:45.826918 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:45.826918 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:45.826918 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:45.826918 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:45.826918 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:45.826918 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:45.830457 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 279/563] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:45.831348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac25508-5b4e-4069-9d8e-0bd0b68d5df2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:45.902910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d641c82-6255-4b49-aad3-4526286e0f11 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:45.904842 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:45.943678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241dc26-ced4-4b42-a59b-c1496014f152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:45.945265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241dc26-ced4-4b42-a59b-c1496014f152 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:45.945828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241dc26-ced4-4b42-a59b-c1496014f152 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:45.946306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0241dc26-ced4-4b42-a59b-c1496014f152 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:45.950864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac25508-5b4e-4069-9d8e-0bd0b68d5df2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:45.956202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241dc26-ced4-4b42-a59b-c1496014f152 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:45.957972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0241dc26-ced4-4b42-a59b-c1496014f152 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-0241dc26-ced4-4b42-a59b-c1496014f152 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:45.973625 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:45.974679 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:45.975643 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 285/564] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:45.982202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241dc26-ced4-4b42-a59b-c1496014f152 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:46.005816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ba67-00c1-43be-b665-abfc19543c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:46.007099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ba67-00c1-43be-b665-abfc19543c60 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.007585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ba67-00c1-43be-b665-abfc19543c60 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.008319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f6ba67-00c1-43be-b665-abfc19543c60 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.018508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ba67-00c1-43be-b665-abfc19543c60 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:46.020478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f6ba67-00c1-43be-b665-abfc19543c60 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:46.033572 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-65f6ba67-00c1-43be-b665-abfc19543c60 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:46.034687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:46.035792 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:46.036711 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:46.036711 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:46.036711 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:46.036711 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:46.036711 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:46.036711 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:46.036711 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:46.036711 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:46.037161 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 280/565] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:46.038311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ba67-00c1-43be-b665-abfc19543c60 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:46.105185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0241dc26-ced4-4b42-a59b-c1496014f152 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:46.149171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c755992-e662-428d-bc21-bc35e6c02121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:46.150544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c755992-e662-428d-bc21-bc35e6c02121 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.151005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c755992-e662-428d-bc21-bc35e6c02121 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.151448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c755992-e662-428d-bc21-bc35e6c02121 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.152321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c755992-e662-428d-bc21-bc35e6c02121 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:46.153396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c755992-e662-428d-bc21-bc35e6c02121 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:46.155361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c755992-e662-428d-bc21-bc35e6c02121 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:46.166842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f6ba67-00c1-43be-b665-abfc19543c60 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:46.176651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 286/566] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:46.177940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c755992-e662-428d-bc21-bc35e6c02121 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:46.195488 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:46.208897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a2841-1e33-4ff9-9270-47a70f54264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:46.209798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2841-1e33-4ff9-9270-47a70f54264e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.210146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2841-1e33-4ff9-9270-47a70f54264e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.210480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a2841-1e33-4ff9-9270-47a70f54264e None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.211335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a2841-1e33-4ff9-9270-47a70f54264e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:46.211706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a2841-1e33-4ff9-9270-47a70f54264e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:46.214236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a2841-1e33-4ff9-9270-47a70f54264e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:46.241412 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 281/567] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Oct 24 08:36:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:46.242377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a2841-1e33-4ff9-9270-47a70f54264e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:46.301054 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:46.308750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c755992-e662-428d-bc21-bc35e6c02121 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:46.365141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdf737-8956-4aee-a880-a1118c427e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:46.365781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdf737-8956-4aee-a880-a1118c427e36 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.366057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdf737-8956-4aee-a880-a1118c427e36 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.366325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdf737-8956-4aee-a880-a1118c427e36 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.367015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdf737-8956-4aee-a880-a1118c427e36 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:46.367320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdf737-8956-4aee-a880-a1118c427e36 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:46.369377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdf737-8956-4aee-a880-a1118c427e36 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:46.378097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a2841-1e33-4ff9-9270-47a70f54264e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:46.382429 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 287/568] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:46.383402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdf737-8956-4aee-a880-a1118c427e36 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:46.420985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f6a57-1268-4a18-979a-99b340b1f5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:46.422003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f6a57-1268-4a18-979a-99b340b1f5f2 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.422522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f6a57-1268-4a18-979a-99b340b1f5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.423006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2f6a57-1268-4a18-979a-99b340b1f5f2 None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/0e9492df0cf34fd0b1e6a0ac2f77cd37/roles/9f1d8ee2ec724d0cbb41c537a7d38406` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.438996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f6a57-1268-4a18-979a-99b340b1f5f2 None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=0e9492df0cf34fd0b1e6a0ac2f77cd37, role_id=9f1d8ee2ec724d0cbb41c537a7d38406)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:46.440851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2f6a57-1268-4a18-979a-99b340b1f5f2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:46.462889 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 282/569] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:46 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/0e9492df0cf34fd0b1e6a0ac2f77cd37/roles/9f1d8ee2ec724d0cbb41c537a7d38406 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:46.462889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f6a57-1268-4a18-979a-99b340b1f5f2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:46.529463 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:46.533503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdf737-8956-4aee-a880-a1118c427e36 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:46.612819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ef66d-ff86-440a-bfb5-ef63a89c8dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:46.613559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ef66d-ff86-440a-bfb5-ef63a89c8dd7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.613841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ef66d-ff86-440a-bfb5-ef63a89c8dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.614117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729ef66d-ff86-440a-bfb5-ef63a89c8dd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.630824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ef66d-ff86-440a-bfb5-ef63a89c8dd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:46.632842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729ef66d-ff86-440a-bfb5-ef63a89c8dd7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-729ef66d-ff86-440a-bfb5-ef63a89c8dd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:46.662462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:46.663562 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:46.664461 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:46.664461 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:46.664461 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:46.667706 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 288/570] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:46.673177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ef66d-ff86-440a-bfb5-ef63a89c8dd7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:46.694084 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:46.697707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2f6a57-1268-4a18-979a-99b340b1f5f2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:46.736390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598a31-3efe-4821-8798-7e1ccb98bb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:46.737396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598a31-3efe-4821-8798-7e1ccb98bb24 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.737905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598a31-3efe-4821-8798-7e1ccb98bb24 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.738393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8598a31-3efe-4821-8798-7e1ccb98bb24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.739425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8598a31-3efe-4821-8798-7e1ccb98bb24 None admin] RBAC: Adding query filter params (role.id=d266f03406d94df8bb9cad19b577978f, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=b31aac6142684a039f9de2051fe42989) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:46.740225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8598a31-3efe-4821-8798-7e1ccb98bb24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:46.741911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8598a31-3efe-4821-8798-7e1ccb98bb24 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:46.749021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 283/571] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:46 2022] GET /identity/v3/role_assignments?user.id=b31aac6142684a039f9de2051fe42989&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=d266f03406d94df8bb9cad19b577978f => generated 608 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:46.796285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729ef66d-ff86-440a-bfb5-ef63a89c8dd7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:46.841202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ff2c7c-c4ac-4320-b322-36b9d9d76319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:46.841933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff2c7c-c4ac-4320-b322-36b9d9d76319 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.842229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff2c7c-c4ac-4320-b322-36b9d9d76319 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.842505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ff2c7c-c4ac-4320-b322-36b9d9d76319 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.843179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff2c7c-c4ac-4320-b322-36b9d9d76319 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:46.843485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff2c7c-c4ac-4320-b322-36b9d9d76319 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:46.845056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ff2c7c-c4ac-4320-b322-36b9d9d76319 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:46.865470 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 289/572] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:46.867081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598a31-3efe-4821-8798-7e1ccb98bb24 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:46.950893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077740f6-69aa-4bf7-9fda-77a109a1961e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.951082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077740f6-69aa-4bf7-9fda-77a109a1961e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.951351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077740f6-69aa-4bf7-9fda-77a109a1961e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.952692 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 290/573] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:36:46.959007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397bdd-e114-42dd-ac98-f05524762626 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:46.959274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397bdd-e114-42dd-ac98-f05524762626 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:46.959544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20397bdd-e114-42dd-ac98-f05524762626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:46.984650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-20397bdd-e114-42dd-ac98-f05524762626 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:46.985964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-20397bdd-e114-42dd-ac98-f05524762626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:46.992538 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:47.003647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8598a31-3efe-4821-8798-7e1ccb98bb24 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:47.052822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb771b5-f950-49ec-9dca-75591ddfa6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:47.060735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb771b5-f950-49ec-9dca-75591ddfa6f4 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:47.061027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb771b5-f950-49ec-9dca-75591ddfa6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:47.061313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb771b5-f950-49ec-9dca-75591ddfa6f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:47.066168 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:47.072358 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 291/574] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:47.072956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb771b5-f950-49ec-9dca-75591ddfa6f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:47.074548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb771b5-f950-49ec-9dca-75591ddfa6f4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-8eb771b5-f950-49ec-9dca-75591ddfa6f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:47.091687 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:47.092705 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:47.093638 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:47.093638 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:47.093638 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:47.093638 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:47.093638 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:47.093638 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:47.093638 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:47.093638 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:47.097428 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 284/575] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:47.099164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20397bdd-e114-42dd-ac98-f05524762626 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:47.206000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20397bdd-e114-42dd-ac98-f05524762626 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:47.242653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc786494-c969-4290-821d-bf0970054003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:47.244129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc786494-c969-4290-821d-bf0970054003 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:47.244410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc786494-c969-4290-821d-bf0970054003 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:47.244689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc786494-c969-4290-821d-bf0970054003 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:47.245466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc786494-c969-4290-821d-bf0970054003 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:47.245774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc786494-c969-4290-821d-bf0970054003 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:47.247213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc786494-c969-4290-821d-bf0970054003 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:47.263630 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 292/576] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:47.266080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb771b5-f950-49ec-9dca-75591ddfa6f4 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:47.372893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb771b5-f950-49ec-9dca-75591ddfa6f4 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:47.381823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc786494-c969-4290-821d-bf0970054003 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:47.413986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af49ec-4aa7-4503-99a2-d913b3ace03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:47.414652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af49ec-4aa7-4503-99a2-d913b3ace03a None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:47.414989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af49ec-4aa7-4503-99a2-d913b3ace03a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:47.415838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af49ec-4aa7-4503-99a2-d913b3ace03a None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/fc41482005be496f822a3118839674c9/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:47.418842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af49ec-4aa7-4503-99a2-d913b3ace03a None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=fc41482005be496f822a3118839674c9, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:47.425320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af49ec-4aa7-4503-99a2-d913b3ace03a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:47.441123 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 285/577] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:47 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/fc41482005be496f822a3118839674c9/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:36:47.488014 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:47.534152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc786494-c969-4290-821d-bf0970054003 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:47.573752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29427a6f-ef75-451c-98dc-45313a50697d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:47.574409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29427a6f-ef75-451c-98dc-45313a50697d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:47.574689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29427a6f-ef75-451c-98dc-45313a50697d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:47.574965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29427a6f-ef75-451c-98dc-45313a50697d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:47.577218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29427a6f-ef75-451c-98dc-45313a50697d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:47.578697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29427a6f-ef75-451c-98dc-45313a50697d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-29427a6f-ef75-451c-98dc-45313a50697d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:47.588706 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:47.589798 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:47.590707 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 293/578] 10.222.0.25 () {56 vars in 1129 bytes} [Mon Oct 24 08:36:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:47.598130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af49ec-4aa7-4503-99a2-d913b3ace03a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:47.616942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c4a8f-c65c-4281-8767-96b0fb5f0805 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:47.617277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c4a8f-c65c-4281-8767-96b0fb5f0805 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:47.617605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36c4a8f-c65c-4281-8767-96b0fb5f0805 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:47.625557 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 294/579] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:47.628424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d76559-e310-4451-862d-c0f083bd0060 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:47.628706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d76559-e310-4451-862d-c0f083bd0060 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:47.628983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d76559-e310-4451-862d-c0f083bd0060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:47.641863 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:47.664903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-92d76559-e310-4451-862d-c0f083bd0060 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:47.666410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-92d76559-e310-4451-862d-c0f083bd0060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:47.746715 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 295/580] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:47.771535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af49ec-4aa7-4503-99a2-d913b3ace03a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:47.809116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf99ae6-3b36-485f-a006-d513bf1e90e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:47.810120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf99ae6-3b36-485f-a006-d513bf1e90e3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:47.810613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf99ae6-3b36-485f-a006-d513bf1e90e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:47.811083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf99ae6-3b36-485f-a006-d513bf1e90e3 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:47.811905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf99ae6-3b36-485f-a006-d513bf1e90e3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:47.812403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf99ae6-3b36-485f-a006-d513bf1e90e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:47.814002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf99ae6-3b36-485f-a006-d513bf1e90e3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:47.819543 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 286/581] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Oct 24 08:36:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:47.825431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d76559-e310-4451-862d-c0f083bd0060 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:47.904948 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:47.969476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d76559-e310-4451-862d-c0f083bd0060 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:48.007427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e007b-728c-4db5-8634-effcc276df92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:48.007958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e007b-728c-4db5-8634-effcc276df92 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:48.008238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e007b-728c-4db5-8634-effcc276df92 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:48.008519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e007b-728c-4db5-8634-effcc276df92 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:48.009179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e007b-728c-4db5-8634-effcc276df92 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:48.009511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e007b-728c-4db5-8634-effcc276df92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:48.010893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e007b-728c-4db5-8634-effcc276df92 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:48.016427 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 296/582] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Oct 24 08:36:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:48.021906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf99ae6-3b36-485f-a006-d513bf1e90e3 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:48.106320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e007b-728c-4db5-8634-effcc276df92 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:48.154232 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:48.190033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf99ae6-3b36-485f-a006-d513bf1e90e3 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:48.256528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3966e0-8b01-4be6-abff-bee5af5796e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:48.257154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3966e0-8b01-4be6-abff-bee5af5796e5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:48.257513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3966e0-8b01-4be6-abff-bee5af5796e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:48.257728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3966e0-8b01-4be6-abff-bee5af5796e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:48.258446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3966e0-8b01-4be6-abff-bee5af5796e5 None admin] RBAC: Adding query filter params (interface=public, service_id=7efeb1c09ce8446592b187ece5c0b9fe, region_id=RegionOne) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:48.258751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3966e0-8b01-4be6-abff-bee5af5796e5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:48.260742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3966e0-8b01-4be6-abff-bee5af5796e5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:48.272998 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 287/583] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Oct 24 08:36:48 2022] GET /identity/v3/endpoints?service_id=7efeb1c09ce8446592b187ece5c0b9fe&interface=public®ion_id=RegionOne => generated 194 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:48.278867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3966e0-8b01-4be6-abff-bee5af5796e5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:48.294832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e007b-728c-4db5-8634-effcc276df92 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:48.320402 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:48.333321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180673e-22d2-486e-8ee0-f19efc7a3806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:48.333982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180673e-22d2-486e-8ee0-f19efc7a3806 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:48.334264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180673e-22d2-486e-8ee0-f19efc7a3806 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:48.334538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2180673e-22d2-486e-8ee0-f19efc7a3806 None admin] PATH_INFO: `/v3/services/network` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:48.335121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180673e-22d2-486e-8ee0-f19efc7a3806 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:48.336732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2180673e-22d2-486e-8ee0-f19efc7a3806 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-2180673e-22d2-486e-8ee0-f19efc7a3806 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:48.349546 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:48.350648 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:48.351547 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 297/584] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:48 2022] GET /identity/v3/services/network => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:48.356849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180673e-22d2-486e-8ee0-f19efc7a3806 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:48.483556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2180673e-22d2-486e-8ee0-f19efc7a3806 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:48.522004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d89e1-6056-49bf-99ec-3c911b400df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:48.522528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d89e1-6056-49bf-99ec-3c911b400df5 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:48.522802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d89e1-6056-49bf-99ec-3c911b400df5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:48.523072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d89e1-6056-49bf-99ec-3c911b400df5 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:48.523691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d89e1-6056-49bf-99ec-3c911b400df5 None admin] RBAC: Adding query filter params (name=network) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:48.523986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d89e1-6056-49bf-99ec-3c911b400df5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:48.525440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d89e1-6056-49bf-99ec-3c911b400df5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:48.530986 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 298/585] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:48 2022] GET /identity/v3/services?name=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:48.537886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d89e1-6056-49bf-99ec-3c911b400df5 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:48.550915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3966e0-8b01-4be6-abff-bee5af5796e5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:48.621668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64701cf7-a9e0-4ca0-97c0-e79e592e966c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:48.622293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64701cf7-a9e0-4ca0-97c0-e79e592e966c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:48.622575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64701cf7-a9e0-4ca0-97c0-e79e592e966c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:48.622848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64701cf7-a9e0-4ca0-97c0-e79e592e966c None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:48.623461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64701cf7-a9e0-4ca0-97c0-e79e592e966c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:48.624841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64701cf7-a9e0-4ca0-97c0-e79e592e966c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:48.630293 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:48.638151 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 288/586] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Oct 24 08:36:48 2022] GET /identity/v3/services => generated 772 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:48.723109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d89e1-6056-49bf-99ec-3c911b400df5 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:48.781199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f492a-23e9-4d67-9ae2-e3408f342276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:48.781796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f492a-23e9-4d67-9ae2-e3408f342276 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:48.782077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f492a-23e9-4d67-9ae2-e3408f342276 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:48.782347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1f492a-23e9-4d67-9ae2-e3408f342276 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:48.782996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f492a-23e9-4d67-9ae2-e3408f342276 None admin] RBAC: Adding query filter params (type=network) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:48.783307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f492a-23e9-4d67-9ae2-e3408f342276 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:48.784717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1f492a-23e9-4d67-9ae2-e3408f342276 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:48.795720 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 299/587] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:48 2022] GET /identity/v3/services?type=network => generated 350 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:48.801833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64701cf7-a9e0-4ca0-97c0-e79e592e966c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:48.814452 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:48.929535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64701cf7-a9e0-4ca0-97c0-e79e592e966c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:48.971537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f454c805-8cec-4e19-95a7-0f99c8e34f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:48.972556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454c805-8cec-4e19-95a7-0f99c8e34f11 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:48.973046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454c805-8cec-4e19-95a7-0f99c8e34f11 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:48.973619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f454c805-8cec-4e19-95a7-0f99c8e34f11 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:48.974577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454c805-8cec-4e19-95a7-0f99c8e34f11 None admin] RBAC: Adding query filter params (interface=public, service_id=1adc846c0ca044948304af84f856e06b, region_id=RegionOne) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:48.975109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454c805-8cec-4e19-95a7-0f99c8e34f11 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:48.976687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f454c805-8cec-4e19-95a7-0f99c8e34f11 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:48.983070 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 289/588] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Oct 24 08:36:48 2022] GET /identity/v3/endpoints?service_id=1adc846c0ca044948304af84f856e06b&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:48.988404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f492a-23e9-4d67-9ae2-e3408f342276 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:49.160886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1f492a-23e9-4d67-9ae2-e3408f342276 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:49.176614 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:49.214273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a3688-05cf-45cb-b576-4bda23fc1e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:49.214900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3688-05cf-45cb-b576-4bda23fc1e54 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:49.215183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3688-05cf-45cb-b576-4bda23fc1e54 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:49.215527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a3688-05cf-45cb-b576-4bda23fc1e54 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:49.216142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a3688-05cf-45cb-b576-4bda23fc1e54 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:49.217555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392a3688-05cf-45cb-b576-4bda23fc1e54 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:49.227041 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 300/589] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Oct 24 08:36:48 2022] GET /identity/v3/services => generated 772 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:49.530735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe93e8-6881-437f-96de-206152054d07 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:49.531434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe93e8-6881-437f-96de-206152054d07 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:49.531940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fe93e8-6881-437f-96de-206152054d07 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:49.533574 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 290/590] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:49.539720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f15b03-ce0a-4b3f-9fd8-9633f99fa5c4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:49.540759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f15b03-ce0a-4b3f-9fd8-9633f99fa5c4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:49.540838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f15b03-ce0a-4b3f-9fd8-9633f99fa5c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:49.560482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-22f15b03-ce0a-4b3f-9fd8-9633f99fa5c4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:49.562398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-22f15b03-ce0a-4b3f-9fd8-9633f99fa5c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:49.635872 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 301/591] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:49.651601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb31d-3ebc-4073-8630-c0d214f5cd1c None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:49.652244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb31d-3ebc-4073-8630-c0d214f5cd1c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:49.652718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3feb31d-3ebc-4073-8630-c0d214f5cd1c None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:49.654556 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 291/592] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:49.660305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f878b-6030-405d-9cbb-70c0ba85c56a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:49.660862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f878b-6030-405d-9cbb-70c0ba85c56a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:49.661401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1f878b-6030-405d-9cbb-70c0ba85c56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:49.681199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ad1f878b-6030-405d-9cbb-70c0ba85c56a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:49.682791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ad1f878b-6030-405d-9cbb-70c0ba85c56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:49.760946 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 302/593] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:49.998364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3feb31d-3ebc-4073-8630-c0d214f5cd1c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.081062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f878b-6030-405d-9cbb-70c0ba85c56a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.098662 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.142368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3feb31d-3ebc-4073-8630-c0d214f5cd1c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.156384 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.218019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6e1d82-f6e3-42f4-a9a5-264db98ba91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.219036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1d82-f6e3-42f4-a9a5-264db98ba91d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.219518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1d82-f6e3-42f4-a9a5-264db98ba91d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.220014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6e1d82-f6e3-42f4-a9a5-264db98ba91d None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.242561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6e1d82-f6e3-42f4-a9a5-264db98ba91d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:50.248950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1f878b-6030-405d-9cbb-70c0ba85c56a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-ce6e1d82-f6e3-42f4-a9a5-264db98ba91d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:50.250633 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:50.251584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:36:50.252437 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:50.255106 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 292/594] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:36:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:50.261212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3661ea-ccf7-4397-8efe-a029debfe5e9 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.261865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3661ea-ccf7-4397-8efe-a029debfe5e9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.262349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3661ea-ccf7-4397-8efe-a029debfe5e9 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.264210 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 293/595] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:50.265149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3661ea-ccf7-4397-8efe-a029debfe5e9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.287863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0489dc-de60-42e1-9c52-76b539d2975d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.288494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0489dc-de60-42e1-9c52-76b539d2975d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.288762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0489dc-de60-42e1-9c52-76b539d2975d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.289040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0489dc-de60-42e1-9c52-76b539d2975d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.290093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0489dc-de60-42e1-9c52-76b539d2975d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:50.292348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0489dc-de60-42e1-9c52-76b539d2975d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4d0489dc-de60-42e1-9c52-76b539d2975d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:50.303720 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:50.304718 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:50.305640 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:50.306997 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 303/596] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:50.308029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343969-bc92-45e4-a84d-c700f818df2d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.308313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343969-bc92-45e4-a84d-c700f818df2d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.308944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343969-bc92-45e4-a84d-c700f818df2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.331217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-86343969-bc92-45e4-a84d-c700f818df2d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:50.332405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-86343969-bc92-45e4-a84d-c700f818df2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:50.394127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3661ea-ccf7-4397-8efe-a029debfe5e9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.417606 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 304/597] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:50.419007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343969-bc92-45e4-a84d-c700f818df2d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.428434 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.443536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414974d-982c-490c-a322-68bcb8e9c20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.444666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414974d-982c-490c-a322-68bcb8e9c20f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.446496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414974d-982c-490c-a322-68bcb8e9c20f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.447035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6414974d-982c-490c-a322-68bcb8e9c20f None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.448040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414974d-982c-490c-a322-68bcb8e9c20f None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:50.448697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414974d-982c-490c-a322-68bcb8e9c20f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:50.452340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6414974d-982c-490c-a322-68bcb8e9c20f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:50.469559 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 294/598] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:50.473920 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.475858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414974d-982c-490c-a322-68bcb8e9c20f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.624013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343969-bc92-45e4-a84d-c700f818df2d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.677400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6414974d-982c-490c-a322-68bcb8e9c20f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.679004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede81e5-e7b8-4ffd-aae9-3b03fe910a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.679899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede81e5-e7b8-4ffd-aae9-3b03fe910a90 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.680382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede81e5-e7b8-4ffd-aae9-3b03fe910a90 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.681467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aede81e5-e7b8-4ffd-aae9-3b03fe910a90 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.682311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede81e5-e7b8-4ffd-aae9-3b03fe910a90 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:50.682814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede81e5-e7b8-4ffd-aae9-3b03fe910a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:50.684484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aede81e5-e7b8-4ffd-aae9-3b03fe910a90 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:50.690120 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 305/599] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:50.695984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede81e5-e7b8-4ffd-aae9-3b03fe910a90 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.749675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688226-a091-4dcf-8c4a-65bad1f67141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.750312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688226-a091-4dcf-8c4a-65bad1f67141 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.750588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688226-a091-4dcf-8c4a-65bad1f67141 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.750860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8688226-a091-4dcf-8c4a-65bad1f67141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.767214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688226-a091-4dcf-8c4a-65bad1f67141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:50.768665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8688226-a091-4dcf-8c4a-65bad1f67141 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c8688226-a091-4dcf-8c4a-65bad1f67141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:50.783670 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:50.784802 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:50.785728 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:50.785728 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:50.785728 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:50.785728 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 295/600] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:50.785967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688226-a091-4dcf-8c4a-65bad1f67141 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.827732 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.838017 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:50.841763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aede81e5-e7b8-4ffd-aae9-3b03fe910a90 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.885267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ced37-4d99-40b2-a21c-75849b39a6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.886262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ced37-4d99-40b2-a21c-75849b39a6df None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.887267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ced37-4d99-40b2-a21c-75849b39a6df None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.888176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5ced37-4d99-40b2-a21c-75849b39a6df None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.889091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ced37-4d99-40b2-a21c-75849b39a6df None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:50.889632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ced37-4d99-40b2-a21c-75849b39a6df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:50.892168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5ced37-4d99-40b2-a21c-75849b39a6df None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:50.903360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8688226-a091-4dcf-8c4a-65bad1f67141 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:50.903793 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 306/601] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:50.905339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ced37-4d99-40b2-a21c-75849b39a6df None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:50.947490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1ce8f-b42f-400b-b0fb-864d0d629cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:50.947917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1ce8f-b42f-400b-b0fb-864d0d629cc8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:50.948196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1ce8f-b42f-400b-b0fb-864d0d629cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:50.948499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1ce8f-b42f-400b-b0fb-864d0d629cc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:50.961193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1ce8f-b42f-400b-b0fb-864d0d629cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d9e1ce8f-b42f-400b-b0fb-864d0d629cc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:50.966932 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:50.967956 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:50.968803 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 296/602] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:50.974165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1ce8f-b42f-400b-b0fb-864d0d629cc8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:51.125111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1ce8f-b42f-400b-b0fb-864d0d629cc8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:51.142169 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:51.173273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdc861-cc7d-447d-a262-8d0bb0d2b499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:51.174545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdc861-cc7d-447d-a262-8d0bb0d2b499 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:51.175048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdc861-cc7d-447d-a262-8d0bb0d2b499 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:51.175943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fdc861-cc7d-447d-a262-8d0bb0d2b499 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:51.177120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdc861-cc7d-447d-a262-8d0bb0d2b499 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:51.177680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdc861-cc7d-447d-a262-8d0bb0d2b499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:51.178668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5ced37-4d99-40b2-a21c-75849b39a6df None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:51.179507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fdc861-cc7d-447d-a262-8d0bb0d2b499 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:51.191738 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 297/603] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:51.197724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdc861-cc7d-447d-a262-8d0bb0d2b499 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:51.238679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc980629-7281-47ce-aab5-5f768e3cb7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:51.239301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc980629-7281-47ce-aab5-5f768e3cb7de None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:51.239581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc980629-7281-47ce-aab5-5f768e3cb7de None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:51.240113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc980629-7281-47ce-aab5-5f768e3cb7de None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:51.240765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc980629-7281-47ce-aab5-5f768e3cb7de None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:51.241132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc980629-7281-47ce-aab5-5f768e3cb7de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:51.244647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc980629-7281-47ce-aab5-5f768e3cb7de None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:51.265334 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 307/604] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:51.267752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc980629-7281-47ce-aab5-5f768e3cb7de None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:51.291029 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:51.343077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fdc861-cc7d-447d-a262-8d0bb0d2b499 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:51.380903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc980629-7281-47ce-aab5-5f768e3cb7de None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:51.386270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa9d57-2756-4582-9c1f-d60ee37ef12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:51.387062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9d57-2756-4582-9c1f-d60ee37ef12b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:51.387356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9d57-2756-4582-9c1f-d60ee37ef12b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:51.387632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa9d57-2756-4582-9c1f-d60ee37ef12b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:51.399979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa9d57-2756-4582-9c1f-d60ee37ef12b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:51.401495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa9d57-2756-4582-9c1f-d60ee37ef12b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:51.416843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84d4ed-f2bc-4022-b31d-fa82fa52679d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:51.417504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d4ed-f2bc-4022-b31d-fa82fa52679d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0eaa9d57-2756-4582-9c1f-d60ee37ef12b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:51.417832 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:51.418736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:51.419631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:51.419631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:51.419631 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:51.419799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d4ed-f2bc-4022-b31d-fa82fa52679d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:51.419799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84d4ed-f2bc-4022-b31d-fa82fa52679d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:51.419937 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 298/605] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:51.421344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde2044-0517-4b9b-8653-9b938811a2de None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:51.421344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde2044-0517-4b9b-8653-9b938811a2de None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:51.421527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbde2044-0517-4b9b-8653-9b938811a2de None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:51.422855 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 299/606] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:51.426411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde2044-0517-4b9b-8653-9b938811a2de None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:51.431379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84d4ed-f2bc-4022-b31d-fa82fa52679d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:51.432847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84d4ed-f2bc-4022-b31d-fa82fa52679d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ea84d4ed-f2bc-4022-b31d-fa82fa52679d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:51.445105 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:51.447947 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 308/607] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Oct 24 08:36:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cd423-25f9-413c-8188-1550df03d0bd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:51.450218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cd423-25f9-413c-8188-1550df03d0bd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:51.451840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458cd423-25f9-413c-8188-1550df03d0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:51.456040 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:51.469119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-458cd423-25f9-413c-8188-1550df03d0bd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:51.470307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-458cd423-25f9-413c-8188-1550df03d0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:51.548228 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 309/608] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:51.549331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cd423-25f9-413c-8188-1550df03d0bd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:51.550999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbde2044-0517-4b9b-8653-9b938811a2de None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:51.557988 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:51.592782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480c296-8942-4d46-aa59-d104f82f777a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:51.595344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480c296-8942-4d46-aa59-d104f82f777a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:51.596640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480c296-8942-4d46-aa59-d104f82f777a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:51.601802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480c296-8942-4d46-aa59-d104f82f777a None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:51.603701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480c296-8942-4d46-aa59-d104f82f777a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:51.604269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480c296-8942-4d46-aa59-d104f82f777a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:51.613345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480c296-8942-4d46-aa59-d104f82f777a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:51.629887 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 300/609] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:51.641336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480c296-8942-4d46-aa59-d104f82f777a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:51.734448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458cd423-25f9-413c-8188-1550df03d0bd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:51.790568 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:51.799942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e302d-c2b7-4f5b-b359-61e568917250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:51.800552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e302d-c2b7-4f5b-b359-61e568917250 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:51.800825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e302d-c2b7-4f5b-b359-61e568917250 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:51.801091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01e302d-c2b7-4f5b-b359-61e568917250 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:51.804498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e302d-c2b7-4f5b-b359-61e568917250 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:51.804812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e302d-c2b7-4f5b-b359-61e568917250 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:51.806322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01e302d-c2b7-4f5b-b359-61e568917250 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:51.833904 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 310/610] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Oct 24 08:36:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:51.835677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480c296-8942-4d46-aa59-d104f82f777a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:51.839532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e302d-c2b7-4f5b-b359-61e568917250 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:51.897763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbddb6-4b00-4365-96db-9cc252c56163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:51.899206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbddb6-4b00-4365-96db-9cc252c56163 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:51.899605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbddb6-4b00-4365-96db-9cc252c56163 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:51.899814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbbddb6-4b00-4365-96db-9cc252c56163 None admin] PATH_INFO: `/v3/users/swift` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:51.911624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbddb6-4b00-4365-96db-9cc252c56163 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:51.914330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbbddb6-4b00-4365-96db-9cc252c56163 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:51.917624 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-6cbbddb6-4b00-4365-96db-9cc252c56163 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:51.934418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:51.935425 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Oct 24 08:36:51.936349 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:51.939444 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 301/611] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:36:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:51.941199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbddb6-4b00-4365-96db-9cc252c56163 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:51.967343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01e302d-c2b7-4f5b-b359-61e568917250 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:52.008123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368018d0-a59f-4101-b284-6567c4ebd1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:52.008654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368018d0-a59f-4101-b284-6567c4ebd1d0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.008933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368018d0-a59f-4101-b284-6567c4ebd1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.009244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368018d0-a59f-4101-b284-6567c4ebd1d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.072007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbbddb6-4b00-4365-96db-9cc252c56163 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:52.092379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368018d0-a59f-4101-b284-6567c4ebd1d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:52.094607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368018d0-a59f-4101-b284-6567c4ebd1d0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:52.109596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01520026-e77a-4bd1-b2f6-17c9d268f4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:52.110246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520026-e77a-4bd1-b2f6-17c9d268f4b7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.110526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520026-e77a-4bd1-b2f6-17c9d268f4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.110800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01520026-e77a-4bd1-b2f6-17c9d268f4b7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.111410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01520026-e77a-4bd1-b2f6-17c9d268f4b7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:52.112854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01520026-e77a-4bd1-b2f6-17c9d268f4b7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-01520026-e77a-4bd1-b2f6-17c9d268f4b7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:52.127010 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:52.129861 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:52.130712 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 302/612] 10.222.0.25 () {56 vars in 1129 bytes} [Mon Oct 24 08:36:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:52.131543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01520026-e77a-4bd1-b2f6-17c9d268f4b7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:52.135072 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:52.178982 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:52.228316 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 311/613] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 08:36:52.228316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0a61a-5f65-4c3f-a12c-63f5327f3790 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.228316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0a61a-5f65-4c3f-a12c-63f5327f3790 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.228316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed0a61a-5f65-4c3f-a12c-63f5327f3790 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.228316 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 312/614] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:52.228316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0a61a-5f65-4c3f-a12c-63f5327f3790 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:52.249433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01520026-e77a-4bd1-b2f6-17c9d268f4b7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:52.287411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493ec9-1455-46ee-a721-06d70b3f7b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:52.287927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493ec9-1455-46ee-a721-06d70b3f7b82 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.288207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493ec9-1455-46ee-a721-06d70b3f7b82 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.288478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11493ec9-1455-46ee-a721-06d70b3f7b82 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.289208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493ec9-1455-46ee-a721-06d70b3f7b82 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:52.289543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493ec9-1455-46ee-a721-06d70b3f7b82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:52.291541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11493ec9-1455-46ee-a721-06d70b3f7b82 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:52.312499 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 303/615] 10.222.0.25 () {56 vars in 1135 bytes} [Mon Oct 24 08:36:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:52.313432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493ec9-1455-46ee-a721-06d70b3f7b82 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:52.353272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed0a61a-5f65-4c3f-a12c-63f5327f3790 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:52.382771 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:52.397244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71342891-f10a-41f2-91b9-c2ec4cb04580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:52.397894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71342891-f10a-41f2-91b9-c2ec4cb04580 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.398176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71342891-f10a-41f2-91b9-c2ec4cb04580 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.398450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71342891-f10a-41f2-91b9-c2ec4cb04580 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.399083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71342891-f10a-41f2-91b9-c2ec4cb04580 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:52.399385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71342891-f10a-41f2-91b9-c2ec4cb04580 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:52.400812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71342891-f10a-41f2-91b9-c2ec4cb04580 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:52.410660 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 313/616] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Oct 24 08:36:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:52.410660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efdf6e-23b2-40cc-9ae4-999657544b3f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.410660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efdf6e-23b2-40cc-9ae4-999657544b3f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.410660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79efdf6e-23b2-40cc-9ae4-999657544b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.429457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-79efdf6e-23b2-40cc-9ae4-999657544b3f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:52.430910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-79efdf6e-23b2-40cc-9ae4-999657544b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:52.440323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11493ec9-1455-46ee-a721-06d70b3f7b82 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:52.460326 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:52.477506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a251c-a4f9-48e5-98d2-e03651fc2495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:52.478683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a251c-a4f9-48e5-98d2-e03651fc2495 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.478955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a251c-a4f9-48e5-98d2-e03651fc2495 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.479228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a251c-a4f9-48e5-98d2-e03651fc2495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.489763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a251c-a4f9-48e5-98d2-e03651fc2495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:52.491481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a251c-a4f9-48e5-98d2-e03651fc2495 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-603a251c-a4f9-48e5-98d2-e03651fc2495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:52.507667 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:52.508915 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:52.510615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:52.510615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:52.510615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:52.510615 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 304/617] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:52.510615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a251c-a4f9-48e5-98d2-e03651fc2495 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:52.521372 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 314/618] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:52.521372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efdf6e-23b2-40cc-9ae4-999657544b3f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:52.656951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a251c-a4f9-48e5-98d2-e03651fc2495 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:52.666086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79efdf6e-23b2-40cc-9ae4-999657544b3f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:52.674045 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:52.700318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67de5b-fc63-4f08-958f-f90e4b5cb8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:52.701179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67de5b-fc63-4f08-958f-f90e4b5cb8ab None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.701876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67de5b-fc63-4f08-958f-f90e4b5cb8ab None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.702328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb67de5b-fc63-4f08-958f-f90e4b5cb8ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.717972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c395c0-923d-4da3-a330-03cf6202ce0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:52.719079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c395c0-923d-4da3-a330-03cf6202ce0e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.719653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c395c0-923d-4da3-a330-03cf6202ce0e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.720247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c395c0-923d-4da3-a330-03cf6202ce0e None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.721362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c395c0-923d-4da3-a330-03cf6202ce0e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:52.721984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c395c0-923d-4da3-a330-03cf6202ce0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:52.724709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c395c0-923d-4da3-a330-03cf6202ce0e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:52.734817 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 315/619] 10.222.0.25 () {56 vars in 1124 bytes} [Mon Oct 24 08:36:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:52.736502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c395c0-923d-4da3-a330-03cf6202ce0e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:52.778414 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:52.785816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67de5b-fc63-4f08-958f-f90e4b5cb8ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:52.788248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb67de5b-fc63-4f08-958f-f90e4b5cb8ab None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:52.879778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c395c0-923d-4da3-a330-03cf6202ce0e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:52.908608 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 305/620] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:36:52 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:36:52.909971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67de5b-fc63-4f08-958f-f90e4b5cb8ab None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:52.922714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf58a6-bbad-4ceb-98a1-5b12bfc1f0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:52.923630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf58a6-bbad-4ceb-98a1-5b12bfc1f0ea None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:52.923913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf58a6-bbad-4ceb-98a1-5b12bfc1f0ea None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:52.924186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccf58a6-bbad-4ceb-98a1-5b12bfc1f0ea None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:52.924841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf58a6-bbad-4ceb-98a1-5b12bfc1f0ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:52.925147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf58a6-bbad-4ceb-98a1-5b12bfc1f0ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:52.926580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccf58a6-bbad-4ceb-98a1-5b12bfc1f0ea None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:52.929798 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:52.946160 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 316/621] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:52.946160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf58a6-bbad-4ceb-98a1-5b12bfc1f0ea None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.028930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb67de5b-fc63-4f08-958f-f90e4b5cb8ab None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.043265 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:53.066673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccf58a6-bbad-4ceb-98a1-5b12bfc1f0ea None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.066986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917ac58-6033-4793-bc54-2c09b8c82634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.067590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917ac58-6033-4793-bc54-2c09b8c82634 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.067865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917ac58-6033-4793-bc54-2c09b8c82634 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.068135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917ac58-6033-4793-bc54-2c09b8c82634 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.068794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917ac58-6033-4793-bc54-2c09b8c82634 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.070215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917ac58-6033-4793-bc54-2c09b8c82634 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.094928 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 306/622] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:36:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:53.095763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917ac58-6033-4793-bc54-2c09b8c82634 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.124627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4aacf-50f1-4184-9666-8d660ce8ac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.125647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4aacf-50f1-4184-9666-8d660ce8ac93 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.126098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4aacf-50f1-4184-9666-8d660ce8ac93 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.126606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe4aacf-50f1-4184-9666-8d660ce8ac93 None admin] PATH_INFO: `/v3/services/network` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.127463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4aacf-50f1-4184-9666-8d660ce8ac93 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.129071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe4aacf-50f1-4184-9666-8d660ce8ac93 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-efe4aacf-50f1-4184-9666-8d660ce8ac93 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:53.140073 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:53.141403 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 24 08:36:53.142494 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:53.144992 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 317/623] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:52 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:53.146167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4aacf-50f1-4184-9666-8d660ce8ac93 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.211670 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:53.238850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917ac58-6033-4793-bc54-2c09b8c82634 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.286554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e429c7-953a-437d-a946-9f70d8ab90fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.287230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e429c7-953a-437d-a946-9f70d8ab90fb None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.287512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e429c7-953a-437d-a946-9f70d8ab90fb None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.287787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e429c7-953a-437d-a946-9f70d8ab90fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.291061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe4aacf-50f1-4184-9666-8d660ce8ac93 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.300258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e429c7-953a-437d-a946-9f70d8ab90fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.301809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e429c7-953a-437d-a946-9f70d8ab90fb None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e1e429c7-953a-437d-a946-9f70d8ab90fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:53.320874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:53.322530 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:53.324317 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:53.324317 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:53.324317 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:53.324317 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 307/624] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:53.324317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e429c7-953a-437d-a946-9f70d8ab90fb None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.335671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eddd6c-ff10-4b27-8c36-efabbdce1c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.336714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eddd6c-ff10-4b27-8c36-efabbdce1c84 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.337918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eddd6c-ff10-4b27-8c36-efabbdce1c84 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.338438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47eddd6c-ff10-4b27-8c36-efabbdce1c84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.346535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eddd6c-ff10-4b27-8c36-efabbdce1c84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.348426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47eddd6c-ff10-4b27-8c36-efabbdce1c84 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-47eddd6c-ff10-4b27-8c36-efabbdce1c84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:53.361810 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:53.362821 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:53.363762 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:53.363762 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:53.363762 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:53.363762 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:53.363762 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:53.363762 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:53.363762 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:53.363762 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:53.363762 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 318/625] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:53.364271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eddd6c-ff10-4b27-8c36-efabbdce1c84 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.367484 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:53.459897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e429c7-953a-437d-a946-9f70d8ab90fb None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.484963 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:53.486975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47eddd6c-ff10-4b27-8c36-efabbdce1c84 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.498531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d69298-26df-4a87-8fdc-3dc04945cd6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.499283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d69298-26df-4a87-8fdc-3dc04945cd6a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.499662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d69298-26df-4a87-8fdc-3dc04945cd6a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.500154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d69298-26df-4a87-8fdc-3dc04945cd6a None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.500745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d69298-26df-4a87-8fdc-3dc04945cd6a None admin] RBAC: Adding query filter params (name=network) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:53.501148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d69298-26df-4a87-8fdc-3dc04945cd6a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.502578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d69298-26df-4a87-8fdc-3dc04945cd6a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.509278 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 308/626] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:53.510125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d69298-26df-4a87-8fdc-3dc04945cd6a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.530611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858bf0aa-36e5-493a-b9cd-baec55b3cf40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.531215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bf0aa-36e5-493a-b9cd-baec55b3cf40 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.531491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bf0aa-36e5-493a-b9cd-baec55b3cf40 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.531757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858bf0aa-36e5-493a-b9cd-baec55b3cf40 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.532433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bf0aa-36e5-493a-b9cd-baec55b3cf40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:53.532736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bf0aa-36e5-493a-b9cd-baec55b3cf40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.534171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858bf0aa-36e5-493a-b9cd-baec55b3cf40 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.547668 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 319/627] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:53.548988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007003f-aad0-4d96-b5a8-e4efc172c0e3 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.549271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007003f-aad0-4d96-b5a8-e4efc172c0e3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.549569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007003f-aad0-4d96-b5a8-e4efc172c0e3 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.550916 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 320/628] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:53.551503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007003f-aad0-4d96-b5a8-e4efc172c0e3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.619878 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:53.626037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d69298-26df-4a87-8fdc-3dc04945cd6a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.663516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15cd73-be7d-4ce7-aa16-a709290da842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.664124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15cd73-be7d-4ce7-aa16-a709290da842 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.664407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15cd73-be7d-4ce7-aa16-a709290da842 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.664702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f15cd73-be7d-4ce7-aa16-a709290da842 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.666016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15cd73-be7d-4ce7-aa16-a709290da842 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:53.666356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15cd73-be7d-4ce7-aa16-a709290da842 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.667476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007003f-aad0-4d96-b5a8-e4efc172c0e3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.667798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f15cd73-be7d-4ce7-aa16-a709290da842 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.687738 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 309/629] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:53.688785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15cd73-be7d-4ce7-aa16-a709290da842 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.711352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1efc21-c8c8-4a41-998e-e3c46281ae0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.711968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efc21-c8c8-4a41-998e-e3c46281ae0d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.712800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efc21-c8c8-4a41-998e-e3c46281ae0d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.713056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1efc21-c8c8-4a41-998e-e3c46281ae0d None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.713720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1efc21-c8c8-4a41-998e-e3c46281ae0d None admin] RBAC: Adding query filter params (type=network) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:53.714022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1efc21-c8c8-4a41-998e-e3c46281ae0d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.715400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1efc21-c8c8-4a41-998e-e3c46281ae0d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.721041 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 321/630] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:53.726824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138049c-5eac-4292-9224-3384d402d418 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.727216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138049c-5eac-4292-9224-3384d402d418 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.727392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9138049c-5eac-4292-9224-3384d402d418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.746097 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:53.746480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9138049c-5eac-4292-9224-3384d402d418 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:53.747691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9138049c-5eac-4292-9224-3384d402d418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:53.803597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f15cd73-be7d-4ce7-aa16-a709290da842 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.832410 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 322/631] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:53.832410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138049c-5eac-4292-9224-3384d402d418 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.839525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd75207-9383-4974-b6e2-07cec7df9d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.840152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd75207-9383-4974-b6e2-07cec7df9d7b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.840432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd75207-9383-4974-b6e2-07cec7df9d7b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.840698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd75207-9383-4974-b6e2-07cec7df9d7b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.848024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd75207-9383-4974-b6e2-07cec7df9d7b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.849654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd75207-9383-4974-b6e2-07cec7df9d7b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0cd75207-9383-4974-b6e2-07cec7df9d7b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:53.862182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:53.863170 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:53.864064 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:53.864064 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:53.864064 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:53.864064 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:53.864064 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:53.864064 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:53.864064 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:53.864064 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:53.869272 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 310/632] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:53.870177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd75207-9383-4974-b6e2-07cec7df9d7b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:53.899629 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:53.950850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9138049c-5eac-4292-9224-3384d402d418 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.987458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79ee2-dee2-4257-9c8b-ee9a76822ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:53.988274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd75207-9383-4974-b6e2-07cec7df9d7b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:53.988571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79ee2-dee2-4257-9c8b-ee9a76822ee4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:53.989063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79ee2-dee2-4257-9c8b-ee9a76822ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:53.989608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e79ee2-dee2-4257-9c8b-ee9a76822ee4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:53.990813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e79ee2-dee2-4257-9c8b-ee9a76822ee4 None admin] RBAC: Adding query filter params (role.id=9f1d8ee2ec724d0cbb41c537a7d38406, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=0e9492df0cf34fd0b1e6a0ac2f77cd37) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:53.991299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e79ee2-dee2-4257-9c8b-ee9a76822ee4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:53.992894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e79ee2-dee2-4257-9c8b-ee9a76822ee4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:53.996656 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:54.000578 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 323/633] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:53 2022] GET /identity/v3/role_assignments?user.id=0e9492df0cf34fd0b1e6a0ac2f77cd37&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=9f1d8ee2ec724d0cbb41c537a7d38406 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:54.001673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79ee2-dee2-4257-9c8b-ee9a76822ee4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:54.029601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0695c6-12d0-4ad1-ba35-d7ea67746bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:54.030622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0695c6-12d0-4ad1-ba35-d7ea67746bed None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:54.031143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0695c6-12d0-4ad1-ba35-d7ea67746bed None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:54.031627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0695c6-12d0-4ad1-ba35-d7ea67746bed None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:54.032548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0695c6-12d0-4ad1-ba35-d7ea67746bed None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:54.034282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0695c6-12d0-4ad1-ba35-d7ea67746bed None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:54.059190 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 311/634] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:36:53 2022] POST /identity/v3/endpoints => generated 337 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:54.123036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e79ee2-dee2-4257-9c8b-ee9a76822ee4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:54.152572 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:54.169758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8450c7b-f03d-4c9b-9404-84fa5c14e706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:54.170385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8450c7b-f03d-4c9b-9404-84fa5c14e706 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:54.170710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8450c7b-f03d-4c9b-9404-84fa5c14e706 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:54.170982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8450c7b-f03d-4c9b-9404-84fa5c14e706 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:54.171699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8450c7b-f03d-4c9b-9404-84fa5c14e706 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:54.172002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8450c7b-f03d-4c9b-9404-84fa5c14e706 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:54.173543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8450c7b-f03d-4c9b-9404-84fa5c14e706 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:54.188987 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 324/635] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:54.195287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0695c6-12d0-4ad1-ba35-d7ea67746bed None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:54.257065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8450c7b-f03d-4c9b-9404-84fa5c14e706 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:54.333362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0695c6-12d0-4ad1-ba35-d7ea67746bed None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:54.378162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329083d2-ee26-4086-884a-401c4bdd5a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:54.378779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329083d2-ee26-4086-884a-401c4bdd5a8a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:54.379060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329083d2-ee26-4086-884a-401c4bdd5a8a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:54.379337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329083d2-ee26-4086-884a-401c4bdd5a8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:54.380069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329083d2-ee26-4086-884a-401c4bdd5a8a None admin] RBAC: Adding query filter params (role.id=d266f03406d94df8bb9cad19b577978f, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=fc41482005be496f822a3118839674c9) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:54.380382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329083d2-ee26-4086-884a-401c4bdd5a8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:54.382695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329083d2-ee26-4086-884a-401c4bdd5a8a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:54.391204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 312/636] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:36:54 2022] GET /identity/v3/role_assignments?user.id=fc41482005be496f822a3118839674c9&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=d266f03406d94df8bb9cad19b577978f => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:54.397098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8450c7b-f03d-4c9b-9404-84fa5c14e706 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:54.439650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6276f703-a93c-4f3c-abf4-ad1fb338a757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:54.440279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276f703-a93c-4f3c-abf4-ad1fb338a757 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:54.440558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276f703-a93c-4f3c-abf4-ad1fb338a757 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:54.440832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6276f703-a93c-4f3c-abf4-ad1fb338a757 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:54.441556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276f703-a93c-4f3c-abf4-ad1fb338a757 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:54.443133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6276f703-a93c-4f3c-abf4-ad1fb338a757 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:54.465018 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 325/637] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:54 2022] POST /identity/v3/services => generated 269 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:36:55.463673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f1fb0-69b0-47c6-a495-9c7097864f4e None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:55.464181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f1fb0-69b0-47c6-a495-9c7097864f4e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:55.464181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26f1fb0-69b0-47c6-a495-9c7097864f4e None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:55.465804 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 313/638] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:55.471218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b99e-3e10-4975-9c49-9e566cf209bd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:55.471789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b99e-3e10-4975-9c49-9e566cf209bd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:55.471789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d85b99e-3e10-4975-9c49-9e566cf209bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:55.491024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7d85b99e-3e10-4975-9c49-9e566cf209bd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:55.492281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7d85b99e-3e10-4975-9c49-9e566cf209bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:55.524043 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:55.572250 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 326/639] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:55 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:55.840827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f1fb0-69b0-47c6-a495-9c7097864f4e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:55.870253 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:55.953101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26f1fb0-69b0-47c6-a495-9c7097864f4e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:55.988664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bf15e-8fb2-402b-8df1-f3e0ec41c08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:55.989315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bf15e-8fb2-402b-8df1-f3e0ec41c08c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:55.989606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bf15e-8fb2-402b-8df1-f3e0ec41c08c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:55.989886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bf15e-8fb2-402b-8df1-f3e0ec41c08c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:55.990734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bf15e-8fb2-402b-8df1-f3e0ec41c08c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:55.992100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bf15e-8fb2-402b-8df1-f3e0ec41c08c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-b37bf15e-8fb2-402b-8df1-f3e0ec41c08c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:56.001818 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:56.002857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:56.003750 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 314/640] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:56.009227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b99e-3e10-4975-9c49-9e566cf209bd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:56.120605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d85b99e-3e10-4975-9c49-9e566cf209bd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:56.157705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891ab977-6c94-4841-80b7-0c8f21eb7417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:56.158319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab977-6c94-4841-80b7-0c8f21eb7417 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.158660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab977-6c94-4841-80b7-0c8f21eb7417 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.158940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891ab977-6c94-4841-80b7-0c8f21eb7417 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.159564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ab977-6c94-4841-80b7-0c8f21eb7417 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:56.159868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ab977-6c94-4841-80b7-0c8f21eb7417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:56.161315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891ab977-6c94-4841-80b7-0c8f21eb7417 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:56.167186 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 327/641] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:56.172423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bf15e-8fb2-402b-8df1-f3e0ec41c08c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:56.284753 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:56.295720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bf15e-8fb2-402b-8df1-f3e0ec41c08c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:56.335008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f864826-fcd4-4133-b182-49fe341bd780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:56.335680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f864826-fcd4-4133-b182-49fe341bd780 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.336064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f864826-fcd4-4133-b182-49fe341bd780 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.336420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f864826-fcd4-4133-b182-49fe341bd780 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.337094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f864826-fcd4-4133-b182-49fe341bd780 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:56.337466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f864826-fcd4-4133-b182-49fe341bd780 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:56.338898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f864826-fcd4-4133-b182-49fe341bd780 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:56.346741 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 315/642] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:36:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:56.494498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ad6ed-ceef-4657-a887-c7b2f903aa45 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.495007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ad6ed-ceef-4657-a887-c7b2f903aa45 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.495007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ad6ed-ceef-4657-a887-c7b2f903aa45 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.496895 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 328/643] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:56.502947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1ee25-3099-4b0d-a0dc-c3a27d254ceb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.503572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1ee25-3099-4b0d-a0dc-c3a27d254ceb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.503572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c1ee25-3099-4b0d-a0dc-c3a27d254ceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.523590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-33c1ee25-3099-4b0d-a0dc-c3a27d254ceb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:56.525383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-33c1ee25-3099-4b0d-a0dc-c3a27d254ceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:56.613438 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 316/644] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:56.691038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376d650-75a2-45b3-bb4c-860e8d43fc3f None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.691379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376d650-75a2-45b3-bb4c-860e8d43fc3f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.691594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f376d650-75a2-45b3-bb4c-860e8d43fc3f None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.693162 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 329/645] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:56.699161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466f677-cc8b-45b9-9d5b-d2270d3584c1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.699476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466f677-cc8b-45b9-9d5b-d2270d3584c1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.699728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d466f677-cc8b-45b9-9d5b-d2270d3584c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.719892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d466f677-cc8b-45b9-9d5b-d2270d3584c1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:56.721082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d466f677-cc8b-45b9-9d5b-d2270d3584c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:56.772208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0d43-797c-40ca-9007-328266ccc5fa None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.772527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0d43-797c-40ca-9007-328266ccc5fa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.772683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe0d43-797c-40ca-9007-328266ccc5fa None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.774267 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 330/646] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:56.780360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea5b0a-6634-4170-83fe-854dc96618ba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:56.780647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea5b0a-6634-4170-83fe-854dc96618ba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:56.780925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ea5b0a-6634-4170-83fe-854dc96618ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:56.801878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-54ea5b0a-6634-4170-83fe-854dc96618ba None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:56.803072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-54ea5b0a-6634-4170-83fe-854dc96618ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:56.805461 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 317/647] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:36:56.829673 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:56.880433 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 331/648] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:56 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:56.918260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466f677-cc8b-45b9-9d5b-d2270d3584c1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:56.935197 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:57.035437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d466f677-cc8b-45b9-9d5b-d2270d3584c1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.079355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6aed9-5b6a-4a18-9f4b-3db568935efe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.080329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6aed9-5b6a-4a18-9f4b-3db568935efe None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.080810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6aed9-5b6a-4a18-9f4b-3db568935efe None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.081127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c6aed9-5b6a-4a18-9f4b-3db568935efe None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.095629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea5b0a-6634-4170-83fe-854dc96618ba None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.097965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c6aed9-5b6a-4a18-9f4b-3db568935efe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-65c6aed9-5b6a-4a18-9f4b-3db568935efe None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:36:57.106552 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:57.107580 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:36:57.108428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:57.109181 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 318/649] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Oct 24 08:36:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:57.115794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6aed9-5b6a-4a18-9f4b-3db568935efe None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.226458 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:57.236978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ea5b0a-6634-4170-83fe-854dc96618ba None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.267437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c6aed9-5b6a-4a18-9f4b-3db568935efe None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.291048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8bc6e-52e0-4fc1-8f9b-b6e509421a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.291606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8bc6e-52e0-4fc1-8f9b-b6e509421a96 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.291892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8bc6e-52e0-4fc1-8f9b-b6e509421a96 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.292163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee8bc6e-52e0-4fc1-8f9b-b6e509421a96 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.292752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8bc6e-52e0-4fc1-8f9b-b6e509421a96 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:57.294162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee8bc6e-52e0-4fc1-8f9b-b6e509421a96 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9ee8bc6e-52e0-4fc1-8f9b-b6e509421a96 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:57.303916 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:57.305165 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:57.306622 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 332/650] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:57.308060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8bc6e-52e0-4fc1-8f9b-b6e509421a96 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.313647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4e436-cacf-4b2b-8de6-2b00c4643c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.314271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e436-cacf-4b2b-8de6-2b00c4643c5f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.314617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e436-cacf-4b2b-8de6-2b00c4643c5f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.314893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4e436-cacf-4b2b-8de6-2b00c4643c5f None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.315570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4e436-cacf-4b2b-8de6-2b00c4643c5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:57.315876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4e436-cacf-4b2b-8de6-2b00c4643c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:57.317256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc4e436-cacf-4b2b-8de6-2b00c4643c5f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:57.329887 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 319/651] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:57.329887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4e436-cacf-4b2b-8de6-2b00c4643c5f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.342499 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:57.445781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc4e436-cacf-4b2b-8de6-2b00c4643c5f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.453964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee8bc6e-52e0-4fc1-8f9b-b6e509421a96 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.491135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045dec5-9f0c-4cc8-b253-ca5aa4eedd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.491755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045dec5-9f0c-4cc8-b253-ca5aa4eedd14 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.492097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045dec5-9f0c-4cc8-b253-ca5aa4eedd14 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.492374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045dec5-9f0c-4cc8-b253-ca5aa4eedd14 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.493009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045dec5-9f0c-4cc8-b253-ca5aa4eedd14 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:57.493891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045dec5-9f0c-4cc8-b253-ca5aa4eedd14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:57.495311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045dec5-9f0c-4cc8-b253-ca5aa4eedd14 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:57.496207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43a7f-ecd9-4894-a191-0341584c3843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.496921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43a7f-ecd9-4894-a191-0341584c3843 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.497211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43a7f-ecd9-4894-a191-0341584c3843 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.497593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b43a7f-ecd9-4894-a191-0341584c3843 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.498167 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:57.498276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b43a7f-ecd9-4894-a191-0341584c3843 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:57.499634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b43a7f-ecd9-4894-a191-0341584c3843 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:57.505645 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 320/652] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:57.508052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045dec5-9f0c-4cc8-b253-ca5aa4eedd14 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-f7b43a7f-ecd9-4894-a191-0341584c3843 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:57.514204 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:57.515193 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:36:57.516094 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 333/653] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:57.516888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43a7f-ecd9-4894-a191-0341584c3843 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.620444 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:57.633365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045dec5-9f0c-4cc8-b253-ca5aa4eedd14 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.638733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b43a7f-ecd9-4894-a191-0341584c3843 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.676662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20539641-835f-41ce-9ee4-d6e1a8ad088d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.679069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20539641-835f-41ce-9ee4-d6e1a8ad088d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.679349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20539641-835f-41ce-9ee4-d6e1a8ad088d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.679623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20539641-835f-41ce-9ee4-d6e1a8ad088d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.684567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdca4f-681f-4369-a5e7-47aaf673ccf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.684567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdca4f-681f-4369-a5e7-47aaf673ccf2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.684567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdca4f-681f-4369-a5e7-47aaf673ccf2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.684567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fdca4f-681f-4369-a5e7-47aaf673ccf2 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.684984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdca4f-681f-4369-a5e7-47aaf673ccf2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:57.684984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdca4f-681f-4369-a5e7-47aaf673ccf2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:57.684984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fdca4f-681f-4369-a5e7-47aaf673ccf2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:57.696060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20539641-835f-41ce-9ee4-d6e1a8ad088d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:57.697775 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 334/654] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:57.698154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20539641-835f-41ce-9ee4-d6e1a8ad088d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:57.699544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdca4f-681f-4369-a5e7-47aaf673ccf2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-20539641-835f-41ce-9ee4-d6e1a8ad088d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:57.716564 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:57.717714 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:57.718641 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:57.718641 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:57.718641 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:57.726317 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 321/655] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:57.726317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20539641-835f-41ce-9ee4-d6e1a8ad088d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.803354 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:57.866121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20539641-835f-41ce-9ee4-d6e1a8ad088d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.881976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fdca4f-681f-4369-a5e7-47aaf673ccf2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:57.906576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bd2b5-00ef-4e16-8d1b-5dd1b33690aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.907501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bd2b5-00ef-4e16-8d1b-5dd1b33690aa None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.907618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bd2b5-00ef-4e16-8d1b-5dd1b33690aa None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.907804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bd2b5-00ef-4e16-8d1b-5dd1b33690aa None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.908448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bd2b5-00ef-4e16-8d1b-5dd1b33690aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:57.908749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bd2b5-00ef-4e16-8d1b-5dd1b33690aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:57.910224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bd2b5-00ef-4e16-8d1b-5dd1b33690aa None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:57.930985 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 322/656] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:57.932787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bd2b5-00ef-4e16-8d1b-5dd1b33690aa None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.935430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae96eef-c53a-4e1a-9fb0-57f41a47b187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:57.936274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae96eef-c53a-4e1a-9fb0-57f41a47b187 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:57.936795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae96eef-c53a-4e1a-9fb0-57f41a47b187 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:57.936995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae96eef-c53a-4e1a-9fb0-57f41a47b187 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:57.937666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae96eef-c53a-4e1a-9fb0-57f41a47b187 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:57.937976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae96eef-c53a-4e1a-9fb0-57f41a47b187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:57.939371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae96eef-c53a-4e1a-9fb0-57f41a47b187 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:57.944887 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 335/657] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:57.951363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae96eef-c53a-4e1a-9fb0-57f41a47b187 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:57.970235 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:58.058457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bd2b5-00ef-4e16-8d1b-5dd1b33690aa None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:58.078726 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:58.101166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae96eef-c53a-4e1a-9fb0-57f41a47b187 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:58.112419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268768f9-e0a4-4a92-adb4-2b1f0e529594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:58.113479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268768f9-e0a4-4a92-adb4-2b1f0e529594 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.113976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268768f9-e0a4-4a92-adb4-2b1f0e529594 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.114493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268768f9-e0a4-4a92-adb4-2b1f0e529594 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.123714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268768f9-e0a4-4a92-adb4-2b1f0e529594 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:58.125507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268768f9-e0a4-4a92-adb4-2b1f0e529594 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:58.141208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f9c61-f0d8-49ef-a734-e3a5fa8c7606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:58.141766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f9c61-f0d8-49ef-a734-e3a5fa8c7606 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.142041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f9c61-f0d8-49ef-a734-e3a5fa8c7606 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.142413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5f9c61-f0d8-49ef-a734-e3a5fa8c7606 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.143049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f9c61-f0d8-49ef-a734-e3a5fa8c7606 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:58.143350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f9c61-f0d8-49ef-a734-e3a5fa8c7606 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-268768f9-e0a4-4a92-adb4-2b1f0e529594 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:36:58.144443 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:58.145387 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:36:58.146350 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:58.146877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5f9c61-f0d8-49ef-a734-e3a5fa8c7606 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:58.153389 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 323/658] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:58.156074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268768f9-e0a4-4a92-adb4-2b1f0e529594 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:58.159275 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 336/659] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:36:57 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:58.166861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f9c61-f0d8-49ef-a734-e3a5fa8c7606 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:58.268047 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:58.277659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268768f9-e0a4-4a92-adb4-2b1f0e529594 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:58.300787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5f9c61-f0d8-49ef-a734-e3a5fa8c7606 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:58.315110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca51558-63dd-4504-8702-c20e41369eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:58.315783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca51558-63dd-4504-8702-c20e41369eb8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.316007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca51558-63dd-4504-8702-c20e41369eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.316291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca51558-63dd-4504-8702-c20e41369eb8 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.317020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca51558-63dd-4504-8702-c20e41369eb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:58.317354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca51558-63dd-4504-8702-c20e41369eb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:58.318854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca51558-63dd-4504-8702-c20e41369eb8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:58.338416 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 324/660] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Oct 24 08:36:58 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:58.346620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca51558-63dd-4504-8702-c20e41369eb8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:58.346811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1c758-fc1c-4c08-b6b9-9c5c7d80eeee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:58.348695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1c758-fc1c-4c08-b6b9-9c5c7d80eeee None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.348695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1c758-fc1c-4c08-b6b9-9c5c7d80eeee None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.348695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a1c758-fc1c-4c08-b6b9-9c5c7d80eeee None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.348695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1c758-fc1c-4c08-b6b9-9c5c7d80eeee None admin] RBAC: Adding query filter params (interface=public, service_id=bc2ffae63dad4646bdcbf082ad3b17c6, region_id=RegionOne) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:58.349066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1c758-fc1c-4c08-b6b9-9c5c7d80eeee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:58.350684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a1c758-fc1c-4c08-b6b9-9c5c7d80eeee None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:58.365786 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 337/661] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Oct 24 08:36:58 2022] GET /identity/v3/endpoints?service_id=bc2ffae63dad4646bdcbf082ad3b17c6&interface=public®ion_id=RegionOne => generated 194 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:58.367255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1c758-fc1c-4c08-b6b9-9c5c7d80eeee None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:58.378670 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:58.456626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca51558-63dd-4504-8702-c20e41369eb8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:58.498841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b47757-0822-460a-93e3-4271eeb4320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:58.499912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47757-0822-460a-93e3-4271eeb4320a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.500477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47757-0822-460a-93e3-4271eeb4320a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.500974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b47757-0822-460a-93e3-4271eeb4320a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.501182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a1c758-fc1c-4c08-b6b9-9c5c7d80eeee None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:58.513791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b47757-0822-460a-93e3-4271eeb4320a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:58.516003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b47757-0822-460a-93e3-4271eeb4320a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-87b47757-0822-460a-93e3-4271eeb4320a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:36:58.534377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:58.535396 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:36:58.536319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:36:58.536319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:36:58.536319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:58.538696 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 325/662] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:36:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:36:58.545012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b47757-0822-460a-93e3-4271eeb4320a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:58.550732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b9761b-5036-4283-a3b4-95198857244b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:58.552407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9761b-5036-4283-a3b4-95198857244b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.553123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9761b-5036-4283-a3b4-95198857244b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.553746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b9761b-5036-4283-a3b4-95198857244b None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.554681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9761b-5036-4283-a3b4-95198857244b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:58.557281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b9761b-5036-4283-a3b4-95198857244b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:58.566752 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 338/663] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Oct 24 08:36:58 2022] GET /identity/v3/services => generated 1029 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:36:58.657799 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:58.662283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987901a-acce-4a93-ae90-b2a3b7c016a5 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.663032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987901a-acce-4a93-ae90-b2a3b7c016a5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.663395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987901a-acce-4a93-ae90-b2a3b7c016a5 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.665783 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 339/664] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:36:58.671925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf68e-2b28-4814-8066-5ff6a0960d7e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.672261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf68e-2b28-4814-8066-5ff6a0960d7e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.672481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9cf68e-2b28-4814-8066-5ff6a0960d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.680293 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:58.686526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b47757-0822-460a-93e3-4271eeb4320a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:58.697184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3e9cf68e-2b28-4814-8066-5ff6a0960d7e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:36:58.698932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3e9cf68e-2b28-4814-8066-5ff6a0960d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:36:58.737889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7438b-6d1b-4c33-83b1-540888a115a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:58.738968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7438b-6d1b-4c33-83b1-540888a115a7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.739485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7438b-6d1b-4c33-83b1-540888a115a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.739973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df7438b-6d1b-4c33-83b1-540888a115a7 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.741034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7438b-6d1b-4c33-83b1-540888a115a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:58.741510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7438b-6d1b-4c33-83b1-540888a115a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:58.743186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df7438b-6d1b-4c33-83b1-540888a115a7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:58.758707 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 326/665] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:36:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:36:58.764201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7438b-6d1b-4c33-83b1-540888a115a7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:58.791961 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 340/666] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:36:58 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:36:58.881508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df7438b-6d1b-4c33-83b1-540888a115a7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:58.918878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990892b3-843f-47db-8218-5dbf4ba2972d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:58.919779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990892b3-843f-47db-8218-5dbf4ba2972d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:58.920233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990892b3-843f-47db-8218-5dbf4ba2972d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:58.920652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990892b3-843f-47db-8218-5dbf4ba2972d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:58.928639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990892b3-843f-47db-8218-5dbf4ba2972d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:58.930468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990892b3-843f-47db-8218-5dbf4ba2972d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-990892b3-843f-47db-8218-5dbf4ba2972d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:36:58.943666 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:36:58.944826 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:36:58.946035 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:36:58.946035 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:36:58.946035 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:36:58.946035 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:36:58.946035 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:36:58.946035 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:36:58.946035 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:36:58.946035 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:36:58.948212 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 327/667] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:36:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:36:58.954017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cf68e-2b28-4814-8066-5ff6a0960d7e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:59.058594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990892b3-843f-47db-8218-5dbf4ba2972d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:59.061410 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:59.071012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9cf68e-2b28-4814-8066-5ff6a0960d7e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:59.109553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139122-2bdf-4803-b382-430293715823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:59.110243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139122-2bdf-4803-b382-430293715823 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:59.110449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139122-2bdf-4803-b382-430293715823 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:59.110720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4139122-2bdf-4803-b382-430293715823 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:59.111413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4139122-2bdf-4803-b382-430293715823 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:36:59.111719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4139122-2bdf-4803-b382-430293715823 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:59.113212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4139122-2bdf-4803-b382-430293715823 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:59.115576 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:36:59.131062 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 341/668] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:36:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:36:59.135902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139122-2bdf-4803-b382-430293715823 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:36:59.207082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990892b3-843f-47db-8218-5dbf4ba2972d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:59.256374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313012ff-35bb-4d5d-909b-bf6b90747fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:59.257813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313012ff-35bb-4d5d-909b-bf6b90747fab None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:59.258513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313012ff-35bb-4d5d-909b-bf6b90747fab None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:59.259035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313012ff-35bb-4d5d-909b-bf6b90747fab None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:59.260160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313012ff-35bb-4d5d-909b-bf6b90747fab None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:59.262414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313012ff-35bb-4d5d-909b-bf6b90747fab None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:59.263571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4139122-2bdf-4803-b382-430293715823 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:36:59.283157 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 328/669] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:36:59 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:36:59.320300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b1bec-a26c-4f5e-ad45-c6dd4fcc76d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:36:59.321023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b1bec-a26c-4f5e-ad45-c6dd4fcc76d3 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:36:59.321348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b1bec-a26c-4f5e-ad45-c6dd4fcc76d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:36:59.321686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b1bec-a26c-4f5e-ad45-c6dd4fcc76d3 None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/0e9492df0cf34fd0b1e6a0ac2f77cd37/roles/a06c81aa06f243bc943fa4744c344458` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:36:59.324077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b1bec-a26c-4f5e-ad45-c6dd4fcc76d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=0e9492df0cf34fd0b1e6a0ac2f77cd37, role_id=a06c81aa06f243bc943fa4744c344458)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:36:59.325586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b1bec-a26c-4f5e-ad45-c6dd4fcc76d3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:36:59.342402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 342/670] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:36:59 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/0e9492df0cf34fd0b1e6a0ac2f77cd37/roles/a06c81aa06f243bc943fa4744c344458 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:37:00.211943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea8148-1f0a-4d8e-a980-a3c9041db958 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:00.213131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea8148-1f0a-4d8e-a980-a3c9041db958 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:00.213131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea8148-1f0a-4d8e-a980-a3c9041db958 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:00.215043 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 329/671] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:00.221274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2c973-12f5-4f5a-9dc0-83dd74ea73bd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:00.221841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2c973-12f5-4f5a-9dc0-83dd74ea73bd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:00.221841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf2c973-12f5-4f5a-9dc0-83dd74ea73bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:00.245663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ecf2c973-12f5-4f5a-9dc0-83dd74ea73bd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:00.247303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ecf2c973-12f5-4f5a-9dc0-83dd74ea73bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:00.313955 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:00.343985 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 343/672] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:00.638490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea8148-1f0a-4d8e-a980-a3c9041db958 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:00.734148 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:00.796889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea8148-1f0a-4d8e-a980-a3c9041db958 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:00.845438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b7f75-b524-4cff-a0e5-e14ccd8adc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:00.846146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b7f75-b524-4cff-a0e5-e14ccd8adc34 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:00.846437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b7f75-b524-4cff-a0e5-e14ccd8adc34 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:00.846742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b7f75-b524-4cff-a0e5-e14ccd8adc34 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:00.847415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b7f75-b524-4cff-a0e5-e14ccd8adc34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:00.848931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b7f75-b524-4cff-a0e5-e14ccd8adc34 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:00.871453 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 330/673] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:37:00 2022] POST /identity/v3/services => generated 241 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:01.037906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9619f3-844f-4c5a-bb17-a046bcf7dcfe None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:01.038141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9619f3-844f-4c5a-bb17-a046bcf7dcfe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:01.038446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9619f3-844f-4c5a-bb17-a046bcf7dcfe None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:01.041091 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 344/674] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:01.047397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa170618-4e3e-497f-b30f-d5a12ce71f12 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:01.047708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa170618-4e3e-497f-b30f-d5a12ce71f12 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:01.047944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa170618-4e3e-497f-b30f-d5a12ce71f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:01.067951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fa170618-4e3e-497f-b30f-d5a12ce71f12 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:01.069169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa170618-4e3e-497f-b30f-d5a12ce71f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:01.190276 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 331/675] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:01.463503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9619f3-844f-4c5a-bb17-a046bcf7dcfe None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:01.580266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9619f3-844f-4c5a-bb17-a046bcf7dcfe None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:01.620922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301859a-6a2e-4f49-9d45-c1dd240f9682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:01.621594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301859a-6a2e-4f49-9d45-c1dd240f9682 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:01.621874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301859a-6a2e-4f49-9d45-c1dd240f9682 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:01.622146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301859a-6a2e-4f49-9d45-c1dd240f9682 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:01.622731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301859a-6a2e-4f49-9d45-c1dd240f9682 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:01.624107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301859a-6a2e-4f49-9d45-c1dd240f9682 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-7301859a-6a2e-4f49-9d45-c1dd240f9682 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:01.634462 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:01.635701 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:01.637774 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 345/676] 10.222.0.25 () {56 vars in 1132 bytes} [Mon Oct 24 08:37:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:01.642583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa170618-4e3e-497f-b30f-d5a12ce71f12 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:01.708362 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:01.726704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c9de9-55b6-4c4b-a8e9-5a100372952b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:01.726912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c9de9-55b6-4c4b-a8e9-5a100372952b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:01.727243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c9de9-55b6-4c4b-a8e9-5a100372952b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:01.729392 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 346/677] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:01.735771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05152ce-1dc3-440d-96d6-10b090982993 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:01.736150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05152ce-1dc3-440d-96d6-10b090982993 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:01.736566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05152ce-1dc3-440d-96d6-10b090982993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:01.759785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b05152ce-1dc3-440d-96d6-10b090982993 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:01.761141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b05152ce-1dc3-440d-96d6-10b090982993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:01.786105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa170618-4e3e-497f-b30f-d5a12ce71f12 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:01.813687 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:01.851612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e0e57-267f-42c2-9c19-f6ffa09430ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:01.852437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e0e57-267f-42c2-9c19-f6ffa09430ec None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:01.852723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e0e57-267f-42c2-9c19-f6ffa09430ec None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:01.853022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e0e57-267f-42c2-9c19-f6ffa09430ec None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:01.853850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e0e57-267f-42c2-9c19-f6ffa09430ec None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:01.854234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e0e57-267f-42c2-9c19-f6ffa09430ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:01.855827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e0e57-267f-42c2-9c19-f6ffa09430ec None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:01.858039 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 347/678] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:01.859210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830b2b-d76d-4a13-8264-7a8f97f55260 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:01.859554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830b2b-d76d-4a13-8264-7a8f97f55260 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:01.859846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7830b2b-d76d-4a13-8264-7a8f97f55260 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:01.861458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 348/679] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:01.867952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463c158-f64b-4e65-82f1-38700c4215f9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:01.869074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463c158-f64b-4e65-82f1-38700c4215f9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:01.869593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7463c158-f64b-4e65-82f1-38700c4215f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:01.873106 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 332/680] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:37:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:01.878496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e0e57-267f-42c2-9c19-f6ffa09430ec None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:01.907282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7463c158-f64b-4e65-82f1-38700c4215f9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:01.909157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7463c158-f64b-4e65-82f1-38700c4215f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:01.997128 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 349/681] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:02.030749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e0e57-267f-42c2-9c19-f6ffa09430ec None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:02.046680 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:02.075701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0413-9e2a-44ca-b3e3-9fff6d8106b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:02.076717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0413-9e2a-44ca-b3e3-9fff6d8106b8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:02.077212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0413-9e2a-44ca-b3e3-9fff6d8106b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:02.077690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee0413-9e2a-44ca-b3e3-9fff6d8106b8 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:02.078805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0413-9e2a-44ca-b3e3-9fff6d8106b8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:02.079353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0413-9e2a-44ca-b3e3-9fff6d8106b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:02.082071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee0413-9e2a-44ca-b3e3-9fff6d8106b8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:02.093105 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 333/682] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:37:01 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:02.098741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463c158-f64b-4e65-82f1-38700c4215f9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:02.157593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0413-9e2a-44ca-b3e3-9fff6d8106b8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:02.210929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7463c158-f64b-4e65-82f1-38700c4215f9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:02.214813 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:02.263994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e023d-172a-4204-9ee7-d8791bdebbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:02.264915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e023d-172a-4204-9ee7-d8791bdebbab None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:02.265439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e023d-172a-4204-9ee7-d8791bdebbab None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:02.265919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551e023d-172a-4204-9ee7-d8791bdebbab None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:02.267891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e023d-172a-4204-9ee7-d8791bdebbab None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:02.269691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551e023d-172a-4204-9ee7-d8791bdebbab None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:02.305471 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 350/683] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:37:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:02.321866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee0413-9e2a-44ca-b3e3-9fff6d8106b8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:02.361339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e023d-172a-4204-9ee7-d8791bdebbab None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:02.403218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca48a0-8e05-49f9-a1b1-8523cf8897b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:02.404694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca48a0-8e05-49f9-a1b1-8523cf8897b0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:02.405437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca48a0-8e05-49f9-a1b1-8523cf8897b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:02.406655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cca48a0-8e05-49f9-a1b1-8523cf8897b0 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:02.407220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca48a0-8e05-49f9-a1b1-8523cf8897b0 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:02.409620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cca48a0-8e05-49f9-a1b1-8523cf8897b0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-3cca48a0-8e05-49f9-a1b1-8523cf8897b0 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:02.423702 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:02.426210 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:37:02.428065 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:02.430617 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 334/684] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:37:02 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:02.431503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca48a0-8e05-49f9-a1b1-8523cf8897b0 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:02.475790 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:02.526257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551e023d-172a-4204-9ee7-d8791bdebbab None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:02.567995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cca48a0-8e05-49f9-a1b1-8523cf8897b0 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:02.578022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da982a0-8b0d-4762-99a5-91d5623d9e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:02.579116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da982a0-8b0d-4762-99a5-91d5623d9e59 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:02.579607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da982a0-8b0d-4762-99a5-91d5623d9e59 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:02.580088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da982a0-8b0d-4762-99a5-91d5623d9e59 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:02.595080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da982a0-8b0d-4762-99a5-91d5623d9e59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-0da982a0-8b0d-4762-99a5-91d5623d9e59 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:37:02.601221 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:02.602282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:37:02.603823 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:02.606649 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 351/685] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Oct 24 08:37:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:02.615746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da982a0-8b0d-4762-99a5-91d5623d9e59 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:02.630404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947988b-1a20-455c-960e-77356eaee416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:02.631580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947988b-1a20-455c-960e-77356eaee416 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:02.632191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947988b-1a20-455c-960e-77356eaee416 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:02.632711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a947988b-1a20-455c-960e-77356eaee416 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:02.633753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947988b-1a20-455c-960e-77356eaee416 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:02.634463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947988b-1a20-455c-960e-77356eaee416 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:02.636569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a947988b-1a20-455c-960e-77356eaee416 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:02.646016 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:02.648855 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 335/686] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:37:02 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:02.652428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947988b-1a20-455c-960e-77356eaee416 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:02.766754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da982a0-8b0d-4762-99a5-91d5623d9e59 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:02.801728 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:02.806314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a947988b-1a20-455c-960e-77356eaee416 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:02.842927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b36dc4-91fd-46b6-9532-94794c89b6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:02.844365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b36dc4-91fd-46b6-9532-94794c89b6fe None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:02.845134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b36dc4-91fd-46b6-9532-94794c89b6fe None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:02.845732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b36dc4-91fd-46b6-9532-94794c89b6fe None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:02.847406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b36dc4-91fd-46b6-9532-94794c89b6fe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:02.848330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b36dc4-91fd-46b6-9532-94794c89b6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:02.851886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b36dc4-91fd-46b6-9532-94794c89b6fe None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:02.852205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38ef3-5247-4235-a4f1-5f794171ec1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:02.853003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38ef3-5247-4235-a4f1-5f794171ec1d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:02.853382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38ef3-5247-4235-a4f1-5f794171ec1d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:02.853726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da38ef3-5247-4235-a4f1-5f794171ec1d None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:02.854460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38ef3-5247-4235-a4f1-5f794171ec1d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:02.854861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38ef3-5247-4235-a4f1-5f794171ec1d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:02.856395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da38ef3-5247-4235-a4f1-5f794171ec1d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:02.865804 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 336/687] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:37:02 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:02.868741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38ef3-5247-4235-a4f1-5f794171ec1d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:02.871118 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 352/688] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Oct 24 08:37:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:02.880002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b36dc4-91fd-46b6-9532-94794c89b6fe None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:02.996702 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:02.999802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da38ef3-5247-4235-a4f1-5f794171ec1d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:03.020689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b36dc4-91fd-46b6-9532-94794c89b6fe None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:03.042954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e365d-47fa-413e-a0de-5a2f221e7f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:03.043658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e365d-47fa-413e-a0de-5a2f221e7f1b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.044006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e365d-47fa-413e-a0de-5a2f221e7f1b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.044352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670e365d-47fa-413e-a0de-5a2f221e7f1b None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.045131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e365d-47fa-413e-a0de-5a2f221e7f1b None admin] RBAC: Adding query filter params (interface=public, service_id=362cc6b5e1714b068b30451ab9874d2f, region_id=RegionOne) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:03.045548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e365d-47fa-413e-a0de-5a2f221e7f1b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:03.047003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670e365d-47fa-413e-a0de-5a2f221e7f1b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:03.063405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8205bc-eafb-416f-90fe-ff2eb679e3a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:03.063637 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 337/689] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Oct 24 08:37:02 2022] GET /identity/v3/endpoints?service_id=362cc6b5e1714b068b30451ab9874d2f&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:03.064437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8205bc-eafb-416f-90fe-ff2eb679e3a3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.065152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8205bc-eafb-416f-90fe-ff2eb679e3a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.065686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8205bc-eafb-416f-90fe-ff2eb679e3a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.066110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e365d-47fa-413e-a0de-5a2f221e7f1b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:03.078981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8205bc-eafb-416f-90fe-ff2eb679e3a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:03.080744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8205bc-eafb-416f-90fe-ff2eb679e3a3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-7f8205bc-eafb-416f-90fe-ff2eb679e3a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:37:03.098275 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:03.099531 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:37:03.100617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:37:03.100617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:03.100617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:03.103808 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 353/690] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:03.109380 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:03.109573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8205bc-eafb-416f-90fe-ff2eb679e3a3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:03.206648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670e365d-47fa-413e-a0de-5a2f221e7f1b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:03.255735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8205bc-eafb-416f-90fe-ff2eb679e3a3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:03.258770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc97b07-b186-4496-9473-ee9848d243c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:03.259969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc97b07-b186-4496-9473-ee9848d243c8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.260247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc97b07-b186-4496-9473-ee9848d243c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.260520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc97b07-b186-4496-9473-ee9848d243c8 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.261135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc97b07-b186-4496-9473-ee9848d243c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:03.262571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc97b07-b186-4496-9473-ee9848d243c8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:03.277694 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 338/691] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Oct 24 08:37:03 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:37:03.312150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61c08d9-a1ca-48cc-a7ae-5b08b152db52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:03.313259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c08d9-a1ca-48cc-a7ae-5b08b152db52 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.313879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c08d9-a1ca-48cc-a7ae-5b08b152db52 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.314388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61c08d9-a1ca-48cc-a7ae-5b08b152db52 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.315290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c08d9-a1ca-48cc-a7ae-5b08b152db52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:03.315962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c08d9-a1ca-48cc-a7ae-5b08b152db52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:03.317753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61c08d9-a1ca-48cc-a7ae-5b08b152db52 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:03.319988 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:03.335300 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 354/692] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:03.345357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc97b07-b186-4496-9473-ee9848d243c8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:03.469204 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:03.481337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc97b07-b186-4496-9473-ee9848d243c8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:03.510601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e0a5-6ca0-46fc-83f9-1c269e43492b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.510889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e0a5-6ca0-46fc-83f9-1c269e43492b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.511167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3e0a5-6ca0-46fc-83f9-1c269e43492b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.514060 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 355/693] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:37:03.520146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b286e8-5dee-4dbd-b843-256e10bb1fda None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.520625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b286e8-5dee-4dbd-b843-256e10bb1fda None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.521048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b286e8-5dee-4dbd-b843-256e10bb1fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.523236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65cbf0-9c25-426e-9498-849916242a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:03.524450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65cbf0-9c25-426e-9498-849916242a8b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.524450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65cbf0-9c25-426e-9498-849916242a8b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.524450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65cbf0-9c25-426e-9498-849916242a8b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.535967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65cbf0-9c25-426e-9498-849916242a8b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:03.538124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65cbf0-9c25-426e-9498-849916242a8b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:03.543397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a1b286e8-5dee-4dbd-b843-256e10bb1fda None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:03.544608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a1b286e8-5dee-4dbd-b843-256e10bb1fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-5f65cbf0-9c25-426e-9498-849916242a8b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:37:03.552674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:03.553741 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:03.555776 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 339/694] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Oct 24 08:37:03 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:03.560733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65cbf0-9c25-426e-9498-849916242a8b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:03.628111 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 356/695] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:03.683632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65cbf0-9c25-426e-9498-849916242a8b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:03.721241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67950b1c-3986-4e84-8f2e-becfae4eb2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:03.721886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950b1c-3986-4e84-8f2e-becfae4eb2ac None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.722161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950b1c-3986-4e84-8f2e-becfae4eb2ac None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.722436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67950b1c-3986-4e84-8f2e-becfae4eb2ac None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.723166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67950b1c-3986-4e84-8f2e-becfae4eb2ac None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:03.723471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67950b1c-3986-4e84-8f2e-becfae4eb2ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:03.724924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67950b1c-3986-4e84-8f2e-becfae4eb2ac None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:03.745400 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 340/696] 10.222.0.25 () {56 vars in 1149 bytes} [Mon Oct 24 08:37:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:03.751203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b286e8-5dee-4dbd-b843-256e10bb1fda None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:03.861072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b286e8-5dee-4dbd-b843-256e10bb1fda None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:03.886660 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:03.899360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878992a-45e5-47d7-8c2e-bd148b84b127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:03.900208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878992a-45e5-47d7-8c2e-bd148b84b127 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:03.900647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878992a-45e5-47d7-8c2e-bd148b84b127 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:03.900944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878992a-45e5-47d7-8c2e-bd148b84b127 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:03.931438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67950b1c-3986-4e84-8f2e-becfae4eb2ac None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:03.957715 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:03.984114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878992a-45e5-47d7-8c2e-bd148b84b127 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:03.985647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878992a-45e5-47d7-8c2e-bd148b84b127 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:04.090238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67950b1c-3986-4e84-8f2e-becfae4eb2ac None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:04.134482 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 357/697] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:37:03 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:37:04.135446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878992a-45e5-47d7-8c2e-bd148b84b127 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:04.148328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99ef38-3ca3-4ede-b847-bcdd3949bb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:04.150468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99ef38-3ca3-4ede-b847-bcdd3949bb1b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.151006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99ef38-3ca3-4ede-b847-bcdd3949bb1b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.151952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e99ef38-3ca3-4ede-b847-bcdd3949bb1b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.153135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99ef38-3ca3-4ede-b847-bcdd3949bb1b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:04.155156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e99ef38-3ca3-4ede-b847-bcdd3949bb1b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:04.168650 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-2e99ef38-3ca3-4ede-b847-bcdd3949bb1b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:04.170383 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:04.171489 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:04.172357 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:04.178649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 341/698] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:37:03 2022] GET /identity/v3/services/object-store => generated 93 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:04.182505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99ef38-3ca3-4ede-b847-bcdd3949bb1b None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:04.275573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878992a-45e5-47d7-8c2e-bd148b84b127 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:04.294629 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:04.326882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a9f9a-4238-4252-b0af-e5293f49bc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:04.327685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a9f9a-4238-4252-b0af-e5293f49bc71 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.328065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a9f9a-4238-4252-b0af-e5293f49bc71 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.328444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615a9f9a-4238-4252-b0af-e5293f49bc71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.333773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e99ef38-3ca3-4ede-b847-bcdd3949bb1b None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:04.341590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a9f9a-4238-4252-b0af-e5293f49bc71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:04.343365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615a9f9a-4238-4252-b0af-e5293f49bc71 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-615a9f9a-4238-4252-b0af-e5293f49bc71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:37:04.361224 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:04.363372 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:37:04.365558 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:37:04.365558 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:04.365558 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:04.369068 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 358/699] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:04.370000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a9f9a-4238-4252-b0af-e5293f49bc71 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:04.398405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583c3c-15d8-491f-a337-8c038e0850a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:04.400181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583c3c-15d8-491f-a337-8c038e0850a9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.400955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583c3c-15d8-491f-a337-8c038e0850a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.401758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa583c3c-15d8-491f-a337-8c038e0850a9 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.403431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583c3c-15d8-491f-a337-8c038e0850a9 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:04.404268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583c3c-15d8-491f-a337-8c038e0850a9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:04.407530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa583c3c-15d8-491f-a337-8c038e0850a9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:04.418453 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 342/700] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:37:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:04.423652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583c3c-15d8-491f-a337-8c038e0850a9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:04.471227 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:04.499898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615a9f9a-4238-4252-b0af-e5293f49bc71 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:04.540776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f809-aeb4-4423-b5ff-f9e6dc64a320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:04.541238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa583c3c-15d8-491f-a337-8c038e0850a9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:04.541764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f809-aeb4-4423-b5ff-f9e6dc64a320 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.542159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f809-aeb4-4423-b5ff-f9e6dc64a320 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.542532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f809-aeb4-4423-b5ff-f9e6dc64a320 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.543307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895f809-aeb4-4423-b5ff-f9e6dc64a320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:04.543716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895f809-aeb4-4423-b5ff-f9e6dc64a320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:04.545324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f895f809-aeb4-4423-b5ff-f9e6dc64a320 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:04.561471 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 359/701] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:37:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:04.565396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f809-aeb4-4423-b5ff-f9e6dc64a320 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:04.595855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e51e6f-d3e2-4407-9b10-67fe5a14f8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:04.596862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e51e6f-d3e2-4407-9b10-67fe5a14f8b7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.597329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e51e6f-d3e2-4407-9b10-67fe5a14f8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.597995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e51e6f-d3e2-4407-9b10-67fe5a14f8b7 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.598817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e51e6f-d3e2-4407-9b10-67fe5a14f8b7 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:04.599355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e51e6f-d3e2-4407-9b10-67fe5a14f8b7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:04.601128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e51e6f-d3e2-4407-9b10-67fe5a14f8b7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:04.607675 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 343/702] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:37:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:04.619584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e51e6f-d3e2-4407-9b10-67fe5a14f8b7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:04.624140 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:04.691333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f809-aeb4-4423-b5ff-f9e6dc64a320 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:04.729096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af88640-d1ef-4aaf-bafd-3d7e4c3d8221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:04.730079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af88640-d1ef-4aaf-bafd-3d7e4c3d8221 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.730536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af88640-d1ef-4aaf-bafd-3d7e4c3d8221 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.730960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af88640-d1ef-4aaf-bafd-3d7e4c3d8221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.732281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e51e6f-d3e2-4407-9b10-67fe5a14f8b7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:04.735586 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:04.741603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af88640-d1ef-4aaf-bafd-3d7e4c3d8221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:04.743187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af88640-d1ef-4aaf-bafd-3d7e4c3d8221 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-5af88640-d1ef-4aaf-bafd-3d7e4c3d8221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:37:04.756556 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:04.757638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 360/703] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:37:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5261-b2a6-4acb-935c-09bbf101830d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.763812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5261-b2a6-4acb-935c-09bbf101830d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.764571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd5261-b2a6-4acb-935c-09bbf101830d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.764571 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 361/704] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:04.766071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5261-b2a6-4acb-935c-09bbf101830d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:04.778054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef758493-8f62-46c9-9c03-6d24812c6af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:04.778665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758493-8f62-46c9-9c03-6d24812c6af0 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.778943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758493-8f62-46c9-9c03-6d24812c6af0 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.779210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef758493-8f62-46c9-9c03-6d24812c6af0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.779907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef758493-8f62-46c9-9c03-6d24812c6af0 None admin] RBAC: Adding query filter params (interface=public, service_id=5e0f30d3d6b049b087578548dff47e66, region_id=RegionOne) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:04.780273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef758493-8f62-46c9-9c03-6d24812c6af0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:04.781695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef758493-8f62-46c9-9c03-6d24812c6af0 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:04.787324 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 344/705] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Oct 24 08:37:04 2022] GET /identity/v3/endpoints?service_id=5e0f30d3d6b049b087578548dff47e66&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:04.788629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1278d-3996-446e-829b-818d5c982850 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.788964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1278d-3996-446e-829b-818d5c982850 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.789238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1278d-3996-446e-829b-818d5c982850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.808439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e3c1278d-3996-446e-829b-818d5c982850 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:04.809649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e3c1278d-3996-446e-829b-818d5c982850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:04.872297 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:04.881039 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 345/706] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:04.881804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1278d-3996-446e-829b-818d5c982850 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:04.900344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd5261-b2a6-4acb-935c-09bbf101830d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:04.939208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd3db7-c091-49e7-96d7-4529a07d964f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:04.939785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3db7-c091-49e7-96d7-4529a07d964f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:04.940066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3db7-c091-49e7-96d7-4529a07d964f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:04.940340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd3db7-c091-49e7-96d7-4529a07d964f None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:04.941092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd3db7-c091-49e7-96d7-4529a07d964f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:04.941491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd3db7-c091-49e7-96d7-4529a07d964f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:04.943009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd3db7-c091-49e7-96d7-4529a07d964f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:04.956796 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 362/707] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:37:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:04.962657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd3db7-c091-49e7-96d7-4529a07d964f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:05.015724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1278d-3996-446e-829b-818d5c982850 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:05.041269 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:05.071958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2192-1044-439a-831c-734d8247b609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:05.072866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2192-1044-439a-831c-734d8247b609 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:05.073328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2192-1044-439a-831c-734d8247b609 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:05.074305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ab2192-1044-439a-831c-734d8247b609 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:05.075077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab2192-1044-439a-831c-734d8247b609 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:05.077502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ab2192-1044-439a-831c-734d8247b609 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:05.087083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 346/708] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Oct 24 08:37:04 2022] GET /identity/v3/services => generated 1497 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:37:05.110064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd3db7-c091-49e7-96d7-4529a07d964f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:05.157331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a109e9-865f-4e25-9e8f-b697845f856a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:05.157331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a109e9-865f-4e25-9e8f-b697845f856a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:05.157331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a109e9-865f-4e25-9e8f-b697845f856a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:05.157331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a109e9-865f-4e25-9e8f-b697845f856a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:05.157765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a109e9-865f-4e25-9e8f-b697845f856a None admin] RBAC: Adding query filter params (role.id=a06c81aa06f243bc943fa4744c344458, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=0e9492df0cf34fd0b1e6a0ac2f77cd37) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:05.157765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a109e9-865f-4e25-9e8f-b697845f856a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:05.157765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a109e9-865f-4e25-9e8f-b697845f856a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:05.163895 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 363/709] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:37:04 2022] GET /identity/v3/role_assignments?user.id=0e9492df0cf34fd0b1e6a0ac2f77cd37&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=a06c81aa06f243bc943fa4744c344458 => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:05.175679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2192-1044-439a-831c-734d8247b609 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:05.257939 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:05.318764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ab2192-1044-439a-831c-734d8247b609 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:05.369274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f3ed6-18dd-4e60-b94b-0c9d099075a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:05.370335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f3ed6-18dd-4e60-b94b-0c9d099075a1 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:05.370856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f3ed6-18dd-4e60-b94b-0c9d099075a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:05.371338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5f3ed6-18dd-4e60-b94b-0c9d099075a1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:05.372181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f3ed6-18dd-4e60-b94b-0c9d099075a1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:05.373817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5f3ed6-18dd-4e60-b94b-0c9d099075a1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0f5f3ed6-18dd-4e60-b94b-0c9d099075a1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:05.383874 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:05.384951 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:37:05.385837 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:05.388907 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 347/710] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:37:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:05.394405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a109e9-865f-4e25-9e8f-b697845f856a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:05.532118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a109e9-865f-4e25-9e8f-b697845f856a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:05.558125 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:05.575296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a733a5d-5822-4a47-9ef3-5c5299d83179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:05.576294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733a5d-5822-4a47-9ef3-5c5299d83179 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:05.576799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733a5d-5822-4a47-9ef3-5c5299d83179 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:05.577286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a733a5d-5822-4a47-9ef3-5c5299d83179 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:05.578144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a733a5d-5822-4a47-9ef3-5c5299d83179 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:05.578651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a733a5d-5822-4a47-9ef3-5c5299d83179 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:05.580248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a733a5d-5822-4a47-9ef3-5c5299d83179 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:05.586318 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 364/711] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:37:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:05.594165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f3ed6-18dd-4e60-b94b-0c9d099075a1 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:05.648377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76de2d3-7634-4105-8b49-beadb79e89ec None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:05.648712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76de2d3-7634-4105-8b49-beadb79e89ec None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:05.648931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76de2d3-7634-4105-8b49-beadb79e89ec None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:05.650815 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 365/712] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:37:05.656435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334d9cc-a140-419a-a5f1-8e7cc5eb6470 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:05.656718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334d9cc-a140-419a-a5f1-8e7cc5eb6470 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:05.657104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d334d9cc-a140-419a-a5f1-8e7cc5eb6470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:05.677953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d334d9cc-a140-419a-a5f1-8e7cc5eb6470 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:05.679146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d334d9cc-a140-419a-a5f1-8e7cc5eb6470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:05.716523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5f3ed6-18dd-4e60-b94b-0c9d099075a1 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:05.746516 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:05.761131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0617602-a236-4ad3-b340-2f46ffe5ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:05.762040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0617602-a236-4ad3-b340-2f46ffe5ce00 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:05.762327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0617602-a236-4ad3-b340-2f46ffe5ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:05.762597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0617602-a236-4ad3-b340-2f46ffe5ce00 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:05.763232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0617602-a236-4ad3-b340-2f46ffe5ce00 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:05.763534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0617602-a236-4ad3-b340-2f46ffe5ce00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:05.764936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0617602-a236-4ad3-b340-2f46ffe5ce00 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:05.773573 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 348/714] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:37:05 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:05.773779 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 366/714] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:06.051159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0617602-a236-4ad3-b340-2f46ffe5ce00 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:06.191720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0617602-a236-4ad3-b340-2f46ffe5ce00 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:06.238670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125fc4-18b1-4d25-a5eb-9030a1ffbbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:06.239647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125fc4-18b1-4d25-a5eb-9030a1ffbbec None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:06.240138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125fc4-18b1-4d25-a5eb-9030a1ffbbec None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:06.240872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4125fc4-18b1-4d25-a5eb-9030a1ffbbec None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:06.242072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125fc4-18b1-4d25-a5eb-9030a1ffbbec None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:06.244206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4125fc4-18b1-4d25-a5eb-9030a1ffbbec None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e4125fc4-18b1-4d25-a5eb-9030a1ffbbec None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:06.257863 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:06.259283 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:06.260167 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 349/715] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:37:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:06.267123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334d9cc-a140-419a-a5f1-8e7cc5eb6470 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:06.382106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d334d9cc-a140-419a-a5f1-8e7cc5eb6470 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:06.398699 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:06.420532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd4921-3ff3-4978-a1f1-0ae08fb63db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:06.421145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd4921-3ff3-4978-a1f1-0ae08fb63db9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:06.421460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd4921-3ff3-4978-a1f1-0ae08fb63db9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:06.421734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddd4921-3ff3-4978-a1f1-0ae08fb63db9 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:06.422365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd4921-3ff3-4978-a1f1-0ae08fb63db9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:06.422671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd4921-3ff3-4978-a1f1-0ae08fb63db9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:06.424175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddd4921-3ff3-4978-a1f1-0ae08fb63db9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:06.429981 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 367/716] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:37:06 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:06.436194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125fc4-18b1-4d25-a5eb-9030a1ffbbec None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:06.506474 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:06.566249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4125fc4-18b1-4d25-a5eb-9030a1ffbbec None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:06.609358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8368efb7-479f-4807-9f09-522637e12169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:06.610361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368efb7-479f-4807-9f09-522637e12169 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:06.610853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368efb7-479f-4807-9f09-522637e12169 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:06.611327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8368efb7-479f-4807-9f09-522637e12169 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:06.612442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368efb7-479f-4807-9f09-522637e12169 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:06.612967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368efb7-479f-4807-9f09-522637e12169 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:06.615784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8368efb7-479f-4807-9f09-522637e12169 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:06.625606 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 350/717] 10.222.0.25 () {56 vars in 1114 bytes} [Mon Oct 24 08:37:06 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:06.631481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd4921-3ff3-4978-a1f1-0ae08fb63db9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:06.766085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddd4921-3ff3-4978-a1f1-0ae08fb63db9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:06.805147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1a95c9-146e-4f84-83f0-c53267a7ba04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:06.805827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a95c9-146e-4f84-83f0-c53267a7ba04 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:06.806109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a95c9-146e-4f84-83f0-c53267a7ba04 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:06.806384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1a95c9-146e-4f84-83f0-c53267a7ba04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:06.807136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a95c9-146e-4f84-83f0-c53267a7ba04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:06.808515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1a95c9-146e-4f84-83f0-c53267a7ba04 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:06.833821 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 368/718] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:37:06 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:07.666571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bb889-a416-4264-8daf-685da79feae7 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:07.667720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bb889-a416-4264-8daf-685da79feae7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:07.668284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32bb889-a416-4264-8daf-685da79feae7 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:07.670388 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 351/719] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:07.676816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cf3ef-ebd6-4d4b-a2f1-eda6ec439f1d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:07.678063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cf3ef-ebd6-4d4b-a2f1-eda6ec439f1d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:07.678565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983cf3ef-ebd6-4d4b-a2f1-eda6ec439f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:07.700694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-983cf3ef-ebd6-4d4b-a2f1-eda6ec439f1d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:07.702454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-983cf3ef-ebd6-4d4b-a2f1-eda6ec439f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:07.710738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5379e7-887d-4e19-89b8-4d5895e88a94 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:07.711064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5379e7-887d-4e19-89b8-4d5895e88a94 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:07.711286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5379e7-887d-4e19-89b8-4d5895e88a94 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:07.713514 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 352/720] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:37:07.719233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2694f-261d-4a3d-9602-174048b523d5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:07.719526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2694f-261d-4a3d-9602-174048b523d5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:07.719781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b2694f-261d-4a3d-9602-174048b523d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:07.738816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b0b2694f-261d-4a3d-9602-174048b523d5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:07.740082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b0b2694f-261d-4a3d-9602-174048b523d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:07.744147 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:07.801524 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 369/721] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:07.827535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 353/722] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:08.089737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cf3ef-ebd6-4d4b-a2f1-eda6ec439f1d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:08.144068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2694f-261d-4a3d-9602-174048b523d5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:08.197272 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:08.222638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983cf3ef-ebd6-4d4b-a2f1-eda6ec439f1d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:08.267008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efe80cc-37ba-418e-8b47-de10ebfb6f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:08.267753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe80cc-37ba-418e-8b47-de10ebfb6f62 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:08.268172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe80cc-37ba-418e-8b47-de10ebfb6f62 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:08.268320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efe80cc-37ba-418e-8b47-de10ebfb6f62 None admin] PATH_INFO: `/v3/services/image` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:08.268882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe80cc-37ba-418e-8b47-de10ebfb6f62 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:08.270447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efe80cc-37ba-418e-8b47-de10ebfb6f62 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:08.277976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b2694f-261d-4a3d-9602-174048b523d5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-8efe80cc-37ba-418e-8b47-de10ebfb6f62 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:08.281218 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:08.282809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:08.283837 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 370/723] 10.222.0.25 () {56 vars in 1105 bytes} [Mon Oct 24 08:37:08 2022] GET /identity/v3/services/image => generated 86 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:08.284893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af2c95-2b33-4903-9ad0-26dd65c924d4 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:08.284893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af2c95-2b33-4903-9ad0-26dd65c924d4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:08.284893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70af2c95-2b33-4903-9ad0-26dd65c924d4 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:08.285782 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 371/724] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:08.288312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af2c95-2b33-4903-9ad0-26dd65c924d4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:08.323421 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:08.336985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24cfbe7-a863-483d-9a25-0167dcc817b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:08.337697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cfbe7-a863-483d-9a25-0167dcc817b7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:08.337985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cfbe7-a863-483d-9a25-0167dcc817b7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:08.338261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24cfbe7-a863-483d-9a25-0167dcc817b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:08.338868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cfbe7-a863-483d-9a25-0167dcc817b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:08.340344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24cfbe7-a863-483d-9a25-0167dcc817b7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e24cfbe7-a863-483d-9a25-0167dcc817b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:08.350054 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:08.351182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:08.352039 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 354/725] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:37:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:08.353552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be123bc-a21e-4eda-b2ac-1502131d7794 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:08.353552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be123bc-a21e-4eda-b2ac-1502131d7794 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:08.354264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be123bc-a21e-4eda-b2ac-1502131d7794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:08.373728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4be123bc-a21e-4eda-b2ac-1502131d7794 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:08.375030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4be123bc-a21e-4eda-b2ac-1502131d7794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:08.429053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70af2c95-2b33-4903-9ad0-26dd65c924d4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:08.448887 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 355/726] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:08.449800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be123bc-a21e-4eda-b2ac-1502131d7794 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:08.484758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dffd78-292b-416f-af9c-c5510fc317b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:08.486614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dffd78-292b-416f-af9c-c5510fc317b6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:08.487460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dffd78-292b-416f-af9c-c5510fc317b6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:08.488091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dffd78-292b-416f-af9c-c5510fc317b6 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:08.489064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dffd78-292b-416f-af9c-c5510fc317b6 None admin] RBAC: Adding query filter params (name=image) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:08.489723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dffd78-292b-416f-af9c-c5510fc317b6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:08.491502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dffd78-292b-416f-af9c-c5510fc317b6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:08.499620 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 372/727] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:08.507318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dffd78-292b-416f-af9c-c5510fc317b6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:08.511435 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:08.599416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be123bc-a21e-4eda-b2ac-1502131d7794 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:08.643933 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:08.657825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cad99-a1e8-4f7c-bf4c-e5b3dc53a5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:08.659375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cad99-a1e8-4f7c-bf4c-e5b3dc53a5d2 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:08.659849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cad99-a1e8-4f7c-bf4c-e5b3dc53a5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:08.660293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1cad99-a1e8-4f7c-bf4c-e5b3dc53a5d2 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:08.661096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cad99-a1e8-4f7c-bf4c-e5b3dc53a5d2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:08.661241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dffd78-292b-416f-af9c-c5510fc317b6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:08.661698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cad99-a1e8-4f7c-bf4c-e5b3dc53a5d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:08.664428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1cad99-a1e8-4f7c-bf4c-e5b3dc53a5d2 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:08.670825 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 356/728] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:37:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:08.676354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cad99-a1e8-4f7c-bf4c-e5b3dc53a5d2 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:08.705798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce0b3f-cbb5-432b-ac6f-597aba43aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:08.707262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce0b3f-cbb5-432b-ac6f-597aba43aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:08.707727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce0b3f-cbb5-432b-ac6f-597aba43aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:08.708175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce0b3f-cbb5-432b-ac6f-597aba43aeb7 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:08.709025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce0b3f-cbb5-432b-ac6f-597aba43aeb7 None admin] RBAC: Adding query filter params (type=image) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:08.709605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce0b3f-cbb5-432b-ac6f-597aba43aeb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:08.711152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce0b3f-cbb5-432b-ac6f-597aba43aeb7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:08.717886 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 373/729] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:08 2022] GET /identity/v3/services?type=image => generated 122 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:08.736659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce0b3f-cbb5-432b-ac6f-597aba43aeb7 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:08.826693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1cad99-a1e8-4f7c-bf4c-e5b3dc53a5d2 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:08.831155 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:08.862717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce0b3f-cbb5-432b-ac6f-597aba43aeb7 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:08.874713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39438178-64de-42db-bc2a-b3b38a560a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:08.875721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39438178-64de-42db-bc2a-b3b38a560a60 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:08.875978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39438178-64de-42db-bc2a-b3b38a560a60 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:08.876466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39438178-64de-42db-bc2a-b3b38a560a60 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:08.877214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39438178-64de-42db-bc2a-b3b38a560a60 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:08.877670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39438178-64de-42db-bc2a-b3b38a560a60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:08.879403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39438178-64de-42db-bc2a-b3b38a560a60 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:08.890525 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 357/730] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:37:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:08.891784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39438178-64de-42db-bc2a-b3b38a560a60 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:08.916781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639378b-46c9-4695-806d-2a263c10622c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:08.917804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639378b-46c9-4695-806d-2a263c10622c None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:08.918285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639378b-46c9-4695-806d-2a263c10622c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:08.918749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639378b-46c9-4695-806d-2a263c10622c None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:08.919738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639378b-46c9-4695-806d-2a263c10622c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:08.921191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639378b-46c9-4695-806d-2a263c10622c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:08.940321 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 374/731] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:37:08 2022] POST /identity/v3/services => generated 242 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:37:09.020900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39438178-64de-42db-bc2a-b3b38a560a60 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:09.076014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d5867e2-0808-4650-9dcf-188f8c4b89a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:09.076957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5867e2-0808-4650-9dcf-188f8c4b89a3 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:09.077423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5867e2-0808-4650-9dcf-188f8c4b89a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:09.077872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d5867e2-0808-4650-9dcf-188f8c4b89a3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:09.079035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5867e2-0808-4650-9dcf-188f8c4b89a3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:09.080708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d5867e2-0808-4650-9dcf-188f8c4b89a3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:09.106132 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 358/732] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:37:08 2022] POST /identity/v3/endpoints => generated 349 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:09.242292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83960b-fd62-4bea-9f78-8288e4dcb3cd None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:09.242663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83960b-fd62-4bea-9f78-8288e4dcb3cd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:09.242868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b83960b-fd62-4bea-9f78-8288e4dcb3cd None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:09.245049 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 375/733] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:09.251240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e509b3f-68f9-4465-8e4f-70aea5472233 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:09.251918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e509b3f-68f9-4465-8e4f-70aea5472233 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:09.252410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e509b3f-68f9-4465-8e4f-70aea5472233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:09.272498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7e509b3f-68f9-4465-8e4f-70aea5472233 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:09.274124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e509b3f-68f9-4465-8e4f-70aea5472233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:09.291381 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:09.366467 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 359/734] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:09 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:09.634364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83960b-fd62-4bea-9f78-8288e4dcb3cd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:09.651162 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:09.743988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b83960b-fd62-4bea-9f78-8288e4dcb3cd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:09.780067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:09.780668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:09.780943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:09.781213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:09.781890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:09.783309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:09.785919 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.server.flask.common [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 24 08:37:09.805390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 08:37:09.805390 n-d-master-1 devstack@keystone.service[88312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:37:09.805390 n-d-master-1 devstack@keystone.service[88312]: [parameters: {'id': 'fa4a43237436494a9da3f5e592672c56', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 08:37:09.805390 n-d-master-1 devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fa4a43237436494a9da3f5e592672c56.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fa4a43237436494a9da3f5e592672c56. Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:37:09.812911 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 08:37:09.813751 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 24 08:37:09.815158 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:37:09.816321 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:37:09.817229 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:37:09.818070 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'id': 'fa4a43237436494a9da3f5e592672c56', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:09.818967 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:09.825311 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id fa4a43237436494a9da3f5e592672c56. Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:09.827471 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 376/735] 10.222.0.25 () {60 vars in 1140 bytes} [Mon Oct 24 08:37:09 2022] POST /identity/v3/projects => generated 262 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:09.828760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e509b3f-68f9-4465-8e4f-70aea5472233 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:09.931776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e509b3f-68f9-4465-8e4f-70aea5472233 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:09.967398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c1e460-1688-457c-9ddd-8938ee9e8ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:09.968019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1e460-1688-457c-9ddd-8938ee9e8ccf None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:09.968292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1e460-1688-457c-9ddd-8938ee9e8ccf None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:09.968561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c1e460-1688-457c-9ddd-8938ee9e8ccf None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:09.975406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1e460-1688-457c-9ddd-8938ee9e8ccf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:09.976849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c1e460-1688-457c-9ddd-8938ee9e8ccf None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c4c1e460-1688-457c-9ddd-8938ee9e8ccf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:37:09.988943 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:09.991301 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:09.993567 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:37:09.993567 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:37:09.993567 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:37:09.993567 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:37:09.993567 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:37:09.993567 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:37:09.993567 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:37:09.993567 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:09.993567 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 360/736] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:37:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:09.996810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:10.073850 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:10.111922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a8b45-fe7b-44a4-b862-c0ff240d2732 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:10.147166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a6ec2-8221-4121-b98f-52e33e90465f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:10.147826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6ec2-8221-4121-b98f-52e33e90465f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:10.148109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6ec2-8221-4121-b98f-52e33e90465f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:10.148380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a6ec2-8221-4121-b98f-52e33e90465f None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:10.149046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a6ec2-8221-4121-b98f-52e33e90465f None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:10.149370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a6ec2-8221-4121-b98f-52e33e90465f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:10.151926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a6ec2-8221-4121-b98f-52e33e90465f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:10.177457 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 377/737] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:37:09 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:11.095917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bba14-05a3-4500-a613-824bc1578867 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.095917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bba14-05a3-4500-a613-824bc1578867 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.095917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9bba14-05a3-4500-a613-824bc1578867 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.095917 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 361/738] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:11.104649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab9c0-8d23-4e08-a201-77cd7134181d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.104649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab9c0-8d23-4e08-a201-77cd7134181d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.104649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbab9c0-8d23-4e08-a201-77cd7134181d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.126122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-edbab9c0-8d23-4e08-a201-77cd7134181d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:11.128008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-edbab9c0-8d23-4e08-a201-77cd7134181d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:11.201060 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 378/739] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:11.209557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6378-4c17-4604-bc11-c150f37973ea None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.210070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6378-4c17-4604-bc11-c150f37973ea None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.210544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada6378-4c17-4604-bc11-c150f37973ea None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.212425 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 362/740] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:11.217663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ef02-fb61-416c-b63c-acb7d56e1833 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.218189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ef02-fb61-416c-b63c-acb7d56e1833 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.218644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1743ef02-fb61-416c-b63c-acb7d56e1833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.241588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1743ef02-fb61-416c-b63c-acb7d56e1833 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:11.244027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1743ef02-fb61-416c-b63c-acb7d56e1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:11.313914 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:11.329826 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 379/741] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:11.443904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad46a1e-4914-45ea-991a-04000033946c None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.444242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad46a1e-4914-45ea-991a-04000033946c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.444455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad46a1e-4914-45ea-991a-04000033946c None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.446089 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 363/742] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:11.451437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdc65c-74b7-4c85-9190-1e5123035b32 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.451966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdc65c-74b7-4c85-9190-1e5123035b32 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.452456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdc65c-74b7-4c85-9190-1e5123035b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.472511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cfcdc65c-74b7-4c85-9190-1e5123035b32 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:11.474159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cfcdc65c-74b7-4c85-9190-1e5123035b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:11.486667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad46a1e-4914-45ea-991a-04000033946c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:11.495737 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:11.551080 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 380/743] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:11 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:11.603625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdc65c-74b7-4c85-9190-1e5123035b32 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:11.615797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad46a1e-4914-45ea-991a-04000033946c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:11.653710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c7ace-baeb-471f-a448-b0f289077a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:11.654599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7ace-baeb-471f-a448-b0f289077a1c None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.655391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7ace-baeb-471f-a448-b0f289077a1c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.655814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c7ace-baeb-471f-a448-b0f289077a1c None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.657002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c7ace-baeb-471f-a448-b0f289077a1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:11.658895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388c7ace-baeb-471f-a448-b0f289077a1c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:11.681792 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 364/744] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:37:11 2022] POST /identity/v3/services => generated 242 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:37:11.736508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdc65c-74b7-4c85-9190-1e5123035b32 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:11.758187 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:11.786230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a82a0-f5d7-4356-b4dd-ceb61c48b986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:11.786979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a82a0-f5d7-4356-b4dd-ceb61c48b986 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.787299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a82a0-f5d7-4356-b4dd-ceb61c48b986 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.787583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a82a0-f5d7-4356-b4dd-ceb61c48b986 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.788180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a82a0-f5d7-4356-b4dd-ceb61c48b986 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:11.789602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a82a0-f5d7-4356-b4dd-ceb61c48b986 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a52a82a0-f5d7-4356-b4dd-ceb61c48b986 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:11.800203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:11.801261 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:11.802142 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 381/745] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:37:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:11.809876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c7ace-baeb-471f-a448-b0f289077a1c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:11.852123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a82a0-f5d7-4356-b4dd-ceb61c48b986 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:11.887115 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:11.930041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c7ace-baeb-471f-a448-b0f289077a1c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:11.977002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a82a0-f5d7-4356-b4dd-ceb61c48b986 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:11.979712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2baa7-5a75-408b-88f8-842d3eb57547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:11.981322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2baa7-5a75-408b-88f8-842d3eb57547 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:11.981641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2baa7-5a75-408b-88f8-842d3eb57547 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:11.981928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc2baa7-5a75-408b-88f8-842d3eb57547 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:11.982578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2baa7-5a75-408b-88f8-842d3eb57547 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:11.982889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2baa7-5a75-408b-88f8-842d3eb57547 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:11.984283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc2baa7-5a75-408b-88f8-842d3eb57547 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:11.992007 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 365/746] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:37:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:11.997432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2baa7-5a75-408b-88f8-842d3eb57547 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:12.022192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fc8d7-4e75-4a7a-82cb-57e3bb3889e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:12.022953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fc8d7-4e75-4a7a-82cb-57e3bb3889e9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.023390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fc8d7-4e75-4a7a-82cb-57e3bb3889e9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.023789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847fc8d7-4e75-4a7a-82cb-57e3bb3889e9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.024394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fc8d7-4e75-4a7a-82cb-57e3bb3889e9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:12.025880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847fc8d7-4e75-4a7a-82cb-57e3bb3889e9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-847fc8d7-4e75-4a7a-82cb-57e3bb3889e9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:12.037330 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:12.038394 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:12.039243 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 382/747] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:37:11 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:12.046498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fc8d7-4e75-4a7a-82cb-57e3bb3889e9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:12.103114 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:12.116122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc2baa7-5a75-408b-88f8-842d3eb57547 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:12.154612 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:12.163943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29cfec-cbd2-4c8f-b0da-11d3cca8c27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:12.164708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29cfec-cbd2-4c8f-b0da-11d3cca8c27a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.165639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29cfec-cbd2-4c8f-b0da-11d3cca8c27a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.166200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae29cfec-cbd2-4c8f-b0da-11d3cca8c27a None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.167256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29cfec-cbd2-4c8f-b0da-11d3cca8c27a None admin] RBAC: Adding query filter params (type=compute) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:12.167682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29cfec-cbd2-4c8f-b0da-11d3cca8c27a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:12.169469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae29cfec-cbd2-4c8f-b0da-11d3cca8c27a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:12.170342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847fc8d7-4e75-4a7a-82cb-57e3bb3889e9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:12.176294 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 366/748] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:37:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:12.181892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29cfec-cbd2-4c8f-b0da-11d3cca8c27a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:12.209202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edc261-9e1e-4aad-b860-9e6d663c2aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:12.209822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edc261-9e1e-4aad-b860-9e6d663c2aee None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.210100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edc261-9e1e-4aad-b860-9e6d663c2aee None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.210373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36edc261-9e1e-4aad-b860-9e6d663c2aee None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.211006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edc261-9e1e-4aad-b860-9e6d663c2aee None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:12.211485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edc261-9e1e-4aad-b860-9e6d663c2aee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:12.213252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36edc261-9e1e-4aad-b860-9e6d663c2aee None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:12.223442 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 383/749] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:37:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:12.224511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edc261-9e1e-4aad-b860-9e6d663c2aee None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:12.298459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae29cfec-cbd2-4c8f-b0da-11d3cca8c27a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:12.334307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f7049-a124-4b22-aa35-e1c25b6e7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:12.335309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f7049-a124-4b22-aa35-e1c25b6e7171 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.335807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f7049-a124-4b22-aa35-e1c25b6e7171 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.336274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f7049-a124-4b22-aa35-e1c25b6e7171 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.337711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f7049-a124-4b22-aa35-e1c25b6e7171 None admin] RBAC: Adding query filter params (interface=public, service_id=9bd0a11839b4417d9b42c52ef463f928, region_id=RegionOne) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:12.338217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f7049-a124-4b22-aa35-e1c25b6e7171 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:12.338575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36edc261-9e1e-4aad-b860-9e6d663c2aee None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:12.340015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f7049-a124-4b22-aa35-e1c25b6e7171 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:12.346028 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 367/750] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Oct 24 08:37:12 2022] GET /identity/v3/endpoints?service_id=9bd0a11839b4417d9b42c52ef463f928&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:12.350656 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:12.351785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f7049-a124-4b22-aa35-e1c25b6e7171 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:12.380330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd5da-101c-4924-a321-c2d838d9dcfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:12.381031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd5da-101c-4924-a321-c2d838d9dcfc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.381480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd5da-101c-4924-a321-c2d838d9dcfc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.381823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32dd5da-101c-4924-a321-c2d838d9dcfc None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.382607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dd5da-101c-4924-a321-c2d838d9dcfc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:12.382975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dd5da-101c-4924-a321-c2d838d9dcfc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:12.384658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32dd5da-101c-4924-a321-c2d838d9dcfc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:12.395367 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 384/751] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:37:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:12.396489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd5da-101c-4924-a321-c2d838d9dcfc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:12.418093 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:12.463947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f7049-a124-4b22-aa35-e1c25b6e7171 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:12.499692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3adc139-a8ea-4e1d-b8b2-bab05d6fcbc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:12.500639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc139-a8ea-4e1d-b8b2-bab05d6fcbc9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.501123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc139-a8ea-4e1d-b8b2-bab05d6fcbc9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.501630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3adc139-a8ea-4e1d-b8b2-bab05d6fcbc9 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.502441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adc139-a8ea-4e1d-b8b2-bab05d6fcbc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:12.504035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3adc139-a8ea-4e1d-b8b2-bab05d6fcbc9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:12.511763 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 368/752] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Oct 24 08:37:12 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:37:12.513464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32dd5da-101c-4924-a321-c2d838d9dcfc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:12.530241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247341-f986-4b74-ad89-b1ded6671107 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.530576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247341-f986-4b74-ad89-b1ded6671107 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.530796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7247341-f986-4b74-ad89-b1ded6671107 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.532280 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 369/753] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:37:12.538405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55355-6a49-4f62-a286-a31e1eb3b7b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.540023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55355-6a49-4f62-a286-a31e1eb3b7b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.540516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c55355-6a49-4f62-a286-a31e1eb3b7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.560733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f3c55355-6a49-4f62-a286-a31e1eb3b7b9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:12.561961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f3c55355-6a49-4f62-a286-a31e1eb3b7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:12.569105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d14c-eac5-4bec-9afa-bff7327b2bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:12.570139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d14c-eac5-4bec-9afa-bff7327b2bd4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.570701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d14c-eac5-4bec-9afa-bff7327b2bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.571187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b09d14c-eac5-4bec-9afa-bff7327b2bd4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.572892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d14c-eac5-4bec-9afa-bff7327b2bd4 None admin] RBAC: Adding query filter params (interface=admin, service_id=5e0f30d3d6b049b087578548dff47e66, region_id=RegionOne) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:12.573486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d14c-eac5-4bec-9afa-bff7327b2bd4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:12.575333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b09d14c-eac5-4bec-9afa-bff7327b2bd4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:12.582566 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 385/754] 10.222.0.25 () {56 vars in 1249 bytes} [Mon Oct 24 08:37:12 2022] GET /identity/v3/endpoints?service_id=5e0f30d3d6b049b087578548dff47e66&interface=admin®ion_id=RegionOne => generated 193 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:12.588842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d14c-eac5-4bec-9afa-bff7327b2bd4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:12.632548 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:12.656094 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 370/755] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:12 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:12.718038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b09d14c-eac5-4bec-9afa-bff7327b2bd4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:12.757171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac46317-f911-4d20-b54c-fe5550bce0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:12.758115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46317-f911-4d20-b54c-fe5550bce0b2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:12.758671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46317-f911-4d20-b54c-fe5550bce0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:12.759695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac46317-f911-4d20-b54c-fe5550bce0b2 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:12.760489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac46317-f911-4d20-b54c-fe5550bce0b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:12.762134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac46317-f911-4d20-b54c-fe5550bce0b2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:12.769719 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 386/756] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Oct 24 08:37:12 2022] GET /identity/v3/services => generated 1957 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:37:12.939628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55355-6a49-4f62-a286-a31e1eb3b7b9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:12.997651 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:13.048860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c55355-6a49-4f62-a286-a31e1eb3b7b9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:13.083932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:13.084534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:13.084811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:13.085078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:13.085758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:13.087763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:13.090341 n-d-master-1 devstack@keystone.service[88311]: WARNING keystone.server.flask.common [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 24 08:37:13.103978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.sql.core [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 08:37:13.103978 n-d-master-1 devstack@keystone.service[88311]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 08:37:13.103978 n-d-master-1 devstack@keystone.service[88311]: [parameters: {'user_id': 'b8e025e6b6ca49b5814a067aa2e128d8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 08:37:13.103978 n-d-master-1 devstack@keystone.service[88311]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88311) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application result.read() Oct 24 08:37:13.121685 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:37:13.123073 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application yield resource Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise self.value Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application session.commit() Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:37:13.124022 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:37:13.124903 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:37:13.125845 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application result.read() Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:37:13.126709 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b8e025e6b6ca49b5814a067aa2e128d8', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:13.127531 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 24 08:37:13.128319 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 24 08:37:13.129243 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 24 08:37:13.129243 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 24 08:37:13.129243 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:37:13.129243 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:37:13.129243 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 24 08:37:13.129243 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:13.129243 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 371/757] 10.222.0.25 () {60 vars in 1131 bytes} [Mon Oct 24 08:37:12 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:13.133946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac46317-f911-4d20-b54c-fe5550bce0b2 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:13.237161 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:13.245376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac46317-f911-4d20-b54c-fe5550bce0b2 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:13.288743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5ac4e-c1d1-4a67-a4e0-82aa0db64161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:13.289701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5ac4e-c1d1-4a67-a4e0-82aa0db64161 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:13.290749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5ac4e-c1d1-4a67-a4e0-82aa0db64161 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:13.291202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5ac4e-c1d1-4a67-a4e0-82aa0db64161 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:13.301626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5ac4e-c1d1-4a67-a4e0-82aa0db64161 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:13.303379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5ac4e-c1d1-4a67-a4e0-82aa0db64161 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ebe5ac4e-c1d1-4a67-a4e0-82aa0db64161 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:37:13.316817 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:13.318107 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 24 08:37:13.319312 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:13.322235 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 387/758] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:37:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:13.328363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:13.437442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88de45-4590-42fc-b28c-bc7893356b1d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:13.453005 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:13.475278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be42597-1e30-4808-bffb-807521471442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:13.476237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be42597-1e30-4808-bffb-807521471442 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:13.476715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be42597-1e30-4808-bffb-807521471442 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:13.477182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be42597-1e30-4808-bffb-807521471442 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:13.478676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be42597-1e30-4808-bffb-807521471442 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:13.479178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be42597-1e30-4808-bffb-807521471442 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:13.481183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be42597-1e30-4808-bffb-807521471442 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:13.525095 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 372/759] 10.222.0.25 () {56 vars in 1101 bytes} [Mon Oct 24 08:37:13 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:14.049770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad7e4-f0b6-4ee4-ab5a-1d0da5bd6510 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:14.050112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad7e4-f0b6-4ee4-ab5a-1d0da5bd6510 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:14.050306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad7e4-f0b6-4ee4-ab5a-1d0da5bd6510 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:14.051650 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 388/760] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:14.057718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b08b-5441-4c00-af15-8f9b7086855e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:14.058151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b08b-5441-4c00-af15-8f9b7086855e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:14.058554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5234b08b-5441-4c00-af15-8f9b7086855e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:14.079240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5234b08b-5441-4c00-af15-8f9b7086855e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:14.080823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5234b08b-5441-4c00-af15-8f9b7086855e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:14.161163 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 373/761] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:14 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:14.427721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad7e4-f0b6-4ee4-ab5a-1d0da5bd6510 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:14.531600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad7e4-f0b6-4ee4-ab5a-1d0da5bd6510 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:14.567122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda60d-8f95-47dc-bcf3-58a47c65d978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:14.567760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda60d-8f95-47dc-bcf3-58a47c65d978 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:14.568040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda60d-8f95-47dc-bcf3-58a47c65d978 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:14.568312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bda60d-8f95-47dc-bcf3-58a47c65d978 None admin] PATH_INFO: `/v3/services/image` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:14.568893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bda60d-8f95-47dc-bcf3-58a47c65d978 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:14.570283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bda60d-8f95-47dc-bcf3-58a47c65d978 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-07bda60d-8f95-47dc-bcf3-58a47c65d978 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:14.579880 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:14.580860 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:37:14.582258 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:14.583351 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 389/762] 10.222.0.25 () {56 vars in 1105 bytes} [Mon Oct 24 08:37:14 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:14.586993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234b08b-5441-4c00-af15-8f9b7086855e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:14.693005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5234b08b-5441-4c00-af15-8f9b7086855e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:14.694540 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:14.735196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a34eca-04d2-4e2a-b4e0-3643234c3313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:14.735806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a34eca-04d2-4e2a-b4e0-3643234c3313 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:14.736082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a34eca-04d2-4e2a-b4e0-3643234c3313 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:14.736349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a34eca-04d2-4e2a-b4e0-3643234c3313 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:14.736972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a34eca-04d2-4e2a-b4e0-3643234c3313 None admin] RBAC: Adding query filter params (name=image) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:14.737272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a34eca-04d2-4e2a-b4e0-3643234c3313 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:14.738646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a34eca-04d2-4e2a-b4e0-3643234c3313 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:14.748580 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 374/763] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:14.750270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda60d-8f95-47dc-bcf3-58a47c65d978 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:14.777584 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:14.780920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b8b1-dec6-447b-919e-30895f49e610 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:14.781207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b8b1-dec6-447b-919e-30895f49e610 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:14.781510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d41b8b1-dec6-447b-919e-30895f49e610 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:14.783510 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 375/764] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:37:14.788666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adfcce-5868-4d69-8f2a-ea4fcff379ba None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:14.788975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adfcce-5868-4d69-8f2a-ea4fcff379ba None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:14.789249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1adfcce-5868-4d69-8f2a-ea4fcff379ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:14.807539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c1adfcce-5868-4d69-8f2a-ea4fcff379ba None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:14.808741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1adfcce-5868-4d69-8f2a-ea4fcff379ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:14.864226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bda60d-8f95-47dc-bcf3-58a47c65d978 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:14.884434 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 376/765] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:14 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:14.902012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c5eae7f-21b2-4123-8fee-0be9f3a71f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:14.902648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eae7f-21b2-4123-8fee-0be9f3a71f24 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:14.902930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eae7f-21b2-4123-8fee-0be9f3a71f24 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:14.903204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c5eae7f-21b2-4123-8fee-0be9f3a71f24 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:14.903833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eae7f-21b2-4123-8fee-0be9f3a71f24 None admin] RBAC: Adding query filter params (type=image) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:14.904137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eae7f-21b2-4123-8fee-0be9f3a71f24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:14.905543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c5eae7f-21b2-4123-8fee-0be9f3a71f24 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:14.910835 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 390/766] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:14.917263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adfcce-5868-4d69-8f2a-ea4fcff379ba None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.018969 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:15.026015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1adfcce-5868-4d69-8f2a-ea4fcff379ba None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:15.050719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cc85c-e0f6-431f-8fb4-d621ff60d731 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.051022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cc85c-e0f6-431f-8fb4-d621ff60d731 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.051277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008cc85c-e0f6-431f-8fb4-d621ff60d731 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.052869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 391/767] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:37:15.060365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eb411-8875-4c46-bdaa-77a5f71822a9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.060645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eb411-8875-4c46-bdaa-77a5f71822a9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.060910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652eb411-8875-4c46-bdaa-77a5f71822a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.070576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ff80a-a897-4cfa-a4d7-2590f0155bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:15.071195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ff80a-a897-4cfa-a4d7-2590f0155bbe None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.072015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ff80a-a897-4cfa-a4d7-2590f0155bbe None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.072288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7ff80a-a897-4cfa-a4d7-2590f0155bbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.072995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ff80a-a897-4cfa-a4d7-2590f0155bbe None admin] RBAC: Adding query filter params (interface=public, service_id=19e13870d1a6458eb7c1ec6207658834, region_id=RegionOne) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:15.073325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ff80a-a897-4cfa-a4d7-2590f0155bbe None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:15.075229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7ff80a-a897-4cfa-a4d7-2590f0155bbe None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:15.079847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-652eb411-8875-4c46-bdaa-77a5f71822a9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:15.080802 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 377/768] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Oct 24 08:37:14 2022] GET /identity/v3/endpoints?service_id=19e13870d1a6458eb7c1ec6207658834&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:15.081026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-652eb411-8875-4c46-bdaa-77a5f71822a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:15.086427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ff80a-a897-4cfa-a4d7-2590f0155bbe None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.156483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 392/769] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:15 2022] POST /identity/v3/auth/tokens => generated 1666 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:15.158363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eb411-8875-4c46-bdaa-77a5f71822a9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.177841 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:15.195439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7ff80a-a897-4cfa-a4d7-2590f0155bbe None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:15.235151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d0bd8-337d-4896-be9d-b6653ae8ea7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:15.235770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d0bd8-337d-4896-be9d-b6653ae8ea7e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.236052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d0bd8-337d-4896-be9d-b6653ae8ea7e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.236329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13d0bd8-337d-4896-be9d-b6653ae8ea7e None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.236938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d0bd8-337d-4896-be9d-b6653ae8ea7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:15.238795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13d0bd8-337d-4896-be9d-b6653ae8ea7e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:15.253492 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 378/770] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Oct 24 08:37:15 2022] GET /identity/v3/services => generated 1957 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:37:15.276355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652eb411-8875-4c46-bdaa-77a5f71822a9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:15.315748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c690e-2176-439a-b3b4-a947791bdd0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:15.316400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c690e-2176-439a-b3b4-a947791bdd0e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.316675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c690e-2176-439a-b3b4-a947791bdd0e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.316943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324c690e-2176-439a-b3b4-a947791bdd0e None admin] PATH_INFO: `/v3/services/compute` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.317559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c690e-2176-439a-b3b4-a947791bdd0e None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:15.318943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324c690e-2176-439a-b3b4-a947791bdd0e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-324c690e-2176-439a-b3b4-a947791bdd0e None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:15.328756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:15.333827 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:15.334681 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 393/771] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:37:15 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:15.336661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d0bd8-337d-4896-be9d-b6653ae8ea7e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.366977 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:15.426547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c690e-2176-439a-b3b4-a947791bdd0e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.457391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13d0bd8-337d-4896-be9d-b6653ae8ea7e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:15.496792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddb9d7-af56-464d-a6cc-af03d5e47d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:15.497431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddb9d7-af56-464d-a6cc-af03d5e47d31 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.497713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddb9d7-af56-464d-a6cc-af03d5e47d31 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.497985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ddb9d7-af56-464d-a6cc-af03d5e47d31 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.498611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddb9d7-af56-464d-a6cc-af03d5e47d31 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:15.498907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddb9d7-af56-464d-a6cc-af03d5e47d31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:15.500285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ddb9d7-af56-464d-a6cc-af03d5e47d31 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:15.505993 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 379/772] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:37:15 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:15.511794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddb9d7-af56-464d-a6cc-af03d5e47d31 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.528450 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:15.550075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324c690e-2176-439a-b3b4-a947791bdd0e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:15.588911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d45f0-14f9-47dd-94cc-0eb1e6245684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:15.589834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d45f0-14f9-47dd-94cc-0eb1e6245684 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.590247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d45f0-14f9-47dd-94cc-0eb1e6245684 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.590649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42d45f0-14f9-47dd-94cc-0eb1e6245684 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.591494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d45f0-14f9-47dd-94cc-0eb1e6245684 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:15.593551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42d45f0-14f9-47dd-94cc-0eb1e6245684 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d42d45f0-14f9-47dd-94cc-0eb1e6245684 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:15.604712 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:15.606023 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:15.606881 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 394/773] 10.222.0.25 () {56 vars in 1126 bytes} [Mon Oct 24 08:37:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:15.611871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d45f0-14f9-47dd-94cc-0eb1e6245684 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.614983 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:15.629410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ddb9d7-af56-464d-a6cc-af03d5e47d31 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:15.665347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d05b4-4d26-4465-8862-dd188ce1376d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:15.665988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d05b4-4d26-4465-8862-dd188ce1376d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.666236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d05b4-4d26-4465-8862-dd188ce1376d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.666506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d05b4-4d26-4465-8862-dd188ce1376d None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.667122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d05b4-4d26-4465-8862-dd188ce1376d None admin] RBAC: Adding query filter params (type=compute) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:15.667418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d05b4-4d26-4465-8862-dd188ce1376d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:15.668811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d05b4-4d26-4465-8862-dd188ce1376d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:15.673851 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 380/774] 10.222.0.25 () {56 vars in 1112 bytes} [Mon Oct 24 08:37:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:15.679538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d05b4-4d26-4465-8862-dd188ce1376d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.717114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42d45f0-14f9-47dd-94cc-0eb1e6245684 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:15.754096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cc621-1e6d-465e-a011-f9293bd8b576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:15.754722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cc621-1e6d-465e-a011-f9293bd8b576 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.755004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cc621-1e6d-465e-a011-f9293bd8b576 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.755282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961cc621-1e6d-465e-a011-f9293bd8b576 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.755912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cc621-1e6d-465e-a011-f9293bd8b576 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:15.756215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cc621-1e6d-465e-a011-f9293bd8b576 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:15.757632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961cc621-1e6d-465e-a011-f9293bd8b576 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:15.764757 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 395/775] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:37:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:15.771217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cc621-1e6d-465e-a011-f9293bd8b576 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.783579 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:15.795528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d05b4-4d26-4465-8862-dd188ce1376d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:15.835223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd684e6-9ae0-4403-9366-8f1933888008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:15.835867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd684e6-9ae0-4403-9366-8f1933888008 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.836144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd684e6-9ae0-4403-9366-8f1933888008 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.836413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd684e6-9ae0-4403-9366-8f1933888008 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.837642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd684e6-9ae0-4403-9366-8f1933888008 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:15.839051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd684e6-9ae0-4403-9366-8f1933888008 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:15.873331 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 381/776] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:37:15 2022] POST /identity/v3/endpoints => generated 334 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:37:15.896578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961cc621-1e6d-465e-a011-f9293bd8b576 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:15.942341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb1a7b9-7609-45b3-946c-07cfecdcd3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:15.942961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a7b9-7609-45b3-946c-07cfecdcd3eb None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:15.943236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a7b9-7609-45b3-946c-07cfecdcd3eb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:15.943505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb1a7b9-7609-45b3-946c-07cfecdcd3eb None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:15.944183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a7b9-7609-45b3-946c-07cfecdcd3eb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:15.944490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a7b9-7609-45b3-946c-07cfecdcd3eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:15.945927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb1a7b9-7609-45b3-946c-07cfecdcd3eb None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:15.952094 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 396/777] 10.222.0.25 () {56 vars in 1122 bytes} [Mon Oct 24 08:37:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:15.958055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd684e6-9ae0-4403-9366-8f1933888008 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:15.970397 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:16.071190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd684e6-9ae0-4403-9366-8f1933888008 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:16.108766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e1279-c05d-48fc-ad3b-8aef0105dd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:16.109453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e1279-c05d-48fc-ad3b-8aef0105dd04 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:16.109730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e1279-c05d-48fc-ad3b-8aef0105dd04 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:16.110004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e1279-c05d-48fc-ad3b-8aef0105dd04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:16.110683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e1279-c05d-48fc-ad3b-8aef0105dd04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:16.112034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e1279-c05d-48fc-ad3b-8aef0105dd04 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:16.133683 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 382/778] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:37:15 2022] POST /identity/v3/endpoints => generated 325 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:17.481076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838178aa-5630-4c86-8ef4-10a2d045feba None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:17.481620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838178aa-5630-4c86-8ef4-10a2d045feba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:17.481620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838178aa-5630-4c86-8ef4-10a2d045feba None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:17.485338 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 397/779] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:17.488371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bd19e-fe3b-4df3-9aae-41c01df4ace2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:17.488783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bd19e-fe3b-4df3-9aae-41c01df4ace2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:17.488958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711bd19e-fe3b-4df3-9aae-41c01df4ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:17.508018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-711bd19e-fe3b-4df3-9aae-41c01df4ace2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:17.509862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-711bd19e-fe3b-4df3-9aae-41c01df4ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:17.573901 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:17.587300 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 383/780] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:17.857578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838178aa-5630-4c86-8ef4-10a2d045feba None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:17.926525 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:17.963171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838178aa-5630-4c86-8ef4-10a2d045feba None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:17.997600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaccc76-0a11-4260-8ede-8268a654d024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:17.998241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaccc76-0a11-4260-8ede-8268a654d024 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:17.998519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaccc76-0a11-4260-8ede-8268a654d024 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:17.998794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaccc76-0a11-4260-8ede-8268a654d024 None admin] PATH_INFO: `/v3/services/image` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:17.999369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaccc76-0a11-4260-8ede-8268a654d024 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:18.000733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaccc76-0a11-4260-8ede-8268a654d024 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-dfaccc76-0a11-4260-8ede-8268a654d024 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:18.009761 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:18.010806 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 24 08:37:18.011664 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:18.013082 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 398/781] 10.222.0.25 () {56 vars in 1105 bytes} [Mon Oct 24 08:37:17 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:18.016800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bd19e-fe3b-4df3-9aae-41c01df4ace2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:18.123904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711bd19e-fe3b-4df3-9aae-41c01df4ace2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:18.161650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39291cfe-e0e7-4d75-9496-a02de99da34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:18.162257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291cfe-e0e7-4d75-9496-a02de99da34b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.162526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291cfe-e0e7-4d75-9496-a02de99da34b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.162795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39291cfe-e0e7-4d75-9496-a02de99da34b None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.163419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291cfe-e0e7-4d75-9496-a02de99da34b None admin] RBAC: Adding query filter params (name=image) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:18.163717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291cfe-e0e7-4d75-9496-a02de99da34b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:18.165625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39291cfe-e0e7-4d75-9496-a02de99da34b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:18.175629 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 384/782] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:18.176906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaccc76-0a11-4260-8ede-8268a654d024 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:18.188808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45c80-f446-48cf-8bf5-68f5c32ea1b8 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.189127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45c80-f446-48cf-8bf5-68f5c32ea1b8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.189409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae45c80-f446-48cf-8bf5-68f5c32ea1b8 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.190994 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 385/783] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:37:18.196816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadfea8-f2d2-4717-bef6-8e23f62b6961 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.197125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadfea8-f2d2-4717-bef6-8e23f62b6961 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.197406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadfea8-f2d2-4717-bef6-8e23f62b6961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.218402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2aadfea8-f2d2-4717-bef6-8e23f62b6961 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:18.219656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2aadfea8-f2d2-4717-bef6-8e23f62b6961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:18.277897 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:18.292535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 386/784] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:18.296511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaccc76-0a11-4260-8ede-8268a654d024 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:18.327193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ffbd6-5672-41a5-8cb5-20de591f1baa None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.327396 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:18.327829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ffbd6-5672-41a5-8cb5-20de591f1baa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.327973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5ffbd6-5672-41a5-8cb5-20de591f1baa None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.330209 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 387/785] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:37:18.333225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588178d4-deaa-444d-93fb-8e42554281c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:18.334291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588178d4-deaa-444d-93fb-8e42554281c6 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.334723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588178d4-deaa-444d-93fb-8e42554281c6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.335128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7cb25-df17-4740-87f7-29f75d676642 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.335262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588178d4-deaa-444d-93fb-8e42554281c6 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.335430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7cb25-df17-4740-87f7-29f75d676642 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.335686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f7cb25-df17-4740-87f7-29f75d676642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.335782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588178d4-deaa-444d-93fb-8e42554281c6 None admin] RBAC: Adding query filter params (type=image) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:18.336065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588178d4-deaa-444d-93fb-8e42554281c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:18.337464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588178d4-deaa-444d-93fb-8e42554281c6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:18.342716 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 399/786] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:18.348425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588178d4-deaa-444d-93fb-8e42554281c6 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:18.353953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-32f7cb25-df17-4740-87f7-29f75d676642 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:18.355140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-32f7cb25-df17-4740-87f7-29f75d676642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:18.425087 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 388/787] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:18.454491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588178d4-deaa-444d-93fb-8e42554281c6 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:18.491841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b764a4-272d-4911-b250-2b5ab095543a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:18.493840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b764a4-272d-4911-b250-2b5ab095543a None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.494377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b764a4-272d-4911-b250-2b5ab095543a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.494844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b764a4-272d-4911-b250-2b5ab095543a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.495696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b764a4-272d-4911-b250-2b5ab095543a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:18.497256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b764a4-272d-4911-b250-2b5ab095543a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:18.518111 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 400/788] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:37:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:18.563307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7cb25-df17-4740-87f7-29f75d676642 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:18.679751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f7cb25-df17-4740-87f7-29f75d676642 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:18.697515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b764a4-272d-4911-b250-2b5ab095543a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:18.699052 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:18.726350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699f274-b0b9-44da-b5c5-9025a6d99b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:18.726980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699f274-b0b9-44da-b5c5-9025a6d99b49 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.727260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699f274-b0b9-44da-b5c5-9025a6d99b49 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.727634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9699f274-b0b9-44da-b5c5-9025a6d99b49 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.741866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9699f274-b0b9-44da-b5c5-9025a6d99b49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-9699f274-b0b9-44da-b5c5-9025a6d99b49 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:37:18.746813 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:18.747771 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:18.748626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 389/789] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Oct 24 08:37:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:18.753917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699f274-b0b9-44da-b5c5-9025a6d99b49 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:18.766708 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:18.818344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b764a4-272d-4911-b250-2b5ab095543a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:18.854311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c003d8-3c8a-47ae-85c2-631481888f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:18.854955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c003d8-3c8a-47ae-85c2-631481888f52 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.855236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c003d8-3c8a-47ae-85c2-631481888f52 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.855512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c003d8-3c8a-47ae-85c2-631481888f52 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.856619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c003d8-3c8a-47ae-85c2-631481888f52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:18.858133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c003d8-3c8a-47ae-85c2-631481888f52 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:18.859741 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 401/790] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:18.866092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c003d8-3c8a-47ae-85c2-631481888f52 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:18.871594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9699f274-b0b9-44da-b5c5-9025a6d99b49 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:18.909708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46286-43c0-485d-9264-b86e130d0dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:18.910595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46286-43c0-485d-9264-b86e130d0dbc None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:18.910595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46286-43c0-485d-9264-b86e130d0dbc None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:18.910875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d46286-43c0-485d-9264-b86e130d0dbc None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:18.911537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d46286-43c0-485d-9264-b86e130d0dbc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:18.911837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d46286-43c0-485d-9264-b86e130d0dbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:18.913198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d46286-43c0-485d-9264-b86e130d0dbc None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:18.921771 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 390/791] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Oct 24 08:37:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:18.927712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46286-43c0-485d-9264-b86e130d0dbc None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:18.966200 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:18.989649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c003d8-3c8a-47ae-85c2-631481888f52 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:19.014120 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:19.031187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3903d4-3234-41bc-ae20-3dbf56bde62b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:19.031805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3903d4-3234-41bc-ae20-3dbf56bde62b None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:19.032080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3903d4-3234-41bc-ae20-3dbf56bde62b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:19.032351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3903d4-3234-41bc-ae20-3dbf56bde62b None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:19.033115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3903d4-3234-41bc-ae20-3dbf56bde62b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:19.034466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3903d4-3234-41bc-ae20-3dbf56bde62b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:19.040018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d46286-43c0-485d-9264-b86e130d0dbc None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:19.077327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 402/792] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:37:18 2022] POST /identity/v3/projects => generated 311 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:37:19.084220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d1cdb-c5ab-44f5-bcde-30ecce1ef595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:19.085042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d1cdb-c5ab-44f5-bcde-30ecce1ef595 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:19.085465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d1cdb-c5ab-44f5-bcde-30ecce1ef595 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:19.085842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d1cdb-c5ab-44f5-bcde-30ecce1ef595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:19.099217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d1cdb-c5ab-44f5-bcde-30ecce1ef595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:19.100878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8d1cdb-c5ab-44f5-bcde-30ecce1ef595 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-dd8d1cdb-c5ab-44f5-bcde-30ecce1ef595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:37:19.119325 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:19.120584 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:37:19.121769 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:37:19.121769 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:19.121769 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:19.122990 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 391/793] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:19.129054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3903d4-3234-41bc-ae20-3dbf56bde62b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:19.242408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3903d4-3234-41bc-ae20-3dbf56bde62b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:19.283425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdace0-bb20-4952-88a6-9d16579aa8c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:19.284042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdace0-bb20-4952-88a6-9d16579aa8c1 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:19.284321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdace0-bb20-4952-88a6-9d16579aa8c1 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:19.284594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fdace0-bb20-4952-88a6-9d16579aa8c1 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:19.285236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdace0-bb20-4952-88a6-9d16579aa8c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:19.285591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdace0-bb20-4952-88a6-9d16579aa8c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:19.286998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fdace0-bb20-4952-88a6-9d16579aa8c1 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:19.299507 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 403/794] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:19.305221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d1cdb-c5ab-44f5-bcde-30ecce1ef595 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:19.395075 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:19.408711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d1cdb-c5ab-44f5-bcde-30ecce1ef595 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:19.443570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb4354-e769-4ab4-9ea8-5e3ed9010f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:19.444226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb4354-e769-4ab4-9ea8-5e3ed9010f06 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:19.444503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb4354-e769-4ab4-9ea8-5e3ed9010f06 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:19.444774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bb4354-e769-4ab4-9ea8-5e3ed9010f06 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:19.454050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb4354-e769-4ab4-9ea8-5e3ed9010f06 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:19.455526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bb4354-e769-4ab4-9ea8-5e3ed9010f06 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e5bb4354-e769-4ab4-9ea8-5e3ed9010f06 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:37:19.467306 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:19.468340 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:19.469269 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 392/795] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Oct 24 08:37:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:19.474346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdace0-bb20-4952-88a6-9d16579aa8c1 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:19.510272 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:19.582179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fdace0-bb20-4952-88a6-9d16579aa8c1 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:19.618854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e85df4-e969-4346-a8b6-b2d05fa0c89b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:19.619814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e85df4-e969-4346-a8b6-b2d05fa0c89b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:19.620290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e85df4-e969-4346-a8b6-b2d05fa0c89b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:19.620784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e85df4-e969-4346-a8b6-b2d05fa0c89b None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:19.621754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e85df4-e969-4346-a8b6-b2d05fa0c89b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:19.622269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e85df4-e969-4346-a8b6-b2d05fa0c89b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:19.623911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e85df4-e969-4346-a8b6-b2d05fa0c89b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:19.642065 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 404/796] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Oct 24 08:37:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:19.647702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb4354-e769-4ab4-9ea8-5e3ed9010f06 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:19.759281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bb4354-e769-4ab4-9ea8-5e3ed9010f06 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:19.794569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39bc14-cbed-40a6-93e2-92a387d197c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:19.795121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39bc14-cbed-40a6-93e2-92a387d197c8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:19.795402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39bc14-cbed-40a6-93e2-92a387d197c8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:19.795677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39bc14-cbed-40a6-93e2-92a387d197c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:19.807286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39bc14-cbed-40a6-93e2-92a387d197c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:19.808752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb39bc14-cbed-40a6-93e2-92a387d197c8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:19.817513 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-eb39bc14-cbed-40a6-93e2-92a387d197c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:37:19.825363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:19.826329 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:37:19.827216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:37:19.827216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:19.827216 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:19.829834 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 393/797] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:19.832945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e85df4-e969-4346-a8b6-b2d05fa0c89b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:19.951956 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:19.966659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e85df4-e969-4346-a8b6-b2d05fa0c89b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:20.003932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946993a6-ff47-4028-b478-01077fa3dd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:20.004632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946993a6-ff47-4028-b478-01077fa3dd74 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:20.005007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946993a6-ff47-4028-b478-01077fa3dd74 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:20.005276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946993a6-ff47-4028-b478-01077fa3dd74 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:20.006076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946993a6-ff47-4028-b478-01077fa3dd74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:20.006539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946993a6-ff47-4028-b478-01077fa3dd74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:20.008654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946993a6-ff47-4028-b478-01077fa3dd74 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:20.023934 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 405/798] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:20.029876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39bc14-cbed-40a6-93e2-92a387d197c8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:20.144664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39bc14-cbed-40a6-93e2-92a387d197c8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:20.177818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798396e-6f6a-488f-9580-9933988c743d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:20.178453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798396e-6f6a-488f-9580-9933988c743d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:20.178729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798396e-6f6a-488f-9580-9933988c743d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:20.178999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798396e-6f6a-488f-9580-9933988c743d None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:20.185769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798396e-6f6a-488f-9580-9933988c743d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:20.187453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798396e-6f6a-488f-9580-9933988c743d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-d798396e-6f6a-488f-9580-9933988c743d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:37:20.199407 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:20.200326 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:20.201223 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:37:20.201223 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:37:20.201223 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:37:20.201223 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:37:20.201223 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:37:20.201223 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:37:20.201223 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:37:20.201223 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:20.205357 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 394/799] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:37:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:20.206537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946993a6-ff47-4028-b478-01077fa3dd74 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:20.308204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946993a6-ff47-4028-b478-01077fa3dd74 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:20.342623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b09e8-af76-4695-841d-57f81cafc46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:20.343230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b09e8-af76-4695-841d-57f81cafc46a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:20.343509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b09e8-af76-4695-841d-57f81cafc46a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:20.343782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b09e8-af76-4695-841d-57f81cafc46a None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:20.344473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b09e8-af76-4695-841d-57f81cafc46a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:20.344780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b09e8-af76-4695-841d-57f81cafc46a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:20.346244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b09e8-af76-4695-841d-57f81cafc46a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:20.358917 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 406/800] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:37:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:20.364694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798396e-6f6a-488f-9580-9933988c743d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:20.434720 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:20.482787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798396e-6f6a-488f-9580-9933988c743d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:20.519632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa657d-dadc-4649-9253-6f03cb2d2271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:20.520316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa657d-dadc-4649-9253-6f03cb2d2271 None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:20.520595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa657d-dadc-4649-9253-6f03cb2d2271 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:20.520872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa657d-dadc-4649-9253-6f03cb2d2271 None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/b31aac6142684a039f9de2051fe42989/roles/a06c81aa06f243bc943fa4744c344458` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:20.523160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa657d-dadc-4649-9253-6f03cb2d2271 None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=b31aac6142684a039f9de2051fe42989, role_id=a06c81aa06f243bc943fa4744c344458)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:20.525159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa657d-dadc-4649-9253-6f03cb2d2271 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:20.541343 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 395/801] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:37:20 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/b31aac6142684a039f9de2051fe42989/roles/a06c81aa06f243bc943fa4744c344458 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:37:20.754825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b0d51-70c5-452b-86be-1ec788aa7b06 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:20.755306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b0d51-70c5-452b-86be-1ec788aa7b06 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:20.755306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6b0d51-70c5-452b-86be-1ec788aa7b06 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:20.756794 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 407/802] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:20.762599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483dbb-d89c-413f-b42b-1016e9c0277a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:20.763026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483dbb-d89c-413f-b42b-1016e9c0277a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:20.763233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78483dbb-d89c-413f-b42b-1016e9c0277a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:20.782149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-78483dbb-d89c-413f-b42b-1016e9c0277a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:20.783344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-78483dbb-d89c-413f-b42b-1016e9c0277a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:20.854451 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 396/803] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:21.123136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b0d51-70c5-452b-86be-1ec788aa7b06 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:21.135620 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:21.241920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6b0d51-70c5-452b-86be-1ec788aa7b06 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:21.277473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:21.278390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:21.278822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:21.279268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:21.280115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:21.281675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:21.291141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:37:21.291141 n-d-master-1 devstack@keystone.service[88312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:37:21.291141 n-d-master-1 devstack@keystone.service[88312]: [parameters: {'id': '133afe38c78546aeaa0e2a043196f5c7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 08:37:21.291141 n-d-master-1 devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:37:21.299363 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 08:37:21.300379 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 08:37:21.301615 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 08:37:21.302788 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 08:37:21.303983 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 08:37:21.305033 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'id': '133afe38c78546aeaa0e2a043196f5c7', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 08:37:21.306255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:21.307255 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 24 08:37:21.308427 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:21.310997 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 408/804] 10.222.0.25 () {60 vars in 1137 bytes} [Mon Oct 24 08:37:21 2022] POST /identity/v3/domains => generated 190 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:21.316552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24f89-92ff-4d34-a47d-70e4290c6f54 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:21.316841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24f89-92ff-4d34-a47d-70e4290c6f54 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:21.317119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c24f89-92ff-4d34-a47d-70e4290c6f54 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:21.318278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:21.318711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 397/805] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:21.325371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2325a67-8793-4bfe-b3f3-ff2132035114 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:21.325598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2325a67-8793-4bfe-b3f3-ff2132035114 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:21.325861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2325a67-8793-4bfe-b3f3-ff2132035114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:21.345613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f2325a67-8793-4bfe-b3f3-ff2132035114 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:21.346789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f2325a67-8793-4bfe-b3f3-ff2132035114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:21.398854 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:21.405439 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:21.423945 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 398/806] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:21.438596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171a1468-3463-45cb-bdb7-d26efde32e38 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:21.475734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda04f5-78ea-4f84-8244-e4cb5196112f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:21.476374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda04f5-78ea-4f84-8244-e4cb5196112f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:21.476656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda04f5-78ea-4f84-8244-e4cb5196112f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:21.476931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda04f5-78ea-4f84-8244-e4cb5196112f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:21.487225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda04f5-78ea-4f84-8244-e4cb5196112f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:21.488674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda04f5-78ea-4f84-8244-e4cb5196112f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-2eda04f5-78ea-4f84-8244-e4cb5196112f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:37:21.505245 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:21.506232 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:37:21.507121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:37:21.507121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:21.507121 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:21.507121 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 409/807] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:21.512499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2325a67-8793-4bfe-b3f3-ff2132035114 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:21.617075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2325a67-8793-4bfe-b3f3-ff2132035114 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:21.653473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021857b1-3f5c-4d86-8972-9c9b83c892fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:21.653998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021857b1-3f5c-4d86-8972-9c9b83c892fa None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:21.654275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021857b1-3f5c-4d86-8972-9c9b83c892fa None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:21.654546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021857b1-3f5c-4d86-8972-9c9b83c892fa None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:21.655186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021857b1-3f5c-4d86-8972-9c9b83c892fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:21.655487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021857b1-3f5c-4d86-8972-9c9b83c892fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:21.656848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021857b1-3f5c-4d86-8972-9c9b83c892fa None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:21.677342 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 399/808] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:21.699098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda04f5-78ea-4f84-8244-e4cb5196112f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:21.810917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda04f5-78ea-4f84-8244-e4cb5196112f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:21.838516 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:21.849021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671ed2b1-6874-4044-af49-eb6c71b56985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:21.849766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ed2b1-6874-4044-af49-eb6c71b56985 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:21.850876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ed2b1-6874-4044-af49-eb6c71b56985 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:21.850876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671ed2b1-6874-4044-af49-eb6c71b56985 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:21.851548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ed2b1-6874-4044-af49-eb6c71b56985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:21.853597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671ed2b1-6874-4044-af49-eb6c71b56985 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:21.855390 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 410/809] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:21.860908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021857b1-3f5c-4d86-8972-9c9b83c892fa None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:21.904350 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:21.971575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021857b1-3f5c-4d86-8972-9c9b83c892fa None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:22.006992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902ba79-fbe2-4e1e-a2ab-5552687ed8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:22.007595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902ba79-fbe2-4e1e-a2ab-5552687ed8bf None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:22.007883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902ba79-fbe2-4e1e-a2ab-5552687ed8bf None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:22.008162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902ba79-fbe2-4e1e-a2ab-5552687ed8bf None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:22.008859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902ba79-fbe2-4e1e-a2ab-5552687ed8bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:22.010391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902ba79-fbe2-4e1e-a2ab-5552687ed8bf None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:22.031513 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 400/810] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:37:21 2022] POST /identity/v3/users => generated 285 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:22.720374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff1f50-e66d-4360-aa2e-e73f57bde7b7 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:22.720658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff1f50-e66d-4360-aa2e-e73f57bde7b7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:22.720932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff1f50-e66d-4360-aa2e-e73f57bde7b7 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:22.722355 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 411/811] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:22.727746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86320313-70c4-4291-b639-5c3016ec161b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:22.728115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86320313-70c4-4291-b639-5c3016ec161b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:22.728457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86320313-70c4-4291-b639-5c3016ec161b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:22.747962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-86320313-70c4-4291-b639-5c3016ec161b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:22.749183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-86320313-70c4-4291-b639-5c3016ec161b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:22.816470 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 401/812] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:23.083885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff1f50-e66d-4360-aa2e-e73f57bde7b7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:23.187276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff1f50-e66d-4360-aa2e-e73f57bde7b7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:23.220063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32a225-2b57-44ed-adba-b878c477b7ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:23.220681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32a225-2b57-44ed-adba-b878c477b7ee None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:23.220952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32a225-2b57-44ed-adba-b878c477b7ee None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:23.221219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac32a225-2b57-44ed-adba-b878c477b7ee None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:23.232042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac32a225-2b57-44ed-adba-b878c477b7ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ac32a225-2b57-44ed-adba-b878c477b7ee None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:37:23.236713 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:23.237847 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:23.238700 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 412/813] 10.222.0.25 () {56 vars in 1120 bytes} [Mon Oct 24 08:37:23 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:23.244174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86320313-70c4-4291-b639-5c3016ec161b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:23.271316 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:23.346104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86320313-70c4-4291-b639-5c3016ec161b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:23.379536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d553ba-0a1f-4d36-8964-5bfbdc3565b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:23.380139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d553ba-0a1f-4d36-8964-5bfbdc3565b3 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:23.380419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d553ba-0a1f-4d36-8964-5bfbdc3565b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:23.380690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d553ba-0a1f-4d36-8964-5bfbdc3565b3 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:23.381375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d553ba-0a1f-4d36-8964-5bfbdc3565b3 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:23.381677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d553ba-0a1f-4d36-8964-5bfbdc3565b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:23.383036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d553ba-0a1f-4d36-8964-5bfbdc3565b3 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:23.391626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 402/814] 10.222.0.25 () {56 vars in 1115 bytes} [Mon Oct 24 08:37:23 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:23.397286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32a225-2b57-44ed-adba-b878c477b7ee None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:23.451989 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:23.497144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac32a225-2b57-44ed-adba-b878c477b7ee None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:23.531776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1270e55-ea24-4a09-964f-dec7b7aec591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:23.532898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1270e55-ea24-4a09-964f-dec7b7aec591 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:23.533420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1270e55-ea24-4a09-964f-dec7b7aec591 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:23.533707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1270e55-ea24-4a09-964f-dec7b7aec591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:23.544530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1270e55-ea24-4a09-964f-dec7b7aec591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:23.546010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1270e55-ea24-4a09-964f-dec7b7aec591 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-f1270e55-ea24-4a09-964f-dec7b7aec591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:37:23.560282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:23.561272 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:37:23.562207 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:37:23.562207 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:23.562207 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:23.562207 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 413/815] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:23.567126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d553ba-0a1f-4d36-8964-5bfbdc3565b3 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:23.658931 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:23.671359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d553ba-0a1f-4d36-8964-5bfbdc3565b3 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:23.705822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717ed68-91ea-4d8c-add9-b2a94d2e5b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:23.706432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717ed68-91ea-4d8c-add9-b2a94d2e5b13 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:23.707311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717ed68-91ea-4d8c-add9-b2a94d2e5b13 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:23.707311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717ed68-91ea-4d8c-add9-b2a94d2e5b13 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:23.707613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717ed68-91ea-4d8c-add9-b2a94d2e5b13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:23.707914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717ed68-91ea-4d8c-add9-b2a94d2e5b13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:23.709282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717ed68-91ea-4d8c-add9-b2a94d2e5b13 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:23.721774 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 403/816] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:23.727668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1270e55-ea24-4a09-964f-dec7b7aec591 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:23.834310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1270e55-ea24-4a09-964f-dec7b7aec591 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:23.841373 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:23.869962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee119-65f1-4d25-9eb8-2550579e96ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:23.870605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee119-65f1-4d25-9eb8-2550579e96ae None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:23.870884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee119-65f1-4d25-9eb8-2550579e96ae None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:23.871156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3ee119-65f1-4d25-9eb8-2550579e96ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:23.879029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee119-65f1-4d25-9eb8-2550579e96ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:23.880456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3ee119-65f1-4d25-9eb8-2550579e96ae None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4c3ee119-65f1-4d25-9eb8-2550579e96ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:37:23.891367 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:23.892333 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:23.893267 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 414/817] 10.222.0.25 () {56 vars in 1093 bytes} [Mon Oct 24 08:37:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:23.898249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717ed68-91ea-4d8c-add9-b2a94d2e5b13 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:24.001464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717ed68-91ea-4d8c-add9-b2a94d2e5b13 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:24.038561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e412556-bf82-4731-87e4-a0f3ba5123ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:24.039168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412556-bf82-4731-87e4-a0f3ba5123ad None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:24.039445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412556-bf82-4731-87e4-a0f3ba5123ad None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:24.039712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e412556-bf82-4731-87e4-a0f3ba5123ad None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:24.040980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e412556-bf82-4731-87e4-a0f3ba5123ad None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:24.041278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e412556-bf82-4731-87e4-a0f3ba5123ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:24.042733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e412556-bf82-4731-87e4-a0f3ba5123ad None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:24.062906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 404/818] 10.222.0.25 () {56 vars in 1133 bytes} [Mon Oct 24 08:37:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:24.068836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee119-65f1-4d25-9eb8-2550579e96ae None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:24.229844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006ead-a32a-448c-83ae-c1aedc990eda None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:24.230126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006ead-a32a-448c-83ae-c1aedc990eda None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:24.230404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b006ead-a32a-448c-83ae-c1aedc990eda None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:24.231813 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 405/819] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:37:24.237809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d821-d589-4c6c-937d-829323e3fc69 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:24.238094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d821-d589-4c6c-937d-829323e3fc69 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:24.238371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d1d821-d589-4c6c-937d-829323e3fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:24.253336 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:24.260694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f4d1d821-d589-4c6c-937d-829323e3fc69 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:24.262158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f4d1d821-d589-4c6c-937d-829323e3fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:24.297919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3ee119-65f1-4d25-9eb8-2550579e96ae None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:24.331190 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 406/820] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:24.332125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9ff7-74eb-4a8b-9821-a3272f5c0567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:24.332722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9ff7-74eb-4a8b-9821-a3272f5c0567 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:24.332995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9ff7-74eb-4a8b-9821-a3272f5c0567 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:24.333260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a9ff7-74eb-4a8b-9821-a3272f5c0567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:24.366390 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:24.398675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9ff7-74eb-4a8b-9821-a3272f5c0567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:24.400614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a9ff7-74eb-4a8b-9821-a3272f5c0567 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:24.493402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 415/821] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:37:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:37:24.499034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d821-d589-4c6c-937d-829323e3fc69 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:24.595477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d1d821-d589-4c6c-937d-829323e3fc69 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:24.601289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9ff7-74eb-4a8b-9821-a3272f5c0567 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:24.630913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b5d0-ef7a-4770-b637-e81fb11ba3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:24.631558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b5d0-ef7a-4770-b637-e81fb11ba3a7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:24.631833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b5d0-ef7a-4770-b637-e81fb11ba3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:24.632103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6441b5d0-ef7a-4770-b637-e81fb11ba3a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:24.636623 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:24.645183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b5d0-ef7a-4770-b637-e81fb11ba3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:24.646680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6441b5d0-ef7a-4770-b637-e81fb11ba3a7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-6441b5d0-ef7a-4770-b637-e81fb11ba3a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:37:24.661447 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:24.662563 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:37:24.663681 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:37:24.663681 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:37:24.663681 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:24.665784 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 407/822] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:24.668655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b5d0-ef7a-4770-b637-e81fb11ba3a7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:24.670359 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:24.705229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a9ff7-74eb-4a8b-9821-a3272f5c0567 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:24.740008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf800ab3-0a69-424a-b1b6-873f33c2cea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:24.740633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf800ab3-0a69-424a-b1b6-873f33c2cea8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:24.741166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf800ab3-0a69-424a-b1b6-873f33c2cea8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:24.741468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf800ab3-0a69-424a-b1b6-873f33c2cea8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:24.752258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf800ab3-0a69-424a-b1b6-873f33c2cea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-cf800ab3-0a69-424a-b1b6-873f33c2cea8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:37:24.757138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:24.758126 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:24.759017 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 416/823] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:37:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:37:24.764734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf800ab3-0a69-424a-b1b6-873f33c2cea8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:24.771908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6441b5d0-ef7a-4770-b637-e81fb11ba3a7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:24.805020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104dcde-df43-4641-8a15-4bc5bde93163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:24.805708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104dcde-df43-4641-8a15-4bc5bde93163 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:24.806486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104dcde-df43-4641-8a15-4bc5bde93163 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:24.806752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7104dcde-df43-4641-8a15-4bc5bde93163 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:24.807378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104dcde-df43-4641-8a15-4bc5bde93163 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:24.807682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104dcde-df43-4641-8a15-4bc5bde93163 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:24.809054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7104dcde-df43-4641-8a15-4bc5bde93163 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:24.820739 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 408/824] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:37:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:24.826472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104dcde-df43-4641-8a15-4bc5bde93163 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:24.864130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf800ab3-0a69-424a-b1b6-873f33c2cea8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:24.874906 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:24.890243 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:24.899421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937f52-d0b6-4985-b625-daf1d6b9f233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:24.900530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937f52-d0b6-4985-b625-daf1d6b9f233 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:24.900810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937f52-d0b6-4985-b625-daf1d6b9f233 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:24.901081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a937f52-d0b6-4985-b625-daf1d6b9f233 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:24.901772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937f52-d0b6-4985-b625-daf1d6b9f233 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:24.902076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937f52-d0b6-4985-b625-daf1d6b9f233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:24.903460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a937f52-d0b6-4985-b625-daf1d6b9f233 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:24.911702 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 417/825] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:37:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:24.917495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937f52-d0b6-4985-b625-daf1d6b9f233 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:24.931070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7104dcde-df43-4641-8a15-4bc5bde93163 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:24.964959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747fcb-733d-403f-82ad-d259079bdf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:24.965631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747fcb-733d-403f-82ad-d259079bdf9c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:24.965896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747fcb-733d-403f-82ad-d259079bdf9c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:24.966164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34747fcb-733d-403f-82ad-d259079bdf9c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:24.973064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34747fcb-733d-403f-82ad-d259079bdf9c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:24.974594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34747fcb-733d-403f-82ad-d259079bdf9c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-34747fcb-733d-403f-82ad-d259079bdf9c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:37:24.986764 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:24.987787 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:24.988736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:37:24.988736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:37:24.988736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:37:24.988736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:37:24.988736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:37:24.988736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:37:24.988736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:37:24.988736 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:24.988736 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 409/826] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:37:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:24.994752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747fcb-733d-403f-82ad-d259079bdf9c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:25.018564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a937f52-d0b6-4985-b625-daf1d6b9f233 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:25.058664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c12d33-4de0-411f-aa1c-76d31d07d44a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:25.059316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12d33-4de0-411f-aa1c-76d31d07d44a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:25.059598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12d33-4de0-411f-aa1c-76d31d07d44a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:25.059869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12d33-4de0-411f-aa1c-76d31d07d44a None admin] PATH_INFO: `/v3/users/5083d4a9d1bb4a1eae7c2b6ecff4b582` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:25.074459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c12d33-4de0-411f-aa1c-76d31d07d44a None admin] RBAC: Authorizing `identity:get_user(user_id=5083d4a9d1bb4a1eae7c2b6ecff4b582)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:25.075927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c12d33-4de0-411f-aa1c-76d31d07d44a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:25.077687 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 418/827] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:24 2022] GET /identity/v3/users/5083d4a9d1bb4a1eae7c2b6ecff4b582 => generated 285 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:25.083745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c12d33-4de0-411f-aa1c-76d31d07d44a None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:25.099359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34747fcb-733d-403f-82ad-d259079bdf9c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:25.108944 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:25.132942 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:25.136182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7b39c-1f79-401f-84df-a2b3a708548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:25.136792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7b39c-1f79-401f-84df-a2b3a708548a None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:25.137068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7b39c-1f79-401f-84df-a2b3a708548a None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:25.137368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab7b39c-1f79-401f-84df-a2b3a708548a None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:25.138057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7b39c-1f79-401f-84df-a2b3a708548a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:25.138359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7b39c-1f79-401f-84df-a2b3a708548a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:25.139785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab7b39c-1f79-401f-84df-a2b3a708548a None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:25.155195 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 410/828] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:37:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:25.161379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7b39c-1f79-401f-84df-a2b3a708548a None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:25.188095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c12d33-4de0-411f-aa1c-76d31d07d44a None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:25.221284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1414c-bfc6-4366-b4fa-16cb81b6bfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:25.221935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1414c-bfc6-4366-b4fa-16cb81b6bfa9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:25.222212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1414c-bfc6-4366-b4fa-16cb81b6bfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:25.222484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb1414c-bfc6-4366-b4fa-16cb81b6bfa9 None admin] PATH_INFO: `/v3/projects/0d40d4382936426ba6df08f1ee29dc18` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:25.223614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1414c-bfc6-4366-b4fa-16cb81b6bfa9 None admin] RBAC: Authorizing `identity:get_project(project_id=0d40d4382936426ba6df08f1ee29dc18)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:25.225041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb1414c-bfc6-4366-b4fa-16cb81b6bfa9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:25.226697 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 419/829] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:37:25 2022] GET /identity/v3/projects/0d40d4382936426ba6df08f1ee29dc18 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:25.233211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1414c-bfc6-4366-b4fa-16cb81b6bfa9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:25.262051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab7b39c-1f79-401f-84df-a2b3a708548a None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:25.297374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0dd2b8-eba9-4982-ab3c-4a8f29b70763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:25.297974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd2b8-eba9-4982-ab3c-4a8f29b70763 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:25.298340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd2b8-eba9-4982-ab3c-4a8f29b70763 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:25.298512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0dd2b8-eba9-4982-ab3c-4a8f29b70763 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:25.299228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dd2b8-eba9-4982-ab3c-4a8f29b70763 None admin] RBAC: Adding query filter params (role.id=a06c81aa06f243bc943fa4744c344458, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=b31aac6142684a039f9de2051fe42989) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:25.299529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dd2b8-eba9-4982-ab3c-4a8f29b70763 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:25.300940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0dd2b8-eba9-4982-ab3c-4a8f29b70763 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:25.306593 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 411/830] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:37:25 2022] GET /identity/v3/role_assignments?user.id=b31aac6142684a039f9de2051fe42989&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=a06c81aa06f243bc943fa4744c344458 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:25.333909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb1414c-bfc6-4366-b4fa-16cb81b6bfa9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:25.350025 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:25.373205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60d1e40-4d45-4edc-929b-306c1c641975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:25.373927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d1e40-4d45-4edc-929b-306c1c641975 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:25.374205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d1e40-4d45-4edc-929b-306c1c641975 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:25.374480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60d1e40-4d45-4edc-929b-306c1c641975 None admin] PATH_INFO: `/v3/projects/0d40d4382936426ba6df08f1ee29dc18/users/5083d4a9d1bb4a1eae7c2b6ecff4b582/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:25.376445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d1e40-4d45-4edc-929b-306c1c641975 None admin] RBAC: Authorizing `identity:create_grant(project_id=0d40d4382936426ba6df08f1ee29dc18, user_id=5083d4a9d1bb4a1eae7c2b6ecff4b582, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:25.377923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60d1e40-4d45-4edc-929b-306c1c641975 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:25.394258 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 420/831] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:37:25 2022] PUT /identity/v3/projects/0d40d4382936426ba6df08f1ee29dc18/users/5083d4a9d1bb4a1eae7c2b6ecff4b582/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:37:27.548423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676d8c-e1bb-4ff9-af37-7c5c46a87364 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:27.548922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676d8c-e1bb-4ff9-af37-7c5c46a87364 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:27.548922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d676d8c-e1bb-4ff9-af37-7c5c46a87364 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:27.550227 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 412/832] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:27.555331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325dc65-0128-44d2-a643-b5b1dcf5e7cc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:27.555760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325dc65-0128-44d2-a643-b5b1dcf5e7cc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:27.555896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325dc65-0128-44d2-a643-b5b1dcf5e7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:27.574822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4325dc65-0128-44d2-a643-b5b1dcf5e7cc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:27.576022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4325dc65-0128-44d2-a643-b5b1dcf5e7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:27.642444 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 421/833] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:27.915860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676d8c-e1bb-4ff9-af37-7c5c46a87364 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:27.947421 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:28.021900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d676d8c-e1bb-4ff9-af37-7c5c46a87364 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:28.058295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f02bf-5b64-44d2-87e2-10ce4b70ac11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:28.058924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f02bf-5b64-44d2-87e2-10ce4b70ac11 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:28.059203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f02bf-5b64-44d2-87e2-10ce4b70ac11 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:28.059473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f02bf-5b64-44d2-87e2-10ce4b70ac11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:28.071177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f02bf-5b64-44d2-87e2-10ce4b70ac11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-8d2f02bf-5b64-44d2-87e2-10ce4b70ac11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:37:28.076726 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:28.077940 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:28.078923 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 413/834] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:37:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:28.084488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325dc65-0128-44d2-a643-b5b1dcf5e7cc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:28.187253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325dc65-0128-44d2-a643-b5b1dcf5e7cc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:28.189622 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:28.222561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a5b10-bda1-4360-a254-1201ad75a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:28.223176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a5b10-bda1-4360-a254-1201ad75a62e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:28.223454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a5b10-bda1-4360-a254-1201ad75a62e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:28.223724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a5b10-bda1-4360-a254-1201ad75a62e None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:28.224386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a5b10-bda1-4360-a254-1201ad75a62e None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:28.224687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a5b10-bda1-4360-a254-1201ad75a62e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:28.226095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5a5b10-bda1-4360-a254-1201ad75a62e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:28.235191 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 422/835] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:37:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:28.243689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f02bf-5b64-44d2-87e2-10ce4b70ac11 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:28.334379 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:28.343564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f02bf-5b64-44d2-87e2-10ce4b70ac11 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:28.377239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ca4e4-439c-4399-bb14-7f4eca3a2dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:28.377881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ca4e4-439c-4399-bb14-7f4eca3a2dbb None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:28.378155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ca4e4-439c-4399-bb14-7f4eca3a2dbb None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:28.378425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ca4e4-439c-4399-bb14-7f4eca3a2dbb None admin] PATH_INFO: `/v3/users/5083d4a9d1bb4a1eae7c2b6ecff4b582` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:28.379529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ca4e4-439c-4399-bb14-7f4eca3a2dbb None admin] RBAC: Authorizing `identity:get_user(user_id=5083d4a9d1bb4a1eae7c2b6ecff4b582)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:28.380943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ca4e4-439c-4399-bb14-7f4eca3a2dbb None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:28.382532 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 414/836] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:28 2022] GET /identity/v3/users/5083d4a9d1bb4a1eae7c2b6ecff4b582 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:28.388463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a5b10-bda1-4360-a254-1201ad75a62e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:28.484710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a5b10-bda1-4360-a254-1201ad75a62e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:28.517382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1b8f-6471-4cd1-9e52-9d1968c577fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:28.517983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1b8f-6471-4cd1-9e52-9d1968c577fe None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:28.518262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1b8f-6471-4cd1-9e52-9d1968c577fe None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:28.518533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7a1b8f-6471-4cd1-9e52-9d1968c577fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:28.551118 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:28.584230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1b8f-6471-4cd1-9e52-9d1968c577fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:28.585700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7a1b8f-6471-4cd1-9e52-9d1968c577fe None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:28.682523 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 423/837] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:37:28 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:37:28.688433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ca4e4-439c-4399-bb14-7f4eca3a2dbb None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:28.786058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ca4e4-439c-4399-bb14-7f4eca3a2dbb None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:28.819145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50445b94-502b-41b7-8c5d-831f452ef406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:28.819760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50445b94-502b-41b7-8c5d-831f452ef406 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:28.820032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50445b94-502b-41b7-8c5d-831f452ef406 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:28.820298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50445b94-502b-41b7-8c5d-831f452ef406 None admin] PATH_INFO: `/v3/projects/0d40d4382936426ba6df08f1ee29dc18` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:28.821956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50445b94-502b-41b7-8c5d-831f452ef406 None admin] RBAC: Authorizing `identity:get_project(project_id=0d40d4382936426ba6df08f1ee29dc18)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:28.823383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50445b94-502b-41b7-8c5d-831f452ef406 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:28.824981 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 415/838] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:37:28 2022] GET /identity/v3/projects/0d40d4382936426ba6df08f1ee29dc18 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:28.831172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1b8f-6471-4cd1-9e52-9d1968c577fe None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:28.894621 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:28.929489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7a1b8f-6471-4cd1-9e52-9d1968c577fe None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:28.964929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154e023-0d51-481f-a4f7-a5bc841329f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:28.965557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e023-0d51-481f-a4f7-a5bc841329f2 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:28.965837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e023-0d51-481f-a4f7-a5bc841329f2 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:28.966107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154e023-0d51-481f-a4f7-a5bc841329f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:28.966817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154e023-0d51-481f-a4f7-a5bc841329f2 None admin] RBAC: Adding query filter params (role.id=d266f03406d94df8bb9cad19b577978f, scope.project.id=0d40d4382936426ba6df08f1ee29dc18, user.id=5083d4a9d1bb4a1eae7c2b6ecff4b582) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:28.967122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154e023-0d51-481f-a4f7-a5bc841329f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:28.968533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7154e023-0d51-481f-a4f7-a5bc841329f2 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:28.974274 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 424/839] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:37:28 2022] GET /identity/v3/role_assignments?user.id=5083d4a9d1bb4a1eae7c2b6ecff4b582&scope.project.id=0d40d4382936426ba6df08f1ee29dc18&role.id=d266f03406d94df8bb9cad19b577978f => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:31.129325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dfc61-c66f-4f3a-8fc6-637001421ce2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:31.129875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dfc61-c66f-4f3a-8fc6-637001421ce2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:31.129968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74dfc61-c66f-4f3a-8fc6-637001421ce2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:31.131274 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 416/840] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:31.136505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba0e9-7ddb-444f-83d9-b191b8f2edd4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:31.136909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba0e9-7ddb-444f-83d9-b191b8f2edd4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:31.137060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527ba0e9-7ddb-444f-83d9-b191b8f2edd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:31.155494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-527ba0e9-7ddb-444f-83d9-b191b8f2edd4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:31.156689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-527ba0e9-7ddb-444f-83d9-b191b8f2edd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:31.221957 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 425/841] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:31.495448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dfc61-c66f-4f3a-8fc6-637001421ce2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:31.523288 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:31.599781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74dfc61-c66f-4f3a-8fc6-637001421ce2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:31.632721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b63439-e36a-4e56-b9c1-98b24a04361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:31.633373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b63439-e36a-4e56-b9c1-98b24a04361b None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:31.634164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b63439-e36a-4e56-b9c1-98b24a04361b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:31.634433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b63439-e36a-4e56-b9c1-98b24a04361b None admin] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:31.635517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b63439-e36a-4e56-b9c1-98b24a04361b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:31.636930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b63439-e36a-4e56-b9c1-98b24a04361b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:31.638522 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 417/842] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:31.644380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba0e9-7ddb-444f-83d9-b191b8f2edd4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:31.701927 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:31.741671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527ba0e9-7ddb-444f-83d9-b191b8f2edd4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:31.775859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dee1da-120f-4c6f-be8b-1600902f8a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:31.776382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee1da-120f-4c6f-be8b-1600902f8a3e None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:31.776663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee1da-120f-4c6f-be8b-1600902f8a3e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:31.776938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee1da-120f-4c6f-be8b-1600902f8a3e None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:31.777609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dee1da-120f-4c6f-be8b-1600902f8a3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:31.779036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dee1da-120f-4c6f-be8b-1600902f8a3e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:31.800350 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 426/843] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:37:31 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:33.990431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e34c4e-2a92-4033-b685-4a77227e7305 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:33.991274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e34c4e-2a92-4033-b685-4a77227e7305 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:33.991274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e34c4e-2a92-4033-b685-4a77227e7305 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:33.992551 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 418/844] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:33.998365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a8c5-73e6-4ea5-ac2c-114aa2ef2634 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:33.998815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a8c5-73e6-4ea5-ac2c-114aa2ef2634 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:33.998915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d502a8c5-73e6-4ea5-ac2c-114aa2ef2634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:34.017417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d502a8c5-73e6-4ea5-ac2c-114aa2ef2634 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:34.018596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d502a8c5-73e6-4ea5-ac2c-114aa2ef2634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:34.084290 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 427/845] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:34.352711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e34c4e-2a92-4033-b685-4a77227e7305 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:34.448272 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:34.455981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e34c4e-2a92-4033-b685-4a77227e7305 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:34.489996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6694-ee7c-418e-911e-503fc0eaaea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:34.490621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6694-ee7c-418e-911e-503fc0eaaea6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:34.491167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6694-ee7c-418e-911e-503fc0eaaea6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:34.491441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6db6694-ee7c-418e-911e-503fc0eaaea6 None admin] PATH_INFO: `/v3/roles/09faee4fb963419e9d5409d109523f73` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:34.492819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db6694-ee7c-418e-911e-503fc0eaaea6 None admin] RBAC: Authorizing `identity:get_role(role_id=09faee4fb963419e9d5409d109523f73)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:34.494787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6db6694-ee7c-418e-911e-503fc0eaaea6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:34.496102 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 419/846] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:34 2022] GET /identity/v3/roles/09faee4fb963419e9d5409d109523f73 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:34.502041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a8c5-73e6-4ea5-ac2c-114aa2ef2634 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:34.553003 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:34.605700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d502a8c5-73e6-4ea5-ac2c-114aa2ef2634 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:34.641691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e9cdc-6375-4ec4-a426-b22842584a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:34.642324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e9cdc-6375-4ec4-a426-b22842584a8d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:34.642599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e9cdc-6375-4ec4-a426-b22842584a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:34.642873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5e9cdc-6375-4ec4-a426-b22842584a8d None admin] PATH_INFO: `/v3/users/4a4067434f2d4bdcafa943d950634a8c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:34.658479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e9cdc-6375-4ec4-a426-b22842584a8d None admin] RBAC: Authorizing `identity:get_user(user_id=4a4067434f2d4bdcafa943d950634a8c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:34.660359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5e9cdc-6375-4ec4-a426-b22842584a8d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:34.662055 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 428/847] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:34 2022] GET /identity/v3/users/4a4067434f2d4bdcafa943d950634a8c => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:34.667944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6694-ee7c-418e-911e-503fc0eaaea6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:34.776715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6db6694-ee7c-418e-911e-503fc0eaaea6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:34.811084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e942442-e22c-48b3-b799-d26a8768c8f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:34.811704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e942442-e22c-48b3-b799-d26a8768c8f8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:34.811979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e942442-e22c-48b3-b799-d26a8768c8f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:34.812251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e942442-e22c-48b3-b799-d26a8768c8f8 None admin] PATH_INFO: `/v3/projects/0d40d4382936426ba6df08f1ee29dc18` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:34.813522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e942442-e22c-48b3-b799-d26a8768c8f8 None admin] RBAC: Authorizing `identity:get_project(project_id=0d40d4382936426ba6df08f1ee29dc18)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:34.815048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e942442-e22c-48b3-b799-d26a8768c8f8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:34.816673 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 420/848] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:37:34 2022] GET /identity/v3/projects/0d40d4382936426ba6df08f1ee29dc18 => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:34.823584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e9cdc-6375-4ec4-a426-b22842584a8d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:34.921911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5e9cdc-6375-4ec4-a426-b22842584a8d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:34.924188 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:34.961401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3032075a-70fc-47f3-8796-afdb36d4e60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:34.962092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032075a-70fc-47f3-8796-afdb36d4e60b None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:34.962383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032075a-70fc-47f3-8796-afdb36d4e60b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:34.962657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3032075a-70fc-47f3-8796-afdb36d4e60b None admin] PATH_INFO: `/v3/projects/0d40d4382936426ba6df08f1ee29dc18/users/4a4067434f2d4bdcafa943d950634a8c/roles/09faee4fb963419e9d5409d109523f73` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:34.964840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032075a-70fc-47f3-8796-afdb36d4e60b None admin] RBAC: Authorizing `identity:create_grant(project_id=0d40d4382936426ba6df08f1ee29dc18, user_id=4a4067434f2d4bdcafa943d950634a8c, role_id=09faee4fb963419e9d5409d109523f73)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:34.966297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3032075a-70fc-47f3-8796-afdb36d4e60b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:34.980885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 429/849] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:37:34 2022] PUT /identity/v3/projects/0d40d4382936426ba6df08f1ee29dc18/users/4a4067434f2d4bdcafa943d950634a8c/roles/09faee4fb963419e9d5409d109523f73 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:37:37.129845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc102457-989a-4c8e-bbbe-57cf7019fffd None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:37.130393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc102457-989a-4c8e-bbbe-57cf7019fffd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:37.130393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc102457-989a-4c8e-bbbe-57cf7019fffd None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:37.131712 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 421/850] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:37.137074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45942b99-906a-48f1-856b-2b8b47f9667f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:37.137523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45942b99-906a-48f1-856b-2b8b47f9667f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:37.137643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45942b99-906a-48f1-856b-2b8b47f9667f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:37.155969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-45942b99-906a-48f1-856b-2b8b47f9667f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:37.157332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-45942b99-906a-48f1-856b-2b8b47f9667f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:37.221422 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 430/851] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:37.488421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc102457-989a-4c8e-bbbe-57cf7019fffd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:37.519126 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:37.588885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc102457-989a-4c8e-bbbe-57cf7019fffd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:37.624244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4675a-50cf-4123-b550-3f05a064804d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:37.624872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4675a-50cf-4123-b550-3f05a064804d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:37.625150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4675a-50cf-4123-b550-3f05a064804d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:37.625526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4675a-50cf-4123-b550-3f05a064804d None admin] PATH_INFO: `/v3/roles/09faee4fb963419e9d5409d109523f73` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:37.626915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4675a-50cf-4123-b550-3f05a064804d None admin] RBAC: Authorizing `identity:get_role(role_id=09faee4fb963419e9d5409d109523f73)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:37.628287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4675a-50cf-4123-b550-3f05a064804d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:37.629650 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 422/852] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:37 2022] GET /identity/v3/roles/09faee4fb963419e9d5409d109523f73 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:37.635620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45942b99-906a-48f1-856b-2b8b47f9667f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:37.724787 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:37.732546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45942b99-906a-48f1-856b-2b8b47f9667f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:37.764979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adafd34-09a6-44ec-9362-ce1f8afdc29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:37.765570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adafd34-09a6-44ec-9362-ce1f8afdc29b None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:37.765850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adafd34-09a6-44ec-9362-ce1f8afdc29b None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:37.766123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adafd34-09a6-44ec-9362-ce1f8afdc29b None admin] PATH_INFO: `/v3/users/4a4067434f2d4bdcafa943d950634a8c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:37.767225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adafd34-09a6-44ec-9362-ce1f8afdc29b None admin] RBAC: Authorizing `identity:get_user(user_id=4a4067434f2d4bdcafa943d950634a8c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:37.768646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adafd34-09a6-44ec-9362-ce1f8afdc29b None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:37.770226 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 431/853] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:37 2022] GET /identity/v3/users/4a4067434f2d4bdcafa943d950634a8c => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:37.776591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4675a-50cf-4123-b550-3f05a064804d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:37.870739 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:37.873721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4675a-50cf-4123-b550-3f05a064804d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:37.906991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6ed32-e3c1-4b87-ad36-5eda63b6c853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:37.907587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6ed32-e3c1-4b87-ad36-5eda63b6c853 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:37.907867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6ed32-e3c1-4b87-ad36-5eda63b6c853 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:37.908137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a6ed32-e3c1-4b87-ad36-5eda63b6c853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:37.978566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6ed32-e3c1-4b87-ad36-5eda63b6c853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:37.980030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a6ed32-e3c1-4b87-ad36-5eda63b6c853 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:38.074829 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:38.078660 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 423/854] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:37:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:37:38.084333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adafd34-09a6-44ec-9362-ce1f8afdc29b None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:38.179861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adafd34-09a6-44ec-9362-ce1f8afdc29b None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:38.212816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a14c2b5-5871-41c4-a797-88c9ffd5696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:38.213457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14c2b5-5871-41c4-a797-88c9ffd5696a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:38.213735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14c2b5-5871-41c4-a797-88c9ffd5696a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:38.214004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a14c2b5-5871-41c4-a797-88c9ffd5696a None admin] PATH_INFO: `/v3/projects/0d40d4382936426ba6df08f1ee29dc18` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:38.215095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14c2b5-5871-41c4-a797-88c9ffd5696a None admin] RBAC: Authorizing `identity:get_project(project_id=0d40d4382936426ba6df08f1ee29dc18)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:38.216508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a14c2b5-5871-41c4-a797-88c9ffd5696a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:38.218134 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 432/855] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:37:38 2022] GET /identity/v3/projects/0d40d4382936426ba6df08f1ee29dc18 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:38.224418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6ed32-e3c1-4b87-ad36-5eda63b6c853 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:38.318610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a6ed32-e3c1-4b87-ad36-5eda63b6c853 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:38.351859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6ce05-2d76-4514-9d78-f7a0e78ef7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:38.352577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ce05-2d76-4514-9d78-f7a0e78ef7b5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:38.352749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ce05-2d76-4514-9d78-f7a0e78ef7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:38.353015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6ce05-2d76-4514-9d78-f7a0e78ef7b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:38.353747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6ce05-2d76-4514-9d78-f7a0e78ef7b5 None admin] RBAC: Adding query filter params (role.id=09faee4fb963419e9d5409d109523f73, scope.project.id=0d40d4382936426ba6df08f1ee29dc18, user.id=4a4067434f2d4bdcafa943d950634a8c) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:38.354049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6ce05-2d76-4514-9d78-f7a0e78ef7b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:38.355455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6ce05-2d76-4514-9d78-f7a0e78ef7b5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:38.361036 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 424/856] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:37:38 2022] GET /identity/v3/role_assignments?user.id=4a4067434f2d4bdcafa943d950634a8c&scope.project.id=0d40d4382936426ba6df08f1ee29dc18&role.id=09faee4fb963419e9d5409d109523f73 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:40.527694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f095f9-bfd4-4bde-a664-535f7011b5c1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:40.528215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f095f9-bfd4-4bde-a664-535f7011b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:40.528215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f095f9-bfd4-4bde-a664-535f7011b5c1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:40.529535 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 433/857] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:40.535340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb15b-d1db-4ee6-b992-8416ded71acf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:40.535874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb15b-d1db-4ee6-b992-8416ded71acf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:40.535874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bb15b-d1db-4ee6-b992-8416ded71acf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:40.554750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-838bb15b-d1db-4ee6-b992-8416ded71acf None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:40.556575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-838bb15b-d1db-4ee6-b992-8416ded71acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:40.617230 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:40.626822 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 425/858] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:37:40.893426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f095f9-bfd4-4bde-a664-535f7011b5c1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:40.923035 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:41.000946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f095f9-bfd4-4bde-a664-535f7011b5c1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:41.037448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76de67-8b18-42fb-aa33-ba288ce1bbe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:41.038074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76de67-8b18-42fb-aa33-ba288ce1bbe7 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:41.038354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76de67-8b18-42fb-aa33-ba288ce1bbe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:41.038623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76de67-8b18-42fb-aa33-ba288ce1bbe7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:41.040229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76de67-8b18-42fb-aa33-ba288ce1bbe7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:41.041696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76de67-8b18-42fb-aa33-ba288ce1bbe7 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:41.043257 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 434/859] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:41.049112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb15b-d1db-4ee6-b992-8416ded71acf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:41.151166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bb15b-d1db-4ee6-b992-8416ded71acf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:41.186882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48171cf3-ae8b-478e-81c4-8fc1ddac4206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:41.187481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48171cf3-ae8b-478e-81c4-8fc1ddac4206 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:41.187760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48171cf3-ae8b-478e-81c4-8fc1ddac4206 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:41.188035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48171cf3-ae8b-478e-81c4-8fc1ddac4206 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:41.188700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48171cf3-ae8b-478e-81c4-8fc1ddac4206 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:41.190151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48171cf3-ae8b-478e-81c4-8fc1ddac4206 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:41.217046 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 426/860] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:37:41 2022] POST /identity/v3/projects => generated 311 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:43.413847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69c7d4-a121-4515-94f1-cb8ac1691689 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:43.414365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69c7d4-a121-4515-94f1-cb8ac1691689 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:43.414365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69c7d4-a121-4515-94f1-cb8ac1691689 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:43.416178 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 435/861] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:43.421416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b646b9c-02d1-4f38-a660-2fe2cdd9a667 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:43.421845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b646b9c-02d1-4f38-a660-2fe2cdd9a667 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:43.421975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b646b9c-02d1-4f38-a660-2fe2cdd9a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:43.441009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3b646b9c-02d1-4f38-a660-2fe2cdd9a667 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:43.442228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3b646b9c-02d1-4f38-a660-2fe2cdd9a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:43.599201 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:43.625831 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 427/862] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:43.896567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69c7d4-a121-4515-94f1-cb8ac1691689 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:43.990459 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:43.996497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69c7d4-a121-4515-94f1-cb8ac1691689 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:44.030581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bd8516-b60e-4050-b7a3-e9d5d1c31401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:44.031203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8516-b60e-4050-b7a3-e9d5d1c31401 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:44.031479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8516-b60e-4050-b7a3-e9d5d1c31401 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:44.031753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd8516-b60e-4050-b7a3-e9d5d1c31401 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:44.032850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8516-b60e-4050-b7a3-e9d5d1c31401 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:44.034296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bd8516-b60e-4050-b7a3-e9d5d1c31401 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:44.035849 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 436/863] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:37:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:44.042181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b646b9c-02d1-4f38-a660-2fe2cdd9a667 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:44.137416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b646b9c-02d1-4f38-a660-2fe2cdd9a667 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:44.170935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9035726-aad9-402b-a1c3-9473a2c3cd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:44.171457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035726-aad9-402b-a1c3-9473a2c3cd93 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:44.171735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035726-aad9-402b-a1c3-9473a2c3cd93 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:44.172008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9035726-aad9-402b-a1c3-9473a2c3cd93 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:44.172660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9035726-aad9-402b-a1c3-9473a2c3cd93 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:44.174102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9035726-aad9-402b-a1c3-9473a2c3cd93 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:44.195681 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 428/864] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:37:44 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:46.379369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574bdf-1b55-4e8d-8c4d-5149fbff9e58 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:46.379910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574bdf-1b55-4e8d-8c4d-5149fbff9e58 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:46.379910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac574bdf-1b55-4e8d-8c4d-5149fbff9e58 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:46.381234 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 437/865] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:46.386866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ea49-2342-4492-964a-d98424bb052c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:46.387316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ea49-2342-4492-964a-d98424bb052c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:46.387447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f3ea49-2342-4492-964a-d98424bb052c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:46.405726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a4f3ea49-2342-4492-964a-d98424bb052c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:46.406867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a4f3ea49-2342-4492-964a-d98424bb052c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:46.431408 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:46.471861 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 429/866] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:46.735998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574bdf-1b55-4e8d-8c4d-5149fbff9e58 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:46.834307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac574bdf-1b55-4e8d-8c4d-5149fbff9e58 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:46.865635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8398b9-497d-4023-9206-3ab08ce02fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:46.866497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8398b9-497d-4023-9206-3ab08ce02fa9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:46.866773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8398b9-497d-4023-9206-3ab08ce02fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:46.867044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8398b9-497d-4023-9206-3ab08ce02fa9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:46.877014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8398b9-497d-4023-9206-3ab08ce02fa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ff8398b9-497d-4023-9206-3ab08ce02fa9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:37:46.881716 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:46.882866 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:37:46.884724 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 438/867] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:37:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:46.889287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3ea49-2342-4492-964a-d98424bb052c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:46.983633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f3ea49-2342-4492-964a-d98424bb052c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:47.015788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923b09f-aff0-41ab-9ca8-3b4e6af06325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:47.016316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923b09f-aff0-41ab-9ca8-3b4e6af06325 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:47.016593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923b09f-aff0-41ab-9ca8-3b4e6af06325 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:47.016865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923b09f-aff0-41ab-9ca8-3b4e6af06325 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:47.017539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923b09f-aff0-41ab-9ca8-3b4e6af06325 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:47.017838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923b09f-aff0-41ab-9ca8-3b4e6af06325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:47.019186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0923b09f-aff0-41ab-9ca8-3b4e6af06325 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:47.027365 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 430/868] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:37:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:47.033765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8398b9-497d-4023-9206-3ab08ce02fa9 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:47.060523 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:47.132960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8398b9-497d-4023-9206-3ab08ce02fa9 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:47.169152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e619b3-6bc5-418b-8d2d-d53121eeb4a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:47.169818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e619b3-6bc5-418b-8d2d-d53121eeb4a3 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:47.170099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e619b3-6bc5-418b-8d2d-d53121eeb4a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:47.170373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e619b3-6bc5-418b-8d2d-d53121eeb4a3 None admin] PATH_INFO: `/v3/users/4d4ef14de2ac4cd09408dda9026fe8fb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:47.184130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e619b3-6bc5-418b-8d2d-d53121eeb4a3 None admin] RBAC: Authorizing `identity:get_user(user_id=4d4ef14de2ac4cd09408dda9026fe8fb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:47.185597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e619b3-6bc5-418b-8d2d-d53121eeb4a3 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:47.187221 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 439/869] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:47 2022] GET /identity/v3/users/4d4ef14de2ac4cd09408dda9026fe8fb => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:47.193053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923b09f-aff0-41ab-9ca8-3b4e6af06325 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:47.221242 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:47.300029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923b09f-aff0-41ab-9ca8-3b4e6af06325 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:47.335037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0627d3cc-0412-4209-b36f-e1a8ac7c83ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:47.335662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d3cc-0412-4209-b36f-e1a8ac7c83ef None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:47.335940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d3cc-0412-4209-b36f-e1a8ac7c83ef None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:47.336213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0627d3cc-0412-4209-b36f-e1a8ac7c83ef None admin] PATH_INFO: `/v3/projects/1d50b8ae61be4d7480b2f1a9ceb2275e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:47.337901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627d3cc-0412-4209-b36f-e1a8ac7c83ef None admin] RBAC: Authorizing `identity:get_project(project_id=1d50b8ae61be4d7480b2f1a9ceb2275e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:47.339313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0627d3cc-0412-4209-b36f-e1a8ac7c83ef None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:47.340934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 431/870] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:37:47 2022] GET /identity/v3/projects/1d50b8ae61be4d7480b2f1a9ceb2275e => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:47.347014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e619b3-6bc5-418b-8d2d-d53121eeb4a3 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:47.432464 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:47.448477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e619b3-6bc5-418b-8d2d-d53121eeb4a3 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:47.481882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f371535-8732-4162-9638-8d45f8b19fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:47.482535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f371535-8732-4162-9638-8d45f8b19fc0 None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:47.482811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f371535-8732-4162-9638-8d45f8b19fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:47.483083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f371535-8732-4162-9638-8d45f8b19fc0 None admin] PATH_INFO: `/v3/projects/1d50b8ae61be4d7480b2f1a9ceb2275e/users/4d4ef14de2ac4cd09408dda9026fe8fb/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:47.484952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f371535-8732-4162-9638-8d45f8b19fc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=1d50b8ae61be4d7480b2f1a9ceb2275e, user_id=4d4ef14de2ac4cd09408dda9026fe8fb, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:47.486440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f371535-8732-4162-9638-8d45f8b19fc0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:47.499651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 440/871] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:37:47 2022] PUT /identity/v3/projects/1d50b8ae61be4d7480b2f1a9ceb2275e/users/4d4ef14de2ac4cd09408dda9026fe8fb/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:37:49.687650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24fafc-df02-46a4-9eaf-3b37e82875ce None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:49.688237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24fafc-df02-46a4-9eaf-3b37e82875ce None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:49.688237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24fafc-df02-46a4-9eaf-3b37e82875ce None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:49.689737 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 432/872] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:49.695511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae315-a7e4-43ec-8b6f-8cb32374a14e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:49.696300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae315-a7e4-43ec-8b6f-8cb32374a14e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:49.696504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae315-a7e4-43ec-8b6f-8cb32374a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:49.716074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1f9ae315-a7e4-43ec-8b6f-8cb32374a14e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:49.717288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1f9ae315-a7e4-43ec-8b6f-8cb32374a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:49.786887 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 441/873] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:50.057093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24fafc-df02-46a4-9eaf-3b37e82875ce None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:50.157875 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:50.169082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24fafc-df02-46a4-9eaf-3b37e82875ce None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:50.205198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d638a-0c17-460d-8126-067fee6a132f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:50.205860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d638a-0c17-460d-8126-067fee6a132f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:50.206136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d638a-0c17-460d-8126-067fee6a132f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:50.206407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055d638a-0c17-460d-8126-067fee6a132f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:50.217143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055d638a-0c17-460d-8126-067fee6a132f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-055d638a-0c17-460d-8126-067fee6a132f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:37:50.222294 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:37:50.223366 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:37:50.224225 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 433/874] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:37:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:37:50.231289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae315-a7e4-43ec-8b6f-8cb32374a14e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:50.312496 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:50.340991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae315-a7e4-43ec-8b6f-8cb32374a14e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:50.375856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494548ef-ef28-47a4-8a56-ba6b2ebec287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:50.376462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494548ef-ef28-47a4-8a56-ba6b2ebec287 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:50.376743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494548ef-ef28-47a4-8a56-ba6b2ebec287 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:50.377011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494548ef-ef28-47a4-8a56-ba6b2ebec287 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:50.377704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494548ef-ef28-47a4-8a56-ba6b2ebec287 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:50.378005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494548ef-ef28-47a4-8a56-ba6b2ebec287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:50.379372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494548ef-ef28-47a4-8a56-ba6b2ebec287 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:50.388574 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 442/875] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:37:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:50.394939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d638a-0c17-460d-8126-067fee6a132f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:50.511411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055d638a-0c17-460d-8126-067fee6a132f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:50.552888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9e69d-5fe7-4034-ad99-3cc0440325d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:50.553551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9e69d-5fe7-4034-ad99-3cc0440325d7 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:50.553834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9e69d-5fe7-4034-ad99-3cc0440325d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:50.554107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e9e69d-5fe7-4034-ad99-3cc0440325d7 None admin] PATH_INFO: `/v3/users/4d4ef14de2ac4cd09408dda9026fe8fb` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:50.555986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9e69d-5fe7-4034-ad99-3cc0440325d7 None admin] RBAC: Authorizing `identity:get_user(user_id=4d4ef14de2ac4cd09408dda9026fe8fb)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:50.557590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e9e69d-5fe7-4034-ad99-3cc0440325d7 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:50.559374 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 434/876] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:37:50 2022] GET /identity/v3/users/4d4ef14de2ac4cd09408dda9026fe8fb => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:50.566165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494548ef-ef28-47a4-8a56-ba6b2ebec287 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:50.680923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494548ef-ef28-47a4-8a56-ba6b2ebec287 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:50.722188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91918-edc3-462c-9b9d-b4b866928fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:50.722885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91918-edc3-462c-9b9d-b4b866928fac None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:50.723185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91918-edc3-462c-9b9d-b4b866928fac None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:50.723539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91918-edc3-462c-9b9d-b4b866928fac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:50.728171 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:50.808476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91918-edc3-462c-9b9d-b4b866928fac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:50.810268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f91918-edc3-462c-9b9d-b4b866928fac None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:50.925104 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 443/877] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:37:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:37:50.931865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9e69d-5fe7-4034-ad99-3cc0440325d7 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:50.957904 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:51.053495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e9e69d-5fe7-4034-ad99-3cc0440325d7 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:51.095460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feef17f-3de7-4abc-aa3b-f5f25d8b338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:51.096143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef17f-3de7-4abc-aa3b-f5f25d8b338e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:51.096456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef17f-3de7-4abc-aa3b-f5f25d8b338e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:51.096723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feef17f-3de7-4abc-aa3b-f5f25d8b338e None admin] PATH_INFO: `/v3/projects/1d50b8ae61be4d7480b2f1a9ceb2275e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:51.097919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feef17f-3de7-4abc-aa3b-f5f25d8b338e None admin] RBAC: Authorizing `identity:get_project(project_id=1d50b8ae61be4d7480b2f1a9ceb2275e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:51.099450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feef17f-3de7-4abc-aa3b-f5f25d8b338e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:51.101210 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 435/878] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:37:50 2022] GET /identity/v3/projects/1d50b8ae61be4d7480b2f1a9ceb2275e => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:51.108118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91918-edc3-462c-9b9d-b4b866928fac None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:51.148189 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:51.221566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f91918-edc3-462c-9b9d-b4b866928fac None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:51.261495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53fc90f-fd42-4238-bf52-e886fe2e203a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:51.262228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fc90f-fd42-4238-bf52-e886fe2e203a None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:51.262571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fc90f-fd42-4238-bf52-e886fe2e203a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:51.262984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53fc90f-fd42-4238-bf52-e886fe2e203a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:51.263911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fc90f-fd42-4238-bf52-e886fe2e203a None admin] RBAC: Adding query filter params (role.id=d266f03406d94df8bb9cad19b577978f, scope.project.id=1d50b8ae61be4d7480b2f1a9ceb2275e, user.id=4d4ef14de2ac4cd09408dda9026fe8fb) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:37:51.264264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fc90f-fd42-4238-bf52-e886fe2e203a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:51.265792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53fc90f-fd42-4238-bf52-e886fe2e203a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:51.273088 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 444/879] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:37:51 2022] GET /identity/v3/role_assignments?user.id=4d4ef14de2ac4cd09408dda9026fe8fb&scope.project.id=1d50b8ae61be4d7480b2f1a9ceb2275e&role.id=d266f03406d94df8bb9cad19b577978f => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:37:53.668783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d376-98c3-4b74-8820-32604516f1bc None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:53.669449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d376-98c3-4b74-8820-32604516f1bc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:53.669449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8456d376-98c3-4b74-8820-32604516f1bc None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:53.670725 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 436/880] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:53.679684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2e06-ebca-46c2-be58-3ad9d6998c52 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:53.680796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2e06-ebca-46c2-be58-3ad9d6998c52 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:53.681115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440f2e06-ebca-46c2-be58-3ad9d6998c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:53.710145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-440f2e06-ebca-46c2-be58-3ad9d6998c52 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:53.712459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-440f2e06-ebca-46c2-be58-3ad9d6998c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:53.820685 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 445/881] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:54.104879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456d376-98c3-4b74-8820-32604516f1bc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:54.221123 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:54.246311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8456d376-98c3-4b74-8820-32604516f1bc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:54.309199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cfb749-a1f3-48cf-bcb1-ce393408ce3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:54.310218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfb749-a1f3-48cf-bcb1-ce393408ce3b None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:54.310699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfb749-a1f3-48cf-bcb1-ce393408ce3b None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:54.311175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cfb749-a1f3-48cf-bcb1-ce393408ce3b None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:54.312410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfb749-a1f3-48cf-bcb1-ce393408ce3b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:54.314750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cfb749-a1f3-48cf-bcb1-ce393408ce3b None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:54.340196 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 437/882] 10.222.0.25 () {60 vars in 1138 bytes} [Mon Oct 24 08:37:54 2022] POST /identity/v3/domains => generated 267 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:56.654756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee30380-4da9-4a15-8666-8a553273f760 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:56.655296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee30380-4da9-4a15-8666-8a553273f760 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:56.655403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee30380-4da9-4a15-8666-8a553273f760 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:56.657401 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 446/883] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:56.663190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d1c30-1f13-43fc-8835-eaf258996a8a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:56.663693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d1c30-1f13-43fc-8835-eaf258996a8a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:56.663824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d1c30-1f13-43fc-8835-eaf258996a8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:56.682365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-603d1c30-1f13-43fc-8835-eaf258996a8a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:56.683548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-603d1c30-1f13-43fc-8835-eaf258996a8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:56.751829 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 438/884] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:37:57.024791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee30380-4da9-4a15-8666-8a553273f760 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:57.060884 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:57.136725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee30380-4da9-4a15-8666-8a553273f760 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:57.179466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452ae493-1e51-42a0-b6ae-18416f55d4f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:57.180100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ae493-1e51-42a0-b6ae-18416f55d4f9 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:57.180998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ae493-1e51-42a0-b6ae-18416f55d4f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:57.181210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452ae493-1e51-42a0-b6ae-18416f55d4f9 None admin] PATH_INFO: `/v3/domains/3efbcc2a8aff4b04b98b8b18213268a9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:57.195150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ae493-1e51-42a0-b6ae-18416f55d4f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3efbcc2a8aff4b04b98b8b18213268a9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:57.200981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452ae493-1e51-42a0-b6ae-18416f55d4f9 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:57.202867 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 447/885] 10.222.0.25 () {56 vars in 1183 bytes} [Mon Oct 24 08:37:57 2022] GET /identity/v3/domains/3efbcc2a8aff4b04b98b8b18213268a9 => generated 267 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:37:57.209044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d1c30-1f13-43fc-8835-eaf258996a8a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:37:57.302396 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:37:57.326625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d1c30-1f13-43fc-8835-eaf258996a8a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:37:57.363709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ab33b-6985-4c31-86fa-bf659abe1bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:37:57.364376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ab33b-6985-4c31-86fa-bf659abe1bce None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:57.364653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ab33b-6985-4c31-86fa-bf659abe1bce None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:57.364944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ab33b-6985-4c31-86fa-bf659abe1bce None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:57.365688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ab33b-6985-4c31-86fa-bf659abe1bce None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:37:57.367530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ab33b-6985-4c31-86fa-bf659abe1bce None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:37:57.399389 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 439/886] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:37:57 2022] POST /identity/v3/projects => generated 361 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:37:59.794438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112f615-f407-4a8e-a7d7-7f6ac7ebb2b9 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:59.795023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112f615-f407-4a8e-a7d7-7f6ac7ebb2b9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:59.795023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112f615-f407-4a8e-a7d7-7f6ac7ebb2b9 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:59.796325 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 448/887] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:37:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:37:59.802424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758244e-1c4f-4d18-bbd5-f3cd8b740eef None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:37:59.802941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758244e-1c4f-4d18-bbd5-f3cd8b740eef None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:37:59.802941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8758244e-1c4f-4d18-bbd5-f3cd8b740eef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:37:59.823985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8758244e-1c4f-4d18-bbd5-f3cd8b740eef None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:37:59.825258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8758244e-1c4f-4d18-bbd5-f3cd8b740eef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:37:59.900680 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 440/888] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:37:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:38:00.184947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112f615-f407-4a8e-a7d7-7f6ac7ebb2b9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:00.315447 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:00.330061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112f615-f407-4a8e-a7d7-7f6ac7ebb2b9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:00.366992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd66c3-0d23-4965-90de-5646bf98d4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:00.367742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd66c3-0d23-4965-90de-5646bf98d4ec None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:00.368004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd66c3-0d23-4965-90de-5646bf98d4ec None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:00.368276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd66c3-0d23-4965-90de-5646bf98d4ec None admin] PATH_INFO: `/v3/domains/3efbcc2a8aff4b04b98b8b18213268a9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:00.369464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd66c3-0d23-4965-90de-5646bf98d4ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=3efbcc2a8aff4b04b98b8b18213268a9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:00.370896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dd66c3-0d23-4965-90de-5646bf98d4ec None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:00.372557 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 449/889] 10.222.0.25 () {56 vars in 1183 bytes} [Mon Oct 24 08:38:00 2022] GET /identity/v3/domains/3efbcc2a8aff4b04b98b8b18213268a9 => generated 267 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:00.378678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758244e-1c4f-4d18-bbd5-f3cd8b740eef None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:00.446547 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:00.492876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8758244e-1c4f-4d18-bbd5-f3cd8b740eef None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:00.527290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77035a28-cb3b-46a5-9d41-aa91a463d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:00.527895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035a28-cb3b-46a5-9d41-aa91a463d0a1 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:00.528170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035a28-cb3b-46a5-9d41-aa91a463d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:00.528440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77035a28-cb3b-46a5-9d41-aa91a463d0a1 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:00.529085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77035a28-cb3b-46a5-9d41-aa91a463d0a1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:00.530578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77035a28-cb3b-46a5-9d41-aa91a463d0a1 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:00.553193 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 441/890] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:38:00 2022] POST /identity/v3/users => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:38:02.892064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f99dfe-4edc-4300-8360-933997021e8a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:02.892627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f99dfe-4edc-4300-8360-933997021e8a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:02.892627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f99dfe-4edc-4300-8360-933997021e8a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:02.894205 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 450/891] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:38:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:38:02.905706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde65d-a0a5-4621-b602-7bd4756e9aa1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:02.906269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde65d-a0a5-4621-b602-7bd4756e9aa1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:02.906594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4cde65d-a0a5-4621-b602-7bd4756e9aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:02.927833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f4cde65d-a0a5-4621-b602-7bd4756e9aa1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:02.929362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f4cde65d-a0a5-4621-b602-7bd4756e9aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:03.020744 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 442/892] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:38:03.303564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f99dfe-4edc-4300-8360-933997021e8a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:03.406393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f99dfe-4edc-4300-8360-933997021e8a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:03.440179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41137-81ff-4ace-9f78-990e4a62264e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:03.440810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41137-81ff-4ace-9f78-990e4a62264e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:03.441089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41137-81ff-4ace-9f78-990e4a62264e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:03.441385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d41137-81ff-4ace-9f78-990e4a62264e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:03.452550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d41137-81ff-4ace-9f78-990e4a62264e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-23d41137-81ff-4ace-9f78-990e4a62264e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:38:03.457366 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:03.458539 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:38:03.459437 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 451/893] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:38:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:03.465233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cde65d-a0a5-4621-b602-7bd4756e9aa1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:03.513273 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:03.571226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4cde65d-a0a5-4621-b602-7bd4756e9aa1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:03.608129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3105-d979-415e-bbe2-3c7d90969792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:03.608733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3105-d979-415e-bbe2-3c7d90969792 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:03.609008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3105-d979-415e-bbe2-3c7d90969792 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:03.609278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ea3105-d979-415e-bbe2-3c7d90969792 None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:03.609966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea3105-d979-415e-bbe2-3c7d90969792 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:03.610263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea3105-d979-415e-bbe2-3c7d90969792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:03.611626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ea3105-d979-415e-bbe2-3c7d90969792 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:03.620927 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 443/894] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:38:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:38:03.630429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41137-81ff-4ace-9f78-990e4a62264e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:03.658180 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:03.742526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d41137-81ff-4ace-9f78-990e4a62264e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:03.782947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb909efd-62f0-44e8-a64e-aeee22a31c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:03.783664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb909efd-62f0-44e8-a64e-aeee22a31c04 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:03.783975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb909efd-62f0-44e8-a64e-aeee22a31c04 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:03.784370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb909efd-62f0-44e8-a64e-aeee22a31c04 None admin] PATH_INFO: `/v3/users/e9f545e6db7c4c5e8ae7c754a51a0215` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:03.799193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb909efd-62f0-44e8-a64e-aeee22a31c04 None admin] RBAC: Authorizing `identity:get_user(user_id=e9f545e6db7c4c5e8ae7c754a51a0215)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:03.800652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb909efd-62f0-44e8-a64e-aeee22a31c04 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:03.802526 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 452/895] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:38:03 2022] GET /identity/v3/users/e9f545e6db7c4c5e8ae7c754a51a0215 => generated 311 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:03.809685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3105-d979-415e-bbe2-3c7d90969792 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:03.921795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ea3105-d979-415e-bbe2-3c7d90969792 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:03.931883 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:03.963426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e9fa4a-8539-4886-8485-e6e94c4d984f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:03.964262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fa4a-8539-4886-8485-e6e94c4d984f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:03.964542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fa4a-8539-4886-8485-e6e94c4d984f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:03.964819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e9fa4a-8539-4886-8485-e6e94c4d984f None admin] PATH_INFO: `/v3/projects/fcea865aad4e425da25fce1f2a7bfb9d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:03.966120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9fa4a-8539-4886-8485-e6e94c4d984f None admin] RBAC: Authorizing `identity:get_project(project_id=fcea865aad4e425da25fce1f2a7bfb9d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:03.967563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e9fa4a-8539-4886-8485-e6e94c4d984f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:03.969266 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 444/896] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:38:03 2022] GET /identity/v3/projects/fcea865aad4e425da25fce1f2a7bfb9d => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:03.975703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb909efd-62f0-44e8-a64e-aeee22a31c04 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:04.060842 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:04.084562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb909efd-62f0-44e8-a64e-aeee22a31c04 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:04.120220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf933991-238e-4f07-b421-91253379fc6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:04.120881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf933991-238e-4f07-b421-91253379fc6a None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:04.121162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf933991-238e-4f07-b421-91253379fc6a None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:04.121466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf933991-238e-4f07-b421-91253379fc6a None admin] PATH_INFO: `/v3/projects/fcea865aad4e425da25fce1f2a7bfb9d/users/e9f545e6db7c4c5e8ae7c754a51a0215/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:04.123445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf933991-238e-4f07-b421-91253379fc6a None admin] RBAC: Authorizing `identity:create_grant(project_id=fcea865aad4e425da25fce1f2a7bfb9d, user_id=e9f545e6db7c4c5e8ae7c754a51a0215, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:04.124865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf933991-238e-4f07-b421-91253379fc6a None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:04.145651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 453/897] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:38:03 2022] PUT /identity/v3/projects/fcea865aad4e425da25fce1f2a7bfb9d/users/e9f545e6db7c4c5e8ae7c754a51a0215/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:38:06.464302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b03e-a057-4fa0-a913-e4c61d0ef1d1 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:06.464806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b03e-a057-4fa0-a913-e4c61d0ef1d1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:06.464806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b82b03e-a057-4fa0-a913-e4c61d0ef1d1 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:06.466125 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 445/898] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:38:06.471812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4bd49-0c6f-477f-89ad-e7b335091619 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:06.472236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4bd49-0c6f-477f-89ad-e7b335091619 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:06.472367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4bd49-0c6f-477f-89ad-e7b335091619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:06.500817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0ad4bd49-0c6f-477f-89ad-e7b335091619 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:38:06.502857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0ad4bd49-0c6f-477f-89ad-e7b335091619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:38:06.576023 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 454/899] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:38:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:38:06.865138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b03e-a057-4fa0-a913-e4c61d0ef1d1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:06.978724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b82b03e-a057-4fa0-a913-e4c61d0ef1d1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:07.016739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d72ef6-9cd9-4642-8959-4836f59a1c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:07.017409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d72ef6-9cd9-4642-8959-4836f59a1c79 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:07.017705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d72ef6-9cd9-4642-8959-4836f59a1c79 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:07.018107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d72ef6-9cd9-4642-8959-4836f59a1c79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:07.030323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d72ef6-9cd9-4642-8959-4836f59a1c79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-80d72ef6-9cd9-4642-8959-4836f59a1c79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:38:07.035415 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:38:07.036543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:38:07.037635 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 446/900] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:38:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:38:07.043534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4bd49-0c6f-477f-89ad-e7b335091619 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:07.118245 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:07.172499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4bd49-0c6f-477f-89ad-e7b335091619 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:07.228158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3202c-dd23-4e49-bde6-e90d138597f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:07.229175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3202c-dd23-4e49-bde6-e90d138597f0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:07.229715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3202c-dd23-4e49-bde6-e90d138597f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:07.230177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3202c-dd23-4e49-bde6-e90d138597f0 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:07.231364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3202c-dd23-4e49-bde6-e90d138597f0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:07.231872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3202c-dd23-4e49-bde6-e90d138597f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:07.233866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3202c-dd23-4e49-bde6-e90d138597f0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:07.248760 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 455/901] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:38:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:07.255418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d72ef6-9cd9-4642-8959-4836f59a1c79 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:07.293368 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:07.369105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d72ef6-9cd9-4642-8959-4836f59a1c79 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:07.405144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d972d1-da28-4f2b-bbee-01e28d4abaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:07.405951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d972d1-da28-4f2b-bbee-01e28d4abaac None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:07.406230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d972d1-da28-4f2b-bbee-01e28d4abaac None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:07.406500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d972d1-da28-4f2b-bbee-01e28d4abaac None admin] PATH_INFO: `/v3/users/e9f545e6db7c4c5e8ae7c754a51a0215` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:07.407624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d972d1-da28-4f2b-bbee-01e28d4abaac None admin] RBAC: Authorizing `identity:get_user(user_id=e9f545e6db7c4c5e8ae7c754a51a0215)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:07.409051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d972d1-da28-4f2b-bbee-01e28d4abaac None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:07.410654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 447/902] 10.222.0.25 () {56 vars in 1177 bytes} [Mon Oct 24 08:38:07 2022] GET /identity/v3/users/e9f545e6db7c4c5e8ae7c754a51a0215 => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:07.417350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3202c-dd23-4e49-bde6-e90d138597f0 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:07.544709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3202c-dd23-4e49-bde6-e90d138597f0 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:07.572948 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:07.581510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518162c3-6817-4460-ae1f-e8843f18d6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:07.582115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518162c3-6817-4460-ae1f-e8843f18d6bf None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:07.582385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518162c3-6817-4460-ae1f-e8843f18d6bf None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:07.582651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518162c3-6817-4460-ae1f-e8843f18d6bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:07.659597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518162c3-6817-4460-ae1f-e8843f18d6bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:07.661579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518162c3-6817-4460-ae1f-e8843f18d6bf None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:07.771591 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 456/903] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:38:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 24 08:38:07.778650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d972d1-da28-4f2b-bbee-01e28d4abaac None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:07.892232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d972d1-da28-4f2b-bbee-01e28d4abaac None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:07.894751 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:07.928906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c655e67-10a0-467b-8d1a-e734f92df73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:07.929399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655e67-10a0-467b-8d1a-e734f92df73d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:07.929707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655e67-10a0-467b-8d1a-e734f92df73d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:07.930019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c655e67-10a0-467b-8d1a-e734f92df73d None admin] PATH_INFO: `/v3/projects/fcea865aad4e425da25fce1f2a7bfb9d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:07.931244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c655e67-10a0-467b-8d1a-e734f92df73d None admin] RBAC: Authorizing `identity:get_project(project_id=fcea865aad4e425da25fce1f2a7bfb9d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:07.932656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c655e67-10a0-467b-8d1a-e734f92df73d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:07.935674 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 448/904] 10.222.0.25 () {56 vars in 1186 bytes} [Mon Oct 24 08:38:07 2022] GET /identity/v3/projects/fcea865aad4e425da25fce1f2a7bfb9d => generated 361 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:38:07.940946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518162c3-6817-4460-ae1f-e8843f18d6bf None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:38:07.970482 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:08.059379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518162c3-6817-4460-ae1f-e8843f18d6bf None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:38:08.100104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dbb32-20eb-48f3-a6b7-76b16407617e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:38:08.100704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dbb32-20eb-48f3-a6b7-76b16407617e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:38:08.100982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dbb32-20eb-48f3-a6b7-76b16407617e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:38:08.101255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dbb32-20eb-48f3-a6b7-76b16407617e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:38:08.102101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dbb32-20eb-48f3-a6b7-76b16407617e None admin] RBAC: Adding query filter params (role.id=d266f03406d94df8bb9cad19b577978f, scope.project.id=fcea865aad4e425da25fce1f2a7bfb9d, user.id=e9f545e6db7c4c5e8ae7c754a51a0215) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:38:08.102548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dbb32-20eb-48f3-a6b7-76b16407617e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:38:08.104057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dbb32-20eb-48f3-a6b7-76b16407617e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:38:08.111177 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 457/905] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:38:07 2022] GET /identity/v3/role_assignments?user.id=e9f545e6db7c4c5e8ae7c754a51a0215&scope.project.id=fcea865aad4e425da25fce1f2a7bfb9d&role.id=d266f03406d94df8bb9cad19b577978f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:38:17.924194 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=14 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:38:18.107818 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=54 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:06.292495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5fd7e-7ac4-48d1-baf0-24309097dab3 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:06.293148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5fd7e-7ac4-48d1-baf0-24309097dab3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:06.293148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a5fd7e-7ac4-48d1-baf0-24309097dab3 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:06.294791 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 449/906] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:39:06.300216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f15859-f9ed-4ab6-a80d-1843baaa5afb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:06.300691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f15859-f9ed-4ab6-a80d-1843baaa5afb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:06.300775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f15859-f9ed-4ab6-a80d-1843baaa5afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:06.321494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-26f15859-f9ed-4ab6-a80d-1843baaa5afb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:39:06.322717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-26f15859-f9ed-4ab6-a80d-1843baaa5afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:39:06.414081 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 458/907] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:39:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:39:06.690408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5fd7e-7ac4-48d1-baf0-24309097dab3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:06.826777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a5fd7e-7ac4-48d1-baf0-24309097dab3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:06.872538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b14659-34c4-454b-942e-19c1f520d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:06.873146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b14659-34c4-454b-942e-19c1f520d83f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:06.873499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b14659-34c4-454b-942e-19c1f520d83f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:06.873716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b14659-34c4-454b-942e-19c1f520d83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:06.885728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b14659-34c4-454b-942e-19c1f520d83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:06.887227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b14659-34c4-454b-942e-19c1f520d83f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-63b14659-34c4-454b-942e-19c1f520d83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:39:06.910262 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:06.911535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:39:06.912551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:39:06.912551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:06.912551 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:06.912551 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 450/908] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:39:06.921810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f15859-f9ed-4ab6-a80d-1843baaa5afb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:07.062822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f15859-f9ed-4ab6-a80d-1843baaa5afb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:07.096875 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:07.104826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37ff10a-06b7-40c1-a953-315b70640e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:07.105530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ff10a-06b7-40c1-a953-315b70640e65 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:07.110356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ff10a-06b7-40c1-a953-315b70640e65 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:07.110356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37ff10a-06b7-40c1-a953-315b70640e65 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:07.110356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ff10a-06b7-40c1-a953-315b70640e65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:07.110356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ff10a-06b7-40c1-a953-315b70640e65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:07.110356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37ff10a-06b7-40c1-a953-315b70640e65 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:07.127841 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 459/909] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:07.134009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b14659-34c4-454b-942e-19c1f520d83f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:07.201406 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:07.283899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b14659-34c4-454b-942e-19c1f520d83f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:07.330789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8addeedb-f09a-4fed-85aa-b1e6b958252c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:07.331464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addeedb-f09a-4fed-85aa-b1e6b958252c None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:07.331691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addeedb-f09a-4fed-85aa-b1e6b958252c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:07.331949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8addeedb-f09a-4fed-85aa-b1e6b958252c None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:07.332770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addeedb-f09a-4fed-85aa-b1e6b958252c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:07.334427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8addeedb-f09a-4fed-85aa-b1e6b958252c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:07.362783 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 451/910] 10.222.0.25 () {60 vars in 1132 bytes} [Mon Oct 24 08:39:07 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:39:09.894441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46dd9-e942-4c12-a04d-becefeb334b3 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:09.895071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46dd9-e942-4c12-a04d-becefeb334b3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:09.895312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d46dd9-e942-4c12-a04d-becefeb334b3 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:09.902641 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 460/911] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:39:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:39:09.905720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a537-cda1-4f45-832d-57d4be9d14d0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:09.906210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a537-cda1-4f45-832d-57d4be9d14d0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:09.906457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a634a537-cda1-4f45-832d-57d4be9d14d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:09.932975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a634a537-cda1-4f45-832d-57d4be9d14d0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:39:09.934640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a634a537-cda1-4f45-832d-57d4be9d14d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:39:10.030144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 452/912] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:39:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:39:10.346174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46dd9-e942-4c12-a04d-becefeb334b3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:10.514021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d46dd9-e942-4c12-a04d-becefeb334b3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:10.577800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e975ba-f40c-436d-9fd3-76a9014cc93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:10.579067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e975ba-f40c-436d-9fd3-76a9014cc93f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:10.580122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e975ba-f40c-436d-9fd3-76a9014cc93f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:10.580487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e975ba-f40c-436d-9fd3-76a9014cc93f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:10.607789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e975ba-f40c-436d-9fd3-76a9014cc93f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-84e975ba-f40c-436d-9fd3-76a9014cc93f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:39:10.612987 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:10.614119 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:10.615151 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 461/913] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:39:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:10.623739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a537-cda1-4f45-832d-57d4be9d14d0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:10.672323 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:10.769343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a634a537-cda1-4f45-832d-57d4be9d14d0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:10.827294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef548272-7c71-41b1-8976-4bdb34b5d2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:10.827294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548272-7c71-41b1-8976-4bdb34b5d2fa None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:10.827294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548272-7c71-41b1-8976-4bdb34b5d2fa None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:10.827294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef548272-7c71-41b1-8976-4bdb34b5d2fa None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:10.828105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef548272-7c71-41b1-8976-4bdb34b5d2fa None admin] RBAC: Adding query filter params (name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:10.828105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef548272-7c71-41b1-8976-4bdb34b5d2fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:10.828105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef548272-7c71-41b1-8976-4bdb34b5d2fa None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:10.840779 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 453/914] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:39:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:10.847509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e975ba-f40c-436d-9fd3-76a9014cc93f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:10.910642 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:10.966581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e975ba-f40c-436d-9fd3-76a9014cc93f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:11.006005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566f4b-2332-4e88-b3e8-e29a7fc1efaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:11.007646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566f4b-2332-4e88-b3e8-e29a7fc1efaa None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:11.007863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566f4b-2332-4e88-b3e8-e29a7fc1efaa None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:11.008142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07566f4b-2332-4e88-b3e8-e29a7fc1efaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:11.023022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07566f4b-2332-4e88-b3e8-e29a7fc1efaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:11.025003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07566f4b-2332-4e88-b3e8-e29a7fc1efaa None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-07566f4b-2332-4e88-b3e8-e29a7fc1efaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:39:11.047005 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:11.048234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:39:11.049273 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:39:11.049273 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:11.049273 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:11.049273 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 462/915] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:11.055677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef548272-7c71-41b1-8976-4bdb34b5d2fa None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:11.189778 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:11.193767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef548272-7c71-41b1-8976-4bdb34b5d2fa None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:11.243137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37dcff-8b51-44cc-b78d-9af2bf8841ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:11.244629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37dcff-8b51-44cc-b78d-9af2bf8841ba None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:11.245131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37dcff-8b51-44cc-b78d-9af2bf8841ba None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:11.245338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37dcff-8b51-44cc-b78d-9af2bf8841ba None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:11.246182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37dcff-8b51-44cc-b78d-9af2bf8841ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:11.246556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37dcff-8b51-44cc-b78d-9af2bf8841ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:11.248053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37dcff-8b51-44cc-b78d-9af2bf8841ba None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:11.264910 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 454/916] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:11.271595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566f4b-2332-4e88-b3e8-e29a7fc1efaa None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:11.418915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07566f4b-2332-4e88-b3e8-e29a7fc1efaa None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:11.421841 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:11.471556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13358ac7-3d15-44be-a086-01ffbcc4d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:11.473945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358ac7-3d15-44be-a086-01ffbcc4d2cc None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:11.474284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358ac7-3d15-44be-a086-01ffbcc4d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:11.474603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13358ac7-3d15-44be-a086-01ffbcc4d2cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:11.489732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13358ac7-3d15-44be-a086-01ffbcc4d2cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:11.491485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13358ac7-3d15-44be-a086-01ffbcc4d2cc None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-13358ac7-3d15-44be-a086-01ffbcc4d2cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:39:11.504642 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:11.510611 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:11.511835 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 463/917] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:11.516585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37dcff-8b51-44cc-b78d-9af2bf8841ba None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:11.648727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37dcff-8b51-44cc-b78d-9af2bf8841ba None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:11.696825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbb806-c759-4926-8888-67a04a1afee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:11.697442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbb806-c759-4926-8888-67a04a1afee9 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:11.697757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbb806-c759-4926-8888-67a04a1afee9 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:11.698028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbbb806-c759-4926-8888-67a04a1afee9 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:11.698791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbb806-c759-4926-8888-67a04a1afee9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:11.699096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbb806-c759-4926-8888-67a04a1afee9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:11.700612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbbb806-c759-4926-8888-67a04a1afee9 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:11.721946 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 455/918] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Oct 24 08:39:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:11.728803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13358ac7-3d15-44be-a086-01ffbcc4d2cc None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:11.865028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13358ac7-3d15-44be-a086-01ffbcc4d2cc None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:11.912569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf444ed-25cb-4f9b-b68a-53d8195e2b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:11.913357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf444ed-25cb-4f9b-b68a-53d8195e2b78 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:11.913529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf444ed-25cb-4f9b-b68a-53d8195e2b78 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:11.913810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf444ed-25cb-4f9b-b68a-53d8195e2b78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:11.928197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf444ed-25cb-4f9b-b68a-53d8195e2b78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:11.929922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf444ed-25cb-4f9b-b68a-53d8195e2b78 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-8cf444ed-25cb-4f9b-b68a-53d8195e2b78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:39:11.947592 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:11.948770 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:39:11.949922 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:39:11.949922 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:11.949922 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:11.949922 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 464/919] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:11.954410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbb806-c759-4926-8888-67a04a1afee9 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:11.980060 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:12.083720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbbb806-c759-4926-8888-67a04a1afee9 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:12.132210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464543ea-0d75-4b17-bdb5-2918c604f37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:12.132830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464543ea-0d75-4b17-bdb5-2918c604f37f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:12.133459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464543ea-0d75-4b17-bdb5-2918c604f37f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:12.133459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464543ea-0d75-4b17-bdb5-2918c604f37f None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:12.134107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464543ea-0d75-4b17-bdb5-2918c604f37f None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:12.134402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464543ea-0d75-4b17-bdb5-2918c604f37f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:12.135821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464543ea-0d75-4b17-bdb5-2918c604f37f None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:12.151906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 456/920] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:12.159392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf444ed-25cb-4f9b-b68a-53d8195e2b78 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:12.177252 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:12.283946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf444ed-25cb-4f9b-b68a-53d8195e2b78 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:12.331781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b329ac-79f0-4e4d-b5d1-d35429a3248f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:12.332431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b329ac-79f0-4e4d-b5d1-d35429a3248f None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:12.332697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b329ac-79f0-4e4d-b5d1-d35429a3248f None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:12.332994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b329ac-79f0-4e4d-b5d1-d35429a3248f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:12.341011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b329ac-79f0-4e4d-b5d1-d35429a3248f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:12.342674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b329ac-79f0-4e4d-b5d1-d35429a3248f None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-81b329ac-79f0-4e4d-b5d1-d35429a3248f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:39:12.358283 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:12.359434 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:12.360477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:39:12.360477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:39:12.360477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:39:12.360477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:39:12.360477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:39:12.360477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:39:12.360477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:39:12.360477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:12.364449 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 465/921] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:39:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:12.365831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464543ea-0d75-4b17-bdb5-2918c604f37f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:12.469452 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:12.497411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464543ea-0d75-4b17-bdb5-2918c604f37f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:12.539758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644de4a4-b943-48ee-b4d4-b252ded8ea32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:12.540400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644de4a4-b943-48ee-b4d4-b252ded8ea32 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:12.540833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644de4a4-b943-48ee-b4d4-b252ded8ea32 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:12.541396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644de4a4-b943-48ee-b4d4-b252ded8ea32 None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:12.542429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644de4a4-b943-48ee-b4d4-b252ded8ea32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:12.542798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644de4a4-b943-48ee-b4d4-b252ded8ea32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:12.544661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644de4a4-b943-48ee-b4d4-b252ded8ea32 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:12.561894 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 457/922] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:39:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:12.571072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b329ac-79f0-4e4d-b5d1-d35429a3248f None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:12.657503 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:12.690035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b329ac-79f0-4e4d-b5d1-d35429a3248f None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:12.743121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91afc49a-7f01-435f-99f1-75e0c654546d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:12.744207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afc49a-7f01-435f-99f1-75e0c654546d None admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:12.744702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afc49a-7f01-435f-99f1-75e0c654546d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:12.745246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91afc49a-7f01-435f-99f1-75e0c654546d None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/dc17e1ac24064752b59ca2438dfdac4c/roles/9f1d8ee2ec724d0cbb41c537a7d38406` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:12.767044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afc49a-7f01-435f-99f1-75e0c654546d None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=dc17e1ac24064752b59ca2438dfdac4c, role_id=9f1d8ee2ec724d0cbb41c537a7d38406)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:12.768998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91afc49a-7f01-435f-99f1-75e0c654546d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:12.790692 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 466/923] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:39:12 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/dc17e1ac24064752b59ca2438dfdac4c/roles/9f1d8ee2ec724d0cbb41c537a7d38406 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:39:15.139104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d6db4-152b-4f8d-b99f-c2388532209c None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:15.139697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d6db4-152b-4f8d-b99f-c2388532209c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:15.139697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32d6db4-152b-4f8d-b99f-c2388532209c None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:15.141182 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 458/924] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:39:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:39:15.151096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69383038-07d1-4b30-8fc1-9bb1a0d52849 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:15.151096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69383038-07d1-4b30-8fc1-9bb1a0d52849 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:15.151096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69383038-07d1-4b30-8fc1-9bb1a0d52849 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:15.172154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-69383038-07d1-4b30-8fc1-9bb1a0d52849 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:39:15.173312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-69383038-07d1-4b30-8fc1-9bb1a0d52849 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:39:15.246008 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 467/925] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:39:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:39:15.516653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d6db4-152b-4f8d-b99f-c2388532209c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:15.621209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32d6db4-152b-4f8d-b99f-c2388532209c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:15.659231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa716f-06a2-4209-ac6b-b942f4f5ad1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:15.659886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa716f-06a2-4209-ac6b-b942f4f5ad1f None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:15.660207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa716f-06a2-4209-ac6b-b942f4f5ad1f None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:15.660516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa716f-06a2-4209-ac6b-b942f4f5ad1f None admin] PATH_INFO: `/v3/roles/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:15.669253 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:15.673623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa716f-06a2-4209-ac6b-b942f4f5ad1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-79aa716f-06a2-4209-ac6b-b942f4f5ad1f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:39:15.679120 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:15.680227 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 24 08:39:15.681190 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:15.688485 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 459/926] 10.222.0.25 () {56 vars in 1102 bytes} [Mon Oct 24 08:39:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:15.688659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69383038-07d1-4b30-8fc1-9bb1a0d52849 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:15.750222 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:15.802973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69383038-07d1-4b30-8fc1-9bb1a0d52849 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:15.840614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc3279-d26c-4fb5-a797-4d8cadbeb730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:15.841507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3279-d26c-4fb5-a797-4d8cadbeb730 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:15.841963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3279-d26c-4fb5-a797-4d8cadbeb730 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:15.842384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfc3279-d26c-4fb5-a797-4d8cadbeb730 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:15.843199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc3279-d26c-4fb5-a797-4d8cadbeb730 None admin] RBAC: Adding query filter params (name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:15.843659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc3279-d26c-4fb5-a797-4d8cadbeb730 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:15.845190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfc3279-d26c-4fb5-a797-4d8cadbeb730 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:15.853928 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 468/927] 10.222.0.25 () {56 vars in 1103 bytes} [Mon Oct 24 08:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:15.860317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa716f-06a2-4209-ac6b-b942f4f5ad1f None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:15.979056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa716f-06a2-4209-ac6b-b942f4f5ad1f None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:16.016518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f108277-307c-4639-915a-86b0e051e022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:16.017149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f108277-307c-4639-915a-86b0e051e022 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:16.017464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f108277-307c-4639-915a-86b0e051e022 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:16.017747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f108277-307c-4639-915a-86b0e051e022 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:16.028395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f108277-307c-4639-915a-86b0e051e022 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:16.029886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f108277-307c-4639-915a-86b0e051e022 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-4f108277-307c-4639-915a-86b0e051e022 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:39:16.048247 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:16.049363 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:39:16.050297 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:39:16.050297 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:16.050297 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:16.050297 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 460/928] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:16.056110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc3279-d26c-4fb5-a797-4d8cadbeb730 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:16.167123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfc3279-d26c-4fb5-a797-4d8cadbeb730 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:16.183955 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:16.202974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed67dd-9dc9-414f-bf6a-2663c16475eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:16.203643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed67dd-9dc9-414f-bf6a-2663c16475eb None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:16.203889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed67dd-9dc9-414f-bf6a-2663c16475eb None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:16.204157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed67dd-9dc9-414f-bf6a-2663c16475eb None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:16.204790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed67dd-9dc9-414f-bf6a-2663c16475eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:16.205093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed67dd-9dc9-414f-bf6a-2663c16475eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:16.206485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fed67dd-9dc9-414f-bf6a-2663c16475eb None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:16.219348 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 469/929] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:16.225216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f108277-307c-4639-915a-86b0e051e022 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:16.284560 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:16.343668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f108277-307c-4639-915a-86b0e051e022 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:16.382817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6131c8e-d353-4d52-adcc-950819eaeb2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:16.383500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6131c8e-d353-4d52-adcc-950819eaeb2e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:16.383757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6131c8e-d353-4d52-adcc-950819eaeb2e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:16.384108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6131c8e-d353-4d52-adcc-950819eaeb2e None admin] PATH_INFO: `/v3/users/placement` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:16.392499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6131c8e-d353-4d52-adcc-950819eaeb2e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:16.394041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6131c8e-d353-4d52-adcc-950819eaeb2e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-b6131c8e-d353-4d52-adcc-950819eaeb2e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:39:16.405907 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:16.407458 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:16.408974 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 461/930] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:16 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:16.413671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed67dd-9dc9-414f-bf6a-2663c16475eb None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:16.520469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed67dd-9dc9-414f-bf6a-2663c16475eb None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:16.557050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952febbb-01ff-49eb-8503-a7a654ee895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:16.557681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952febbb-01ff-49eb-8503-a7a654ee895e None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:16.557945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952febbb-01ff-49eb-8503-a7a654ee895e None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:16.558270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952febbb-01ff-49eb-8503-a7a654ee895e None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:16.558946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952febbb-01ff-49eb-8503-a7a654ee895e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:16.559246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952febbb-01ff-49eb-8503-a7a654ee895e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:16.560757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952febbb-01ff-49eb-8503-a7a654ee895e None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:16.578641 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 470/931] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Oct 24 08:39:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:16.584633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6131c8e-d353-4d52-adcc-950819eaeb2e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:16.702906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6131c8e-d353-4d52-adcc-950819eaeb2e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:16.716638 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:16.747611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05814f36-c53d-4455-9a9e-d101290f2b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:16.748295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05814f36-c53d-4455-9a9e-d101290f2b5e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:16.748683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05814f36-c53d-4455-9a9e-d101290f2b5e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:16.749121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05814f36-c53d-4455-9a9e-d101290f2b5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:16.827180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05814f36-c53d-4455-9a9e-d101290f2b5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:16.828756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05814f36-c53d-4455-9a9e-d101290f2b5e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:16.940076 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 462/932] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:39:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 08:39:16.946880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952febbb-01ff-49eb-8503-a7a654ee895e None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:16.982498 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:17.061196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952febbb-01ff-49eb-8503-a7a654ee895e None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:17.097740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cda90f-d4ea-4b26-9221-409df1ebdf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:17.098378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cda90f-d4ea-4b26-9221-409df1ebdf79 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:17.098656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cda90f-d4ea-4b26-9221-409df1ebdf79 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:17.098926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cda90f-d4ea-4b26-9221-409df1ebdf79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:17.110081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cda90f-d4ea-4b26-9221-409df1ebdf79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:17.111590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43cda90f-d4ea-4b26-9221-409df1ebdf79 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-43cda90f-d4ea-4b26-9221-409df1ebdf79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:39:17.129596 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:17.130803 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:39:17.132638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:39:17.132638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:17.132638 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:17.132638 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 471/933] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 24 08:39:17.137461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05814f36-c53d-4455-9a9e-d101290f2b5e None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:17.151848 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:17.252355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05814f36-c53d-4455-9a9e-d101290f2b5e None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:17.294655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f96047-f965-4091-b637-754adcf34d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:17.295505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f96047-f965-4091-b637-754adcf34d30 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:17.295870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f96047-f965-4091-b637-754adcf34d30 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:17.296078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f96047-f965-4091-b637-754adcf34d30 None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:17.296734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f96047-f965-4091-b637-754adcf34d30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:17.297036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f96047-f965-4091-b637-754adcf34d30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:17.298519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f96047-f965-4091-b637-754adcf34d30 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:17.311747 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 463/934] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:17.317494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cda90f-d4ea-4b26-9221-409df1ebdf79 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:17.413365 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:17.430951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cda90f-d4ea-4b26-9221-409df1ebdf79 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:17.467521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5e4b4-6397-4a0c-9261-1785276a9ded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:17.468160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5e4b4-6397-4a0c-9261-1785276a9ded None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:17.468476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5e4b4-6397-4a0c-9261-1785276a9ded None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:17.468735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5e4b4-6397-4a0c-9261-1785276a9ded None admin] PATH_INFO: `/v3/projects/service` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:17.477699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5e4b4-6397-4a0c-9261-1785276a9ded None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:17.479512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5e4b4-6397-4a0c-9261-1785276a9ded None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-1ac5e4b4-6397-4a0c-9261-1785276a9ded None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:39:17.492838 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:17.494015 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:17.495064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:39:17.495064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:39:17.495064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:39:17.495064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:39:17.495064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:39:17.495064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:39:17.495064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:39:17.495064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:17.495064 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 472/935] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:17.499972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f96047-f965-4091-b637-754adcf34d30 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:17.580555 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:17.617755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f96047-f965-4091-b637-754adcf34d30 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:17.657793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259e86b-86db-4e01-a7be-ac5898a31cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:17.658510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259e86b-86db-4e01-a7be-ac5898a31cbc None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:17.658795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259e86b-86db-4e01-a7be-ac5898a31cbc None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:17.659072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259e86b-86db-4e01-a7be-ac5898a31cbc None admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:17.659875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259e86b-86db-4e01-a7be-ac5898a31cbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:17.660239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259e86b-86db-4e01-a7be-ac5898a31cbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:17.661761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259e86b-86db-4e01-a7be-ac5898a31cbc None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:17.677413 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 464/936] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:17.684126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5e4b4-6397-4a0c-9261-1785276a9ded None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:17.793003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5e4b4-6397-4a0c-9261-1785276a9ded None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:17.831056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143b3d3-e769-4ace-ba2b-180ae8e0aa40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:17.831575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b3d3-e769-4ace-ba2b-180ae8e0aa40 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:17.831851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b3d3-e769-4ace-ba2b-180ae8e0aa40 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:17.832123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143b3d3-e769-4ace-ba2b-180ae8e0aa40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:17.832837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b3d3-e769-4ace-ba2b-180ae8e0aa40 None admin] RBAC: Adding query filter params (role.id=9f1d8ee2ec724d0cbb41c537a7d38406, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=dc17e1ac24064752b59ca2438dfdac4c) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:17.833145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b3d3-e769-4ace-ba2b-180ae8e0aa40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:17.835157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143b3d3-e769-4ace-ba2b-180ae8e0aa40 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:17.841110 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 473/937] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:39:17 2022] GET /identity/v3/role_assignments?user.id=dc17e1ac24064752b59ca2438dfdac4c&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=9f1d8ee2ec724d0cbb41c537a7d38406 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:20.185688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03229a96-d862-4a31-877f-34bab7e9b7e9 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:20.186213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03229a96-d862-4a31-877f-34bab7e9b7e9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:20.186741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03229a96-d862-4a31-877f-34bab7e9b7e9 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:20.189396 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 465/938] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:39:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:39:20.197825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bd045-3c7b-4aa3-94a5-908c7869798f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:20.198371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bd045-3c7b-4aa3-94a5-908c7869798f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:20.198478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2bd045-3c7b-4aa3-94a5-908c7869798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:20.217891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fb2bd045-3c7b-4aa3-94a5-908c7869798f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:39:20.219373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb2bd045-3c7b-4aa3-94a5-908c7869798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:39:20.223128 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:20.308663 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 474/939] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:39:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:39:20.586752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03229a96-d862-4a31-877f-34bab7e9b7e9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:20.717751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03229a96-d862-4a31-877f-34bab7e9b7e9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:20.753565 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:20.759914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395313a-35d8-4082-91ea-badc43e219ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:20.760563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395313a-35d8-4082-91ea-badc43e219ed None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:20.760815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395313a-35d8-4082-91ea-badc43e219ed None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:20.761089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7395313a-35d8-4082-91ea-badc43e219ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:20.771372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7395313a-35d8-4082-91ea-badc43e219ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-7395313a-35d8-4082-91ea-badc43e219ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:39:20.776590 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:20.777713 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:20.778676 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 466/940] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:39:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:20.783923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bd045-3c7b-4aa3-94a5-908c7869798f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:20.892343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2bd045-3c7b-4aa3-94a5-908c7869798f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:20.931251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86461fc2-4527-446e-a223-ea7e545708e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:20.931868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86461fc2-4527-446e-a223-ea7e545708e4 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:20.932146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86461fc2-4527-446e-a223-ea7e545708e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:20.932506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86461fc2-4527-446e-a223-ea7e545708e4 None admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:20.933074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86461fc2-4527-446e-a223-ea7e545708e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:20.933400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86461fc2-4527-446e-a223-ea7e545708e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:20.934763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86461fc2-4527-446e-a223-ea7e545708e4 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:20.944270 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 475/941] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:39:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:20.950765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395313a-35d8-4082-91ea-badc43e219ed None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:21.071180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7395313a-35d8-4082-91ea-badc43e219ed None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:21.115929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcd09a-0f1e-4ecc-8f5b-89de6d1c144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:21.116590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcd09a-0f1e-4ecc-8f5b-89de6d1c144c None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:21.117090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcd09a-0f1e-4ecc-8f5b-89de6d1c144c None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:21.117385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fcd09a-0f1e-4ecc-8f5b-89de6d1c144c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:21.127668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcd09a-0f1e-4ecc-8f5b-89de6d1c144c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:21.129102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fcd09a-0f1e-4ecc-8f5b-89de6d1c144c None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-38fcd09a-0f1e-4ecc-8f5b-89de6d1c144c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:39:21.146354 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:21.148604 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:39:21.149738 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:39:21.149738 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:21.149738 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:21.149738 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 467/942] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:21.154164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86461fc2-4527-446e-a223-ea7e545708e4 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:21.157287 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:21.268693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86461fc2-4527-446e-a223-ea7e545708e4 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:21.312936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681474b-6aa4-4873-be14-ede4d337725d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:21.313677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681474b-6aa4-4873-be14-ede4d337725d None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:21.313969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681474b-6aa4-4873-be14-ede4d337725d None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:21.314238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3681474b-6aa4-4873-be14-ede4d337725d None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:21.314931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681474b-6aa4-4873-be14-ede4d337725d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:21.315337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681474b-6aa4-4873-be14-ede4d337725d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:21.316900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3681474b-6aa4-4873-be14-ede4d337725d None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:21.337161 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 476/943] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:21.345512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcd09a-0f1e-4ecc-8f5b-89de6d1c144c None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:21.400262 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:21.479343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fcd09a-0f1e-4ecc-8f5b-89de6d1c144c None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:21.530233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7206c6-a109-4fd1-a208-8377b6909e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:21.531263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7206c6-a109-4fd1-a208-8377b6909e90 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:21.531748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7206c6-a109-4fd1-a208-8377b6909e90 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:21.532237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7206c6-a109-4fd1-a208-8377b6909e90 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:21.544418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7206c6-a109-4fd1-a208-8377b6909e90 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:21.547093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7206c6-a109-4fd1-a208-8377b6909e90 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-6d7206c6-a109-4fd1-a208-8377b6909e90 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:39:21.564597 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:21.565866 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:39:21.567115 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:21.571189 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 468/944] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:21.577368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681474b-6aa4-4873-be14-ede4d337725d None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:21.660882 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:21.707406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3681474b-6aa4-4873-be14-ede4d337725d None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:21.746989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a3579-6afb-44eb-a03d-dfe91a70cce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:21.747612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a3579-6afb-44eb-a03d-dfe91a70cce8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:21.747890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a3579-6afb-44eb-a03d-dfe91a70cce8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:21.748164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a3579-6afb-44eb-a03d-dfe91a70cce8 None admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:21.748900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a3579-6afb-44eb-a03d-dfe91a70cce8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:21.749207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a3579-6afb-44eb-a03d-dfe91a70cce8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:21.750699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a3579-6afb-44eb-a03d-dfe91a70cce8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:21.772519 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 477/945] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Oct 24 08:39:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:21.778502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7206c6-a109-4fd1-a208-8377b6909e90 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:21.894001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7206c6-a109-4fd1-a208-8377b6909e90 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:21.895614 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:21.934389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f367e-5430-494e-8684-0b629865ffc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:21.934936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f367e-5430-494e-8684-0b629865ffc5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:21.935220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f367e-5430-494e-8684-0b629865ffc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:21.935493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156f367e-5430-494e-8684-0b629865ffc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:21.948225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f367e-5430-494e-8684-0b629865ffc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:21.949879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156f367e-5430-494e-8684-0b629865ffc5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-156f367e-5430-494e-8684-0b629865ffc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:39:21.965450 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:21.966898 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:39:21.967817 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:39:21.967817 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:21.967817 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:21.967817 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 469/946] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:21.972744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a3579-6afb-44eb-a03d-dfe91a70cce8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:22.103272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a3579-6afb-44eb-a03d-dfe91a70cce8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:22.128397 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:22.147876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e8efd-b289-43fe-925c-3eead6dd99bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:22.148433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e8efd-b289-43fe-925c-3eead6dd99bf None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:22.148731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e8efd-b289-43fe-925c-3eead6dd99bf None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:22.149006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e8efd-b289-43fe-925c-3eead6dd99bf None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:22.149783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e8efd-b289-43fe-925c-3eead6dd99bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:22.150152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e8efd-b289-43fe-925c-3eead6dd99bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:22.151639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e8efd-b289-43fe-925c-3eead6dd99bf None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:22.170365 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 478/947] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:39:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:22.171937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f367e-5430-494e-8684-0b629865ffc5 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:22.291863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156f367e-5430-494e-8684-0b629865ffc5 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:22.336039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679bcf-188d-445d-84c4-595537488056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:22.336685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679bcf-188d-445d-84c4-595537488056 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:22.336965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679bcf-188d-445d-84c4-595537488056 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:22.337239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d679bcf-188d-445d-84c4-595537488056 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:22.344974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d679bcf-188d-445d-84c4-595537488056 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:22.346784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d679bcf-188d-445d-84c4-595537488056 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1d679bcf-188d-445d-84c4-595537488056 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:39:22.359974 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:22.361165 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:22.367276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:39:22.367276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:39:22.367276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:39:22.367276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:39:22.367276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:39:22.367276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:39:22.367276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:39:22.367276 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:22.367276 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 470/948] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:39:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:22.367830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e8efd-b289-43fe-925c-3eead6dd99bf None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:22.483129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e8efd-b289-43fe-925c-3eead6dd99bf None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:22.523601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5731138d-1ab3-4ace-911f-e72d7afed290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:22.524215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731138d-1ab3-4ace-911f-e72d7afed290 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:22.524497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731138d-1ab3-4ace-911f-e72d7afed290 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:22.524774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5731138d-1ab3-4ace-911f-e72d7afed290 None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:22.525497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731138d-1ab3-4ace-911f-e72d7afed290 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:22.525805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731138d-1ab3-4ace-911f-e72d7afed290 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:22.527244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5731138d-1ab3-4ace-911f-e72d7afed290 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:22.539975 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 479/949] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:39:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:22.545812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679bcf-188d-445d-84c4-595537488056 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:22.568321 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:22.680214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d679bcf-188d-445d-84c4-595537488056 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:22.722904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354813e6-cdb3-4872-98e4-d72f6c04e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:22.723972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354813e6-cdb3-4872-98e4-d72f6c04e0be None admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:22.724460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354813e6-cdb3-4872-98e4-d72f6c04e0be None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:22.724974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354813e6-cdb3-4872-98e4-d72f6c04e0be None admin] PATH_INFO: `/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/dc17e1ac24064752b59ca2438dfdac4c/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:22.728251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354813e6-cdb3-4872-98e4-d72f6c04e0be None admin] RBAC: Authorizing `identity:create_grant(project_id=de695f740e9e4a4f8197694b0f0db773, user_id=dc17e1ac24064752b59ca2438dfdac4c, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:22.730303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354813e6-cdb3-4872-98e4-d72f6c04e0be None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:22.747616 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 471/950] 10.222.0.25 () {58 vars in 1439 bytes} [Mon Oct 24 08:39:22 2022] PUT /identity/v3/projects/de695f740e9e4a4f8197694b0f0db773/users/dc17e1ac24064752b59ca2438dfdac4c/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:39:24.997569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf7ff-4c60-4f4a-aa1d-0c7dc1d34566 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:24.998153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf7ff-4c60-4f4a-aa1d-0c7dc1d34566 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:24.998153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1bf7ff-4c60-4f4a-aa1d-0c7dc1d34566 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:24.999453 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 480/951] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:39:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:39:25.005807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17a386-d525-4b79-9aff-5699485b6a85 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:25.006326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17a386-d525-4b79-9aff-5699485b6a85 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:25.006559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc17a386-d525-4b79-9aff-5699485b6a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:25.028508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fc17a386-d525-4b79-9aff-5699485b6a85 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:39:25.029853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fc17a386-d525-4b79-9aff-5699485b6a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:39:25.130899 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 472/952] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:39:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:39:25.453358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf7ff-4c60-4f4a-aa1d-0c7dc1d34566 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:25.507158 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:25.590081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1bf7ff-4c60-4f4a-aa1d-0c7dc1d34566 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:25.633071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b147a8-7d65-4601-a71a-8775e9461968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:25.633734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b147a8-7d65-4601-a71a-8775e9461968 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:25.634016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b147a8-7d65-4601-a71a-8775e9461968 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:25.634349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b147a8-7d65-4601-a71a-8775e9461968 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:25.646084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b147a8-7d65-4601-a71a-8775e9461968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d2b147a8-7d65-4601-a71a-8775e9461968 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 24 08:39:25.652412 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:25.653696 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:25.661024 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 481/953] 10.222.0.25 () {56 vars in 1096 bytes} [Mon Oct 24 08:39:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:25.661795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17a386-d525-4b79-9aff-5699485b6a85 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:25.664310 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:25.780589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc17a386-d525-4b79-9aff-5699485b6a85 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:25.820317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b4307-bdfe-412e-8f21-74b3d28041db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:25.820911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b4307-bdfe-412e-8f21-74b3d28041db None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:25.821204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b4307-bdfe-412e-8f21-74b3d28041db None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:25.821493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21b4307-bdfe-412e-8f21-74b3d28041db None admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:25.822160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b4307-bdfe-412e-8f21-74b3d28041db None admin] RBAC: Adding query filter params (name=admin) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:25.822465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b4307-bdfe-412e-8f21-74b3d28041db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:25.823830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21b4307-bdfe-412e-8f21-74b3d28041db None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:25.832549 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 473/954] 10.222.0.25 () {56 vars in 1099 bytes} [Mon Oct 24 08:39:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:25.838713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b147a8-7d65-4601-a71a-8775e9461968 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:25.967545 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:25.971473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b147a8-7d65-4601-a71a-8775e9461968 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:26.023518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38f72f-453f-4809-b8e0-768a982f88ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:26.024211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f72f-453f-4809-b8e0-768a982f88ea None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:26.024438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f72f-453f-4809-b8e0-768a982f88ea None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:26.024717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38f72f-453f-4809-b8e0-768a982f88ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:26.037181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38f72f-453f-4809-b8e0-768a982f88ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:26.039399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38f72f-453f-4809-b8e0-768a982f88ea None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-eb38f72f-453f-4809-b8e0-768a982f88ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:39:26.057156 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:26.064876 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:39:26.065909 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:39:26.065909 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:26.065909 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:26.065909 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 482/955] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:26.066144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b4307-bdfe-412e-8f21-74b3d28041db None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:26.146778 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:26.201003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21b4307-bdfe-412e-8f21-74b3d28041db None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:26.248924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d8ba4-7e7e-4c46-9ba9-27e485011e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:26.249856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d8ba4-7e7e-4c46-9ba9-27e485011e8d None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:26.250221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d8ba4-7e7e-4c46-9ba9-27e485011e8d None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:26.250615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9d8ba4-7e7e-4c46-9ba9-27e485011e8d None admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:26.251772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d8ba4-7e7e-4c46-9ba9-27e485011e8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:26.252306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d8ba4-7e7e-4c46-9ba9-27e485011e8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:26.254334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9d8ba4-7e7e-4c46-9ba9-27e485011e8d None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:26.276814 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 474/956] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:39:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:39:26.283316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38f72f-453f-4809-b8e0-768a982f88ea None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:26.402741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38f72f-453f-4809-b8e0-768a982f88ea None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:26.439057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3619c-f2fa-4110-8e63-d1ed5674f2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:26.439695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3619c-f2fa-4110-8e63-d1ed5674f2a8 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:26.439975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3619c-f2fa-4110-8e63-d1ed5674f2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:26.440244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3619c-f2fa-4110-8e63-d1ed5674f2a8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:26.449190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3619c-f2fa-4110-8e63-d1ed5674f2a8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:26.450681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3619c-f2fa-4110-8e63-d1ed5674f2a8 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-8cb3619c-f2fa-4110-8e63-d1ed5674f2a8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 08:39:26.465236 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:26.466438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:26.467609 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 483/957] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:26.472892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d8ba4-7e7e-4c46-9ba9-27e485011e8d None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:26.598198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9d8ba4-7e7e-4c46-9ba9-27e485011e8d None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:26.628300 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:26.639396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b531b1-197e-45ae-a7b9-be1f39869396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:26.640061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b531b1-197e-45ae-a7b9-be1f39869396 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:26.640340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b531b1-197e-45ae-a7b9-be1f39869396 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:26.640612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b531b1-197e-45ae-a7b9-be1f39869396 None admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:26.641466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b531b1-197e-45ae-a7b9-be1f39869396 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:26.641855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b531b1-197e-45ae-a7b9-be1f39869396 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:26.643435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b531b1-197e-45ae-a7b9-be1f39869396 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:26.664017 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 475/958] 10.222.0.25 () {56 vars in 1143 bytes} [Mon Oct 24 08:39:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:26.670427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3619c-f2fa-4110-8e63-d1ed5674f2a8 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:26.690605 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:26.797140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3619c-f2fa-4110-8e63-d1ed5674f2a8 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:26.840870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4263a-b2a7-4fdd-92ce-b47b715322e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:26.841535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4263a-b2a7-4fdd-92ce-b47b715322e5 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:26.841795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4263a-b2a7-4fdd-92ce-b47b715322e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:26.842331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d4263a-b2a7-4fdd-92ce-b47b715322e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:26.919112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4263a-b2a7-4fdd-92ce-b47b715322e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:26.920997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d4263a-b2a7-4fdd-92ce-b47b715322e5 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:26.936932 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:27.054639 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 484/959] 10.222.0.25 () {58 vars in 1282 bytes} [Mon Oct 24 08:39:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Oct 24 08:39:27.061255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b531b1-197e-45ae-a7b9-be1f39869396 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:27.204088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b531b1-197e-45ae-a7b9-be1f39869396 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:27.245690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56281-26fe-4ddd-84e6-cef50b68caaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:27.246372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56281-26fe-4ddd-84e6-cef50b68caaf None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:27.246752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56281-26fe-4ddd-84e6-cef50b68caaf None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:27.247109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db56281-26fe-4ddd-84e6-cef50b68caaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:27.261182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56281-26fe-4ddd-84e6-cef50b68caaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:27.262705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db56281-26fe-4ddd-84e6-cef50b68caaf None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1db56281-26fe-4ddd-84e6-cef50b68caaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 08:39:27.289246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:27.291637 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 24 08:39:27.293922 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 08:39:27.293922 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 24 08:39:27.293922 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:27.293922 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 476/960] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:27.300650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4263a-b2a7-4fdd-92ce-b47b715322e5 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:27.417154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d4263a-b2a7-4fdd-92ce-b47b715322e5 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:27.433321 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:27.459753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c27f73-8b51-4a16-8982-3462fa951d48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:27.460302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c27f73-8b51-4a16-8982-3462fa951d48 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:27.460586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c27f73-8b51-4a16-8982-3462fa951d48 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:27.460866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c27f73-8b51-4a16-8982-3462fa951d48 None admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:27.461729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c27f73-8b51-4a16-8982-3462fa951d48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:27.462037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c27f73-8b51-4a16-8982-3462fa951d48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:27.463796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c27f73-8b51-4a16-8982-3462fa951d48 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:27.477184 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 485/961] 10.222.0.25 () {56 vars in 1109 bytes} [Mon Oct 24 08:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:27.483354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56281-26fe-4ddd-84e6-cef50b68caaf None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:27.531184 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:27.629948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db56281-26fe-4ddd-84e6-cef50b68caaf None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:27.669955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060be249-0f7e-4431-8586-3d7eb5c278e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:27.670602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060be249-0f7e-4431-8586-3d7eb5c278e6 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:27.670883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060be249-0f7e-4431-8586-3d7eb5c278e6 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:27.671257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060be249-0f7e-4431-8586-3d7eb5c278e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:27.680824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060be249-0f7e-4431-8586-3d7eb5c278e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:27.682363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060be249-0f7e-4431-8586-3d7eb5c278e6 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-060be249-0f7e-4431-8586-3d7eb5c278e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 24 08:39:27.695239 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:27.697026 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:27.698938 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 24 08:39:27.698938 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 24 08:39:27.698938 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 08:39:27.698938 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 08:39:27.698938 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 08:39:27.698938 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 08:39:27.698938 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 24 08:39:27.698938 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 08:39:27.698938 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 477/962] 10.222.0.25 () {56 vars in 1111 bytes} [Mon Oct 24 08:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:27.704351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c27f73-8b51-4a16-8982-3462fa951d48 None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:27.822813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c27f73-8b51-4a16-8982-3462fa951d48 None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:27.861941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9a6d77-db82-4870-baf7-e3bb82fb35de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:27.862567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a6d77-db82-4870-baf7-e3bb82fb35de None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:27.862843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a6d77-db82-4870-baf7-e3bb82fb35de None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:27.863117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9a6d77-db82-4870-baf7-e3bb82fb35de None admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:27.863835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a6d77-db82-4870-baf7-e3bb82fb35de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:27.864151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a6d77-db82-4870-baf7-e3bb82fb35de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:27.865687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9a6d77-db82-4870-baf7-e3bb82fb35de None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:27.879855 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 486/963] 10.222.0.25 () {56 vars in 1148 bytes} [Mon Oct 24 08:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:27.886925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060be249-0f7e-4431-8586-3d7eb5c278e6 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:27.999904 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:28.008745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060be249-0f7e-4431-8586-3d7eb5c278e6 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:28.057865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db4a189-7399-4108-88c2-bd85cc0e4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:28.058880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a189-7399-4108-88c2-bd85cc0e4a79 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:28.059354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a189-7399-4108-88c2-bd85cc0e4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:28.059776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db4a189-7399-4108-88c2-bd85cc0e4a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:28.061025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4a189-7399-4108-88c2-bd85cc0e4a79 None admin] RBAC: Adding query filter params (role.id=d266f03406d94df8bb9cad19b577978f, scope.project.id=de695f740e9e4a4f8197694b0f0db773, user.id=dc17e1ac24064752b59ca2438dfdac4c) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:28.061598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4a189-7399-4108-88c2-bd85cc0e4a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:28.064204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db4a189-7399-4108-88c2-bd85cc0e4a79 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:28.073444 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 478/964] 10.222.0.25 () {56 vars in 1374 bytes} [Mon Oct 24 08:39:27 2022] GET /identity/v3/role_assignments?user.id=dc17e1ac24064752b59ca2438dfdac4c&scope.project.id=de695f740e9e4a4f8197694b0f0db773&role.id=d266f03406d94df8bb9cad19b577978f => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:30.298929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57bad3-7a54-45a7-a138-a66a30ef73bd None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:30.299485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57bad3-7a54-45a7-a138-a66a30ef73bd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:30.299769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57bad3-7a54-45a7-a138-a66a30ef73bd None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:30.301726 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 487/965] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:39:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:39:30.309260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7efa67-c1e4-4b6b-88c3-97f35d63d019 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:30.309918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7efa67-c1e4-4b6b-88c3-97f35d63d019 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:30.309918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7efa67-c1e4-4b6b-88c3-97f35d63d019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:30.331839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5b7efa67-c1e4-4b6b-88c3-97f35d63d019 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:39:30.333318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5b7efa67-c1e4-4b6b-88c3-97f35d63d019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:39:30.413165 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 479/966] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:39:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:39:30.684345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57bad3-7a54-45a7-a138-a66a30ef73bd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:30.719160 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:30.796634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57bad3-7a54-45a7-a138-a66a30ef73bd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:30.840390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ef76a-7069-4c54-a0d2-5804c1aa626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:30.841083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ef76a-7069-4c54-a0d2-5804c1aa626c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:30.841430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ef76a-7069-4c54-a0d2-5804c1aa626c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:30.841742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72ef76a-7069-4c54-a0d2-5804c1aa626c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:30.842374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ef76a-7069-4c54-a0d2-5804c1aa626c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:30.843846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72ef76a-7069-4c54-a0d2-5804c1aa626c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-b72ef76a-7069-4c54-a0d2-5804c1aa626c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:30.854617 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:30.856477 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:30.857910 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 488/967] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Oct 24 08:39:30 2022] GET /identity/v3/services/placement => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:30.863484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7efa67-c1e4-4b6b-88c3-97f35d63d019 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:30.966634 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:30.978197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7efa67-c1e4-4b6b-88c3-97f35d63d019 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:31.014159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d1619a-6bc4-4046-bb68-a15b4c8e5dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:31.014826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1619a-6bc4-4046-bb68-a15b4c8e5dc5 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:31.015141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1619a-6bc4-4046-bb68-a15b4c8e5dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:31.015451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d1619a-6bc4-4046-bb68-a15b4c8e5dc5 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:31.016123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1619a-6bc4-4046-bb68-a15b4c8e5dc5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:31.016461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1619a-6bc4-4046-bb68-a15b4c8e5dc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:31.017920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d1619a-6bc4-4046-bb68-a15b4c8e5dc5 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:31.023722 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 480/968] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Oct 24 08:39:30 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:31.032626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ef76a-7069-4c54-a0d2-5804c1aa626c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:31.135366 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:31.142649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72ef76a-7069-4c54-a0d2-5804c1aa626c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:31.178857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50157022-991b-4d0e-ac00-2e6b6d58b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:31.179526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157022-991b-4d0e-ac00-2e6b6d58b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:31.179844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157022-991b-4d0e-ac00-2e6b6d58b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:31.180156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50157022-991b-4d0e-ac00-2e6b6d58b0b0 None admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:31.180838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157022-991b-4d0e-ac00-2e6b6d58b0b0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:31.181178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157022-991b-4d0e-ac00-2e6b6d58b0b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:31.182676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50157022-991b-4d0e-ac00-2e6b6d58b0b0 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:31.187822 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 489/969] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Oct 24 08:39:31 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:33.464614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f0c2a-bc20-4e03-aa6f-7bb1f76c4449 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:33.465140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f0c2a-bc20-4e03-aa6f-7bb1f76c4449 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:33.465140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463f0c2a-bc20-4e03-aa6f-7bb1f76c4449 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:33.466616 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 481/970] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:39:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:39:33.472278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaa0d6-9bff-4988-9442-151350be4250 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:33.472807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaa0d6-9bff-4988-9442-151350be4250 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:33.472993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aaa0d6-9bff-4988-9442-151350be4250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:33.492851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-36aaa0d6-9bff-4988-9442-151350be4250 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:39:33.494143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-36aaa0d6-9bff-4988-9442-151350be4250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:39:33.565503 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 490/971] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:39:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:39:33.834353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f0c2a-bc20-4e03-aa6f-7bb1f76c4449 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:33.939410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463f0c2a-bc20-4e03-aa6f-7bb1f76c4449 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:33.973732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a49139-b979-4b64-bc3e-5fe4a8b0c3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:33.974339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a49139-b979-4b64-bc3e-5fe4a8b0c3f4 None admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:33.974649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a49139-b979-4b64-bc3e-5fe4a8b0c3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:33.974920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a49139-b979-4b64-bc3e-5fe4a8b0c3f4 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:33.975581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a49139-b979-4b64-bc3e-5fe4a8b0c3f4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:33.976945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a49139-b979-4b64-bc3e-5fe4a8b0c3f4 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:33.993458 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 482/972] 10.222.0.25 () {60 vars in 1141 bytes} [Mon Oct 24 08:39:33 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:39:36.192660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64849dc9-77d3-48ae-a7fc-21585964d4b3 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:36.193359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64849dc9-77d3-48ae-a7fc-21585964d4b3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:36.193359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64849dc9-77d3-48ae-a7fc-21585964d4b3 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:36.194614 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 491/973] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:39:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:39:36.199948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb7c3e-8a30-499c-bd2e-bdb051f8d23e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:36.200410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb7c3e-8a30-499c-bd2e-bdb051f8d23e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:36.200514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fb7c3e-8a30-499c-bd2e-bdb051f8d23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:36.219143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b3fb7c3e-8a30-499c-bd2e-bdb051f8d23e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:39:36.220333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b3fb7c3e-8a30-499c-bd2e-bdb051f8d23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:39:36.230456 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:36.307478 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 483/974] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:39:36 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 24 08:39:36.584199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64849dc9-77d3-48ae-a7fc-21585964d4b3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:36.685878 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:36.698287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64849dc9-77d3-48ae-a7fc-21585964d4b3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:36.735118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6bb39-b308-4999-99f2-e1367e1fab6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:36.735748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6bb39-b308-4999-99f2-e1367e1fab6c None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:36.736027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6bb39-b308-4999-99f2-e1367e1fab6c None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:36.736301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a6bb39-b308-4999-99f2-e1367e1fab6c None admin] PATH_INFO: `/v3/services/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:36.736875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6bb39-b308-4999-99f2-e1367e1fab6c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:36.738270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a6bb39-b308-4999-99f2-e1367e1fab6c None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-52a6bb39-b308-4999-99f2-e1367e1fab6c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:36.748092 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:36.750186 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:36.752169 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 492/975] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Oct 24 08:39:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:36.755893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb7c3e-8a30-499c-bd2e-bdb051f8d23e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:36.856053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fb7c3e-8a30-499c-bd2e-bdb051f8d23e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:36.891239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb33b52-64d0-4409-a207-fe6678cce7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:36.891845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33b52-64d0-4409-a207-fe6678cce7d8 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:36.892124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33b52-64d0-4409-a207-fe6678cce7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:36.892396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb33b52-64d0-4409-a207-fe6678cce7d8 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:36.893020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb33b52-64d0-4409-a207-fe6678cce7d8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:36.893344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb33b52-64d0-4409-a207-fe6678cce7d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:36.894717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb33b52-64d0-4409-a207-fe6678cce7d8 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:36.899929 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 484/976] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Oct 24 08:39:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:36.905927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6bb39-b308-4999-99f2-e1367e1fab6c None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:37.006864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a6bb39-b308-4999-99f2-e1367e1fab6c None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:37.040739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83271dc-bf13-4c64-bdd1-148a4d657f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:37.041370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83271dc-bf13-4c64-bdd1-148a4d657f45 None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:37.041653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83271dc-bf13-4c64-bdd1-148a4d657f45 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:37.041930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83271dc-bf13-4c64-bdd1-148a4d657f45 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:37.042630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83271dc-bf13-4c64-bdd1-148a4d657f45 None admin] RBAC: Adding query filter params (interface=public, service_id=3fa2c0818af9478fa646f76de9bff60d, region_id=RegionOne) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:37.042940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83271dc-bf13-4c64-bdd1-148a4d657f45 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:37.044313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83271dc-bf13-4c64-bdd1-148a4d657f45 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:37.049520 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 493/977] 10.222.0.25 () {56 vars in 1251 bytes} [Mon Oct 24 08:39:36 2022] GET /identity/v3/endpoints?service_id=3fa2c0818af9478fa646f76de9bff60d&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:37.055677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb33b52-64d0-4409-a207-fe6678cce7d8 None admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:37.059595 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:37.158973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb33b52-64d0-4409-a207-fe6678cce7d8 None admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:37.194225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309c44f8-b0d3-40a3-8968-96a80a1c6f9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:37.194849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c44f8-b0d3-40a3-8968-96a80a1c6f9e None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:37.195128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c44f8-b0d3-40a3-8968-96a80a1c6f9e None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:37.195420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309c44f8-b0d3-40a3-8968-96a80a1c6f9e None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:37.196038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c44f8-b0d3-40a3-8968-96a80a1c6f9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:37.197479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309c44f8-b0d3-40a3-8968-96a80a1c6f9e None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:37.205037 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 485/978] 10.222.0.25 () {56 vars in 1087 bytes} [Mon Oct 24 08:39:37 2022] GET /identity/v3/services => generated 2191 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:39:39.408524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50240bb-7a7b-4c76-b05e-9229a9c249b2 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:39.409046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50240bb-7a7b-4c76-b05e-9229a9c249b2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:39.409046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50240bb-7a7b-4c76-b05e-9229a9c249b2 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:39.410343 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 494/979] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:39:39.416136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137085d6-c233-416c-aefb-7ad65c78d7fb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:39.416566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137085d6-c233-416c-aefb-7ad65c78d7fb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:39.416694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137085d6-c233-416c-aefb-7ad65c78d7fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:39.435583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-137085d6-c233-416c-aefb-7ad65c78d7fb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:39:39.436786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-137085d6-c233-416c-aefb-7ad65c78d7fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:39:39.501374 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:39.507874 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 486/980] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:39:39 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 08:39:39.783014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50240bb-7a7b-4c76-b05e-9229a9c249b2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:39.802318 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:39.886667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50240bb-7a7b-4c76-b05e-9229a9c249b2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:39.919815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe093e-3c71-4fdd-9a2e-c9b748bd92dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:39.920441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe093e-3c71-4fdd-9a2e-c9b748bd92dd None admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:39.920719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe093e-3c71-4fdd-9a2e-c9b748bd92dd None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:39.920990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fe093e-3c71-4fdd-9a2e-c9b748bd92dd None admin] PATH_INFO: `/v3/services/placement` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:39.921592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe093e-3c71-4fdd-9a2e-c9b748bd92dd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:39.922964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fe093e-3c71-4fdd-9a2e-c9b748bd92dd None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-b6fe093e-3c71-4fdd-9a2e-c9b748bd92dd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 08:39:39.932636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 08:39:39.933871 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 08:39:39.934872 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 495/981] 10.222.0.25 () {56 vars in 1117 bytes} [Mon Oct 24 08:39:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 08:39:39.939885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137085d6-c233-416c-aefb-7ad65c78d7fb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:40.039264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137085d6-c233-416c-aefb-7ad65c78d7fb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:40.074356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fe884f-5107-4301-92d7-aff99e0b9d21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:40.074963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe884f-5107-4301-92d7-aff99e0b9d21 None admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:40.075244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe884f-5107-4301-92d7-aff99e0b9d21 None admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:40.075520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fe884f-5107-4301-92d7-aff99e0b9d21 None admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:40.076150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe884f-5107-4301-92d7-aff99e0b9d21 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:39:40.076452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe884f-5107-4301-92d7-aff99e0b9d21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:40.077852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fe884f-5107-4301-92d7-aff99e0b9d21 None admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:40.082980 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 487/982] 10.222.0.25 () {56 vars in 1116 bytes} [Mon Oct 24 08:39:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:39:40.088822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe093e-3c71-4fdd-9a2e-c9b748bd92dd None admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:39:40.170182 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:40.188249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fe093e-3c71-4fdd-9a2e-c9b748bd92dd None admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:39:40.220937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593f200b-5d7e-4b2a-a6f8-6a4b586038a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:39:40.221553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f200b-5d7e-4b2a-a6f8-6a4b586038a6 None admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:39:40.221827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f200b-5d7e-4b2a-a6f8-6a4b586038a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:39:40.222094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593f200b-5d7e-4b2a-a6f8-6a4b586038a6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:39:40.222755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f200b-5d7e-4b2a-a6f8-6a4b586038a6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:39:40.224103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593f200b-5d7e-4b2a-a6f8-6a4b586038a6 None admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:39:40.243796 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 496/983] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:39:40 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:39:50.079945 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=69 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:39:50.239049 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:48.282655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43648d57-f8f1-4d93-8921-eed826961eb5 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:48.284314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43648d57-f8f1-4d93-8921-eed826961eb5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:48.285319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43648d57-f8f1-4d93-8921-eed826961eb5 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:48.288366 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 488/984] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:40:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:48.296914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371d86-7e67-4ec6-ad1b-3df7201c5872 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:48.297791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371d86-7e67-4ec6-ad1b-3df7201c5872 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:48.297923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3371d86-7e67-4ec6-ad1b-3df7201c5872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:48.394781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c3371d86-7e67-4ec6-ad1b-3df7201c5872 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:48.395990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c3371d86-7e67-4ec6-ad1b-3df7201c5872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:48.525765 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 497/985] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:48.811873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a187-8a88-48a7-87ef-efc9796791d8 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:48.812136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a187-8a88-48a7-87ef-efc9796791d8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:48.812406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a498a187-8a88-48a7-87ef-efc9796791d8 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:48.814805 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 489/986] 10.222.0.25 () {54 vars in 964 bytes} [Mon Oct 24 08:40:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:48.821908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f56a-f732-44e9-be97-636dec0533ee None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:48.822197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f56a-f732-44e9-be97-636dec0533ee None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:48.822474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098f56a-f732-44e9-be97-636dec0533ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:48.915495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3098f56a-f732-44e9-be97-636dec0533ee None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:48.916735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3098f56a-f732-44e9-be97-636dec0533ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:48.941430 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:49.007833 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 498/987] 10.222.0.25 () {58 vars in 1061 bytes} [Mon Oct 24 08:40:48 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:49.017130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498a187-8a88-48a7-87ef-efc9796791d8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:49.019710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a498a187-8a88-48a7-87ef-efc9796791d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:49.161115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a498a187-8a88-48a7-87ef-efc9796791d8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:49.256391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886d61e-2751-4275-b4c1-068e55255486 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:49.257145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886d61e-2751-4275-b4c1-068e55255486 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:49.257446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886d61e-2751-4275-b4c1-068e55255486 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:49.257719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886d61e-2751-4275-b4c1-068e55255486 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:49.259566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e886d61e-2751-4275-b4c1-068e55255486 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:49.360698 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:49.470791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886d61e-2751-4275-b4c1-068e55255486 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:49.474535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886d61e-2751-4275-b4c1-068e55255486 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:49.513670 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 490/988] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:52.165273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d6a1e-deb3-46bc-aba4-9b7140a48f91 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:52.166034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d6a1e-deb3-46bc-aba4-9b7140a48f91 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:52.166034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50d6a1e-deb3-46bc-aba4-9b7140a48f91 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:52.167231 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 499/989] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:52.173429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89688b29-e4cf-49ac-9aeb-403ab8fd2e23 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:52.174154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89688b29-e4cf-49ac-9aeb-403ab8fd2e23 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:52.174154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89688b29-e4cf-49ac-9aeb-403ab8fd2e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:52.294351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-89688b29-e4cf-49ac-9aeb-403ab8fd2e23 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:52.296373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-89688b29-e4cf-49ac-9aeb-403ab8fd2e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:52.459883 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 491/990] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:40:52.758749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46f87c-c5be-43b2-acfa-c8ee1c70495d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:52.759037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46f87c-c5be-43b2-acfa-c8ee1c70495d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:52.759340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f46f87c-c5be-43b2-acfa-c8ee1c70495d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:52.760689 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 500/991] 10.222.0.25 () {54 vars in 964 bytes} [Mon Oct 24 08:40:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:52.767210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793e120-8ac8-43ed-bcd3-9c788d63f82e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:52.767492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793e120-8ac8-43ed-bcd3-9c788d63f82e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:52.767775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e793e120-8ac8-43ed-bcd3-9c788d63f82e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:52.780453 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:52.851963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e793e120-8ac8-43ed-bcd3-9c788d63f82e None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:52.853193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e793e120-8ac8-43ed-bcd3-9c788d63f82e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:52.931022 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 492/992] 10.222.0.25 () {58 vars in 1061 bytes} [Mon Oct 24 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:52.940423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46f87c-c5be-43b2-acfa-c8ee1c70495d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:52.942654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7f46f87c-c5be-43b2-acfa-c8ee1c70495d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:53.060896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f46f87c-c5be-43b2-acfa-c8ee1c70495d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:53.135629 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:53.138986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e43f8b0-7ea4-4ba9-9610-4a41545fcec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:53.139866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43f8b0-7ea4-4ba9-9610-4a41545fcec4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:53.140319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43f8b0-7ea4-4ba9-9610-4a41545fcec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:53.140827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e43f8b0-7ea4-4ba9-9610-4a41545fcec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:53.142554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e43f8b0-7ea4-4ba9-9610-4a41545fcec4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:53.259532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43f8b0-7ea4-4ba9-9610-4a41545fcec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:53.260988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e43f8b0-7ea4-4ba9-9610-4a41545fcec4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:53.282271 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 501/993] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:40:56.045496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17604-9335-4a3f-8e8a-6595aa6d40a2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:56.046119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17604-9335-4a3f-8e8a-6595aa6d40a2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:56.046119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c17604-9335-4a3f-8e8a-6595aa6d40a2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:56.047376 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 493/994] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:40:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:40:56.053947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb666b0-f7f5-4b25-8f8d-89749598133c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:56.054467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb666b0-f7f5-4b25-8f8d-89749598133c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:56.054609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb666b0-f7f5-4b25-8f8d-89749598133c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:56.122343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1bb666b0-f7f5-4b25-8f8d-89749598133c None None] MFA Rules not processed for user `fbcdd02eda2945e1b299f07489044358`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:40:56.123688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1bb666b0-f7f5-4b25-8f8d-89749598133c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:56.179753 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:56.227175 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 502/995] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:40:56 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:40:56.515667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c17604-9335-4a3f-8e8a-6595aa6d40a2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:40:56.518200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f7c17604-9335-4a3f-8e8a-6595aa6d40a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:56.638177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c17604-9335-4a3f-8e8a-6595aa6d40a2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:40:56.641121 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:40:56.751668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077630d-2c97-4c2d-b519-8518370598af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:40:56.752667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077630d-2c97-4c2d-b519-8518370598af service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:40:56.753086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077630d-2c97-4c2d-b519-8518370598af service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:40:56.754059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077630d-2c97-4c2d-b519-8518370598af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:40:56.756963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4077630d-2c97-4c2d-b519-8518370598af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:40:56.903366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077630d-2c97-4c2d-b519-8518370598af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:40:56.904835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077630d-2c97-4c2d-b519-8518370598af service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:40:56.927176 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 494/996] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:40:56 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:00.133320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb798e-f968-4b4f-a7e9-d6bb4f8abe05 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:00.133861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb798e-f968-4b4f-a7e9-d6bb4f8abe05 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:00.134169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bb798e-f968-4b4f-a7e9-d6bb4f8abe05 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:00.136505 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 503/997] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:00.142614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab477-e64a-44a6-984e-8b6aa0b53ebb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:00.143401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab477-e64a-44a6-984e-8b6aa0b53ebb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:00.143401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6ab477-e64a-44a6-984e-8b6aa0b53ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:00.186847 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:00.215311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ef6ab477-e64a-44a6-984e-8b6aa0b53ebb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:00.216531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ef6ab477-e64a-44a6-984e-8b6aa0b53ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:00.324168 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 495/998] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:00 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:00.614199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb798e-f968-4b4f-a7e9-d6bb4f8abe05 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:00.615745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-16bb798e-f968-4b4f-a7e9-d6bb4f8abe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:00.733410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16bb798e-f968-4b4f-a7e9-d6bb4f8abe05 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:00.821771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e61f7e-4bf6-4e6b-8ebf-8775957774d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:00.822502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61f7e-4bf6-4e6b-8ebf-8775957774d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:00.822800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61f7e-4bf6-4e6b-8ebf-8775957774d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:00.823168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e61f7e-4bf6-4e6b-8ebf-8775957774d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:00.824874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0e61f7e-4bf6-4e6b-8ebf-8775957774d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:00.834104 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:00.942734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e61f7e-4bf6-4e6b-8ebf-8775957774d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:00.944126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e61f7e-4bf6-4e6b-8ebf-8775957774d2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:00.974671 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 504/999] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:04.017158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963938bd-ce83-4bb9-8cee-672c83abcf39 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:04.017744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963938bd-ce83-4bb9-8cee-672c83abcf39 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:04.017744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963938bd-ce83-4bb9-8cee-672c83abcf39 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:04.019729 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 496/1000] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:04.025927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4551a-f05f-418e-8819-29380c34ba34 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:04.026467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4551a-f05f-418e-8819-29380c34ba34 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:04.026467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4551a-f05f-418e-8819-29380c34ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:04.104148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-27f4551a-f05f-418e-8819-29380c34ba34 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:04.105435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-27f4551a-f05f-418e-8819-29380c34ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:04.177585 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:04.234574 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 505/1001] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:04.524096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963938bd-ce83-4bb9-8cee-672c83abcf39 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:04.525793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-963938bd-ce83-4bb9-8cee-672c83abcf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:04.635914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963938bd-ce83-4bb9-8cee-672c83abcf39 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:04.652595 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:04.727052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3ae759-f26c-4608-88ec-66379fad0457 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:04.727652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae759-f26c-4608-88ec-66379fad0457 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:04.727931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae759-f26c-4608-88ec-66379fad0457 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:04.728200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3ae759-f26c-4608-88ec-66379fad0457 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:04.729839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f3ae759-f26c-4608-88ec-66379fad0457 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:04.855753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae759-f26c-4608-88ec-66379fad0457 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:04.857312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3ae759-f26c-4608-88ec-66379fad0457 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:04.876746 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 497/1002] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:07.152993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae9e6-4522-4cef-b858-f608aeba5ef7 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:07.153735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae9e6-4522-4cef-b858-f608aeba5ef7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:07.153735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3ae9e6-4522-4cef-b858-f608aeba5ef7 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:07.155007 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 506/1003] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:07.164619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab64d4-1f5c-43a7-8543-617fdf89301d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:07.165168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab64d4-1f5c-43a7-8543-617fdf89301d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:07.165900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab64d4-1f5c-43a7-8543-617fdf89301d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:07.225024 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:07.248607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-79ab64d4-1f5c-43a7-8543-617fdf89301d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:07.249876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-79ab64d4-1f5c-43a7-8543-617fdf89301d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:07.370257 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 498/1004] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:07.662266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ae9e6-4522-4cef-b858-f608aeba5ef7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:07.663841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1e3ae9e6-4522-4cef-b858-f608aeba5ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:07.793182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3ae9e6-4522-4cef-b858-f608aeba5ef7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:07.875738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be0a626-57a8-4fb1-a9c6-9d8a853eb5aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:07.876434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0a626-57a8-4fb1-a9c6-9d8a853eb5aa service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:07.876767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0a626-57a8-4fb1-a9c6-9d8a853eb5aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:07.877103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be0a626-57a8-4fb1-a9c6-9d8a853eb5aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:07.878935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3be0a626-57a8-4fb1-a9c6-9d8a853eb5aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:07.899244 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:08.007740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0a626-57a8-4fb1-a9c6-9d8a853eb5aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:08.009369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be0a626-57a8-4fb1-a9c6-9d8a853eb5aa service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:08.028661 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 507/1005] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:10.320863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf50c7-d8ec-4df0-8728-0677e6b3a559 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:10.321508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf50c7-d8ec-4df0-8728-0677e6b3a559 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:10.321664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abf50c7-d8ec-4df0-8728-0677e6b3a559 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:10.323302 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 499/1006] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:10.330558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeefcb8-1a8d-4871-9e59-b49786d53cb2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:10.331118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeefcb8-1a8d-4871-9e59-b49786d53cb2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:10.331217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeefcb8-1a8d-4871-9e59-b49786d53cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:10.405889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7aeefcb8-1a8d-4871-9e59-b49786d53cb2 None None] MFA Rules not processed for user `fbcdd02eda2945e1b299f07489044358`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:10.413824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7aeefcb8-1a8d-4871-9e59-b49786d53cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:10.506016 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:10.544220 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 508/1007] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:10 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:10.831862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf50c7-d8ec-4df0-8728-0677e6b3a559 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:10.833478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7abf50c7-d8ec-4df0-8728-0677e6b3a559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:10.946390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abf50c7-d8ec-4df0-8728-0677e6b3a559 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:10.968729 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:11.026467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8906d015-b946-49ad-8b90-2927b2411578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:11.027072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906d015-b946-49ad-8b90-2927b2411578 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:11.027359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906d015-b946-49ad-8b90-2927b2411578 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:11.027628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8906d015-b946-49ad-8b90-2927b2411578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:11.029248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8906d015-b946-49ad-8b90-2927b2411578 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:11.177814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906d015-b946-49ad-8b90-2927b2411578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:11.179288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8906d015-b946-49ad-8b90-2927b2411578 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:11.199653 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 500/1008] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:10 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:13.959551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b6f62-6ed9-4dfe-a646-2b4119405020 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:13.960093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b6f62-6ed9-4dfe-a646-2b4119405020 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:13.960553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618b6f62-6ed9-4dfe-a646-2b4119405020 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:13.962851 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 509/1009] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:41:13.968955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e271c-cd6d-47d5-90d2-1611bb9ce1b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:13.969504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e271c-cd6d-47d5-90d2-1611bb9ce1b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:13.969615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72e271c-cd6d-47d5-90d2-1611bb9ce1b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:14.038654 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:14.041688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a72e271c-cd6d-47d5-90d2-1611bb9ce1b9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:14.043545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a72e271c-cd6d-47d5-90d2-1611bb9ce1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:14.149467 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 501/1010] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:41:14.439290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b6f62-6ed9-4dfe-a646-2b4119405020 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:14.442442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-618b6f62-6ed9-4dfe-a646-2b4119405020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:14.559869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618b6f62-6ed9-4dfe-a646-2b4119405020 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:14.640893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfbbdb5-5053-4309-aa62-998535cb890f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:14.641531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbbdb5-5053-4309-aa62-998535cb890f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:14.641809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbbdb5-5053-4309-aa62-998535cb890f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:14.642073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfbbdb5-5053-4309-aa62-998535cb890f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:14.644269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5bfbbdb5-5053-4309-aa62-998535cb890f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:14.676485 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:14.763325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbbdb5-5053-4309-aa62-998535cb890f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:14.764765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfbbdb5-5053-4309-aa62-998535cb890f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:14.783210 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 510/1011] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:17.038658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f265-6094-487a-add3-1b7163a8f628 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:17.039246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f265-6094-487a-add3-1b7163a8f628 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:17.039246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032f265-6094-487a-add3-1b7163a8f628 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:17.040590 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 502/1012] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:17.046830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da94a3e-acca-4384-9b5b-f57ae8b45118 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:17.047426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da94a3e-acca-4384-9b5b-f57ae8b45118 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:17.047426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da94a3e-acca-4384-9b5b-f57ae8b45118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:17.124417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2da94a3e-acca-4384-9b5b-f57ae8b45118 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:17.125695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2da94a3e-acca-4384-9b5b-f57ae8b45118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:17.208804 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:17.233486 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 511/1013] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:17.521238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f265-6094-487a-add3-1b7163a8f628 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:17.522841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8032f265-6094-487a-add3-1b7163a8f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:17.638747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032f265-6094-487a-add3-1b7163a8f628 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:17.668891 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:17.716116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b3c234-f3f8-4785-b9a4-5690eb6c549a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:17.716714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3c234-f3f8-4785-b9a4-5690eb6c549a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:17.716990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3c234-f3f8-4785-b9a4-5690eb6c549a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:17.717259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b3c234-f3f8-4785-b9a4-5690eb6c549a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:17.718894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-05b3c234-f3f8-4785-b9a4-5690eb6c549a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:17.840583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3c234-f3f8-4785-b9a4-5690eb6c549a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:17.841964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b3c234-f3f8-4785-b9a4-5690eb6c549a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:17.863982 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 503/1014] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:20.513735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85d6df-add1-4a47-988f-728b4a5d2ee6 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:20.514261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85d6df-add1-4a47-988f-728b4a5d2ee6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:20.514725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a85d6df-add1-4a47-988f-728b4a5d2ee6 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:20.517265 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 512/1015] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:20 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:20.522929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccbda6-a0a8-451c-9264-9101140cdccf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:20.523385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccbda6-a0a8-451c-9264-9101140cdccf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:20.523518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccbda6-a0a8-451c-9264-9101140cdccf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:20.594076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c0ccbda6-a0a8-451c-9264-9101140cdccf None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:20.595285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c0ccbda6-a0a8-451c-9264-9101140cdccf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:20.603887 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:20.695359 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 504/1016] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:20 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:41:20.976461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85d6df-add1-4a47-988f-728b4a5d2ee6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:20.978400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3a85d6df-add1-4a47-988f-728b4a5d2ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:21.101092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a85d6df-add1-4a47-988f-728b4a5d2ee6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:21.181505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c491311-76af-4832-88f0-4fd37deb3a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:21.182108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491311-76af-4832-88f0-4fd37deb3a05 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:21.182385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491311-76af-4832-88f0-4fd37deb3a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:21.182653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c491311-76af-4832-88f0-4fd37deb3a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:21.184263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7c491311-76af-4832-88f0-4fd37deb3a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:21.238199 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:21.339660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c491311-76af-4832-88f0-4fd37deb3a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:21.342570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c491311-76af-4832-88f0-4fd37deb3a05 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:21.378360 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 513/1017] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:20 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:25.603202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013008-a051-472c-a99c-fa5cca57db2a None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:25.603923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013008-a051-472c-a99c-fa5cca57db2a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:25.603923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7013008-a051-472c-a99c-fa5cca57db2a None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:25.605335 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 505/1018] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:25.611141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa4b0a-9cc1-4f8f-85ae-559460a69f99 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:25.611768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa4b0a-9cc1-4f8f-85ae-559460a69f99 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:25.611768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaa4b0a-9cc1-4f8f-85ae-559460a69f99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:25.701204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1eaa4b0a-9cc1-4f8f-85ae-559460a69f99 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:25.702847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1eaa4b0a-9cc1-4f8f-85ae-559460a69f99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:25.836970 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:25.853732 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 514/1019] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:26.143897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7013008-a051-472c-a99c-fa5cca57db2a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:26.145577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c7013008-a051-472c-a99c-fa5cca57db2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:26.284404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7013008-a051-472c-a99c-fa5cca57db2a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:26.325556 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:26.366840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07496936-199d-4135-bcec-42c0ee932d49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:26.367442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496936-199d-4135-bcec-42c0ee932d49 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:26.367719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496936-199d-4135-bcec-42c0ee932d49 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:26.367989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07496936-199d-4135-bcec-42c0ee932d49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:26.369713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-07496936-199d-4135-bcec-42c0ee932d49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:26.492244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07496936-199d-4135-bcec-42c0ee932d49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:26.493672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07496936-199d-4135-bcec-42c0ee932d49 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:26.515477 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 506/1020] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:29.372513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0f9e2-25e1-428f-b662-9faacb939fe9 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:29.373044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0f9e2-25e1-428f-b662-9faacb939fe9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:29.373242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0f9e2-25e1-428f-b662-9faacb939fe9 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:29.374703 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 515/1021] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:29.380519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e82c-daea-47f9-bce7-178f11016d39 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:29.381028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e82c-daea-47f9-bce7-178f11016d39 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:29.381200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0e82c-daea-47f9-bce7-178f11016d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:29.451617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0ec0e82c-daea-47f9-bce7-178f11016d39 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:29.452751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ec0e82c-daea-47f9-bce7-178f11016d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:29.471856 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:29.555287 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 507/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:29 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:29.839200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0f9e2-25e1-428f-b662-9faacb939fe9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:29.840766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1ca0f9e2-25e1-428f-b662-9faacb939fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:29.947092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0f9e2-25e1-428f-b662-9faacb939fe9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:30.027151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6147862-8ecb-4513-a5cb-06e1156434f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:30.027754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147862-8ecb-4513-a5cb-06e1156434f1 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:30.028034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147862-8ecb-4513-a5cb-06e1156434f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:30.028304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6147862-8ecb-4513-a5cb-06e1156434f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:30.029929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6147862-8ecb-4513-a5cb-06e1156434f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:30.079634 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:30.149438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6147862-8ecb-4513-a5cb-06e1156434f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:30.150969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6147862-8ecb-4513-a5cb-06e1156434f1 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:30.169123 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 516/1023] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:29 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:34.489784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43426250-780d-40a8-96db-e6f199394a75 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:34.490482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43426250-780d-40a8-96db-e6f199394a75 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:34.490482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43426250-780d-40a8-96db-e6f199394a75 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:34.491962 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 508/1024] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:34.497666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1852c8-6702-4d97-b7da-d9d492f1da31 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:34.498199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1852c8-6702-4d97-b7da-d9d492f1da31 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:34.498199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1852c8-6702-4d97-b7da-d9d492f1da31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:34.578350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bb1852c8-6702-4d97-b7da-d9d492f1da31 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:34.578914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb1852c8-6702-4d97-b7da-d9d492f1da31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:34.702100 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:34.709521 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 517/1025] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:34.988268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43426250-780d-40a8-96db-e6f199394a75 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:34.989821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-43426250-780d-40a8-96db-e6f199394a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:35.096263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43426250-780d-40a8-96db-e6f199394a75 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:35.147858 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:35.173481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041f903c-b491-4c5b-81ec-360ba389cc8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:35.174075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f903c-b491-4c5b-81ec-360ba389cc8f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:35.174351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f903c-b491-4c5b-81ec-360ba389cc8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:35.174619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041f903c-b491-4c5b-81ec-360ba389cc8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:35.176205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-041f903c-b491-4c5b-81ec-360ba389cc8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:35.286360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f903c-b491-4c5b-81ec-360ba389cc8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:35.287837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041f903c-b491-4c5b-81ec-360ba389cc8f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:35.306092 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 509/1026] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:40.375982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602a87-0457-4ccb-b003-d72733a89704 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:40.375982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602a87-0457-4ccb-b003-d72733a89704 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:40.375982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7602a87-0457-4ccb-b003-d72733a89704 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:40.377857 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 518/1027] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:41:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:40.383269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1cf01-0e30-44d4-8242-18d45dc5c2f2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:40.383728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1cf01-0e30-44d4-8242-18d45dc5c2f2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:40.383827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae1cf01-0e30-44d4-8242-18d45dc5c2f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:40.497205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7ae1cf01-0e30-44d4-8242-18d45dc5c2f2 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:40.498465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7ae1cf01-0e30-44d4-8242-18d45dc5c2f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:40.526955 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:40.695121 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 510/1028] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:41:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:45.138139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786669a-0c76-457a-8305-4be715ffb6dd None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:45.138684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786669a-0c76-457a-8305-4be715ffb6dd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:45.138684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4786669a-0c76-457a-8305-4be715ffb6dd None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:45.139997 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 519/1029] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:41:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:45.147710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308308e3-65ae-49bf-a496-c99540a98026 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:45.148230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308308e3-65ae-49bf-a496-c99540a98026 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:45.148334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308308e3-65ae-49bf-a496-c99540a98026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:45.242535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-308308e3-65ae-49bf-a496-c99540a98026 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:45.243751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-308308e3-65ae-49bf-a496-c99540a98026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:45.324058 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:45.367275 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 511/1030] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:41:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:46.744825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e420cbb-e64c-4412-b454-e3dd9f21d31c None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:46.745551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e420cbb-e64c-4412-b454-e3dd9f21d31c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:46.745551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e420cbb-e64c-4412-b454-e3dd9f21d31c None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:46.746930 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 520/1031] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:41:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:46.752309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e5263-27cb-4fa0-9592-3e48cc953664 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:46.752787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e5263-27cb-4fa0-9592-3e48cc953664 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:46.752977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3e5263-27cb-4fa0-9592-3e48cc953664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:46.833332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7d3e5263-27cb-4fa0-9592-3e48cc953664 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:46.834561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7d3e5263-27cb-4fa0-9592-3e48cc953664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:46.946118 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 512/1032] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:41:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:50.591122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c2a7a-0f8f-40d4-8764-dc0b50220ab2 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:50.591637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c2a7a-0f8f-40d4-8764-dc0b50220ab2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:50.591824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c2a7a-0f8f-40d4-8764-dc0b50220ab2 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:50.593259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 521/1033] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:50.600046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777e5f8-22bf-4990-94c5-6fbb4c744ad9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:50.601372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777e5f8-22bf-4990-94c5-6fbb4c744ad9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:50.601889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e777e5f8-22bf-4990-94c5-6fbb4c744ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:50.660014 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:50.700888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e777e5f8-22bf-4990-94c5-6fbb4c744ad9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:50.702638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e777e5f8-22bf-4990-94c5-6fbb4c744ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:50.820497 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 513/1034] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:51.125427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6d93-b203-406a-a4c5-f4b019476d3e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:51.126101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6d93-b203-406a-a4c5-f4b019476d3e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:51.127464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfc6d93-b203-406a-a4c5-f4b019476d3e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:51.130094 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 522/1035] 10.222.0.25 () {54 vars in 961 bytes} [Mon Oct 24 08:41:51 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:51.137918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9191700-8cdc-4b2a-97f8-eb7fce778d94 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:51.139277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9191700-8cdc-4b2a-97f8-eb7fce778d94 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:51.140010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9191700-8cdc-4b2a-97f8-eb7fce778d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:51.230580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a9191700-8cdc-4b2a-97f8-eb7fce778d94 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:51.231788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a9191700-8cdc-4b2a-97f8-eb7fce778d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:51.285821 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:51.359101 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 514/1036] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 08:41:51 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:41:51.367835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc6d93-b203-406a-a4c5-f4b019476d3e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:51.369499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3cfc6d93-b203-406a-a4c5-f4b019476d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:51.528715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfc6d93-b203-406a-a4c5-f4b019476d3e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:51.607765 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:51.660184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a3178-19b7-4203-9ac9-af36ab7cacdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:51.660826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a3178-19b7-4203-9ac9-af36ab7cacdc service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:51.661174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a3178-19b7-4203-9ac9-af36ab7cacdc service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:51.661583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a3178-19b7-4203-9ac9-af36ab7cacdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:51.663247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e81a3178-19b7-4203-9ac9-af36ab7cacdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:51.769881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a3178-19b7-4203-9ac9-af36ab7cacdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:51.771683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a3178-19b7-4203-9ac9-af36ab7cacdc service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:51.793641 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 523/1037] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:54.228697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4133-e5ac-4a41-8cbd-0741125af0f8 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:54.229183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4133-e5ac-4a41-8cbd-0741125af0f8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:54.229183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ad4133-e5ac-4a41-8cbd-0741125af0f8 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:54.236075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2e15-ecab-4c47-832b-db2beb576735 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:54.236677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2e15-ecab-4c47-832b-db2beb576735 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:54.236677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b2e15-ecab-4c47-832b-db2beb576735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:54.239172 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 515/1038] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:54 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:54.317827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-337b2e15-ecab-4c47-832b-db2beb576735 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:54.319588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-337b2e15-ecab-4c47-832b-db2beb576735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:54.362678 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:54.432420 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 524/1039] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:41:54.728986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad4133-e5ac-4a41-8cbd-0741125af0f8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:54.730710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-40ad4133-e5ac-4a41-8cbd-0741125af0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:54.926740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ad4133-e5ac-4a41-8cbd-0741125af0f8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:54.938759 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:55.072397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d9517b-585c-43a2-9441-a0a4bc376de2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:55.073386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9517b-585c-43a2-9441-a0a4bc376de2 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:55.073550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9517b-585c-43a2-9441-a0a4bc376de2 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:55.073846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d9517b-585c-43a2-9441-a0a4bc376de2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:55.075562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-68d9517b-585c-43a2-9441-a0a4bc376de2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:55.174427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9517b-585c-43a2-9441-a0a4bc376de2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:55.175959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d9517b-585c-43a2-9441-a0a4bc376de2 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:55.195977 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 516/1040] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:41:57.761101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a7ea-ff7d-48a6-a0f0-65e1dbea5b39 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:57.761664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a7ea-ff7d-48a6-a0f0-65e1dbea5b39 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:57.762069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d3a7ea-ff7d-48a6-a0f0-65e1dbea5b39 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:57.763698 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 525/1041] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:41:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:57.769287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34519d-2009-43ef-84c6-6ded40d4ba14 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:57.770116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34519d-2009-43ef-84c6-6ded40d4ba14 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:57.770600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34519d-2009-43ef-84c6-6ded40d4ba14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:57.790146 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:57.849010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7f34519d-2009-43ef-84c6-6ded40d4ba14 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:57.850387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7f34519d-2009-43ef-84c6-6ded40d4ba14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:57.980208 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 517/1042] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:41:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:58.304755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3001-bca3-4858-9d9a-31ca67d9043c None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:58.305044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3001-bca3-4858-9d9a-31ca67d9043c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:58.305536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3001-bca3-4858-9d9a-31ca67d9043c None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:58.307137 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 526/1043] 10.222.0.25 () {54 vars in 961 bytes} [Mon Oct 24 08:41:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:41:58.313818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc4689-faf9-41f1-a9dc-47eee05d2c15 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:58.314996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc4689-faf9-41f1-a9dc-47eee05d2c15 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:58.314996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cc4689-faf9-41f1-a9dc-47eee05d2c15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:58.410581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-81cc4689-faf9-41f1-a9dc-47eee05d2c15 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:41:58.411952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81cc4689-faf9-41f1-a9dc-47eee05d2c15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:58.478646 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:58.607647 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 518/1044] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 08:41:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:41:58.616755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3001-bca3-4858-9d9a-31ca67d9043c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:41:58.618451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ec6c3001-bca3-4858-9d9a-31ca67d9043c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:58.828427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3001-bca3-4858-9d9a-31ca67d9043c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:41:58.863223 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:41:59.034374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ded5b6-a1a1-4914-8971-248f8590bc27 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:41:59.036288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded5b6-a1a1-4914-8971-248f8590bc27 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:41:59.036567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded5b6-a1a1-4914-8971-248f8590bc27 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:41:59.036837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ded5b6-a1a1-4914-8971-248f8590bc27 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:41:59.038765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e2ded5b6-a1a1-4914-8971-248f8590bc27 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:41:59.166419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ded5b6-a1a1-4914-8971-248f8590bc27 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:41:59.168155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ded5b6-a1a1-4914-8971-248f8590bc27 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:41:59.210009 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 527/1045] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:41:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:01.660355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd8c5-8926-4a45-b8aa-d3cb0a880263 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:01.661409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd8c5-8926-4a45-b8aa-d3cb0a880263 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:01.661955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50edd8c5-8926-4a45-b8aa-d3cb0a880263 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:01.667722 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 519/1046] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:01.669273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af6934-7382-4a70-9e71-639b67e3ce03 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:01.669753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af6934-7382-4a70-9e71-639b67e3ce03 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:01.669833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4af6934-7382-4a70-9e71-639b67e3ce03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:01.706388 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:01.754569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e4af6934-7382-4a70-9e71-639b67e3ce03 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:01.755935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4af6934-7382-4a70-9e71-639b67e3ce03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:01.889153 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 528/1047] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:02.215877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd8c5-8926-4a45-b8aa-d3cb0a880263 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:02.217370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50edd8c5-8926-4a45-b8aa-d3cb0a880263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:02.511397 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:02.520902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50edd8c5-8926-4a45-b8aa-d3cb0a880263 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:02.672730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f439814e-1849-4d3a-b003-dceb0fe22634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:02.673627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439814e-1849-4d3a-b003-dceb0fe22634 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:02.673906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439814e-1849-4d3a-b003-dceb0fe22634 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:02.674176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f439814e-1849-4d3a-b003-dceb0fe22634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:02.675842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f439814e-1849-4d3a-b003-dceb0fe22634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:02.786564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439814e-1849-4d3a-b003-dceb0fe22634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:02.788349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f439814e-1849-4d3a-b003-dceb0fe22634 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:02.807709 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:02.821877 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 520/1048] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 606 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:02.871344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c25c04-ee98-4297-9197-6da9a459eaca None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:02.872217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c25c04-ee98-4297-9197-6da9a459eaca None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:02.872217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c25c04-ee98-4297-9197-6da9a459eaca None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:02.873223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 529/1049] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:42:02.879628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4545-3ab6-4b6f-9fd1-7c9a0c25269b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:02.879996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4545-3ab6-4b6f-9fd1-7c9a0c25269b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:02.880288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96f4545-3ab6-4b6f-9fd1-7c9a0c25269b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:02.974281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b96f4545-3ab6-4b6f-9fd1-7c9a0c25269b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:02.975576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b96f4545-3ab6-4b6f-9fd1-7c9a0c25269b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:03.134720 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 521/1050] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:42:03.472038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dbedd-30ef-4ef3-a775-03267f4c2253 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:03.472038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dbedd-30ef-4ef3-a775-03267f4c2253 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:03.472038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825dbedd-30ef-4ef3-a775-03267f4c2253 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:03.473921 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 530/1051] 10.222.0.25 () {54 vars in 963 bytes} [Mon Oct 24 08:42:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:03.477961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086e41-b6af-4805-8f9c-665dff15731b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:03.478252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086e41-b6af-4805-8f9c-665dff15731b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:03.478532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62086e41-b6af-4805-8f9c-665dff15731b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:03.571937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-62086e41-b6af-4805-8f9c-665dff15731b None None] MFA Rules not processed for user `ed628f1d565e440792f530dd97512cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:03.573150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-62086e41-b6af-4805-8f9c-665dff15731b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:03.596196 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:03.666480 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 522/1052] 10.222.0.25 () {58 vars in 1060 bytes} [Mon Oct 24 08:42:03 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:03.674043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dbedd-30ef-4ef3-a775-03267f4c2253 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:03.675885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-825dbedd-30ef-4ef3-a775-03267f4c2253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:03.798150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825dbedd-30ef-4ef3-a775-03267f4c2253 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:03.802923 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:03.881345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fd0d7b-5485-427c-8f17-01126d141179 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:03.881995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd0d7b-5485-427c-8f17-01126d141179 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:03.882285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd0d7b-5485-427c-8f17-01126d141179 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:03.882501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd0d7b-5485-427c-8f17-01126d141179 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:03.884107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-20fd0d7b-5485-427c-8f17-01126d141179 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:04.010587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd0d7b-5485-427c-8f17-01126d141179 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:04.012197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fd0d7b-5485-427c-8f17-01126d141179 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:04.032106 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 531/1053] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:05.101050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282aa6a-d089-4aae-8ea6-eb7b5fa90550 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:05.101625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282aa6a-d089-4aae-8ea6-eb7b5fa90550 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:05.101625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3282aa6a-d089-4aae-8ea6-eb7b5fa90550 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:05.102989 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 523/1054] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:05.108522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a438c-175e-4ea2-bd81-76bbf033ad22 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:05.108974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a438c-175e-4ea2-bd81-76bbf033ad22 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:05.109075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503a438c-175e-4ea2-bd81-76bbf033ad22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:05.159395 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:05.184340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-503a438c-175e-4ea2-bd81-76bbf033ad22 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:05.185622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-503a438c-175e-4ea2-bd81-76bbf033ad22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:05.287292 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 532/1055] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:05.580581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282aa6a-d089-4aae-8ea6-eb7b5fa90550 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:05.582134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3282aa6a-d089-4aae-8ea6-eb7b5fa90550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:05.773775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3282aa6a-d089-4aae-8ea6-eb7b5fa90550 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:05.809769 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:05.913781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd966ff7-94a7-422e-8e51-bcc75b078e40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:05.914566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966ff7-94a7-422e-8e51-bcc75b078e40 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:05.915460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966ff7-94a7-422e-8e51-bcc75b078e40 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:05.915460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd966ff7-94a7-422e-8e51-bcc75b078e40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:05.916807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dd966ff7-94a7-422e-8e51-bcc75b078e40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:06.029693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966ff7-94a7-422e-8e51-bcc75b078e40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:06.031304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd966ff7-94a7-422e-8e51-bcc75b078e40 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:06.061698 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 524/1056] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:08.440802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef4a66-edec-4755-9a3f-e7d7b579a633 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:08.441696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef4a66-edec-4755-9a3f-e7d7b579a633 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:08.442121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ef4a66-edec-4755-9a3f-e7d7b579a633 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:08.443898 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 533/1057] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:08.450805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804b055-6d5e-4893-bc0c-a5de61ea8296 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:08.451616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804b055-6d5e-4893-bc0c-a5de61ea8296 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:08.452043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804b055-6d5e-4893-bc0c-a5de61ea8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:08.498510 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:08.529399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6804b055-6d5e-4893-bc0c-a5de61ea8296 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:08.530881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6804b055-6d5e-4893-bc0c-a5de61ea8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:08.657929 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 525/1058] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:08.959857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef4a66-edec-4755-9a3f-e7d7b579a633 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:08.961563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-88ef4a66-edec-4755-9a3f-e7d7b579a633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:09.079458 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:09.134451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ef4a66-edec-4755-9a3f-e7d7b579a633 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:09.270546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c2b58-5018-48e7-b38d-55eeef8351bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:09.271424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c2b58-5018-48e7-b38d-55eeef8351bd service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:09.272034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c2b58-5018-48e7-b38d-55eeef8351bd service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:09.272537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c2b58-5018-48e7-b38d-55eeef8351bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:09.276085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-187c2b58-5018-48e7-b38d-55eeef8351bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:09.436238 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:09.454227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c2b58-5018-48e7-b38d-55eeef8351bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:09.455972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c2b58-5018-48e7-b38d-55eeef8351bd service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:09.476691 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 534/1059] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:11.842429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16553600-34d6-4cb4-a831-d5f7a8afbb21 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:11.842908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16553600-34d6-4cb4-a831-d5f7a8afbb21 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:11.843088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16553600-34d6-4cb4-a831-d5f7a8afbb21 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:11.844825 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 526/1060] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:11.850711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fcc94-ccd0-4551-8ac4-2660451f6690 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:11.851145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fcc94-ccd0-4551-8ac4-2660451f6690 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:11.851521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573fcc94-ccd0-4551-8ac4-2660451f6690 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:11.930550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-573fcc94-ccd0-4551-8ac4-2660451f6690 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:11.931654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-573fcc94-ccd0-4551-8ac4-2660451f6690 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:12.084826 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 535/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:12.378256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16553600-34d6-4cb4-a831-d5f7a8afbb21 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:12.381073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16553600-34d6-4cb4-a831-d5f7a8afbb21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:12.519183 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:12.568006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16553600-34d6-4cb4-a831-d5f7a8afbb21 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:12.720263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f794a26-933d-4d37-84ba-755f22405de1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:12.720883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f794a26-933d-4d37-84ba-755f22405de1 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:12.721159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f794a26-933d-4d37-84ba-755f22405de1 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:12.721471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f794a26-933d-4d37-84ba-755f22405de1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:12.723156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f794a26-933d-4d37-84ba-755f22405de1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:12.826495 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:12.854960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f794a26-933d-4d37-84ba-755f22405de1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:12.857968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f794a26-933d-4d37-84ba-755f22405de1 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:12.890533 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 527/1062] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:15.666663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e6c2-f771-484d-880e-3264b23e478e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:15.667551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e6c2-f771-484d-880e-3264b23e478e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:15.667551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d87e6c2-f771-484d-880e-3264b23e478e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:15.668937 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 536/1063] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:15.674250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1541fa-7bda-4244-a619-fe894e67fcd1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:15.675143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1541fa-7bda-4244-a619-fe894e67fcd1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:15.675143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1541fa-7bda-4244-a619-fe894e67fcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:15.779721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8c1541fa-7bda-4244-a619-fe894e67fcd1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:15.781953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c1541fa-7bda-4244-a619-fe894e67fcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:15.910951 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 528/1064] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:16.273119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e6c2-f771-484d-880e-3264b23e478e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:16.274869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3d87e6c2-f771-484d-880e-3264b23e478e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:16.347121 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:16.471791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d87e6c2-f771-484d-880e-3264b23e478e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:16.611754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25635626-d753-46e2-b1f7-d8c166ab6dda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:16.612368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25635626-d753-46e2-b1f7-d8c166ab6dda service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:16.612646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25635626-d753-46e2-b1f7-d8c166ab6dda service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:16.612950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25635626-d753-46e2-b1f7-d8c166ab6dda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:16.614627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-25635626-d753-46e2-b1f7-d8c166ab6dda service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:16.629598 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:16.719573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25635626-d753-46e2-b1f7-d8c166ab6dda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:16.721247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25635626-d753-46e2-b1f7-d8c166ab6dda service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:16.741649 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 537/1065] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:42:19.035124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144dd04-da40-4a5f-b273-9d7964b22d53 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:19.035626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144dd04-da40-4a5f-b273-9d7964b22d53 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:19.035745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144dd04-da40-4a5f-b273-9d7964b22d53 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:19.037006 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 529/1066] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:19.042731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d9b9-6f67-4cfe-98ce-46b079693076 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:19.043220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d9b9-6f67-4cfe-98ce-46b079693076 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:19.043321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83d9b9-6f67-4cfe-98ce-46b079693076 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:19.116192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ac83d9b9-6f67-4cfe-98ce-46b079693076 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:19.117443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ac83d9b9-6f67-4cfe-98ce-46b079693076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:19.206207 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:19.218154 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 538/1067] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:19.508679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144dd04-da40-4a5f-b273-9d7964b22d53 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:19.510265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2144dd04-da40-4a5f-b273-9d7964b22d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:19.564893 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:19.662502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2144dd04-da40-4a5f-b273-9d7964b22d53 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:19.786884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1792f2d-97fa-4563-9015-77b054e1815f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:19.787382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1792f2d-97fa-4563-9015-77b054e1815f service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:19.787661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1792f2d-97fa-4563-9015-77b054e1815f service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:19.787932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1792f2d-97fa-4563-9015-77b054e1815f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:19.789539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1792f2d-97fa-4563-9015-77b054e1815f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:19.803278 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:19.846499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac4f2-43f6-43c3-a772-52fc0384fe69 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:19.846798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac4f2-43f6-43c3-a772-52fc0384fe69 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:19.847051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94ac4f2-43f6-43c3-a772-52fc0384fe69 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:19.848419 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 539/1068] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:42:19.853579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab7d57-2cde-4dd9-b5af-6d1ca2d8e18a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:19.853860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab7d57-2cde-4dd9-b5af-6d1ca2d8e18a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:19.854132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ab7d57-2cde-4dd9-b5af-6d1ca2d8e18a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:19.889757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1792f2d-97fa-4563-9015-77b054e1815f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:19.891396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1792f2d-97fa-4563-9015-77b054e1815f service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:19.911501 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 530/1069] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:19.922770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-09ab7d57-2cde-4dd9-b5af-6d1ca2d8e18a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:19.923985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-09ab7d57-2cde-4dd9-b5af-6d1ca2d8e18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:20.033767 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 540/1070] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:42:20.336525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6873-e2f4-4a30-bbbf-eeb720dccf55 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:20.337052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6873-e2f4-4a30-bbbf-eeb720dccf55 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:20.337052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad6873-e2f4-4a30-bbbf-eeb720dccf55 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:20.338406 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 531/1071] 10.222.0.25 () {54 vars in 962 bytes} [Mon Oct 24 08:42:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:20.343761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273a80-7d84-4eba-82a1-4bc37d074b4a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:20.344315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273a80-7d84-4eba-82a1-4bc37d074b4a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:20.344315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4273a80-7d84-4eba-82a1-4bc37d074b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:20.429245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b4273a80-7d84-4eba-82a1-4bc37d074b4a None None] MFA Rules not processed for user `3a1cba9ba74946de8c58da91e59ddcfc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:20.430412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b4273a80-7d84-4eba-82a1-4bc37d074b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:20.443935 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:20.521106 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 541/1072] 10.222.0.25 () {58 vars in 1059 bytes} [Mon Oct 24 08:42:20 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:20.529669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6873-e2f4-4a30-bbbf-eeb720dccf55 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:20.531913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-09ad6873-e2f4-4a30-bbbf-eeb720dccf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:20.640799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad6873-e2f4-4a30-bbbf-eeb720dccf55 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:20.679600 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:20.720943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a655581e-cb41-4ce8-907f-6d9767d240fe service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:20.721584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655581e-cb41-4ce8-907f-6d9767d240fe service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:20.721856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655581e-cb41-4ce8-907f-6d9767d240fe service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:20.722123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a655581e-cb41-4ce8-907f-6d9767d240fe service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:20.723735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a655581e-cb41-4ce8-907f-6d9767d240fe service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:20.838400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655581e-cb41-4ce8-907f-6d9767d240fe service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:20.839879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a655581e-cb41-4ce8-907f-6d9767d240fe service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:20.860389 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 532/1073] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:42:21.628811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2e9c1-b1fe-407b-807e-785fa721241a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:21.629413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2e9c1-b1fe-407b-807e-785fa721241a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:21.629413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe2e9c1-b1fe-407b-807e-785fa721241a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:21.699860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1fe2e9c1-b1fe-407b-807e-785fa721241a None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:21.701191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1fe2e9c1-b1fe-407b-807e-785fa721241a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:21.792202 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 542/1074] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:42:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:21.839973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e623f8-ffd7-45f6-af90-fbb23f0c8d6a None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:21.840480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e623f8-ffd7-45f6-af90-fbb23f0c8d6a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:21.840587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e623f8-ffd7-45f6-af90-fbb23f0c8d6a None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:21.841934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 533/1075] 10.222.0.25 () {54 vars in 943 bytes} [Mon Oct 24 08:42:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:21.848800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dbe91-23a1-4fed-a5b6-3198f2270c2a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:21.849087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dbe91-23a1-4fed-a5b6-3198f2270c2a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:21.849475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8dbe91-23a1-4fed-a5b6-3198f2270c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:21.883195 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:21.930635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5b8dbe91-23a1-4fed-a5b6-3198f2270c2a None None] MFA Rules not processed for user `fc41482005be496f822a3118839674c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:21.931848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5b8dbe91-23a1-4fed-a5b6-3198f2270c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:22.051145 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 543/1076] 10.222.0.25 () {58 vars in 1040 bytes} [Mon Oct 24 08:42:21 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:22.062457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e623f8-ffd7-45f6-af90-fbb23f0c8d6a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:22.064077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5e623f8-ffd7-45f6-af90-fbb23f0c8d6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:22.149539 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:22.157694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b608a-3c9a-4d15-a676-26f7cf7e4807 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:22.158043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b608a-3c9a-4d15-a676-26f7cf7e4807 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:22.158373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915b608a-3c9a-4d15-a676-26f7cf7e4807 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:22.159794 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 544/1077] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:42:22.165221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b046f62-dc54-466e-a822-1d018716b270 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:22.165531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b046f62-dc54-466e-a822-1d018716b270 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:22.165807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b046f62-dc54-466e-a822-1d018716b270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:22.222381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e623f8-ffd7-45f6-af90-fbb23f0c8d6a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:22.239352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9b046f62-dc54-466e-a822-1d018716b270 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:22.240567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b046f62-dc54-466e-a822-1d018716b270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:22.285476 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:22.343223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a8893-cd7b-4adb-9705-396a218730b5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:22.343957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a8893-cd7b-4adb-9705-396a218730b5 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:22.344262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a8893-cd7b-4adb-9705-396a218730b5 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:22.344579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a8893-cd7b-4adb-9705-396a218730b5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:22.346875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-925a8893-cd7b-4adb-9705-396a218730b5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:22.354167 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 545/1078] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:42:22.415109 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:22.453714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a8893-cd7b-4adb-9705-396a218730b5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:22.455440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a8893-cd7b-4adb-9705-396a218730b5 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:22.464585 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 534/1079] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:42:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:42:22.660571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b046f62-dc54-466e-a822-1d018716b270 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:22.661869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b046f62-dc54-466e-a822-1d018716b270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:22.791386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b046f62-dc54-466e-a822-1d018716b270 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:22.847621 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:22.941967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddb7b72-8db2-41fe-9940-1d612e4a4cb3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:22.943276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb7b72-8db2-41fe-9940-1d612e4a4cb3 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:22.943779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb7b72-8db2-41fe-9940-1d612e4a4cb3 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:22.944285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddb7b72-8db2-41fe-9940-1d612e4a4cb3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:22.946692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6ddb7b72-8db2-41fe-9940-1d612e4a4cb3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:23.096688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb7b72-8db2-41fe-9940-1d612e4a4cb3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:23.098510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddb7b72-8db2-41fe-9940-1d612e4a4cb3 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:23.120702 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 546/1080] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:25.390206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41066ad-1d74-4fe4-b5b9-0966cd42b1d7 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:25.391240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41066ad-1d74-4fe4-b5b9-0966cd42b1d7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:25.391352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41066ad-1d74-4fe4-b5b9-0966cd42b1d7 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:25.392919 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 535/1081] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:25.400105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db128ebf-eceb-410a-b680-c192dfa453f7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:25.400654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db128ebf-eceb-410a-b680-c192dfa453f7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:25.400654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db128ebf-eceb-410a-b680-c192dfa453f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:25.480990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-db128ebf-eceb-410a-b680-c192dfa453f7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:25.482235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-db128ebf-eceb-410a-b680-c192dfa453f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:25.492152 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:25.595391 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 547/1082] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:25.895419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41066ad-1d74-4fe4-b5b9-0966cd42b1d7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:25.897002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b41066ad-1d74-4fe4-b5b9-0966cd42b1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:26.082781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41066ad-1d74-4fe4-b5b9-0966cd42b1d7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:26.140117 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:26.231294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc16559-cdec-4f06-b41f-6ba19b85e8e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:26.232239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16559-cdec-4f06-b41f-6ba19b85e8e2 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:26.232528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16559-cdec-4f06-b41f-6ba19b85e8e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:26.232934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc16559-cdec-4f06-b41f-6ba19b85e8e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:26.235660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cdc16559-cdec-4f06-b41f-6ba19b85e8e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:26.347005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc16559-cdec-4f06-b41f-6ba19b85e8e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:26.348619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc16559-cdec-4f06-b41f-6ba19b85e8e2 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:26.369036 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 536/1083] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 474 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:28.650150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458514-3a18-4690-9ee2-493dfa0a499f None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:28.650719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458514-3a18-4690-9ee2-493dfa0a499f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:28.650719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87458514-3a18-4690-9ee2-493dfa0a499f None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:28.652053 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 548/1084] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:42:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:28.657602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b64a8b-a6c9-4eb3-8971-4350f36a4334 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:28.658420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b64a8b-a6c9-4eb3-8971-4350f36a4334 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:28.658876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b64a8b-a6c9-4eb3-8971-4350f36a4334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:28.732949 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:28.738527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-16b64a8b-a6c9-4eb3-8971-4350f36a4334 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:28.739778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16b64a8b-a6c9-4eb3-8971-4350f36a4334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:28.861660 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 537/1085] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:42:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:29.153709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458514-3a18-4690-9ee2-493dfa0a499f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:29.155250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-87458514-3a18-4690-9ee2-493dfa0a499f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:29.316363 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:29.324182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87458514-3a18-4690-9ee2-493dfa0a499f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:29.454145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7890f57-cd98-4294-9193-ab27214af1a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:29.454660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890f57-cd98-4294-9193-ab27214af1a0 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:29.454934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890f57-cd98-4294-9193-ab27214af1a0 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:29.455204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7890f57-cd98-4294-9193-ab27214af1a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:29.456797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e7890f57-cd98-4294-9193-ab27214af1a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:29.561195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7890f57-cd98-4294-9193-ab27214af1a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:29.563657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7890f57-cd98-4294-9193-ab27214af1a0 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:29.578481 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:29.584535 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 549/1086] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:38.859129 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=43 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:39.582829 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:45.818239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17b0f-e784-486f-b891-a0d6607ed4ab None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:45.818822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17b0f-e784-486f-b891-a0d6607ed4ab None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:45.818822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c17b0f-e784-486f-b891-a0d6607ed4ab None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:45.820160 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 538/1087] 10.222.0.25 () {54 vars in 918 bytes} [Mon Oct 24 08:42:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:45.825916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241a81d-5c4a-4ad8-a98b-0d5164259ddc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:45.826389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241a81d-5c4a-4ad8-a98b-0d5164259ddc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:45.826498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7241a81d-5c4a-4ad8-a98b-0d5164259ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:45.911865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7241a81d-5c4a-4ad8-a98b-0d5164259ddc None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:45.913090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7241a81d-5c4a-4ad8-a98b-0d5164259ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:46.022070 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 550/1088] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 24 08:42:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:46.037511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ca79-ff4c-47a7-9652-b33996dd59c7 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:46.037791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ca79-ff4c-47a7-9652-b33996dd59c7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:46.038062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb8ca79-ff4c-47a7-9652-b33996dd59c7 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:46.039386 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 539/1089] 10.222.0.25 () {54 vars in 918 bytes} [Mon Oct 24 08:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:46.044200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8b9d-fca4-4203-8723-688a4a7ae204 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:46.044485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8b9d-fca4-4203-8723-688a4a7ae204 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:46.044757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d8b9d-fca4-4203-8723-688a4a7ae204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:46.120406 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:46.123840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6a9d8b9d-fca4-4203-8723-688a4a7ae204 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:46.125774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6a9d8b9d-fca4-4203-8723-688a4a7ae204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:46.244882 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 551/1090] 10.222.0.25 () {58 vars in 1015 bytes} [Mon Oct 24 08:42:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:48.892324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22334c3b-de9d-4148-9d6c-fd1eed7fed96 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:48.892981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22334c3b-de9d-4148-9d6c-fd1eed7fed96 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:48.892981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22334c3b-de9d-4148-9d6c-fd1eed7fed96 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:48.894229 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 540/1091] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:48.899780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c954-4c97-4213-b76f-4339426a341a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:48.900208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c954-4c97-4213-b76f-4339426a341a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:48.900318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2838c954-4c97-4213-b76f-4339426a341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:48.969886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2838c954-4c97-4213-b76f-4339426a341a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:48.971104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2838c954-4c97-4213-b76f-4339426a341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:49.027018 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:49.072059 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 552/1092] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:42:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:49.362778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22334c3b-de9d-4148-9d6c-fd1eed7fed96 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:49.364354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-22334c3b-de9d-4148-9d6c-fd1eed7fed96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:49.512610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22334c3b-de9d-4148-9d6c-fd1eed7fed96 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:49.587535 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:49.629101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a3edeb-f1e7-491f-a92d-8fcd4390a392 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:49.629734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3edeb-f1e7-491f-a92d-8fcd4390a392 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:49.630006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3edeb-f1e7-491f-a92d-8fcd4390a392 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:49.630275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a3edeb-f1e7-491f-a92d-8fcd4390a392 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:49.631870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52a3edeb-f1e7-491f-a92d-8fcd4390a392 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:49.726707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3edeb-f1e7-491f-a92d-8fcd4390a392 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:49.728308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a3edeb-f1e7-491f-a92d-8fcd4390a392 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:49.747860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 541/1093] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:50.893202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241bbb0-ce02-4589-ac3d-6f47afca80be None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:50.893807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241bbb0-ce02-4589-ac3d-6f47afca80be None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:50.893807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4241bbb0-ce02-4589-ac3d-6f47afca80be None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:50.895186 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 553/1094] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:42:50.900662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85955b9-ae52-407e-819c-aee23d873fb5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:50.901480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85955b9-ae52-407e-819c-aee23d873fb5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:50.901480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85955b9-ae52-407e-819c-aee23d873fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:50.980378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d85955b9-ae52-407e-819c-aee23d873fb5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:50.981615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d85955b9-ae52-407e-819c-aee23d873fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:51.009048 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:51.082537 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 542/1095] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:51.237750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241bbb0-ce02-4589-ac3d-6f47afca80be None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:51.239368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4241bbb0-ce02-4589-ac3d-6f47afca80be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:51.387869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4241bbb0-ce02-4589-ac3d-6f47afca80be None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:51.428547 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:51.501029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741537b8-60a4-4a4b-8844-7a8505811b91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:51.501660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741537b8-60a4-4a4b-8844-7a8505811b91 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:51.501936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741537b8-60a4-4a4b-8844-7a8505811b91 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:51.502204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741537b8-60a4-4a4b-8844-7a8505811b91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:51.503784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-741537b8-60a4-4a4b-8844-7a8505811b91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:51.592430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741537b8-60a4-4a4b-8844-7a8505811b91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:51.594542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741537b8-60a4-4a4b-8844-7a8505811b91 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:51.613120 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 554/1096] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:52.746618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a19c6-246d-4b90-8be7-093860ca495b None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:52.747195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a19c6-246d-4b90-8be7-093860ca495b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:52.747195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970a19c6-246d-4b90-8be7-093860ca495b None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:52.748526 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 543/1097] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:52.754026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae5174-9212-419c-a6b2-3818529df0ce None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:52.754504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae5174-9212-419c-a6b2-3818529df0ce None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:52.754665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ae5174-9212-419c-a6b2-3818529df0ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:52.811046 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:52.834885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-69ae5174-9212-419c-a6b2-3818529df0ce None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:52.836191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-69ae5174-9212-419c-a6b2-3818529df0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:52.938248 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 555/1098] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:53.090353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a19c6-246d-4b90-8be7-093860ca495b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:53.091842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-970a19c6-246d-4b90-8be7-093860ca495b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:53.255174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970a19c6-246d-4b90-8be7-093860ca495b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:53.268839 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:53.376948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1351cf1b-65d5-4310-88f5-867dd556a11b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:53.377584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351cf1b-65d5-4310-88f5-867dd556a11b service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:53.377871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351cf1b-65d5-4310-88f5-867dd556a11b service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:53.378144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1351cf1b-65d5-4310-88f5-867dd556a11b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:53.379758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1351cf1b-65d5-4310-88f5-867dd556a11b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:53.470241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351cf1b-65d5-4310-88f5-867dd556a11b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:53.471828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1351cf1b-65d5-4310-88f5-867dd556a11b service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:53.490204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 544/1099] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:54.588440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24a8a5-b5cc-4dd7-b115-53397d03d839 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:54.588950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24a8a5-b5cc-4dd7-b115-53397d03d839 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:54.588950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf24a8a5-b5cc-4dd7-b115-53397d03d839 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:54.590255 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 556/1100] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:54.595431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2314ed-f847-46b6-88f1-ab76348deb9e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:54.595898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2314ed-f847-46b6-88f1-ab76348deb9e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:54.596005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2314ed-f847-46b6-88f1-ab76348deb9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:54.615387 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:54.676311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5c2314ed-f847-46b6-88f1-ab76348deb9e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:54.677617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5c2314ed-f847-46b6-88f1-ab76348deb9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:54.776146 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 545/1101] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:54.927510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24a8a5-b5cc-4dd7-b115-53397d03d839 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:54.929036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cf24a8a5-b5cc-4dd7-b115-53397d03d839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:55.040776 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:55.076832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf24a8a5-b5cc-4dd7-b115-53397d03d839 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:55.194219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0be2597-eb87-4814-ba59-1b269d4d5d56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:55.194716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2597-eb87-4814-ba59-1b269d4d5d56 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:55.194992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2597-eb87-4814-ba59-1b269d4d5d56 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:55.195255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0be2597-eb87-4814-ba59-1b269d4d5d56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:55.196882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0be2597-eb87-4814-ba59-1b269d4d5d56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:55.275428 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:55.291555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be2597-eb87-4814-ba59-1b269d4d5d56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:55.293162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0be2597-eb87-4814-ba59-1b269d4d5d56 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:55.312083 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 557/1102] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:42:56.433909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571427f5-c3a4-4b18-b10a-dd1350057caa None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:56.434442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571427f5-c3a4-4b18-b10a-dd1350057caa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:56.434442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571427f5-c3a4-4b18-b10a-dd1350057caa None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:56.435826 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 546/1103] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:56.441244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d230aa-bfae-4f9d-bf9f-96f7e5da2c7d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:56.441756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d230aa-bfae-4f9d-bf9f-96f7e5da2c7d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:56.441923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d230aa-bfae-4f9d-bf9f-96f7e5da2c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:56.519118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c1d230aa-bfae-4f9d-bf9f-96f7e5da2c7d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:56.520331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c1d230aa-bfae-4f9d-bf9f-96f7e5da2c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:56.617179 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 558/1104] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:56.766783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571427f5-c3a4-4b18-b10a-dd1350057caa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:56.768368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-571427f5-c3a4-4b18-b10a-dd1350057caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:56.853874 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:56.916867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571427f5-c3a4-4b18-b10a-dd1350057caa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:57.031259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0302b9c0-c85c-4033-85c3-81ae625ce6b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:57.031858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302b9c0-c85c-4033-85c3-81ae625ce6b1 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:57.032137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302b9c0-c85c-4033-85c3-81ae625ce6b1 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:57.032408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0302b9c0-c85c-4033-85c3-81ae625ce6b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:57.034042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0302b9c0-c85c-4033-85c3-81ae625ce6b1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:57.084620 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:57.127970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302b9c0-c85c-4033-85c3-81ae625ce6b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:57.129594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0302b9c0-c85c-4033-85c3-81ae625ce6b1 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:57.149775 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 547/1105] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:42:58.197058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ac9ec-b219-4c31-b4fa-e0efd0191298 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:58.197655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ac9ec-b219-4c31-b4fa-e0efd0191298 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:58.197655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ac9ec-b219-4c31-b4fa-e0efd0191298 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:58.198956 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 559/1106] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:42:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:42:58.205069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131f19-1781-40ac-bd20-04e21bcc2a58 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:58.205589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131f19-1781-40ac-bd20-04e21bcc2a58 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:58.205698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a131f19-1781-40ac-bd20-04e21bcc2a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:58.292786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4a131f19-1781-40ac-bd20-04e21bcc2a58 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:42:58.294451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a131f19-1781-40ac-bd20-04e21bcc2a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:58.404026 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 548/1107] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:42:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:42:58.552440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ac9ec-b219-4c31-b4fa-e0efd0191298 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:42:58.554723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ba0ac9ec-b219-4c31-b4fa-e0efd0191298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:58.605715 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:58.712149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ac9ec-b219-4c31-b4fa-e0efd0191298 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:42:58.829620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8d2fc2-d574-4406-87d4-fde936effaac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:42:58.830221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2fc2-d574-4406-87d4-fde936effaac service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:42:58.830494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2fc2-d574-4406-87d4-fde936effaac service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:42:58.830762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8d2fc2-d574-4406-87d4-fde936effaac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:42:58.832415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb8d2fc2-d574-4406-87d4-fde936effaac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:42:58.839461 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:42:58.929188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d2fc2-d574-4406-87d4-fde936effaac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:42:58.930807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8d2fc2-d574-4406-87d4-fde936effaac service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:42:58.949474 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 560/1108] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:42:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:00.015978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699527-3af3-4615-b025-5062b3e33b85 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:00.016557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699527-3af3-4615-b025-5062b3e33b85 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:00.016557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35699527-3af3-4615-b025-5062b3e33b85 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:00.017879 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 549/1109] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:00.022999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e29524-f84f-405e-8e41-7d55d9627c1c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:00.023440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e29524-f84f-405e-8e41-7d55d9627c1c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:00.023559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e29524-f84f-405e-8e41-7d55d9627c1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:00.101592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f2e29524-f84f-405e-8e41-7d55d9627c1c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:00.102723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f2e29524-f84f-405e-8e41-7d55d9627c1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:00.180416 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:00.210275 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 561/1110] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:43:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:00.362504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699527-3af3-4615-b025-5062b3e33b85 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:00.364307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-35699527-3af3-4615-b025-5062b3e33b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:00.383622 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:00.516224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35699527-3af3-4615-b025-5062b3e33b85 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:00.602867 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:00.628561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f69ab9-c5e5-43a2-9531-34651bc2d1a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:00.629160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f69ab9-c5e5-43a2-9531-34651bc2d1a4 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:00.629464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f69ab9-c5e5-43a2-9531-34651bc2d1a4 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:00.629738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f69ab9-c5e5-43a2-9531-34651bc2d1a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:00.631305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-59f69ab9-c5e5-43a2-9531-34651bc2d1a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:00.722532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f69ab9-c5e5-43a2-9531-34651bc2d1a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:00.724133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f69ab9-c5e5-43a2-9531-34651bc2d1a4 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:00.743946 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 550/1111] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:01.805108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647749e-e0a8-41f4-abdc-169b53383c10 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:01.805703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647749e-e0a8-41f4-abdc-169b53383c10 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:01.805703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647749e-e0a8-41f4-abdc-169b53383c10 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:01.807026 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 562/1112] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:43:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:01.812203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a20f1-5c13-441d-8fe7-d8ca6059ac58 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:01.812660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a20f1-5c13-441d-8fe7-d8ca6059ac58 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:01.812761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736a20f1-5c13-441d-8fe7-d8ca6059ac58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:01.892781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-736a20f1-5c13-441d-8fe7-d8ca6059ac58 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:01.894021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-736a20f1-5c13-441d-8fe7-d8ca6059ac58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:01.936101 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:01.992516 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 551/1113] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:43:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:02.142252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647749e-e0a8-41f4-abdc-169b53383c10 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:02.143882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4647749e-e0a8-41f4-abdc-169b53383c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:02.294784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647749e-e0a8-41f4-abdc-169b53383c10 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:02.378354 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:02.442138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f82e99-965f-432a-92a4-cb6b16e43ddc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:02.442646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f82e99-965f-432a-92a4-cb6b16e43ddc service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:02.442920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f82e99-965f-432a-92a4-cb6b16e43ddc service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:02.443185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f82e99-965f-432a-92a4-cb6b16e43ddc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:02.444786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48f82e99-965f-432a-92a4-cb6b16e43ddc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:02.534388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f82e99-965f-432a-92a4-cb6b16e43ddc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:02.535982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f82e99-965f-432a-92a4-cb6b16e43ddc service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:02.554882 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 563/1114] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:03.639820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142724-9aca-40a8-95c1-9a15ddba59c2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:03.640519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142724-9aca-40a8-95c1-9a15ddba59c2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:03.640519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c142724-9aca-40a8-95c1-9a15ddba59c2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:03.641805 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 552/1115] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:43:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:03.647384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8141cf-1e4c-4f97-b0af-4a092b840a58 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:03.647948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8141cf-1e4c-4f97-b0af-4a092b840a58 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:03.647948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8141cf-1e4c-4f97-b0af-4a092b840a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:03.743882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bd8141cf-1e4c-4f97-b0af-4a092b840a58 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:03.745235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bd8141cf-1e4c-4f97-b0af-4a092b840a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:03.747505 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:03.857056 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 564/1116] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:43:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:43:04.038592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142724-9aca-40a8-95c1-9a15ddba59c2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:04.040091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4c142724-9aca-40a8-95c1-9a15ddba59c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:04.203097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c142724-9aca-40a8-95c1-9a15ddba59c2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:04.231832 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:04.324945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8410b630-317f-4ee0-8e35-d9213c3ff5fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:04.325760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b630-317f-4ee0-8e35-d9213c3ff5fb service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:04.325760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b630-317f-4ee0-8e35-d9213c3ff5fb service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:04.326110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8410b630-317f-4ee0-8e35-d9213c3ff5fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:04.328281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8410b630-317f-4ee0-8e35-d9213c3ff5fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:04.440707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b630-317f-4ee0-8e35-d9213c3ff5fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:04.442379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8410b630-317f-4ee0-8e35-d9213c3ff5fb service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:04.463010 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 553/1117] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:06.587582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eddf10-772a-412f-a29a-f2931886600b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:06.588157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eddf10-772a-412f-a29a-f2931886600b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:06.588277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88eddf10-772a-412f-a29a-f2931886600b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:06.589945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 565/1118] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:06.596908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8db3-ddfc-4f1c-af39-fa65a5650294 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:06.597521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8db3-ddfc-4f1c-af39-fa65a5650294 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:06.597627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6d8db3-ddfc-4f1c-af39-fa65a5650294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:06.645203 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:06.673446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ca6d8db3-ddfc-4f1c-af39-fa65a5650294 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:06.674667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ca6d8db3-ddfc-4f1c-af39-fa65a5650294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:06.776790 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 554/1119] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:07.061106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eddf10-772a-412f-a29a-f2931886600b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:07.062730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-88eddf10-772a-412f-a29a-f2931886600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:07.172767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88eddf10-772a-412f-a29a-f2931886600b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:07.205357 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:07.252972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cda48-6113-40ee-b785-9b5aa94c8aba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:07.253621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cda48-6113-40ee-b785-9b5aa94c8aba service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:07.253899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cda48-6113-40ee-b785-9b5aa94c8aba service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:07.254170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cda48-6113-40ee-b785-9b5aa94c8aba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:07.255795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a10cda48-6113-40ee-b785-9b5aa94c8aba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:07.372138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cda48-6113-40ee-b785-9b5aa94c8aba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:07.373606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10cda48-6113-40ee-b785-9b5aa94c8aba service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:07.393115 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 566/1120] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:09.709779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c61698-acd7-47c6-8d96-c804a847b576 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:09.710322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c61698-acd7-47c6-8d96-c804a847b576 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:09.710322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c61698-acd7-47c6-8d96-c804a847b576 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:09.711751 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 555/1121] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:09.717115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139077a-7ad6-41e3-8efd-dea1d88d19c4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:09.717682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139077a-7ad6-41e3-8efd-dea1d88d19c4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:09.717875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139077a-7ad6-41e3-8efd-dea1d88d19c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:09.787349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6139077a-7ad6-41e3-8efd-dea1d88d19c4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:09.788572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6139077a-7ad6-41e3-8efd-dea1d88d19c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:09.803665 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:09.885781 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 567/1122] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:10.170199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c61698-acd7-47c6-8d96-c804a847b576 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:10.172266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-77c61698-acd7-47c6-8d96-c804a847b576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:10.275674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c61698-acd7-47c6-8d96-c804a847b576 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:10.290537 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:10.354067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45554700-8c93-40d7-9669-0937dba7f31a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:10.354662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45554700-8c93-40d7-9669-0937dba7f31a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:10.354937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45554700-8c93-40d7-9669-0937dba7f31a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:10.355207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45554700-8c93-40d7-9669-0937dba7f31a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:10.356774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-45554700-8c93-40d7-9669-0937dba7f31a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:10.464911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45554700-8c93-40d7-9669-0937dba7f31a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:10.466275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45554700-8c93-40d7-9669-0937dba7f31a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:10.483856 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 556/1123] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:12.941419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a966a7-85cb-48d9-95cb-b92b93bed0f6 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:12.942062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a966a7-85cb-48d9-95cb-b92b93bed0f6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:12.942062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a966a7-85cb-48d9-95cb-b92b93bed0f6 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:12.943571 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 568/1124] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:43:12.948911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc22940-5668-4c5b-8b1f-40aaf2077c6a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:12.949390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc22940-5668-4c5b-8b1f-40aaf2077c6a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:12.949502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc22940-5668-4c5b-8b1f-40aaf2077c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:12.999100 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:13.022740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2cc22940-5668-4c5b-8b1f-40aaf2077c6a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:13.023966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2cc22940-5668-4c5b-8b1f-40aaf2077c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:13.121459 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 557/1125] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:13.408907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a966a7-85cb-48d9-95cb-b92b93bed0f6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:13.410524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-64a966a7-85cb-48d9-95cb-b92b93bed0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:13.512642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a966a7-85cb-48d9-95cb-b92b93bed0f6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:13.553147 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:13.588111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3416c7c0-1014-44a1-aab8-0594175245b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:13.588708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416c7c0-1014-44a1-aab8-0594175245b0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:13.588985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416c7c0-1014-44a1-aab8-0594175245b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:13.589255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3416c7c0-1014-44a1-aab8-0594175245b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:13.590883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3416c7c0-1014-44a1-aab8-0594175245b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:13.701776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416c7c0-1014-44a1-aab8-0594175245b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:13.703763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3416c7c0-1014-44a1-aab8-0594175245b0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:13.723122 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 569/1126] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:16.057817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dd8e2-e7f9-49a6-86b1-436482d2debb None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:16.058371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dd8e2-e7f9-49a6-86b1-436482d2debb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:16.058371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96dd8e2-e7f9-49a6-86b1-436482d2debb None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:16.059706 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 558/1127] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:16.065795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb11db8-345f-4c62-8e83-8ea0f724d0b0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:16.066222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb11db8-345f-4c62-8e83-8ea0f724d0b0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:16.066355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb11db8-345f-4c62-8e83-8ea0f724d0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:16.133108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ebb11db8-345f-4c62-8e83-8ea0f724d0b0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:16.134330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ebb11db8-345f-4c62-8e83-8ea0f724d0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:16.155282 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:16.234614 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 570/1128] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:16.522791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dd8e2-e7f9-49a6-86b1-436482d2debb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:16.524377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b96dd8e2-e7f9-49a6-86b1-436482d2debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:16.628794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96dd8e2-e7f9-49a6-86b1-436482d2debb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:16.649583 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:16.705037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a6a7d9-97ec-4bea-b5d2-083ec000fc6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:16.705692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6a7d9-97ec-4bea-b5d2-083ec000fc6a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:16.705977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6a7d9-97ec-4bea-b5d2-083ec000fc6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:16.706267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a6a7d9-97ec-4bea-b5d2-083ec000fc6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:16.707914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31a6a7d9-97ec-4bea-b5d2-083ec000fc6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:16.820531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6a7d9-97ec-4bea-b5d2-083ec000fc6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:16.821999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a6a7d9-97ec-4bea-b5d2-083ec000fc6a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:16.840037 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 559/1129] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:19.131758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f81f54-bd3a-464b-88a8-fb5d6700e6ba None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:19.132317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f81f54-bd3a-464b-88a8-fb5d6700e6ba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:19.132317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f81f54-bd3a-464b-88a8-fb5d6700e6ba None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:19.133671 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 571/1130] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:43:19.139060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aedf10-20fb-4a5b-86ab-8f3137b601fd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:19.139514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aedf10-20fb-4a5b-86ab-8f3137b601fd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:19.140119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aedf10-20fb-4a5b-86ab-8f3137b601fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:19.206195 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:19.208882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-48aedf10-20fb-4a5b-86ab-8f3137b601fd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:19.210653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-48aedf10-20fb-4a5b-86ab-8f3137b601fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:19.309711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 560/1131] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:19.593564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f81f54-bd3a-464b-88a8-fb5d6700e6ba None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:19.595143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c6f81f54-bd3a-464b-88a8-fb5d6700e6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:19.698489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f81f54-bd3a-464b-88a8-fb5d6700e6ba None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:19.750640 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:19.778492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5600b3-d345-4389-b84d-b50bf3af8a99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:19.779098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5600b3-d345-4389-b84d-b50bf3af8a99 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:19.779381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5600b3-d345-4389-b84d-b50bf3af8a99 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:19.779673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5600b3-d345-4389-b84d-b50bf3af8a99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:19.781959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6b5600b3-d345-4389-b84d-b50bf3af8a99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:19.893702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5600b3-d345-4389-b84d-b50bf3af8a99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:19.895144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5600b3-d345-4389-b84d-b50bf3af8a99 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:19.913982 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 572/1132] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:22.144395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7c3fc-49ca-4434-b19f-24668ea45ebb None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:22.144958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7c3fc-49ca-4434-b19f-24668ea45ebb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:22.144958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f7c3fc-49ca-4434-b19f-24668ea45ebb None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:22.146346 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 561/1133] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:22.152278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbadf6-6cc3-4135-a4cc-1a0a0a9ff990 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:22.152712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbadf6-6cc3-4135-a4cc-1a0a0a9ff990 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:22.152839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbadf6-6cc3-4135-a4cc-1a0a0a9ff990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:22.225923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-41cbadf6-6cc3-4135-a4cc-1a0a0a9ff990 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:22.227148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-41cbadf6-6cc3-4135-a4cc-1a0a0a9ff990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:22.257767 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:22.327490 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 573/1134] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:22.617656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7c3fc-49ca-4434-b19f-24668ea45ebb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:22.619181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-07f7c3fc-49ca-4434-b19f-24668ea45ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:22.727490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f7c3fc-49ca-4434-b19f-24668ea45ebb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:22.757506 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:22.805231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8571660e-3178-4c92-af1a-5b85c2aca2b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:22.805863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571660e-3178-4c92-af1a-5b85c2aca2b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:22.806140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571660e-3178-4c92-af1a-5b85c2aca2b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:22.806414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8571660e-3178-4c92-af1a-5b85c2aca2b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:22.808021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8571660e-3178-4c92-af1a-5b85c2aca2b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:22.918389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571660e-3178-4c92-af1a-5b85c2aca2b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:22.919911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8571660e-3178-4c92-af1a-5b85c2aca2b2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:22.938170 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 562/1135] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:25.152085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98dd40-7a59-41e9-b696-2ba414187e53 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:25.152559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98dd40-7a59-41e9-b696-2ba414187e53 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:25.152667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c98dd40-7a59-41e9-b696-2ba414187e53 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:25.153989 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 574/1136] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:25.159311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb9336-61fb-4b6e-9109-8dc4e3256a24 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:25.159747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb9336-61fb-4b6e-9109-8dc4e3256a24 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:25.159862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badb9336-61fb-4b6e-9109-8dc4e3256a24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:25.227099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-badb9336-61fb-4b6e-9109-8dc4e3256a24 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:25.228320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-badb9336-61fb-4b6e-9109-8dc4e3256a24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:25.237332 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:25.332682 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 563/1137] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:25.615519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98dd40-7a59-41e9-b696-2ba414187e53 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:25.617347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c98dd40-7a59-41e9-b696-2ba414187e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:25.733226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c98dd40-7a59-41e9-b696-2ba414187e53 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:25.795675 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:25.818911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447c4df2-e765-4c92-888b-9feb929a943c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:25.819923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c4df2-e765-4c92-888b-9feb929a943c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:25.820220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c4df2-e765-4c92-888b-9feb929a943c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:25.820502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447c4df2-e765-4c92-888b-9feb929a943c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:25.823056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-447c4df2-e765-4c92-888b-9feb929a943c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:25.939999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c4df2-e765-4c92-888b-9feb929a943c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:25.941451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447c4df2-e765-4c92-888b-9feb929a943c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:25.959890 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 575/1138] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:28.203731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4910d7-57a7-4000-b9e7-3bfc9d9018af None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:28.204298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4910d7-57a7-4000-b9e7-3bfc9d9018af None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:28.204298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4910d7-57a7-4000-b9e7-3bfc9d9018af None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:28.205631 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 564/1139] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:28.211021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593670d-14d3-4522-9c0b-3cf2e261c047 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:28.211455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593670d-14d3-4522-9c0b-3cf2e261c047 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:28.211580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593670d-14d3-4522-9c0b-3cf2e261c047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:28.279572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a593670d-14d3-4522-9c0b-3cf2e261c047 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:28.281387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a593670d-14d3-4522-9c0b-3cf2e261c047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:28.320662 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:28.379234 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 576/1140] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:28.664951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4910d7-57a7-4000-b9e7-3bfc9d9018af None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:28.666548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f4910d7-57a7-4000-b9e7-3bfc9d9018af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:28.773003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4910d7-57a7-4000-b9e7-3bfc9d9018af None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:28.811697 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:28.848900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e9d373-4102-4bf8-ba70-3d6401858dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:28.849536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9d373-4102-4bf8-ba70-3d6401858dad service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:28.849812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9d373-4102-4bf8-ba70-3d6401858dad service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:28.850085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e9d373-4102-4bf8-ba70-3d6401858dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:28.851730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-43e9d373-4102-4bf8-ba70-3d6401858dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:28.962901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9d373-4102-4bf8-ba70-3d6401858dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:28.964242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e9d373-4102-4bf8-ba70-3d6401858dad service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:28.982290 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 565/1141] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:31.156877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af16f13-ba5a-4446-aa72-9ce1961f1c2a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:31.157394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af16f13-ba5a-4446-aa72-9ce1961f1c2a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:31.157502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af16f13-ba5a-4446-aa72-9ce1961f1c2a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:31.158813 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 577/1142] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:31.164450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d4740-8cf9-4b9a-a4ab-200bb8b26f9c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:31.164953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d4740-8cf9-4b9a-a4ab-200bb8b26f9c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:31.165055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131d4740-8cf9-4b9a-a4ab-200bb8b26f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:31.230397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-131d4740-8cf9-4b9a-a4ab-200bb8b26f9c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:31.231622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-131d4740-8cf9-4b9a-a4ab-200bb8b26f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:31.249813 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:31.331197 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 566/1143] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:31.618299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af16f13-ba5a-4446-aa72-9ce1961f1c2a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:31.619861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3af16f13-ba5a-4446-aa72-9ce1961f1c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:31.731265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af16f13-ba5a-4446-aa72-9ce1961f1c2a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:31.799231 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:31.806142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e17ebc9-82c9-4859-9f76-db9f8efe0a1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:31.806758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ebc9-82c9-4859-9f76-db9f8efe0a1f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:31.807034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ebc9-82c9-4859-9f76-db9f8efe0a1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:31.807308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e17ebc9-82c9-4859-9f76-db9f8efe0a1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:31.808915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7e17ebc9-82c9-4859-9f76-db9f8efe0a1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:31.920722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17ebc9-82c9-4859-9f76-db9f8efe0a1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:31.922247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e17ebc9-82c9-4859-9f76-db9f8efe0a1f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:31.940225 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 578/1144] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:34.181512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089de6e4-e2b5-47ca-8e04-4269e93ace27 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:34.182032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089de6e4-e2b5-47ca-8e04-4269e93ace27 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:34.182032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089de6e4-e2b5-47ca-8e04-4269e93ace27 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:34.183385 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 567/1145] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:34.188819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f7eb-5d21-4646-9fc3-2e76b00bd4c9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:34.189232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f7eb-5d21-4646-9fc3-2e76b00bd4c9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:34.189406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db48f7eb-5d21-4646-9fc3-2e76b00bd4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:34.258339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-db48f7eb-5d21-4646-9fc3-2e76b00bd4c9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:34.259546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-db48f7eb-5d21-4646-9fc3-2e76b00bd4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:34.309610 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:34.360839 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 579/1146] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:43:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:34.642830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089de6e4-e2b5-47ca-8e04-4269e93ace27 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:34.644376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-089de6e4-e2b5-47ca-8e04-4269e93ace27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:34.750779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089de6e4-e2b5-47ca-8e04-4269e93ace27 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:34.799597 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:34.825394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4a1d07-a053-4dec-9e1f-d9ba2767570d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:34.825996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a1d07-a053-4dec-9e1f-d9ba2767570d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:34.826271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a1d07-a053-4dec-9e1f-d9ba2767570d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:34.826540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4a1d07-a053-4dec-9e1f-d9ba2767570d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:34.828712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cd4a1d07-a053-4dec-9e1f-d9ba2767570d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:34.944928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a1d07-a053-4dec-9e1f-d9ba2767570d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:34.946304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4a1d07-a053-4dec-9e1f-d9ba2767570d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:34.964573 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 568/1147] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:44.359362 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=22 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:44.962131 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=66 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:55.622057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744c89c-8700-4c3d-a7be-d2b4465ca7d1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:55.622681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744c89c-8700-4c3d-a7be-d2b4465ca7d1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:55.622887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4744c89c-8700-4c3d-a7be-d2b4465ca7d1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:55.625506 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 580/1148] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:43:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:43:55.632598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851093e-8b55-42cc-9ae6-24a84d085aa9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:55.633122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851093e-8b55-42cc-9ae6-24a84d085aa9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:55.633225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5851093e-8b55-42cc-9ae6-24a84d085aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:55.709551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5851093e-8b55-42cc-9ae6-24a84d085aa9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:55.711049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5851093e-8b55-42cc-9ae6-24a84d085aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:55.817412 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 569/1149] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:43:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:43:56.236063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aa497-9d0e-41bc-af4c-f79b3ad59a44 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:56.236488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aa497-9d0e-41bc-af4c-f79b3ad59a44 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:56.236986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601aa497-9d0e-41bc-af4c-f79b3ad59a44 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:56.239451 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 581/1150] 10.222.0.25 () {54 vars in 962 bytes} [Mon Oct 24 08:43:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:56.247106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42d5e0-6442-4b59-9b4e-17f6917ea8e5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:56.247732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42d5e0-6442-4b59-9b4e-17f6917ea8e5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:56.248025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42d5e0-6442-4b59-9b4e-17f6917ea8e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:56.341283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ae42d5e0-6442-4b59-9b4e-17f6917ea8e5 None None] MFA Rules not processed for user `3a1cba9ba74946de8c58da91e59ddcfc`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:56.343645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ae42d5e0-6442-4b59-9b4e-17f6917ea8e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:56.374118 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:56.449675 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 570/1151] 10.222.0.25 () {58 vars in 1059 bytes} [Mon Oct 24 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:56.458700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aa497-9d0e-41bc-af4c-f79b3ad59a44 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:56.460938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-601aa497-9d0e-41bc-af4c-f79b3ad59a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:56.573272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601aa497-9d0e-41bc-af4c-f79b3ad59a44 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:56.649249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9c645-a8ad-4306-92fc-d53a448f1a0e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:56.650029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9c645-a8ad-4306-92fc-d53a448f1a0e service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:56.650143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9c645-a8ad-4306-92fc-d53a448f1a0e service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:56.650403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9c645-a8ad-4306-92fc-d53a448f1a0e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:56.651972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-05e9c645-a8ad-4306-92fc-d53a448f1a0e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:56.710294 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:56.771486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9c645-a8ad-4306-92fc-d53a448f1a0e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:56.773083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9c645-a8ad-4306-92fc-d53a448f1a0e service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:56.793387 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 582/1152] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:43:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:43:59.073045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb900cc-9f56-4aa4-90af-6cd2272f9d79 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:59.073665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb900cc-9f56-4aa4-90af-6cd2272f9d79 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:59.073917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb900cc-9f56-4aa4-90af-6cd2272f9d79 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:59.076012 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 571/1153] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:43:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:43:59.081733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391756a3-7701-403e-acd4-f58548665af3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:59.082267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391756a3-7701-403e-acd4-f58548665af3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:59.082372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391756a3-7701-403e-acd4-f58548665af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:59.161152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-391756a3-7701-403e-acd4-f58548665af3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:43:59.162403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-391756a3-7701-403e-acd4-f58548665af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:59.272518 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 583/1154] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:43:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:43:59.569459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb900cc-9f56-4aa4-90af-6cd2272f9d79 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:43:59.571015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4fb900cc-9f56-4aa4-90af-6cd2272f9d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:43:59.717213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb900cc-9f56-4aa4-90af-6cd2272f9d79 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:43:59.773559 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:43:59.822111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bbf1c-5c16-4f77-8139-0d8401b7bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:43:59.822636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bbf1c-5c16-4f77-8139-0d8401b7bdc3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:43:59.822956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bbf1c-5c16-4f77-8139-0d8401b7bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:43:59.823284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bbf1c-5c16-4f77-8139-0d8401b7bdc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:43:59.824166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bbf1c-5c16-4f77-8139-0d8401b7bdc3 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:43:59.825853 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-353bbf1c-5c16-4f77-8139-0d8401b7bdc3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:43:59.825853 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 08:43:59.825853 n-d-master-1 devstack@keystone.service[88311]: Oct 24 08:43:59.827084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353bbf1c-5c16-4f77-8139-0d8401b7bdc3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:43:59.848428 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 572/1155] 10.222.0.25 () {56 vars in 1108 bytes} [Mon Oct 24 08:43:59 2022] GET /identity/v3/projects => generated 2553 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:44:02.056005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f8524-b0cc-4a9b-882d-c23c46f0317a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:02.056576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f8524-b0cc-4a9b-882d-c23c46f0317a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:02.056576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f8524-b0cc-4a9b-882d-c23c46f0317a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:02.057973 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 584/1156] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:44:02.064320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902463-1c15-427c-8638-a8680faf27d8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:02.064782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902463-1c15-427c-8638-a8680faf27d8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:02.064906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01902463-1c15-427c-8638-a8680faf27d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:02.132349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-01902463-1c15-427c-8638-a8680faf27d8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:02.133580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01902463-1c15-427c-8638-a8680faf27d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:02.235375 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 573/1157] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:44:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:02.532558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f8524-b0cc-4a9b-882d-c23c46f0317a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:02.534427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-436f8524-b0cc-4a9b-882d-c23c46f0317a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:02.544057 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:02.688484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f8524-b0cc-4a9b-882d-c23c46f0317a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:02.771366 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:02.806120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab29c7-bb08-4977-b283-282dcc2ae4f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:02.806767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab29c7-bb08-4977-b283-282dcc2ae4f4 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:02.807047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab29c7-bb08-4977-b283-282dcc2ae4f4 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:02.807323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab29c7-bb08-4977-b283-282dcc2ae4f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:02.808959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e3ab29c7-bb08-4977-b283-282dcc2ae4f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:02.898527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab29c7-bb08-4977-b283-282dcc2ae4f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:02.900131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab29c7-bb08-4977-b283-282dcc2ae4f4 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:02.918775 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 585/1158] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:44:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:44:05.251156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb01911-5533-444c-91c7-4860c0dfe8fe None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:05.251731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb01911-5533-444c-91c7-4860c0dfe8fe None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:05.251731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb01911-5533-444c-91c7-4860c0dfe8fe None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:05.253037 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 574/1159] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:44:05.258497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9991dd-92d1-44ab-bda3-f6778ae15a12 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:05.258938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9991dd-92d1-44ab-bda3-f6778ae15a12 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:05.259075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9991dd-92d1-44ab-bda3-f6778ae15a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:05.329934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cd9991dd-92d1-44ab-bda3-f6778ae15a12 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:05.331183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cd9991dd-92d1-44ab-bda3-f6778ae15a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:05.379094 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:05.431431 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 586/1160] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:44:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:05.716963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb01911-5533-444c-91c7-4860c0dfe8fe None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:05.718567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ebb01911-5533-444c-91c7-4860c0dfe8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:05.741446 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:05.821320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb01911-5533-444c-91c7-4860c0dfe8fe None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:05.898332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6062cff0-dfe1-48c8-81da-4dbd88ff3419 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:05.898946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062cff0-dfe1-48c8-81da-4dbd88ff3419 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:05.899222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062cff0-dfe1-48c8-81da-4dbd88ff3419 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:05.899491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6062cff0-dfe1-48c8-81da-4dbd88ff3419 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:05.901175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6062cff0-dfe1-48c8-81da-4dbd88ff3419 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:05.982250 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:06.021389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062cff0-dfe1-48c8-81da-4dbd88ff3419 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:06.022853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6062cff0-dfe1-48c8-81da-4dbd88ff3419 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:06.042783 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 575/1161] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:44:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:44:08.291664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0825a3-5716-4398-bf8a-bb66b13eb106 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:08.292266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0825a3-5716-4398-bf8a-bb66b13eb106 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:08.292266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0825a3-5716-4398-bf8a-bb66b13eb106 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:08.293598 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 587/1162] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:44:08.299846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d0b0-5cae-449e-9522-375e81c55754 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:08.300298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d0b0-5cae-449e-9522-375e81c55754 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:08.300412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81d0b0-5cae-449e-9522-375e81c55754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:08.368797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3b81d0b0-5cae-449e-9522-375e81c55754 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:08.370055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3b81d0b0-5cae-449e-9522-375e81c55754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:08.468548 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 576/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:08.752657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0825a3-5716-4398-bf8a-bb66b13eb106 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:08.754239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a0825a3-5716-4398-bf8a-bb66b13eb106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:08.858027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0825a3-5716-4398-bf8a-bb66b13eb106 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:08.931574 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:08.933196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5311c4-7a9b-4424-ac29-169b0921f371 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:08.933990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5311c4-7a9b-4424-ac29-169b0921f371 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:08.934265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5311c4-7a9b-4424-ac29-169b0921f371 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:08.934535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5311c4-7a9b-4424-ac29-169b0921f371 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:08.937258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cf5311c4-7a9b-4424-ac29-169b0921f371 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:09.043906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5311c4-7a9b-4424-ac29-169b0921f371 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:09.045247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5311c4-7a9b-4424-ac29-169b0921f371 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:09.063670 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 588/1164] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:44:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:44:11.378396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bd5d9-1bc5-4bbd-a65d-d0f9333f5945 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:11.378939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bd5d9-1bc5-4bbd-a65d-d0f9333f5945 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:11.378939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095bd5d9-1bc5-4bbd-a65d-d0f9333f5945 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:11.380276 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 577/1165] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:44:11.385653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dbc00-7087-4202-a558-abd05b1bce9e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:11.386084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dbc00-7087-4202-a558-abd05b1bce9e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:11.386192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11dbc00-7087-4202-a558-abd05b1bce9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:11.452761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a11dbc00-7087-4202-a558-abd05b1bce9e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:11.453900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a11dbc00-7087-4202-a558-abd05b1bce9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:11.507301 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:11.551848 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 589/1166] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:11.838133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bd5d9-1bc5-4bbd-a65d-d0f9333f5945 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:11.839662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-095bd5d9-1bc5-4bbd-a65d-d0f9333f5945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:11.879680 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:11.948182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095bd5d9-1bc5-4bbd-a65d-d0f9333f5945 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:12.022587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e845a114-020e-4693-a577-0aed2246a19f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:12.023184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845a114-020e-4693-a577-0aed2246a19f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:12.023462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845a114-020e-4693-a577-0aed2246a19f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:12.023734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e845a114-020e-4693-a577-0aed2246a19f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:12.025359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e845a114-020e-4693-a577-0aed2246a19f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:12.109795 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:12.140964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845a114-020e-4693-a577-0aed2246a19f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:12.142470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e845a114-020e-4693-a577-0aed2246a19f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:12.161275 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 578/1167] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:44:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:44:14.554048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db9967-e02b-4ab3-b0ae-05a88faff5e7 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:14.554603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db9967-e02b-4ab3-b0ae-05a88faff5e7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:14.554603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db9967-e02b-4ab3-b0ae-05a88faff5e7 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:14.555949 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 590/1168] 10.222.0.25 () {54 vars in 927 bytes} [Mon Oct 24 08:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:44:14.561533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3b83b-d349-4969-a389-6b2600f17279 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:14.561983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3b83b-d349-4969-a389-6b2600f17279 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:14.562092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff3b83b-d349-4969-a389-6b2600f17279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:14.629271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9ff3b83b-d349-4969-a389-6b2600f17279 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:44:14.630502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9ff3b83b-d349-4969-a389-6b2600f17279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:14.732852 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 579/1169] 10.222.0.25 () {58 vars in 1024 bytes} [Mon Oct 24 08:44:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:44:15.023842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db9967-e02b-4ab3-b0ae-05a88faff5e7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:44:15.025472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-65db9967-e02b-4ab3-b0ae-05a88faff5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:15.130737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db9967-e02b-4ab3-b0ae-05a88faff5e7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:44:15.206443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de85d1da-1393-4cc4-a1f5-06ccd205ca55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:44:15.207056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85d1da-1393-4cc4-a1f5-06ccd205ca55 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:44:15.207334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85d1da-1393-4cc4-a1f5-06ccd205ca55 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:44:15.207609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de85d1da-1393-4cc4-a1f5-06ccd205ca55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:44:15.209283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-de85d1da-1393-4cc4-a1f5-06ccd205ca55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:44:15.218829 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:15.325678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85d1da-1393-4cc4-a1f5-06ccd205ca55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:44:15.327597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de85d1da-1393-4cc4-a1f5-06ccd205ca55 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:44:15.346617 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 591/1170] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:44:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:44:24.730994 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=82 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:44:25.344308 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=50 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:28.981720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064544-d63b-4801-8a78-9b0cb7baeb15 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:28.982347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064544-d63b-4801-8a78-9b0cb7baeb15 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:28.982347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66064544-d63b-4801-8a78-9b0cb7baeb15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:29.058604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-66064544-d63b-4801-8a78-9b0cb7baeb15 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:45:29.059813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-66064544-d63b-4801-8a78-9b0cb7baeb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:29.155568 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 580/1171] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:45:29.163620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a2981-768a-4bf2-8334-2fd635b6f73a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:29.164116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a2981-768a-4bf2-8334-2fd635b6f73a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:29.164339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a2981-768a-4bf2-8334-2fd635b6f73a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:29.238061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-745a2981-768a-4bf2-8334-2fd635b6f73a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:45:29.239167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-745a2981-768a-4bf2-8334-2fd635b6f73a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:29.334464 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 592/1172] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:45:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:45:29.339095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064544-d63b-4801-8a78-9b0cb7baeb15 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:29.340317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-66064544-d63b-4801-8a78-9b0cb7baeb15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:29.352074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66064544-d63b-4801-8a78-9b0cb7baeb15 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:29.412967 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:29.446744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:29.447340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:29.447618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:29.447888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:29.448520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:45:29.448819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:29.449849 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:45:29.449849 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 08:45:29.449849 n-d-master-1 devstack@keystone.service[88311]: Oct 24 08:45:29.450718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:29.465043 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 581/1173] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:45:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:45:29.475146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a2981-768a-4bf2-8334-2fd635b6f73a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:29.484258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a2981-768a-4bf2-8334-2fd635b6f73a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:29.545201 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:29.579487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:29.580099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:29.580378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:29.580647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:29.581282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:29.582408 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:45:29.582408 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 08:45:29.582408 n-d-master-1 devstack@keystone.service[88312]: Oct 24 08:45:29.583607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:29.639873 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 593/1174] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:45:29 2022] POST /identity/v3/projects => generated 377 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:45:29.643992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:29.645536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:29.678437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b64fe61-1eb9-41f0-8eb6-72e9377603f4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:29.770182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:29.770779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:29.771052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:29.771320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:29.771951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:29.773019 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:45:29.773019 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 08:45:29.773019 n-d-master-1 devstack@keystone.service[88311]: Oct 24 08:45:29.774255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:29.819939 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 582/1175] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:45:29 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:45:29.824022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:29.825563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:29.889876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6107c4-c600-43ae-8307-24ca39e57740 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:29.972132 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:29.982918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4260be-4eba-4575-bb8c-d103fea8f117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:29.983551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4260be-4eba-4575-bb8c-d103fea8f117 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:29.983829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4260be-4eba-4575-bb8c-d103fea8f117 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:29.984097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4260be-4eba-4575-bb8c-d103fea8f117 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:29.984728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4260be-4eba-4575-bb8c-d103fea8f117 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:29.986419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4260be-4eba-4575-bb8c-d103fea8f117 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:29.999464 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 594/1176] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:45:29 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:45:30.003637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:30.005169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:30.017003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431e8c88-ac3b-4b77-b1cc-3ec82317c9e2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:30.041602 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:30.111343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c60e3f3-3cf5-4931-95e2-703fdc1ac1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:30.111940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60e3f3-3cf5-4931-95e2-703fdc1ac1ba admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:30.112219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60e3f3-3cf5-4931-95e2-703fdc1ac1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:30.112490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c60e3f3-3cf5-4931-95e2-703fdc1ac1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:30.113123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60e3f3-3cf5-4931-95e2-703fdc1ac1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:30.114756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c60e3f3-3cf5-4931-95e2-703fdc1ac1ba admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:30.127507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 583/1177] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:45:30.131844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4260be-4eba-4575-bb8c-d103fea8f117 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:30.133419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b4260be-4eba-4575-bb8c-d103fea8f117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:30.168208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4260be-4eba-4575-bb8c-d103fea8f117 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:30.260884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e90ea72-e6f5-40a9-a2cc-9b2acdbffb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:30.261577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ea72-e6f5-40a9-a2cc-9b2acdbffb44 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:30.261853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ea72-e6f5-40a9-a2cc-9b2acdbffb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:30.262126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e90ea72-e6f5-40a9-a2cc-9b2acdbffb44 admin admin] PATH_INFO: `/v3/projects/cc0a5d959391496bac75dbfdf46b794c/users/ef643cfa5dc240ed835b201e67913f9b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:30.285810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90ea72-e6f5-40a9-a2cc-9b2acdbffb44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc0a5d959391496bac75dbfdf46b794c, user_id=ef643cfa5dc240ed835b201e67913f9b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:30.288508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e90ea72-e6f5-40a9-a2cc-9b2acdbffb44 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:30.314597 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 595/1178] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:45:30 2022] PUT /identity/v3/projects/cc0a5d959391496bac75dbfdf46b794c/users/ef643cfa5dc240ed835b201e67913f9b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:45:30.325497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fca2c-55bc-431e-80a9-7a172709529b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:30.325810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fca2c-55bc-431e-80a9-7a172709529b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:30.326121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fca2c-55bc-431e-80a9-7a172709529b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:30.384569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4d9fca2c-55bc-431e-80a9-7a172709529b None None] MFA Rules not processed for user `ef643cfa5dc240ed835b201e67913f9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:45:30.385704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4d9fca2c-55bc-431e-80a9-7a172709529b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:30.463061 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 584/1179] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:45:30.476893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc4b5-9e59-4278-872c-7dccc8726bb1 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:30.477180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc4b5-9e59-4278-872c-7dccc8726bb1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:30.477514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbfc4b5-9e59-4278-872c-7dccc8726bb1 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:30.478836 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 596/1180] 10.222.0.25 () {54 vars in 963 bytes} [Mon Oct 24 08:45:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:45:30.483701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cde92a-1792-4ba5-822f-80628d9a9686 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:30.483989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cde92a-1792-4ba5-822f-80628d9a9686 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:30.484262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cde92a-1792-4ba5-822f-80628d9a9686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:30.518142 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:30.563632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d1cde92a-1792-4ba5-822f-80628d9a9686 None None] MFA Rules not processed for user `ed628f1d565e440792f530dd97512cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:45:30.564823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1cde92a-1792-4ba5-822f-80628d9a9686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:30.642672 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 585/1181] 10.222.0.25 () {58 vars in 1060 bytes} [Mon Oct 24 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:45:30.650187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc4b5-9e59-4278-872c-7dccc8726bb1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:30.651733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ddbfc4b5-9e59-4278-872c-7dccc8726bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:30.702979 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:30.762456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbfc4b5-9e59-4278-872c-7dccc8726bb1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:30.842409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:30.843387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:30.843685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:30.843959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:30.845602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:30.956006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:30.957412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:30.961603 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:30.978616 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 597/1182] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:45:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:45:31.024348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeacfd-7572-45ad-9d43-9d5b932d3ff2 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:31.024791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeacfd-7572-45ad-9d43-9d5b932d3ff2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:31.024925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaeacfd-7572-45ad-9d43-9d5b932d3ff2 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:31.026218 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 586/1183] 10.222.0.25 () {52 vars in 830 bytes} [Mon Oct 24 08:45:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:45:31.030472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:31.031855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:31.130604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416e5b-502f-4c03-b964-428c1562b985 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:31.226613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:31.227266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:31.227419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:31.227686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] PATH_INFO: `/v3/users/ef643cfa5dc240ed835b201e67913f9b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:31.240952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef643cfa5dc240ed835b201e67913f9b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:31.242030 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:45:31.242030 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 08:45:31.242030 n-d-master-1 devstack@keystone.service[88312]: Oct 24 08:45:31.243281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:31.258911 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:31.321411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef643cfa5dc240ed835b201e67913f9b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:31.345796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef643cfa5dc240ed835b201e67913f9b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:31.346278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef643cfa5dc240ed835b201e67913f9b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:31.355724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef643cfa5dc240ed835b201e67913f9b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:31.371380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef643cfa5dc240ed835b201e67913f9b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:31.377938 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 598/1184] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:45:31 2022] DELETE /identity/v3/users/ef643cfa5dc240ed835b201e67913f9b => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:45:31.382871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aee95-9036-460f-879c-16f1ceab9146 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:31.383231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aee95-9036-460f-879c-16f1ceab9146 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:31.383604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aee95-9036-460f-879c-16f1ceab9146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:31.445312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-023aee95-9036-460f-879c-16f1ceab9146 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:45:31.446597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-023aee95-9036-460f-879c-16f1ceab9146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:31.532818 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:31.546344 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 587/1185] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:45:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:45:31.556275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:31.558510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:31.672448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd72ccc-224e-479a-9164-e0e2228fbaa7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:31.739500 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:31.764262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa81d554-457a-4c66-9416-12f4f730bb5e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:31.764881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81d554-457a-4c66-9416-12f4f730bb5e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:31.765162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81d554-457a-4c66-9416-12f4f730bb5e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:31.765468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa81d554-457a-4c66-9416-12f4f730bb5e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:31.767780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa81d554-457a-4c66-9416-12f4f730bb5e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:31.886699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81d554-457a-4c66-9416-12f4f730bb5e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:31.888289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa81d554-457a-4c66-9416-12f4f730bb5e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:31.907255 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 599/1186] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:45:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:45:32.272368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aee95-9036-460f-879c-16f1ceab9146 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:45:32.273618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-023aee95-9036-460f-879c-16f1ceab9146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:45:32.286334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aee95-9036-460f-879c-16f1ceab9146 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:45:32.401590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:45:32.402231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:45:32.402511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:45:32.402781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] PATH_INFO: `/v3/projects/cc0a5d959391496bac75dbfdf46b794c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:45:32.413573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc0a5d959391496bac75dbfdf46b794c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:45:32.414609 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:45:32.414609 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 08:45:32.414609 n-d-master-1 devstack@keystone.service[88311]: Oct 24 08:45:32.415805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:45:32.474989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc0a5d959391496bac75dbfdf46b794c', 'request_id': 'req-49c46729-fc90-426f-be33-ad9a298b5646'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:32.488596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc0a5d959391496bac75dbfdf46b794c', 'request_id': 'req-49c46729-fc90-426f-be33-ad9a298b5646'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:32.498335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc0a5d959391496bac75dbfdf46b794c', 'request_id': 'req-49c46729-fc90-426f-be33-ad9a298b5646'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:32.524350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] The token cache is being invalidate because project cc0a5d959391496bac75dbfdf46b794c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:45:32.524638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:32.525071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49c46729-fc90-426f-be33-ad9a298b5646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:45:32.526510 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 588/1187] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:45:32 2022] DELETE /identity/v3/projects/cc0a5d959391496bac75dbfdf46b794c => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:45:41.904900 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=62 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:45:42.522334 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:48:41.459422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec6374-5831-4c51-9774-80752e81c913 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:41.459993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec6374-5831-4c51-9774-80752e81c913 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:41.459993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ec6374-5831-4c51-9774-80752e81c913 None None] PATH_INFO: `/v3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:41.461190 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 600/1188] 10.222.0.52 () {54 vars in 925 bytes} [Mon Oct 24 08:48:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:48:41.474585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8081178-adb8-4313-a246-455d7a0446b1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:41.475046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8081178-adb8-4313-a246-455d7a0446b1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:41.475155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8081178-adb8-4313-a246-455d7a0446b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:41.556949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c8081178-adb8-4313-a246-455d7a0446b1 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:41.558181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c8081178-adb8-4313-a246-455d7a0446b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:41.671563 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 589/1189] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Oct 24 08:48:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:45.450768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1442a87-6579-4dac-9081-ef089ab4cbbf None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:45.451285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1442a87-6579-4dac-9081-ef089ab4cbbf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:45.451382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1442a87-6579-4dac-9081-ef089ab4cbbf None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:45.452792 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 601/1190] 10.222.0.25 () {54 vars in 961 bytes} [Mon Oct 24 08:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:48:45.458009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27889-b153-4e50-af0e-7c0802992d44 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:45.458457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27889-b153-4e50-af0e-7c0802992d44 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:45.458555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da27889-b153-4e50-af0e-7c0802992d44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:45.479385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7da27889-b153-4e50-af0e-7c0802992d44 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:45.480617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7da27889-b153-4e50-af0e-7c0802992d44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:45.489261 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 590/1191] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 08:48:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:45.498180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1442a87-6579-4dac-9081-ef089ab4cbbf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:45.513606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1442a87-6579-4dac-9081-ef089ab4cbbf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:45.519297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5116ee-78ef-4444-8132-7b296eeb93b6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:45.520566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5116ee-78ef-4444-8132-7b296eeb93b6 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:45.520566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5116ee-78ef-4444-8132-7b296eeb93b6 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:45.520566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5116ee-78ef-4444-8132-7b296eeb93b6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:45.529612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5116ee-78ef-4444-8132-7b296eeb93b6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:45.531280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5116ee-78ef-4444-8132-7b296eeb93b6 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:45.551049 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 602/1192] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:48:45.655935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d28c6-930c-4658-a15e-16135cd35364 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:45.656713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d28c6-930c-4658-a15e-16135cd35364 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:45.656713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d28c6-930c-4658-a15e-16135cd35364 None None] PATH_INFO: `/v3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:45.658516 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 591/1193] 10.222.0.43 () {54 vars in 925 bytes} [Mon Oct 24 08:48:45 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:48:45.667775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a30f-bb45-4c35-bf1b-bcbad148af15 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:45.668066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a30f-bb45-4c35-bf1b-bcbad148af15 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:45.668529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b05a30f-bb45-4c35-bf1b-bcbad148af15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:45.689825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6b05a30f-bb45-4c35-bf1b-bcbad148af15 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:45.690958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6b05a30f-bb45-4c35-bf1b-bcbad148af15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:45.699947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 603/1194] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Oct 24 08:48:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:48:54.060638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e4774-33c5-4482-9949-614178342063 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:54.061132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e4774-33c5-4482-9949-614178342063 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:54.061237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e4774-33c5-4482-9949-614178342063 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:54.062540 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 592/1195] 10.222.0.25 () {54 vars in 961 bytes} [Mon Oct 24 08:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:48:54.067595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e4e6a-b07c-4f11-b050-6ba6bf1de884 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:54.068062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e4e6a-b07c-4f11-b050-6ba6bf1de884 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:54.068145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e4e6a-b07c-4f11-b050-6ba6bf1de884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:54.088109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-099e4e6a-b07c-4f11-b050-6ba6bf1de884 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:48:54.089434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-099e4e6a-b07c-4f11-b050-6ba6bf1de884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:48:54.098818 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 604/1196] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 08:48:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:48:54.107516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e4774-33c5-4482-9949-614178342063 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:48:54.121010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e4774-33c5-4482-9949-614178342063 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:48:54.126448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94481fb9-f6e4-4b71-84cc-cdcecdb6b91c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:48:54.127051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94481fb9-f6e4-4b71-84cc-cdcecdb6b91c service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:48:54.127336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94481fb9-f6e4-4b71-84cc-cdcecdb6b91c service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:48:54.127604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94481fb9-f6e4-4b71-84cc-cdcecdb6b91c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:48:54.136436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94481fb9-f6e4-4b71-84cc-cdcecdb6b91c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:48:54.138638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94481fb9-f6e4-4b71-84cc-cdcecdb6b91c service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:48:54.149523 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 593/1197] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:48:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:49:04.082371 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=12 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:04.145148 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:11.229950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465a89-1357-4c37-b262-5beb08aa4354 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:11.231052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465a89-1357-4c37-b262-5beb08aa4354 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:11.231052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f465a89-1357-4c37-b262-5beb08aa4354 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:11.232444 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 605/1198] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:49:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:49:11.237258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9868a-73d7-4c0b-9a67-9a75868ab581 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:11.237734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9868a-73d7-4c0b-9a67-9a75868ab581 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:11.237840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c9868a-73d7-4c0b-9a67-9a75868ab581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:11.298351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a2c9868a-73d7-4c0b-9a67-9a75868ab581 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:49:11.299632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a2c9868a-73d7-4c0b-9a67-9a75868ab581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:49:11.376155 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 594/1199] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:49:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:49:11.534484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465a89-1357-4c37-b262-5beb08aa4354 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:49:11.536286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3f465a89-1357-4c37-b262-5beb08aa4354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:49:11.648377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f465a89-1357-4c37-b262-5beb08aa4354 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:49:11.654547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4019de-2a80-473d-a638-df3a436bc67c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:49:11.655087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4019de-2a80-473d-a638-df3a436bc67c service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:11.655362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4019de-2a80-473d-a638-df3a436bc67c service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:11.655631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4019de-2a80-473d-a638-df3a436bc67c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:11.664666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4019de-2a80-473d-a638-df3a436bc67c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:49:11.666296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4019de-2a80-473d-a638-df3a436bc67c service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:49:11.675896 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 606/1200] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:49:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:49:12.774897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d3d01-17c1-4628-8324-3685b0db4661 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:12.775425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d3d01-17c1-4628-8324-3685b0db4661 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:12.775425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67d3d01-17c1-4628-8324-3685b0db4661 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:12.776688 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 595/1201] 127.0.0.1 () {54 vars in 901 bytes} [Mon Oct 24 08:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:49:12.782016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690a3a7-fc13-4752-9e14-1ec53d0537da None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:12.782446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690a3a7-fc13-4752-9e14-1ec53d0537da None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:12.782640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7690a3a7-fc13-4752-9e14-1ec53d0537da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:12.804809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7690a3a7-fc13-4752-9e14-1ec53d0537da None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:49:12.806084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7690a3a7-fc13-4752-9e14-1ec53d0537da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:49:12.816244 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 607/1202] 127.0.0.1 () {58 vars in 998 bytes} [Mon Oct 24 08:49:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:49:12.970215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d3d01-17c1-4628-8324-3685b0db4661 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:49:12.985062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67d3d01-17c1-4628-8324-3685b0db4661 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:49:12.990586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda4303e-8a92-4134-95be-d28995a756a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:49:12.991185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4303e-8a92-4134-95be-d28995a756a9 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:12.991464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4303e-8a92-4134-95be-d28995a756a9 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:12.991727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda4303e-8a92-4134-95be-d28995a756a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:13.001421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4303e-8a92-4134-95be-d28995a756a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:49:13.003101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda4303e-8a92-4134-95be-d28995a756a9 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:49:13.013132 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 596/1203] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:49:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:49:17.033146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4bc5-61dc-4535-939a-21e9bb6ab8c5 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:17.033777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4bc5-61dc-4535-939a-21e9bb6ab8c5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:17.033777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54d4bc5-61dc-4535-939a-21e9bb6ab8c5 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:17.035062 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 608/1204] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:49:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:49:17.040208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae407-50fc-4a0d-898d-15ea2998b7f1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:17.040645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae407-50fc-4a0d-898d-15ea2998b7f1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:17.040764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eae407-50fc-4a0d-898d-15ea2998b7f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:17.060997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-28eae407-50fc-4a0d-898d-15ea2998b7f1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:49:17.062222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-28eae407-50fc-4a0d-898d-15ea2998b7f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:49:17.070056 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 597/1205] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:49:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:49:17.355578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4bc5-61dc-4535-939a-21e9bb6ab8c5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:49:17.357532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c54d4bc5-61dc-4535-939a-21e9bb6ab8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:49:17.443969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54d4bc5-61dc-4535-939a-21e9bb6ab8c5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:49:17.447575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcc7916-0d7c-4da9-8b05-104e9572473e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:49:17.448183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc7916-0d7c-4da9-8b05-104e9572473e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:17.448459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc7916-0d7c-4da9-8b05-104e9572473e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:17.448729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcc7916-0d7c-4da9-8b05-104e9572473e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:17.458219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc7916-0d7c-4da9-8b05-104e9572473e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:49:17.459652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcc7916-0d7c-4da9-8b05-104e9572473e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:49:17.470237 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 609/1206] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:49:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:49:19.691150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc54d-eb42-4ffa-bbb0-37825f8f32cc None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:19.691705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc54d-eb42-4ffa-bbb0-37825f8f32cc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:19.691705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aecc54d-eb42-4ffa-bbb0-37825f8f32cc None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:19.693053 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 598/1207] 127.0.0.1 () {54 vars in 917 bytes} [Mon Oct 24 08:49:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:49:19.698411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14e441-4033-4404-a8fb-4a7c10c1b956 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:19.699418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14e441-4033-4404-a8fb-4a7c10c1b956 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:19.699609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da14e441-4033-4404-a8fb-4a7c10c1b956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:19.720046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-da14e441-4033-4404-a8fb-4a7c10c1b956 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:49:19.721284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da14e441-4033-4404-a8fb-4a7c10c1b956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:49:19.729185 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 610/1208] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Oct 24 08:49:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:49:20.016290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc54d-eb42-4ffa-bbb0-37825f8f32cc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:49:20.027878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aecc54d-eb42-4ffa-bbb0-37825f8f32cc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:49:20.031388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e693eaed-52eb-4e3a-a44d-cce16f9cae5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:49:20.031980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693eaed-52eb-4e3a-a44d-cce16f9cae5b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:49:20.032260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693eaed-52eb-4e3a-a44d-cce16f9cae5b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:49:20.032535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e693eaed-52eb-4e3a-a44d-cce16f9cae5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:49:20.041320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693eaed-52eb-4e3a-a44d-cce16f9cae5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:49:20.042758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e693eaed-52eb-4e3a-a44d-cce16f9cae5b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:49:20.052039 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 599/1209] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:49:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:49:29.714319 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:49:30.048029 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=65 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:13.279934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9939-3d5d-4ab3-b85d-227ca3db0b3a None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:13.280538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9939-3d5d-4ab3-b85d-227ca3db0b3a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:13.280538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b9939-3d5d-4ab3-b85d-227ca3db0b3a None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:13.282045 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 611/1210] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:50:13.287944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ede78-80ea-43d7-a2fb-8df33edb9896 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:13.288516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ede78-80ea-43d7-a2fb-8df33edb9896 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:13.288516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54ede78-80ea-43d7-a2fb-8df33edb9896 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:13.309801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a54ede78-80ea-43d7-a2fb-8df33edb9896 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:13.311057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a54ede78-80ea-43d7-a2fb-8df33edb9896 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:13.321618 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 600/1211] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:50:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:23.303956 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:45.271188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e8519-f205-49ae-bbfd-e9e18db21a66 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:45.271801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e8519-f205-49ae-bbfd-e9e18db21a66 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:45.271801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742e8519-f205-49ae-bbfd-e9e18db21a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:45.303445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-742e8519-f205-49ae-bbfd-e9e18db21a66 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:45.304788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-742e8519-f205-49ae-bbfd-e9e18db21a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:45.318087 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 612/1212] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:50:45.331767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c895b7-3e90-4efd-8953-7cfbdbb16276 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:45.332699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c895b7-3e90-4efd-8953-7cfbdbb16276 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:45.332699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c895b7-3e90-4efd-8953-7cfbdbb16276 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:45.374340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-94c895b7-3e90-4efd-8953-7cfbdbb16276 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:45.375923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-94c895b7-3e90-4efd-8953-7cfbdbb16276 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:45.392195 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 601/1213] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:45.398083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e8519-f205-49ae-bbfd-e9e18db21a66 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:45.416824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742e8519-f205-49ae-bbfd-e9e18db21a66 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:45.433055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35ab65-3818-45da-b947-22aeed9aa26b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:45.433568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35ab65-3818-45da-b947-22aeed9aa26b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:45.433757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a35ab65-3818-45da-b947-22aeed9aa26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:45.436514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:45.437153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:45.437475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:45.437750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:45.438409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:45.438710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:45.439746 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:50:45.439746 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 08:50:45.439746 n-d-master-1 devstack@keystone.service[88312]: Oct 24 08:50:45.440649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:45.472562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1a35ab65-3818-45da-b947-22aeed9aa26b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:45.478352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a35ab65-3818-45da-b947-22aeed9aa26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:45.483903 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 613/1214] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:45.491357 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 602/1215] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:50:45.496504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:45.503247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276cc81-1bcd-487d-b2a7-101776e18472 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:45.503603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276cc81-1bcd-487d-b2a7-101776e18472 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:45.503819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4276cc81-1bcd-487d-b2a7-101776e18472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:45.530453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e3b4c-8771-4dc8-baaf-63161d33deee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:45.563723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4276cc81-1bcd-487d-b2a7-101776e18472 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:45.569217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4276cc81-1bcd-487d-b2a7-101776e18472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:45.570489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e77065-7151-4b71-b2b4-2d381ae61b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:45.570712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e77065-7151-4b71-b2b4-2d381ae61b70 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:45.570949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e77065-7151-4b71-b2b4-2d381ae61b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:45.571226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e77065-7151-4b71-b2b4-2d381ae61b70 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:45.572169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e77065-7151-4b71-b2b4-2d381ae61b70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:45.582630 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 603/1216] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:45.583278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e77065-7151-4b71-b2b4-2d381ae61b70 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:45.588330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276cc81-1bcd-487d-b2a7-101776e18472 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:45.603548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4276cc81-1bcd-487d-b2a7-101776e18472 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:45.608986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e59a53-8666-4182-9eef-d2f1679a6a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:45.615010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59a53-8666-4182-9eef-d2f1679a6a24 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:45.615358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59a53-8666-4182-9eef-d2f1679a6a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:45.615571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e59a53-8666-4182-9eef-d2f1679a6a24 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:45.616275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e59a53-8666-4182-9eef-d2f1679a6a24 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:45.616589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e59a53-8666-4182-9eef-d2f1679a6a24 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:45.618345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e59a53-8666-4182-9eef-d2f1679a6a24 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:45.638050 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 604/1217] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:50:45.646307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e59a53-8666-4182-9eef-d2f1679a6a24 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:45.669470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e59a53-8666-4182-9eef-d2f1679a6a24 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:45.687913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2d7c-d594-48ac-8f6e-a080d823d639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:45.690309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2d7c-d594-48ac-8f6e-a080d823d639 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:45.691233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2d7c-d594-48ac-8f6e-a080d823d639 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:45.691729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a2d7c-d594-48ac-8f6e-a080d823d639 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:45.692701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a2d7c-d594-48ac-8f6e-a080d823d639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:45.698725 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-447a2d7c-d594-48ac-8f6e-a080d823d639 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:50:45.698725 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 08:50:45.698725 n-d-master-1 devstack@keystone.service[88311]: Oct 24 08:50:45.700489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a2d7c-d594-48ac-8f6e-a080d823d639 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:45.725323 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 614/1218] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:45 2022] POST /identity/v3/projects => generated 375 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:45.725323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e77065-7151-4b71-b2b4-2d381ae61b70 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:45.755671 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 605/1219] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:45 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:50:45.762483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2d7c-d594-48ac-8f6e-a080d823d639 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:45.879009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e77065-7151-4b71-b2b4-2d381ae61b70 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:45.898709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a2d7c-d594-48ac-8f6e-a080d823d639 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:45.936003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1981818-d0d5-4c72-98df-e0bd99729507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:45.937003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981818-d0d5-4c72-98df-e0bd99729507 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:45.937573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981818-d0d5-4c72-98df-e0bd99729507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:45.938087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1981818-d0d5-4c72-98df-e0bd99729507 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:45.938951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981818-d0d5-4c72-98df-e0bd99729507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:45.949817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1981818-d0d5-4c72-98df-e0bd99729507 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:45.991262 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 606/1220] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:45 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:50:46.000174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff3350-15bc-4a94-a4c2-8d048b134d93 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.000452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1d1d2-4d88-42cd-abfd-ba5684650fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.001002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff3350-15bc-4a94-a4c2-8d048b134d93 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.001132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1d1d2-4d88-42cd-abfd-ba5684650fd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.001338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1d1d2-4d88-42cd-abfd-ba5684650fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.001829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ff3350-15bc-4a94-a4c2-8d048b134d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.001949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1d1d2-4d88-42cd-abfd-ba5684650fd6 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.002485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1d1d2-4d88-42cd-abfd-ba5684650fd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.003552 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-9ef1d1d2-4d88-42cd-abfd-ba5684650fd6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:50:46.003552 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 08:50:46.003552 n-d-master-1 devstack@keystone.service[88312]: Oct 24 08:50:46.004755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1d1d2-4d88-42cd-abfd-ba5684650fd6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.034919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f1ff3350-15bc-4a94-a4c2-8d048b134d93 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.036547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f1ff3350-15bc-4a94-a4c2-8d048b134d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.053660 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 615/1221] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:45 2022] POST /identity/v3/users => generated 288 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:46.056097 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 607/1222] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.058685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24713d7-b084-4c4c-940b-c012d8e1efe9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.058975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24713d7-b084-4c4c-940b-c012d8e1efe9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.059240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24713d7-b084-4c4c-940b-c012d8e1efe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.060713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeda35-98c1-41e5-bc5c-7bc26981642d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.060992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeda35-98c1-41e5-bc5c-7bc26981642d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.061260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57aeda35-98c1-41e5-bc5c-7bc26981642d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.090217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f24713d7-b084-4c4c-940b-c012d8e1efe9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.091610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f24713d7-b084-4c4c-940b-c012d8e1efe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.092753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-57aeda35-98c1-41e5-bc5c-7bc26981642d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.094634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57aeda35-98c1-41e5-bc5c-7bc26981642d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.100571 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 616/1223] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.103171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a8222-c30b-4b67-881a-382a5c921794 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.103171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a8222-c30b-4b67-881a-382a5c921794 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.103171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950a8222-c30b-4b67-881a-382a5c921794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.111792 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 608/1224] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.111792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeda35-98c1-41e5-bc5c-7bc26981642d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.125402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57aeda35-98c1-41e5-bc5c-7bc26981642d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.133795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b2fc9-b704-4fbb-b7cb-77df354c68b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.134379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b2fc9-b704-4fbb-b7cb-77df354c68b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.134662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b2fc9-b704-4fbb-b7cb-77df354c68b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.134941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b2fc9-b704-4fbb-b7cb-77df354c68b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.135589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b2fc9-b704-4fbb-b7cb-77df354c68b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.139602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-950a8222-c30b-4b67-881a-382a5c921794 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.140564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-950a8222-c30b-4b67-881a-382a5c921794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.141977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2b2fc9-b704-4fbb-b7cb-77df354c68b6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.149965 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 617/1225] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.151364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117eab-a4d7-4824-b8e7-2487fa6868f3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.151643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117eab-a4d7-4824-b8e7-2487fa6868f3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.151911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb117eab-a4d7-4824-b8e7-2487fa6868f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.162305 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 609/1226] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:46.163152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b2fc9-b704-4fbb-b7cb-77df354c68b6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.173131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bb117eab-a4d7-4824-b8e7-2487fa6868f3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.174351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb117eab-a4d7-4824-b8e7-2487fa6868f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.174525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b2fc9-b704-4fbb-b7cb-77df354c68b6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.180096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34427985-01c5-49fb-a190-a5a6983b94a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.180750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34427985-01c5-49fb-a190-a5a6983b94a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.181069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34427985-01c5-49fb-a190-a5a6983b94a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.181322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34427985-01c5-49fb-a190-a5a6983b94a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.182101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34427985-01c5-49fb-a190-a5a6983b94a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.182351 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 618/1227] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.183618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619db53a-fbd9-40ca-a42f-fa56cd8829d4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.183731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34427985-01c5-49fb-a190-a5a6983b94a7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.183904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619db53a-fbd9-40ca-a42f-fa56cd8829d4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.184177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619db53a-fbd9-40ca-a42f-fa56cd8829d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.202065 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 610/1228] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:46.204811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-619db53a-fbd9-40ca-a42f-fa56cd8829d4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.206020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-619db53a-fbd9-40ca-a42f-fa56cd8829d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.206149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa86b-e609-49fe-8ccb-2262584e761b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.206413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa86b-e609-49fe-8ccb-2262584e761b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.206689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757aa86b-e609-49fe-8ccb-2262584e761b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.218142 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 619/1229] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.218142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c2749-8f03-4282-938c-61acbf22281b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.218142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c2749-8f03-4282-938c-61acbf22281b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.218142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26c2749-8f03-4282-938c-61acbf22281b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.229363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-757aa86b-e609-49fe-8ccb-2262584e761b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.230555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-757aa86b-e609-49fe-8ccb-2262584e761b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.238494 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 611/1230] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.239810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da08f-830f-4cd8-9ad0-1cdd94d79744 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.240094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da08f-830f-4cd8-9ad0-1cdd94d79744 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.240400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314da08f-830f-4cd8-9ad0-1cdd94d79744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.241374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c26c2749-8f03-4282-938c-61acbf22281b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.243358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c26c2749-8f03-4282-938c-61acbf22281b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.254671 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 620/1231] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.256197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2feaa-e200-4792-ac59-96777b88df91 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.256735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2feaa-e200-4792-ac59-96777b88df91 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.257800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2feaa-e200-4792-ac59-96777b88df91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.261633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-314da08f-830f-4cd8-9ad0-1cdd94d79744 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.262898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-314da08f-830f-4cd8-9ad0-1cdd94d79744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.275264 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 612/1232] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.276323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314da08f-830f-4cd8-9ad0-1cdd94d79744 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.280408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-03c2feaa-e200-4792-ac59-96777b88df91 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.282354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-03c2feaa-e200-4792-ac59-96777b88df91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.287531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314da08f-830f-4cd8-9ad0-1cdd94d79744 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.297132 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 621/1233] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.297132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3b7d-9efe-447f-8c78-eb46debdd94b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.297132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3b7d-9efe-447f-8c78-eb46debdd94b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.297132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984c3b7d-9efe-447f-8c78-eb46debdd94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.299102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6f5c4-01ef-4e11-b236-832c8d78ccd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.299943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6f5c4-01ef-4e11-b236-832c8d78ccd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.300297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6f5c4-01ef-4e11-b236-832c8d78ccd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.300643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6f5c4-01ef-4e11-b236-832c8d78ccd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.305413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6f5c4-01ef-4e11-b236-832c8d78ccd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.305413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6f5c4-01ef-4e11-b236-832c8d78ccd7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.313812 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:46.314296 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 613/1234] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:46.315134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6f5c4-01ef-4e11-b236-832c8d78ccd7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.323355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-984c3b7d-9efe-447f-8c78-eb46debdd94b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.324999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-984c3b7d-9efe-447f-8c78-eb46debdd94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.326594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6f5c4-01ef-4e11-b236-832c8d78ccd7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.331418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c6eb45-0f11-4b58-bc42-a0948965e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.332145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6eb45-0f11-4b58-bc42-a0948965e892 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.332784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6eb45-0f11-4b58-bc42-a0948965e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.332784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c6eb45-0f11-4b58-bc42-a0948965e892 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.333316 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 622/1235] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.334128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3b7d-9efe-447f-8c78-eb46debdd94b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.337601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6eb45-0f11-4b58-bc42-a0948965e892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.339274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c6eb45-0f11-4b58-bc42-a0948965e892 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.344467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984c3b7d-9efe-447f-8c78-eb46debdd94b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.349470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ec1dd-5610-4f3c-b0a6-2a43ebe01da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.349630 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 614/1236] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:46.350722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bac30d-efd9-4933-b505-60d8064c5015 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.350878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ec1dd-5610-4f3c-b0a6-2a43ebe01da6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.351033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bac30d-efd9-4933-b505-60d8064c5015 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.351305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bac30d-efd9-4933-b505-60d8064c5015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.351555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ec1dd-5610-4f3c-b0a6-2a43ebe01da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.351953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ec1dd-5610-4f3c-b0a6-2a43ebe01da6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.352796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ec1dd-5610-4f3c-b0a6-2a43ebe01da6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:46.353065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ec1dd-5610-4f3c-b0a6-2a43ebe01da6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.354700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ec1dd-5610-4f3c-b0a6-2a43ebe01da6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.374999 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 623/1237] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:46.374999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ec1dd-5610-4f3c-b0a6-2a43ebe01da6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.375798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-12bac30d-efd9-4933-b505-60d8064c5015 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.375798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-12bac30d-efd9-4933-b505-60d8064c5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.386842 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 615/1238] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:46.386842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bac30d-efd9-4933-b505-60d8064c5015 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.390465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ec1dd-5610-4f3c-b0a6-2a43ebe01da6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.395609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bac30d-efd9-4933-b505-60d8064c5015 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.396809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827c10-cd5f-43cd-9f02-dec7a49eebeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.397614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827c10-cd5f-43cd-9f02-dec7a49eebeb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.398408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827c10-cd5f-43cd-9f02-dec7a49eebeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.398698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16827c10-cd5f-43cd-9f02-dec7a49eebeb admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.399358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16827c10-cd5f-43cd-9f02-dec7a49eebeb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:46.399665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16827c10-cd5f-43cd-9f02-dec7a49eebeb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.401334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16827c10-cd5f-43cd-9f02-dec7a49eebeb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.403258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e57e-d1a2-44fb-9d27-e5cf7e3017cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.405016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e57e-d1a2-44fb-9d27-e5cf7e3017cf admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.405471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e57e-d1a2-44fb-9d27-e5cf7e3017cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.405821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107e57e-d1a2-44fb-9d27-e5cf7e3017cf admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.406607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107e57e-d1a2-44fb-9d27-e5cf7e3017cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:46.407010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107e57e-d1a2-44fb-9d27-e5cf7e3017cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.408815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a107e57e-d1a2-44fb-9d27-e5cf7e3017cf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.421709 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 624/1239] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:46.423273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827c10-cd5f-43cd-9f02-dec7a49eebeb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.423593 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 616/1240] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:46.424476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e57e-d1a2-44fb-9d27-e5cf7e3017cf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.437363 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:46.443513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16827c10-cd5f-43cd-9f02-dec7a49eebeb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.443828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107e57e-d1a2-44fb-9d27-e5cf7e3017cf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.449505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa52323-acae-4011-8e27-69b4cf86fbc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.450401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa52323-acae-4011-8e27-69b4cf86fbc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.450686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa52323-acae-4011-8e27-69b4cf86fbc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.451008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa52323-acae-4011-8e27-69b4cf86fbc5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.451847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd831-6819-4192-814d-cbe0cae6f840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.451988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa52323-acae-4011-8e27-69b4cf86fbc5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:46.452259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa52323-acae-4011-8e27-69b4cf86fbc5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.452683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd831-6819-4192-814d-cbe0cae6f840 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.453026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd831-6819-4192-814d-cbe0cae6f840 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.453537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88dd831-6819-4192-814d-cbe0cae6f840 admin admin] PATH_INFO: `/v3/projects/b6c53bdfc24c4cb0a6c9b02779cc7d62/users/f8347b4e37424f499f5756ca8b88fab4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.454180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa52323-acae-4011-8e27-69b4cf86fbc5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.468434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 625/1241] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:46.470535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa52323-acae-4011-8e27-69b4cf86fbc5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.471787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dd831-6819-4192-814d-cbe0cae6f840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6c53bdfc24c4cb0a6c9b02779cc7d62, user_id=f8347b4e37424f499f5756ca8b88fab4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.474994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88dd831-6819-4192-814d-cbe0cae6f840 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.483304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa52323-acae-4011-8e27-69b4cf86fbc5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.489669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db20b-95f9-45be-81d0-019ff0da9fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.490292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db20b-95f9-45be-81d0-019ff0da9fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.490604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db20b-95f9-45be-81d0-019ff0da9fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.490963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12db20b-95f9-45be-81d0-019ff0da9fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.492197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12db20b-95f9-45be-81d0-019ff0da9fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:46.492508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12db20b-95f9-45be-81d0-019ff0da9fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.493873 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 617/1242] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:46 2022] PUT /identity/v3/projects/b6c53bdfc24c4cb0a6c9b02779cc7d62/users/f8347b4e37424f499f5756ca8b88fab4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:46.494436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12db20b-95f9-45be-81d0-019ff0da9fc6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.494619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd831-6819-4192-814d-cbe0cae6f840 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.510633 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 626/1243] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:46.512217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db20b-95f9-45be-81d0-019ff0da9fc6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.523042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12db20b-95f9-45be-81d0-019ff0da9fc6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.573656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88dd831-6819-4192-814d-cbe0cae6f840 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.578792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a16e8-ab38-4d4a-9dfc-61cc2a11aae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.580080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a16e8-ab38-4d4a-9dfc-61cc2a11aae7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.580292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a16e8-ab38-4d4a-9dfc-61cc2a11aae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.580662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863a16e8-ab38-4d4a-9dfc-61cc2a11aae7 admin admin] PATH_INFO: `/v3/projects/7784f0dfd226407cbb3bc67566ccedf5/users/78b4383266414cb69102b500917782d5/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.599535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af087ceb-7330-41d4-8bfe-7cd199becf21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.600902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af087ceb-7330-41d4-8bfe-7cd199becf21 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.601521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af087ceb-7330-41d4-8bfe-7cd199becf21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.602161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af087ceb-7330-41d4-8bfe-7cd199becf21 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.603720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af087ceb-7330-41d4-8bfe-7cd199becf21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.608185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af087ceb-7330-41d4-8bfe-7cd199becf21 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.608593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a16e8-ab38-4d4a-9dfc-61cc2a11aae7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7784f0dfd226407cbb3bc67566ccedf5, user_id=78b4383266414cb69102b500917782d5, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.611391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863a16e8-ab38-4d4a-9dfc-61cc2a11aae7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.632008 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 618/1244] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:46 2022] PUT /identity/v3/projects/7784f0dfd226407cbb3bc67566ccedf5/users/78b4383266414cb69102b500917782d5/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:46.633741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a16e8-ab38-4d4a-9dfc-61cc2a11aae7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.660883 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 627/1245] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/projects => generated 389 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:46.662074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af087ceb-7330-41d4-8bfe-7cd199becf21 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.708866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863a16e8-ab38-4d4a-9dfc-61cc2a11aae7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.732347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af087ceb-7330-41d4-8bfe-7cd199becf21 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.737795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb5941-19ef-49ad-8c15-c20323435036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.738560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb5941-19ef-49ad-8c15-c20323435036 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.738978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb5941-19ef-49ad-8c15-c20323435036 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.739322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbb5941-19ef-49ad-8c15-c20323435036 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.740087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb5941-19ef-49ad-8c15-c20323435036 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.742697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbb5941-19ef-49ad-8c15-c20323435036 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.778889 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 628/1246] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/projects => generated 397 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:46.778889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb5941-19ef-49ad-8c15-c20323435036 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.780288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8e02a-153d-4527-a601-dcfa2966cb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.781023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8e02a-153d-4527-a601-dcfa2966cb94 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.781404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8e02a-153d-4527-a601-dcfa2966cb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.782424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d8e02a-153d-4527-a601-dcfa2966cb94 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.783612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8e02a-153d-4527-a601-dcfa2966cb94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:46.783737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8e02a-153d-4527-a601-dcfa2966cb94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.785934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d8e02a-153d-4527-a601-dcfa2966cb94 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.800670 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 619/1247] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:46.801906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8e02a-153d-4527-a601-dcfa2966cb94 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.802341 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:46.811215 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:46.816758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d8e02a-153d-4527-a601-dcfa2966cb94 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.851894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbb5941-19ef-49ad-8c15-c20323435036 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:46.857158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09876f6c-d024-49d3-ade9-357c5528779d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.857808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09876f6c-d024-49d3-ade9-357c5528779d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.858090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09876f6c-d024-49d3-ade9-357c5528779d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.858455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09876f6c-d024-49d3-ade9-357c5528779d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.859091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09876f6c-d024-49d3-ade9-357c5528779d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.861153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09876f6c-d024-49d3-ade9-357c5528779d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.882032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f688f-7175-4120-ab86-5188358d7a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:46.882847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f688f-7175-4120-ab86-5188358d7a13 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.883063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f688f-7175-4120-ab86-5188358d7a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.883386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f688f-7175-4120-ab86-5188358d7a13 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.884198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f688f-7175-4120-ab86-5188358d7a13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:46.886118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737f688f-7175-4120-ab86-5188358d7a13 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:46.895590 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 629/1248] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:46.895590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559b5f3-8d02-426d-8a11-1d1aa0f411b5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:46.895590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559b5f3-8d02-426d-8a11-1d1aa0f411b5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:46.895590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6559b5f3-8d02-426d-8a11-1d1aa0f411b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:46.919294 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 620/1249] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:46.920618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f688f-7175-4120-ab86-5188358d7a13 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:46.934727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6559b5f3-8d02-426d-8a11-1d1aa0f411b5 None None] MFA Rules not processed for user `f8347b4e37424f499f5756ca8b88fab4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:46.936873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6559b5f3-8d02-426d-8a11-1d1aa0f411b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:46.996358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737f688f-7175-4120-ab86-5188358d7a13 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.001392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f23f-4084-4d85-bdf1-e61cbc267888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.002068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f23f-4084-4d85-bdf1-e61cbc267888 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.002347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f23f-4084-4d85-bdf1-e61cbc267888 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.009695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a804f23f-4084-4d85-bdf1-e61cbc267888 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.010387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f23f-4084-4d85-bdf1-e61cbc267888 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.012735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a804f23f-4084-4d85-bdf1-e61cbc267888 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.014303 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 630/1250] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:47.019888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b13d7-e5cb-4591-8fc0-c3e32e2db11b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.020259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b13d7-e5cb-4591-8fc0-c3e32e2db11b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.020644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b13d7-e5cb-4591-8fc0-c3e32e2db11b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.045585 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 621/1251] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:46 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.048905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f23f-4084-4d85-bdf1-e61cbc267888 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.057940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a72b13d7-e5cb-4591-8fc0-c3e32e2db11b None None] MFA Rules not processed for user `78b4383266414cb69102b500917782d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:47.059272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a72b13d7-e5cb-4591-8fc0-c3e32e2db11b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:47.118358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a804f23f-4084-4d85-bdf1-e61cbc267888 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.124674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15318f-4fec-4ebc-baeb-ce31f14bb8f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.125632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15318f-4fec-4ebc-baeb-ce31f14bb8f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.126132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15318f-4fec-4ebc-baeb-ce31f14bb8f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.126754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a15318f-4fec-4ebc-baeb-ce31f14bb8f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.127418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15318f-4fec-4ebc-baeb-ce31f14bb8f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.129451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a15318f-4fec-4ebc-baeb-ce31f14bb8f5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.140636 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 631/1252] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:47.141766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b13d7-e5cb-4591-8fc0-c3e32e2db11b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.155738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b13d7-e5cb-4591-8fc0-c3e32e2db11b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.162185 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 622/1253] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/users => generated 295 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.162185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15318f-4fec-4ebc-baeb-ce31f14bb8f5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.162434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f5df7-7be1-48df-b367-832fe613f6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.162434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f5df7-7be1-48df-b367-832fe613f6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.162434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f5df7-7be1-48df-b367-832fe613f6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.162434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2f5df7-7be1-48df-b367-832fe613f6a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.162811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f5df7-7be1-48df-b367-832fe613f6a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.164654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2f5df7-7be1-48df-b367-832fe613f6a5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.169024 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:47.173717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a15318f-4fec-4ebc-baeb-ce31f14bb8f5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.182400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba067-23f4-4c73-a772-0f52ae307cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.183007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba067-23f4-4c73-a772-0f52ae307cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.183282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba067-23f4-4c73-a772-0f52ae307cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.183574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38ba067-23f4-4c73-a772-0f52ae307cf2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.184204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ba067-23f4-4c73-a772-0f52ae307cf2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.186245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38ba067-23f4-4c73-a772-0f52ae307cf2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.187011 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 632/1254] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/users => generated 299 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.187833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f5df7-7be1-48df-b367-832fe613f6a5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.194123 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:47.198300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2f5df7-7be1-48df-b367-832fe613f6a5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.204917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebbdb8-9902-4b6d-a9f4-d6270216956a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.205585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebbdb8-9902-4b6d-a9f4-d6270216956a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.205905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebbdb8-9902-4b6d-a9f4-d6270216956a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.206200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ebbdb8-9902-4b6d-a9f4-d6270216956a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.206925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebbdb8-9902-4b6d-a9f4-d6270216956a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.209129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ebbdb8-9902-4b6d-a9f4-d6270216956a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.216484 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 623/1255] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.217564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba067-23f4-4c73-a772-0f52ae307cf2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.234542 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 633/1256] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/users => generated 292 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.235707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebbdb8-9902-4b6d-a9f4-d6270216956a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.246582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ebbdb8-9902-4b6d-a9f4-d6270216956a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.288110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38ba067-23f4-4c73-a772-0f52ae307cf2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.294261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b17f1-b084-499e-91b4-c1668e6be138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.294882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b17f1-b084-499e-91b4-c1668e6be138 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.295159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b17f1-b084-499e-91b4-c1668e6be138 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.295437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8b17f1-b084-499e-91b4-c1668e6be138 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.296065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b17f1-b084-499e-91b4-c1668e6be138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.298026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8b17f1-b084-499e-91b4-c1668e6be138 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.318671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7009f-cbbf-4230-8eb5-266e675cf14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.319245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7009f-cbbf-4230-8eb5-266e675cf14b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.319516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7009f-cbbf-4230-8eb5-266e675cf14b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.319918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e7009f-cbbf-4230-8eb5-266e675cf14b admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.320546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7009f-cbbf-4230-8eb5-266e675cf14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.322652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e7009f-cbbf-4230-8eb5-266e675cf14b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.322774 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 624/1257] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.323565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b17f1-b084-499e-91b4-c1668e6be138 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.333914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8b17f1-b084-499e-91b4-c1668e6be138 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.339498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e814aad-acdc-4ca7-bb36-957670f1c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.340129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e814aad-acdc-4ca7-bb36-957670f1c61c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.340414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e814aad-acdc-4ca7-bb36-957670f1c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.340690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e814aad-acdc-4ca7-bb36-957670f1c61c admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.341341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e814aad-acdc-4ca7-bb36-957670f1c61c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.343270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e814aad-acdc-4ca7-bb36-957670f1c61c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.356862 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 634/1258] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/projects => generated 383 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.357711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7009f-cbbf-4230-8eb5-266e675cf14b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.364565 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 625/1259] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/users => generated 286 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.365448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e814aad-acdc-4ca7-bb36-957670f1c61c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.375771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e814aad-acdc-4ca7-bb36-957670f1c61c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.428723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e7009f-cbbf-4230-8eb5-266e675cf14b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.432124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737813a-6bce-4124-9812-503ae5f96ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.432726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737813a-6bce-4124-9812-503ae5f96ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.433001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737813a-6bce-4124-9812-503ae5f96ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.433268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737813a-6bce-4124-9812-503ae5f96ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.433928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737813a-6bce-4124-9812-503ae5f96ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.434042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d423fd4-52a5-49a1-8511-a4bba2dd796a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.434642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d423fd4-52a5-49a1-8511-a4bba2dd796a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.434996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d423fd4-52a5-49a1-8511-a4bba2dd796a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.435276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d423fd4-52a5-49a1-8511-a4bba2dd796a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.435509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737813a-6bce-4124-9812-503ae5f96ba8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.435911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d423fd4-52a5-49a1-8511-a4bba2dd796a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.438668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d423fd4-52a5-49a1-8511-a4bba2dd796a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.447251 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 626/1260] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.448294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737813a-6bce-4124-9812-503ae5f96ba8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.458047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737813a-6bce-4124-9812-503ae5f96ba8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.467129 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 635/1261] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/projects => generated 377 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.467394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd8df-8883-4b34-8381-faa8d0f1789c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.468040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd8df-8883-4b34-8381-faa8d0f1789c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.468326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd8df-8883-4b34-8381-faa8d0f1789c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.468437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d423fd4-52a5-49a1-8511-a4bba2dd796a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.468612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1dd8df-8883-4b34-8381-faa8d0f1789c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.469240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd8df-8883-4b34-8381-faa8d0f1789c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.470870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1dd8df-8883-4b34-8381-faa8d0f1789c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.482682 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 627/1262] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.483497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd8df-8883-4b34-8381-faa8d0f1789c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.493208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1dd8df-8883-4b34-8381-faa8d0f1789c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.531560 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:47.535157 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:47.535848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d423fd4-52a5-49a1-8511-a4bba2dd796a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.542471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989d3a0-bdbc-4d7e-a3e5-0d42e579e663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.543132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989d3a0-bdbc-4d7e-a3e5-0d42e579e663 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.543474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989d3a0-bdbc-4d7e-a3e5-0d42e579e663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.543750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8989d3a0-bdbc-4d7e-a3e5-0d42e579e663 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.544375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989d3a0-bdbc-4d7e-a3e5-0d42e579e663 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.546511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8989d3a0-bdbc-4d7e-a3e5-0d42e579e663 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.556365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d91e5-f8a6-40e4-8342-adf58c6bb3a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.557510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d91e5-f8a6-40e4-8342-adf58c6bb3a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.557899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d91e5-f8a6-40e4-8342-adf58c6bb3a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.558715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20d91e5-f8a6-40e4-8342-adf58c6bb3a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.559541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d91e5-f8a6-40e4-8342-adf58c6bb3a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.561454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20d91e5-f8a6-40e4-8342-adf58c6bb3a2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.569117 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 636/1263] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.570626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989d3a0-bdbc-4d7e-a3e5-0d42e579e663 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.576240 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 628/1264] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.576240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d91e5-f8a6-40e4-8342-adf58c6bb3a2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.581058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8989d3a0-bdbc-4d7e-a3e5-0d42e579e663 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.584169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20d91e5-f8a6-40e4-8342-adf58c6bb3a2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.586692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea9b16-40bf-4151-9ef9-4800459d9cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.587295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea9b16-40bf-4151-9ef9-4800459d9cff admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.587579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea9b16-40bf-4151-9ef9-4800459d9cff admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.587855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea9b16-40bf-4151-9ef9-4800459d9cff admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.588495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea9b16-40bf-4151-9ef9-4800459d9cff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.589767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a3239-6834-41f4-adf6-2f38a9180fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.590158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eea9b16-40bf-4151-9ef9-4800459d9cff admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.590366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a3239-6834-41f4-adf6-2f38a9180fbd admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.590650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a3239-6834-41f4-adf6-2f38a9180fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.590927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9a3239-6834-41f4-adf6-2f38a9180fbd admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.591563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a3239-6834-41f4-adf6-2f38a9180fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.593554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9a3239-6834-41f4-adf6-2f38a9180fbd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.601266 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 637/1265] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.601894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea9b16-40bf-4151-9ef9-4800459d9cff admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.611817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eea9b16-40bf-4151-9ef9-4800459d9cff admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.616693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966f4de-e5cf-42ff-ac15-299957bffbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.617340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966f4de-e5cf-42ff-ac15-299957bffbd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.617616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966f4de-e5cf-42ff-ac15-299957bffbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.617793 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 629/1266] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/users => generated 298 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.617901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3966f4de-e5cf-42ff-ac15-299957bffbd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.618554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966f4de-e5cf-42ff-ac15-299957bffbd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.618658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a3239-6834-41f4-adf6-2f38a9180fbd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.620630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3966f4de-e5cf-42ff-ac15-299957bffbd0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.628528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9a3239-6834-41f4-adf6-2f38a9180fbd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.634736 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 638/1267] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.634736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966f4de-e5cf-42ff-ac15-299957bffbd0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.634983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda88b8a-18d1-4a4c-9d8c-bdfc4d1e2aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.634983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88b8a-18d1-4a4c-9d8c-bdfc4d1e2aff admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.634983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88b8a-18d1-4a4c-9d8c-bdfc4d1e2aff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.634983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda88b8a-18d1-4a4c-9d8c-bdfc4d1e2aff admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.635441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda88b8a-18d1-4a4c-9d8c-bdfc4d1e2aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.637025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda88b8a-18d1-4a4c-9d8c-bdfc4d1e2aff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.644109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3966f4de-e5cf-42ff-ac15-299957bffbd0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.647742 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 630/1268] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.649130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda88b8a-18d1-4a4c-9d8c-bdfc4d1e2aff admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.649396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fd5b4-b7e4-4d21-a4f6-b9f78d9e1d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.649998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fd5b4-b7e4-4d21-a4f6-b9f78d9e1d1b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.650460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fd5b4-b7e4-4d21-a4f6-b9f78d9e1d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.650738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9fd5b4-b7e4-4d21-a4f6-b9f78d9e1d1b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.651487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fd5b4-b7e4-4d21-a4f6-b9f78d9e1d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.653726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9fd5b4-b7e4-4d21-a4f6-b9f78d9e1d1b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.659195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda88b8a-18d1-4a4c-9d8c-bdfc4d1e2aff admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.667448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda233d8-bd9d-4314-a38c-1396e6161ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.668188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda233d8-bd9d-4314-a38c-1396e6161ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.668511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda233d8-bd9d-4314-a38c-1396e6161ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.668914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda233d8-bd9d-4314-a38c-1396e6161ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.669722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda233d8-bd9d-4314-a38c-1396e6161ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.671783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda233d8-bd9d-4314-a38c-1396e6161ec8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.677948 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 639/1269] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:47 2022] POST /identity/v3/users => generated 295 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:47.678781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fd5b4-b7e4-4d21-a4f6-b9f78d9e1d1b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.683339 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 631/1270] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.684511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda233d8-bd9d-4314-a38c-1396e6161ec8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.691761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9fd5b4-b7e4-4d21-a4f6-b9f78d9e1d1b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.695945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda233d8-bd9d-4314-a38c-1396e6161ec8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.697048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c50b-df55-471d-8013-587f5e261dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.697708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c50b-df55-471d-8013-587f5e261dec admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.697995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c50b-df55-471d-8013-587f5e261dec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.698277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1c50b-df55-471d-8013-587f5e261dec admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.698920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c50b-df55-471d-8013-587f5e261dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.700527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1c50b-df55-471d-8013-587f5e261dec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.700812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2fac8-342a-45fa-937b-b38706147b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.701446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2fac8-342a-45fa-937b-b38706147b75 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.701720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2fac8-342a-45fa-937b-b38706147b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.702008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a2fac8-342a-45fa-937b-b38706147b75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.702658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2fac8-342a-45fa-937b-b38706147b75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.704278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a2fac8-342a-45fa-937b-b38706147b75 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.714587 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 640/1271] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.715559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c50b-df55-471d-8013-587f5e261dec admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.717330 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 632/1272] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.718155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2fac8-342a-45fa-937b-b38706147b75 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.728307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a2fac8-342a-45fa-937b-b38706147b75 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.729448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1c50b-df55-471d-8013-587f5e261dec admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.733282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3642b-dce5-4b15-aa7a-0ac2f63ae4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.733867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3642b-dce5-4b15-aa7a-0ac2f63ae4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.734206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3642b-dce5-4b15-aa7a-0ac2f63ae4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.734338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4e0a8-b6d4-4520-a58c-ab0d3ae80c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.734519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f3642b-dce5-4b15-aa7a-0ac2f63ae4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.734829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4e0a8-b6d4-4520-a58c-ab0d3ae80c00 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.735113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3642b-dce5-4b15-aa7a-0ac2f63ae4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.735325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4e0a8-b6d4-4520-a58c-ab0d3ae80c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.736039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da4e0a8-b6d4-4520-a58c-ab0d3ae80c00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.736687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4e0a8-b6d4-4520-a58c-ab0d3ae80c00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.736902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f3642b-dce5-4b15-aa7a-0ac2f63ae4d3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.738375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da4e0a8-b6d4-4520-a58c-ab0d3ae80c00 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.752527 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 633/1273] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.752769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 641/1274] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.752769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4e0a8-b6d4-4520-a58c-ab0d3ae80c00 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.754137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3642b-dce5-4b15-aa7a-0ac2f63ae4d3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.759847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da4e0a8-b6d4-4520-a58c-ab0d3ae80c00 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.764656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae956875-7142-4307-afb1-0d0e07e9fbdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.765256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae956875-7142-4307-afb1-0d0e07e9fbdb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.765560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae956875-7142-4307-afb1-0d0e07e9fbdb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.765838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae956875-7142-4307-afb1-0d0e07e9fbdb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.765941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f3642b-dce5-4b15-aa7a-0ac2f63ae4d3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.766473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae956875-7142-4307-afb1-0d0e07e9fbdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.768066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae956875-7142-4307-afb1-0d0e07e9fbdb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.770613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831015ca-fbce-49a8-9254-80e00bfe837a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.771257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831015ca-fbce-49a8-9254-80e00bfe837a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.771534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831015ca-fbce-49a8-9254-80e00bfe837a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.771804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831015ca-fbce-49a8-9254-80e00bfe837a admin admin] PATH_INFO: `/v3/projects/f573f5fcb0b84c6897e41f478d05286d/users/d948c144feed4b4baebaa31e67002d8a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.779015 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 642/1275] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.779804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae956875-7142-4307-afb1-0d0e07e9fbdb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.787712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831015ca-fbce-49a8-9254-80e00bfe837a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f573f5fcb0b84c6897e41f478d05286d, user_id=d948c144feed4b4baebaa31e67002d8a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.789841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae956875-7142-4307-afb1-0d0e07e9fbdb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.791047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831015ca-fbce-49a8-9254-80e00bfe837a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.795154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6a707-46f2-4a98-8f40-e40995fe2b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.795850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6a707-46f2-4a98-8f40-e40995fe2b7c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.796316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6a707-46f2-4a98-8f40-e40995fe2b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.796734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b6a707-46f2-4a98-8f40-e40995fe2b7c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.797528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6a707-46f2-4a98-8f40-e40995fe2b7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.799626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b6a707-46f2-4a98-8f40-e40995fe2b7c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.806535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 634/1276] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:47 2022] PUT /identity/v3/projects/f573f5fcb0b84c6897e41f478d05286d/users/d948c144feed4b4baebaa31e67002d8a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:47.807341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831015ca-fbce-49a8-9254-80e00bfe837a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.811340 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 643/1277] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.812165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6a707-46f2-4a98-8f40-e40995fe2b7c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.825863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b6a707-46f2-4a98-8f40-e40995fe2b7c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.883517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831015ca-fbce-49a8-9254-80e00bfe837a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.884482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2f6f-02f0-4b59-b175-4d882c3a7b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.885226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2f6f-02f0-4b59-b175-4d882c3a7b84 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.885553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2f6f-02f0-4b59-b175-4d882c3a7b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.885836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0af2f6f-02f0-4b59-b175-4d882c3a7b84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.886483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af2f6f-02f0-4b59-b175-4d882c3a7b84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.888132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84670b42-8176-4767-980f-36ea3d8e40a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.888289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0af2f6f-02f0-4b59-b175-4d882c3a7b84 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.888779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84670b42-8176-4767-980f-36ea3d8e40a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.889065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84670b42-8176-4767-980f-36ea3d8e40a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.889441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84670b42-8176-4767-980f-36ea3d8e40a2 admin admin] PATH_INFO: `/v3/projects/b0f35890b16448ec826fa5c1dd4e2c2c/users/1297fc6a7dd748e7ba7bf7a647ffd3da/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.898843 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 644/1278] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:47.899787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2f6f-02f0-4b59-b175-4d882c3a7b84 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.907471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84670b42-8176-4767-980f-36ea3d8e40a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0f35890b16448ec826fa5c1dd4e2c2c, user_id=1297fc6a7dd748e7ba7bf7a647ffd3da, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.909411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0af2f6f-02f0-4b59-b175-4d882c3a7b84 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:47.910327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84670b42-8176-4767-980f-36ea3d8e40a2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.914152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb6fe0-ed98-4e6e-b6dd-015adfecd0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:47.914973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb6fe0-ed98-4e6e-b6dd-015adfecd0d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:47.915466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb6fe0-ed98-4e6e-b6dd-015adfecd0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:47.915809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cb6fe0-ed98-4e6e-b6dd-015adfecd0d3 admin admin] PATH_INFO: `/v3/projects/08ae7863a74b463382c610eefe5586f5/users/b35d1690512a499fbca3fc4de2b60bfe/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:47.924137 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 635/1279] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:47 2022] PUT /identity/v3/projects/b0f35890b16448ec826fa5c1dd4e2c2c/users/1297fc6a7dd748e7ba7bf7a647ffd3da/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:47.925012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84670b42-8176-4767-980f-36ea3d8e40a2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.932648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb6fe0-ed98-4e6e-b6dd-015adfecd0d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08ae7863a74b463382c610eefe5586f5, user_id=b35d1690512a499fbca3fc4de2b60bfe, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:47.935425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cb6fe0-ed98-4e6e-b6dd-015adfecd0d3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:47.949260 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 645/1280] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:47 2022] PUT /identity/v3/projects/08ae7863a74b463382c610eefe5586f5/users/b35d1690512a499fbca3fc4de2b60bfe/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:47.950074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb6fe0-ed98-4e6e-b6dd-015adfecd0d3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:47.963759 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:47.995813 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:47.996021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84670b42-8176-4767-980f-36ea3d8e40a2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.020217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cb6fe0-ed98-4e6e-b6dd-015adfecd0d3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.025774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218545f-eb32-4db3-b144-6782aca1ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.026490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218545f-eb32-4db3-b144-6782aca1ff51 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.026818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218545f-eb32-4db3-b144-6782aca1ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.027118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1218545f-eb32-4db3-b144-6782aca1ff51 admin admin] PATH_INFO: `/v3/projects/6016c15bfdde44bab9699c21dabfe9c1/users/0850088244324db999931ef997700a69/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.043495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218545f-eb32-4db3-b144-6782aca1ff51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6016c15bfdde44bab9699c21dabfe9c1, user_id=0850088244324db999931ef997700a69, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.046469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1218545f-eb32-4db3-b144-6782aca1ff51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.053018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfcd18-1420-4e48-a27b-7f8baa1061de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.053712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfcd18-1420-4e48-a27b-7f8baa1061de admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.054000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfcd18-1420-4e48-a27b-7f8baa1061de admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.054803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfcd18-1420-4e48-a27b-7f8baa1061de admin admin] PATH_INFO: `/v3/projects/795036e27bb94a21a2e278bdba2ffc71/users/c8cbd9603b0b471eb7e4eeeb542505fa/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.063403 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 646/1281] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:47 2022] PUT /identity/v3/projects/6016c15bfdde44bab9699c21dabfe9c1/users/0850088244324db999931ef997700a69/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:48.066828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218545f-eb32-4db3-b144-6782aca1ff51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.071781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfcd18-1420-4e48-a27b-7f8baa1061de admin admin] RBAC: Authorizing `identity:create_grant(project_id=795036e27bb94a21a2e278bdba2ffc71, user_id=c8cbd9603b0b471eb7e4eeeb542505fa, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.075257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfcd18-1420-4e48-a27b-7f8baa1061de admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.089062 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 636/1282] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:47 2022] PUT /identity/v3/projects/795036e27bb94a21a2e278bdba2ffc71/users/c8cbd9603b0b471eb7e4eeeb542505fa/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:48.090266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfcd18-1420-4e48-a27b-7f8baa1061de admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.129544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1218545f-eb32-4db3-b144-6782aca1ff51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.156076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfcd18-1420-4e48-a27b-7f8baa1061de admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.161052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d83e342-72d3-4414-981c-c8358c4965e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.161744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83e342-72d3-4414-981c-c8358c4965e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.162024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83e342-72d3-4414-981c-c8358c4965e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.162300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d83e342-72d3-4414-981c-c8358c4965e6 admin admin] PATH_INFO: `/v3/projects/f587d85a98b64be5aae05d66e35cf5b2/users/0779d91ec674452b873823f73ed6e8cb/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.176851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83e342-72d3-4414-981c-c8358c4965e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f587d85a98b64be5aae05d66e35cf5b2, user_id=0779d91ec674452b873823f73ed6e8cb, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.180097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d83e342-72d3-4414-981c-c8358c4965e6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.190229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b23905-a9ab-4ffc-8ec1-970e89c7606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.190898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b23905-a9ab-4ffc-8ec1-970e89c7606c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.191183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b23905-a9ab-4ffc-8ec1-970e89c7606c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.191465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b23905-a9ab-4ffc-8ec1-970e89c7606c admin admin] PATH_INFO: `/v3/projects/773e2628405a49089109aa5bf45eac6e/users/03667bc832004351a9c822f597f334ba/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.194846 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 637/1283] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:48 2022] PUT /identity/v3/projects/f587d85a98b64be5aae05d66e35cf5b2/users/0779d91ec674452b873823f73ed6e8cb/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:48.198746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8fa3-21e0-4946-8429-b492f876db8e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.199039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8fa3-21e0-4946-8429-b492f876db8e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.199314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae8fa3-21e0-4946-8429-b492f876db8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.207444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b23905-a9ab-4ffc-8ec1-970e89c7606c admin admin] RBAC: Authorizing `identity:create_grant(project_id=773e2628405a49089109aa5bf45eac6e, user_id=03667bc832004351a9c822f597f334ba, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.210173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b23905-a9ab-4ffc-8ec1-970e89c7606c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.224349 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 647/1284] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:48 2022] PUT /identity/v3/projects/773e2628405a49089109aa5bf45eac6e/users/03667bc832004351a9c822f597f334ba/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:48.225526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b23905-a9ab-4ffc-8ec1-970e89c7606c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.229909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-64ae8fa3-21e0-4946-8429-b492f876db8e None None] MFA Rules not processed for user `d948c144feed4b4baebaa31e67002d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:48.231410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-64ae8fa3-21e0-4946-8429-b492f876db8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:48.267410 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:48.283802 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:48.298761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b23905-a9ab-4ffc-8ec1-970e89c7606c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.303347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfbf3b7-3410-4c47-808a-ad4ad2d40cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.308303 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 638/1285] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:48.308554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbf3b7-3410-4c47-808a-ad4ad2d40cbe admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.308554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbf3b7-3410-4c47-808a-ad4ad2d40cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.308554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfbf3b7-3410-4c47-808a-ad4ad2d40cbe admin admin] PATH_INFO: `/v3/projects/475f9813da214a4f8ae7513258868d93/users/1efcace670dc4275a267b4eea407fe2f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.308959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab27f2-954a-4c0b-97a8-52824df7cee6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.308959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab27f2-954a-4c0b-97a8-52824df7cee6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.308959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ab27f2-954a-4c0b-97a8-52824df7cee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.320263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbf3b7-3410-4c47-808a-ad4ad2d40cbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=475f9813da214a4f8ae7513258868d93, user_id=1efcace670dc4275a267b4eea407fe2f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.322969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfbf3b7-3410-4c47-808a-ad4ad2d40cbe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.336553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-37ab27f2-954a-4c0b-97a8-52824df7cee6 None None] MFA Rules not processed for user `1297fc6a7dd748e7ba7bf7a647ffd3da`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:48.337275 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 648/1286] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:48 2022] PUT /identity/v3/projects/475f9813da214a4f8ae7513258868d93/users/1efcace670dc4275a267b4eea407fe2f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:48.337793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-37ab27f2-954a-4c0b-97a8-52824df7cee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:48.338664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7dc0-ee55-45e8-a122-2af385477fcc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.338951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7dc0-ee55-45e8-a122-2af385477fcc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.339230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8c7dc0-ee55-45e8-a122-2af385477fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.367848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bb8c7dc0-ee55-45e8-a122-2af385477fcc None None] MFA Rules not processed for user `b35d1690512a499fbca3fc4de2b60bfe`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:48.369048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb8c7dc0-ee55-45e8-a122-2af385477fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:48.409001 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 639/1287] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:48.409887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab27f2-954a-4c0b-97a8-52824df7cee6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.437714 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 649/1288] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:48.439070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76e67-e824-4f10-842c-c2d19805c59b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.439353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76e67-e824-4f10-842c-c2d19805c59b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.439627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc76e67-e824-4f10-842c-c2d19805c59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.468454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5bc76e67-e824-4f10-842c-c2d19805c59b None None] MFA Rules not processed for user `c8cbd9603b0b471eb7e4eeeb542505fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:48.469687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5bc76e67-e824-4f10-842c-c2d19805c59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:48.473168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ab27f2-954a-4c0b-97a8-52824df7cee6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.478363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9405ac-00e8-488f-ac42-01e11455f225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.478970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9405ac-00e8-488f-ac42-01e11455f225 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.479248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9405ac-00e8-488f-ac42-01e11455f225 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.479520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9405ac-00e8-488f-ac42-01e11455f225 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.480160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9405ac-00e8-488f-ac42-01e11455f225 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.481796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9405ac-00e8-488f-ac42-01e11455f225 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.492251 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 640/1289] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:48.493373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9405ac-00e8-488f-ac42-01e11455f225 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.503293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9405ac-00e8-488f-ac42-01e11455f225 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.508598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d3a32b-8680-4702-941f-c14cec8c8beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.509185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3a32b-8680-4702-941f-c14cec8c8beb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.509496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3a32b-8680-4702-941f-c14cec8c8beb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.509770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d3a32b-8680-4702-941f-c14cec8c8beb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.510396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3a32b-8680-4702-941f-c14cec8c8beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.511962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d3a32b-8680-4702-941f-c14cec8c8beb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.521898 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 641/1290] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:48.523164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03dd24-bcaf-4391-aadf-acc631ce610b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.523553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03dd24-bcaf-4391-aadf-acc631ce610b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.523985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf03dd24-bcaf-4391-aadf-acc631ce610b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.536469 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 650/1291] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:48.537336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc76e67-e824-4f10-842c-c2d19805c59b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.548487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc76e67-e824-4f10-842c-c2d19805c59b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.552803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cf03dd24-bcaf-4391-aadf-acc631ce610b None None] MFA Rules not processed for user `03667bc832004351a9c822f597f334ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:48.555093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cf03dd24-bcaf-4391-aadf-acc631ce610b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:48.555981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a0072d-4879-4137-98fe-07b350840c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.556090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0072d-4879-4137-98fe-07b350840c50 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.556413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0072d-4879-4137-98fe-07b350840c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.556738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a0072d-4879-4137-98fe-07b350840c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.557522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0072d-4879-4137-98fe-07b350840c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.559457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a0072d-4879-4137-98fe-07b350840c50 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.587689 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 651/1292] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:48.591980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e174e-cd8f-4fe0-bfb3-c35d89673e6d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.592271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e174e-cd8f-4fe0-bfb3-c35d89673e6d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.592560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88e174e-cd8f-4fe0-bfb3-c35d89673e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.598286 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:48.621443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e88e174e-cd8f-4fe0-bfb3-c35d89673e6d None None] MFA Rules not processed for user `1efcace670dc4275a267b4eea407fe2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:48.622953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e88e174e-cd8f-4fe0-bfb3-c35d89673e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:48.624391 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 642/1293] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:48.625035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03dd24-bcaf-4391-aadf-acc631ce610b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.635243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf03dd24-bcaf-4391-aadf-acc631ce610b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.649797 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:48.693896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a03dd-2a91-41c7-b4c8-5cde66313c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.694507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a03dd-2a91-41c7-b4c8-5cde66313c40 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.694832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a03dd-2a91-41c7-b4c8-5cde66313c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.695105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a03dd-2a91-41c7-b4c8-5cde66313c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.695741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a03dd-2a91-41c7-b4c8-5cde66313c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.697703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a03dd-2a91-41c7-b4c8-5cde66313c40 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.701447 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 652/1294] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:48.702309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e174e-cd8f-4fe0-bfb3-c35d89673e6d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.729455 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 643/1295] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/projects => generated 397 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:48.729455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a03dd-2a91-41c7-b4c8-5cde66313c40 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.761860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88e174e-cd8f-4fe0-bfb3-c35d89673e6d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.798330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a03dd-2a91-41c7-b4c8-5cde66313c40 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.805038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4f9dc-9a0c-4ce8-a45b-9c9012ba304d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.805499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4f9dc-9a0c-4ce8-a45b-9c9012ba304d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.805772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4f9dc-9a0c-4ce8-a45b-9c9012ba304d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.806047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4f9dc-9a0c-4ce8-a45b-9c9012ba304d admin admin] PATH_INFO: `/v3/projects/6016c15bfdde44bab9699c21dabfe9c1/users/0850088244324db999931ef997700a69/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.808455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4f9dc-9a0c-4ce8-a45b-9c9012ba304d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6016c15bfdde44bab9699c21dabfe9c1, user_id=0850088244324db999931ef997700a69, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.811579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4f9dc-9a0c-4ce8-a45b-9c9012ba304d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.819464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a62343-ebc2-46ec-bdde-545fafea1c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.820839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a62343-ebc2-46ec-bdde-545fafea1c2f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.821122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a62343-ebc2-46ec-bdde-545fafea1c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.821429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a62343-ebc2-46ec-bdde-545fafea1c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.823778 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 644/1296] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:48 2022] PUT /identity/v3/projects/6016c15bfdde44bab9699c21dabfe9c1/users/0850088244324db999931ef997700a69/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:48.824644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4f9dc-9a0c-4ce8-a45b-9c9012ba304d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.883981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a62343-ebc2-46ec-bdde-545fafea1c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.885518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a62343-ebc2-46ec-bdde-545fafea1c2f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.889072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4f9dc-9a0c-4ce8-a45b-9c9012ba304d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.893755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14898a-e862-416f-961c-cfe3424234be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.894408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14898a-e862-416f-961c-cfe3424234be admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.894693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14898a-e862-416f-961c-cfe3424234be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.894975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff14898a-e862-416f-961c-cfe3424234be admin admin] PATH_INFO: `/v3/projects/f587d85a98b64be5aae05d66e35cf5b2/users/0779d91ec674452b873823f73ed6e8cb/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.895111 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 653/1297] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:48 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:48.896021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a62343-ebc2-46ec-bdde-545fafea1c2f service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.899394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14898a-e862-416f-961c-cfe3424234be admin admin] RBAC: Authorizing `identity:create_grant(project_id=f587d85a98b64be5aae05d66e35cf5b2, user_id=0779d91ec674452b873823f73ed6e8cb, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.902328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff14898a-e862-416f-961c-cfe3424234be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.905531 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:48.907860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a62343-ebc2-46ec-bdde-545fafea1c2f service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:48.913566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffd1c6-6965-474b-aadf-2825587cbdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:48.914225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffd1c6-6965-474b-aadf-2825587cbdad admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:48.914508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffd1c6-6965-474b-aadf-2825587cbdad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:48.914772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ffd1c6-6965-474b-aadf-2825587cbdad admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:48.915420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffd1c6-6965-474b-aadf-2825587cbdad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:48.917925 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 645/1298] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:48 2022] PUT /identity/v3/projects/f587d85a98b64be5aae05d66e35cf5b2/users/0779d91ec674452b873823f73ed6e8cb/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:48.918215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ffd1c6-6965-474b-aadf-2825587cbdad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:48.918672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14898a-e862-416f-961c-cfe3424234be admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.952271 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 654/1299] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:48.953512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffd1c6-6965-474b-aadf-2825587cbdad admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:48.962646 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:48.999233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff14898a-e862-416f-961c-cfe3424234be admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.026369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ffd1c6-6965-474b-aadf-2825587cbdad admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.031226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a6178-4e59-4dc0-8c65-9a91f40193a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.031932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6178-4e59-4dc0-8c65-9a91f40193a3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.032329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6178-4e59-4dc0-8c65-9a91f40193a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.032676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368a6178-4e59-4dc0-8c65-9a91f40193a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.033402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a6178-4e59-4dc0-8c65-9a91f40193a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.035871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368a6178-4e59-4dc0-8c65-9a91f40193a3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.065960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa8c16-fbed-4a6c-9ba9-748ae4bcf7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.066541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8c16-fbed-4a6c-9ba9-748ae4bcf7bc admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.066824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8c16-fbed-4a6c-9ba9-748ae4bcf7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.067097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa8c16-fbed-4a6c-9ba9-748ae4bcf7bc admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.067731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa8c16-fbed-4a6c-9ba9-748ae4bcf7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.072636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa8c16-fbed-4a6c-9ba9-748ae4bcf7bc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.073118 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 655/1300] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:49.074310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a6178-4e59-4dc0-8c65-9a91f40193a3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.097273 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 646/1301] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:48 2022] POST /identity/v3/users => generated 301 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:49.098691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa8c16-fbed-4a6c-9ba9-748ae4bcf7bc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.111221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa8c16-fbed-4a6c-9ba9-748ae4bcf7bc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.145270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368a6178-4e59-4dc0-8c65-9a91f40193a3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.151168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1147817-273d-487f-942a-7e6cfc6f1fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.152296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1147817-273d-487f-942a-7e6cfc6f1fa8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.152796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1147817-273d-487f-942a-7e6cfc6f1fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.153316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1147817-273d-487f-942a-7e6cfc6f1fa8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.154545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1147817-273d-487f-942a-7e6cfc6f1fa8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.157210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1147817-273d-487f-942a-7e6cfc6f1fa8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.188110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e30a7-7e85-441c-ade2-e7204d976dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.188723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e30a7-7e85-441c-ade2-e7204d976dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.189002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e30a7-7e85-441c-ade2-e7204d976dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.189517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e30a7-7e85-441c-ade2-e7204d976dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.189629 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 656/1302] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/projects => generated 383 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:49.189924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e30a7-7e85-441c-ade2-e7204d976dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.190734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14efbf9-1db3-4362-8174-07e8b091d040 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.191026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14efbf9-1db3-4362-8174-07e8b091d040 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.191298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14efbf9-1db3-4362-8174-07e8b091d040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.191859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e30a7-7e85-441c-ade2-e7204d976dd7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.224382 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 647/1303] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/users => generated 305 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:49.224382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401fc3-67c9-4a61-bae7-590ab037fc2c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.224382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401fc3-67c9-4a61-bae7-590ab037fc2c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.224382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e401fc3-67c9-4a61-bae7-590ab037fc2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.227553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a14efbf9-1db3-4362-8174-07e8b091d040 None None] MFA Rules not processed for user `0850088244324db999931ef997700a69`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:49.228926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a14efbf9-1db3-4362-8174-07e8b091d040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.255474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8e401fc3-67c9-4a61-bae7-590ab037fc2c None None] MFA Rules not processed for user `0779d91ec674452b873823f73ed6e8cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:49.256701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8e401fc3-67c9-4a61-bae7-590ab037fc2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.265542 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.302131 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 657/1304] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:49.306301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14efbf9-1db3-4362-8174-07e8b091d040 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.310792 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.334953 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 648/1305] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:49.336010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401fc3-67c9-4a61-bae7-590ab037fc2c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.391577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14efbf9-1db3-4362-8174-07e8b091d040 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.396147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca052d-c7ff-4ff5-90fc-e1502ae3568d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.396754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca052d-c7ff-4ff5-90fc-e1502ae3568d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.397029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca052d-c7ff-4ff5-90fc-e1502ae3568d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.397325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca052d-c7ff-4ff5-90fc-e1502ae3568d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.398005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca052d-c7ff-4ff5-90fc-e1502ae3568d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.399922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca052d-c7ff-4ff5-90fc-e1502ae3568d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.409578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e401fc3-67c9-4a61-bae7-590ab037fc2c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.415052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e1230-7cef-44ff-a8cd-81e6ca33fedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.415718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e1230-7cef-44ff-a8cd-81e6ca33fedd admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.416088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e1230-7cef-44ff-a8cd-81e6ca33fedd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.416370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e1230-7cef-44ff-a8cd-81e6ca33fedd admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.417021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e1230-7cef-44ff-a8cd-81e6ca33fedd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.418946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e1230-7cef-44ff-a8cd-81e6ca33fedd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.421462 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 658/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/users => generated 297 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:49.422379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca052d-c7ff-4ff5-90fc-e1502ae3568d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.433795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca052d-c7ff-4ff5-90fc-e1502ae3568d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.439015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b726074-2473-4d00-88ee-32a0d09ba2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.439612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b726074-2473-4d00-88ee-32a0d09ba2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.439893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b726074-2473-4d00-88ee-32a0d09ba2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.440168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b726074-2473-4d00-88ee-32a0d09ba2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.440804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b726074-2473-4d00-88ee-32a0d09ba2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.441358 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 649/1307] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:49.442019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e1230-7cef-44ff-a8cd-81e6ca33fedd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.442433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b726074-2473-4d00-88ee-32a0d09ba2f5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.456114 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 659/1308] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:49.456114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b726074-2473-4d00-88ee-32a0d09ba2f5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.456458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e1230-7cef-44ff-a8cd-81e6ca33fedd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.460922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713bbe9c-6c64-4041-a8e4-152d0de29b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.461757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bbe9c-6c64-4041-a8e4-152d0de29b9e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.462037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bbe9c-6c64-4041-a8e4-152d0de29b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.463129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713bbe9c-6c64-4041-a8e4-152d0de29b9e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.463767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bbe9c-6c64-4041-a8e4-152d0de29b9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.465738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713bbe9c-6c64-4041-a8e4-152d0de29b9e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.466179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b726074-2473-4d00-88ee-32a0d09ba2f5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.470828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963057c-0926-45e2-9f6d-f5e3c0143b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.471400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963057c-0926-45e2-9f6d-f5e3c0143b51 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.471683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963057c-0926-45e2-9f6d-f5e3c0143b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.471956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e963057c-0926-45e2-9f6d-f5e3c0143b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.472654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963057c-0926-45e2-9f6d-f5e3c0143b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.474259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e963057c-0926-45e2-9f6d-f5e3c0143b51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.486289 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 660/1309] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:49.487139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963057c-0926-45e2-9f6d-f5e3c0143b51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.491438 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 650/1310] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/users => generated 298 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:49.491438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a36df0-61cb-42eb-a538-792e57b5657f None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.491438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a36df0-61cb-42eb-a538-792e57b5657f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.491438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a36df0-61cb-42eb-a538-792e57b5657f None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.491438 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 651/1311] 10.222.0.25 () {54 vars in 961 bytes} [Mon Oct 24 08:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:50:49.492730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9a68-be08-481a-87b4-2789c95afb23 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.493171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9a68-be08-481a-87b4-2789c95afb23 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.493613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04d9a68-be08-481a-87b4-2789c95afb23 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.495071 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 652/1312] 10.222.0.25 () {54 vars in 961 bytes} [Mon Oct 24 08:50:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:50:49.495788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9a68-be08-481a-87b4-2789c95afb23 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.499116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e963057c-0926-45e2-9f6d-f5e3c0143b51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.503861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.504488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.504928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.505214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] PATH_INFO: `/v3/users/b35d1690512a499fbca3fc4de2b60bfe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.506410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b35d1690512a499fbca3fc4de2b60bfe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.508396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.508878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04d9a68-be08-481a-87b4-2789c95afb23 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.513551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bafc7-e71b-4d8d-9ad2-6d3863efa8c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.514131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bafc7-e71b-4d8d-9ad2-6d3863efa8c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.514410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bafc7-e71b-4d8d-9ad2-6d3863efa8c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.514684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653bafc7-e71b-4d8d-9ad2-6d3863efa8c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.515314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bafc7-e71b-4d8d-9ad2-6d3863efa8c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.516875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653bafc7-e71b-4d8d-9ad2-6d3863efa8c3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.528431 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 653/1313] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:49.532466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bafc7-e71b-4d8d-9ad2-6d3863efa8c3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.545503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653bafc7-e71b-4d8d-9ad2-6d3863efa8c3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.550158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852557f-33d9-4e29-bf29-3b2147d8b252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.550747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852557f-33d9-4e29-bf29-3b2147d8b252 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.551033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852557f-33d9-4e29-bf29-3b2147d8b252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.551308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852557f-33d9-4e29-bf29-3b2147d8b252 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.551941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852557f-33d9-4e29-bf29-3b2147d8b252 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.553549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852557f-33d9-4e29-bf29-3b2147d8b252 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.559767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b35d1690512a499fbca3fc4de2b60bfe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:49.564466 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 654/1314] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:49.565140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852557f-33d9-4e29-bf29-3b2147d8b252 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.575417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852557f-33d9-4e29-bf29-3b2147d8b252 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.576183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b35d1690512a499fbca3fc4de2b60bfe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:49.576898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b35d1690512a499fbca3fc4de2b60bfe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:49.580294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7363ec-2f76-4824-b766-4f8230a25fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.580925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7363ec-2f76-4824-b766-4f8230a25fff admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.581365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7363ec-2f76-4824-b766-4f8230a25fff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.581508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7363ec-2f76-4824-b766-4f8230a25fff admin admin] PATH_INFO: `/v3/projects/70e959422a934c69aefb8c6edfacd871/users/f22d1fba646142e7b7f376a939e57b69/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.584752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b35d1690512a499fbca3fc4de2b60bfe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:49.592533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b35d1690512a499fbca3fc4de2b60bfe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:49.597339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7363ec-2f76-4824-b766-4f8230a25fff admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e959422a934c69aefb8c6edfacd871, user_id=f22d1fba646142e7b7f376a939e57b69, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.599269 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 661/1315] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:50:49 2022] DELETE /identity/v3/users/b35d1690512a499fbca3fc4de2b60bfe => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:49.599825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.600046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7363ec-2f76-4824-b766-4f8230a25fff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.601154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.614053 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 655/1316] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:49 2022] PUT /identity/v3/projects/70e959422a934c69aefb8c6edfacd871/users/f22d1fba646142e7b7f376a939e57b69/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:49.614863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7363ec-2f76-4824-b766-4f8230a25fff admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.616399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7f7363ec-2f76-4824-b766-4f8230a25fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.652194 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.655604 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.677531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2593c45-b33a-4d56-9201-13fc205bcdbc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.682424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ca3de3-fc55-48fb-a4f6-1d4981ffb07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.683075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca3de3-fc55-48fb-a4f6-1d4981ffb07a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.683354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca3de3-fc55-48fb-a4f6-1d4981ffb07a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.683626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ca3de3-fc55-48fb-a4f6-1d4981ffb07a admin admin] PATH_INFO: `/v3/projects/b8b8b36f82984eb9bbbbda190dca1bb9/users/2a4e66ab55bf4171ad321a7dc89b98b1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.688778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7363ec-2f76-4824-b766-4f8230a25fff admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.694023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ab811-8bf1-4113-97e5-f51fd3c3742f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.695335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ab811-8bf1-4113-97e5-f51fd3c3742f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.695623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ab811-8bf1-4113-97e5-f51fd3c3742f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.695954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ab811-8bf1-4113-97e5-f51fd3c3742f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.696686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ab811-8bf1-4113-97e5-f51fd3c3742f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.698634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ab811-8bf1-4113-97e5-f51fd3c3742f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.702344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca3de3-fc55-48fb-a4f6-1d4981ffb07a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b8b36f82984eb9bbbbda190dca1bb9, user_id=2a4e66ab55bf4171ad321a7dc89b98b1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.705205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ca3de3-fc55-48fb-a4f6-1d4981ffb07a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.710991 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 656/1317] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:49.712368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5f1cc-d592-44f2-a766-a2e2f46e410b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.712702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5f1cc-d592-44f2-a766-a2e2f46e410b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.713018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c5f1cc-d592-44f2-a766-a2e2f46e410b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.721509 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 662/1318] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:49 2022] PUT /identity/v3/projects/b8b8b36f82984eb9bbbbda190dca1bb9/users/2a4e66ab55bf4171ad321a7dc89b98b1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:49.722823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c4e0c-03e5-4085-b02b-b69a70a0db15 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.723112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c4e0c-03e5-4085-b02b-b69a70a0db15 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.723393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9c4e0c-03e5-4085-b02b-b69a70a0db15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.752497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e7c5f1cc-d592-44f2-a766-a2e2f46e410b None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:49.753755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e7c5f1cc-d592-44f2-a766-a2e2f46e410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.755957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fb9c4e0c-03e5-4085-b02b-b69a70a0db15 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:49.757832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb9c4e0c-03e5-4085-b02b-b69a70a0db15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.825065 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 657/1319] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:49.826094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5f1cc-d592-44f2-a766-a2e2f46e410b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.827342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e7c5f1cc-d592-44f2-a766-a2e2f46e410b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.828573 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 663/1320] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:49.829327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c4e0c-03e5-4085-b02b-b69a70a0db15 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.830702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb9c4e0c-03e5-4085-b02b-b69a70a0db15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.897666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9c4e0c-03e5-4085-b02b-b69a70a0db15 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.900383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c5f1cc-d592-44f2-a766-a2e2f46e410b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:49.902909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928a5a13-f5ef-416d-aa13-1de6af510b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.903678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a5a13-f5ef-416d-aa13-1de6af510b2e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.903962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a5a13-f5ef-416d-aa13-1de6af510b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.904268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928a5a13-f5ef-416d-aa13-1de6af510b2e admin admin] PATH_INFO: `/v3/projects/fb94552fe2df4240a7d49d6696bfaff5/users/f459a36262d34af2a36be88200e3e0cd/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.905038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58bc71-84ac-4b33-bcc8-a58e7e40a5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:49.905708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58bc71-84ac-4b33-bcc8-a58e7e40a5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.905983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58bc71-84ac-4b33-bcc8-a58e7e40a5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.906272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e58bc71-84ac-4b33-bcc8-a58e7e40a5f3 admin admin] PATH_INFO: `/v3/projects/2355d0fe66394d808917a67018c9bcc0/users/14b05a11349d49c791f254fdf465a5c1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.919766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a5a13-f5ef-416d-aa13-1de6af510b2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb94552fe2df4240a7d49d6696bfaff5, user_id=f459a36262d34af2a36be88200e3e0cd, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.920509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58bc71-84ac-4b33-bcc8-a58e7e40a5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2355d0fe66394d808917a67018c9bcc0, user_id=14b05a11349d49c791f254fdf465a5c1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:49.922549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928a5a13-f5ef-416d-aa13-1de6af510b2e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.923694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e58bc71-84ac-4b33-bcc8-a58e7e40a5f3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:49.936605 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 664/1321] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:49 2022] PUT /identity/v3/projects/fb94552fe2df4240a7d49d6696bfaff5/users/f459a36262d34af2a36be88200e3e0cd/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:49.940115 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 658/1322] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:49 2022] PUT /identity/v3/projects/2355d0fe66394d808917a67018c9bcc0/users/14b05a11349d49c791f254fdf465a5c1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:49.940260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988149-008a-4dc4-8d2a-b8cd360d1d7f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:49.940260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988149-008a-4dc4-8d2a-b8cd360d1d7f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:49.940260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0988149-008a-4dc4-8d2a-b8cd360d1d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:49.941501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58bc71-84ac-4b33-bcc8-a58e7e40a5f3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:49.943310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e58bc71-84ac-4b33-bcc8-a58e7e40a5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.959126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f0988149-008a-4dc4-8d2a-b8cd360d1d7f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:49.960188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f0988149-008a-4dc4-8d2a-b8cd360d1d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:49.978157 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:49.991683 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:50.015256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e58bc71-84ac-4b33-bcc8-a58e7e40a5f3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.020066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951fcd-777d-4d4a-9336-2842437b5161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.020668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951fcd-777d-4d4a-9336-2842437b5161 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.020951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951fcd-777d-4d4a-9336-2842437b5161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.021229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c951fcd-777d-4d4a-9336-2842437b5161 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.021904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951fcd-777d-4d4a-9336-2842437b5161 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.023934 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 665/1323] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:50.024073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c951fcd-777d-4d4a-9336-2842437b5161 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.024996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988149-008a-4dc4-8d2a-b8cd360d1d7f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.035744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0988149-008a-4dc4-8d2a-b8cd360d1d7f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.037194 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 659/1324] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:49 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:50.038071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951fcd-777d-4d4a-9336-2842437b5161 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.040840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e34c8-7f4a-43df-af41-2156bc35a3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.041552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e34c8-7f4a-43df-af41-2156bc35a3e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.041835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e34c8-7f4a-43df-af41-2156bc35a3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.042111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76e34c8-7f4a-43df-af41-2156bc35a3e4 admin admin] PATH_INFO: `/v3/projects/760c0ea6c9cc4f60a67fe7cd93f45853/users/8a38745dd48245e9b51809c66e677fc2/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.047932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c951fcd-777d-4d4a-9336-2842437b5161 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.052482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b9ce6-3146-4e6a-a0d1-7d28e1158125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.053071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b9ce6-3146-4e6a-a0d1-7d28e1158125 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.053399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b9ce6-3146-4e6a-a0d1-7d28e1158125 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.053662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7b9ce6-3146-4e6a-a0d1-7d28e1158125 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.054326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b9ce6-3146-4e6a-a0d1-7d28e1158125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.055909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7b9ce6-3146-4e6a-a0d1-7d28e1158125 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.061991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e34c8-7f4a-43df-af41-2156bc35a3e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=760c0ea6c9cc4f60a67fe7cd93f45853, user_id=8a38745dd48245e9b51809c66e677fc2, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.064646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76e34c8-7f4a-43df-af41-2156bc35a3e4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.066093 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 660/1325] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:50.066896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b9ce6-3146-4e6a-a0d1-7d28e1158125 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.082180 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 666/1326] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:50 2022] PUT /identity/v3/projects/760c0ea6c9cc4f60a67fe7cd93f45853/users/8a38745dd48245e9b51809c66e677fc2/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:50.083008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e34c8-7f4a-43df-af41-2156bc35a3e4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.145559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7b9ce6-3146-4e6a-a0d1-7d28e1158125 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.158132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76e34c8-7f4a-43df-af41-2156bc35a3e4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.164088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059e8a-3b11-4813-bd6e-239c9da3d770 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.164815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059e8a-3b11-4813-bd6e-239c9da3d770 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.165165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059e8a-3b11-4813-bd6e-239c9da3d770 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.165539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79059e8a-3b11-4813-bd6e-239c9da3d770 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.167592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-79059e8a-3b11-4813-bd6e-239c9da3d770 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:50.215273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a3093-fa5c-4dc3-8081-8ef7fe9bfd39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.215911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a3093-fa5c-4dc3-8081-8ef7fe9bfd39 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.216196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a3093-fa5c-4dc3-8081-8ef7fe9bfd39 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.216474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a3093-fa5c-4dc3-8081-8ef7fe9bfd39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.218363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-212a3093-fa5c-4dc3-8081-8ef7fe9bfd39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:50.235112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059e8a-3b11-4813-bd6e-239c9da3d770 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.236862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79059e8a-3b11-4813-bd6e-239c9da3d770 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.249100 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 667/1327] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:50 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:50.249983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059e8a-3b11-4813-bd6e-239c9da3d770 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.278114 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:50.295354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a3093-fa5c-4dc3-8081-8ef7fe9bfd39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.297189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212a3093-fa5c-4dc3-8081-8ef7fe9bfd39 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.307745 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 661/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:50 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:50.308483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a3093-fa5c-4dc3-8081-8ef7fe9bfd39 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.325909 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:50.355307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79059e8a-3b11-4813-bd6e-239c9da3d770 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.361384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2b127-c338-4faf-aee3-a1ed03dd5811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.362193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2b127-c338-4faf-aee3-a1ed03dd5811 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.362482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2b127-c338-4faf-aee3-a1ed03dd5811 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.362758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a2b127-c338-4faf-aee3-a1ed03dd5811 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.363407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2b127-c338-4faf-aee3-a1ed03dd5811 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.366473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a2b127-c338-4faf-aee3-a1ed03dd5811 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.382234 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 668/1329] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:50.383631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2b127-c338-4faf-aee3-a1ed03dd5811 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.384737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a3093-fa5c-4dc3-8081-8ef7fe9bfd39 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.386179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-91a2b127-c338-4faf-aee3-a1ed03dd5811 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:50.390116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d4cf-33a0-4cc7-ae7f-14886a206d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.391078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d4cf-33a0-4cc7-ae7f-14886a206d0d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.391605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d4cf-33a0-4cc7-ae7f-14886a206d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.392124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c5d4cf-33a0-4cc7-ae7f-14886a206d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.392989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d4cf-33a0-4cc7-ae7f-14886a206d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.394937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c5d4cf-33a0-4cc7-ae7f-14886a206d0d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.406229 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 662/1330] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:50.407377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d4cf-33a0-4cc7-ae7f-14886a206d0d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.418278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c5d4cf-33a0-4cc7-ae7f-14886a206d0d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.425006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebbd4e-0c66-4800-ba7f-c2e17340171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.426525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebbd4e-0c66-4800-ba7f-c2e17340171e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.427086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebbd4e-0c66-4800-ba7f-c2e17340171e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.427712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebbd4e-0c66-4800-ba7f-c2e17340171e admin admin] PATH_INFO: `/v3/projects/70e959422a934c69aefb8c6edfacd871/users/f22d1fba646142e7b7f376a939e57b69/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.430688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebbd4e-0c66-4800-ba7f-c2e17340171e admin admin] RBAC: Authorizing `identity:create_grant(project_id=70e959422a934c69aefb8c6edfacd871, user_id=f22d1fba646142e7b7f376a939e57b69, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.434206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebbd4e-0c66-4800-ba7f-c2e17340171e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.455845 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 663/1331] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:50 2022] PUT /identity/v3/projects/70e959422a934c69aefb8c6edfacd871/users/f22d1fba646142e7b7f376a939e57b69/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:50.455845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebbd4e-0c66-4800-ba7f-c2e17340171e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.462106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a2b127-c338-4faf-aee3-a1ed03dd5811 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.551166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff1719-097e-46c0-bc4d-eeb8215bc1ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.551910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1719-097e-46c0-bc4d-eeb8215bc1ea service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.552182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1719-097e-46c0-bc4d-eeb8215bc1ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.552448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ff1719-097e-46c0-bc4d-eeb8215bc1ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.568570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebbd4e-0c66-4800-ba7f-c2e17340171e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.568808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff1719-097e-46c0-bc4d-eeb8215bc1ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.570897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ff1719-097e-46c0-bc4d-eeb8215bc1ea service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.575349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148cc2-49c0-4f00-be57-cca9a1943915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.576277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148cc2-49c0-4f00-be57-cca9a1943915 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.578029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148cc2-49c0-4f00-be57-cca9a1943915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.578624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29148cc2-49c0-4f00-be57-cca9a1943915 admin admin] PATH_INFO: `/v3/projects/b8b8b36f82984eb9bbbbda190dca1bb9/users/2a4e66ab55bf4171ad321a7dc89b98b1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.581336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148cc2-49c0-4f00-be57-cca9a1943915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8b8b36f82984eb9bbbbda190dca1bb9, user_id=2a4e66ab55bf4171ad321a7dc89b98b1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.583905 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 669/1332] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:50.584717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29148cc2-49c0-4f00-be57-cca9a1943915 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.585360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff1719-097e-46c0-bc4d-eeb8215bc1ea service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.596106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ff1719-097e-46c0-bc4d-eeb8215bc1ea service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.603209 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 664/1333] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:50 2022] PUT /identity/v3/projects/b8b8b36f82984eb9bbbbda190dca1bb9/users/2a4e66ab55bf4171ad321a7dc89b98b1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:50.607340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148cc2-49c0-4f00-be57-cca9a1943915 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.680534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314f6a-7d5e-4bc8-bcd5-96ac3f0e3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.681171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314f6a-7d5e-4bc8-bcd5-96ac3f0e3449 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.681713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314f6a-7d5e-4bc8-bcd5-96ac3f0e3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.682042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1314f6a-7d5e-4bc8-bcd5-96ac3f0e3449 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.682849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1314f6a-7d5e-4bc8-bcd5-96ac3f0e3449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.684906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1314f6a-7d5e-4bc8-bcd5-96ac3f0e3449 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.703872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29148cc2-49c0-4f00-be57-cca9a1943915 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.712051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2adb16-4875-4c42-8197-74254d56b385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.713066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2adb16-4875-4c42-8197-74254d56b385 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.713193 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 670/1334] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:50 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:50.713719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2adb16-4875-4c42-8197-74254d56b385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.714155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314f6a-7d5e-4bc8-bcd5-96ac3f0e3449 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.714749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2adb16-4875-4c42-8197-74254d56b385 admin admin] PATH_INFO: `/v3/projects/fb94552fe2df4240a7d49d6696bfaff5/users/f459a36262d34af2a36be88200e3e0cd/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.717733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2adb16-4875-4c42-8197-74254d56b385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb94552fe2df4240a7d49d6696bfaff5, user_id=f459a36262d34af2a36be88200e3e0cd, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.720529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2adb16-4875-4c42-8197-74254d56b385 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.724075 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:50.730037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1314f6a-7d5e-4bc8-bcd5-96ac3f0e3449 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.737670 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 665/1335] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:50 2022] PUT /identity/v3/projects/fb94552fe2df4240a7d49d6696bfaff5/users/f459a36262d34af2a36be88200e3e0cd/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:50.747905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296e46-b6e9-44d9-8f17-715dda7800a8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.747905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296e46-b6e9-44d9-8f17-715dda7800a8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.747905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d296e46-b6e9-44d9-8f17-715dda7800a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.779089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8d296e46-b6e9-44d9-8f17-715dda7800a8 None None] MFA Rules not processed for user `f22d1fba646142e7b7f376a939e57b69`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:50.781211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8d296e46-b6e9-44d9-8f17-715dda7800a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:50.795024 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:50.842407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59a3dcf-78ee-4a57-95b1-2fdc86d81c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:50.843402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3dcf-78ee-4a57-95b1-2fdc86d81c83 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.843688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3dcf-78ee-4a57-95b1-2fdc86d81c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.843966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59a3dcf-78ee-4a57-95b1-2fdc86d81c83 admin admin] PATH_INFO: `/v3/projects/2355d0fe66394d808917a67018c9bcc0/users/14b05a11349d49c791f254fdf465a5c1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.848043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a3dcf-78ee-4a57-95b1-2fdc86d81c83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2355d0fe66394d808917a67018c9bcc0, user_id=14b05a11349d49c791f254fdf465a5c1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:50.852385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59a3dcf-78ee-4a57-95b1-2fdc86d81c83 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:50.892903 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 671/1336] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:50 2022] PUT /identity/v3/projects/2355d0fe66394d808917a67018c9bcc0/users/14b05a11349d49c791f254fdf465a5c1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:50.894315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dca0cc-d99b-417a-a13f-794af86a5287 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:50.894606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dca0cc-d99b-417a-a13f-794af86a5287 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:50.894881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dca0cc-d99b-417a-a13f-794af86a5287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:50.899922 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 666/1337] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:50 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:50.900761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d296e46-b6e9-44d9-8f17-715dda7800a8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:50.924436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d296e46-b6e9-44d9-8f17-715dda7800a8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:50.946690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-87dca0cc-d99b-417a-a13f-794af86a5287 None None] MFA Rules not processed for user `2a4e66ab55bf4171ad321a7dc89b98b1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:50.950251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-87dca0cc-d99b-417a-a13f-794af86a5287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.027751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c8aea4-de60-4c90-8022-31034856ec3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:51.028991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8aea4-de60-4c90-8022-31034856ec3c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.029519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8aea4-de60-4c90-8022-31034856ec3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.029942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c8aea4-de60-4c90-8022-31034856ec3c admin admin] PATH_INFO: `/v3/projects/760c0ea6c9cc4f60a67fe7cd93f45853/users/8a38745dd48245e9b51809c66e677fc2/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.032120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8aea4-de60-4c90-8022-31034856ec3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=760c0ea6c9cc4f60a67fe7cd93f45853, user_id=8a38745dd48245e9b51809c66e677fc2, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:51.035434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c8aea4-de60-4c90-8022-31034856ec3c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:51.047894 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 667/1338] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:50 2022] PUT /identity/v3/projects/760c0ea6c9cc4f60a67fe7cd93f45853/users/8a38745dd48245e9b51809c66e677fc2/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:51.049641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3643ed-1068-4a10-ab94-66f0dd4a8a33 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.050071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3643ed-1068-4a10-ab94-66f0dd4a8a33 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.050495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3643ed-1068-4a10-ab94-66f0dd4a8a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.065938 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 672/1339] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:50 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:51.068149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47833b23-7840-4a4f-8210-2db9b2a2a029 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.068509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47833b23-7840-4a4f-8210-2db9b2a2a029 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.068998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47833b23-7840-4a4f-8210-2db9b2a2a029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.091605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0d3643ed-1068-4a10-ab94-66f0dd4a8a33 None None] MFA Rules not processed for user `f459a36262d34af2a36be88200e3e0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:51.093220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0d3643ed-1068-4a10-ab94-66f0dd4a8a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.102330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-47833b23-7840-4a4f-8210-2db9b2a2a029 None None] MFA Rules not processed for user `14b05a11349d49c791f254fdf465a5c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:51.103548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-47833b23-7840-4a4f-8210-2db9b2a2a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.171854 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:51.181341 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 668/1340] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:51.181341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3643ed-1068-4a10-ab94-66f0dd4a8a33 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.198372 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 673/1341] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:51.202018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94791447-5c5f-4f6d-9346-4752da1a5555 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.202862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94791447-5c5f-4f6d-9346-4752da1a5555 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.203426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94791447-5c5f-4f6d-9346-4752da1a5555 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.205383 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 674/1342] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:50:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:50:51.210025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0a150-53b7-4cba-a65d-21acb31f1454 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.210532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0a150-53b7-4cba-a65d-21acb31f1454 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.211522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0a150-53b7-4cba-a65d-21acb31f1454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.248002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1ec0a150-53b7-4cba-a65d-21acb31f1454 None None] MFA Rules not processed for user `8a38745dd48245e9b51809c66e677fc2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:51.249337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1ec0a150-53b7-4cba-a65d-21acb31f1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.274257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3643ed-1068-4a10-ab94-66f0dd4a8a33 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:51.278843 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:51.280023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca723217-1bea-484d-bfd2-53ecada820f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:51.280620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723217-1bea-484d-bfd2-53ecada820f8 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.280887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723217-1bea-484d-bfd2-53ecada820f8 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.281236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca723217-1bea-484d-bfd2-53ecada820f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.330139 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 675/1343] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:51.330139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0a150-53b7-4cba-a65d-21acb31f1454 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.330139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1ec0a150-53b7-4cba-a65d-21acb31f1454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.347114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca723217-1bea-484d-bfd2-53ecada820f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:51.348717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca723217-1bea-484d-bfd2-53ecada820f8 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:51.359232 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 669/1344] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:51 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:51.360468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31dbfb-1b81-48b8-afd9-6243e966d2ec None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.360754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31dbfb-1b81-48b8-afd9-6243e966d2ec None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.361248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31dbfb-1b81-48b8-afd9-6243e966d2ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.385766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8f31dbfb-1b81-48b8-afd9-6243e966d2ec None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:51.387330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f31dbfb-1b81-48b8-afd9-6243e966d2ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.396624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0a150-53b7-4cba-a65d-21acb31f1454 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:51.402137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:51.402999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.403294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.403577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] PATH_INFO: `/v3/projects/08ae7863a74b463382c610eefe5586f5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.404707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=08ae7863a74b463382c610eefe5586f5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:51.405921 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:50:51.405921 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 08:50:51.405921 n-d-master-1 devstack@keystone.service[88312]: Oct 24 08:50:51.406956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:51.463119 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 670/1345] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:51.463875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31dbfb-1b81-48b8-afd9-6243e966d2ec None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.477034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31dbfb-1b81-48b8-afd9-6243e966d2ec None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:51.494767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08ae7863a74b463382c610eefe5586f5', 'request_id': 'req-89d33068-4093-4d67-9eb6-02d9f436b4bc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:51.503308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08ae7863a74b463382c610eefe5586f5', 'request_id': 'req-89d33068-4093-4d67-9eb6-02d9f436b4bc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:51.508115 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:51.518649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08ae7863a74b463382c610eefe5586f5', 'request_id': 'req-89d33068-4093-4d67-9eb6-02d9f436b4bc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:51.531768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] The token cache is being invalidate because project 08ae7863a74b463382c610eefe5586f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:50:51.532058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:51.532759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:51.534379 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 676/1346] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:50:51 2022] DELETE /identity/v3/projects/08ae7863a74b463382c610eefe5586f5 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:51.535148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.536430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.550317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c526169-987f-4333-a1ff-ee379aa33a9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:51.550923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c526169-987f-4333-a1ff-ee379aa33a9e service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.551201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c526169-987f-4333-a1ff-ee379aa33a9e service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.551482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c526169-987f-4333-a1ff-ee379aa33a9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.553158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9c526169-987f-4333-a1ff-ee379aa33a9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.592362 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:51.611393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d33068-4093-4d67-9eb6-02d9f436b4bc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:51.615552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c526169-987f-4333-a1ff-ee379aa33a9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:51.617096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:51.617709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c526169-987f-4333-a1ff-ee379aa33a9e service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:51.617853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.618027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.618327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.620175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.627499 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 671/1347] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:51 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:51.628697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274cc78-cc69-4825-975e-ad94abbe277c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.628976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274cc78-cc69-4825-975e-ad94abbe277c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.629322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f274cc78-cc69-4825-975e-ad94abbe277c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.633212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:51.634855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:51.647055 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 677/1348] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:51.650072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f274cc78-cc69-4825-975e-ad94abbe277c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:51.651480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f274cc78-cc69-4825-975e-ad94abbe277c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.678103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.680121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.695884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6d4a2-3aa4-4e6c-a23e-275e8f48a5c2 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:51.701994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3783bad-e37a-4cc4-af2f-b29952440f2e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:51.702678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3783bad-e37a-4cc4-af2f-b29952440f2e service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.703027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3783bad-e37a-4cc4-af2f-b29952440f2e service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.703299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3783bad-e37a-4cc4-af2f-b29952440f2e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.705083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e3783bad-e37a-4cc4-af2f-b29952440f2e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.724049 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 672/1349] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:51.732688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a05320-0f45-4216-88e0-ff8e75df47a6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.732973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a05320-0f45-4216-88e0-ff8e75df47a6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.733384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a05320-0f45-4216-88e0-ff8e75df47a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.756877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-84a05320-0f45-4216-88e0-ff8e75df47a6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:51.758924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-84a05320-0f45-4216-88e0-ff8e75df47a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.767709 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 673/1350] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:50:51.771770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a05320-0f45-4216-88e0-ff8e75df47a6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.781539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a05320-0f45-4216-88e0-ff8e75df47a6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:51.786152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:51.786726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.787000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.787268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.787906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:51.788202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:51.788516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3783bad-e37a-4cc4-af2f-b29952440f2e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:51.790074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:51.790199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3783bad-e37a-4cc4-af2f-b29952440f2e service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:51.800037 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 678/1351] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:51 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:51.801344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1327ce-5765-41f9-86a5-286a75c78810 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.801646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1327ce-5765-41f9-86a5-286a75c78810 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.801921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1327ce-5765-41f9-86a5-286a75c78810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.805641 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 674/1352] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:50:51.806932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.808783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.823657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cc1327ce-5765-41f9-86a5-286a75c78810 None None] MFA Rules not processed for user `f8347b4e37424f499f5756ca8b88fab4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:51.824915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc1327ce-5765-41f9-86a5-286a75c78810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.827196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1751f0-bdcc-4f24-9fba-36229e8498e4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:51.834772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8c10-f826-48d4-bb58-9a0d7e1a78ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:51.856359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8c10-f826-48d4-bb58-9a0d7e1a78ad service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.856359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8c10-f826-48d4-bb58-9a0d7e1a78ad service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.856359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42a8c10-f826-48d4-bb58-9a0d7e1a78ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.856359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e42a8c10-f826-48d4-bb58-9a0d7e1a78ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:51.891807 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 679/1353] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:51 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:51.892498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1327ce-5765-41f9-86a5-286a75c78810 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.902999 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:51.903743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1327ce-5765-41f9-86a5-286a75c78810 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:51.908843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bb361-e8c7-476e-a803-4773abbe676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:51.909486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bb361-e8c7-476e-a803-4773abbe676b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:51.909773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bb361-e8c7-476e-a803-4773abbe676b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:51.910048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2bb361-e8c7-476e-a803-4773abbe676b admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:51.910676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bb361-e8c7-476e-a803-4773abbe676b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:51.912576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2bb361-e8c7-476e-a803-4773abbe676b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:51.925766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a8c10-f826-48d4-bb58-9a0d7e1a78ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:51.927286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42a8c10-f826-48d4-bb58-9a0d7e1a78ad service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:51.939076 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 675/1354] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:51.939902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8c10-f826-48d4-bb58-9a0d7e1a78ad service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.945985 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 680/1355] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:51 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:51.948021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bb361-e8c7-476e-a803-4773abbe676b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:51.951395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42a8c10-f826-48d4-bb58-9a0d7e1a78ad service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.021881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d809edd-d124-490e-8532-18efac00fa14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.022599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d809edd-d124-490e-8532-18efac00fa14 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.022966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d809edd-d124-490e-8532-18efac00fa14 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.023303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d809edd-d124-490e-8532-18efac00fa14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.025097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4d809edd-d124-490e-8532-18efac00fa14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.031033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2bb361-e8c7-476e-a803-4773abbe676b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.035588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f01a9-f0d5-4f0b-abf9-810fb8ff4c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.036195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f01a9-f0d5-4f0b-abf9-810fb8ff4c7b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.036475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f01a9-f0d5-4f0b-abf9-810fb8ff4c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.036752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f01a9-f0d5-4f0b-abf9-810fb8ff4c7b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.037439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f01a9-f0d5-4f0b-abf9-810fb8ff4c7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.039937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f01a9-f0d5-4f0b-abf9-810fb8ff4c7b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.048029 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:52.065470 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 681/1356] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:51 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:52.065470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f01a9-f0d5-4f0b-abf9-810fb8ff4c7b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.079643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f01a9-f0d5-4f0b-abf9-810fb8ff4c7b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.085695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9146614-917c-48ec-badd-72c942a6cd9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.086299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146614-917c-48ec-badd-72c942a6cd9a service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.086517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146614-917c-48ec-badd-72c942a6cd9a service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.086794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9146614-917c-48ec-badd-72c942a6cd9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.088570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b9146614-917c-48ec-badd-72c942a6cd9a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.094359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d809edd-d124-490e-8532-18efac00fa14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.095944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d809edd-d124-490e-8532-18efac00fa14 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.105487 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 676/1357] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:51 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:52.106398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d809edd-d124-490e-8532-18efac00fa14 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.118248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d809edd-d124-490e-8532-18efac00fa14 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.127698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb95bc4-7faf-45d8-8e62-afcfab7a1c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.128308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95bc4-7faf-45d8-8e62-afcfab7a1c4d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.128601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95bc4-7faf-45d8-8e62-afcfab7a1c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.128874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb95bc4-7faf-45d8-8e62-afcfab7a1c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.129972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb95bc4-7faf-45d8-8e62-afcfab7a1c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.131651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb95bc4-7faf-45d8-8e62-afcfab7a1c4d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.145755 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 677/1358] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:52.150742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb95bc4-7faf-45d8-8e62-afcfab7a1c4d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.153105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ebb95bc4-7faf-45d8-8e62-afcfab7a1c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.168924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb95bc4-7faf-45d8-8e62-afcfab7a1c4d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.172811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9146614-917c-48ec-badd-72c942a6cd9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.174566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9146614-917c-48ec-badd-72c942a6cd9a service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.174867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.175649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.175993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.176271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] PATH_INFO: `/v3/users/1efcace670dc4275a267b4eea407fe2f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.177645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1efcace670dc4275a267b4eea407fe2f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.179673 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 08:50:52.179673 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 08:50:52.179673 n-d-master-1 devstack@keystone.service[88311]: Oct 24 08:50:52.181331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.192969 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 682/1359] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:52 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:52.193970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9146614-917c-48ec-badd-72c942a6cd9a service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.204382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9146614-917c-48ec-badd-72c942a6cd9a service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.218095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d3bdd-61d6-49d5-bb1b-8ad0c2ed45d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.218562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d3bdd-61d6-49d5-bb1b-8ad0c2ed45d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.218936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d3bdd-61d6-49d5-bb1b-8ad0c2ed45d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.219302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d3bdd-61d6-49d5-bb1b-8ad0c2ed45d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.220346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d3bdd-61d6-49d5-bb1b-8ad0c2ed45d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.222282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84d3bdd-61d6-49d5-bb1b-8ad0c2ed45d3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.235391 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 683/1360] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:52.236050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d3bdd-61d6-49d5-bb1b-8ad0c2ed45d3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.252665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d3bdd-61d6-49d5-bb1b-8ad0c2ed45d3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.274668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f885fd85-a0cb-4f97-8aa5-dd0d0826c84e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.275434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885fd85-a0cb-4f97-8aa5-dd0d0826c84e service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.275818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885fd85-a0cb-4f97-8aa5-dd0d0826c84e service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.276203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f885fd85-a0cb-4f97-8aa5-dd0d0826c84e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.278240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f885fd85-a0cb-4f97-8aa5-dd0d0826c84e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.279671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1efcace670dc4275a267b4eea407fe2f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:52.293606 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:52.307275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1efcace670dc4275a267b4eea407fe2f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:52.307275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1efcace670dc4275a267b4eea407fe2f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:52.323956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1efcace670dc4275a267b4eea407fe2f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:52.337989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1efcace670dc4275a267b4eea407fe2f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:52.347453 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 678/1361] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:50:52 2022] DELETE /identity/v3/users/1efcace670dc4275a267b4eea407fe2f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:52.350128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.354870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.358698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885fd85-a0cb-4f97-8aa5-dd0d0826c84e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.360696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f885fd85-a0cb-4f97-8aa5-dd0d0826c84e service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.372049 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 684/1362] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:52 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:52.373541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205cd3-d960-48d1-bc4c-b6fb29f9a8d2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.373998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205cd3-d960-48d1-bc4c-b6fb29f9a8d2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.374568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5205cd3-d960-48d1-bc4c-b6fb29f9a8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.401577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c5205cd3-d960-48d1-bc4c-b6fb29f9a8d2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:52.402961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c5205cd3-d960-48d1-bc4c-b6fb29f9a8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.472327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df41004f-d0ab-4f3f-93f3-cc2530f7c7c3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.478513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0aed-c83d-4936-8ef7-e1128a879b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.479247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0aed-c83d-4936-8ef7-e1128a879b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.479547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0aed-c83d-4936-8ef7-e1128a879b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.479930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7b0aed-c83d-4936-8ef7-e1128a879b8d admin admin] PATH_INFO: `/v3/projects/3d7b9d4b5ef5454fbed4733abbd15bbe/users/327f1d46d859423982fab017258b9ada/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.498519 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 685/1363] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:52.500727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636afe1-6ce4-4ca9-96d8-158fc0334c1c None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.500846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0aed-c83d-4936-8ef7-e1128a879b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d7b9d4b5ef5454fbed4733abbd15bbe, user_id=327f1d46d859423982fab017258b9ada, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.501452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636afe1-6ce4-4ca9-96d8-158fc0334c1c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.501848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636afe1-6ce4-4ca9-96d8-158fc0334c1c None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.503490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7b0aed-c83d-4936-8ef7-e1128a879b8d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.503814 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 686/1364] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:50:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:50:52.509945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc87a0-c6d2-4060-b8d9-0cf25db33f4f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.510773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc87a0-c6d2-4060-b8d9-0cf25db33f4f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.510773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc87a0-c6d2-4060-b8d9-0cf25db33f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.520961 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 679/1365] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:52 2022] PUT /identity/v3/projects/3d7b9d4b5ef5454fbed4733abbd15bbe/users/327f1d46d859423982fab017258b9ada/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:52.522490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0aed-c83d-4936-8ef7-e1128a879b8d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.533116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9c7b0aed-c83d-4936-8ef7-e1128a879b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.534258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d1bc87a0-c6d2-4060-b8d9-0cf25db33f4f None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:52.535601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d1bc87a0-c6d2-4060-b8d9-0cf25db33f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.551308 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:52.615008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7b0aed-c83d-4936-8ef7-e1128a879b8d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.624050 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 687/1366] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:50:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:52.632895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748199-71ea-4adb-a540-26a1a1bca0d2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.633321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748199-71ea-4adb-a540-26a1a1bca0d2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.633480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da748199-71ea-4adb-a540-26a1a1bca0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.636663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de6e3-318b-44aa-ac99-15c971339704 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.637317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de6e3-318b-44aa-ac99-15c971339704 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.637599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de6e3-318b-44aa-ac99-15c971339704 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.637868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389de6e3-318b-44aa-ac99-15c971339704 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.680842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-da748199-71ea-4adb-a540-26a1a1bca0d2 None None] MFA Rules not processed for user `327f1d46d859423982fab017258b9ada`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:52.682068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da748199-71ea-4adb-a540-26a1a1bca0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.723732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389de6e3-318b-44aa-ac99-15c971339704 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.726803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389de6e3-318b-44aa-ac99-15c971339704 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.744754 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 680/1367] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:52.745332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de6e3-318b-44aa-ac99-15c971339704 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.746994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-389de6e3-318b-44aa-ac99-15c971339704 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.756889 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:52.773387 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 688/1368] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:52.773387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748199-71ea-4adb-a540-26a1a1bca0d2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.774394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da748199-71ea-4adb-a540-26a1a1bca0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.795040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da748199-71ea-4adb-a540-26a1a1bca0d2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.800963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f995-d73f-4d77-9dd3-b03e47ecabae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.801607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f995-d73f-4d77-9dd3-b03e47ecabae service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.801880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f995-d73f-4d77-9dd3-b03e47ecabae service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.802150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7229f995-d73f-4d77-9dd3-b03e47ecabae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.806243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7229f995-d73f-4d77-9dd3-b03e47ecabae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:52.847140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389de6e3-318b-44aa-ac99-15c971339704 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.851074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75241acc-c364-492c-869a-e971a13e71c3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.851789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75241acc-c364-492c-869a-e971a13e71c3 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.852188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75241acc-c364-492c-869a-e971a13e71c3 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.852588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75241acc-c364-492c-869a-e971a13e71c3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.866631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75241acc-c364-492c-869a-e971a13e71c3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.868510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75241acc-c364-492c-869a-e971a13e71c3 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.873807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229f995-d73f-4d77-9dd3-b03e47ecabae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.875411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7229f995-d73f-4d77-9dd3-b03e47ecabae service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.880649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 681/1369] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:52.881588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75241acc-c364-492c-869a-e971a13e71c3 service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.886212 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 689/1370] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:52.893068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75241acc-c364-492c-869a-e971a13e71c3 service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:52.900089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a48f-cfaf-44c7-8c38-df828158e77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:52.900840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a48f-cfaf-44c7-8c38-df828158e77f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:52.901214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a48f-cfaf-44c7-8c38-df828158e77f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:52.901638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e023a48f-cfaf-44c7-8c38-df828158e77f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:52.902370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023a48f-cfaf-44c7-8c38-df828158e77f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:52.904413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e023a48f-cfaf-44c7-8c38-df828158e77f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:52.945571 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 682/1371] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:52 2022] POST /identity/v3/projects => generated 387 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:52.947017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f995-d73f-4d77-9dd3-b03e47ecabae service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:52.979478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7229f995-d73f-4d77-9dd3-b03e47ecabae service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:53.036343 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:53.073617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a48f-cfaf-44c7-8c38-df828158e77f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:53.074619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e023a48f-cfaf-44c7-8c38-df828158e77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.085025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157739-4d03-4f31-8093-22010afffded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:53.086703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157739-4d03-4f31-8093-22010afffded admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.087291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157739-4d03-4f31-8093-22010afffded admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.087865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9157739-4d03-4f31-8093-22010afffded admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.089128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157739-4d03-4f31-8093-22010afffded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:53.093384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9157739-4d03-4f31-8093-22010afffded admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:53.131511 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 690/1372] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:52 2022] POST /identity/v3/users => generated 300 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:50:53.136448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157739-4d03-4f31-8093-22010afffded admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:53.138223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f9157739-4d03-4f31-8093-22010afffded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.158315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9157739-4d03-4f31-8093-22010afffded admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:53.163522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:53.164190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.164471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.164750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] PATH_INFO: `/v3/projects/475f9813da214a4f8ae7513258868d93` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.166086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] RBAC: Authorizing `identity:delete_project(project_id=475f9813da214a4f8ae7513258868d93)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:53.168252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:53.199288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e023a48f-cfaf-44c7-8c38-df828158e77f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:53.205473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:53.206838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.207196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.207683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] PATH_INFO: `/v3/users/d948c144feed4b4baebaa31e67002d8a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.209328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d948c144feed4b4baebaa31e67002d8a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:53.212351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:53.248514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '475f9813da214a4f8ae7513258868d93', 'request_id': 'req-dad1940d-c4cc-4115-aac6-3bbda436f546'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.266887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '475f9813da214a4f8ae7513258868d93', 'request_id': 'req-dad1940d-c4cc-4115-aac6-3bbda436f546'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.282616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '475f9813da214a4f8ae7513258868d93', 'request_id': 'req-dad1940d-c4cc-4115-aac6-3bbda436f546'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.298864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] The token cache is being invalidate because project 475f9813da214a4f8ae7513258868d93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:50:53.299180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.299869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.301175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd948c144feed4b4baebaa31e67002d8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.301712 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 691/1373] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:50:53 2022] DELETE /identity/v3/projects/475f9813da214a4f8ae7513258868d93 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:53.302596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:53.304668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.324138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd948c144feed4b4baebaa31e67002d8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.328115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd948c144feed4b4baebaa31e67002d8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.334467 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:53.340244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd948c144feed4b4baebaa31e67002d8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.353273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd948c144feed4b4baebaa31e67002d8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.367359 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 683/1374] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:50:53 2022] DELETE /identity/v3/users/d948c144feed4b4baebaa31e67002d8a => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:53.367359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:53.367359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.403232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1940d-c4cc-4115-aac6-3bbda436f546 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:53.468294 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:53.474577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a555597-3a5b-4f96-a5c2-cd0f28412529 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:53.481752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:53.481752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.482030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.483029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] PATH_INFO: `/v3/users/8a38745dd48245e9b51809c66e677fc2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.484089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a38745dd48245e9b51809c66e677fc2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:53.486324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:53.499255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba6388a-4890-4381-af1b-9936b0c4adfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:53.499884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6388a-4890-4381-af1b-9936b0c4adfd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.500247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6388a-4890-4381-af1b-9936b0c4adfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.500459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba6388a-4890-4381-af1b-9936b0c4adfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.501103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6388a-4890-4381-af1b-9936b0c4adfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:53.503323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba6388a-4890-4381-af1b-9936b0c4adfd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:53.521014 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 692/1375] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:53.521014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30140252-5e5c-43cd-b29c-c4e4819ee7b1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.521014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30140252-5e5c-43cd-b29c-c4e4819ee7b1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.521014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30140252-5e5c-43cd-b29c-c4e4819ee7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.548977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-30140252-5e5c-43cd-b29c-c4e4819ee7b1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:53.551756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-30140252-5e5c-43cd-b29c-c4e4819ee7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.564815 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 693/1376] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:53.572583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30140252-5e5c-43cd-b29c-c4e4819ee7b1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:53.572583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-30140252-5e5c-43cd-b29c-c4e4819ee7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.580180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a38745dd48245e9b51809c66e677fc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.598250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30140252-5e5c-43cd-b29c-c4e4819ee7b1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:53.600182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a38745dd48245e9b51809c66e677fc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.602253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a38745dd48245e9b51809c66e677fc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.606865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c2e56-b1b2-4693-b02e-fa93d0250b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:53.608467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c2e56-b1b2-4693-b02e-fa93d0250b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.608794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c2e56-b1b2-4693-b02e-fa93d0250b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.609123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0c2e56-b1b2-4693-b02e-fa93d0250b43 admin admin] PATH_INFO: `/v3/projects/ca64f62573b843af8904c683c6068497/users/1275d5281a5c4efe89cc26d46f3c07c6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.616637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a38745dd48245e9b51809c66e677fc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.630164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c2e56-b1b2-4693-b02e-fa93d0250b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca64f62573b843af8904c683c6068497, user_id=1275d5281a5c4efe89cc26d46f3c07c6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:53.633052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a38745dd48245e9b51809c66e677fc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:53.633895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0c2e56-b1b2-4693-b02e-fa93d0250b43 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:53.653353 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 684/1377] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:50:53 2022] DELETE /identity/v3/users/8a38745dd48245e9b51809c66e677fc2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:53.653353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:53.653353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.678277 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 694/1378] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:53 2022] PUT /identity/v3/projects/ca64f62573b843af8904c683c6068497/users/1275d5281a5c4efe89cc26d46f3c07c6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:53.680991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c2e56-b1b2-4693-b02e-fa93d0250b43 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:53.683729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ae0c2e56-b1b2-4693-b02e-fa93d0250b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.780177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6b0c6e-e0ce-4965-baa3-18fe2533232d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:53.784907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d988d-e7a2-4c8b-9237-ea69ea5111e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:53.785581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d988d-e7a2-4c8b-9237-ea69ea5111e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.789210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d988d-e7a2-4c8b-9237-ea69ea5111e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.789210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d988d-e7a2-4c8b-9237-ea69ea5111e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.792899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e78d988d-e7a2-4c8b-9237-ea69ea5111e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.823356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0c2e56-b1b2-4693-b02e-fa93d0250b43 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:53.833534 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:53.904846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d988d-e7a2-4c8b-9237-ea69ea5111e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:53.906360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78d988d-e7a2-4c8b-9237-ea69ea5111e2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:53.908385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576e5979-1fd6-47a7-9b37-b7fc4a9203fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:53.909850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5979-1fd6-47a7-9b37-b7fc4a9203fb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.910221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5979-1fd6-47a7-9b37-b7fc4a9203fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.910569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576e5979-1fd6-47a7-9b37-b7fc4a9203fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.911438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5979-1fd6-47a7-9b37-b7fc4a9203fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:53.914430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576e5979-1fd6-47a7-9b37-b7fc4a9203fb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:53.918306 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 685/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:53.919611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e07f3-947f-4c82-a70c-43c24c808ebe None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.919897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e07f3-947f-4c82-a70c-43c24c808ebe None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.920231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5e07f3-947f-4c82-a70c-43c24c808ebe None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.921876 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 686/1380] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:50:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:50:53.922616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e07f3-947f-4c82-a70c-43c24c808ebe None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:53.924571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dd5e07f3-947f-4c82-a70c-43c24c808ebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:53.930667 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 695/1381] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:53 2022] GET /identity/v3/roles => generated 1420 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:53.932205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61500eb-51aa-4601-9192-8f5ecb6056f7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:53.932559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61500eb-51aa-4601-9192-8f5ecb6056f7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:53.933576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61500eb-51aa-4601-9192-8f5ecb6056f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:53.971786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c61500eb-51aa-4601-9192-8f5ecb6056f7 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:53.972777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c61500eb-51aa-4601-9192-8f5ecb6056f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.061063 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:54.073907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5e07f3-947f-4c82-a70c-43c24c808ebe None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:54.081518 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 696/1382] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:50:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:54.082915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61500eb-51aa-4601-9192-8f5ecb6056f7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:54.092121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:54.092748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.093029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.093331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.095319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.096103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61500eb-51aa-4601-9192-8f5ecb6056f7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:54.103216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b4512-8920-4cb9-80a3-c50c6a31ccb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:54.104188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b4512-8920-4cb9-80a3-c50c6a31ccb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.104572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b4512-8920-4cb9-80a3-c50c6a31ccb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.104958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874b4512-8920-4cb9-80a3-c50c6a31ccb4 admin admin] PATH_INFO: `/v3/projects/ca64f62573b843af8904c683c6068497/users/1275d5281a5c4efe89cc26d46f3c07c6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.107205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b4512-8920-4cb9-80a3-c50c6a31ccb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca64f62573b843af8904c683c6068497, user_id=1275d5281a5c4efe89cc26d46f3c07c6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:54.108670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:54.110439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874b4512-8920-4cb9-80a3-c50c6a31ccb4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:54.110556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:54.126434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 697/1383] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:54 2022] PUT /identity/v3/projects/ca64f62573b843af8904c683c6068497/users/1275d5281a5c4efe89cc26d46f3c07c6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:54.127643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b4512-8920-4cb9-80a3-c50c6a31ccb4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:54.129884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-874b4512-8920-4cb9-80a3-c50c6a31ccb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.145273 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 687/1384] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:54.146539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:54.149839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.170703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0011dc47-9759-4577-a64d-d56b34151b37 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:54.227923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874b4512-8920-4cb9-80a3-c50c6a31ccb4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:54.238342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:54.238342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.238342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.238342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] PATH_INFO: `/v3/projects/760c0ea6c9cc4f60a67fe7cd93f45853` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.239137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e5cc62-1ffb-4d30-8b7b-5703fa29cbd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:54.239469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=760c0ea6c9cc4f60a67fe7cd93f45853)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:54.240173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5cc62-1ffb-4d30-8b7b-5703fa29cbd9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.240530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5cc62-1ffb-4d30-8b7b-5703fa29cbd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.240873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e5cc62-1ffb-4d30-8b7b-5703fa29cbd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.242880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:54.329247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '760c0ea6c9cc4f60a67fe7cd93f45853', 'request_id': 'req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.340285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '760c0ea6c9cc4f60a67fe7cd93f45853', 'request_id': 'req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.348810 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:54.349420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '760c0ea6c9cc4f60a67fe7cd93f45853', 'request_id': 'req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.362387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] The token cache is being invalidate because project 760c0ea6c9cc4f60a67fe7cd93f45853 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:50:54.362939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.363733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c6df3efd-fc5a-4c45-90b6-d97d1c2920c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.365796 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 698/1385] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:50:54 2022] DELETE /identity/v3/projects/760c0ea6c9cc4f60a67fe7cd93f45853 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:54.367258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93a9d-9f46-4d45-8256-4ed2bacc80a3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.367682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93a9d-9f46-4d45-8256-4ed2bacc80a3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.368114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b93a9d-9f46-4d45-8256-4ed2bacc80a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.377663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5cc62-1ffb-4d30-8b7b-5703fa29cbd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:54.378849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e5cc62-1ffb-4d30-8b7b-5703fa29cbd9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:54.396586 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 688/1386] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:54.398362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3867d7-decf-4ffa-aae1-b483e8157c3a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.398943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3867d7-decf-4ffa-aae1-b483e8157c3a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.399459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3867d7-decf-4ffa-aae1-b483e8157c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.403727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b0b93a9d-9f46-4d45-8256-4ed2bacc80a3 None None] MFA Rules not processed for user `1275d5281a5c4efe89cc26d46f3c07c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:54.404950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b0b93a9d-9f46-4d45-8256-4ed2bacc80a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.429154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3e3867d7-decf-4ffa-aae1-b483e8157c3a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:54.430764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3e3867d7-decf-4ffa-aae1-b483e8157c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.503471 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:54.524426 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 699/1387] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:54.525818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b93a9d-9f46-4d45-8256-4ed2bacc80a3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:54.527718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b0b93a9d-9f46-4d45-8256-4ed2bacc80a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.558063 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 689/1388] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:54.561776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096011f5-0646-4f98-a6dd-ada84811dfe2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.562296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096011f5-0646-4f98-a6dd-ada84811dfe2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.562755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096011f5-0646-4f98-a6dd-ada84811dfe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.586370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-096011f5-0646-4f98-a6dd-ada84811dfe2 None None] MFA Rules not processed for user `327f1d46d859423982fab017258b9ada`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:54.587671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-096011f5-0646-4f98-a6dd-ada84811dfe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.643737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b93a9d-9f46-4d45-8256-4ed2bacc80a3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:54.649774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:54.650365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.650651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.650925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] PATH_INFO: `/v3/users/78b4383266414cb69102b500917782d5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.652071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] RBAC: Authorizing `identity:delete_user(user_id=78b4383266414cb69102b500917782d5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:54.654060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:54.673738 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 690/1389] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:54.679354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295861a-50e7-4ceb-a62c-0b3334a14e3f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.679664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295861a-50e7-4ceb-a62c-0b3334a14e3f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.680581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6295861a-50e7-4ceb-a62c-0b3334a14e3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.707900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6295861a-50e7-4ceb-a62c-0b3334a14e3f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:54.709782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6295861a-50e7-4ceb-a62c-0b3334a14e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.712364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78b4383266414cb69102b500917782d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.718818 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 691/1390] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:54.719990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295861a-50e7-4ceb-a62c-0b3334a14e3f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:54.721481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6295861a-50e7-4ceb-a62c-0b3334a14e3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.732174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78b4383266414cb69102b500917782d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.733119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78b4383266414cb69102b500917782d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.734861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6295861a-50e7-4ceb-a62c-0b3334a14e3f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:54.740792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:54.741999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.742253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.742523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] PATH_INFO: `/v3/projects/f573f5fcb0b84c6897e41f478d05286d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.743707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f573f5fcb0b84c6897e41f478d05286d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:54.743891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78b4383266414cb69102b500917782d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.745810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:54.754289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78b4383266414cb69102b500917782d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.764624 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 700/1391] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:50:54 2022] DELETE /identity/v3/users/78b4383266414cb69102b500917782d5 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:54.765759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:54.767805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.811728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f573f5fcb0b84c6897e41f478d05286d', 'request_id': 'req-6268dc5b-2f67-43f2-825e-7c29df7b9109'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.820777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f573f5fcb0b84c6897e41f478d05286d', 'request_id': 'req-6268dc5b-2f67-43f2-825e-7c29df7b9109'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.829617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f573f5fcb0b84c6897e41f478d05286d', 'request_id': 'req-6268dc5b-2f67-43f2-825e-7c29df7b9109'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.843432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] The token cache is being invalidate because project f573f5fcb0b84c6897e41f478d05286d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:50:54.843804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.844734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:54.846661 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 692/1392] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:50:54 2022] DELETE /identity/v3/projects/f573f5fcb0b84c6897e41f478d05286d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:54.849734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:54.849734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.853924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ceb968-b0ae-4f29-a542-2443c3f8474f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:54.860127 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:54.868481 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:54.922841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6268dc5b-2f67-43f2-825e-7c29df7b9109 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:54.929937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbaf1ee-a35b-4812-be4d-fe2ff0259ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:54.930547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaf1ee-a35b-4812-be4d-fe2ff0259ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.930824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaf1ee-a35b-4812-be4d-fe2ff0259ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.931135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbaf1ee-a35b-4812-be4d-fe2ff0259ef8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.931775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaf1ee-a35b-4812-be4d-fe2ff0259ef8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:54.932122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaf1ee-a35b-4812-be4d-fe2ff0259ef8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:54.933759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbaf1ee-a35b-4812-be4d-fe2ff0259ef8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:54.935114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874ca60-a866-4b3f-8f63-4331551b56e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:54.935773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874ca60-a866-4b3f-8f63-4331551b56e7 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.936036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874ca60-a866-4b3f-8f63-4331551b56e7 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.936369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874ca60-a866-4b3f-8f63-4331551b56e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.938271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8874ca60-a866-4b3f-8f63-4331551b56e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.947389 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 693/1393] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:54.949017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4affd-a19f-44e6-bffa-3b300ee0adb9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:54.949309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4affd-a19f-44e6-bffa-3b300ee0adb9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:54.949584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d4affd-a19f-44e6-bffa-3b300ee0adb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:54.970511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b8d4affd-a19f-44e6-bffa-3b300ee0adb9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:54.971719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b8d4affd-a19f-44e6-bffa-3b300ee0adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.983435 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 694/1394] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:54.984550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4affd-a19f-44e6-bffa-3b300ee0adb9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:54.985820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b8d4affd-a19f-44e6-bffa-3b300ee0adb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:54.998885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d4affd-a19f-44e6-bffa-3b300ee0adb9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:55.003746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:55.004379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.004836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.005090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] PATH_INFO: `/v3/users/f22d1fba646142e7b7f376a939e57b69` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.008068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f22d1fba646142e7b7f376a939e57b69)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:55.010352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:55.010696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874ca60-a866-4b3f-8f63-4331551b56e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:55.012957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874ca60-a866-4b3f-8f63-4331551b56e7 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:55.025758 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 701/1395] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:54 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:55.032099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874ca60-a866-4b3f-8f63-4331551b56e7 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:55.048679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874ca60-a866-4b3f-8f63-4331551b56e7 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:55.056479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1034890-a22d-4d91-8d54-f7c9bc7ca389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:55.057599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034890-a22d-4d91-8d54-f7c9bc7ca389 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.058166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034890-a22d-4d91-8d54-f7c9bc7ca389 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.058448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1034890-a22d-4d91-8d54-f7c9bc7ca389 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.059089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1034890-a22d-4d91-8d54-f7c9bc7ca389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:55.062097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1034890-a22d-4d91-8d54-f7c9bc7ca389 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:55.067007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f22d1fba646142e7b7f376a939e57b69'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:55.080045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f22d1fba646142e7b7f376a939e57b69'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:55.080948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f22d1fba646142e7b7f376a939e57b69'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:55.091872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f22d1fba646142e7b7f376a939e57b69'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:55.106321 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 702/1396] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:55 2022] POST /identity/v3/projects => generated 377 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:55.106321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1034890-a22d-4d91-8d54-f7c9bc7ca389 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:55.106467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f22d1fba646142e7b7f376a939e57b69'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:55.106537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b1034890-a22d-4d91-8d54-f7c9bc7ca389 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:55.112159 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 695/1397] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:50:54 2022] DELETE /identity/v3/users/f22d1fba646142e7b7f376a939e57b69 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:55.113892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:55.117543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:55.192840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1034890-a22d-4d91-8d54-f7c9bc7ca389 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:55.224654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4baa730-3fd4-44f9-b361-2c4e4390b0eb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:55.236097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ef29a-3e9f-4f85-aa9a-9696fae26406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:55.236894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ef29a-3e9f-4f85-aa9a-9696fae26406 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.237191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ef29a-3e9f-4f85-aa9a-9696fae26406 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.237494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ef29a-3e9f-4f85-aa9a-9696fae26406 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.238573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ef29a-3e9f-4f85-aa9a-9696fae26406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:55.241043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8ef29a-3e9f-4f85-aa9a-9696fae26406 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:55.262451 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:55.271165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ad284-7f33-44cd-9160-a82e04d6e7c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:55.272201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ad284-7f33-44cd-9160-a82e04d6e7c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.272795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ad284-7f33-44cd-9160-a82e04d6e7c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.273922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278ad284-7f33-44cd-9160-a82e04d6e7c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.274481 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:55.280364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-278ad284-7f33-44cd-9160-a82e04d6e7c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:55.289477 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 696/1398] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:55 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:55.294408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ef29a-3e9f-4f85-aa9a-9696fae26406 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:55.301078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ad284-7f33-44cd-9160-a82e04d6e7c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:55.302639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278ad284-7f33-44cd-9160-a82e04d6e7c1 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:55.313742 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 703/1399] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:55.323285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ef29a-3e9f-4f85-aa9a-9696fae26406 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:55.328089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed3697-5037-4138-a28d-f8a7d5727027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:55.328700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed3697-5037-4138-a28d-f8a7d5727027 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.328985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed3697-5037-4138-a28d-f8a7d5727027 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.329919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed3697-5037-4138-a28d-f8a7d5727027 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.330790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed3697-5037-4138-a28d-f8a7d5727027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:55.332666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed3697-5037-4138-a28d-f8a7d5727027 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:55.344965 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 697/1400] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:50:55.348942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ad284-7f33-44cd-9160-a82e04d6e7c1 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:55.359145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278ad284-7f33-44cd-9160-a82e04d6e7c1 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:55.364036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab31c6-a84a-4441-bf10-2bc052c3be05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:55.364771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab31c6-a84a-4441-bf10-2bc052c3be05 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.365118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab31c6-a84a-4441-bf10-2bc052c3be05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.365350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab31c6-a84a-4441-bf10-2bc052c3be05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.365990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab31c6-a84a-4441-bf10-2bc052c3be05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:55.368118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab31c6-a84a-4441-bf10-2bc052c3be05 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:55.384769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed3697-5037-4138-a28d-f8a7d5727027 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:55.385219 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 704/1401] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:55.395276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed3697-5037-4138-a28d-f8a7d5727027 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:55.400158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ca015-bbc6-42d4-b70f-7927a51596da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:55.400838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ca015-bbc6-42d4-b70f-7927a51596da admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.401180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ca015-bbc6-42d4-b70f-7927a51596da admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.401660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8ca015-bbc6-42d4-b70f-7927a51596da admin admin] PATH_INFO: `/v3/projects/6138e94ecf2a46ea84c5348af3c7e628/users/678a66668f2f45989ae7b53f1254686b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.419771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ca015-bbc6-42d4-b70f-7927a51596da admin admin] RBAC: Authorizing `identity:create_grant(project_id=6138e94ecf2a46ea84c5348af3c7e628, user_id=678a66668f2f45989ae7b53f1254686b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:55.422755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8ca015-bbc6-42d4-b70f-7927a51596da admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:55.439150 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 698/1402] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:55 2022] PUT /identity/v3/projects/6138e94ecf2a46ea84c5348af3c7e628/users/678a66668f2f45989ae7b53f1254686b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:50:55.449535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15195c8-1089-4ed3-b5e2-476708f74cd1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.449830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15195c8-1089-4ed3-b5e2-476708f74cd1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.450093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15195c8-1089-4ed3-b5e2-476708f74cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.495506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b15195c8-1089-4ed3-b5e2-476708f74cd1 None None] MFA Rules not processed for user `678a66668f2f45989ae7b53f1254686b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:55.497286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b15195c8-1089-4ed3-b5e2-476708f74cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:55.681216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ca015-bbc6-42d4-b70f-7927a51596da admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:55.682158 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 705/1403] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:55.783811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15195c8-1089-4ed3-b5e2-476708f74cd1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:55.785567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b15195c8-1089-4ed3-b5e2-476708f74cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:55.804300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8ca015-bbc6-42d4-b70f-7927a51596da admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:55.824704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520ead-3726-44aa-b6fd-29afe112196e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:55.825369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520ead-3726-44aa-b6fd-29afe112196e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.825629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520ead-3726-44aa-b6fd-29afe112196e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.825900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf520ead-3726-44aa-b6fd-29afe112196e admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.826539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf520ead-3726-44aa-b6fd-29afe112196e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:55.828461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf520ead-3726-44aa-b6fd-29afe112196e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:55.870877 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 699/1404] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:55 2022] POST /identity/v3/projects => generated 379 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:55.876507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520ead-3726-44aa-b6fd-29afe112196e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:55.884413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15195c8-1089-4ed3-b5e2-476708f74cd1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:55.994478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:55.995349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:55.995737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:55.996061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] PATH_INFO: `/v3/projects/70e959422a934c69aefb8c6edfacd871` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:55.997587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70e959422a934c69aefb8c6edfacd871)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.000768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:56.035049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf520ead-3726-44aa-b6fd-29afe112196e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:56.035538 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:56.049981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a266-1704-44a9-aaaf-2305a9fd39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:56.050706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a266-1704-44a9-aaaf-2305a9fd39a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.051160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a266-1704-44a9-aaaf-2305a9fd39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.051749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8245a266-1704-44a9-aaaf-2305a9fd39a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.052529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245a266-1704-44a9-aaaf-2305a9fd39a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.060400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8245a266-1704-44a9-aaaf-2305a9fd39a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:56.080605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70e959422a934c69aefb8c6edfacd871', 'request_id': 'req-81f2ff84-5141-4c6a-a3df-7fb699a20676'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.090293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70e959422a934c69aefb8c6edfacd871', 'request_id': 'req-81f2ff84-5141-4c6a-a3df-7fb699a20676'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.094743 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 700/1405] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:55 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:56.095692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a266-1704-44a9-aaaf-2305a9fd39a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:56.098996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8245a266-1704-44a9-aaaf-2305a9fd39a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.100677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70e959422a934c69aefb8c6edfacd871', 'request_id': 'req-81f2ff84-5141-4c6a-a3df-7fb699a20676'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.116173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8245a266-1704-44a9-aaaf-2305a9fd39a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:56.117548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] The token cache is being invalidate because project 70e959422a934c69aefb8c6edfacd871 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:50:56.118211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.119331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.121256 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 706/1406] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:50:55 2022] DELETE /identity/v3/projects/70e959422a934c69aefb8c6edfacd871 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:50:56.122692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:56.124546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.201101 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:56.239178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:56.240109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.240616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.241022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] PATH_INFO: `/v3/projects/7784f0dfd226407cbb3bc67566ccedf5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.242573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7784f0dfd226407cbb3bc67566ccedf5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.245056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:56.252387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f2ff84-5141-4c6a-a3df-7fb699a20676 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:56.265409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5da79c-a1a7-4bbb-b75f-f366765b1e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:56.266239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5da79c-a1a7-4bbb-b75f-f366765b1e32 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.266519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5da79c-a1a7-4bbb-b75f-f366765b1e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.266796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5da79c-a1a7-4bbb-b75f-f366765b1e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.267628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5da79c-a1a7-4bbb-b75f-f366765b1e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.279817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5da79c-a1a7-4bbb-b75f-f366765b1e32 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:56.297845 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 707/1407] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:56.299130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cddc20-c746-4116-8600-9301ca8aa75e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.299423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cddc20-c746-4116-8600-9301ca8aa75e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.299701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cddc20-c746-4116-8600-9301ca8aa75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.325403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7784f0dfd226407cbb3bc67566ccedf5', 'request_id': 'req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.326982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-42cddc20-c746-4116-8600-9301ca8aa75e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:56.328300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42cddc20-c746-4116-8600-9301ca8aa75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.338056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7784f0dfd226407cbb3bc67566ccedf5', 'request_id': 'req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.346873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7784f0dfd226407cbb3bc67566ccedf5', 'request_id': 'req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.359489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] The token cache is being invalidate because project 7784f0dfd226407cbb3bc67566ccedf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:50:56.359697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.360356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.362182 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 701/1408] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:50:56 2022] DELETE /identity/v3/projects/7784f0dfd226407cbb3bc67566ccedf5 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:56.365923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:56.367359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.399373 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 708/1409] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:56.402516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cddc20-c746-4116-8600-9301ca8aa75e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:56.405415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42cddc20-c746-4116-8600-9301ca8aa75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.422313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cddc20-c746-4116-8600-9301ca8aa75e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:56.428103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:56.428744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.429056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.429528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] PATH_INFO: `/v3/users/0779d91ec674452b873823f73ed6e8cb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.430599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0779d91ec674452b873823f73ed6e8cb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.432714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:56.439518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbe00ba-5edb-443a-a9a0-f8158f07e53c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:56.445132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da0f99c-81be-4f26-a6fb-1e0b44984f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:56.445860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0f99c-81be-4f26-a6fb-1e0b44984f11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.446881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0f99c-81be-4f26-a6fb-1e0b44984f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.447076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da0f99c-81be-4f26-a6fb-1e0b44984f11 admin admin] PATH_INFO: `/v3/projects/c839095903074c5993d256787c192121/users/96fc891a98794418ab50f903358f1ef2/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.470480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0f99c-81be-4f26-a6fb-1e0b44984f11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c839095903074c5993d256787c192121, user_id=96fc891a98794418ab50f903358f1ef2, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.473942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da0f99c-81be-4f26-a6fb-1e0b44984f11 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:56.481922 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:56.492697 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 702/1410] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:56 2022] PUT /identity/v3/projects/c839095903074c5993d256787c192121/users/96fc891a98794418ab50f903358f1ef2/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:56.494060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537b342-e7bc-496f-b172-99d81c7e1b41 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.494447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537b342-e7bc-496f-b172-99d81c7e1b41 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.494873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537b342-e7bc-496f-b172-99d81c7e1b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.498938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0779d91ec674452b873823f73ed6e8cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.515715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0779d91ec674452b873823f73ed6e8cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.516746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0779d91ec674452b873823f73ed6e8cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.518481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1537b342-e7bc-496f-b172-99d81c7e1b41 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:56.520104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1537b342-e7bc-496f-b172-99d81c7e1b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.527431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0779d91ec674452b873823f73ed6e8cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.537700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0779d91ec674452b873823f73ed6e8cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:56.550606 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 709/1411] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:50:56 2022] DELETE /identity/v3/users/0779d91ec674452b873823f73ed6e8cb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:56.551924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:56.566117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.636843 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:56.662926 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 703/1412] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:56.665090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae164ae-dbaf-4999-9cce-43fa01d0722d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.665496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae164ae-dbaf-4999-9cce-43fa01d0722d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.665968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae164ae-dbaf-4999-9cce-43fa01d0722d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.728183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e2ed9b-1d9c-4b8d-9b6e-21624b10f7f8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:56.734820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cae164ae-dbaf-4999-9cce-43fa01d0722d None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:56.736238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cae164ae-dbaf-4999-9cce-43fa01d0722d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.743374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54f07c-a795-460a-b769-7a819f962f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:56.743517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54f07c-a795-460a-b769-7a819f962f65 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.745456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54f07c-a795-460a-b769-7a819f962f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.745767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54f07c-a795-460a-b769-7a819f962f65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.746447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54f07c-a795-460a-b769-7a819f962f65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.748353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54f07c-a795-460a-b769-7a819f962f65 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:56.770211 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 710/1413] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:56 2022] GET /identity/v3/roles => generated 1420 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:56.771020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54f07c-a795-460a-b769-7a819f962f65 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:56.783454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54f07c-a795-460a-b769-7a819f962f65 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:56.789816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c944e10-b790-4f55-9053-ab1b4f415116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:56.790439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c944e10-b790-4f55-9053-ab1b4f415116 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.790719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c944e10-b790-4f55-9053-ab1b4f415116 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.790990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c944e10-b790-4f55-9053-ab1b4f415116 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.791647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c944e10-b790-4f55-9053-ab1b4f415116 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:56.791973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c944e10-b790-4f55-9053-ab1b4f415116 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.794412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c944e10-b790-4f55-9053-ab1b4f415116 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:56.811921 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 711/1414] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:56.816293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c944e10-b790-4f55-9053-ab1b4f415116 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:56.827929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c944e10-b790-4f55-9053-ab1b4f415116 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:56.832986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fb407f-c707-44d5-8f6e-726e0dfb3829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:56.834427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb407f-c707-44d5-8f6e-726e0dfb3829 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.834780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb407f-c707-44d5-8f6e-726e0dfb3829 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.835707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fb407f-c707-44d5-8f6e-726e0dfb3829 admin admin] PATH_INFO: `/v3/projects/c839095903074c5993d256787c192121/users/96fc891a98794418ab50f903358f1ef2/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.838027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb407f-c707-44d5-8f6e-726e0dfb3829 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c839095903074c5993d256787c192121, user_id=96fc891a98794418ab50f903358f1ef2, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.840913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fb407f-c707-44d5-8f6e-726e0dfb3829 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:56.844849 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 704/1415] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:50:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:56.845932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae164ae-dbaf-4999-9cce-43fa01d0722d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:56.860875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae164ae-dbaf-4999-9cce-43fa01d0722d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:56.861376 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 712/1416] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:56 2022] PUT /identity/v3/projects/c839095903074c5993d256787c192121/users/96fc891a98794418ab50f903358f1ef2/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:56.872518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e417c79-6329-4b1b-a047-32f5f3d1c3d4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.873114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e417c79-6329-4b1b-a047-32f5f3d1c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.873468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e417c79-6329-4b1b-a047-32f5f3d1c3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.920106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0e417c79-6329-4b1b-a047-32f5f3d1c3d4 None None] MFA Rules not processed for user `96fc891a98794418ab50f903358f1ef2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:56.931400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0e417c79-6329-4b1b-a047-32f5f3d1c3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:56.936797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0229b2-cfcb-4193-a124-91145f3b8955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:56.937473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0229b2-cfcb-4193-a124-91145f3b8955 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:56.937995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0229b2-cfcb-4193-a124-91145f3b8955 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:56.938087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0229b2-cfcb-4193-a124-91145f3b8955 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:56.938801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0229b2-cfcb-4193-a124-91145f3b8955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:56.940971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0229b2-cfcb-4193-a124-91145f3b8955 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:57.005562 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 705/1417] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:56 2022] POST /identity/v3/projects => generated 409 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:57.007617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0229b2-cfcb-4193-a124-91145f3b8955 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:57.023466 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 713/1418] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:50:57.063797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e417c79-6329-4b1b-a047-32f5f3d1c3d4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:57.065378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0e417c79-6329-4b1b-a047-32f5f3d1c3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:57.083112 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:57.114740 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:57.155606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0229b2-cfcb-4193-a124-91145f3b8955 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:57.170038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90067-2b3a-4e4d-817d-ca6b02e6a7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:57.170804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90067-2b3a-4e4d-817d-ca6b02e6a7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.171093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90067-2b3a-4e4d-817d-ca6b02e6a7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.171421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b90067-2b3a-4e4d-817d-ca6b02e6a7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:57.172138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90067-2b3a-4e4d-817d-ca6b02e6a7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:57.177143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b90067-2b3a-4e4d-817d-ca6b02e6a7a1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:57.230417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e417c79-6329-4b1b-a047-32f5f3d1c3d4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:57.249596 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 706/1419] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:57 2022] POST /identity/v3/users => generated 305 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:57.250849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90067-2b3a-4e4d-817d-ca6b02e6a7a1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:57.253609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-25b90067-2b3a-4e4d-817d-ca6b02e6a7a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:57.318753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fb6d3-e70b-494b-8727-a837560f4fa6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:57.319529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fb6d3-e70b-494b-8727-a837560f4fa6 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.319882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fb6d3-e70b-494b-8727-a837560f4fa6 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.320218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fb6d3-e70b-494b-8727-a837560f4fa6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:57.347133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b90067-2b3a-4e4d-817d-ca6b02e6a7a1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:57.354596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511e378-a51a-42f4-bf32-087f26693d00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:57.355519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511e378-a51a-42f4-bf32-087f26693d00 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.355940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511e378-a51a-42f4-bf32-087f26693d00 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.356352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a511e378-a51a-42f4-bf32-087f26693d00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:57.387754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fb6d3-e70b-494b-8727-a837560f4fa6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:57.391716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fb6d3-e70b-494b-8727-a837560f4fa6 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:57.405005 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 714/1420] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:50:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:57.405804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fb6d3-e70b-494b-8727-a837560f4fa6 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:57.407695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ed1fb6d3-e70b-494b-8727-a837560f4fa6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:57.427732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fb6d3-e70b-494b-8727-a837560f4fa6 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:57.433932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511e378-a51a-42f4-bf32-087f26693d00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:57.434083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:57.434599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.434966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.435361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] PATH_INFO: `/v3/projects/f587d85a98b64be5aae05d66e35cf5b2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:57.435767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a511e378-a51a-42f4-bf32-087f26693d00 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:57.436655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f587d85a98b64be5aae05d66e35cf5b2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:57.438919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:57.451753 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 707/1421] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:57.454681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511e378-a51a-42f4-bf32-087f26693d00 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:57.486750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a511e378-a51a-42f4-bf32-087f26693d00 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:57.499632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431db46e-b089-42e9-8518-d8c4b075c4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:57.500576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431db46e-b089-42e9-8518-d8c4b075c4f6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.501056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431db46e-b089-42e9-8518-d8c4b075c4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.501563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431db46e-b089-42e9-8518-d8c4b075c4f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:57.502412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431db46e-b089-42e9-8518-d8c4b075c4f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:57.504434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431db46e-b089-42e9-8518-d8c4b075c4f6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:57.545233 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 708/1422] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:57.547009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431db46e-b089-42e9-8518-d8c4b075c4f6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:57.549195 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:57.559339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431db46e-b089-42e9-8518-d8c4b075c4f6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:57.584468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f587d85a98b64be5aae05d66e35cf5b2', 'request_id': 'req-9be6c102-08d1-4a78-98cb-f0c28cc053f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:57.600335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f587d85a98b64be5aae05d66e35cf5b2', 'request_id': 'req-9be6c102-08d1-4a78-98cb-f0c28cc053f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:57.612677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f587d85a98b64be5aae05d66e35cf5b2', 'request_id': 'req-9be6c102-08d1-4a78-98cb-f0c28cc053f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:57.636177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] The token cache is being invalidate because project f587d85a98b64be5aae05d66e35cf5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:50:57.641494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:57.642408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9be6c102-08d1-4a78-98cb-f0c28cc053f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:50:57.648110 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 715/1423] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:50:57 2022] DELETE /identity/v3/projects/f587d85a98b64be5aae05d66e35cf5b2 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:57.653046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94e714-6e76-460f-8cee-606cd7cb13ba None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.653629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94e714-6e76-460f-8cee-606cd7cb13ba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.654625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed94e714-6e76-460f-8cee-606cd7cb13ba None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:57.663839 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 716/1424] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:50:57 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:50:57.666164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d380f6b-925d-4780-b695-3145de69b1a7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.666681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d380f6b-925d-4780-b695-3145de69b1a7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.667312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d380f6b-925d-4780-b695-3145de69b1a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:57.696044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8d380f6b-925d-4780-b695-3145de69b1a7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:57.697868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d380f6b-925d-4780-b695-3145de69b1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:57.762218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:57.762795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.763143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.763492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:57.772081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:57.774474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:57.776259 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:57.809556 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 709/1425] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:57 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:57.810629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:50:57.812402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 717/1426] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:57.813429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d380f6b-925d-4780-b695-3145de69b1a7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:57.814784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d380f6b-925d-4780-b695-3145de69b1a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:57.828045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:57.845852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d380f6b-925d-4780-b695-3145de69b1a7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:57.866065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dbbd69-5cf8-4c90-a871-3e155da68b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:57.866824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbbd69-5cf8-4c90-a871-3e155da68b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.867120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbbd69-5cf8-4c90-a871-3e155da68b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.867394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dbbd69-5cf8-4c90-a871-3e155da68b0c admin admin] PATH_INFO: `/v3/projects/b5dfa9d66ac747138d412e0f39f59ab6/users/b945314dc73b4bd2a5b29cbfccd55ef7/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:57.923556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbbd69-5cf8-4c90-a871-3e155da68b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dfa9d66ac747138d412e0f39f59ab6, user_id=b945314dc73b4bd2a5b29cbfccd55ef7, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:57.934015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dbbd69-5cf8-4c90-a871-3e155da68b0c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:57.964806 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 718/1427] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:57 2022] PUT /identity/v3/projects/b5dfa9d66ac747138d412e0f39f59ab6/users/b945314dc73b4bd2a5b29cbfccd55ef7/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:57.966159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456228b-ef07-4725-bb35-1f910834f16b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:57.966447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456228b-ef07-4725-bb35-1f910834f16b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:57.966727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456228b-ef07-4725-bb35-1f910834f16b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:58.015629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1456228b-ef07-4725-bb35-1f910834f16b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:58.017610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1456228b-ef07-4725-bb35-1f910834f16b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:58.019885 n-d-master-1 devstack@keystone.service[88311]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 24 08:50:58.020195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:58.032543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:58.144596 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 719/1428] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:58.156635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292aea5-17af-49ce-9e06-066d64b61747 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:58.157879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292aea5-17af-49ce-9e06-066d64b61747 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:58.158289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e292aea5-17af-49ce-9e06-066d64b61747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:58.193734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f67fd-506c-49b9-be6c-d7335c867f5e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:58.244436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e292aea5-17af-49ce-9e06-066d64b61747 None None] MFA Rules not processed for user `b945314dc73b4bd2a5b29cbfccd55ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:58.246277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e292aea5-17af-49ce-9e06-066d64b61747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:58.311709 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:58.379080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163b218-3f37-4421-bd51-890405e76f08 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fc891a98794418ab50f903358f1ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c839095903074c5993d256787c192121', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:58.379768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163b218-3f37-4421-bd51-890405e76f08 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:58.380082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163b218-3f37-4421-bd51-890405e76f08 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:58.380416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163b218-3f37-4421-bd51-890405e76f08 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] PATH_INFO: `/v3/projects/6138e94ecf2a46ea84c5348af3c7e628` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:58.382059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163b218-3f37-4421-bd51-890405e76f08 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] RBAC: Authorizing `identity:get_project(project_id=6138e94ecf2a46ea84c5348af3c7e628)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:58.384844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163b218-3f37-4421-bd51-890405e76f08 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:58.393467 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 710/1429] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:50:57 2022] GET /identity/v3/projects/6138e94ecf2a46ea84c5348af3c7e628 => generated 377 bytes in 583 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:58.398171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163b218-3f37-4421-bd51-890405e76f08 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:58.424100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163b218-3f37-4421-bd51-890405e76f08 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:58.438066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f7f13-75d8-45b3-b374-88eb45024c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:58.438690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7f13-75d8-45b3-b374-88eb45024c3c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:58.438969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7f13-75d8-45b3-b374-88eb45024c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:58.439242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f7f13-75d8-45b3-b374-88eb45024c3c admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:58.440122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f7f13-75d8-45b3-b374-88eb45024c3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:50:58.443911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f7f13-75d8-45b3-b374-88eb45024c3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:58.443911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f7f13-75d8-45b3-b374-88eb45024c3c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:58.444564 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 720/1430] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:50:58 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:58.447158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872cc72-f412-45c1-8795-3ef9ea7b7dd4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:58.447796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872cc72-f412-45c1-8795-3ef9ea7b7dd4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:58.448272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872cc72-f412-45c1-8795-3ef9ea7b7dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:58.471527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b872cc72-f412-45c1-8795-3ef9ea7b7dd4 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:58.471914 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 711/1431] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:50:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:58.473226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc07c0-2294-4ac4-8099-1f0e98a6a508 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:58.473543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc07c0-2294-4ac4-8099-1f0e98a6a508 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:58.473775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b872cc72-f412-45c1-8795-3ef9ea7b7dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:58.473871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc07c0-2294-4ac4-8099-1f0e98a6a508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:58.558296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a0cc07c0-2294-4ac4-8099-1f0e98a6a508 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:50:58.559580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a0cc07c0-2294-4ac4-8099-1f0e98a6a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:58.584713 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:58.594182 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 721/1432] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:50:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:58.597126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872cc72-f412-45c1-8795-3ef9ea7b7dd4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:58.626941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872cc72-f412-45c1-8795-3ef9ea7b7dd4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:58.644328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dde95-1f85-4d70-bfda-4c696f161273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:58.644971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dde95-1f85-4d70-bfda-4c696f161273 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:58.645254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dde95-1f85-4d70-bfda-4c696f161273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:58.645557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25dde95-1f85-4d70-bfda-4c696f161273 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:58.649286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dde95-1f85-4d70-bfda-4c696f161273 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:58.651314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25dde95-1f85-4d70-bfda-4c696f161273 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:58.735475 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 722/1433] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:58 2022] POST /identity/v3/projects => generated 407 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:58.735475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dde95-1f85-4d70-bfda-4c696f161273 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:58.762724 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 712/1434] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Oct 24 08:50:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:50:58.763670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc07c0-2294-4ac4-8099-1f0e98a6a508 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:58.767979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a0cc07c0-2294-4ac4-8099-1f0e98a6a508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:58.887528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25dde95-1f85-4d70-bfda-4c696f161273 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:58.899785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6740f7e-7396-4210-984a-8e36f43fefad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:58.901402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6740f7e-7396-4210-984a-8e36f43fefad admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:58.901402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6740f7e-7396-4210-984a-8e36f43fefad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:58.901614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6740f7e-7396-4210-984a-8e36f43fefad admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:58.902584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6740f7e-7396-4210-984a-8e36f43fefad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:58.905381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6740f7e-7396-4210-984a-8e36f43fefad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:58.953422 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 723/1435] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:50:58 2022] POST /identity/v3/projects => generated 389 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:58.954686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6740f7e-7396-4210-984a-8e36f43fefad admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:58.958633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e6740f7e-7396-4210-984a-8e36f43fefad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:58.967072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc07c0-2294-4ac4-8099-1f0e98a6a508 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:59.024147 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:59.070827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6740f7e-7396-4210-984a-8e36f43fefad admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:59.076994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc298dc0-2497-4912-93db-af482bd423ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:59.077179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3037f-5b27-4244-b666-ce520ba865df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:59.077977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc298dc0-2497-4912-93db-af482bd423ac service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:59.078104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3037f-5b27-4244-b666-ce520ba865df service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:59.078286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3037f-5b27-4244-b666-ce520ba865df service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:59.078567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c3037f-5b27-4244-b666-ce520ba865df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:59.078907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc298dc0-2497-4912-93db-af482bd423ac service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:59.079325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc298dc0-2497-4912-93db-af482bd423ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:59.081695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fc298dc0-2497-4912-93db-af482bd423ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:59.190809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc298dc0-2497-4912-93db-af482bd423ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:59.192714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc298dc0-2497-4912-93db-af482bd423ac service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:59.197666 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:50:59.229850 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 713/1436] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:59.231265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc298dc0-2497-4912-93db-af482bd423ac service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:59.232651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3037f-5b27-4244-b666-ce520ba865df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:59.234532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c3037f-5b27-4244-b666-ce520ba865df service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:59.254136 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 724/1437] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:50:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:50:59.256354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3037f-5b27-4244-b666-ce520ba865df service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:59.258666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08c3037f-5b27-4244-b666-ce520ba865df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:50:59.407118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc298dc0-2497-4912-93db-af482bd423ac service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:59.423922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c3037f-5b27-4244-b666-ce520ba865df service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:59.428433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6442cdc-f59a-409c-ba10-2ab3031b6f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:59.432181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6442cdc-f59a-409c-ba10-2ab3031b6f8a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:59.434710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6442cdc-f59a-409c-ba10-2ab3031b6f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:59.435276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f51911-d795-4ebc-942c-003d00bd9fa5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:59.435788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6442cdc-f59a-409c-ba10-2ab3031b6f8a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:59.436944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f51911-d795-4ebc-942c-003d00bd9fa5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:59.437401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f51911-d795-4ebc-942c-003d00bd9fa5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:59.438138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f51911-d795-4ebc-942c-003d00bd9fa5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:59.439571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6442cdc-f59a-409c-ba10-2ab3031b6f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:59.451747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6442cdc-f59a-409c-ba10-2ab3031b6f8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:59.462014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f51911-d795-4ebc-942c-003d00bd9fa5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:59.463487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f51911-d795-4ebc-942c-003d00bd9fa5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:59.510734 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 725/1438] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:50:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:50:59.514689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f51911-d795-4ebc-942c-003d00bd9fa5 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:59.526481 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 714/1439] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:59 2022] POST /identity/v3/users => generated 310 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:59.535067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acaf26-3791-4f08-b302-1ebb3d0edcd0 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:59.536059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acaf26-3791-4f08-b302-1ebb3d0edcd0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:59.541489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52acaf26-3791-4f08-b302-1ebb3d0edcd0 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:59.544314 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 715/1440] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:50:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:50:59.545881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acaf26-3791-4f08-b302-1ebb3d0edcd0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:59.581278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f51911-d795-4ebc-942c-003d00bd9fa5 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:59.596474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f4fc3-8f06-42b0-9555-af1f1689340d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:59.597686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f4fc3-8f06-42b0-9555-af1f1689340d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:59.597813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52acaf26-3791-4f08-b302-1ebb3d0edcd0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:59.598863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f4fc3-8f06-42b0-9555-af1f1689340d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:59.599248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f4fc3-8f06-42b0-9555-af1f1689340d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:59.602270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f4fc3-8f06-42b0-9555-af1f1689340d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:59.609192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824f4fc3-8f06-42b0-9555-af1f1689340d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:59.619468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285718d2-65f7-4406-8367-ec10d871fc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:59.622211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285718d2-65f7-4406-8367-ec10d871fc10 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:59.622622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285718d2-65f7-4406-8367-ec10d871fc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:59.622996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285718d2-65f7-4406-8367-ec10d871fc10 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:59.623782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285718d2-65f7-4406-8367-ec10d871fc10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:59.627958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285718d2-65f7-4406-8367-ec10d871fc10 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:59.653553 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 716/1441] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:50:59.654711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285718d2-65f7-4406-8367-ec10d871fc10 admin admin] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:50:59.678493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285718d2-65f7-4406-8367-ec10d871fc10 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:59.713729 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 726/1442] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:50:59 2022] POST /identity/v3/users => generated 295 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:50:59.713729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f4fc3-8f06-42b0-9555-af1f1689340d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:59.775101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f4fc3-8f06-42b0-9555-af1f1689340d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:59.792606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d404200-b276-4080-8769-5a39d16e17bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:59.794284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d404200-b276-4080-8769-5a39d16e17bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:59.794811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d404200-b276-4080-8769-5a39d16e17bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:59.795698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d404200-b276-4080-8769-5a39d16e17bb admin admin] PATH_INFO: `/v3/projects/9869c04401ed46e186ea0c8b6a20dc2a/users/4b7e283469f54398957ef3c261ebf9fa/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:59.827488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285718d2-65f7-4406-8367-ec10d871fc10 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:59.839366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d404200-b276-4080-8769-5a39d16e17bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=9869c04401ed46e186ea0c8b6a20dc2a, user_id=4b7e283469f54398957ef3c261ebf9fa, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:59.842612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d404200-b276-4080-8769-5a39d16e17bb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:59.844473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc5f16-8796-41e7-a8de-17255cbeec17 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '96fc891a98794418ab50f903358f1ef2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c839095903074c5993d256787c192121', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:50:59.845125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc5f16-8796-41e7-a8de-17255cbeec17 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:50:59.851587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc5f16-8796-41e7-a8de-17255cbeec17 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:50:59.851587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc5f16-8796-41e7-a8de-17255cbeec17 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] PATH_INFO: `/v3/projects/6138e94ecf2a46ea84c5348af3c7e628` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:50:59.851587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc5f16-8796-41e7-a8de-17255cbeec17 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] RBAC: Authorizing `identity:get_project(project_id=6138e94ecf2a46ea84c5348af3c7e628)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:50:59.851587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc5f16-8796-41e7-a8de-17255cbeec17 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:50:59.852051 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 717/1443] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:50:59 2022] GET /identity/v3/projects/6138e94ecf2a46ea84c5348af3c7e628 => generated 377 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:50:59.852812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc5f16-8796-41e7-a8de-17255cbeec17 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:50:59.894172 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 727/1444] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:50:59 2022] PUT /identity/v3/projects/9869c04401ed46e186ea0c8b6a20dc2a/users/4b7e283469f54398957ef3c261ebf9fa/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:50:59.903088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc5f16-8796-41e7-a8de-17255cbeec17 tempest-FlavorsAccessTestJSON-1119399875 tempest-FlavorsAccessTestJSON-1119399875-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:50:59.907476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d404200-b276-4080-8769-5a39d16e17bb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:00.051143 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:00.134751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d404200-b276-4080-8769-5a39d16e17bb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:00.152953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679831b5-d0dd-45cd-b66a-6dfba209ace7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:00.153639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679831b5-d0dd-45cd-b66a-6dfba209ace7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:00.153759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a17c00-9dc5-4d94-a9f4-581f5dd040ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:00.154296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a17c00-9dc5-4d94-a9f4-581f5dd040ef admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:00.154589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a17c00-9dc5-4d94-a9f4-581f5dd040ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:00.154833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a17c00-9dc5-4d94-a9f4-581f5dd040ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:00.155868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679831b5-d0dd-45cd-b66a-6dfba209ace7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:00.156122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a17c00-9dc5-4d94-a9f4-581f5dd040ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:00.156218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679831b5-d0dd-45cd-b66a-6dfba209ace7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:00.156924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679831b5-d0dd-45cd-b66a-6dfba209ace7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:00.158468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679831b5-d0dd-45cd-b66a-6dfba209ace7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:00.158744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a17c00-9dc5-4d94-a9f4-581f5dd040ef admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:00.193177 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 728/1445] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:00.199742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679831b5-d0dd-45cd-b66a-6dfba209ace7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:00.215669 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 718/1446] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:50:59 2022] GET /identity/v3/roles => generated 1420 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:00.219683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a17c00-9dc5-4d94-a9f4-581f5dd040ef admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:00.220618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679831b5-d0dd-45cd-b66a-6dfba209ace7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:00.236632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9817cb43-46d5-4c9e-a807-6ec6c8777e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:00.237325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817cb43-46d5-4c9e-a807-6ec6c8777e73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:00.237622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817cb43-46d5-4c9e-a807-6ec6c8777e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:00.237892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9817cb43-46d5-4c9e-a807-6ec6c8777e73 admin admin] PATH_INFO: `/v3/projects/9869c04401ed46e186ea0c8b6a20dc2a/users/4b7e283469f54398957ef3c261ebf9fa/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:00.243419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817cb43-46d5-4c9e-a807-6ec6c8777e73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9869c04401ed46e186ea0c8b6a20dc2a, user_id=4b7e283469f54398957ef3c261ebf9fa, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:00.246150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9817cb43-46d5-4c9e-a807-6ec6c8777e73 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:00.252256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a17c00-9dc5-4d94-a9f4-581f5dd040ef admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:00.271545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015957b-5838-4ac0-9c89-e1a10384c2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:00.276184 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 729/1447] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:00 2022] PUT /identity/v3/projects/9869c04401ed46e186ea0c8b6a20dc2a/users/4b7e283469f54398957ef3c261ebf9fa/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:00.277470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015957b-5838-4ac0-9c89-e1a10384c2ff admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:00.277983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015957b-5838-4ac0-9c89-e1a10384c2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:00.278503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015957b-5838-4ac0-9c89-e1a10384c2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:00.280548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015957b-5838-4ac0-9c89-e1a10384c2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:00.288575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd42058-da8b-44f9-ba8e-3bf3a3e24ef8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:00.288914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd42058-da8b-44f9-ba8e-3bf3a3e24ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:00.289196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd42058-da8b-44f9-ba8e-3bf3a3e24ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:00.289674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015957b-5838-4ac0-9c89-e1a10384c2ff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:00.312903 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:00.340664 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 719/1448] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:00 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:00.345243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015957b-5838-4ac0-9c89-e1a10384c2ff admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:00.358597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9cd42058-da8b-44f9-ba8e-3bf3a3e24ef8 None None] MFA Rules not processed for user `4b7e283469f54398957ef3c261ebf9fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:00.359854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9cd42058-da8b-44f9-ba8e-3bf3a3e24ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:00.386281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015957b-5838-4ac0-9c89-e1a10384c2ff admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:00.573996 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 730/1449] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:00 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:00.599177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfe1dd-227b-4c90-8a39-4cbe6073f9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:00.602787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfe1dd-227b-4c90-8a39-4cbe6073f9b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:00.605539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfe1dd-227b-4c90-8a39-4cbe6073f9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:00.608018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dfe1dd-227b-4c90-8a39-4cbe6073f9b2 admin admin] PATH_INFO: `/v3/projects/9af307e5e89c4099972981e29e3332ee/users/0576ba8fa0f84772a3fc1c22d58b72e1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:00.629889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd42058-da8b-44f9-ba8e-3bf3a3e24ef8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:00.631479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9cd42058-da8b-44f9-ba8e-3bf3a3e24ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:00.654781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd42058-da8b-44f9-ba8e-3bf3a3e24ef8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:00.661014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:00.661997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:00.662447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:00.663137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] PATH_INFO: `/v3/users/678a66668f2f45989ae7b53f1254686b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:00.663503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfe1dd-227b-4c90-8a39-4cbe6073f9b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9af307e5e89c4099972981e29e3332ee, user_id=0576ba8fa0f84772a3fc1c22d58b72e1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:00.665020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=678a66668f2f45989ae7b53f1254686b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:00.668330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:00.672355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dfe1dd-227b-4c90-8a39-4cbe6073f9b2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:00.706815 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 720/1450] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:00 2022] PUT /identity/v3/projects/9af307e5e89c4099972981e29e3332ee/users/0576ba8fa0f84772a3fc1c22d58b72e1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:00.706815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfe1dd-227b-4c90-8a39-4cbe6073f9b2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:00.800811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '678a66668f2f45989ae7b53f1254686b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:00.836817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '678a66668f2f45989ae7b53f1254686b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:00.837765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '678a66668f2f45989ae7b53f1254686b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:00.852525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '678a66668f2f45989ae7b53f1254686b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:00.858444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dfe1dd-227b-4c90-8a39-4cbe6073f9b2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:00.869715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820323e-9e9b-4ca9-b620-5e70149be316 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:00.870768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820323e-9e9b-4ca9-b620-5e70149be316 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:00.871553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820323e-9e9b-4ca9-b620-5e70149be316 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:00.872533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820323e-9e9b-4ca9-b620-5e70149be316 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:00.872713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc0a2313-f208-4e63-962a-519bf48958a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '678a66668f2f45989ae7b53f1254686b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:00.876242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f820323e-9e9b-4ca9-b620-5e70149be316 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:00.888667 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 731/1451] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:00 2022] DELETE /identity/v3/users/678a66668f2f45989ae7b53f1254686b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:00.893013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44991df-86bf-473f-a850-0d1c82296f2a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:00.893272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44991df-86bf-473f-a850-0d1c82296f2a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:00.893715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44991df-86bf-473f-a850-0d1c82296f2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:00.968847 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:00.978330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d44991df-86bf-473f-a850-0d1c82296f2a None None] MFA Rules not processed for user `0576ba8fa0f84772a3fc1c22d58b72e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:00.981508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d44991df-86bf-473f-a850-0d1c82296f2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:01.054812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820323e-9e9b-4ca9-b620-5e70149be316 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:01.056634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820323e-9e9b-4ca9-b620-5e70149be316 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:01.083457 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 721/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:00 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:01.085215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78374d-8b6b-425b-b997-7a640ae78238 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:01.085574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78374d-8b6b-425b-b997-7a640ae78238 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:01.085862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78374d-8b6b-425b-b997-7a640ae78238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:01.125098 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 732/1453] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:01.126764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc2e42-37d9-4e54-886a-a4807564f841 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:01.127193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc2e42-37d9-4e54-886a-a4807564f841 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:01.127799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dc2e42-37d9-4e54-886a-a4807564f841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:01.139504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fb78374d-8b6b-425b-b997-7a640ae78238 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:01.141122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb78374d-8b6b-425b-b997-7a640ae78238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:01.158950 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:01.187463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-50dc2e42-37d9-4e54-886a-a4807564f841 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:01.191065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-50dc2e42-37d9-4e54-886a-a4807564f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:01.333587 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 722/1454] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:01.333587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78374d-8b6b-425b-b997-7a640ae78238 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:01.338754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb78374d-8b6b-425b-b997-7a640ae78238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:01.374322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78374d-8b6b-425b-b997-7a640ae78238 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:01.384752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5f114-f74a-4e58-8dda-f3e8b3f6eaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:01.385420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5f114-f74a-4e58-8dda-f3e8b3f6eaf4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:01.385705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5f114-f74a-4e58-8dda-f3e8b3f6eaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:01.385989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f5f114-f74a-4e58-8dda-f3e8b3f6eaf4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:01.386700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5f114-f74a-4e58-8dda-f3e8b3f6eaf4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:01.389209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f5f114-f74a-4e58-8dda-f3e8b3f6eaf4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:01.393552 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 733/1455] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Oct 24 08:51:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:01.394495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc2e42-37d9-4e54-886a-a4807564f841 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:01.404039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-50dc2e42-37d9-4e54-886a-a4807564f841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:01.445519 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 723/1456] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:01 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:01.448192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5f114-f74a-4e58-8dda-f3e8b3f6eaf4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:01.451218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-93f5f114-f74a-4e58-8dda-f3e8b3f6eaf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:01.603437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f5f114-f74a-4e58-8dda-f3e8b3f6eaf4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:01.614569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e066cb-98d8-4f0f-94e2-1e4f8835f921 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:01.617838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e066cb-98d8-4f0f-94e2-1e4f8835f921 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:01.619074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e066cb-98d8-4f0f-94e2-1e4f8835f921 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:01.619526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e066cb-98d8-4f0f-94e2-1e4f8835f921 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:01.648459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dc2e42-37d9-4e54-886a-a4807564f841 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:01.722498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e066cb-98d8-4f0f-94e2-1e4f8835f921 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:01.725751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e066cb-98d8-4f0f-94e2-1e4f8835f921 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:01.751057 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 724/1457] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:01.753019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e066cb-98d8-4f0f-94e2-1e4f8835f921 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:01.765861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e066cb-98d8-4f0f-94e2-1e4f8835f921 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:01.772424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0f6e4-f7d2-4b7d-acd7-38cf343ddd53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:01.774093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f6e4-f7d2-4b7d-acd7-38cf343ddd53 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:01.774570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f6e4-f7d2-4b7d-acd7-38cf343ddd53 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:01.774955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c0f6e4-f7d2-4b7d-acd7-38cf343ddd53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:01.786896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0f6e4-f7d2-4b7d-acd7-38cf343ddd53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:01.788987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c0f6e4-f7d2-4b7d-acd7-38cf343ddd53 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:01.797582 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:01.801351 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 725/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:01.802633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0f6e4-f7d2-4b7d-acd7-38cf343ddd53 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:01.824430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c0f6e4-f7d2-4b7d-acd7-38cf343ddd53 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:01.830784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4b2ba-7637-42d4-aaab-3f414cf04319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:01.831478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4b2ba-7637-42d4-aaab-3f414cf04319 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:01.831938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4b2ba-7637-42d4-aaab-3f414cf04319 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:01.832207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a4b2ba-7637-42d4-aaab-3f414cf04319 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:01.832820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fe159-488d-4800-83c0-09b9ca429abd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:01.832955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4b2ba-7637-42d4-aaab-3f414cf04319 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:01.834693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fe159-488d-4800-83c0-09b9ca429abd service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:01.835628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fe159-488d-4800-83c0-09b9ca429abd service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:01.836053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594fe159-488d-4800-83c0-09b9ca429abd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:01.836373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a4b2ba-7637-42d4-aaab-3f414cf04319 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:01.839396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-594fe159-488d-4800-83c0-09b9ca429abd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:01.932663 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 726/1459] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:01 2022] POST /identity/v3/users => generated 302 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:01.933792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4b2ba-7637-42d4-aaab-3f414cf04319 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:01.977569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a4b2ba-7637-42d4-aaab-3f414cf04319 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:02.006613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf36360-9545-4821-891a-ef3bf4f13d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:02.008748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf36360-9545-4821-891a-ef3bf4f13d3c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:02.009041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf36360-9545-4821-891a-ef3bf4f13d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:02.009335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf36360-9545-4821-891a-ef3bf4f13d3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:02.011387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf36360-9545-4821-891a-ef3bf4f13d3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:02.014246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf36360-9545-4821-891a-ef3bf4f13d3c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:02.032241 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 727/1460] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:02.036005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf36360-9545-4821-891a-ef3bf4f13d3c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:02.042986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fe159-488d-4800-83c0-09b9ca429abd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:02.045222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594fe159-488d-4800-83c0-09b9ca429abd service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:02.076581 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:02.077345 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 734/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:01 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:02.093068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf36360-9545-4821-891a-ef3bf4f13d3c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:02.109232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4817fa2-5e12-4a82-8a2a-1a9018018fc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:02.112041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817fa2-5e12-4a82-8a2a-1a9018018fc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:02.112626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817fa2-5e12-4a82-8a2a-1a9018018fc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:02.113321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4817fa2-5e12-4a82-8a2a-1a9018018fc7 admin admin] PATH_INFO: `/v3/projects/4012127f640f456090be0534b28f66c6/users/7896f2a16d884bfcb61c9c1073bef780/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:02.159043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4817fa2-5e12-4a82-8a2a-1a9018018fc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4012127f640f456090be0534b28f66c6, user_id=7896f2a16d884bfcb61c9c1073bef780, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:02.166236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4817fa2-5e12-4a82-8a2a-1a9018018fc7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:02.202368 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 728/1462] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:02 2022] PUT /identity/v3/projects/4012127f640f456090be0534b28f66c6/users/7896f2a16d884bfcb61c9c1073bef780/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:02.203871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fe159-488d-4800-83c0-09b9ca429abd service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:02.234855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594fe159-488d-4800-83c0-09b9ca429abd service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:02.370659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145d59e-169f-4ca5-9102-925b8622b693 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:02.371093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145d59e-169f-4ca5-9102-925b8622b693 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:02.371493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9145d59e-169f-4ca5-9102-925b8622b693 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:02.373468 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 729/1463] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:51:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:02.403510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51504c-02b8-4c38-ae66-652f304a01a3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:02.403800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51504c-02b8-4c38-ae66-652f304a01a3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:02.404183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab51504c-02b8-4c38-ae66-652f304a01a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:02.418519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fef57-0669-415d-8534-a3dc08f85538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:02.419154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fef57-0669-415d-8534-a3dc08f85538 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:02.419523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fef57-0669-415d-8534-a3dc08f85538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:02.419785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fef57-0669-415d-8534-a3dc08f85538 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:02.420514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fef57-0669-415d-8534-a3dc08f85538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:02.422245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fef57-0669-415d-8534-a3dc08f85538 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:02.445666 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 735/1464] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:02 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:51:02.448709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ab51504c-02b8-4c38-ae66-652f304a01a3 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:02.449344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fef57-0669-415d-8534-a3dc08f85538 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:02.450438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab51504c-02b8-4c38-ae66-652f304a01a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:02.468417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fef57-0669-415d-8534-a3dc08f85538 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:02.473880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37900f75-e6ef-40ec-bb21-5059f5ed0351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:02.474748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37900f75-e6ef-40ec-bb21-5059f5ed0351 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:02.474993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37900f75-e6ef-40ec-bb21-5059f5ed0351 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:02.475266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37900f75-e6ef-40ec-bb21-5059f5ed0351 admin admin] PATH_INFO: `/v3/projects/4012127f640f456090be0534b28f66c6/users/7896f2a16d884bfcb61c9c1073bef780/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:02.479556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37900f75-e6ef-40ec-bb21-5059f5ed0351 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4012127f640f456090be0534b28f66c6, user_id=7896f2a16d884bfcb61c9c1073bef780, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:02.482768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37900f75-e6ef-40ec-bb21-5059f5ed0351 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:02.518938 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 736/1465] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:02 2022] PUT /identity/v3/projects/4012127f640f456090be0534b28f66c6/users/7896f2a16d884bfcb61c9c1073bef780/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:02.520393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37900f75-e6ef-40ec-bb21-5059f5ed0351 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:02.523427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37900f75-e6ef-40ec-bb21-5059f5ed0351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:02.615360 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 730/1466] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:51:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:02.617614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82751-26e9-4b18-a73c-e24d46645d35 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:02.618374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82751-26e9-4b18-a73c-e24d46645d35 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:02.619483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc82751-26e9-4b18-a73c-e24d46645d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:02.662366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37900f75-e6ef-40ec-bb21-5059f5ed0351 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:02.666334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9cc82751-26e9-4b18-a73c-e24d46645d35 None None] MFA Rules not processed for user `7896f2a16d884bfcb61c9c1073bef780`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:02.667702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9cc82751-26e9-4b18-a73c-e24d46645d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:02.673671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:02.676636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:02.677263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:02.677731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] PATH_INFO: `/v3/users/b945314dc73b4bd2a5b29cbfccd55ef7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:02.679797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b945314dc73b4bd2a5b29cbfccd55ef7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:02.683493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:02.706741 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:02.786196 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 731/1467] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:02 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:02.787560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc82751-26e9-4b18-a73c-e24d46645d35 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:02.803569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b945314dc73b4bd2a5b29cbfccd55ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:02.839993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b945314dc73b4bd2a5b29cbfccd55ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:02.843580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b945314dc73b4bd2a5b29cbfccd55ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:02.873194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b945314dc73b4bd2a5b29cbfccd55ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:02.888553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b945314dc73b4bd2a5b29cbfccd55ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:02.889341 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:02.909106 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 737/1468] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:02 2022] DELETE /identity/v3/users/b945314dc73b4bd2a5b29cbfccd55ef7 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:02.910027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:02.917345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:02.927523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc82751-26e9-4b18-a73c-e24d46645d35 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:03.050676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5ffc37-55cb-4a59-99b3-7c8a56df144d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:03.051358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ffc37-55cb-4a59-99b3-7c8a56df144d service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:03.051919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ffc37-55cb-4a59-99b3-7c8a56df144d service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:03.055407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5ffc37-55cb-4a59-99b3-7c8a56df144d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:03.060688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e5ffc37-55cb-4a59-99b3-7c8a56df144d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:03.102338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ffc37-55cb-4a59-99b3-7c8a56df144d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:03.104021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5ffc37-55cb-4a59-99b3-7c8a56df144d service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:03.140315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9200f2d-189f-4153-9f22-e8a30bb1a6fb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:03.159279 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 732/1469] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:03.164210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a02ce-df8d-4e24-9f2e-adfff6de2862 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:03.164481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a02ce-df8d-4e24-9f2e-adfff6de2862 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:03.164806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3a02ce-df8d-4e24-9f2e-adfff6de2862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:03.175708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0d6f55-04f9-4b13-99af-84b88ff5e42c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:03.176372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d6f55-04f9-4b13-99af-84b88ff5e42c service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:03.177505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d6f55-04f9-4b13-99af-84b88ff5e42c service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:03.177788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0d6f55-04f9-4b13-99af-84b88ff5e42c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:03.183203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5b0d6f55-04f9-4b13-99af-84b88ff5e42c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:03.243629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7a3a02ce-df8d-4e24-9f2e-adfff6de2862 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:03.247509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a3a02ce-df8d-4e24-9f2e-adfff6de2862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:03.379846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d6f55-04f9-4b13-99af-84b88ff5e42c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:03.382261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0d6f55-04f9-4b13-99af-84b88ff5e42c service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:03.405696 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 733/1470] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:03.410282 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 738/1471] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:02 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:03.440497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a02ce-df8d-4e24-9f2e-adfff6de2862 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:03.442625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a3a02ce-df8d-4e24-9f2e-adfff6de2862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:03.596096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3a02ce-df8d-4e24-9f2e-adfff6de2862 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:03.604787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7eef74-dea5-4c4b-91fa-88146f91fd1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:03.606170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eef74-dea5-4c4b-91fa-88146f91fd1a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:03.606728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eef74-dea5-4c4b-91fa-88146f91fd1a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:03.607260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7eef74-dea5-4c4b-91fa-88146f91fd1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:03.634580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eef74-dea5-4c4b-91fa-88146f91fd1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:03.640596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7eef74-dea5-4c4b-91fa-88146f91fd1a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:03.662607 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 734/1472] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:04.296082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a956-9019-46dd-98fc-5c1ce4e11b08 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:04.297008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a956-9019-46dd-98fc-5c1ce4e11b08 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:04.297008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb10a956-9019-46dd-98fc-5c1ce4e11b08 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:04.298518 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 739/1473] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:04.331268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62e96c-de0c-4488-a758-53cc86fcc92a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:04.332266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62e96c-de0c-4488-a758-53cc86fcc92a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:04.332266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62e96c-de0c-4488-a758-53cc86fcc92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:04.381133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5f62e96c-de0c-4488-a758-53cc86fcc92a None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:04.382941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5f62e96c-de0c-4488-a758-53cc86fcc92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:04.404744 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 735/1474] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:51:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:04.494252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10a956-9019-46dd-98fc-5c1ce4e11b08 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:04.496042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cb10a956-9019-46dd-98fc-5c1ce4e11b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:04.535808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb10a956-9019-46dd-98fc-5c1ce4e11b08 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:04.548140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:04.548794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:04.549074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:04.549543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] PATH_INFO: `/v3/projects/6138e94ecf2a46ea84c5348af3c7e628` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:04.565391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6138e94ecf2a46ea84c5348af3c7e628)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:04.565391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:04.598177 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:04.636149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62e96c-de0c-4488-a758-53cc86fcc92a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:04.640295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5f62e96c-de0c-4488-a758-53cc86fcc92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:04.658611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62e96c-de0c-4488-a758-53cc86fcc92a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:04.699563 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:04.744485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6138e94ecf2a46ea84c5348af3c7e628', 'request_id': 'req-07ae495b-ecb7-4270-8320-88fd337bf5e5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:04.762113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6138e94ecf2a46ea84c5348af3c7e628', 'request_id': 'req-07ae495b-ecb7-4270-8320-88fd337bf5e5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:04.773278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6138e94ecf2a46ea84c5348af3c7e628', 'request_id': 'req-07ae495b-ecb7-4270-8320-88fd337bf5e5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:04.808485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:04.809874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:04.810460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] The token cache is being invalidate because project 6138e94ecf2a46ea84c5348af3c7e628 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:04.810754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:04.810982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:04.811474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:04.812669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:04.814448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:04.816192 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 740/1475] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:04 2022] DELETE /identity/v3/projects/6138e94ecf2a46ea84c5348af3c7e628 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:04.820169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:04.822513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:04.850182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:04.852474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:04.893405 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 736/1476] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:04.894542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:04.900083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:05.051247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a024efb8-ea3f-4f2f-8e0a-3e6d53f7e222 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:05.062877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:05.064638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:05.065090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:05.065555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] PATH_INFO: `/v3/users/96fc891a98794418ab50f903358f1ef2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:05.067412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] RBAC: Authorizing `identity:delete_user(user_id=96fc891a98794418ab50f903358f1ef2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:05.070109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:05.070948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ae495b-ecb7-4270-8320-88fd337bf5e5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:05.077620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:05.079466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:05.079466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:05.079466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] PATH_INFO: `/v3/users/0576ba8fa0f84772a3fc1c22d58b72e1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:05.080965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0576ba8fa0f84772a3fc1c22d58b72e1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:05.083711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:05.185895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0576ba8fa0f84772a3fc1c22d58b72e1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.188882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '96fc891a98794418ab50f903358f1ef2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.214812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '96fc891a98794418ab50f903358f1ef2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.215722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '96fc891a98794418ab50f903358f1ef2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.216789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0576ba8fa0f84772a3fc1c22d58b72e1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.217600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0576ba8fa0f84772a3fc1c22d58b72e1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.226799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '96fc891a98794418ab50f903358f1ef2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.237934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0576ba8fa0f84772a3fc1c22d58b72e1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.241532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b5e546fe-0609-4394-ba54-b8fced35e281 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '96fc891a98794418ab50f903358f1ef2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.252597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0576ba8fa0f84772a3fc1c22d58b72e1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.257535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 737/1477] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:04 2022] DELETE /identity/v3/users/96fc891a98794418ab50f903358f1ef2 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:05.271020 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 741/1478] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:04 2022] DELETE /identity/v3/users/0576ba8fa0f84772a3fc1c22d58b72e1 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:05.276836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0e233-0f8c-4c67-85a2-fbc0ed976fd3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:05.277451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0e233-0f8c-4c67-85a2-fbc0ed976fd3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:05.277820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0e233-0f8c-4c67-85a2-fbc0ed976fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:05.358672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-77f0e233-0f8c-4c67-85a2-fbc0ed976fd3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:05.363661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-77f0e233-0f8c-4c67-85a2-fbc0ed976fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:05.417153 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:05.477886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:05.482823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:05.530933 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 738/1479] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:05.543364 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:05.594635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0e233-0f8c-4c67-85a2-fbc0ed976fd3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:05.596169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-77f0e233-0f8c-4c67-85a2-fbc0ed976fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:05.628654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ede74-6091-4deb-8ff1-0d294632e4c2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:05.635976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:05.636828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:05.637218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:05.637694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] PATH_INFO: `/v3/projects/b5dfa9d66ac747138d412e0f39f59ab6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:05.655470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dfa9d66ac747138d412e0f39f59ab6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:05.661887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:05.787798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dfa9d66ac747138d412e0f39f59ab6', 'request_id': 'req-c0455679-c863-4427-ba1b-2260ebe705f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.801430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dfa9d66ac747138d412e0f39f59ab6', 'request_id': 'req-c0455679-c863-4427-ba1b-2260ebe705f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.814389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dfa9d66ac747138d412e0f39f59ab6', 'request_id': 'req-c0455679-c863-4427-ba1b-2260ebe705f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.823617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0e233-0f8c-4c67-85a2-fbc0ed976fd3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:05.840366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] The token cache is being invalidate because project b5dfa9d66ac747138d412e0f39f59ab6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:05.842827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.845195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:05.855846 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 742/1480] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:05 2022] DELETE /identity/v3/projects/b5dfa9d66ac747138d412e0f39f59ab6 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:05.858895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:05.863454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:06.011507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:06.012450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:06.012897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:06.013366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:06.015740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:06.064662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0455679-c863-4427-ba1b-2260ebe705f8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:06.074309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:06.075184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:06.076218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:06.076556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] PATH_INFO: `/v3/users/4b7e283469f54398957ef3c261ebf9fa` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:06.078156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b7e283469f54398957ef3c261ebf9fa)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:06.082861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:06.190264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:06.192228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:06.194895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b7e283469f54398957ef3c261ebf9fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.204923 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:06.223051 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 739/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:06.238437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b7e283469f54398957ef3c261ebf9fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.240310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b7e283469f54398957ef3c261ebf9fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.259059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b7e283469f54398957ef3c261ebf9fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.283219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4e2aff52-05bb-4079-905e-35bc689c12d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b7e283469f54398957ef3c261ebf9fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.311200 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 743/1482] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:05 2022] DELETE /identity/v3/users/4b7e283469f54398957ef3c261ebf9fa => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:06.357692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:06.359461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:06.382209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180bd2c4-2955-45df-88ce-951641992a1c service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:06.446443 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:06.559360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:06.560619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:06.561253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:06.561885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] PATH_INFO: `/v3/projects/c839095903074c5993d256787c192121` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:06.568336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c839095903074c5993d256787c192121)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:06.572255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:06.689762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c839095903074c5993d256787c192121', 'request_id': 'req-c1be8bab-d9f8-4877-bca8-638838f45a21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.707419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c839095903074c5993d256787c192121', 'request_id': 'req-c1be8bab-d9f8-4877-bca8-638838f45a21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.732547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c839095903074c5993d256787c192121', 'request_id': 'req-c1be8bab-d9f8-4877-bca8-638838f45a21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.765453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] The token cache is being invalidate because project c839095903074c5993d256787c192121 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:06.765888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.769034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:06.777187 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 740/1483] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:06 2022] DELETE /identity/v3/projects/c839095903074c5993d256787c192121 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:06.781116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccfd41-2084-4345-9772-d09ba9032984 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:06.782284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccfd41-2084-4345-9772-d09ba9032984 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:06.782284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ccfd41-2084-4345-9772-d09ba9032984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:06.822254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-37ccfd41-2084-4345-9772-d09ba9032984 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:06.823849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37ccfd41-2084-4345-9772-d09ba9032984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:06.989603 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 744/1484] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:06.989867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:06.989867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:06.991687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41260a74-b770-4abe-a7d0-4328f2161a61 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:06.991966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41260a74-b770-4abe-a7d0-4328f2161a61 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:06.992290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41260a74-b770-4abe-a7d0-4328f2161a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:07.018145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1be8bab-d9f8-4877-bca8-638838f45a21 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:07.027958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-41260a74-b770-4abe-a7d0-4328f2161a61 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:07.029763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-41260a74-b770-4abe-a7d0-4328f2161a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:07.044828 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 745/1485] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:07.047760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:07.048868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41260a74-b770-4abe-a7d0-4328f2161a61 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:07.049911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:07.050990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:07.051873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] PATH_INFO: `/v3/projects/9869c04401ed46e186ea0c8b6a20dc2a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:07.056928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9869c04401ed46e186ea0c8b6a20dc2a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:07.061962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:07.081479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41260a74-b770-4abe-a7d0-4328f2161a61 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:07.126252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e533f-a48b-4f70-ba67-425bb169482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:07.136173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e533f-a48b-4f70-ba67-425bb169482e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:07.140582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e533f-a48b-4f70-ba67-425bb169482e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:07.140582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e533f-a48b-4f70-ba67-425bb169482e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:07.143742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e533f-a48b-4f70-ba67-425bb169482e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:07.144064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e533f-a48b-4f70-ba67-425bb169482e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:07.159243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e533f-a48b-4f70-ba67-425bb169482e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:07.220494 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 746/1486] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:51:07.224435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e533f-a48b-4f70-ba67-425bb169482e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:07.258829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e533f-a48b-4f70-ba67-425bb169482e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:07.289432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9869c04401ed46e186ea0c8b6a20dc2a', 'request_id': 'req-702b862b-1c12-4976-97d0-31ee6556acb9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:07.318679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9869c04401ed46e186ea0c8b6a20dc2a', 'request_id': 'req-702b862b-1c12-4976-97d0-31ee6556acb9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:07.339384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9869c04401ed46e186ea0c8b6a20dc2a', 'request_id': 'req-702b862b-1c12-4976-97d0-31ee6556acb9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:07.385329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] The token cache is being invalidate because project 9869c04401ed46e186ea0c8b6a20dc2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:07.386732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:07.391550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-702b862b-1c12-4976-97d0-31ee6556acb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:07.393958 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 741/1487] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:06 2022] DELETE /identity/v3/projects/9869c04401ed46e186ea0c8b6a20dc2a => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:07.399026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e0294-f215-493d-ab82-6c15e9017ef8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:07.399716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e0294-f215-493d-ab82-6c15e9017ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:07.400196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583e0294-f215-493d-ab82-6c15e9017ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:07.466459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-583e0294-f215-493d-ab82-6c15e9017ef8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:07.468178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-583e0294-f215-493d-ab82-6c15e9017ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:07.568005 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:07.577366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb0971-e5e0-4b9e-b3c6-54f0ac5359ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:07.580800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0971-e5e0-4b9e-b3c6-54f0ac5359ae admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:07.581241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0971-e5e0-4b9e-b3c6-54f0ac5359ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:07.581677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feb0971-e5e0-4b9e-b3c6-54f0ac5359ae admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:07.599473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb0971-e5e0-4b9e-b3c6-54f0ac5359ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:07.606877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feb0971-e5e0-4b9e-b3c6-54f0ac5359ae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:07.644918 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 742/1488] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:07.652611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6b275-ffcc-4131-998c-8cd7e8149bcb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:07.653251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6b275-ffcc-4131-998c-8cd7e8149bcb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:07.653874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6b275-ffcc-4131-998c-8cd7e8149bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:07.691456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-74d6b275-ffcc-4131-998c-8cd7e8149bcb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:07.693821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-74d6b275-ffcc-4131-998c-8cd7e8149bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:07.709216 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 743/1489] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:07.710726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6b275-ffcc-4131-998c-8cd7e8149bcb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:07.711458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 747/1490] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:07 2022] POST /identity/v3/projects => generated 385 bytes in 488 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:07.714126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb0971-e5e0-4b9e-b3c6-54f0ac5359ae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:07.717400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-74d6b275-ffcc-4131-998c-8cd7e8149bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:07.760453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6b275-ffcc-4131-998c-8cd7e8149bcb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:07.835117 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:07.888195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feb0971-e5e0-4b9e-b3c6-54f0ac5359ae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:07.900047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:07.900765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:07.901077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:07.901382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:07.902042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:07.902370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:07.904926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:07.934566 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 748/1491] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:07.936350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:07.938404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:07.959347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2321356-366a-4695-b8ad-e85bcbf1077a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:07.969999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b7ad7-8b8e-429a-863d-ff4066623bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:07.971758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b7ad7-8b8e-429a-863d-ff4066623bb2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:07.972750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b7ad7-8b8e-429a-863d-ff4066623bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:07.974480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1b7ad7-8b8e-429a-863d-ff4066623bb2 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:07.976834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b7ad7-8b8e-429a-863d-ff4066623bb2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:07.981024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1b7ad7-8b8e-429a-863d-ff4066623bb2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:07.985371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:07.985941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:07.986216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:07.989354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] PATH_INFO: `/v3/projects/9af307e5e89c4099972981e29e3332ee` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:08.002901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9af307e5e89c4099972981e29e3332ee)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:08.004843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:08.039513 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 744/1492] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:07 2022] POST /identity/v3/users => generated 293 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:08.043691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b7ad7-8b8e-429a-863d-ff4066623bb2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:08.067260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1b7ad7-8b8e-429a-863d-ff4066623bb2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:08.079840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a506a6-6e04-4832-bc66-96fed334c80a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:08.080899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a506a6-6e04-4832-bc66-96fed334c80a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:08.081407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a506a6-6e04-4832-bc66-96fed334c80a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:08.081741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a506a6-6e04-4832-bc66-96fed334c80a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:08.082494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a506a6-6e04-4832-bc66-96fed334c80a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:08.088904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a506a6-6e04-4832-bc66-96fed334c80a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:08.146866 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 745/1493] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:08 2022] POST /identity/v3/projects => generated 361 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:08.148163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a506a6-6e04-4832-bc66-96fed334c80a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:08.159040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9af307e5e89c4099972981e29e3332ee', 'request_id': 'req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.200248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9af307e5e89c4099972981e29e3332ee', 'request_id': 'req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.215625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9af307e5e89c4099972981e29e3332ee', 'request_id': 'req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.244437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] The token cache is being invalidate because project 9af307e5e89c4099972981e29e3332ee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:08.247275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.249031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.251131 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 749/1494] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:07 2022] DELETE /identity/v3/projects/9af307e5e89c4099972981e29e3332ee => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:08.254965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:08.261456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:08.388727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a506a6-6e04-4832-bc66-96fed334c80a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:08.409737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a67733-5550-4d08-8aa5-e4b2fa2fad52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:08.410677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a67733-5550-4d08-8aa5-e4b2fa2fad52 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:08.411148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a67733-5550-4d08-8aa5-e4b2fa2fad52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:08.411631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a67733-5550-4d08-8aa5-e4b2fa2fad52 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:08.412447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a67733-5550-4d08-8aa5-e4b2fa2fad52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:08.414977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a67733-5550-4d08-8aa5-e4b2fa2fad52 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:08.449816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8e8238-f07c-4a8e-9e30-5e09e1294ff2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:08.453581 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 746/1495] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:08.454638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a67733-5550-4d08-8aa5-e4b2fa2fad52 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:08.456594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-62a67733-5550-4d08-8aa5-e4b2fa2fad52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:08.458391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87125777-580b-4dff-ba3a-96e5bc26ab85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:08.459441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87125777-580b-4dff-ba3a-96e5bc26ab85 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:08.459831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87125777-580b-4dff-ba3a-96e5bc26ab85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:08.460284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87125777-580b-4dff-ba3a-96e5bc26ab85 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:08.461432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87125777-580b-4dff-ba3a-96e5bc26ab85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:08.468561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87125777-580b-4dff-ba3a-96e5bc26ab85 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:08.488786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a67733-5550-4d08-8aa5-e4b2fa2fad52 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:08.501938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:08.502704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:08.503074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:08.503423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] PATH_INFO: `/v3/users/7896f2a16d884bfcb61c9c1073bef780` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:08.505040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7896f2a16d884bfcb61c9c1073bef780)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:08.507936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:08.534662 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 750/1496] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:08 2022] POST /identity/v3/users => generated 281 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:08.534662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87125777-580b-4dff-ba3a-96e5bc26ab85 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:08.540081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-87125777-580b-4dff-ba3a-96e5bc26ab85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:08.563603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87125777-580b-4dff-ba3a-96e5bc26ab85 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:08.583039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86685a0f-9ed9-406a-a4a6-8a1012174a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:08.585378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685a0f-9ed9-406a-a4a6-8a1012174a79 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:08.585378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685a0f-9ed9-406a-a4a6-8a1012174a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:08.585378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86685a0f-9ed9-406a-a4a6-8a1012174a79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:08.588667 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:08.590463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685a0f-9ed9-406a-a4a6-8a1012174a79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:08.603833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86685a0f-9ed9-406a-a4a6-8a1012174a79 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:08.620017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7896f2a16d884bfcb61c9c1073bef780'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.633284 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 751/1497] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:08.634636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86685a0f-9ed9-406a-a4a6-8a1012174a79 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:08.665835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86685a0f-9ed9-406a-a4a6-8a1012174a79 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:08.667476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7896f2a16d884bfcb61c9c1073bef780'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.673792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7896f2a16d884bfcb61c9c1073bef780'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.685326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a8f42-7f62-418d-bb8f-50252f5163b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:08.686489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a8f42-7f62-418d-bb8f-50252f5163b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:08.687079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a8f42-7f62-418d-bb8f-50252f5163b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:08.687636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077a8f42-7f62-418d-bb8f-50252f5163b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:08.688619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a8f42-7f62-418d-bb8f-50252f5163b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:08.689057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7896f2a16d884bfcb61c9c1073bef780'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.690754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077a8f42-7f62-418d-bb8f-50252f5163b8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:08.704700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7896f2a16d884bfcb61c9c1073bef780'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:08.715020 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 752/1498] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:08.716280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a8f42-7f62-418d-bb8f-50252f5163b8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:08.722164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-077a8f42-7f62-418d-bb8f-50252f5163b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:08.725567 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 747/1499] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:08 2022] DELETE /identity/v3/users/7896f2a16d884bfcb61c9c1073bef780 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:08.727099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:08.729116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:08.744811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077a8f42-7f62-418d-bb8f-50252f5163b8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:08.791696 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:08.892746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67da5a75-53d9-4cb0-bfc1-e7661b9d6cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:08.893637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5a75-53d9-4cb0-bfc1-e7661b9d6cbb admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:08.893979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5a75-53d9-4cb0-bfc1-e7661b9d6cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:08.894315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67da5a75-53d9-4cb0-bfc1-e7661b9d6cbb admin admin] PATH_INFO: `/v3/projects/ff96b32188664909a077a329c33f8ccc/users/64b71302b9104e5faf7da8bf3a26c48d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:08.924632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5a75-53d9-4cb0-bfc1-e7661b9d6cbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff96b32188664909a077a329c33f8ccc, user_id=64b71302b9104e5faf7da8bf3a26c48d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:08.928185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5b8d37-d867-4d3f-999a-07670afa3ef7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:08.932218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67da5a75-53d9-4cb0-bfc1-e7661b9d6cbb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:08.954770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a735917-85ff-462c-b291-3a099818915c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:08.955519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735917-85ff-462c-b291-3a099818915c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:08.955802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735917-85ff-462c-b291-3a099818915c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:08.956082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a735917-85ff-462c-b291-3a099818915c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:08.957615 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 753/1500] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:08 2022] PUT /identity/v3/projects/ff96b32188664909a077a329c33f8ccc/users/64b71302b9104e5faf7da8bf3a26c48d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:08.970574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a735917-85ff-462c-b291-3a099818915c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:08.972236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a735917-85ff-462c-b291-3a099818915c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:08.974500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc17e8-52a4-48d5-a828-41e081c09b09 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:08.974890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc17e8-52a4-48d5-a828-41e081c09b09 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:08.975269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbc17e8-52a4-48d5-a828-41e081c09b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:09.004240 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 748/1501] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:08 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:09.016428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a735917-85ff-462c-b291-3a099818915c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:09.066085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a735917-85ff-462c-b291-3a099818915c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:09.068004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7fbc17e8-52a4-48d5-a828-41e081c09b09 None None] MFA Rules not processed for user `64b71302b9104e5faf7da8bf3a26c48d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:09.069878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7fbc17e8-52a4-48d5-a828-41e081c09b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:09.273934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bd61ec-3901-4537-86b6-90c5d104c792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:09.281936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd61ec-3901-4537-86b6-90c5d104c792 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:09.282235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd61ec-3901-4537-86b6-90c5d104c792 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:09.282520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bd61ec-3901-4537-86b6-90c5d104c792 admin admin] PATH_INFO: `/v3/projects/28fd0cde485c446186e5397176d18faa/users/2aaf9878d1634d699e1b5e17c2cca1e7/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:09.312741 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 754/1502] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:09.314059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc17e8-52a4-48d5-a828-41e081c09b09 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:09.332182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd61ec-3901-4537-86b6-90c5d104c792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28fd0cde485c446186e5397176d18faa, user_id=2aaf9878d1634d699e1b5e17c2cca1e7, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:09.338315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bd61ec-3901-4537-86b6-90c5d104c792 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:09.348797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbc17e8-52a4-48d5-a828-41e081c09b09 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:09.368846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a6e8f-a290-4342-bede-5675bb626eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:09.370085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a6e8f-a290-4342-bede-5675bb626eca admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:09.370840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a6e8f-a290-4342-bede-5675bb626eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:09.371322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a6e8f-a290-4342-bede-5675bb626eca admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:09.372435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a6e8f-a290-4342-bede-5675bb626eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:09.373506 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 749/1503] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:09 2022] PUT /identity/v3/projects/28fd0cde485c446186e5397176d18faa/users/2aaf9878d1634d699e1b5e17c2cca1e7/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:09.374946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a6e8f-a290-4342-bede-5675bb626eca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:09.386471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911acd9c-5015-4cc0-81fc-c89dbc2ee7c5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:09.386967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911acd9c-5015-4cc0-81fc-c89dbc2ee7c5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:09.387826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911acd9c-5015-4cc0-81fc-c89dbc2ee7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:09.447483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 755/1504] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:09 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:09.451598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a6e8f-a290-4342-bede-5675bb626eca admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:09.484342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-911acd9c-5015-4cc0-81fc-c89dbc2ee7c5 None None] MFA Rules not processed for user `2aaf9878d1634d699e1b5e17c2cca1e7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:09.491991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-911acd9c-5015-4cc0-81fc-c89dbc2ee7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:09.563436 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:09.683795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a6e8f-a290-4342-bede-5675bb626eca admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:09.702535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6235c-bb30-4bfe-91c8-8cbfe9f9c76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:09.703173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6235c-bb30-4bfe-91c8-8cbfe9f9c76a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:09.703491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6235c-bb30-4bfe-91c8-8cbfe9f9c76a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:09.703765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f6235c-bb30-4bfe-91c8-8cbfe9f9c76a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:09.704589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6235c-bb30-4bfe-91c8-8cbfe9f9c76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:09.707013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f6235c-bb30-4bfe-91c8-8cbfe9f9c76a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:09.771111 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 750/1505] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:09 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 388 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:09.772984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911acd9c-5015-4cc0-81fc-c89dbc2ee7c5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:09.781191 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 756/1506] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:09 2022] POST /identity/v3/users => generated 300 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:09.782189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6235c-bb30-4bfe-91c8-8cbfe9f9c76a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:09.791239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-911acd9c-5015-4cc0-81fc-c89dbc2ee7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:09.801519 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:09.808969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f6235c-bb30-4bfe-91c8-8cbfe9f9c76a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:09.820022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911acd9c-5015-4cc0-81fc-c89dbc2ee7c5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:09.821858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaf9bc-67db-40bc-a6e0-2defe522421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:09.825077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf9bc-67db-40bc-a6e0-2defe522421f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:09.826205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf9bc-67db-40bc-a6e0-2defe522421f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:09.827294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-addaf9bc-67db-40bc-a6e0-2defe522421f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:09.829321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaf9bc-67db-40bc-a6e0-2defe522421f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:09.829983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:09.831209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:09.831693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:09.832206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] PATH_INFO: `/v3/projects/4012127f640f456090be0534b28f66c6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:09.834120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=4012127f640f456090be0534b28f66c6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:09.834618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-addaf9bc-67db-40bc-a6e0-2defe522421f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:09.837832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:09.912305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4012127f640f456090be0534b28f66c6', 'request_id': 'req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:09.924212 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 757/1507] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:09 2022] POST /identity/v3/projects => generated 361 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:09.924212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaf9bc-67db-40bc-a6e0-2defe522421f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:09.928305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4012127f640f456090be0534b28f66c6', 'request_id': 'req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:09.949011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4012127f640f456090be0534b28f66c6', 'request_id': 'req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:09.981367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] The token cache is being invalidate because project 4012127f640f456090be0534b28f66c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:09.982873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:09.984627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:09.992196 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 751/1508] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:09 2022] DELETE /identity/v3/projects/4012127f640f456090be0534b28f66c6 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:09.992196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:09.994205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:10.137662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-addaf9bc-67db-40bc-a6e0-2defe522421f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:10.154766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612aef60-997f-4044-a0f1-972f1b397cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:10.155826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612aef60-997f-4044-a0f1-972f1b397cd1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.156335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612aef60-997f-4044-a0f1-972f1b397cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.156830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612aef60-997f-4044-a0f1-972f1b397cd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.157709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612aef60-997f-4044-a0f1-972f1b397cd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:10.159644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612aef60-997f-4044-a0f1-972f1b397cd1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:10.174228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f0aff4-aa8a-4788-bfbf-f55e6b13d9cb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:10.182773 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 758/1509] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:09 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:10.184082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65f14-9490-44bf-b9b2-16c645f8446b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.184389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65f14-9490-44bf-b9b2-16c645f8446b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.184797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af65f14-9490-44bf-b9b2-16c645f8446b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.188674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f60e3-380f-4356-939d-39200a08cbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:10.189472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f60e3-380f-4356-939d-39200a08cbc7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.189755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f60e3-380f-4356-939d-39200a08cbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.190089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f60e3-380f-4356-939d-39200a08cbc7 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.190701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f60e3-380f-4356-939d-39200a08cbc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:10.199149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296f60e3-380f-4356-939d-39200a08cbc7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:10.236694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9af65f14-9490-44bf-b9b2-16c645f8446b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:10.237936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9af65f14-9490-44bf-b9b2-16c645f8446b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:10.262488 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 752/1510] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:09 2022] POST /identity/v3/users => generated 287 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:10.264961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f60e3-380f-4356-939d-39200a08cbc7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:10.268935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-296f60e3-380f-4356-939d-39200a08cbc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:10.273673 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 759/1511] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:10.276103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af65f14-9490-44bf-b9b2-16c645f8446b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:10.313274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f60e3-380f-4356-939d-39200a08cbc7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:10.317060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af65f14-9490-44bf-b9b2-16c645f8446b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:10.330390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1b24-a93c-4846-a1a5-c7285191733d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:10.332160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1b24-a93c-4846-a1a5-c7285191733d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.333622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1b24-a93c-4846-a1a5-c7285191733d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.336220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a1b24-a93c-4846-a1a5-c7285191733d admin admin] PATH_INFO: `/v3/projects/358498de8e0d43e186ea0b53271f60e1/users/fa43aad419dc43e7876a3d17d755baba/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.337288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fe97ad-b00e-4bc7-967a-b07fd3d1a1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:10.338186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe97ad-b00e-4bc7-967a-b07fd3d1a1d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.338415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe97ad-b00e-4bc7-967a-b07fd3d1a1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.338669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fe97ad-b00e-4bc7-967a-b07fd3d1a1d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.339445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe97ad-b00e-4bc7-967a-b07fd3d1a1d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:10.341189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fe97ad-b00e-4bc7-967a-b07fd3d1a1d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:10.367371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1b24-a93c-4846-a1a5-c7285191733d admin admin] RBAC: Authorizing `identity:create_grant(project_id=358498de8e0d43e186ea0b53271f60e1, user_id=fa43aad419dc43e7876a3d17d755baba, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:10.371050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a1b24-a93c-4846-a1a5-c7285191733d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:10.406024 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 760/1512] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:10.407589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accad471-8b1a-4dc7-b57f-af7f9a909ec7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.412137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accad471-8b1a-4dc7-b57f-af7f9a909ec7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.412491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accad471-8b1a-4dc7-b57f-af7f9a909ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.445870 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 753/1513] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:10 2022] PUT /identity/v3/projects/358498de8e0d43e186ea0b53271f60e1/users/fa43aad419dc43e7876a3d17d755baba/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:10.450046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1b24-a93c-4846-a1a5-c7285191733d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:10.459188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-accad471-8b1a-4dc7-b57f-af7f9a909ec7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:10.461496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-accad471-8b1a-4dc7-b57f-af7f9a909ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:10.474918 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:10.572811 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 761/1514] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:10.574441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accad471-8b1a-4dc7-b57f-af7f9a909ec7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:10.595419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a1b24-a93c-4846-a1a5-c7285191733d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:10.596549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accad471-8b1a-4dc7-b57f-af7f9a909ec7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:10.604858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2c9f-117c-4823-bbd6-44d54af356f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:10.610216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2c9f-117c-4823-bbd6-44d54af356f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.611138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2c9f-117c-4823-bbd6-44d54af356f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.611995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d360f-9475-4b0f-9ebf-66c42f0cd997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:10.612627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d360f-9475-4b0f-9ebf-66c42f0cd997 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.612909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d360f-9475-4b0f-9ebf-66c42f0cd997 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.613181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649d360f-9475-4b0f-9ebf-66c42f0cd997 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.613915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a2c9f-117c-4823-bbd6-44d54af356f0 admin admin] PATH_INFO: `/v3/projects/4f7c3b79f0464aeb912ed2dc21efa3ba/users/4c39e779f0ef45a887d2b1a78644d443/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.615278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d360f-9475-4b0f-9ebf-66c42f0cd997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:10.620690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649d360f-9475-4b0f-9ebf-66c42f0cd997 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:10.653268 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 762/1515] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:10.654341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d360f-9475-4b0f-9ebf-66c42f0cd997 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:10.659365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a2c9f-117c-4823-bbd6-44d54af356f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7c3b79f0464aeb912ed2dc21efa3ba, user_id=4c39e779f0ef45a887d2b1a78644d443, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:10.664192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a2c9f-117c-4823-bbd6-44d54af356f0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:10.678704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649d360f-9475-4b0f-9ebf-66c42f0cd997 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:10.698784 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 754/1516] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:10 2022] PUT /identity/v3/projects/4f7c3b79f0464aeb912ed2dc21efa3ba/users/4c39e779f0ef45a887d2b1a78644d443/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:10.703431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2c9f-117c-4823-bbd6-44d54af356f0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:10.780976 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:10.809477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b80d1e-263b-4ef6-8423-8208c0bc52c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:10.810796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b80d1e-263b-4ef6-8423-8208c0bc52c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.811092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b80d1e-263b-4ef6-8423-8208c0bc52c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.811372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b80d1e-263b-4ef6-8423-8208c0bc52c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.812039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b80d1e-263b-4ef6-8423-8208c0bc52c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:10.817689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b80d1e-263b-4ef6-8423-8208c0bc52c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:10.821492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b80d1e-263b-4ef6-8423-8208c0bc52c5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:10.855358 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 763/1517] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:10.856440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b80d1e-263b-4ef6-8423-8208c0bc52c5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:10.877723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b80d1e-263b-4ef6-8423-8208c0bc52c5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:10.885586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41521b22-d7c2-4eea-8c4c-e909f8b4aa97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:10.886213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41521b22-d7c2-4eea-8c4c-e909f8b4aa97 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.886556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41521b22-d7c2-4eea-8c4c-e909f8b4aa97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.887204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41521b22-d7c2-4eea-8c4c-e909f8b4aa97 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.887965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41521b22-d7c2-4eea-8c4c-e909f8b4aa97 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:10.891123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a2c9f-117c-4823-bbd6-44d54af356f0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:10.894529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41521b22-d7c2-4eea-8c4c-e909f8b4aa97 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:10.901149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd48d9-a732-4adc-852f-b87fb2cb4e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:10.901910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd48d9-a732-4adc-852f-b87fb2cb4e81 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:10.902255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd48d9-a732-4adc-852f-b87fb2cb4e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:10.902561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dd48d9-a732-4adc-852f-b87fb2cb4e81 admin admin] PATH_INFO: `/v3/projects/358498de8e0d43e186ea0b53271f60e1/users/fa43aad419dc43e7876a3d17d755baba/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:10.909106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd48d9-a732-4adc-852f-b87fb2cb4e81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=358498de8e0d43e186ea0b53271f60e1, user_id=fa43aad419dc43e7876a3d17d755baba, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:10.912125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dd48d9-a732-4adc-852f-b87fb2cb4e81 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:10.921203 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 764/1518] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:10 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:10.925283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41521b22-d7c2-4eea-8c4c-e909f8b4aa97 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:10.952690 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 755/1519] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:10 2022] PUT /identity/v3/projects/358498de8e0d43e186ea0b53271f60e1/users/fa43aad419dc43e7876a3d17d755baba/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:10.955018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd48d9-a732-4adc-852f-b87fb2cb4e81 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:10.963229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41521b22-d7c2-4eea-8c4c-e909f8b4aa97 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.052268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dd48d9-a732-4adc-852f-b87fb2cb4e81 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.061829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382178ac-275f-4b3a-9334-218a7242868e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.062522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382178ac-275f-4b3a-9334-218a7242868e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.062796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382178ac-275f-4b3a-9334-218a7242868e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.063072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382178ac-275f-4b3a-9334-218a7242868e admin admin] PATH_INFO: `/v3/projects/4f7c3b79f0464aeb912ed2dc21efa3ba/users/4c39e779f0ef45a887d2b1a78644d443/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.064725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a2fd47-918a-4764-9621-b6eef624f8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.065125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382178ac-275f-4b3a-9334-218a7242868e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f7c3b79f0464aeb912ed2dc21efa3ba, user_id=4c39e779f0ef45a887d2b1a78644d443, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.065737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2fd47-918a-4764-9621-b6eef624f8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.066181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2fd47-918a-4764-9621-b6eef624f8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.066613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a2fd47-918a-4764-9621-b6eef624f8e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.067450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2fd47-918a-4764-9621-b6eef624f8e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.068392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382178ac-275f-4b3a-9334-218a7242868e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.069941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a2fd47-918a-4764-9621-b6eef624f8e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.083914 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 756/1520] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:10 2022] PUT /identity/v3/projects/4f7c3b79f0464aeb912ed2dc21efa3ba/users/4c39e779f0ef45a887d2b1a78644d443/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:11.085787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e66340-7748-4954-9cb8-ed2d039c8914 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.086229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e66340-7748-4954-9cb8-ed2d039c8914 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.086510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e66340-7748-4954-9cb8-ed2d039c8914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.117598 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 765/1521] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:10 2022] POST /identity/v3/projects => generated 369 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:11.120577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4335b65-b887-42e2-8f16-d0defa40bd95 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.122953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4335b65-b887-42e2-8f16-d0defa40bd95 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.123403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4335b65-b887-42e2-8f16-d0defa40bd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.158657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e4335b65-b887-42e2-8f16-d0defa40bd95 None None] MFA Rules not processed for user `4c39e779f0ef45a887d2b1a78644d443`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:11.159969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4335b65-b887-42e2-8f16-d0defa40bd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:11.160214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-01e66340-7748-4954-9cb8-ed2d039c8914 None None] MFA Rules not processed for user `fa43aad419dc43e7876a3d17d755baba`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:11.161810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01e66340-7748-4954-9cb8-ed2d039c8914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:11.173638 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:11.252718 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 766/1522] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:11 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:11.253549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4335b65-b887-42e2-8f16-d0defa40bd95 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:11.259728 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 757/1523] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:11.264694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e66340-7748-4954-9cb8-ed2d039c8914 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:11.266134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01e66340-7748-4954-9cb8-ed2d039c8914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:11.315259 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:11.335346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4335b65-b887-42e2-8f16-d0defa40bd95 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.340336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80ab70-79b0-4298-86e7-3fc187e5df43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.341111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80ab70-79b0-4298-86e7-3fc187e5df43 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.341407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80ab70-79b0-4298-86e7-3fc187e5df43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.341739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e80ab70-79b0-4298-86e7-3fc187e5df43 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.342448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80ab70-79b0-4298-86e7-3fc187e5df43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.344480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e80ab70-79b0-4298-86e7-3fc187e5df43 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.367480 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 767/1524] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:11 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:11.368422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80ab70-79b0-4298-86e7-3fc187e5df43 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:11.369913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e66340-7748-4954-9cb8-ed2d039c8914 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.370185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1e80ab70-79b0-4298-86e7-3fc187e5df43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:11.375740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f853215-e3aa-4b59-9c54-dca26ee72fd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.376338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f853215-e3aa-4b59-9c54-dca26ee72fd3 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.376617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f853215-e3aa-4b59-9c54-dca26ee72fd3 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.376881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f853215-e3aa-4b59-9c54-dca26ee72fd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.385750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f853215-e3aa-4b59-9c54-dca26ee72fd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.386210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e80ab70-79b0-4298-86e7-3fc187e5df43 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.387433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f853215-e3aa-4b59-9c54-dca26ee72fd3 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.391942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215be3-6e50-4515-af31-6cfb169bf907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.392529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215be3-6e50-4515-af31-6cfb169bf907 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.392854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215be3-6e50-4515-af31-6cfb169bf907 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.393092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4215be3-6e50-4515-af31-6cfb169bf907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.400137 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 758/1525] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:11 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:51:11.401515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f853215-e3aa-4b59-9c54-dca26ee72fd3 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:11.403994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4215be3-6e50-4515-af31-6cfb169bf907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.405843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4215be3-6e50-4515-af31-6cfb169bf907 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.418719 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 768/1526] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:11.421765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f853215-e3aa-4b59-9c54-dca26ee72fd3 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.426560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0c834-217e-4e2a-b87c-19195999fc99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.427226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0c834-217e-4e2a-b87c-19195999fc99 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.427568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0c834-217e-4e2a-b87c-19195999fc99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.428011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0c834-217e-4e2a-b87c-19195999fc99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.429205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0c834-217e-4e2a-b87c-19195999fc99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.430812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0c834-217e-4e2a-b87c-19195999fc99 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.444723 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 759/1527] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:11.449204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215be3-6e50-4515-af31-6cfb169bf907 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:11.471211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4215be3-6e50-4515-af31-6cfb169bf907 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.477150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d9796-6210-4945-9f96-568c749d0cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.477810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d9796-6210-4945-9f96-568c749d0cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.478093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d9796-6210-4945-9f96-568c749d0cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.478377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12d9796-6210-4945-9f96-568c749d0cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.479280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d9796-6210-4945-9f96-568c749d0cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.480616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12d9796-6210-4945-9f96-568c749d0cd9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.492907 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 769/1528] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:11 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:11.497246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0c834-217e-4e2a-b87c-19195999fc99 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:11.508102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0c834-217e-4e2a-b87c-19195999fc99 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.513220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65f7d71-c143-48d9-b78d-6d109718a4ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.513934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7d71-c143-48d9-b78d-6d109718a4ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.514218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7d71-c143-48d9-b78d-6d109718a4ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.514496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65f7d71-c143-48d9-b78d-6d109718a4ba admin admin] PATH_INFO: `/v3/projects/bdb9aeb0656347798749c2b8e4434c56/users/b43a269fe8b746b88c38db6b9e9bfa12/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.520520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d9796-6210-4945-9f96-568c749d0cd9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:11.532609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f7d71-c143-48d9-b78d-6d109718a4ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb9aeb0656347798749c2b8e4434c56, user_id=b43a269fe8b746b88c38db6b9e9bfa12, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.535921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65f7d71-c143-48d9-b78d-6d109718a4ba admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.536148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12d9796-6210-4945-9f96-568c749d0cd9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.543490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.544129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.544548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.544808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.547149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:11.554403 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 760/1529] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:11 2022] PUT /identity/v3/projects/bdb9aeb0656347798749c2b8e4434c56/users/b43a269fe8b746b88c38db6b9e9bfa12/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:11.560527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e586645-7fba-48c8-bf98-b9615127e0b6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.560807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e586645-7fba-48c8-bf98-b9615127e0b6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.561107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e586645-7fba-48c8-bf98-b9615127e0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.583079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3e586645-7fba-48c8-bf98-b9615127e0b6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:11.584456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3e586645-7fba-48c8-bf98-b9615127e0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:11.622443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.624234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.634824 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 770/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:11 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:51:11.641072 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:11.656945 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 761/1531] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:11.667154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:11.668860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:11.740385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86433d1f-1ed9-4b7e-8a20-d7776fbbf1d4 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.799413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55509b68-0792-442e-aa90-936d28fdfe84 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.800101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509b68-0792-442e-aa90-936d28fdfe84 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.800384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509b68-0792-442e-aa90-936d28fdfe84 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.801154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55509b68-0792-442e-aa90-936d28fdfe84 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.803664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e586645-7fba-48c8-bf98-b9615127e0b6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:11.812869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55509b68-0792-442e-aa90-936d28fdfe84 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.814246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e586645-7fba-48c8-bf98-b9615127e0b6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:11.814611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55509b68-0792-442e-aa90-936d28fdfe84 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.819230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:11.819946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.820293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.820693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] PATH_INFO: `/v3/users/2aaf9878d1634d699e1b5e17c2cca1e7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:11.826268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2aaf9878d1634d699e1b5e17c2cca1e7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:11.826268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:11.827336 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 771/1532] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:11.924728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2aaf9878d1634d699e1b5e17c2cca1e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:11.948318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2aaf9878d1634d699e1b5e17c2cca1e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:11.949787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2aaf9878d1634d699e1b5e17c2cca1e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:11.966017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2aaf9878d1634d699e1b5e17c2cca1e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:11.976150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2aaf9878d1634d699e1b5e17c2cca1e7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:11.984196 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 762/1533] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:11 2022] DELETE /identity/v3/users/2aaf9878d1634d699e1b5e17c2cca1e7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:11.988946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a61882-cefe-494d-b0a0-ee2be95eefc4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:11.990463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a61882-cefe-494d-b0a0-ee2be95eefc4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:11.990686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a61882-cefe-494d-b0a0-ee2be95eefc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:12.010019 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:12.017664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f6a61882-cefe-494d-b0a0-ee2be95eefc4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:12.019610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6a61882-cefe-494d-b0a0-ee2be95eefc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:12.102630 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 772/1534] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:12.118470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:12.119977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:12.209173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a61882-cefe-494d-b0a0-ee2be95eefc4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:12.209419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17329236-a060-44be-b519-da31eb3e1f11 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:12.211651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6a61882-cefe-494d-b0a0-ee2be95eefc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:12.214064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c033f6-c804-4431-8a8f-51f22691ac82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:12.214736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c033f6-c804-4431-8a8f-51f22691ac82 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:12.215021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c033f6-c804-4431-8a8f-51f22691ac82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:12.215295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c033f6-c804-4431-8a8f-51f22691ac82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:12.224674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a61882-cefe-494d-b0a0-ee2be95eefc4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:12.226010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c033f6-c804-4431-8a8f-51f22691ac82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:12.227590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c033f6-c804-4431-8a8f-51f22691ac82 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:12.230043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:12.230778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:12.231128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:12.231569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] PATH_INFO: `/v3/users/64b71302b9104e5faf7da8bf3a26c48d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:12.232902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64b71302b9104e5faf7da8bf3a26c48d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:12.235225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:12.239562 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 763/1535] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:51:12.290243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64b71302b9104e5faf7da8bf3a26c48d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.303471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64b71302b9104e5faf7da8bf3a26c48d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.304437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64b71302b9104e5faf7da8bf3a26c48d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.313873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64b71302b9104e5faf7da8bf3a26c48d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.321532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64b71302b9104e5faf7da8bf3a26c48d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.328616 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 773/1536] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:12 2022] DELETE /identity/v3/users/64b71302b9104e5faf7da8bf3a26c48d => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:12.333191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aa724-0044-4f1c-b284-1447c6345125 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:12.333713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aa724-0044-4f1c-b284-1447c6345125 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:12.333995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aa724-0044-4f1c-b284-1447c6345125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:12.355757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ee8aa724-0044-4f1c-b284-1447c6345125 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:12.357110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ee8aa724-0044-4f1c-b284-1447c6345125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:12.425837 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 764/1537] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:12.436382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:12.438113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:12.521524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f3e2f1-76c4-43c1-a867-8300c7a5b635 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:12.525897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a871fb3-7e79-4757-8169-45e617f7f0d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:12.526770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a871fb3-7e79-4757-8169-45e617f7f0d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:12.527212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a871fb3-7e79-4757-8169-45e617f7f0d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:12.527963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a871fb3-7e79-4757-8169-45e617f7f0d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:12.539826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a871fb3-7e79-4757-8169-45e617f7f0d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:12.541817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a871fb3-7e79-4757-8169-45e617f7f0d6 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:12.562092 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 774/1538] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:12.768973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aa724-0044-4f1c-b284-1447c6345125 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:12.770774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ee8aa724-0044-4f1c-b284-1447c6345125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:12.787078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aa724-0044-4f1c-b284-1447c6345125 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:12.793011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:12.793681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:12.793956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:12.794226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] PATH_INFO: `/v3/projects/28fd0cde485c446186e5397176d18faa` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:12.795464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] RBAC: Authorizing `identity:delete_project(project_id=28fd0cde485c446186e5397176d18faa)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:12.797549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:12.800753 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:12.860915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28fd0cde485c446186e5397176d18faa', 'request_id': 'req-2532d32e-19b2-4c3c-a07e-9d746244735a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.869565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28fd0cde485c446186e5397176d18faa', 'request_id': 'req-2532d32e-19b2-4c3c-a07e-9d746244735a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.879724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28fd0cde485c446186e5397176d18faa', 'request_id': 'req-2532d32e-19b2-4c3c-a07e-9d746244735a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.898293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] The token cache is being invalidate because project 28fd0cde485c446186e5397176d18faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:12.898558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.899536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:12.904231 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 765/1539] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:12 2022] DELETE /identity/v3/projects/28fd0cde485c446186e5397176d18faa => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:12.905417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a871fb3-7e79-4757-8169-45e617f7f0d6 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:12.918559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a871fb3-7e79-4757-8169-45e617f7f0d6 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:12.954557 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:13.021346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:13.021346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:13.021346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:13.021346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] PATH_INFO: `/v3/users/4c39e779f0ef45a887d2b1a78644d443` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:13.024133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c39e779f0ef45a887d2b1a78644d443)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:13.024246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:13.025345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:13.034807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:13.047624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532d32e-19b2-4c3c-a07e-9d746244735a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:13.068333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:13.070297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:13.070297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:13.070297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] PATH_INFO: `/v3/projects/ff96b32188664909a077a329c33f8ccc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:13.072139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff96b32188664909a077a329c33f8ccc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:13.074518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:13.130104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c39e779f0ef45a887d2b1a78644d443'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.158807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c39e779f0ef45a887d2b1a78644d443'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.160701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c39e779f0ef45a887d2b1a78644d443'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.176764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c39e779f0ef45a887d2b1a78644d443'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.191872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c39e779f0ef45a887d2b1a78644d443'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.197149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff96b32188664909a077a329c33f8ccc', 'request_id': 'req-74ccdd2c-bf0a-402c-a6be-6fe677d25569'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.213945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 775/1540] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:12 2022] DELETE /identity/v3/users/4c39e779f0ef45a887d2b1a78644d443 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:13.217083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff96b32188664909a077a329c33f8ccc', 'request_id': 'req-74ccdd2c-bf0a-402c-a6be-6fe677d25569'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.232933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff96b32188664909a077a329c33f8ccc', 'request_id': 'req-74ccdd2c-bf0a-402c-a6be-6fe677d25569'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.252009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] The token cache is being invalidate because project ff96b32188664909a077a329c33f8ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:13.252404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.253342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.257774 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 766/1541] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:13 2022] DELETE /identity/v3/projects/ff96b32188664909a077a329c33f8ccc => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:13.259292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:13.260851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:13.379780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580095ed-fa47-4996-a84b-b3ef48f69e42 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:13.385563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:13.386385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:13.386780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:13.387242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] PATH_INFO: `/v3/users/fa43aad419dc43e7876a3d17d755baba` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:13.388703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa43aad419dc43e7876a3d17d755baba)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:13.390830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:13.452744 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:13.456496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa43aad419dc43e7876a3d17d755baba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.475070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa43aad419dc43e7876a3d17d755baba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.476085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa43aad419dc43e7876a3d17d755baba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.488418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa43aad419dc43e7876a3d17d755baba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.512276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa43aad419dc43e7876a3d17d755baba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:13.520069 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 776/1542] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:13 2022] DELETE /identity/v3/users/fa43aad419dc43e7876a3d17d755baba => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:13.749660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:13.751382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:13.877996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ccdd2c-bf0a-402c-a6be-6fe677d25569 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:13.910915 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:13.990031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:13.990597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:13.991406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:13.991689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] PATH_INFO: `/v3/projects/4f7c3b79f0464aeb912ed2dc21efa3ba` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:13.993267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f7c3b79f0464aeb912ed2dc21efa3ba)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:13.995425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.039646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.042072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:14.065094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba901124-6464-40d9-9f4f-cd0940eff30c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.075897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f7c3b79f0464aeb912ed2dc21efa3ba', 'request_id': 'req-50735046-2803-4607-9950-bc49edc59dc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.083873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f7c3b79f0464aeb912ed2dc21efa3ba', 'request_id': 'req-50735046-2803-4607-9950-bc49edc59dc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.096965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f7c3b79f0464aeb912ed2dc21efa3ba', 'request_id': 'req-50735046-2803-4607-9950-bc49edc59dc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.114955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] The token cache is being invalidate because project 4f7c3b79f0464aeb912ed2dc21efa3ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:14.115269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.116251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50735046-2803-4607-9950-bc49edc59dc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.122366 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 767/1543] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:13 2022] DELETE /identity/v3/projects/4f7c3b79f0464aeb912ed2dc21efa3ba => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:14.123963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27ed37-96c9-4275-b14c-8d2e8acb111d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.124403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27ed37-96c9-4275-b14c-8d2e8acb111d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.124690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb27ed37-96c9-4275-b14c-8d2e8acb111d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.159654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fb27ed37-96c9-4275-b14c-8d2e8acb111d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:14.160955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb27ed37-96c9-4275-b14c-8d2e8acb111d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:14.207997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.208275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.208471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.208950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] PATH_INFO: `/v3/projects/358498de8e0d43e186ea0b53271f60e1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.210250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] RBAC: Authorizing `identity:delete_project(project_id=358498de8e0d43e186ea0b53271f60e1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.212212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.262985 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 768/1544] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:14.271276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e6cab-6f70-4e27-84e3-1864f970b738 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.271575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e6cab-6f70-4e27-84e3-1864f970b738 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.272131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e6cab-6f70-4e27-84e3-1864f970b738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.292617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '358498de8e0d43e186ea0b53271f60e1', 'request_id': 'req-046c889f-c01c-48b2-aac3-2ea04fb2c33b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.295904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b61e6cab-6f70-4e27-84e3-1864f970b738 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:14.297904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b61e6cab-6f70-4e27-84e3-1864f970b738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:14.306457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '358498de8e0d43e186ea0b53271f60e1', 'request_id': 'req-046c889f-c01c-48b2-aac3-2ea04fb2c33b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.316425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '358498de8e0d43e186ea0b53271f60e1', 'request_id': 'req-046c889f-c01c-48b2-aac3-2ea04fb2c33b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.334933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] The token cache is being invalidate because project 358498de8e0d43e186ea0b53271f60e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:14.335438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.336132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-046c889f-c01c-48b2-aac3-2ea04fb2c33b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:14.337770 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 777/1545] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:14 2022] DELETE /identity/v3/projects/358498de8e0d43e186ea0b53271f60e1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:14.342521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053456-20d2-407a-9137-c98381a1bee8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.342811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053456-20d2-407a-9137-c98381a1bee8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.343093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50053456-20d2-407a-9137-c98381a1bee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.365639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-50053456-20d2-407a-9137-c98381a1bee8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:14.367330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-50053456-20d2-407a-9137-c98381a1bee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:14.385754 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:14.421987 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 769/1546] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:14.422974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e6cab-6f70-4e27-84e3-1864f970b738 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.434135 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:14.435593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e6cab-6f70-4e27-84e3-1864f970b738 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.442722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902766a4-37af-4e69-a9e0-0ad6bea98325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.443396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902766a4-37af-4e69-a9e0-0ad6bea98325 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.443595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902766a4-37af-4e69-a9e0-0ad6bea98325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.444538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902766a4-37af-4e69-a9e0-0ad6bea98325 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.445237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902766a4-37af-4e69-a9e0-0ad6bea98325 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:14.445602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902766a4-37af-4e69-a9e0-0ad6bea98325 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.447238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902766a4-37af-4e69-a9e0-0ad6bea98325 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.461150 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 770/1547] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:14.462547 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 778/1548] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:14.466839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed19a35-ea3f-4ed0-a959-237424e84a39 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.467205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed19a35-ea3f-4ed0-a959-237424e84a39 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.467559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed19a35-ea3f-4ed0-a959-237424e84a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.482190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053456-20d2-407a-9137-c98381a1bee8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.490297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8ed19a35-ea3f-4ed0-a959-237424e84a39 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:14.491708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8ed19a35-ea3f-4ed0-a959-237424e84a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:14.510898 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 771/1549] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:14.511920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50053456-20d2-407a-9137-c98381a1bee8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.513829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed19a35-ea3f-4ed0-a959-237424e84a39 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.519462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b726eab-e3fd-4d11-a745-e2ce1b49f0b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.520940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b726eab-e3fd-4d11-a745-e2ce1b49f0b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.521279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b726eab-e3fd-4d11-a745-e2ce1b49f0b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.521790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b726eab-e3fd-4d11-a745-e2ce1b49f0b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.523679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b726eab-e3fd-4d11-a745-e2ce1b49f0b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.526015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b726eab-e3fd-4d11-a745-e2ce1b49f0b6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.533101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed19a35-ea3f-4ed0-a959-237424e84a39 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.543281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886d623-c27e-4d08-9f1d-12d6ff8dfe3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.544377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886d623-c27e-4d08-9f1d-12d6ff8dfe3d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.544911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886d623-c27e-4d08-9f1d-12d6ff8dfe3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.545453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886d623-c27e-4d08-9f1d-12d6ff8dfe3d admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.546307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886d623-c27e-4d08-9f1d-12d6ff8dfe3d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:14.547053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886d623-c27e-4d08-9f1d-12d6ff8dfe3d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.549146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886d623-c27e-4d08-9f1d-12d6ff8dfe3d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.569705 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 772/1550] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:51:14.570659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886d623-c27e-4d08-9f1d-12d6ff8dfe3d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.585345 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 779/1551] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:14 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:14.585345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b726eab-e3fd-4d11-a745-e2ce1b49f0b6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.592087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886d623-c27e-4d08-9f1d-12d6ff8dfe3d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.664298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1424cc-1d30-40aa-adf1-197ac8238e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.664988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1424cc-1d30-40aa-adf1-197ac8238e78 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.665276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1424cc-1d30-40aa-adf1-197ac8238e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.665579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1424cc-1d30-40aa-adf1-197ac8238e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.666788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1424cc-1d30-40aa-adf1-197ac8238e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.669247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1424cc-1d30-40aa-adf1-197ac8238e78 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.671509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b726eab-e3fd-4d11-a745-e2ce1b49f0b6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.677700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba1831-1504-4a2d-861c-06d6bc8a83ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.678936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba1831-1504-4a2d-861c-06d6bc8a83ff admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.679563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba1831-1504-4a2d-861c-06d6bc8a83ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.679910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bba1831-1504-4a2d-861c-06d6bc8a83ff admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.680681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba1831-1504-4a2d-861c-06d6bc8a83ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.683121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bba1831-1504-4a2d-861c-06d6bc8a83ff admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.723319 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 773/1552] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:14 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:14.724708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1424cc-1d30-40aa-adf1-197ac8238e78 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.728106 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 780/1553] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:14 2022] POST /identity/v3/users => generated 293 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:14.729289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba1831-1504-4a2d-861c-06d6bc8a83ff admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.747625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bba1831-1504-4a2d-861c-06d6bc8a83ff admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.829923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89876097-6259-4184-81f5-03890a913302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.831233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89876097-6259-4184-81f5-03890a913302 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.831866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89876097-6259-4184-81f5-03890a913302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.832410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89876097-6259-4184-81f5-03890a913302 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.833263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89876097-6259-4184-81f5-03890a913302 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.835680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89876097-6259-4184-81f5-03890a913302 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.845676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1424cc-1d30-40aa-adf1-197ac8238e78 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.852009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6e822-5ff3-46f8-ad43-10941217684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.853450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e822-5ff3-46f8-ad43-10941217684f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.853450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e822-5ff3-46f8-ad43-10941217684f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.853450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e822-5ff3-46f8-ad43-10941217684f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.854086 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 781/1554] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:14.854299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6e822-5ff3-46f8-ad43-10941217684f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.856888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a6e822-5ff3-46f8-ad43-10941217684f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.858722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89876097-6259-4184-81f5-03890a913302 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.869215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89876097-6259-4184-81f5-03890a913302 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.882426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d6c3f-d914-49fd-a914-79464467d3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.883434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d6c3f-d914-49fd-a914-79464467d3fe admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.883859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d6c3f-d914-49fd-a914-79464467d3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.884267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894d6c3f-d914-49fd-a914-79464467d3fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.885049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d6c3f-d914-49fd-a914-79464467d3fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.886918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894d6c3f-d914-49fd-a914-79464467d3fe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.899388 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 774/1555] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:14 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:14.900486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6e822-5ff3-46f8-ad43-10941217684f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.900641 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 782/1556] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:14.906595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d6c3f-d914-49fd-a914-79464467d3fe admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.917692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a6e822-5ff3-46f8-ad43-10941217684f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.922993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894d6c3f-d914-49fd-a914-79464467d3fe admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.925704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6c88a-54ed-4688-8236-9381af17068d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.926409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6c88a-54ed-4688-8236-9381af17068d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.926860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6c88a-54ed-4688-8236-9381af17068d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.927053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde6c88a-54ed-4688-8236-9381af17068d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.928278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6c88a-54ed-4688-8236-9381af17068d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.930548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde6c88a-54ed-4688-8236-9381af17068d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.931250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f526adc-6c99-4e19-b103-8533ce8754e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.932696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f526adc-6c99-4e19-b103-8533ce8754e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.934205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f526adc-6c99-4e19-b103-8533ce8754e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.934666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f526adc-6c99-4e19-b103-8533ce8754e5 admin admin] PATH_INFO: `/v3/projects/49b925189d394a48a071051c8073baec/users/242544b0f2ca46eb9099e4ee3e2cbae4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.948619 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 775/1557] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:14.949892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6c88a-54ed-4688-8236-9381af17068d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:14.962217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f526adc-6c99-4e19-b103-8533ce8754e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49b925189d394a48a071051c8073baec, user_id=242544b0f2ca46eb9099e4ee3e2cbae4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.963752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde6c88a-54ed-4688-8236-9381af17068d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:14.967232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f526adc-6c99-4e19-b103-8533ce8754e5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.971618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911907-250f-4020-b54d-072c13ab017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:14.973033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911907-250f-4020-b54d-072c13ab017e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:14.973575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911907-250f-4020-b54d-072c13ab017e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:14.973924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b911907-250f-4020-b54d-072c13ab017e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:14.974589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b911907-250f-4020-b54d-072c13ab017e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:14.977460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b911907-250f-4020-b54d-072c13ab017e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:14.997987 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 776/1558] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:14.999139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911907-250f-4020-b54d-072c13ab017e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.003197 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 783/1559] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:14 2022] PUT /identity/v3/projects/49b925189d394a48a071051c8073baec/users/242544b0f2ca46eb9099e4ee3e2cbae4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:15.013468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b911907-250f-4020-b54d-072c13ab017e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.016876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08c5a1-06f4-4516-aafe-cf7a95d932af None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.021111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08c5a1-06f4-4516-aafe-cf7a95d932af None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.025314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08c5a1-06f4-4516-aafe-cf7a95d932af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.030415 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:15.111976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cc08c5a1-06f4-4516-aafe-cf7a95d932af None None] MFA Rules not processed for user `242544b0f2ca46eb9099e4ee3e2cbae4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:15.113221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc08c5a1-06f4-4516-aafe-cf7a95d932af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:15.129208 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:15.171685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134ed62-4e4c-4693-a07d-25b0cff8bc40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:15.173319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134ed62-4e4c-4693-a07d-25b0cff8bc40 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.173601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134ed62-4e4c-4693-a07d-25b0cff8bc40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.173880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e134ed62-4e4c-4693-a07d-25b0cff8bc40 admin admin] PATH_INFO: `/v3/projects/03f5fec99e8c4e149e46d27fe3f5a189/users/7e5abe25d50b454a956f56a0ec3fe1af/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.198119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134ed62-4e4c-4693-a07d-25b0cff8bc40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03f5fec99e8c4e149e46d27fe3f5a189, user_id=7e5abe25d50b454a956f56a0ec3fe1af, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:15.202706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e134ed62-4e4c-4693-a07d-25b0cff8bc40 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:15.229331 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 784/1561] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:15.232226 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 777/1561] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:14 2022] PUT /identity/v3/projects/03f5fec99e8c4e149e46d27fe3f5a189/users/7e5abe25d50b454a956f56a0ec3fe1af/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:15.234198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816f29-5883-4415-b6b4-f735d1229061 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.234323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134ed62-4e4c-4693-a07d-25b0cff8bc40 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.234829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816f29-5883-4415-b6b4-f735d1229061 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.235105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c816f29-5883-4415-b6b4-f735d1229061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.269836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6c816f29-5883-4415-b6b4-f735d1229061 None None] MFA Rules not processed for user `7e5abe25d50b454a956f56a0ec3fe1af`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:15.271126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6c816f29-5883-4415-b6b4-f735d1229061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:15.324914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e134ed62-4e4c-4693-a07d-25b0cff8bc40 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.331256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41a98f-edcb-490c-92fa-22987bd90390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:15.331989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a98f-edcb-490c-92fa-22987bd90390 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.332320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a98f-edcb-490c-92fa-22987bd90390 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.332591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a41a98f-edcb-490c-92fa-22987bd90390 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.333823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41a98f-edcb-490c-92fa-22987bd90390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:15.336546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a41a98f-edcb-490c-92fa-22987bd90390 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:15.377763 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 778/1562] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:15 2022] POST /identity/v3/projects => generated 387 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:15.382504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41a98f-edcb-490c-92fa-22987bd90390 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.389884 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 785/1563] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:15 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:15.390887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c816f29-5883-4415-b6b4-f735d1229061 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.407310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c816f29-5883-4415-b6b4-f735d1229061 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.495851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839387d9-d138-49e8-97ad-6c9d94557868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:15.496706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839387d9-d138-49e8-97ad-6c9d94557868 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.497558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839387d9-d138-49e8-97ad-6c9d94557868 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.497840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839387d9-d138-49e8-97ad-6c9d94557868 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.498732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839387d9-d138-49e8-97ad-6c9d94557868 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:15.499530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a41a98f-edcb-490c-92fa-22987bd90390 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.500935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839387d9-d138-49e8-97ad-6c9d94557868 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:15.505093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310a6c-f1a7-4832-a903-7f8d451b7f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:15.505900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310a6c-f1a7-4832-a903-7f8d451b7f06 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.506254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310a6c-f1a7-4832-a903-7f8d451b7f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.506913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92310a6c-f1a7-4832-a903-7f8d451b7f06 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.507759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92310a6c-f1a7-4832-a903-7f8d451b7f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:15.510151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92310a6c-f1a7-4832-a903-7f8d451b7f06 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:15.538450 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 786/1564] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:15 2022] POST /identity/v3/projects => generated 375 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:15.541568 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 779/1565] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:15 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:51:15.542685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839387d9-d138-49e8-97ad-6c9d94557868 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.545170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310a6c-f1a7-4832-a903-7f8d451b7f06 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.558940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92310a6c-f1a7-4832-a903-7f8d451b7f06 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.570098 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:15.579847 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:15.671964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839387d9-d138-49e8-97ad-6c9d94557868 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.674373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000bd97-2587-47c3-85c7-60b9b719e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:15.675187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000bd97-2587-47c3-85c7-60b9b719e900 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.675584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000bd97-2587-47c3-85c7-60b9b719e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.676102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d000bd97-2587-47c3-85c7-60b9b719e900 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.677262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000bd97-2587-47c3-85c7-60b9b719e900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:15.677743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23b37d-7e00-43e4-9c33-bb52c4e57c97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:15.678880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23b37d-7e00-43e4-9c33-bb52c4e57c97 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.679170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23b37d-7e00-43e4-9c33-bb52c4e57c97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.679452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae23b37d-7e00-43e4-9c33-bb52c4e57c97 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.680095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23b37d-7e00-43e4-9c33-bb52c4e57c97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:15.681103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d000bd97-2587-47c3-85c7-60b9b719e900 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:15.682065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae23b37d-7e00-43e4-9c33-bb52c4e57c97 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:15.703275 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 780/1566] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:51:15.712599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000bd97-2587-47c3-85c7-60b9b719e900 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.736655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d000bd97-2587-47c3-85c7-60b9b719e900 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.747427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da783229-913a-451c-9b5f-fb6a7dc89eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:15.747427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da783229-913a-451c-9b5f-fb6a7dc89eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.747427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da783229-913a-451c-9b5f-fb6a7dc89eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.747427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da783229-913a-451c-9b5f-fb6a7dc89eb2 admin admin] PATH_INFO: `/v3/projects/326243a8963543e495514473441ef22f/users/1d8514c369c04504af401e8a5b7efb2f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.779756 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 787/1567] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:15 2022] POST /identity/v3/users => generated 294 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:15.799433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da783229-913a-451c-9b5f-fb6a7dc89eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=326243a8963543e495514473441ef22f, user_id=1d8514c369c04504af401e8a5b7efb2f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:15.805949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23b37d-7e00-43e4-9c33-bb52c4e57c97 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.810145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da783229-913a-451c-9b5f-fb6a7dc89eb2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:15.824010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae23b37d-7e00-43e4-9c33-bb52c4e57c97 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.835484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5963954-b251-46a6-ae45-181cbd8f88ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:15.836116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5963954-b251-46a6-ae45-181cbd8f88ce admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.836395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5963954-b251-46a6-ae45-181cbd8f88ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.836663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5963954-b251-46a6-ae45-181cbd8f88ce admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.837358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5963954-b251-46a6-ae45-181cbd8f88ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:15.838986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5963954-b251-46a6-ae45-181cbd8f88ce admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:15.849736 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 781/1568] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:15 2022] PUT /identity/v3/projects/326243a8963543e495514473441ef22f/users/1d8514c369c04504af401e8a5b7efb2f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:15.854486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da783229-913a-451c-9b5f-fb6a7dc89eb2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.878867 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 788/1569] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:15.880389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5963954-b251-46a6-ae45-181cbd8f88ce admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:15.907171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5963954-b251-46a6-ae45-181cbd8f88ce admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.963004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da783229-913a-451c-9b5f-fb6a7dc89eb2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:15.972278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a810d-a140-409b-af34-71cf59590d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:15.973800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a810d-a140-409b-af34-71cf59590d65 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:15.974286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a810d-a140-409b-af34-71cf59590d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:15.975031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a810d-a140-409b-af34-71cf59590d65 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:15.977665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a810d-a140-409b-af34-71cf59590d65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:15.980993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a810d-a140-409b-af34-71cf59590d65 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:15.997906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 782/1570] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:15 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:16.001989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a810d-a140-409b-af34-71cf59590d65 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:16.015832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a810d-a140-409b-af34-71cf59590d65 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:16.023979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb41234-e341-4bdd-9f2b-2d663074499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:16.025568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb41234-e341-4bdd-9f2b-2d663074499b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.026196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb41234-e341-4bdd-9f2b-2d663074499b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.027121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb41234-e341-4bdd-9f2b-2d663074499b admin admin] PATH_INFO: `/v3/projects/326243a8963543e495514473441ef22f/users/1d8514c369c04504af401e8a5b7efb2f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.033438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb41234-e341-4bdd-9f2b-2d663074499b admin admin] RBAC: Authorizing `identity:create_grant(project_id=326243a8963543e495514473441ef22f, user_id=1d8514c369c04504af401e8a5b7efb2f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:16.037046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb41234-e341-4bdd-9f2b-2d663074499b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:16.037806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1649109-de34-4076-81ea-6408701440b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:16.038501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1649109-de34-4076-81ea-6408701440b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.038797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1649109-de34-4076-81ea-6408701440b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.039070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1649109-de34-4076-81ea-6408701440b3 admin admin] PATH_INFO: `/v3/projects/fc65c2c08bfc4fbeb4adc79b5d97fa52/users/0cf98c641dba4caa99263a1483849619/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.056574 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 783/1571] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:16 2022] PUT /identity/v3/projects/326243a8963543e495514473441ef22f/users/1d8514c369c04504af401e8a5b7efb2f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:16.078413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6e4ff-eff6-4cbb-bcae-5116e0bb70a3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.080746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6e4ff-eff6-4cbb-bcae-5116e0bb70a3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.081287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f6e4ff-eff6-4cbb-bcae-5116e0bb70a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.088762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1649109-de34-4076-81ea-6408701440b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc65c2c08bfc4fbeb4adc79b5d97fa52, user_id=0cf98c641dba4caa99263a1483849619, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:16.091263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1649109-de34-4076-81ea-6408701440b3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:16.122360 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 789/1572] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:15 2022] PUT /identity/v3/projects/fc65c2c08bfc4fbeb4adc79b5d97fa52/users/0cf98c641dba4caa99263a1483849619/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:16.123939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1649109-de34-4076-81ea-6408701440b3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:16.132918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e0f6e4ff-eff6-4cbb-bcae-5116e0bb70a3 None None] MFA Rules not processed for user `1d8514c369c04504af401e8a5b7efb2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:16.134897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e0f6e4ff-eff6-4cbb-bcae-5116e0bb70a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:16.209974 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:16.261403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1649109-de34-4076-81ea-6408701440b3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:16.278567 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 784/1573] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:16 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:16.290294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2575b-f19a-4e37-8d41-1c31c07a50ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:16.290984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2575b-f19a-4e37-8d41-1c31c07a50ec admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.291264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2575b-f19a-4e37-8d41-1c31c07a50ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.291540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2575b-f19a-4e37-8d41-1c31c07a50ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.292287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2575b-f19a-4e37-8d41-1c31c07a50ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:16.294941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2575b-f19a-4e37-8d41-1c31c07a50ec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:16.307630 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 790/1574] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:16 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:16.311542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6e4ff-eff6-4cbb-bcae-5116e0bb70a3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:16.327226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f6e4ff-eff6-4cbb-bcae-5116e0bb70a3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:16.332931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21aa227-fdec-4ed3-b690-272a5009caaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:16.333653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aa227-fdec-4ed3-b690-272a5009caaa admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.334107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aa227-fdec-4ed3-b690-272a5009caaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.335056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21aa227-fdec-4ed3-b690-272a5009caaa admin admin] PATH_INFO: `/v3/projects/fc65c2c08bfc4fbeb4adc79b5d97fa52/users/0cf98c641dba4caa99263a1483849619/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.337496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21aa227-fdec-4ed3-b690-272a5009caaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc65c2c08bfc4fbeb4adc79b5d97fa52, user_id=0cf98c641dba4caa99263a1483849619, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:16.340866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2575b-f19a-4e37-8d41-1c31c07a50ec admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:16.342801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eda2575b-f19a-4e37-8d41-1c31c07a50ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:16.352662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21aa227-fdec-4ed3-b690-272a5009caaa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:16.398649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 785/1575] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:16 2022] PUT /identity/v3/projects/fc65c2c08bfc4fbeb4adc79b5d97fa52/users/0cf98c641dba4caa99263a1483849619/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:16.400232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc4225-8718-41de-afa5-c50bdc222fc2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.400523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc4225-8718-41de-afa5-c50bdc222fc2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.400802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdc4225-8718-41de-afa5-c50bdc222fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.409730 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:16.522711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2575b-f19a-4e37-8d41-1c31c07a50ec admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:16.668013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85110126-b885-4d0b-8b14-ef790790a42a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:16.668642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85110126-b885-4d0b-8b14-ef790790a42a service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.668918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85110126-b885-4d0b-8b14-ef790790a42a service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.669186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85110126-b885-4d0b-8b14-ef790790a42a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.688295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0cdc4225-8718-41de-afa5-c50bdc222fc2 None None] MFA Rules not processed for user `0cf98c641dba4caa99263a1483849619`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:16.689563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0cdc4225-8718-41de-afa5-c50bdc222fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:16.837966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85110126-b885-4d0b-8b14-ef790790a42a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:16.839907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85110126-b885-4d0b-8b14-ef790790a42a service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:16.844829 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 786/1576] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:16 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 445 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:16.845988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc4225-8718-41de-afa5-c50bdc222fc2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:16.847656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0cdc4225-8718-41de-afa5-c50bdc222fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:16.871349 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 791/1577] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:51:16.874994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdc4225-8718-41de-afa5-c50bdc222fc2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:16.882584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1c81-1709-42d2-840f-8f5982e05d10 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:16.884363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1c81-1709-42d2-840f-8f5982e05d10 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:16.884865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1c81-1709-42d2-840f-8f5982e05d10 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:16.885383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a1c81-1709-42d2-840f-8f5982e05d10 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:16.902402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1c81-1709-42d2-840f-8f5982e05d10 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:16.904223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591a1c81-1709-42d2-840f-8f5982e05d10 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:16.928883 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 787/1578] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:16 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:17.767700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85110126-b885-4d0b-8b14-ef790790a42a service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:17.856464 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:17.893936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85110126-b885-4d0b-8b14-ef790790a42a service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:17.899928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:17.900578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:17.900895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:17.901174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] PATH_INFO: `/v3/users/7e5abe25d50b454a956f56a0ec3fe1af` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:17.902374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e5abe25d50b454a956f56a0ec3fe1af)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:17.904295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:17.950690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1c81-1709-42d2-840f-8f5982e05d10 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:17.973375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a1c81-1709-42d2-840f-8f5982e05d10 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:17.984932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:17.986030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:17.986526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:17.986896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] PATH_INFO: `/v3/users/242544b0f2ca46eb9099e4ee3e2cbae4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:17.988411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=242544b0f2ca46eb9099e4ee3e2cbae4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:17.990493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:17.996657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e5abe25d50b454a956f56a0ec3fe1af'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.046546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e5abe25d50b454a956f56a0ec3fe1af'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.047491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e5abe25d50b454a956f56a0ec3fe1af'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.062352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e5abe25d50b454a956f56a0ec3fe1af'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.078489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a372c47-3c1b-4268-bca0-c1da259da0ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e5abe25d50b454a956f56a0ec3fe1af'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.091132 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 792/1579] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:17 2022] DELETE /identity/v3/users/7e5abe25d50b454a956f56a0ec3fe1af => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:18.095693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc983c-e887-4cb3-ac76-0bbf61d7d421 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:18.097636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc983c-e887-4cb3-ac76-0bbf61d7d421 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:18.098135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc983c-e887-4cb3-ac76-0bbf61d7d421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:18.110231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '242544b0f2ca46eb9099e4ee3e2cbae4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.137316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-32dc983c-e887-4cb3-ac76-0bbf61d7d421 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:18.139816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-32dc983c-e887-4cb3-ac76-0bbf61d7d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:18.140894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '242544b0f2ca46eb9099e4ee3e2cbae4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.147581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '242544b0f2ca46eb9099e4ee3e2cbae4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.162404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '242544b0f2ca46eb9099e4ee3e2cbae4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.174951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0691aeec-fd08-453c-b3cb-6201d3e5ba39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '242544b0f2ca46eb9099e4ee3e2cbae4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:18.182089 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 788/1580] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:17 2022] DELETE /identity/v3/users/242544b0f2ca46eb9099e4ee3e2cbae4 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:18.187111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4dcc1-4350-42ee-a4b1-18908351cb1c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:18.187437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4dcc1-4350-42ee-a4b1-18908351cb1c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:18.187745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4dcc1-4350-42ee-a4b1-18908351cb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:18.218237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-44f4dcc1-4350-42ee-a4b1-18908351cb1c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:18.219429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-44f4dcc1-4350-42ee-a4b1-18908351cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:18.244884 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:18.272397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 793/1581] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:18.285500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc983c-e887-4cb3-ac76-0bbf61d7d421 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:18.287061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-32dc983c-e887-4cb3-ac76-0bbf61d7d421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:18.347041 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 789/1582] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:18.348831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4dcc1-4350-42ee-a4b1-18908351cb1c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:18.350681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-44f4dcc1-4350-42ee-a4b1-18908351cb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:18.400025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc983c-e887-4cb3-ac76-0bbf61d7d421 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:18.436942 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:18.450022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4dcc1-4350-42ee-a4b1-18908351cb1c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:18.458315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c23238-d76f-462b-85e5-55828cfe3072 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:18.460306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c23238-d76f-462b-85e5-55828cfe3072 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:18.460821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c23238-d76f-462b-85e5-55828cfe3072 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:18.461324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c23238-d76f-462b-85e5-55828cfe3072 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:18.471904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc6373-d7f1-4009-ab46-71258885b619 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:18.472199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc6373-d7f1-4009-ab46-71258885b619 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:18.472468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc6373-d7f1-4009-ab46-71258885b619 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:18.472687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fc6373-d7f1-4009-ab46-71258885b619 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:18.477405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c23238-d76f-462b-85e5-55828cfe3072 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:18.478996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c23238-d76f-462b-85e5-55828cfe3072 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:18.487120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc6373-d7f1-4009-ab46-71258885b619 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:18.488809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fc6373-d7f1-4009-ab46-71258885b619 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:18.511095 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 790/1583] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:18.512439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e673-a064-4660-a3f1-94e10be0b540 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:18.512723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e673-a064-4660-a3f1-94e10be0b540 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:18.512998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd6e673-a064-4660-a3f1-94e10be0b540 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:18.514330 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 791/1584] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:51:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:18.516647 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 794/1585] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:51:18.523549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c4b9b-dcaa-4a6f-97cb-9d560bec5237 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:18.523900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c4b9b-dcaa-4a6f-97cb-9d560bec5237 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:18.524237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c4b9b-dcaa-4a6f-97cb-9d560bec5237 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:18.552064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b40c4b9b-dcaa-4a6f-97cb-9d560bec5237 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:18.553996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b40c4b9b-dcaa-4a6f-97cb-9d560bec5237 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:18.698098 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 792/1586] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:51:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:18.723328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc6373-d7f1-4009-ab46-71258885b619 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:18.724961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48fc6373-d7f1-4009-ab46-71258885b619 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:18.778487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fc6373-d7f1-4009-ab46-71258885b619 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:18.792946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a46e5-4e01-42fb-9ae3-2a044f4affc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:18.793714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a46e5-4e01-42fb-9ae3-2a044f4affc2 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:18.808736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a46e5-4e01-42fb-9ae3-2a044f4affc2 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:18.809023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0a46e5-4e01-42fb-9ae3-2a044f4affc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:18.855128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a46e5-4e01-42fb-9ae3-2a044f4affc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:18.856765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0a46e5-4e01-42fb-9ae3-2a044f4affc2 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:18.878080 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 795/1587] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:19.006815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7820a7-f4e7-4e51-9b8a-8cc0499334a0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:19.007260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7820a7-f4e7-4e51-9b8a-8cc0499334a0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:19.007260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7820a7-f4e7-4e51-9b8a-8cc0499334a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:19.097376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3e7820a7-f4e7-4e51-9b8a-8cc0499334a0 None None] MFA Rules not processed for user `b43a269fe8b746b88c38db6b9e9bfa12`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:19.099345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3e7820a7-f4e7-4e51-9b8a-8cc0499334a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:19.194500 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:19.233981 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 793/1588] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:19.235670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a46e5-4e01-42fb-9ae3-2a044f4affc2 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:19.239199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ed0a46e5-4e01-42fb-9ae3-2a044f4affc2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:19.268146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0a46e5-4e01-42fb-9ae3-2a044f4affc2 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:19.286479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26cc03-ef16-45b7-ad68-c94857b67348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:19.287194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26cc03-ef16-45b7-ad68-c94857b67348 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:19.288064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26cc03-ef16-45b7-ad68-c94857b67348 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:19.288467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26cc03-ef16-45b7-ad68-c94857b67348 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:19.289179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26cc03-ef16-45b7-ad68-c94857b67348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:19.292031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26cc03-ef16-45b7-ad68-c94857b67348 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:19.318363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7820a7-f4e7-4e51-9b8a-8cc0499334a0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:19.319857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3e7820a7-f4e7-4e51-9b8a-8cc0499334a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:19.347032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7820a7-f4e7-4e51-9b8a-8cc0499334a0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:19.349035 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 796/1589] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:19 2022] POST /identity/v3/projects => generated 371 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:19.350540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26cc03-ef16-45b7-ad68-c94857b67348 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:19.353383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eb26cc03-ef16-45b7-ad68-c94857b67348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:19.441872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:19.443039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:19.443300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:19.443606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] PATH_INFO: `/v3/projects/49b925189d394a48a071051c8073baec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:19.447641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49b925189d394a48a071051c8073baec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:19.451832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:19.474864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26cc03-ef16-45b7-ad68-c94857b67348 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:19.481026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:19.481877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:19.482234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:19.482693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] PATH_INFO: `/v3/projects/03f5fec99e8c4e149e46d27fe3f5a189` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:19.493973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03f5fec99e8c4e149e46d27fe3f5a189)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:19.496458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:19.536257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49b925189d394a48a071051c8073baec', 'request_id': 'req-598d5588-c782-4446-b461-1d6abda18252'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.547992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49b925189d394a48a071051c8073baec', 'request_id': 'req-598d5588-c782-4446-b461-1d6abda18252'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.563606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03f5fec99e8c4e149e46d27fe3f5a189', 'request_id': 'req-2db4c31f-5d8f-439a-a8cf-161526159c17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.565519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49b925189d394a48a071051c8073baec', 'request_id': 'req-598d5588-c782-4446-b461-1d6abda18252'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.574751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03f5fec99e8c4e149e46d27fe3f5a189', 'request_id': 'req-2db4c31f-5d8f-439a-a8cf-161526159c17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.579969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] The token cache is being invalidate because project 49b925189d394a48a071051c8073baec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:19.580276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.581150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.583057 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 794/1590] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:19 2022] DELETE /identity/v3/projects/49b925189d394a48a071051c8073baec => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:19.587226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:19.587556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03f5fec99e8c4e149e46d27fe3f5a189', 'request_id': 'req-2db4c31f-5d8f-439a-a8cf-161526159c17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.589187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:19.601508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] The token cache is being invalidate because project 03f5fec99e8c4e149e46d27fe3f5a189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:19.602365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.602481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.607524 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 797/1591] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:19 2022] DELETE /identity/v3/projects/03f5fec99e8c4e149e46d27fe3f5a189 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:19.607524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:19.608835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:19.667911 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:19.673736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d5588-c782-4446-b461-1d6abda18252 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:19.702473 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:19.712724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4c31f-5d8f-439a-a8cf-161526159c17 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:19.719714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:19.720768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:19.720768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:19.721013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] PATH_INFO: `/v3/users/1d8514c369c04504af401e8a5b7efb2f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:19.722334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d8514c369c04504af401e8a5b7efb2f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:19.724519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:19.750965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b147ac-429f-479f-901b-9e52e86e7bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:19.751575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b147ac-429f-479f-901b-9e52e86e7bf6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:19.751850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b147ac-429f-479f-901b-9e52e86e7bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:19.752122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b147ac-429f-479f-901b-9e52e86e7bf6 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:19.752989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b147ac-429f-479f-901b-9e52e86e7bf6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:19.755790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b147ac-429f-479f-901b-9e52e86e7bf6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:19.783796 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 795/1592] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:19 2022] POST /identity/v3/users => generated 292 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:19.784912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b147ac-429f-479f-901b-9e52e86e7bf6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:19.790793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-69b147ac-429f-479f-901b-9e52e86e7bf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:19.797419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d8514c369c04504af401e8a5b7efb2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.805613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b147ac-429f-479f-901b-9e52e86e7bf6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:19.810781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:19.811484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:19.811988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:19.812501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] PATH_INFO: `/v3/users/0cf98c641dba4caa99263a1483849619` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:19.813205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d8514c369c04504af401e8a5b7efb2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.813961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d8514c369c04504af401e8a5b7efb2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.814202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cf98c641dba4caa99263a1483849619)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:19.816306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:19.823298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d8514c369c04504af401e8a5b7efb2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.833863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d8514c369c04504af401e8a5b7efb2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.845839 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 798/1593] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:19 2022] DELETE /identity/v3/users/1d8514c369c04504af401e8a5b7efb2f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:19.845839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:19.850206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:19.888762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cf98c641dba4caa99263a1483849619'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.904622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cf98c641dba4caa99263a1483849619'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.906070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cf98c641dba4caa99263a1483849619'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.916019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cf98c641dba4caa99263a1483849619'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.925032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cf98c641dba4caa99263a1483849619'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:19.940039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58830281-9086-403b-9502-cc9e2be313d7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:19.940979 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 796/1594] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:19 2022] DELETE /identity/v3/users/0cf98c641dba4caa99263a1483849619 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:20.035569 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:20.051525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabfee1-e039-4db3-bf18-94bd0a183992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:20.051525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabfee1-e039-4db3-bf18-94bd0a183992 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.051525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabfee1-e039-4db3-bf18-94bd0a183992 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.051525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcabfee1-e039-4db3-bf18-94bd0a183992 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.052089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabfee1-e039-4db3-bf18-94bd0a183992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:20.059490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcabfee1-e039-4db3-bf18-94bd0a183992 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:20.066299 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 799/1595] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:19 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:20.070740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:20.072203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:20.086597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a3f84d-6d52-4a66-aff4-7acdd5d6de6d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:20.092516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cec71-124a-4f68-931c-da9d867d750c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:20.093268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cec71-124a-4f68-931c-da9d867d750c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.093602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cec71-124a-4f68-931c-da9d867d750c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.093964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82cec71-124a-4f68-931c-da9d867d750c admin admin] PATH_INFO: `/v3/projects/0e89b067267b4fc1979432f328b7b5ec/users/4ddd42bac53f4b43a7d3b7ff317a175b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.111076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cec71-124a-4f68-931c-da9d867d750c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e89b067267b4fc1979432f328b7b5ec, user_id=4ddd42bac53f4b43a7d3b7ff317a175b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:20.113793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82cec71-124a-4f68-931c-da9d867d750c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:20.129270 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 797/1596] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:20 2022] PUT /identity/v3/projects/0e89b067267b4fc1979432f328b7b5ec/users/4ddd42bac53f4b43a7d3b7ff317a175b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:20.135881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabfee1-e039-4db3-bf18-94bd0a183992 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:20.152766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcabfee1-e039-4db3-bf18-94bd0a183992 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:20.265560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc275dbe-6c14-4971-b236-d83fcc3881f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:20.266330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc275dbe-6c14-4971-b236-d83fcc3881f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.266808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc275dbe-6c14-4971-b236-d83fcc3881f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.267660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc275dbe-6c14-4971-b236-d83fcc3881f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.270163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc275dbe-6c14-4971-b236-d83fcc3881f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:20.281285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc275dbe-6c14-4971-b236-d83fcc3881f5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:20.298829 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 800/1597] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:20 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:20.302583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cec71-124a-4f68-931c-da9d867d750c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:20.304166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc275dbe-6c14-4971-b236-d83fcc3881f5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:20.304734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e82cec71-124a-4f68-931c-da9d867d750c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:20.327911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc275dbe-6c14-4971-b236-d83fcc3881f5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:20.330143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82cec71-124a-4f68-931c-da9d867d750c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:20.335640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f1af0f-3167-4bc8-b602-032d9a497c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:20.336429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:20.337000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1af0f-3167-4bc8-b602-032d9a497c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.337153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.338685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.338685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] PATH_INFO: `/v3/projects/326243a8963543e495514473441ef22f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.339073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] RBAC: Authorizing `identity:delete_project(project_id=326243a8963543e495514473441ef22f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:20.339918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1af0f-3167-4bc8-b602-032d9a497c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.340419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f1af0f-3167-4bc8-b602-032d9a497c28 admin admin] PATH_INFO: `/v3/projects/0e89b067267b4fc1979432f328b7b5ec/users/4ddd42bac53f4b43a7d3b7ff317a175b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.341870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:20.344129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1af0f-3167-4bc8-b602-032d9a497c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e89b067267b4fc1979432f328b7b5ec, user_id=4ddd42bac53f4b43a7d3b7ff317a175b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:20.347608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f1af0f-3167-4bc8-b602-032d9a497c28 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:20.365777 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 801/1598] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:20 2022] PUT /identity/v3/projects/0e89b067267b4fc1979432f328b7b5ec/users/4ddd42bac53f4b43a7d3b7ff317a175b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:20.444797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '326243a8963543e495514473441ef22f', 'request_id': 'req-6d6de7ff-bd17-410a-9b90-24866022895d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.456211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '326243a8963543e495514473441ef22f', 'request_id': 'req-6d6de7ff-bd17-410a-9b90-24866022895d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.460330 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=80,keystone:INSERT=6,keystone:DELETE=14 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:20.469748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '326243a8963543e495514473441ef22f', 'request_id': 'req-6d6de7ff-bd17-410a-9b90-24866022895d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.502239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] The token cache is being invalidate because project 326243a8963543e495514473441ef22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:20.503206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.505223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.513815 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 798/1599] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:20 2022] DELETE /identity/v3/projects/326243a8963543e495514473441ef22f => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:20.515526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c05f-da65-4a28-abb1-721fb8016093 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.516100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c05f-da65-4a28-abb1-721fb8016093 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.516444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b234c05f-da65-4a28-abb1-721fb8016093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.540677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:20.543630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:20.548477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b234c05f-da65-4a28-abb1-721fb8016093 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:20.551389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b234c05f-da65-4a28-abb1-721fb8016093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:20.669820 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 802/1600] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:20.681812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba28d0-9ff0-4af8-9e80-5918988a5f13 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.682121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba28d0-9ff0-4af8-9e80-5918988a5f13 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.682633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba28d0-9ff0-4af8-9e80-5918988a5f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.701944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6de7ff-bd17-410a-9b90-24866022895d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:20.713831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:20.714768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d8ba28d0-9ff0-4af8-9e80-5918988a5f13 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:20.716822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.717047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d8ba28d0-9ff0-4af8-9e80-5918988a5f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:20.718361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.719407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] PATH_INFO: `/v3/projects/fc65c2c08bfc4fbeb4adc79b5d97fa52` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.721510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc65c2c08bfc4fbeb4adc79b5d97fa52)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:20.727096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:20.730005 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 803/1601] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:20.734342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba28d0-9ff0-4af8-9e80-5918988a5f13 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:20.747895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba28d0-9ff0-4af8-9e80-5918988a5f13 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:20.754508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91854c1f-be8c-45ee-8c3c-39c8d19185c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:20.755259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91854c1f-be8c-45ee-8c3c-39c8d19185c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.755680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91854c1f-be8c-45ee-8c3c-39c8d19185c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.756048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91854c1f-be8c-45ee-8c3c-39c8d19185c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.756884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91854c1f-be8c-45ee-8c3c-39c8d19185c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:20.757342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91854c1f-be8c-45ee-8c3c-39c8d19185c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:20.759210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91854c1f-be8c-45ee-8c3c-39c8d19185c9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:20.781542 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 804/1602] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:51:20.781542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91854c1f-be8c-45ee-8c3c-39c8d19185c9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:20.791804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91854c1f-be8c-45ee-8c3c-39c8d19185c9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:20.797598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b177-ee6a-46ce-95cc-a194410d0685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:20.798290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b177-ee6a-46ce-95cc-a194410d0685 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.798640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b177-ee6a-46ce-95cc-a194410d0685 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.798981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d0b177-ee6a-46ce-95cc-a194410d0685 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.799973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0b177-ee6a-46ce-95cc-a194410d0685 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:20.802218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d0b177-ee6a-46ce-95cc-a194410d0685 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:20.847633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc65c2c08bfc4fbeb4adc79b5d97fa52', 'request_id': 'req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.856256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc65c2c08bfc4fbeb4adc79b5d97fa52', 'request_id': 'req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.861497 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 805/1603] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:20 2022] POST /identity/v3/projects => generated 379 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:20.863088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b177-ee6a-46ce-95cc-a194410d0685 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:20.867882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc65c2c08bfc4fbeb4adc79b5d97fa52', 'request_id': 'req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.893545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] The token cache is being invalidate because project fc65c2c08bfc4fbeb4adc79b5d97fa52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:20.894485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.896177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b793f102-9a3c-4f2a-bd5e-7f26b2e4e675 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:20.899117 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 799/1604] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:20 2022] DELETE /identity/v3/projects/fc65c2c08bfc4fbeb4adc79b5d97fa52 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:20.904634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a5bf-20e2-4066-af05-34e0452aaec6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.905449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a5bf-20e2-4066-af05-34e0452aaec6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.905909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0358a5bf-20e2-4066-af05-34e0452aaec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.919178 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:20.944027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0358a5bf-20e2-4066-af05-34e0452aaec6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:20.946452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0358a5bf-20e2-4066-af05-34e0452aaec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:20.961861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d0b177-ee6a-46ce-95cc-a194410d0685 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:20.968464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d20d6-216a-4a4f-a69e-59e994efba58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:20.969521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d20d6-216a-4a4f-a69e-59e994efba58 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:20.969677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d20d6-216a-4a4f-a69e-59e994efba58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:20.970281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3d20d6-216a-4a4f-a69e-59e994efba58 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:20.970570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d20d6-216a-4a4f-a69e-59e994efba58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:20.972757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3d20d6-216a-4a4f-a69e-59e994efba58 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.025241 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 806/1605] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:20 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:21.026700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d20d6-216a-4a4f-a69e-59e994efba58 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.028929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d3d20d6-216a-4a4f-a69e-59e994efba58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:21.044469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3d20d6-216a-4a4f-a69e-59e994efba58 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.050156 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 800/1606] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:21.067512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d643f16-5bda-481a-8d5e-4078c93c2cbd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.067798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d643f16-5bda-481a-8d5e-4078c93c2cbd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.068019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6461e-036a-4939-ab55-6bbd35824d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.068134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d643f16-5bda-481a-8d5e-4078c93c2cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.069517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6461e-036a-4939-ab55-6bbd35824d32 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.070117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6461e-036a-4939-ab55-6bbd35824d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.070561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c6461e-036a-4939-ab55-6bbd35824d32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.072318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6461e-036a-4939-ab55-6bbd35824d32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.074149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c6461e-036a-4939-ab55-6bbd35824d32 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.103014 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 807/1607] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:21.106495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6461e-036a-4939-ab55-6bbd35824d32 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.115956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9d643f16-5bda-481a-8d5e-4078c93c2cbd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:21.117999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9d643f16-5bda-481a-8d5e-4078c93c2cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:21.124161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c6461e-036a-4939-ab55-6bbd35824d32 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.129207 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 801/1608] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:21.133860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748debe5-e6c6-4309-8ec1-b1155482d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.134571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748debe5-e6c6-4309-8ec1-b1155482d2ad admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.134750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748debe5-e6c6-4309-8ec1-b1155482d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.134971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748debe5-e6c6-4309-8ec1-b1155482d2ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.135631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748debe5-e6c6-4309-8ec1-b1155482d2ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.136869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d643f16-5bda-481a-8d5e-4078c93c2cbd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.139944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748debe5-e6c6-4309-8ec1-b1155482d2ad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.158021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d643f16-5bda-481a-8d5e-4078c93c2cbd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.164459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8377e6-073b-4f7c-beb2-4ee40dfa124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.165203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8377e6-073b-4f7c-beb2-4ee40dfa124f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.166000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8377e6-073b-4f7c-beb2-4ee40dfa124f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.166000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8377e6-073b-4f7c-beb2-4ee40dfa124f admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.166938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8377e6-073b-4f7c-beb2-4ee40dfa124f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:21.167344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8377e6-073b-4f7c-beb2-4ee40dfa124f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.169099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8377e6-073b-4f7c-beb2-4ee40dfa124f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.172185 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:21.183608 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 808/1609] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:51:21.185873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748debe5-e6c6-4309-8ec1-b1155482d2ad admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.193349 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 802/1610] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:21.197204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8377e6-073b-4f7c-beb2-4ee40dfa124f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.209542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8377e6-073b-4f7c-beb2-4ee40dfa124f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.210754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748debe5-e6c6-4309-8ec1-b1155482d2ad admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.217544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886736a-c7df-46cf-a8a9-882ce151177b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.218698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886736a-c7df-46cf-a8a9-882ce151177b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.219193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886736a-c7df-46cf-a8a9-882ce151177b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.219674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4886736a-c7df-46cf-a8a9-882ce151177b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.220768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886736a-c7df-46cf-a8a9-882ce151177b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.223616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4886736a-c7df-46cf-a8a9-882ce151177b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.231625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cf472d-ffba-4e62-95e9-140dd086dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.232326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf472d-ffba-4e62-95e9-140dd086dc92 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.232606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf472d-ffba-4e62-95e9-140dd086dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.232883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cf472d-ffba-4e62-95e9-140dd086dc92 admin admin] PATH_INFO: `/v3/projects/0d09d5c75d2a49aaa59afa04cbf9900f/users/b930cfd32eab435f96cb4ab8ae622bb6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.280424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf472d-ffba-4e62-95e9-140dd086dc92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d09d5c75d2a49aaa59afa04cbf9900f, user_id=b930cfd32eab435f96cb4ab8ae622bb6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.284897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73cf472d-ffba-4e62-95e9-140dd086dc92 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.306159 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 803/1611] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:21 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:21.307358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886736a-c7df-46cf-a8a9-882ce151177b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.324108 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 809/1612] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:21 2022] PUT /identity/v3/projects/0d09d5c75d2a49aaa59afa04cbf9900f/users/b930cfd32eab435f96cb4ab8ae622bb6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:21.328520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6f1be-6091-4705-8297-9aa68b31fbb3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.330518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6f1be-6091-4705-8297-9aa68b31fbb3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.331653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6f1be-6091-4705-8297-9aa68b31fbb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.370342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0ce6f1be-6091-4705-8297-9aa68b31fbb3 None None] MFA Rules not processed for user `b930cfd32eab435f96cb4ab8ae622bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:21.372168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0ce6f1be-6091-4705-8297-9aa68b31fbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:21.469544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4886736a-c7df-46cf-a8a9-882ce151177b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.493478 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 810/1613] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:21.510244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6f1be-6091-4705-8297-9aa68b31fbb3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.512346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0ce6f1be-6091-4705-8297-9aa68b31fbb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:21.579142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a72708-580c-4f18-9b39-50d32dc790e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.582085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a72708-580c-4f18-9b39-50d32dc790e1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.582567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a72708-580c-4f18-9b39-50d32dc790e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.582983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a72708-580c-4f18-9b39-50d32dc790e1 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.584017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a72708-580c-4f18-9b39-50d32dc790e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.594424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a72708-580c-4f18-9b39-50d32dc790e1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.642755 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 804/1614] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:21 2022] POST /identity/v3/users => generated 287 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:21.643957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a72708-580c-4f18-9b39-50d32dc790e1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.664326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a72708-580c-4f18-9b39-50d32dc790e1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.670990 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:21.676885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f319d-b5b9-4d75-a822-d83c007b41d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.677769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f319d-b5b9-4d75-a822-d83c007b41d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.678157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f319d-b5b9-4d75-a822-d83c007b41d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.678434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3f319d-b5b9-4d75-a822-d83c007b41d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.679092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f319d-b5b9-4d75-a822-d83c007b41d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.681067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3f319d-b5b9-4d75-a822-d83c007b41d2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.685124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6f1be-6091-4705-8297-9aa68b31fbb3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.701965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadda207-2f9f-4517-afab-17e1a4a39ccc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.702184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadda207-2f9f-4517-afab-17e1a4a39ccc service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.702349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadda207-2f9f-4517-afab-17e1a4a39ccc service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.702743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadda207-2f9f-4517-afab-17e1a4a39ccc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.702897 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 805/1615] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:21.704360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f319d-b5b9-4d75-a822-d83c007b41d2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.720006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3f319d-b5b9-4d75-a822-d83c007b41d2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.721775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadda207-2f9f-4517-afab-17e1a4a39ccc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.726442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadda207-2f9f-4517-afab-17e1a4a39ccc service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.727181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa31f6-f745-497c-b7b8-1d3bbf23a7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.728407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa31f6-f745-497c-b7b8-1d3bbf23a7d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.728891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa31f6-f745-497c-b7b8-1d3bbf23a7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.729366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa31f6-f745-497c-b7b8-1d3bbf23a7d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.730172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa31f6-f745-497c-b7b8-1d3bbf23a7d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.731986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa31f6-f745-497c-b7b8-1d3bbf23a7d7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.751607 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 806/1616] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:21.752736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa31f6-f745-497c-b7b8-1d3bbf23a7d7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:21.765146 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 811/1617] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:21.765906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa31f6-f745-497c-b7b8-1d3bbf23a7d7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:21.781979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9911a9-148c-44e8-9dbc-fb68290838cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:21.781979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9911a9-148c-44e8-9dbc-fb68290838cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.781979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9911a9-148c-44e8-9dbc-fb68290838cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.781979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9911a9-148c-44e8-9dbc-fb68290838cd admin admin] PATH_INFO: `/v3/projects/ebe64af26110447790eb20d2352046f9/users/8b95bf90ebd142c280147e2b43f24a7d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.814016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9911a9-148c-44e8-9dbc-fb68290838cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebe64af26110447790eb20d2352046f9, user_id=8b95bf90ebd142c280147e2b43f24a7d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:21.821683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9911a9-148c-44e8-9dbc-fb68290838cd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:21.854369 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 807/1618] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:21 2022] PUT /identity/v3/projects/ebe64af26110447790eb20d2352046f9/users/8b95bf90ebd142c280147e2b43f24a7d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:21.865371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b511de-6965-477f-9796-4c1c86cd2a95 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:21.866847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b511de-6965-477f-9796-4c1c86cd2a95 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:21.867284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b511de-6965-477f-9796-4c1c86cd2a95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:21.944941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b5b511de-6965-477f-9796-4c1c86cd2a95 None None] MFA Rules not processed for user `8b95bf90ebd142c280147e2b43f24a7d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:21.946642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b5b511de-6965-477f-9796-4c1c86cd2a95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:22.084874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788190-abed-4be0-9f95-99636c28f14e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:22.085608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788190-abed-4be0-9f95-99636c28f14e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:22.086085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788190-abed-4be0-9f95-99636c28f14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:22.104001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 812/1619] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:22.105308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b511de-6965-477f-9796-4c1c86cd2a95 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:22.116018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7c788190-abed-4be0-9f95-99636c28f14e None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:22.118202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7c788190-abed-4be0-9f95-99636c28f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:22.156079 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:22.213553 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 808/1620] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:51:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:22.230172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788190-abed-4be0-9f95-99636c28f14e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:22.232000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b511de-6965-477f-9796-4c1c86cd2a95 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:22.232332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7c788190-abed-4be0-9f95-99636c28f14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:22.236901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f799d2-c826-4e27-ad43-cac0b33a90cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:22.237642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f799d2-c826-4e27-ad43-cac0b33a90cd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:22.237993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f799d2-c826-4e27-ad43-cac0b33a90cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:22.238336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f799d2-c826-4e27-ad43-cac0b33a90cd admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:22.239709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f799d2-c826-4e27-ad43-cac0b33a90cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:22.241955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f799d2-c826-4e27-ad43-cac0b33a90cd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:22.283651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 813/1621] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:22 2022] POST /identity/v3/projects => generated 375 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:51:22.285144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f799d2-c826-4e27-ad43-cac0b33a90cd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:22.383082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f799d2-c826-4e27-ad43-cac0b33a90cd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:22.389107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be58a3-b04a-445b-8ad6-830a77d7de48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:22.389867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be58a3-b04a-445b-8ad6-830a77d7de48 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:22.390807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be58a3-b04a-445b-8ad6-830a77d7de48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:22.390807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be58a3-b04a-445b-8ad6-830a77d7de48 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:22.391330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be58a3-b04a-445b-8ad6-830a77d7de48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:22.393448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6be58a3-b04a-445b-8ad6-830a77d7de48 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:22.406074 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:22.412239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788190-abed-4be0-9f95-99636c28f14e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:22.431219 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 814/1622] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:22 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:22.432274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be58a3-b04a-445b-8ad6-830a77d7de48 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:22.435388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a6be58a3-b04a-445b-8ad6-830a77d7de48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:22.524660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e007d19-7c88-4637-8302-96a737b439dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:22.525760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e007d19-7c88-4637-8302-96a737b439dd service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:22.526904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e007d19-7c88-4637-8302-96a737b439dd service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:22.527287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e007d19-7c88-4637-8302-96a737b439dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:22.613930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6be58a3-b04a-445b-8ad6-830a77d7de48 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:22.627688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e007d19-7c88-4637-8302-96a737b439dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:22.628068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b820b-df72-4e4b-9a00-11f0b395cd9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:22.628809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b820b-df72-4e4b-9a00-11f0b395cd9e service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:22.629963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b820b-df72-4e4b-9a00-11f0b395cd9e service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:22.630357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76b820b-df72-4e4b-9a00-11f0b395cd9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:22.632880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e007d19-7c88-4637-8302-96a737b439dd service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:22.637349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c76b820b-df72-4e4b-9a00-11f0b395cd9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:22.652108 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 809/1623] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:51:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 08:51:22.654103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e007d19-7c88-4637-8302-96a737b439dd service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:22.683610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e007d19-7c88-4637-8302-96a737b439dd service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:22.695361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c012e-1368-44ff-ac7d-ce1021066bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:22.696315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c012e-1368-44ff-ac7d-ce1021066bb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:22.696660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c012e-1368-44ff-ac7d-ce1021066bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:22.696992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c012e-1368-44ff-ac7d-ce1021066bb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:22.697951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c012e-1368-44ff-ac7d-ce1021066bb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:22.700298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c012e-1368-44ff-ac7d-ce1021066bb8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:22.719964 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 810/1624] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:22.723304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c012e-1368-44ff-ac7d-ce1021066bb8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:22.735757 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:22.763651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c012e-1368-44ff-ac7d-ce1021066bb8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:22.776443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbde1c37-b85a-4794-b02b-bcf0297867ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:22.778438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde1c37-b85a-4794-b02b-bcf0297867ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:22.778882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde1c37-b85a-4794-b02b-bcf0297867ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:22.779303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbde1c37-b85a-4794-b02b-bcf0297867ed admin admin] PATH_INFO: `/v3/projects/338b7af57d364feb8c119442c548896d/users/d8ba5f69e95a494c970a22f3ca0674cc/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:22.830367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b820b-df72-4e4b-9a00-11f0b395cd9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:22.832114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76b820b-df72-4e4b-9a00-11f0b395cd9e service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:22.848588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde1c37-b85a-4794-b02b-bcf0297867ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=338b7af57d364feb8c119442c548896d, user_id=d8ba5f69e95a494c970a22f3ca0674cc, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:22.857034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbde1c37-b85a-4794-b02b-bcf0297867ed admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:22.866444 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 815/1625] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:22.888010 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 811/1626] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:22 2022] PUT /identity/v3/projects/338b7af57d364feb8c119442c548896d/users/d8ba5f69e95a494c970a22f3ca0674cc/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:22.893652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b820b-df72-4e4b-9a00-11f0b395cd9e service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:22.912825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76b820b-df72-4e4b-9a00-11f0b395cd9e service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:22.982064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1a02-e885-45a7-aa1a-e814d6594774 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:22.982933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1a02-e885-45a7-aa1a-e814d6594774 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:22.983273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ca1a02-e885-45a7-aa1a-e814d6594774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:23.025053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c7ca1a02-e885-45a7-aa1a-e814d6594774 None None] MFA Rules not processed for user `b930cfd32eab435f96cb4ab8ae622bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:23.030478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c7ca1a02-e885-45a7-aa1a-e814d6594774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:23.074651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9be65-0274-493b-b8a8-7ff0ff4d8ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:23.076514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9be65-0274-493b-b8a8-7ff0ff4d8ec3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:23.077028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9be65-0274-493b-b8a8-7ff0ff4d8ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:23.077836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef9be65-0274-493b-b8a8-7ff0ff4d8ec3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:23.078820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9be65-0274-493b-b8a8-7ff0ff4d8ec3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:23.083355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef9be65-0274-493b-b8a8-7ff0ff4d8ec3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:23.105438 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 816/1627] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:22 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:23.110061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9be65-0274-493b-b8a8-7ff0ff4d8ec3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:23.129509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef9be65-0274-493b-b8a8-7ff0ff4d8ec3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:23.138206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e44025-6a81-43a3-a675-f1b56207433d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:23.141653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44025-6a81-43a3-a675-f1b56207433d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:23.151924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44025-6a81-43a3-a675-f1b56207433d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:23.153711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e44025-6a81-43a3-a675-f1b56207433d admin admin] PATH_INFO: `/v3/projects/338b7af57d364feb8c119442c548896d/users/d8ba5f69e95a494c970a22f3ca0674cc/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:23.156462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e44025-6a81-43a3-a675-f1b56207433d admin admin] RBAC: Authorizing `identity:create_grant(project_id=338b7af57d364feb8c119442c548896d, user_id=d8ba5f69e95a494c970a22f3ca0674cc, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:23.170467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e44025-6a81-43a3-a675-f1b56207433d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:23.225858 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 817/1628] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:23 2022] PUT /identity/v3/projects/338b7af57d364feb8c119442c548896d/users/d8ba5f69e95a494c970a22f3ca0674cc/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:23.228523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541b00-3144-4fbb-907d-467ffc91561a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:23.228812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541b00-3144-4fbb-907d-467ffc91561a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:23.229093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3541b00-3144-4fbb-907d-467ffc91561a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:23.230082 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 812/1629] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:23.257536 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:23.275561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a3541b00-3144-4fbb-907d-467ffc91561a None None] MFA Rules not processed for user `d8ba5f69e95a494c970a22f3ca0674cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:23.278914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a3541b00-3144-4fbb-907d-467ffc91561a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:23.410290 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 818/1630] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:23.429436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1a02-e885-45a7-aa1a-e814d6594774 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:23.668640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ca1a02-e885-45a7-aa1a-e814d6594774 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:23.684992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c6a5a-85dc-4a86-a8fc-c04c318a9055 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:23.685761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c6a5a-85dc-4a86-a8fc-c04c318a9055 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:23.686114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c6a5a-85dc-4a86-a8fc-c04c318a9055 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:23.686469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c6a5a-85dc-4a86-a8fc-c04c318a9055 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:23.687256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c6a5a-85dc-4a86-a8fc-c04c318a9055 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:23.687645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c6a5a-85dc-4a86-a8fc-c04c318a9055 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:23.689704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c6a5a-85dc-4a86-a8fc-c04c318a9055 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:23.712178 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 813/1631] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:23.716380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3541b00-3144-4fbb-907d-467ffc91561a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:23.730079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3541b00-3144-4fbb-907d-467ffc91561a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:23.747110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3f42f1-1fb0-43c9-8684-0e5a1cebf14f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:23.748267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f42f1-1fb0-43c9-8684-0e5a1cebf14f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:23.748762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f42f1-1fb0-43c9-8684-0e5a1cebf14f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:23.749451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3f42f1-1fb0-43c9-8684-0e5a1cebf14f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:23.750402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f42f1-1fb0-43c9-8684-0e5a1cebf14f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:23.753955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3f42f1-1fb0-43c9-8684-0e5a1cebf14f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:23.849001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 819/1632] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:23 2022] POST /identity/v3/projects => generated 371 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:51:23.853552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c6a5a-85dc-4a86-a8fc-c04c318a9055 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:23.886281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c6a5a-85dc-4a86-a8fc-c04c318a9055 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:24.056851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264fe7c-616e-4ed7-a7f2-fabb2864ef6d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.056851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264fe7c-616e-4ed7-a7f2-fabb2864ef6d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.056851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264fe7c-616e-4ed7-a7f2-fabb2864ef6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.091298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e264fe7c-616e-4ed7-a7f2-fabb2864ef6d None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:24.092600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e264fe7c-616e-4ed7-a7f2-fabb2864ef6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:24.098044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda60b19-e1a7-4647-8b73-e4fedb13e873 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:24.098743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda60b19-e1a7-4647-8b73-e4fedb13e873 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.099095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda60b19-e1a7-4647-8b73-e4fedb13e873 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.099443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda60b19-e1a7-4647-8b73-e4fedb13e873 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.100355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda60b19-e1a7-4647-8b73-e4fedb13e873 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:24.100777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda60b19-e1a7-4647-8b73-e4fedb13e873 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:24.102555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda60b19-e1a7-4647-8b73-e4fedb13e873 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:24.126831 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 814/1633] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:24.138697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda60b19-e1a7-4647-8b73-e4fedb13e873 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:24.155798 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:24.180563 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 820/1634] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 08:51:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:24.198401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264fe7c-616e-4ed7-a7f2-fabb2864ef6d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:24.243817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda60b19-e1a7-4647-8b73-e4fedb13e873 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:24.250381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bcb802-fc3d-4b0c-993c-6e7ed7e945ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:24.251379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcb802-fc3d-4b0c-993c-6e7ed7e945ea service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.251638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcb802-fc3d-4b0c-993c-6e7ed7e945ea service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.252199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bcb802-fc3d-4b0c-993c-6e7ed7e945ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.263533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcb802-fc3d-4b0c-993c-6e7ed7e945ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:24.265332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bcb802-fc3d-4b0c-993c-6e7ed7e945ea service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:24.279791 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 815/1635] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:24.290970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e264fe7c-616e-4ed7-a7f2-fabb2864ef6d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:24.296669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151750ff-7084-4dca-97a2-d072b3c21763 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:24.296838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479316b-4b2f-4228-a7bf-75d461c1d4ab None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.297125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479316b-4b2f-4228-a7bf-75d461c1d4ab None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.297284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151750ff-7084-4dca-97a2-d072b3c21763 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.297483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e479316b-4b2f-4228-a7bf-75d461c1d4ab None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.297633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151750ff-7084-4dca-97a2-d072b3c21763 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.297870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151750ff-7084-4dca-97a2-d072b3c21763 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.299321 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 816/1636] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:51:24.305565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479316b-4b2f-4228-a7bf-75d461c1d4ab None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:24.311123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151750ff-7084-4dca-97a2-d072b3c21763 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:24.312756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151750ff-7084-4dca-97a2-d072b3c21763 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:24.323499 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 821/1637] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:51:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:24.323872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479316b-4b2f-4228-a7bf-75d461c1d4ab None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:24.335779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e479316b-4b2f-4228-a7bf-75d461c1d4ab None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:24.340638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40928c-a8b0-421e-bf21-6fa4d0083eae tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:24.341223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40928c-a8b0-421e-bf21-6fa4d0083eae tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.341539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40928c-a8b0-421e-bf21-6fa4d0083eae tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.341792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40928c-a8b0-421e-bf21-6fa4d0083eae tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/144b2061817342f9924a79b5a5629df4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.342895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40928c-a8b0-421e-bf21-6fa4d0083eae tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=144b2061817342f9924a79b5a5629df4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:24.344986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb40928c-a8b0-421e-bf21-6fa4d0083eae tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:24.353669 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 817/1638] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:24 2022] GET /identity/v3/projects/144b2061817342f9924a79b5a5629df4 => generated 371 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:51:24.388606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7619-af7e-4c99-ab88-cb79b32bd86e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.388897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7619-af7e-4c99-ab88-cb79b32bd86e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.389710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dd7619-af7e-4c99-ab88-cb79b32bd86e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.391033 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 822/1639] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:24.397394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40928c-a8b0-421e-bf21-6fa4d0083eae tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:24.411202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40928c-a8b0-421e-bf21-6fa4d0083eae tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:24.420804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb40928c-a8b0-421e-bf21-6fa4d0083eae tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:24.425817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff07d8b-6278-4906-b4b9-ba3b61ce79cc tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:24.426690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff07d8b-6278-4906-b4b9-ba3b61ce79cc tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.427562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff07d8b-6278-4906-b4b9-ba3b61ce79cc tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.428538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff07d8b-6278-4906-b4b9-ba3b61ce79cc tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/144b2061817342f9924a79b5a5629df4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.429866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff07d8b-6278-4906-b4b9-ba3b61ce79cc tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=144b2061817342f9924a79b5a5629df4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:24.432143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff07d8b-6278-4906-b4b9-ba3b61ce79cc tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:24.438770 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 818/1640] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:24 2022] GET /identity/v3/projects/144b2061817342f9924a79b5a5629df4 => generated 371 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:24.448965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd7619-af7e-4c99-ab88-cb79b32bd86e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:24.460958 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:24.537126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dd7619-af7e-4c99-ab88-cb79b32bd86e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:24.543554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:24.544377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.544667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.544945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] PATH_INFO: `/v3/users/b930cfd32eab435f96cb4ab8ae622bb6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.546273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b930cfd32eab435f96cb4ab8ae622bb6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:24.548253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:24.591448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517c8de-4dd9-492a-b1bc-f7622b3c60b6 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.592871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517c8de-4dd9-492a-b1bc-f7622b3c60b6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.593318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0517c8de-4dd9-492a-b1bc-f7622b3c60b6 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.595130 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 819/1641] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:51:24.600573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517c8de-4dd9-492a-b1bc-f7622b3c60b6 None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:24.613755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b930cfd32eab435f96cb4ab8ae622bb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:24.617426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517c8de-4dd9-492a-b1bc-f7622b3c60b6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:24.629070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b930cfd32eab435f96cb4ab8ae622bb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:24.629890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b930cfd32eab435f96cb4ab8ae622bb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:24.634648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0517c8de-4dd9-492a-b1bc-f7622b3c60b6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:24.642091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6100ea-b06a-44b8-b5e9-b1422519ac79 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:24.642778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6100ea-b06a-44b8-b5e9-b1422519ac79 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.643138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6100ea-b06a-44b8-b5e9-b1422519ac79 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.645107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b930cfd32eab435f96cb4ab8ae622bb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:24.646825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6100ea-b06a-44b8-b5e9-b1422519ac79 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/144b2061817342f9924a79b5a5629df4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.648163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6100ea-b06a-44b8-b5e9-b1422519ac79 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=144b2061817342f9924a79b5a5629df4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:24.650303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6100ea-b06a-44b8-b5e9-b1422519ac79 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:24.652031 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 820/1642] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:24 2022] GET /identity/v3/projects/144b2061817342f9924a79b5a5629df4 => generated 371 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:51:24.662964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63943fc2-fc7c-4edc-94aa-4d9445671f64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b930cfd32eab435f96cb4ab8ae622bb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:24.680351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6100ea-b06a-44b8-b5e9-b1422519ac79 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:24.682207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3a6100ea-b06a-44b8-b5e9-b1422519ac79 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:24.692059 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 823/1643] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:24 2022] DELETE /identity/v3/users/b930cfd32eab435f96cb4ab8ae622bb6 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:24.697266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43430d-0a52-4081-a20e-5d99bbc1a568 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.697584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43430d-0a52-4081-a20e-5d99bbc1a568 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.697869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce43430d-0a52-4081-a20e-5d99bbc1a568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.713917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6100ea-b06a-44b8-b5e9-b1422519ac79 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:24.788643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ce43430d-0a52-4081-a20e-5d99bbc1a568 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:24.792625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ce43430d-0a52-4081-a20e-5d99bbc1a568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:24.829686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:24.830699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:24.831173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:24.831794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/144b2061817342f9924a79b5a5629df4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:24.834924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:delete_project(project_id=144b2061817342f9924a79b5a5629df4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:24.837258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:24.960875 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 824/1644] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:24.965545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '144b2061817342f9924a79b5a5629df4', 'request_id': 'req-bb47b91d-ec69-4089-aad5-1ebb583a67c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:24.975675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '144b2061817342f9924a79b5a5629df4', 'request_id': 'req-bb47b91d-ec69-4089-aad5-1ebb583a67c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:24.991788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43430d-0a52-4081-a20e-5d99bbc1a568 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:24.993385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ce43430d-0a52-4081-a20e-5d99bbc1a568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:24.994370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '144b2061817342f9924a79b5a5629df4', 'request_id': 'req-bb47b91d-ec69-4089-aad5-1ebb583a67c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:25.018003 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:25.049922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] The token cache is being invalidate because project 144b2061817342f9924a79b5a5629df4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:25.050527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:25.052503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb47b91d-ec69-4089-aad5-1ebb583a67c1 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:25.055932 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 821/1645] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:24 2022] DELETE /identity/v3/projects/144b2061817342f9924a79b5a5629df4 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:25.080351 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:25.157463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce43430d-0a52-4081-a20e-5d99bbc1a568 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:25.250774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:25.251590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:25.251974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:25.252399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:25.254492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:25.335712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:25.337467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:25.356037 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 825/1646] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:51:25.461789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d7e0d-17db-4bec-bcbf-5f29c1519cd0 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:25.462290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d7e0d-17db-4bec-bcbf-5f29c1519cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:25.462378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7d7e0d-17db-4bec-bcbf-5f29c1519cd0 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:25.464390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 822/1647] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:25.479649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:25.481410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:25.666047 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Oct 24 08:51:25.668960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:25.670768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:25.732450 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:25.823128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d6b27f-c01e-4312-ac56-8cc524f30692 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:25.834059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c11162-00c3-43e7-a3c4-bc434098ff4a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:25.835252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c11162-00c3-43e7-a3c4-bc434098ff4a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:25.836168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c11162-00c3-43e7-a3c4-bc434098ff4a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:25.836168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c11162-00c3-43e7-a3c4-bc434098ff4a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/ebe64af26110447790eb20d2352046f9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:25.837254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c11162-00c3-43e7-a3c4-bc434098ff4a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=ebe64af26110447790eb20d2352046f9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:25.839683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c11162-00c3-43e7-a3c4-bc434098ff4a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:25.841358 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 826/1648] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:25 2022] GET /identity/v3/projects/ebe64af26110447790eb20d2352046f9 => generated 373 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:25.870715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d7e0d-17db-4bec-bcbf-5f29c1519cd0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:25.903494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7d7e0d-17db-4bec-bcbf-5f29c1519cd0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:25.917534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d426ca-b17f-4d68-a4ac-d5ff5a3d022a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:25.918535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d426ca-b17f-4d68-a4ac-d5ff5a3d022a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:25.918968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d426ca-b17f-4d68-a4ac-d5ff5a3d022a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:25.919391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d426ca-b17f-4d68-a4ac-d5ff5a3d022a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:25.920206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d426ca-b17f-4d68-a4ac-d5ff5a3d022a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:25.922044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d426ca-b17f-4d68-a4ac-d5ff5a3d022a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:25.925679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d426ca-b17f-4d68-a4ac-d5ff5a3d022a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:25.958765 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 823/1649] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:25.963108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c11162-00c3-43e7-a3c4-bc434098ff4a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:25.978341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c11162-00c3-43e7-a3c4-bc434098ff4a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:25.991795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631636c-39f5-4784-859b-ebb61a510c77 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:25.992828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631636c-39f5-4784-859b-ebb61a510c77 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:25.993348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631636c-39f5-4784-859b-ebb61a510c77 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:25.993844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631636c-39f5-4784-859b-ebb61a510c77 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:25.994797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631636c-39f5-4784-859b-ebb61a510c77 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:26.002317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631636c-39f5-4784-859b-ebb61a510c77 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:26.082114 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 827/1650] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:25 2022] POST /identity/v3/projects => generated 371 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:26.083650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d426ca-b17f-4d68-a4ac-d5ff5a3d022a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:26.099903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d426ca-b17f-4d68-a4ac-d5ff5a3d022a tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:26.273882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f0447-fdd6-4608-9f39-1d0325afa8d3 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:26.292074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0447-fdd6-4608-9f39-1d0325afa8d3 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:26.292370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0447-fdd6-4608-9f39-1d0325afa8d3 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:26.293907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f0447-fdd6-4608-9f39-1d0325afa8d3 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:26.294631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f0447-fdd6-4608-9f39-1d0325afa8d3 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:26.294999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f0447-fdd6-4608-9f39-1d0325afa8d3 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:26.296656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f0447-fdd6-4608-9f39-1d0325afa8d3 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:26.325351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631636c-39f5-4784-859b-ebb61a510c77 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:26.327841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f631636c-39f5-4784-859b-ebb61a510c77 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:26.341505 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 824/1651] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:26.425582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2616e-937f-4f03-b0c8-9105e444c2a3 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:26.425582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2616e-937f-4f03-b0c8-9105e444c2a3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:26.426021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c2616e-937f-4f03-b0c8-9105e444c2a3 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:26.428805 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 825/1652] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:26.438622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2616e-937f-4f03-b0c8-9105e444c2a3 None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:26.474427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631636c-39f5-4784-859b-ebb61a510c77 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:26.486204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:26.487584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:26.488389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:26.489513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] PATH_INFO: `/v3/projects/0d09d5c75d2a49aaa59afa04cbf9900f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:26.492041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d09d5c75d2a49aaa59afa04cbf9900f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:26.494563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:26.555300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2616e-937f-4f03-b0c8-9105e444c2a3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:26.567535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c2616e-937f-4f03-b0c8-9105e444c2a3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:26.580913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d09d5c75d2a49aaa59afa04cbf9900f', 'request_id': 'req-57073fd2-b3d2-45e6-b6ff-66da67974ab1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:26.594411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d09d5c75d2a49aaa59afa04cbf9900f', 'request_id': 'req-57073fd2-b3d2-45e6-b6ff-66da67974ab1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:26.626367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d09d5c75d2a49aaa59afa04cbf9900f', 'request_id': 'req-57073fd2-b3d2-45e6-b6ff-66da67974ab1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:26.663037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] The token cache is being invalidate because project 0d09d5c75d2a49aaa59afa04cbf9900f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:26.663339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:26.664030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-57073fd2-b3d2-45e6-b6ff-66da67974ab1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:26.669023 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 828/1653] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:26 2022] DELETE /identity/v3/projects/0d09d5c75d2a49aaa59afa04cbf9900f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:26.670739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8686179-7eba-4db0-8f3d-d5e36f6b5ffb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:26.671071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8686179-7eba-4db0-8f3d-d5e36f6b5ffb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:26.671349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8686179-7eba-4db0-8f3d-d5e36f6b5ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:26.696857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e8686179-7eba-4db0-8f3d-d5e36f6b5ffb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:26.699787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e8686179-7eba-4db0-8f3d-d5e36f6b5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:26.720876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bafbe9-a598-4fef-af1f-0d8e714f9501 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:26.721653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bafbe9-a598-4fef-af1f-0d8e714f9501 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:26.722752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bafbe9-a598-4fef-af1f-0d8e714f9501 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:26.723536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bafbe9-a598-4fef-af1f-0d8e714f9501 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/7062978dec4f48f196a1ce48632d7076` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:26.726460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bafbe9-a598-4fef-af1f-0d8e714f9501 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=7062978dec4f48f196a1ce48632d7076)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:26.730581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bafbe9-a598-4fef-af1f-0d8e714f9501 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:26.747734 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 826/1654] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:26 2022] GET /identity/v3/projects/7062978dec4f48f196a1ce48632d7076 => generated 371 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:26.773371 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:26.887281 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 829/1655] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:26.894874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d9118-3057-444d-a233-e6bf047e002a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:26.895164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d9118-3057-444d-a233-e6bf047e002a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:26.895443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658d9118-3057-444d-a233-e6bf047e002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:26.916505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c205-8356-43c5-906e-9b2a3111e696 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:26.916796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c205-8356-43c5-906e-9b2a3111e696 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:26.917073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a513c205-8356-43c5-906e-9b2a3111e696 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:26.925434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 830/1656] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:26 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:26.933716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c205-8356-43c5-906e-9b2a3111e696 None None] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:26.937487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a513c205-8356-43c5-906e-9b2a3111e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:26.948297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-658d9118-3057-444d-a233-e6bf047e002a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:26.949568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-658d9118-3057-444d-a233-e6bf047e002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:26.982706 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 827/1657] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:26.983663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d9118-3057-444d-a233-e6bf047e002a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.018511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658d9118-3057-444d-a233-e6bf047e002a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.033282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da7d4-941d-4461-9e67-3c5a669ec077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.034055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da7d4-941d-4461-9e67-3c5a669ec077 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.034411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da7d4-941d-4461-9e67-3c5a669ec077 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.034815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5da7d4-941d-4461-9e67-3c5a669ec077 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.035584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5da7d4-941d-4461-9e67-3c5a669ec077 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:27.035993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5da7d4-941d-4461-9e67-3c5a669ec077 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.038279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5da7d4-941d-4461-9e67-3c5a669ec077 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.052536 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:27.068715 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 828/1658] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:27.069982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da7d4-941d-4461-9e67-3c5a669ec077 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.093495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5da7d4-941d-4461-9e67-3c5a669ec077 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.095628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c205-8356-43c5-906e-9b2a3111e696 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.097337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a513c205-8356-43c5-906e-9b2a3111e696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:27.108288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e7935-93d3-4139-9291-3c06c59afdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.109078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e7935-93d3-4139-9291-3c06c59afdf6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.109503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e7935-93d3-4139-9291-3c06c59afdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.109808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075e7935-93d3-4139-9291-3c06c59afdf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.110523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e7935-93d3-4139-9291-3c06c59afdf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.113237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075e7935-93d3-4139-9291-3c06c59afdf6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.116156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a513c205-8356-43c5-906e-9b2a3111e696 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.123304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f34d96-b8ec-444b-8134-905b864d3c4e tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.124064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f34d96-b8ec-444b-8134-905b864d3c4e tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.124607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f34d96-b8ec-444b-8134-905b864d3c4e tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.124903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f34d96-b8ec-444b-8134-905b864d3c4e tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/7062978dec4f48f196a1ce48632d7076` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.126268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f34d96-b8ec-444b-8134-905b864d3c4e tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=7062978dec4f48f196a1ce48632d7076)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.128535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f34d96-b8ec-444b-8134-905b864d3c4e tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.131567 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 831/1659] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:26 2022] GET /identity/v3/projects/7062978dec4f48f196a1ce48632d7076 => generated 371 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:51:27.192255 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 829/1660] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:27 2022] POST /identity/v3/projects => generated 389 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:27.197117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f34d96-b8ec-444b-8134-905b864d3c4e tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.215475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f34d96-b8ec-444b-8134-905b864d3c4e tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.219938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e7935-93d3-4139-9291-3c06c59afdf6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.325743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa423d-c0e8-49fe-bd0f-7eaed9ed5ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.332258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa423d-c0e8-49fe-bd0f-7eaed9ed5ece admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.332905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa423d-c0e8-49fe-bd0f-7eaed9ed5ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.333382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baa423d-c0e8-49fe-bd0f-7eaed9ed5ece admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.334579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa423d-c0e8-49fe-bd0f-7eaed9ed5ece admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.339054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baa423d-c0e8-49fe-bd0f-7eaed9ed5ece admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.345768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075e7935-93d3-4139-9291-3c06c59afdf6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.353854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2ccab-b3ee-4c5b-8afd-f3bea7925760 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.354475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ccab-b3ee-4c5b-8afd-f3bea7925760 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.354755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ccab-b3ee-4c5b-8afd-f3bea7925760 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.355081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ccab-b3ee-4c5b-8afd-f3bea7925760 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.355687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2ccab-b3ee-4c5b-8afd-f3bea7925760 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:27.355993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2ccab-b3ee-4c5b-8afd-f3bea7925760 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.357628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac2ccab-b3ee-4c5b-8afd-f3bea7925760 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.372262 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 830/1661] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:27.376981 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 832/1662] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:27 2022] POST /identity/v3/users => generated 295 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:27.377425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2ccab-b3ee-4c5b-8afd-f3bea7925760 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.380393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa423d-c0e8-49fe-bd0f-7eaed9ed5ece admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.393229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baa423d-c0e8-49fe-bd0f-7eaed9ed5ece admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.395070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2ccab-b3ee-4c5b-8afd-f3bea7925760 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.398963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25d54d-5972-4598-b90f-6d6ab7aff6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.399693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25d54d-5972-4598-b90f-6d6ab7aff6ca admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.400367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25d54d-5972-4598-b90f-6d6ab7aff6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.400367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee25d54d-5972-4598-b90f-6d6ab7aff6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.401063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68c2e0-92e9-4da2-aa21-3b7983c2ed02 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.401191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25d54d-5972-4598-b90f-6d6ab7aff6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.401833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68c2e0-92e9-4da2-aa21-3b7983c2ed02 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.402474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68c2e0-92e9-4da2-aa21-3b7983c2ed02 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.402683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d68c2e0-92e9-4da2-aa21-3b7983c2ed02 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.403038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee25d54d-5972-4598-b90f-6d6ab7aff6ca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.403610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68c2e0-92e9-4da2-aa21-3b7983c2ed02 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.406446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d68c2e0-92e9-4da2-aa21-3b7983c2ed02 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.414805 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 833/1663] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:51:27.418957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25d54d-5972-4598-b90f-6d6ab7aff6ca admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.430992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee25d54d-5972-4598-b90f-6d6ab7aff6ca admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.433249 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 831/1664] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:27 2022] POST /identity/v3/users => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:27.436970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808dde-6174-4615-922e-bf1647f4d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.437119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68c2e0-92e9-4da2-aa21-3b7983c2ed02 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.437857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808dde-6174-4615-922e-bf1647f4d3fb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.438208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808dde-6174-4615-922e-bf1647f4d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.438702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89808dde-6174-4615-922e-bf1647f4d3fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.439444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89808dde-6174-4615-922e-bf1647f4d3fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.441127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89808dde-6174-4615-922e-bf1647f4d3fb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.448896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d68c2e0-92e9-4da2-aa21-3b7983c2ed02 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.456595 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 834/1665] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:51:27.456745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cf610d-552a-4759-a787-b9f5d00bd4a5 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.456745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf610d-552a-4759-a787-b9f5d00bd4a5 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.456745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf610d-552a-4759-a787-b9f5d00bd4a5 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.456981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cf610d-552a-4759-a787-b9f5d00bd4a5 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.456981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf610d-552a-4759-a787-b9f5d00bd4a5 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:27.456981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf610d-552a-4759-a787-b9f5d00bd4a5 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.457424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808dde-6174-4615-922e-bf1647f4d3fb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.458044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cf610d-552a-4759-a787-b9f5d00bd4a5 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.471391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89808dde-6174-4615-922e-bf1647f4d3fb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.472633 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 832/1666] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:27.477334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1102cb-9a15-41ef-994c-16ea997b7c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.478262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1102cb-9a15-41ef-994c-16ea997b7c28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.478625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1102cb-9a15-41ef-994c-16ea997b7c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.478999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1102cb-9a15-41ef-994c-16ea997b7c28 admin admin] PATH_INFO: `/v3/projects/e306129f54ed47fc8682f46b3cb7c955/users/f30ed27bff6c406a987841dcf1ade4a1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.496954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d82d-1846-4581-b357-eefe35fc35fa None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.497450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d82d-1846-4581-b357-eefe35fc35fa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.497698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff26d82d-1846-4581-b357-eefe35fc35fa None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.498491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1102cb-9a15-41ef-994c-16ea997b7c28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e306129f54ed47fc8682f46b3cb7c955, user_id=f30ed27bff6c406a987841dcf1ade4a1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.499453 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 833/1667] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:51:27.501462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1102cb-9a15-41ef-994c-16ea997b7c28 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.507017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d82d-1846-4581-b357-eefe35fc35fa None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:27.509750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ff26d82d-1846-4581-b357-eefe35fc35fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:27.520405 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 835/1668] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:27 2022] PUT /identity/v3/projects/e306129f54ed47fc8682f46b3cb7c955/users/f30ed27bff6c406a987841dcf1ade4a1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:27.525618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e3d4-4351-4f1a-8816-a2b61056681e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.525908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e3d4-4351-4f1a-8816-a2b61056681e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.526395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe29e3d4-4351-4f1a-8816-a2b61056681e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.550499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fe29e3d4-4351-4f1a-8816-a2b61056681e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:27.551823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fe29e3d4-4351-4f1a-8816-a2b61056681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:27.559798 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:27.663845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d82d-1846-4581-b357-eefe35fc35fa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.693036 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 836/1669] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:27.699839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e3d4-4351-4f1a-8816-a2b61056681e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:27.701421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fe29e3d4-4351-4f1a-8816-a2b61056681e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:27.746957 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:27.808910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe29e3d4-4351-4f1a-8816-a2b61056681e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.814792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310049f7-5f34-4d95-8041-5e6a6d0136b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.816281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310049f7-5f34-4d95-8041-5e6a6d0136b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.816679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310049f7-5f34-4d95-8041-5e6a6d0136b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.817167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310049f7-5f34-4d95-8041-5e6a6d0136b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.823521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff26d82d-1846-4581-b357-eefe35fc35fa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:27.830369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b6374-b7b0-4e3c-a96a-45c9904e077f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:27.831763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b6374-b7b0-4e3c-a96a-45c9904e077f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:27.832148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b6374-b7b0-4e3c-a96a-45c9904e077f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:27.832605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b6374-b7b0-4e3c-a96a-45c9904e077f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/7062978dec4f48f196a1ce48632d7076` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:27.833919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b6374-b7b0-4e3c-a96a-45c9904e077f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=7062978dec4f48f196a1ce48632d7076)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.836923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b6374-b7b0-4e3c-a96a-45c9904e077f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.839187 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 834/1670] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:27 2022] GET /identity/v3/projects/7062978dec4f48f196a1ce48632d7076 => generated 371 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:27.841813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310049f7-5f34-4d95-8041-5e6a6d0136b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:27.844662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310049f7-5f34-4d95-8041-5e6a6d0136b2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:27.862953 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 837/1671] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:51:28.078967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df729e42-1d2d-4e35-9318-51e67852c526 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:28.079485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df729e42-1d2d-4e35-9318-51e67852c526 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:28.079900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df729e42-1d2d-4e35-9318-51e67852c526 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:28.082275 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 835/1672] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:28.091374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310049f7-5f34-4d95-8041-5e6a6d0136b2 service neutron] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:28.111972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310049f7-5f34-4d95-8041-5e6a6d0136b2 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:28.128600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c13fb-2b0b-497a-8a01-ae72b2cd8296 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:28.129114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c13fb-2b0b-497a-8a01-ae72b2cd8296 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:28.129488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924c13fb-2b0b-497a-8a01-ae72b2cd8296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:28.153073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310049f7-5f34-4d95-8041-5e6a6d0136b2 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:28.168117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44174541-7de0-47af-98c1-a0c360a53953 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:28.168811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44174541-7de0-47af-98c1-a0c360a53953 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:28.170645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44174541-7de0-47af-98c1-a0c360a53953 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:28.170931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44174541-7de0-47af-98c1-a0c360a53953 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/7062978dec4f48f196a1ce48632d7076` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:28.176234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-924c13fb-2b0b-497a-8a01-ae72b2cd8296 None None] MFA Rules not processed for user `327f1d46d859423982fab017258b9ada`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:28.176814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44174541-7de0-47af-98c1-a0c360a53953 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=7062978dec4f48f196a1ce48632d7076)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:28.179862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-924c13fb-2b0b-497a-8a01-ae72b2cd8296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:28.184364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44174541-7de0-47af-98c1-a0c360a53953 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:28.187442 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 838/1673] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:28 2022] GET /identity/v3/projects/7062978dec4f48f196a1ce48632d7076 => generated 371 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:28.241888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44174541-7de0-47af-98c1-a0c360a53953 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:28.265022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44174541-7de0-47af-98c1-a0c360a53953 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:28.272096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:28.273091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:28.273357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:28.273710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/users/a989d9f8e85d454c87b02a746f170b90` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:28.283492 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 836/1674] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:28.338330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a989d9f8e85d454c87b02a746f170b90)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:28.340997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:28.492745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a989d9f8e85d454c87b02a746f170b90'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.514953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a989d9f8e85d454c87b02a746f170b90'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.516091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a989d9f8e85d454c87b02a746f170b90'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.530097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a989d9f8e85d454c87b02a746f170b90'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.542295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1af605d4-2089-4cab-aacd-3cb11f43ed68 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a989d9f8e85d454c87b02a746f170b90'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.555156 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 839/1675] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:28 2022] DELETE /identity/v3/users/a989d9f8e85d454c87b02a746f170b90 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:28.555355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c13fb-2b0b-497a-8a01-ae72b2cd8296 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:28.576519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924c13fb-2b0b-497a-8a01-ae72b2cd8296 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:28.611656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0816e1-f0ee-437b-887d-8259709ea5d4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:28.611947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0816e1-f0ee-437b-887d-8259709ea5d4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:28.612225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0816e1-f0ee-437b-887d-8259709ea5d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:28.627204 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:28.655013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ac0816e1-f0ee-437b-887d-8259709ea5d4 None None] MFA Rules not processed for user `4ddd42bac53f4b43a7d3b7ff317a175b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:28.655674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ac0816e1-f0ee-437b-887d-8259709ea5d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:28.672639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:28.675439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:28.676503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:28.678773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/7062978dec4f48f196a1ce48632d7076` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:28.694978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7062978dec4f48f196a1ce48632d7076)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:28.698938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:28.788563 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 840/1676] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:28 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:28.799486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b61a-11b0-4f14-b5c2-9f94b40a4aa2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:28.800702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b61a-11b0-4f14-b5c2-9f94b40a4aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:28.800976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c01b61a-11b0-4f14-b5c2-9f94b40a4aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:28.812796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7062978dec4f48f196a1ce48632d7076', 'request_id': 'req-0eb14c60-5bfe-490d-adc1-987f32e3af64'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.822545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7062978dec4f48f196a1ce48632d7076', 'request_id': 'req-0eb14c60-5bfe-490d-adc1-987f32e3af64'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.833061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7062978dec4f48f196a1ce48632d7076', 'request_id': 'req-0eb14c60-5bfe-490d-adc1-987f32e3af64'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.839687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1c01b61a-11b0-4f14-b5c2-9f94b40a4aa2 None None] MFA Rules not processed for user `b43a269fe8b746b88c38db6b9e9bfa12`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:28.843187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c01b61a-11b0-4f14-b5c2-9f94b40a4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:28.846591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] The token cache is being invalidate because project 7062978dec4f48f196a1ce48632d7076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:28.847124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.847879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0eb14c60-5bfe-490d-adc1-987f32e3af64 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:28.855129 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 837/1677] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:28 2022] DELETE /identity/v3/projects/7062978dec4f48f196a1ce48632d7076 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:51:28.871273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc692-a4e1-4474-9c5f-ff9907126cb9 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:28.871657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc692-a4e1-4474-9c5f-ff9907126cb9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:28.872329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9bc692-a4e1-4474-9c5f-ff9907126cb9 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:28.879670 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 838/1678] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:28.882107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc692-a4e1-4474-9c5f-ff9907126cb9 None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:28.886787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9e9bc692-a4e1-4474-9c5f-ff9907126cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:28.928940 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:28.952068 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 841/1679] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:29.038937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b61a-11b0-4f14-b5c2-9f94b40a4aa2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:29.040842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c01b61a-11b0-4f14-b5c2-9f94b40a4aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:29.062026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc692-a4e1-4474-9c5f-ff9907126cb9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:29.063530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9e9bc692-a4e1-4474-9c5f-ff9907126cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:29.071165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c01b61a-11b0-4f14-b5c2-9f94b40a4aa2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:29.078734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e6c40-e362-4694-9ff2-2c09206f33a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:29.079493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e6c40-e362-4694-9ff2-2c09206f33a6 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:29.079844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e6c40-e362-4694-9ff2-2c09206f33a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:29.080359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e6c40-e362-4694-9ff2-2c09206f33a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:29.082512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b9e6c40-e362-4694-9ff2-2c09206f33a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:29.097289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e6c40-e362-4694-9ff2-2c09206f33a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:29.101444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e6c40-e362-4694-9ff2-2c09206f33a6 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:29.117999 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 842/1680] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:29 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:29.234650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9bc692-a4e1-4474-9c5f-ff9907126cb9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:29.245244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f636b5-5ebb-4c00-ac7f-9eefdc4e032f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:29.245912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f636b5-5ebb-4c00-ac7f-9eefdc4e032f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:29.246184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f636b5-5ebb-4c00-ac7f-9eefdc4e032f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:29.246456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f636b5-5ebb-4c00-ac7f-9eefdc4e032f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/ebe64af26110447790eb20d2352046f9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:29.259257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f636b5-5ebb-4c00-ac7f-9eefdc4e032f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=ebe64af26110447790eb20d2352046f9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:29.261582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f636b5-5ebb-4c00-ac7f-9eefdc4e032f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:29.283302 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 839/1681] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:28 2022] GET /identity/v3/projects/ebe64af26110447790eb20d2352046f9 => generated 373 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:29.578218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68f434-8172-4162-8d39-363a0db71db5 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:29.578513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68f434-8172-4162-8d39-363a0db71db5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:29.578777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f68f434-8172-4162-8d39-363a0db71db5 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:29.580419 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 843/1682] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:29.589431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f636b5-5ebb-4c00-ac7f-9eefdc4e032f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:29.608852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f636b5-5ebb-4c00-ac7f-9eefdc4e032f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:29.634888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f636b5-5ebb-4c00-ac7f-9eefdc4e032f tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:29.649032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a612775-9c8d-4b21-8428-60d6c137a4a0 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:29.650189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a612775-9c8d-4b21-8428-60d6c137a4a0 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:29.650681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a612775-9c8d-4b21-8428-60d6c137a4a0 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:29.651156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a612775-9c8d-4b21-8428-60d6c137a4a0 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/ebe64af26110447790eb20d2352046f9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:29.652681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a612775-9c8d-4b21-8428-60d6c137a4a0 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=ebe64af26110447790eb20d2352046f9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:29.655240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a612775-9c8d-4b21-8428-60d6c137a4a0 tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:29.673543 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 840/1683] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:29 2022] GET /identity/v3/projects/ebe64af26110447790eb20d2352046f9 => generated 373 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:29.777172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30372f-7d45-4c81-9414-2c8761c89a47 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:29.777553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30372f-7d45-4c81-9414-2c8761c89a47 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:29.777831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b30372f-7d45-4c81-9414-2c8761c89a47 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:29.779251 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 844/1684] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:29.786506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d2d42-2738-4d66-b04e-1b9e9fb6eda7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:29.787479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d2d42-2738-4d66-b04e-1b9e9fb6eda7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:29.787976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53d2d42-2738-4d66-b04e-1b9e9fb6eda7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:29.857798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a53d2d42-2738-4d66-b04e-1b9e9fb6eda7 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:29.861860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a53d2d42-2738-4d66-b04e-1b9e9fb6eda7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:30.000343 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 841/1685] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:51:29 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:30.014743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30372f-7d45-4c81-9414-2c8761c89a47 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:30.018077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4b30372f-7d45-4c81-9414-2c8761c89a47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:30.038728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b30372f-7d45-4c81-9414-2c8761c89a47 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:30.043748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664fa9a-c66e-41f4-868e-d583fa92e0c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:30.045264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664fa9a-c66e-41f4-868e-d583fa92e0c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:30.045936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664fa9a-c66e-41f4-868e-d583fa92e0c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:30.046416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9664fa9a-c66e-41f4-868e-d583fa92e0c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:30.062130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664fa9a-c66e-41f4-868e-d583fa92e0c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:30.065594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9664fa9a-c66e-41f4-868e-d583fa92e0c7 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:30.096392 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 845/1686] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:30.303772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f0a90-2451-4a65-a627-31d4d9524df7 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:30.304051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f0a90-2451-4a65-a627-31d4d9524df7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:30.304357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f0a90-2451-4a65-a627-31d4d9524df7 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:30.306908 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 842/1687] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:30.315548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664fa9a-c66e-41f4-868e-d583fa92e0c7 service neutron] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:30.339579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664fa9a-c66e-41f4-868e-d583fa92e0c7 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:30.360934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9664fa9a-c66e-41f4-868e-d583fa92e0c7 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:30.372507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9605ef2-63f6-4c96-8153-47c3122dd8ab tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8ba5f69e95a494c970a22f3ca0674cc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '338b7af57d364feb8c119442c548896d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:30.373219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9605ef2-63f6-4c96-8153-47c3122dd8ab tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:30.374165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9605ef2-63f6-4c96-8153-47c3122dd8ab tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:30.374350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9605ef2-63f6-4c96-8153-47c3122dd8ab tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] PATH_INFO: `/v3/projects/ebe64af26110447790eb20d2352046f9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:30.376249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9605ef2-63f6-4c96-8153-47c3122dd8ab tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorizing `identity:get_project(project_id=ebe64af26110447790eb20d2352046f9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:30.380390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9605ef2-63f6-4c96-8153-47c3122dd8ab tempest-QuotasAdminTestJSON-1458498738 tempest-QuotasAdminTestJSON-1458498738-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:30.396343 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 846/1688] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:30 2022] GET /identity/v3/projects/ebe64af26110447790eb20d2352046f9 => generated 373 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:31.093840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f0a90-2451-4a65-a627-31d4d9524df7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:31.096665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-665f0a90-2451-4a65-a627-31d4d9524df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:31.214248 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:31.237285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f0a90-2451-4a65-a627-31d4d9524df7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:31.244080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:31.244862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:31.245438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:31.245815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] PATH_INFO: `/v3/users/8b95bf90ebd142c280147e2b43f24a7d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:31.247831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b95bf90ebd142c280147e2b43f24a7d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:31.249978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:31.336474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b95bf90ebd142c280147e2b43f24a7d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:31.378000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b95bf90ebd142c280147e2b43f24a7d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:31.381564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b95bf90ebd142c280147e2b43f24a7d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:31.396052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b95bf90ebd142c280147e2b43f24a7d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:31.412793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b95bf90ebd142c280147e2b43f24a7d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:31.422360 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 843/1689] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:31 2022] DELETE /identity/v3/users/8b95bf90ebd142c280147e2b43f24a7d => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:31.427069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eea78-9f7a-4f6e-8367-fe8a63b1825f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:31.427533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eea78-9f7a-4f6e-8367-fe8a63b1825f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:31.427713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157eea78-9f7a-4f6e-8367-fe8a63b1825f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:31.484086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-157eea78-9f7a-4f6e-8367-fe8a63b1825f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:31.485352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-157eea78-9f7a-4f6e-8367-fe8a63b1825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:31.622017 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 847/1690] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:31.659067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:31.661895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:31.801901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb286c2-d2dd-49f3-8aff-a24367a60a68 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:31.810893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae9e3-9891-4699-958a-d3ffb95fc245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:31.812026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae9e3-9891-4699-958a-d3ffb95fc245 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:31.812518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae9e3-9891-4699-958a-d3ffb95fc245 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:31.816590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260ae9e3-9891-4699-958a-d3ffb95fc245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:31.837858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ae9e3-9891-4699-958a-d3ffb95fc245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:31.853419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260ae9e3-9891-4699-958a-d3ffb95fc245 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:31.856434 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 844/1691] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:34.730955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eea78-9f7a-4f6e-8367-fe8a63b1825f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:34.732667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-157eea78-9f7a-4f6e-8367-fe8a63b1825f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:34.744121 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:34.757484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157eea78-9f7a-4f6e-8367-fe8a63b1825f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:34.787041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:34.787857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:34.789104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:34.793727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] PATH_INFO: `/v3/projects/ebe64af26110447790eb20d2352046f9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:34.798321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebe64af26110447790eb20d2352046f9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:34.810120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:34.974435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebe64af26110447790eb20d2352046f9', 'request_id': 'req-4097e3c2-71da-4309-ba00-0fc3295af09b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:34.997010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebe64af26110447790eb20d2352046f9', 'request_id': 'req-4097e3c2-71da-4309-ba00-0fc3295af09b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:35.014311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebe64af26110447790eb20d2352046f9', 'request_id': 'req-4097e3c2-71da-4309-ba00-0fc3295af09b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:35.045350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] The token cache is being invalidate because project ebe64af26110447790eb20d2352046f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:35.045615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:35.064742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4097e3c2-71da-4309-ba00-0fc3295af09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:35.074259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 848/1692] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:34 2022] DELETE /identity/v3/projects/ebe64af26110447790eb20d2352046f9 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:35.078288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae9e3-9891-4699-958a-d3ffb95fc245 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:35.094507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260ae9e3-9891-4699-958a-d3ffb95fc245 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:35.294275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:35.298173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:35.301075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:35.301495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] PATH_INFO: `/v3/users/d8ba5f69e95a494c970a22f3ca0674cc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:35.309483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8ba5f69e95a494c970a22f3ca0674cc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:35.311616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:35.336324 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:35.421002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8ba5f69e95a494c970a22f3ca0674cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:35.477889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8ba5f69e95a494c970a22f3ca0674cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:35.481514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8ba5f69e95a494c970a22f3ca0674cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:35.505441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8ba5f69e95a494c970a22f3ca0674cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:35.520843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55e8beab-67c2-41c2-9cc3-7b38846185e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8ba5f69e95a494c970a22f3ca0674cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:35.533900 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 845/1693] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:35 2022] DELETE /identity/v3/users/d8ba5f69e95a494c970a22f3ca0674cc => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:35.630844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f2e5-4d2c-4465-9e0c-e1a8c50e0a75 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:35.631329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f2e5-4d2c-4465-9e0c-e1a8c50e0a75 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:35.631595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7231f2e5-4d2c-4465-9e0c-e1a8c50e0a75 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:35.633066 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 849/1694] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:35.640953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2add3-05a3-4984-82a2-992e5a420de8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:35.642250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2add3-05a3-4984-82a2-992e5a420de8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:35.642250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2add3-05a3-4984-82a2-992e5a420de8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:35.678720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0af2add3-05a3-4984-82a2-992e5a420de8 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:35.684626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0af2add3-05a3-4984-82a2-992e5a420de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:35.845570 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 846/1695] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:51:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:35.882992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231f2e5-4d2c-4465-9e0c-e1a8c50e0a75 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:35.884774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7231f2e5-4d2c-4465-9e0c-e1a8c50e0a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:35.925111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7231f2e5-4d2c-4465-9e0c-e1a8c50e0a75 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:35.934656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92161-55ec-4873-96c6-1f81ad3af2c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:35.935736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92161-55ec-4873-96c6-1f81ad3af2c9 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:35.937473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92161-55ec-4873-96c6-1f81ad3af2c9 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:35.937939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c92161-55ec-4873-96c6-1f81ad3af2c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:35.958530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c92161-55ec-4873-96c6-1f81ad3af2c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:35.961461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c92161-55ec-4873-96c6-1f81ad3af2c9 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:35.991001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 850/1696] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:36.836861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2add3-05a3-4984-82a2-992e5a420de8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:36.840176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0af2add3-05a3-4984-82a2-992e5a420de8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:37.014639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2add3-05a3-4984-82a2-992e5a420de8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:37.024069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279d2890-1d57-4dce-b073-6228d18f2c3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:37.024702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d2890-1d57-4dce-b073-6228d18f2c3f service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:37.024978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d2890-1d57-4dce-b073-6228d18f2c3f service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:37.025250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279d2890-1d57-4dce-b073-6228d18f2c3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:37.027723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-279d2890-1d57-4dce-b073-6228d18f2c3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:37.052206 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:37.116072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d2890-1d57-4dce-b073-6228d18f2c3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:37.118324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279d2890-1d57-4dce-b073-6228d18f2c3f service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:37.133938 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 847/1697] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:36 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:37.373819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92161-55ec-4873-96c6-1f81ad3af2c9 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:37.375976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d8c92161-55ec-4873-96c6-1f81ad3af2c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:37.556362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c92161-55ec-4873-96c6-1f81ad3af2c9 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:37.574006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:37.574831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:37.575275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:37.575704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] PATH_INFO: `/v3/projects/338b7af57d364feb8c119442c548896d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:37.577414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=338b7af57d364feb8c119442c548896d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:37.579874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:37.678379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '338b7af57d364feb8c119442c548896d', 'request_id': 'req-46d699c9-4071-418e-bf96-c9fc548e2e1f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:37.698721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '338b7af57d364feb8c119442c548896d', 'request_id': 'req-46d699c9-4071-418e-bf96-c9fc548e2e1f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:37.709523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '338b7af57d364feb8c119442c548896d', 'request_id': 'req-46d699c9-4071-418e-bf96-c9fc548e2e1f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:37.739905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] The token cache is being invalidate because project 338b7af57d364feb8c119442c548896d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:37.740875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:37.741506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46d699c9-4071-418e-bf96-c9fc548e2e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:37.743081 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 851/1698] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:37 2022] DELETE /identity/v3/projects/338b7af57d364feb8c119442c548896d => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:37.750978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65175-596b-4efe-8fdc-42a20a899101 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:37.751307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65175-596b-4efe-8fdc-42a20a899101 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:37.752994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b65175-596b-4efe-8fdc-42a20a899101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:37.803781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-47b65175-596b-4efe-8fdc-42a20a899101 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:37.807979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-47b65175-596b-4efe-8fdc-42a20a899101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:37.935963 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 848/1699] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:37.944506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271597-16bc-423c-a52f-adf387c437f6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:37.944885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271597-16bc-423c-a52f-adf387c437f6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:37.945170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b271597-16bc-423c-a52f-adf387c437f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:37.953753 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:37.972837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1b271597-16bc-423c-a52f-adf387c437f6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:37.974323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1b271597-16bc-423c-a52f-adf387c437f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:37.983243 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 852/1700] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:37.987572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65175-596b-4efe-8fdc-42a20a899101 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:38.002977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b65175-596b-4efe-8fdc-42a20a899101 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:38.030157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e9b55-ff2f-4c7d-b5a3-06898a0ab2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:38.034182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e9b55-ff2f-4c7d-b5a3-06898a0ab2bf admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:38.034678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e9b55-ff2f-4c7d-b5a3-06898a0ab2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:38.035473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e9b55-ff2f-4c7d-b5a3-06898a0ab2bf admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:38.036353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e9b55-ff2f-4c7d-b5a3-06898a0ab2bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:38.039081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e9b55-ff2f-4c7d-b5a3-06898a0ab2bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:38.041138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e9b55-ff2f-4c7d-b5a3-06898a0ab2bf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:38.078805 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 849/1701] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:38.079956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b271597-16bc-423c-a52f-adf387c437f6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:38.099249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b271597-16bc-423c-a52f-adf387c437f6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:38.107054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536fff7-112f-4142-a018-caee9ca50c45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:38.107742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536fff7-112f-4142-a018-caee9ca50c45 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:38.108926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536fff7-112f-4142-a018-caee9ca50c45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:38.109527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d536fff7-112f-4142-a018-caee9ca50c45 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:38.111548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536fff7-112f-4142-a018-caee9ca50c45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:38.115258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d536fff7-112f-4142-a018-caee9ca50c45 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:38.186592 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 853/1702] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:38 2022] POST /identity/v3/projects => generated 395 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:38.191623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e9b55-ff2f-4c7d-b5a3-06898a0ab2bf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:38.201362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536fff7-112f-4142-a018-caee9ca50c45 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:38.202546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d536fff7-112f-4142-a018-caee9ca50c45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:38.223769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e9b55-ff2f-4c7d-b5a3-06898a0ab2bf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:38.374066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d536fff7-112f-4142-a018-caee9ca50c45 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:38.379502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:38.381176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:38.381694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:38.382041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] PATH_INFO: `/v3/users/c8cbd9603b0b471eb7e4eeeb542505fa` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:38.383384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cbd9603b0b471eb7e4eeeb542505fa)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:38.385657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:38.404924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06cc7a5-ba0c-4851-9abc-dfc0a0de81e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:38.405545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cc7a5-ba0c-4851-9abc-dfc0a0de81e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:38.405697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cc7a5-ba0c-4851-9abc-dfc0a0de81e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:38.406551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06cc7a5-ba0c-4851-9abc-dfc0a0de81e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:38.407197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cc7a5-ba0c-4851-9abc-dfc0a0de81e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:38.409150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06cc7a5-ba0c-4851-9abc-dfc0a0de81e8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:38.463476 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 850/1703] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:38 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:38.471835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90536bf1-1dfc-4240-9242-7f0af04adcbd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:38.472315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90536bf1-1dfc-4240-9242-7f0af04adcbd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:38.472612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90536bf1-1dfc-4240-9242-7f0af04adcbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:38.481383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cbd9603b0b471eb7e4eeeb542505fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.502067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cbd9603b0b471eb7e4eeeb542505fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.502929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cbd9603b0b471eb7e4eeeb542505fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.512348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cbd9603b0b471eb7e4eeeb542505fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.532044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cbd9603b0b471eb7e4eeeb542505fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.535706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-90536bf1-1dfc-4240-9242-7f0af04adcbd None None] MFA Rules not processed for user `f30ed27bff6c406a987841dcf1ade4a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:38.537015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-90536bf1-1dfc-4240-9242-7f0af04adcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:38.544049 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 854/1704] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:38 2022] DELETE /identity/v3/users/c8cbd9603b0b471eb7e4eeeb542505fa => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:38.548407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:38.552594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:38.615776 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:38.675810 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:38.698784 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 851/1705] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:38.703250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90536bf1-1dfc-4240-9242-7f0af04adcbd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:38.705628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-90536bf1-1dfc-4240-9242-7f0af04adcbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:38.710225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64f9d05-a3f2-40bd-ae2d-e567d41cbeac admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:38.723014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:38.723749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:38.724033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:38.724315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] PATH_INFO: `/v3/users/f8347b4e37424f499f5756ca8b88fab4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:38.727396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8347b4e37424f499f5756ca8b88fab4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:38.729854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:38.740847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90536bf1-1dfc-4240-9242-7f0af04adcbd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:38.748200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9ec24d-5456-44e1-9aa2-aad9ccc84e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:38.748200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ec24d-5456-44e1-9aa2-aad9ccc84e19 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:38.748200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ec24d-5456-44e1-9aa2-aad9ccc84e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:38.748200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ec24d-5456-44e1-9aa2-aad9ccc84e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:38.748588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ec24d-5456-44e1-9aa2-aad9ccc84e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:38.749769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9ec24d-5456-44e1-9aa2-aad9ccc84e19 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:38.784859 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 852/1706] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:38.787830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542d36-50bc-464b-b91e-d321afbbbe9e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:38.788118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542d36-50bc-464b-b91e-d321afbbbe9e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:38.788388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76542d36-50bc-464b-b91e-d321afbbbe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:38.840619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-76542d36-50bc-464b-b91e-d321afbbbe9e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:38.843437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-76542d36-50bc-464b-b91e-d321afbbbe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:38.852572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8347b4e37424f499f5756ca8b88fab4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.865328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 853/1707] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:38.866562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76542d36-50bc-464b-b91e-d321afbbbe9e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:38.877886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76542d36-50bc-464b-b91e-d321afbbbe9e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:38.885017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa221f-0687-4420-9fc1-2c87ceb63735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:38.886161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa221f-0687-4420-9fc1-2c87ceb63735 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:38.886628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa221f-0687-4420-9fc1-2c87ceb63735 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:38.887090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa221f-0687-4420-9fc1-2c87ceb63735 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:38.888127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa221f-0687-4420-9fc1-2c87ceb63735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:38.890371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa221f-0687-4420-9fc1-2c87ceb63735 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:38.890512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8347b4e37424f499f5756ca8b88fab4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.891352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8347b4e37424f499f5756ca8b88fab4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.903514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8347b4e37424f499f5756ca8b88fab4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.916743 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 854/1708] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:38 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:38.918447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa221f-0687-4420-9fc1-2c87ceb63735 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:38.921952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8347b4e37424f499f5756ca8b88fab4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:38.922177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6daa221f-0687-4420-9fc1-2c87ceb63735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:38.937268 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 855/1709] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:38 2022] DELETE /identity/v3/users/f8347b4e37424f499f5756ca8b88fab4 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:38.937963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:38.944172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.064622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0da416-846a-4450-b604-7bbf8981fc61 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:39.066449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa221f-0687-4420-9fc1-2c87ceb63735 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:39.071376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:39.073845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:39.074997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:39.075496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:39.078170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.180469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc20828c-dfe1-47bb-8f4d-18dec2f82998 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:39.180469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20828c-dfe1-47bb-8f4d-18dec2f82998 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:39.180469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20828c-dfe1-47bb-8f4d-18dec2f82998 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:39.180469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc20828c-dfe1-47bb-8f4d-18dec2f82998 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:39.182394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dc20828c-dfe1-47bb-8f4d-18dec2f82998 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.252919 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:39.266560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:39.268667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:39.289720 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 856/1710] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:39.290601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:39.299837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.307824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20828c-dfe1-47bb-8f4d-18dec2f82998 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:39.313560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc20828c-dfe1-47bb-8f4d-18dec2f82998 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:39.329167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35046e35-7d68-40ad-80cf-63ce5f066e46 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:39.334610 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 855/1711] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:38 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:39.336350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3d8dd-a98a-40a3-b8c6-0bad8330a8b2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:39.336631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3d8dd-a98a-40a3-b8c6-0bad8330a8b2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:39.336903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3d8dd-a98a-40a3-b8c6-0bad8330a8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:39.344881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6bccf-517b-4c5a-8feb-490e24302114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:39.345597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6bccf-517b-4c5a-8feb-490e24302114 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:39.345882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6bccf-517b-4c5a-8feb-490e24302114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:39.346169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6bccf-517b-4c5a-8feb-490e24302114 admin admin] PATH_INFO: `/v3/projects/51f58b19f97f4eb7a30c2106758088d6/users/cc1ba89738f2407abcbc8eb5cbc6d356/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:39.382973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b5c3d8dd-a98a-40a3-b8c6-0bad8330a8b2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:39.384628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b5c3d8dd-a98a-40a3-b8c6-0bad8330a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.398440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6bccf-517b-4c5a-8feb-490e24302114 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51f58b19f97f4eb7a30c2106758088d6, user_id=cc1ba89738f2407abcbc8eb5cbc6d356, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:39.400038 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 856/1712] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:39.402089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3d8dd-a98a-40a3-b8c6-0bad8330a8b2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:39.404373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b5c3d8dd-a98a-40a3-b8c6-0bad8330a8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.404531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6bccf-517b-4c5a-8feb-490e24302114 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:39.414944 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:39.426862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3d8dd-a98a-40a3-b8c6-0bad8330a8b2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:39.428977 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 857/1713] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:39 2022] PUT /identity/v3/projects/51f58b19f97f4eb7a30c2106758088d6/users/cc1ba89738f2407abcbc8eb5cbc6d356/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:39.441152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6bccf-517b-4c5a-8feb-490e24302114 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:39.443213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-90c6bccf-517b-4c5a-8feb-490e24302114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.536946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:39.537495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:39.537874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:39.539156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] PATH_INFO: `/v3/users/03667bc832004351a9c822f597f334ba` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:39.540162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03667bc832004351a9c822f597f334ba)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:39.545350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:39.590080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6bccf-517b-4c5a-8feb-490e24302114 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:39.597197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db55871-4297-4375-9e2d-1bed703add3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:39.605345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55871-4297-4375-9e2d-1bed703add3e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:39.605345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55871-4297-4375-9e2d-1bed703add3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:39.605345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db55871-4297-4375-9e2d-1bed703add3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:39.621488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db55871-4297-4375-9e2d-1bed703add3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:39.623520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db55871-4297-4375-9e2d-1bed703add3e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:39.642373 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 858/1714] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:39.644461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780eff0-a883-4db4-9622-ea0c3cfa1199 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:39.644764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780eff0-a883-4db4-9622-ea0c3cfa1199 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:39.645042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b780eff0-a883-4db4-9622-ea0c3cfa1199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:39.674975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03667bc832004351a9c822f597f334ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:39.688303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b780eff0-a883-4db4-9622-ea0c3cfa1199 None None] MFA Rules not processed for user `cc1ba89738f2407abcbc8eb5cbc6d356`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:39.689969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b780eff0-a883-4db4-9622-ea0c3cfa1199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.710303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03667bc832004351a9c822f597f334ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:39.711089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03667bc832004351a9c822f597f334ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:39.722087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03667bc832004351a9c822f597f334ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:39.739258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0efdd14c-5144-42df-b0bb-d588821649d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03667bc832004351a9c822f597f334ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:39.754273 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 857/1715] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:39 2022] DELETE /identity/v3/users/03667bc832004351a9c822f597f334ba => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:39.756335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3338-f867-4aef-ac7e-167e40ff18f0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:39.756798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3338-f867-4aef-ac7e-167e40ff18f0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:39.757081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52d3338-f867-4aef-ac7e-167e40ff18f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:39.809919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e52d3338-f867-4aef-ac7e-167e40ff18f0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:39.811144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e52d3338-f867-4aef-ac7e-167e40ff18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.847268 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 859/1716] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:39.853924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780eff0-a883-4db4-9622-ea0c3cfa1199 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:39.858697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b780eff0-a883-4db4-9622-ea0c3cfa1199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:39.879066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b780eff0-a883-4db4-9622-ea0c3cfa1199 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:39.914689 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:39.951120 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 858/1717] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:39.965822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d3338-f867-4aef-ac7e-167e40ff18f0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:39.968314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e52d3338-f867-4aef-ac7e-167e40ff18f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:40.004938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7b05-61d5-48a8-ace9-0647ec028c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:40.007573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7b05-61d5-48a8-ace9-0647ec028c1c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:40.007885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7b05-61d5-48a8-ace9-0647ec028c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:40.008214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914c7b05-61d5-48a8-ace9-0647ec028c1c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:40.012385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c7b05-61d5-48a8-ace9-0647ec028c1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:40.019111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914c7b05-61d5-48a8-ace9-0647ec028c1c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:40.118834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52d3338-f867-4aef-ac7e-167e40ff18f0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:40.123147 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 860/1718] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:39 2022] POST /identity/v3/projects => generated 395 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:40.130256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7b05-61d5-48a8-ace9-0647ec028c1c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:40.135023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0a938-e0f0-41e8-9ee1-8be4edf99ae6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:40.135971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0a938-e0f0-41e8-9ee1-8be4edf99ae6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:40.136715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0a938-e0f0-41e8-9ee1-8be4edf99ae6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:40.140508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0a938-e0f0-41e8-9ee1-8be4edf99ae6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:40.167659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0a938-e0f0-41e8-9ee1-8be4edf99ae6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:40.171075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0a938-e0f0-41e8-9ee1-8be4edf99ae6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:40.185308 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:40.199047 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 859/1719] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:51:40.200400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0a938-e0f0-41e8-9ee1-8be4edf99ae6 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:40.203458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-37f0a938-e0f0-41e8-9ee1-8be4edf99ae6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:40.237535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0a938-e0f0-41e8-9ee1-8be4edf99ae6 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:40.285608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914c7b05-61d5-48a8-ace9-0647ec028c1c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:40.299865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc980f7c-66ca-4d3e-aca2-4a5df739c7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:40.302014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980f7c-66ca-4d3e-aca2-4a5df739c7c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:40.304204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980f7c-66ca-4d3e-aca2-4a5df739c7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:40.304726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc980f7c-66ca-4d3e-aca2-4a5df739c7c1 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:40.307823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc980f7c-66ca-4d3e-aca2-4a5df739c7c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:40.312156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc980f7c-66ca-4d3e-aca2-4a5df739c7c1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:40.387066 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 861/1720] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:40 2022] POST /identity/v3/users => generated 304 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:40.393747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc980f7c-66ca-4d3e-aca2-4a5df739c7c1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:40.421264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc980f7c-66ca-4d3e-aca2-4a5df739c7c1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:40.426815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:40.428097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:40.428410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:40.434955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] PATH_INFO: `/v3/projects/795036e27bb94a21a2e278bdba2ffc71` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:40.438149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795036e27bb94a21a2e278bdba2ffc71)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:40.439924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342aaac-aa5b-4ab3-b48f-87d9d0e2fd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:40.440552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342aaac-aa5b-4ab3-b48f-87d9d0e2fd6e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:40.440905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342aaac-aa5b-4ab3-b48f-87d9d0e2fd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:40.441193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1342aaac-aa5b-4ab3-b48f-87d9d0e2fd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:40.441859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342aaac-aa5b-4ab3-b48f-87d9d0e2fd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:40.443536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1342aaac-aa5b-4ab3-b48f-87d9d0e2fd6e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:40.448642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:40.478466 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 862/1721] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:40.479449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342aaac-aa5b-4ab3-b48f-87d9d0e2fd6e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:40.509716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1342aaac-aa5b-4ab3-b48f-87d9d0e2fd6e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:40.523864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3897ba-3064-40ea-a9a3-0572ec20b3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:40.524944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3897ba-3064-40ea-a9a3-0572ec20b3c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:40.526426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3897ba-3064-40ea-a9a3-0572ec20b3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:40.526819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3897ba-3064-40ea-a9a3-0572ec20b3c8 admin admin] PATH_INFO: `/v3/projects/ba295e47ad5648c08e6cef9674f5abde/users/574d00065b2f47d1baf596c611522597/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:40.587042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3897ba-3064-40ea-a9a3-0572ec20b3c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba295e47ad5648c08e6cef9674f5abde, user_id=574d00065b2f47d1baf596c611522597, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:40.590785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3897ba-3064-40ea-a9a3-0572ec20b3c8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:40.631806 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 863/1722] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:40 2022] PUT /identity/v3/projects/ba295e47ad5648c08e6cef9674f5abde/users/574d00065b2f47d1baf596c611522597/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:40.635719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3897ba-3064-40ea-a9a3-0572ec20b3c8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:40.637888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cd3897ba-3064-40ea-a9a3-0572ec20b3c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:40.642750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795036e27bb94a21a2e278bdba2ffc71', 'request_id': 'req-01373fd2-859b-4dfe-a64a-10481b4bb6e2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:40.652205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795036e27bb94a21a2e278bdba2ffc71', 'request_id': 'req-01373fd2-859b-4dfe-a64a-10481b4bb6e2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:40.667191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795036e27bb94a21a2e278bdba2ffc71', 'request_id': 'req-01373fd2-859b-4dfe-a64a-10481b4bb6e2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:40.686621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] The token cache is being invalidate because project 795036e27bb94a21a2e278bdba2ffc71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:40.686912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:40.689650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:40.697555 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 860/1723] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:40 2022] DELETE /identity/v3/projects/795036e27bb94a21a2e278bdba2ffc71 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:40.698480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:40.704112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:40.769254 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:40.819679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3897ba-3064-40ea-a9a3-0572ec20b3c8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:40.826684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:40.828135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:40.829046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:40.829459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] PATH_INFO: `/v3/projects/b6c53bdfc24c4cb0a6c9b02779cc7d62` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:40.831473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6c53bdfc24c4cb0a6c9b02779cc7d62)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:40.835655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:40.868957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01373fd2-859b-4dfe-a64a-10481b4bb6e2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:40.881320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4fef-8bdf-451f-adec-c1013a570806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:40.882180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4fef-8bdf-451f-adec-c1013a570806 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:40.882458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4fef-8bdf-451f-adec-c1013a570806 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:40.882729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4fef-8bdf-451f-adec-c1013a570806 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:40.883437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c4fef-8bdf-451f-adec-c1013a570806 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:40.886843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c4fef-8bdf-451f-adec-c1013a570806 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:40.905515 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 861/1724] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:40 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:40.907034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4fef-8bdf-451f-adec-c1013a570806 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:40.909027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9d2c4fef-8bdf-451f-adec-c1013a570806 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:40.928664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4fef-8bdf-451f-adec-c1013a570806 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:40.942460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'request_id': 'req-a7d4eefe-373c-4d6d-b63b-25318d985c3a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:40.965775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'request_id': 'req-a7d4eefe-373c-4d6d-b63b-25318d985c3a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:40.975030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6c53bdfc24c4cb0a6c9b02779cc7d62', 'request_id': 'req-a7d4eefe-373c-4d6d-b63b-25318d985c3a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:40.996089 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:41.004782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] The token cache is being invalidate because project b6c53bdfc24c4cb0a6c9b02779cc7d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:41.005554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.008635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.010694 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 864/1725] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:40 2022] DELETE /identity/v3/projects/b6c53bdfc24c4cb0a6c9b02779cc7d62 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:41.011712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:41.017335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:41.026267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:41.027255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:41.027489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:41.027775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] PATH_INFO: `/v3/users/14b05a11349d49c791f254fdf465a5c1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:41.029509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b05a11349d49c791f254fdf465a5c1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:41.032004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:41.047903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d4eefe-373c-4d6d-b63b-25318d985c3a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:41.068945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:41.070900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:41.070900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:41.071222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] PATH_INFO: `/v3/users/1297fc6a7dd748e7ba7bf7a647ffd3da` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:41.073949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1297fc6a7dd748e7ba7bf7a647ffd3da)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:41.079560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:41.108018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b05a11349d49c791f254fdf465a5c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.148931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b05a11349d49c791f254fdf465a5c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.148931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b05a11349d49c791f254fdf465a5c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.168512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b05a11349d49c791f254fdf465a5c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.195936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b05a11349d49c791f254fdf465a5c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.206634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1297fc6a7dd748e7ba7bf7a647ffd3da'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.208861 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 862/1726] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:40 2022] DELETE /identity/v3/users/14b05a11349d49c791f254fdf465a5c1 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:41.210150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:41.212112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:41.234095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1297fc6a7dd748e7ba7bf7a647ffd3da'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.234698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1297fc6a7dd748e7ba7bf7a647ffd3da'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.247633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1297fc6a7dd748e7ba7bf7a647ffd3da'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.259470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1297fc6a7dd748e7ba7bf7a647ffd3da'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.283219 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 865/1727] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:41 2022] DELETE /identity/v3/users/1297fc6a7dd748e7ba7bf7a647ffd3da => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:41.291721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:41.294857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:41.321037 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:41.375776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bfdd6-8795-4141-9379-4c8aa82a2792 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:41.418346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece94d39-a100-465e-a222-1322d9ff94f0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:41.425801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:41.430310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:41.431476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:41.432421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] PATH_INFO: `/v3/users/0850088244324db999931ef997700a69` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:41.435576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0850088244324db999931ef997700a69)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:41.442642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:41.490775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724e304-1b4f-4266-9b99-40003eed12a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:41.491803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724e304-1b4f-4266-9b99-40003eed12a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:41.493915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724e304-1b4f-4266-9b99-40003eed12a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:41.494459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7724e304-1b4f-4266-9b99-40003eed12a0 admin admin] PATH_INFO: `/v3/projects/ba295e47ad5648c08e6cef9674f5abde/users/574d00065b2f47d1baf596c611522597/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:41.498859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724e304-1b4f-4266-9b99-40003eed12a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba295e47ad5648c08e6cef9674f5abde, user_id=574d00065b2f47d1baf596c611522597, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:41.504634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7724e304-1b4f-4266-9b99-40003eed12a0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:41.527020 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 863/1728] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:41 2022] PUT /identity/v3/projects/ba295e47ad5648c08e6cef9674f5abde/users/574d00065b2f47d1baf596c611522597/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:41.529558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724e304-1b4f-4266-9b99-40003eed12a0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:41.531966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7724e304-1b4f-4266-9b99-40003eed12a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:41.562937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0850088244324db999931ef997700a69'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.580447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0850088244324db999931ef997700a69'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.581661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0850088244324db999931ef997700a69'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.592789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0850088244324db999931ef997700a69'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.595996 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:41.604713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2f163f97-011f-43eb-bca2-089468de0410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0850088244324db999931ef997700a69'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.615947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 866/1729] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:41 2022] DELETE /identity/v3/users/0850088244324db999931ef997700a69 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:41.617878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7dabc-68c0-430e-a29e-6648b1b1a660 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:41.618275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7dabc-68c0-430e-a29e-6648b1b1a660 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:41.618658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe7dabc-68c0-430e-a29e-6648b1b1a660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:41.642591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7724e304-1b4f-4266-9b99-40003eed12a0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:41.644883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dbe7dabc-68c0-430e-a29e-6648b1b1a660 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:41.647091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dbe7dabc-68c0-430e-a29e-6648b1b1a660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:41.725491 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 867/1730] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:41.725723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6eff9-36c3-4ae7-871a-9fa91c8740a2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:41.726077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6eff9-36c3-4ae7-871a-9fa91c8740a2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:41.726455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b6eff9-36c3-4ae7-871a-9fa91c8740a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:41.738315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:41.739112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:41.739469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:41.739812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] PATH_INFO: `/v3/projects/773e2628405a49089109aa5bf45eac6e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:41.741667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=773e2628405a49089109aa5bf45eac6e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:41.743697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:41.765412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-21b6eff9-36c3-4ae7-871a-9fa91c8740a2 None None] MFA Rules not processed for user `574d00065b2f47d1baf596c611522597`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:41.766765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-21b6eff9-36c3-4ae7-871a-9fa91c8740a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:41.789639 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:41.813717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '773e2628405a49089109aa5bf45eac6e', 'request_id': 'req-85b89d64-801d-4d86-be34-6be199ab08c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.823058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '773e2628405a49089109aa5bf45eac6e', 'request_id': 'req-85b89d64-801d-4d86-be34-6be199ab08c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.834714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '773e2628405a49089109aa5bf45eac6e', 'request_id': 'req-85b89d64-801d-4d86-be34-6be199ab08c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.864355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] The token cache is being invalidate because project 773e2628405a49089109aa5bf45eac6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:41.864969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.865859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:41.869368 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 864/1731] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:41 2022] DELETE /identity/v3/projects/773e2628405a49089109aa5bf45eac6e => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:41.870722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:41.873180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:41.883959 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 868/1732] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:41 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:41.889861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6eff9-36c3-4ae7-871a-9fa91c8740a2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:41.891728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-21b6eff9-36c3-4ae7-871a-9fa91c8740a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:41.981778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b89d64-801d-4d86-be34-6be199ab08c2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:41.987766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:41.988416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:41.988698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:41.988969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] PATH_INFO: `/v3/projects/2355d0fe66394d808917a67018c9bcc0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:41.991174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2355d0fe66394d808917a67018c9bcc0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:41.993093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b6eff9-36c3-4ae7-871a-9fa91c8740a2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:41.993549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:42.064900 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:42.091785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2355d0fe66394d808917a67018c9bcc0', 'request_id': 'req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.109212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:42.110190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:42.110550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:42.110904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:42.119347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:42.123452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2355d0fe66394d808917a67018c9bcc0', 'request_id': 'req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.147679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:42.152727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:42.155800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2355d0fe66394d808917a67018c9bcc0', 'request_id': 'req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.176234 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 869/1733] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:42.177128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] The token cache is being invalidate because project 2355d0fe66394d808917a67018c9bcc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:42.177241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:42.178541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.178662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:42.179550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c62b5a6c-54ed-4e7e-a856-7e6b1a52af2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.181923 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 865/1734] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:41 2022] DELETE /identity/v3/projects/2355d0fe66394d808917a67018c9bcc0 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:42.183592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf50c3-51f8-4d24-a61a-31956c5dfa17 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:42.184187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf50c3-51f8-4d24-a61a-31956c5dfa17 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:42.185513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edf50c3-51f8-4d24-a61a-31956c5dfa17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:42.195090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea9bff0-1bb3-4500-bdc9-d33a3eae95e2 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:42.231801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5edf50c3-51f8-4d24-a61a-31956c5dfa17 None None] MFA Rules not processed for user `cc1ba89738f2407abcbc8eb5cbc6d356`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:42.233097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5edf50c3-51f8-4d24-a61a-31956c5dfa17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:42.321553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:42.322889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:42.324265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:42.325026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] PATH_INFO: `/v3/users/f459a36262d34af2a36be88200e3e0cd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:42.327583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f459a36262d34af2a36be88200e3e0cd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:42.330441 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:42.337830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:42.415728 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 866/1735] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:42.417164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79b1bc-b100-4167-9371-0354e9ea94ee None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:42.421972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79b1bc-b100-4167-9371-0354e9ea94ee None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:42.422317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79b1bc-b100-4167-9371-0354e9ea94ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:42.450172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f459a36262d34af2a36be88200e3e0cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.481407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6c79b1bc-b100-4167-9371-0354e9ea94ee None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:42.482911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c79b1bc-b100-4167-9371-0354e9ea94ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:42.486285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f459a36262d34af2a36be88200e3e0cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.487572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f459a36262d34af2a36be88200e3e0cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.503340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f459a36262d34af2a36be88200e3e0cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.511749 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 867/1736] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:42.515125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79b1bc-b100-4167-9371-0354e9ea94ee None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:42.519601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c79b1bc-b100-4167-9371-0354e9ea94ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:42.523719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f459a36262d34af2a36be88200e3e0cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:42.547658 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 870/1737] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:42 2022] DELETE /identity/v3/users/f459a36262d34af2a36be88200e3e0cd => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:42.548764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:42.556923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:42.560212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c79b1bc-b100-4167-9371-0354e9ea94ee None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:42.795675 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:42.822517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:42.824526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:42.826081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:42.840367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] PATH_INFO: `/v3/projects/6016c15bfdde44bab9699c21dabfe9c1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:42.845141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6016c15bfdde44bab9699c21dabfe9c1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:42.867893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:42.935230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73dab9a-a1af-4f39-9e43-02d9da742c3d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:42.950171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:42.951738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:42.952774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:42.953062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:42.959393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:43.044481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6016c15bfdde44bab9699c21dabfe9c1', 'request_id': 'req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.076951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6016c15bfdde44bab9699c21dabfe9c1', 'request_id': 'req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.108038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6016c15bfdde44bab9699c21dabfe9c1', 'request_id': 'req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.152893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] The token cache is being invalidate because project 6016c15bfdde44bab9699c21dabfe9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:43.153342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.154135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d8460848-a8c1-4759-a3ac-08e8c4c40ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.160736 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 868/1738] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:42 2022] DELETE /identity/v3/projects/6016c15bfdde44bab9699c21dabfe9c1 => generated 0 bytes in 644 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:43.160736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ac90-d5b5-4a7c-96e8-547ec20af141 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:43.160736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ac90-d5b5-4a7c-96e8-547ec20af141 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:43.160736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e2ac90-d5b5-4a7c-96e8-547ec20af141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:43.177258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:43.199274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:43.203185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-81e2ac90-d5b5-4a7c-96e8-547ec20af141 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:43.204556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81e2ac90-d5b5-4a7c-96e8-547ec20af141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:43.236763 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 871/1739] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:42 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 686 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:43.238097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:43.245593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:43.289567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2947c6ce-7120-441f-a25b-550f317fe9f5 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:43.408305 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 869/1740] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:43.409844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9ae3-6865-4dcb-bf97-351983f860e9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:43.410149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9ae3-6865-4dcb-bf97-351983f860e9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:43.410391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe9ae3-6865-4dcb-bf97-351983f860e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:43.443320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:43.448382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:43.448382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:43.448382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] PATH_INFO: `/v3/projects/b0f35890b16448ec826fa5c1dd4e2c2c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:43.450486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0f35890b16448ec826fa5c1dd4e2c2c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:43.452382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:43.458735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8dfe9ae3-6865-4dcb-bf97-351983f860e9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:43.460037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8dfe9ae3-6865-4dcb-bf97-351983f860e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:43.482645 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 870/1741] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:43.484393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe9ae3-6865-4dcb-bf97-351983f860e9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:43.498830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe9ae3-6865-4dcb-bf97-351983f860e9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:43.516167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abbadfd-9b13-41ea-8513-5228fc049154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:43.518766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbadfd-9b13-41ea-8513-5228fc049154 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:43.519050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbadfd-9b13-41ea-8513-5228fc049154 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:43.519328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abbadfd-9b13-41ea-8513-5228fc049154 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:43.521916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbadfd-9b13-41ea-8513-5228fc049154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:43.523439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbadfd-9b13-41ea-8513-5228fc049154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:43.528230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abbadfd-9b13-41ea-8513-5228fc049154 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:43.541517 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:43.576939 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 871/1742] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:43.584999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84519f5-eb39-42d4-94ef-3d47993924ce None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:43.585330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84519f5-eb39-42d4-94ef-3d47993924ce None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:43.588309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84519f5-eb39-42d4-94ef-3d47993924ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:43.594682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0f35890b16448ec826fa5c1dd4e2c2c', 'request_id': 'req-5a802c69-a5a6-4e39-b3fe-8af263c557ed'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.612348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0f35890b16448ec826fa5c1dd4e2c2c', 'request_id': 'req-5a802c69-a5a6-4e39-b3fe-8af263c557ed'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.630560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0f35890b16448ec826fa5c1dd4e2c2c', 'request_id': 'req-5a802c69-a5a6-4e39-b3fe-8af263c557ed'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.645992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d84519f5-eb39-42d4-94ef-3d47993924ce None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:43.647309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d84519f5-eb39-42d4-94ef-3d47993924ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:43.659996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] The token cache is being invalidate because project b0f35890b16448ec826fa5c1dd4e2c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:43.660361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.662205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.671151 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 872/1743] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:43 2022] DELETE /identity/v3/projects/b0f35890b16448ec826fa5c1dd4e2c2c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:43.671151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:43.675461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:43.741243 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:43.799751 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 872/1744] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:43.801078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84519f5-eb39-42d4-94ef-3d47993924ce None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:43.803257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d84519f5-eb39-42d4-94ef-3d47993924ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:43.828059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84519f5-eb39-42d4-94ef-3d47993924ce None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:43.834534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a802c69-a5a6-4e39-b3fe-8af263c557ed admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:43.841829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:43.842638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:43.843044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:43.843466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] PATH_INFO: `/v3/users/2a4e66ab55bf4171ad321a7dc89b98b1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:43.845238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a4e66ab55bf4171ad321a7dc89b98b1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:43.847548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:43.848410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97adc4d-09d7-40d9-adbf-31acedf389c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:43.849943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97adc4d-09d7-40d9-adbf-31acedf389c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:43.850392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97adc4d-09d7-40d9-adbf-31acedf389c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:43.850828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97adc4d-09d7-40d9-adbf-31acedf389c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:43.851623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97adc4d-09d7-40d9-adbf-31acedf389c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:43.853776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97adc4d-09d7-40d9-adbf-31acedf389c9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:43.887755 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 873/1745] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:43 2022] POST /identity/v3/projects => generated 381 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:43.888880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97adc4d-09d7-40d9-adbf-31acedf389c9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:43.890785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a97adc4d-09d7-40d9-adbf-31acedf389c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:43.923413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a4e66ab55bf4171ad321a7dc89b98b1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.959347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a4e66ab55bf4171ad321a7dc89b98b1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.960121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a4e66ab55bf4171ad321a7dc89b98b1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.971627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a4e66ab55bf4171ad321a7dc89b98b1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.991888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a4e66ab55bf4171ad321a7dc89b98b1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:43.993413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97adc4d-09d7-40d9-adbf-31acedf389c9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:44.007315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:44.008131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:44.008729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:44.009052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] PATH_INFO: `/v3/projects/fb94552fe2df4240a7d49d6696bfaff5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:44.011901 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 873/1746] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:43 2022] DELETE /identity/v3/users/2a4e66ab55bf4171ad321a7dc89b98b1 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:44.012815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb94552fe2df4240a7d49d6696bfaff5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:44.016342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:44.019434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:44.019959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:44.151878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb94552fe2df4240a7d49d6696bfaff5', 'request_id': 'req-b02338fa-cacf-441c-895f-1a72932256d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:44.165073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d663c9ad-30fa-4eef-a96f-ebfda21da1e4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:44.167110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb94552fe2df4240a7d49d6696bfaff5', 'request_id': 'req-b02338fa-cacf-441c-895f-1a72932256d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:44.180020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb94552fe2df4240a7d49d6696bfaff5', 'request_id': 'req-b02338fa-cacf-441c-895f-1a72932256d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:44.198921 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:44.203727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] The token cache is being invalidate because project fb94552fe2df4240a7d49d6696bfaff5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:44.206854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:44.207715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:44.209993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 874/1747] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:43 2022] DELETE /identity/v3/projects/fb94552fe2df4240a7d49d6696bfaff5 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:44.213556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:44.213556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:44.309715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa0bea-be42-4903-93a3-c3d23ddf33b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:44.313205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0bea-be42-4903-93a3-c3d23ddf33b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:44.313626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0bea-be42-4903-93a3-c3d23ddf33b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:44.314351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa0bea-be42-4903-93a3-c3d23ddf33b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:44.315062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0bea-be42-4903-93a3-c3d23ddf33b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:44.315062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0bea-be42-4903-93a3-c3d23ddf33b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:44.322291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa0bea-be42-4903-93a3-c3d23ddf33b7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:44.339929 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:44.355904 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 874/1748] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:44.357509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399b5f-5e1b-40ea-9c16-9899de8ffdd7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:44.357914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399b5f-5e1b-40ea-9c16-9899de8ffdd7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:44.360755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04399b5f-5e1b-40ea-9c16-9899de8ffdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:44.436094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-04399b5f-5e1b-40ea-9c16-9899de8ffdd7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:44.437531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-04399b5f-5e1b-40ea-9c16-9899de8ffdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:44.441958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02338fa-cacf-441c-895f-1a72932256d5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:44.450878 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 875/1749] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:44.450878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04399b5f-5e1b-40ea-9c16-9899de8ffdd7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:44.451882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb66fc-f5ab-457c-bc41-cf4ca6bb532c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:44.452629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb66fc-f5ab-457c-bc41-cf4ca6bb532c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:44.453087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb66fc-f5ab-457c-bc41-cf4ca6bb532c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:44.453990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-04399b5f-5e1b-40ea-9c16-9899de8ffdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:44.454474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb66fc-f5ab-457c-bc41-cf4ca6bb532c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:44.455244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb66fc-f5ab-457c-bc41-cf4ca6bb532c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:44.459351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb66fc-f5ab-457c-bc41-cf4ca6bb532c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:44.503300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04399b5f-5e1b-40ea-9c16-9899de8ffdd7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:44.514553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f2b8d-0c6f-4ec0-9d0c-a3db3b696736 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:44.516969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f2b8d-0c6f-4ec0-9d0c-a3db3b696736 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:44.517665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f2b8d-0c6f-4ec0-9d0c-a3db3b696736 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:44.518062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f2b8d-0c6f-4ec0-9d0c-a3db3b696736 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:44.519116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f2b8d-0c6f-4ec0-9d0c-a3db3b696736 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:44.525449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f2b8d-0c6f-4ec0-9d0c-a3db3b696736 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:44.533168 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 875/1750] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:44 2022] POST /identity/v3/users => generated 291 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:44.541804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced1941-7cd0-4a92-995c-acf9dbb1d556 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:44.542183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced1941-7cd0-4a92-995c-acf9dbb1d556 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:44.542462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced1941-7cd0-4a92-995c-acf9dbb1d556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:44.601209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5ced1941-7cd0-4a92-995c-acf9dbb1d556 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:44.602783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5ced1941-7cd0-4a92-995c-acf9dbb1d556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:44.618451 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 876/1751] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:44.619655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced1941-7cd0-4a92-995c-acf9dbb1d556 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:44.636637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced1941-7cd0-4a92-995c-acf9dbb1d556 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:44.659009 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 876/1752] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:44 2022] POST /identity/v3/projects => generated 395 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:44.659839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfb53c-dc80-49a4-9cf2-55134f4b9c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:44.660220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f2b8d-0c6f-4ec0-9d0c-a3db3b696736 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:44.660469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfb53c-dc80-49a4-9cf2-55134f4b9c4c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:44.660847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfb53c-dc80-49a4-9cf2-55134f4b9c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:44.661124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dfb53c-dc80-49a4-9cf2-55134f4b9c4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:44.662531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfb53c-dc80-49a4-9cf2-55134f4b9c4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:44.664985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dfb53c-dc80-49a4-9cf2-55134f4b9c4c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:44.689680 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 877/1753] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:44 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:44.691703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfb53c-dc80-49a4-9cf2-55134f4b9c4c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:44.743477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dfb53c-dc80-49a4-9cf2-55134f4b9c4c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:44.973178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f2b8d-0c6f-4ec0-9d0c-a3db3b696736 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:44.977829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937dc9-69f4-426d-9f95-d4416a015dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:44.981355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937dc9-69f4-426d-9f95-d4416a015dae admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:44.982392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937dc9-69f4-426d-9f95-d4416a015dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:44.983628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98937dc9-69f4-426d-9f95-d4416a015dae admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:44.984934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98937dc9-69f4-426d-9f95-d4416a015dae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:44.985960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7ce26-2461-4370-b9fb-f9092d9f3013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:44.986582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ce26-2461-4370-b9fb-f9092d9f3013 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:44.987001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ce26-2461-4370-b9fb-f9092d9f3013 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:44.987287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7ce26-2461-4370-b9fb-f9092d9f3013 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:44.987950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7ce26-2461-4370-b9fb-f9092d9f3013 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:44.988257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7ce26-2461-4370-b9fb-f9092d9f3013 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:44.993465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98937dc9-69f4-426d-9f95-d4416a015dae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:44.995475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7ce26-2461-4370-b9fb-f9092d9f3013 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.065196 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 878/1754] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:44 2022] POST /identity/v3/users => generated 298 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:45.067532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937dc9-69f4-426d-9f95-d4416a015dae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:45.071671 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 877/1755] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 412 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:45.073334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7ce26-2461-4370-b9fb-f9092d9f3013 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:45.095394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98937dc9-69f4-426d-9f95-d4416a015dae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:45.110684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0c0a4-8385-48ea-9c51-ba9dc9adfbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:45.112133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0c0a4-8385-48ea-9c51-ba9dc9adfbeb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.112654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0c0a4-8385-48ea-9c51-ba9dc9adfbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.114401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a0c0a4-8385-48ea-9c51-ba9dc9adfbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.116014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0c0a4-8385-48ea-9c51-ba9dc9adfbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:45.121152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a0c0a4-8385-48ea-9c51-ba9dc9adfbeb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.124572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7ce26-2461-4370-b9fb-f9092d9f3013 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:45.145507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d58e51-9fb4-4584-a5f3-4a2d4dbd9144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:45.145851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d58e51-9fb4-4584-a5f3-4a2d4dbd9144 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.146186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d58e51-9fb4-4584-a5f3-4a2d4dbd9144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.146427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d58e51-9fb4-4584-a5f3-4a2d4dbd9144 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.147086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d58e51-9fb4-4584-a5f3-4a2d4dbd9144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:45.148903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d58e51-9fb4-4584-a5f3-4a2d4dbd9144 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.162178 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 879/1756] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:45.163329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0c0a4-8385-48ea-9c51-ba9dc9adfbeb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:45.175785 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 878/1757] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:45.176667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d58e51-9fb4-4584-a5f3-4a2d4dbd9144 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:45.192728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a0c0a4-8385-48ea-9c51-ba9dc9adfbeb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:45.200998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19911690-53be-4e1c-9142-ecc29b52aa4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:45.201232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d58e51-9fb4-4584-a5f3-4a2d4dbd9144 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:45.201782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19911690-53be-4e1c-9142-ecc29b52aa4d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.202186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19911690-53be-4e1c-9142-ecc29b52aa4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.202470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19911690-53be-4e1c-9142-ecc29b52aa4d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.203194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19911690-53be-4e1c-9142-ecc29b52aa4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:45.205283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19911690-53be-4e1c-9142-ecc29b52aa4d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.216340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cacb6-6094-4dca-9194-e874a8bbaacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:45.217079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cacb6-6094-4dca-9194-e874a8bbaacd admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.217316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cacb6-6094-4dca-9194-e874a8bbaacd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.217596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108cacb6-6094-4dca-9194-e874a8bbaacd admin admin] PATH_INFO: `/v3/projects/781c653f5d304a85af6266cfafe5fc6e/users/501f1daa455e4ebb86f976116219875f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.253885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cacb6-6094-4dca-9194-e874a8bbaacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=781c653f5d304a85af6266cfafe5fc6e, user_id=501f1daa455e4ebb86f976116219875f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:45.256679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108cacb6-6094-4dca-9194-e874a8bbaacd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.265854 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 880/1758] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:45 2022] POST /identity/v3/projects => generated 393 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:45.266978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19911690-53be-4e1c-9142-ecc29b52aa4d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:45.295770 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 879/1759] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:45 2022] PUT /identity/v3/projects/781c653f5d304a85af6266cfafe5fc6e/users/501f1daa455e4ebb86f976116219875f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:45.296835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cacb6-6094-4dca-9194-e874a8bbaacd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:45.397268 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:45.440076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108cacb6-6094-4dca-9194-e874a8bbaacd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:45.449394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19911690-53be-4e1c-9142-ecc29b52aa4d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:45.467580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdba5cd-dfac-494a-8d62-19729ef01ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:45.468843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdba5cd-dfac-494a-8d62-19729ef01ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.469234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdba5cd-dfac-494a-8d62-19729ef01ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.469671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdba5cd-dfac-494a-8d62-19729ef01ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.470549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdba5cd-dfac-494a-8d62-19729ef01ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:45.473360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdba5cd-dfac-494a-8d62-19729ef01ad2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.479532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741ade6-b4ac-48d2-bc83-44b43f6f4bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:45.480166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ade6-b4ac-48d2-bc83-44b43f6f4bdd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.480447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ade6-b4ac-48d2-bc83-44b43f6f4bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.480722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ade6-b4ac-48d2-bc83-44b43f6f4bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.481880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741ade6-b4ac-48d2-bc83-44b43f6f4bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:45.483548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741ade6-b4ac-48d2-bc83-44b43f6f4bdd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.509621 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 881/1760] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:45.512441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd84da-5425-448b-b38a-4f71388194ab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.512441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd84da-5425-448b-b38a-4f71388194ab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.512723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd84da-5425-448b-b38a-4f71388194ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.534053 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:45.555294 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 880/1761] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:45 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:45.555294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdba5cd-dfac-494a-8d62-19729ef01ad2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:45.580827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdba5cd-dfac-494a-8d62-19729ef01ad2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:45.591833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a27b-bbc7-4933-8d8f-8e58c6720d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:45.592889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a27b-bbc7-4933-8d8f-8e58c6720d48 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.593459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a27b-bbc7-4933-8d8f-8e58c6720d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.593983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d55a27b-bbc7-4933-8d8f-8e58c6720d48 admin admin] PATH_INFO: `/v3/projects/c7b62320759146fc883679048eac1fec/users/271bfaad0d2c44a1b26f59aece15ebb4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.611591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-37fd84da-5425-448b-b38a-4f71388194ab None None] MFA Rules not processed for user `501f1daa455e4ebb86f976116219875f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:45.613473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37fd84da-5425-448b-b38a-4f71388194ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:45.618028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55a27b-bbc7-4933-8d8f-8e58c6720d48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7b62320759146fc883679048eac1fec, user_id=271bfaad0d2c44a1b26f59aece15ebb4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:45.626137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d55a27b-bbc7-4933-8d8f-8e58c6720d48 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.707587 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 881/1762] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:45 2022] PUT /identity/v3/projects/c7b62320759146fc883679048eac1fec/users/271bfaad0d2c44a1b26f59aece15ebb4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:45.722279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a27b-bbc7-4933-8d8f-8e58c6720d48 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:45.816865 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 882/1763] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:45.816865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd84da-5425-448b-b38a-4f71388194ab None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:45.818425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37fd84da-5425-448b-b38a-4f71388194ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:45.873926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd84da-5425-448b-b38a-4f71388194ab None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:45.882760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:45.883529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.883884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.884888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] PATH_INFO: `/v3/projects/b8b8b36f82984eb9bbbbda190dca1bb9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.886549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8b8b36f82984eb9bbbbda190dca1bb9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:45.889697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.912421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d55a27b-bbc7-4933-8d8f-8e58c6720d48 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:45.931836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5befe-8060-47bb-94d4-a3da1fc06af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:45.932813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5befe-8060-47bb-94d4-a3da1fc06af8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.934442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5befe-8060-47bb-94d4-a3da1fc06af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.934585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5befe-8060-47bb-94d4-a3da1fc06af8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.935327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5befe-8060-47bb-94d4-a3da1fc06af8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:45.949552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5befe-8060-47bb-94d4-a3da1fc06af8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:45.978028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8b8b36f82984eb9bbbbda190dca1bb9', 'request_id': 'req-7126cf53-9cb3-4c9d-89dc-b48438e50e08'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:45.982931 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 882/1764] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:45 2022] GET /identity/v3/roles => generated 1420 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:45.982931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06148-7bbe-4a78-af70-d198691d3f6c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:45.982931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06148-7bbe-4a78-af70-d198691d3f6c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:45.982931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a06148-7bbe-4a78-af70-d198691d3f6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:45.994926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8b8b36f82984eb9bbbbda190dca1bb9', 'request_id': 'req-7126cf53-9cb3-4c9d-89dc-b48438e50e08'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:46.009484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8b8b36f82984eb9bbbbda190dca1bb9', 'request_id': 'req-7126cf53-9cb3-4c9d-89dc-b48438e50e08'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:46.028445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a9a06148-7bbe-4a78-af70-d198691d3f6c None None] MFA Rules not processed for user `271bfaad0d2c44a1b26f59aece15ebb4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:46.029780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a9a06148-7bbe-4a78-af70-d198691d3f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:46.039119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] The token cache is being invalidate because project b8b8b36f82984eb9bbbbda190dca1bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:46.054788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:46.056584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:46.063714 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 883/1765] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:45 2022] DELETE /identity/v3/projects/b8b8b36f82984eb9bbbbda190dca1bb9 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:46.065894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:46.068963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:46.184515 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 883/1766] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:45 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:46.185547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a06148-7bbe-4a78-af70-d198691d3f6c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:46.189042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a9a06148-7bbe-4a78-af70-d198691d3f6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:46.240783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7126cf53-9cb3-4c9d-89dc-b48438e50e08 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:46.251941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56f5e46-6228-44a6-ba54-c378530d1446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:46.254679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f5e46-6228-44a6-ba54-c378530d1446 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:46.255382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f5e46-6228-44a6-ba54-c378530d1446 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:46.255976 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:46.256425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56f5e46-6228-44a6-ba54-c378530d1446 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:46.259517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f5e46-6228-44a6-ba54-c378530d1446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:46.261988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56f5e46-6228-44a6-ba54-c378530d1446 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:46.314662 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:46.323584 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 884/1767] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:46 2022] POST /identity/v3/projects => generated 383 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:46.325671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08379827-078f-4476-84f8-5b1575d2225b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:46.326562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08379827-078f-4476-84f8-5b1575d2225b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:46.327196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08379827-078f-4476-84f8-5b1575d2225b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:46.355805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a06148-7bbe-4a78-af70-d198691d3f6c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:46.359802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-08379827-078f-4476-84f8-5b1575d2225b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:46.361241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08379827-078f-4476-84f8-5b1575d2225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:46.468224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc37065-4828-4c1d-bc35-dfa37d3aa2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:46.468478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc37065-4828-4c1d-bc35-dfa37d3aa2a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:46.468788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc37065-4828-4c1d-bc35-dfa37d3aa2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:46.469029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc37065-4828-4c1d-bc35-dfa37d3aa2a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:46.470846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc37065-4828-4c1d-bc35-dfa37d3aa2a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:46.472493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc37065-4828-4c1d-bc35-dfa37d3aa2a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:46.487852 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 885/1768] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:46.488747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08379827-078f-4476-84f8-5b1575d2225b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:46.492230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08379827-078f-4476-84f8-5b1575d2225b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:46.498940 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 884/1769] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:46.500548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc37065-4828-4c1d-bc35-dfa37d3aa2a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:46.516792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08379827-078f-4476-84f8-5b1575d2225b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:46.519941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc37065-4828-4c1d-bc35-dfa37d3aa2a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:46.527524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa885fd-941e-4991-a80b-45daa08178c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:46.528851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa885fd-941e-4991-a80b-45daa08178c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:46.529072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa885fd-941e-4991-a80b-45daa08178c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:46.530005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa885fd-941e-4991-a80b-45daa08178c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:46.531780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa885fd-941e-4991-a80b-45daa08178c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:46.534008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f7d8fb-2cae-4095-a096-8a2010839111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:46.535825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d8fb-2cae-4095-a096-8a2010839111 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:46.536057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d8fb-2cae-4095-a096-8a2010839111 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:46.536339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f7d8fb-2cae-4095-a096-8a2010839111 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:46.537060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d8fb-2cae-4095-a096-8a2010839111 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:46.537893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa885fd-941e-4991-a80b-45daa08178c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:46.542245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f7d8fb-2cae-4095-a096-8a2010839111 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:46.594540 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 885/1770] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:46 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:46.596118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc978fa-cb89-4940-9c0c-b81a94ecb1da None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:46.596355 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 886/1771] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:46 2022] POST /identity/v3/projects => generated 393 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:46.597321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa885fd-941e-4991-a80b-45daa08178c2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:46.599461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc978fa-cb89-4940-9c0c-b81a94ecb1da None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:46.599894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc978fa-cb89-4940-9c0c-b81a94ecb1da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:46.654526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-acc978fa-cb89-4940-9c0c-b81a94ecb1da None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:46.655797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-acc978fa-cb89-4940-9c0c-b81a94ecb1da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:46.738874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa885fd-941e-4991-a80b-45daa08178c2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:46.761145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fc87b-a59a-45a3-96ea-2c8ddc163d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:46.762176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fc87b-a59a-45a3-96ea-2c8ddc163d45 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:46.762411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fc87b-a59a-45a3-96ea-2c8ddc163d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:46.762720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2fc87b-a59a-45a3-96ea-2c8ddc163d45 admin admin] PATH_INFO: `/v3/projects/3ea3398f7cf848c78868f6804fbafbb3/users/41b9fb1c962048889302667d85c193f5/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:46.784416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fc87b-a59a-45a3-96ea-2c8ddc163d45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea3398f7cf848c78868f6804fbafbb3, user_id=41b9fb1c962048889302667d85c193f5, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:46.787804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2fc87b-a59a-45a3-96ea-2c8ddc163d45 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:46.809161 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 886/1772] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:46.813510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc978fa-cb89-4940-9c0c-b81a94ecb1da None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:46.820436 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 887/1773] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:46 2022] PUT /identity/v3/projects/3ea3398f7cf848c78868f6804fbafbb3/users/41b9fb1c962048889302667d85c193f5/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:46.823912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fc87b-a59a-45a3-96ea-2c8ddc163d45 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:46.830703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc978fa-cb89-4940-9c0c-b81a94ecb1da None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:46.985289 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:47.006466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21ecd-1de2-4b25-b895-f31c36e0ecf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.007108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21ecd-1de2-4b25-b895-f31c36e0ecf4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.007474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21ecd-1de2-4b25-b895-f31c36e0ecf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.007757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d21ecd-1de2-4b25-b895-f31c36e0ecf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.008423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d21ecd-1de2-4b25-b895-f31c36e0ecf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:47.010127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d21ecd-1de2-4b25-b895-f31c36e0ecf4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:47.036456 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 887/1774] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:46 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:47.036456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21ecd-1de2-4b25-b895-f31c36e0ecf4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:47.037241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2fc87b-a59a-45a3-96ea-2c8ddc163d45 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:47.048133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d21ecd-1de2-4b25-b895-f31c36e0ecf4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:47.049647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae29d42-39b1-4e28-9d6d-c5519aa38eae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.050298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae29d42-39b1-4e28-9d6d-c5519aa38eae admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.050575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae29d42-39b1-4e28-9d6d-c5519aa38eae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.050845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae29d42-39b1-4e28-9d6d-c5519aa38eae admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.051503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae29d42-39b1-4e28-9d6d-c5519aa38eae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:47.055599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae29d42-39b1-4e28-9d6d-c5519aa38eae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:47.056482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d4877b-41d8-4aec-8ea2-8646f6035699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.057449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4877b-41d8-4aec-8ea2-8646f6035699 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.057897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4877b-41d8-4aec-8ea2-8646f6035699 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.058458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d4877b-41d8-4aec-8ea2-8646f6035699 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.059318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4877b-41d8-4aec-8ea2-8646f6035699 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:47.059980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4877b-41d8-4aec-8ea2-8646f6035699 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:47.062129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d4877b-41d8-4aec-8ea2-8646f6035699 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:47.086799 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:47.095787 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 888/1775] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:47.095787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117495c6-1709-47e6-a2a7-41f8a935c828 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.095787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117495c6-1709-47e6-a2a7-41f8a935c828 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.095787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117495c6-1709-47e6-a2a7-41f8a935c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.122174 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 888/1776] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:46 2022] POST /identity/v3/users => generated 303 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:47.126270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae29d42-39b1-4e28-9d6d-c5519aa38eae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:47.146839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae29d42-39b1-4e28-9d6d-c5519aa38eae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:47.154053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-117495c6-1709-47e6-a2a7-41f8a935c828 None None] MFA Rules not processed for user `41b9fb1c962048889302667d85c193f5`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:47.155353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d33fe-35f4-4b9c-b2f8-34d483ef23ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.156360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d33fe-35f4-4b9c-b2f8-34d483ef23ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.156726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d33fe-35f4-4b9c-b2f8-34d483ef23ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.157077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d33fe-35f4-4b9c-b2f8-34d483ef23ba admin admin] PATH_INFO: `/v3/projects/4a08727684ec4f53adb25eb571a34587/users/5def2c28df594247ac3f16ea18c0c887/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.157967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-117495c6-1709-47e6-a2a7-41f8a935c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:47.209159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d33fe-35f4-4b9c-b2f8-34d483ef23ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a08727684ec4f53adb25eb571a34587, user_id=5def2c28df594247ac3f16ea18c0c887, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:47.212291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d33fe-35f4-4b9c-b2f8-34d483ef23ba admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:47.244002 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 889/1777] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:47 2022] PUT /identity/v3/projects/4a08727684ec4f53adb25eb571a34587/users/5def2c28df594247ac3f16ea18c0c887/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:47.246473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d33fe-35f4-4b9c-b2f8-34d483ef23ba admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:47.371932 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 889/1778] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:47 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:47.375080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117495c6-1709-47e6-a2a7-41f8a935c828 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:47.382548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d33fe-35f4-4b9c-b2f8-34d483ef23ba admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:47.388641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01449c-5420-43b7-8b68-19bbdf825530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.389470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01449c-5420-43b7-8b68-19bbdf825530 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.389861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01449c-5420-43b7-8b68-19bbdf825530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.390244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01449c-5420-43b7-8b68-19bbdf825530 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.391415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01449c-5420-43b7-8b68-19bbdf825530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:47.394331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01449c-5420-43b7-8b68-19bbdf825530 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:47.421651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117495c6-1709-47e6-a2a7-41f8a935c828 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:47.448627 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 890/1779] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:47 2022] POST /identity/v3/projects => generated 369 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:47.449847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01449c-5420-43b7-8b68-19bbdf825530 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:47.471738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5221b-3eda-4ce8-88c9-e1c1a3599331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.472378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5221b-3eda-4ce8-88c9-e1c1a3599331 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.472664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5221b-3eda-4ce8-88c9-e1c1a3599331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.476052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5221b-3eda-4ce8-88c9-e1c1a3599331 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.481093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5221b-3eda-4ce8-88c9-e1c1a3599331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:47.482875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5221b-3eda-4ce8-88c9-e1c1a3599331 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:47.510274 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 890/1780] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:47.515641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5221b-3eda-4ce8-88c9-e1c1a3599331 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:47.530771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5221b-3eda-4ce8-88c9-e1c1a3599331 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:47.589345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01449c-5420-43b7-8b68-19bbdf825530 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:47.608199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763f9af-ba94-4497-b8d9-c4a72ae5bc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.609765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763f9af-ba94-4497-b8d9-c4a72ae5bc9c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.612789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763f9af-ba94-4497-b8d9-c4a72ae5bc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.613285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f763f9af-ba94-4497-b8d9-c4a72ae5bc9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.614856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763f9af-ba94-4497-b8d9-c4a72ae5bc9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:47.617061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f763f9af-ba94-4497-b8d9-c4a72ae5bc9c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:47.676903 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 891/1781] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:47 2022] GET /identity/v3/roles => generated 1420 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:47.678899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763f9af-ba94-4497-b8d9-c4a72ae5bc9c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:47.745624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f763f9af-ba94-4497-b8d9-c4a72ae5bc9c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:47.769231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c4f8-60a0-499e-bfbc-11ac4bd3919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.770263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c4f8-60a0-499e-bfbc-11ac4bd3919c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.770593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4fa4-057b-4bd6-8e11-a7ddecaf68ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.770795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c4f8-60a0-499e-bfbc-11ac4bd3919c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.771774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4fa4-057b-4bd6-8e11-a7ddecaf68ec admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.771954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c4f8-60a0-499e-bfbc-11ac4bd3919c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.772116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4fa4-057b-4bd6-8e11-a7ddecaf68ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.772318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debc4fa4-057b-4bd6-8e11-a7ddecaf68ec admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:47.772970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0c4f8-60a0-499e-bfbc-11ac4bd3919c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:47.773139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc4fa4-057b-4bd6-8e11-a7ddecaf68ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:47.774946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debc4fa4-057b-4bd6-8e11-a7ddecaf68ec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:47.775768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0c4f8-60a0-499e-bfbc-11ac4bd3919c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:47.823894 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 892/1782] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:47 2022] POST /identity/v3/users => generated 285 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:47.824912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4fa4-057b-4bd6-8e11-a7ddecaf68ec admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:47.852675 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 891/1783] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:47 2022] POST /identity/v3/projects => generated 395 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:47.854561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c4f8-60a0-499e-bfbc-11ac4bd3919c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:47.856146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debc4fa4-057b-4bd6-8e11-a7ddecaf68ec admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:47.922169 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:47.984672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e33d6f-1981-4608-a4ca-2e592b55d1b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:47.985364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e33d6f-1981-4608-a4ca-2e592b55d1b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:47.985686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e33d6f-1981-4608-a4ca-2e592b55d1b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:47.985987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e33d6f-1981-4608-a4ca-2e592b55d1b7 admin admin] PATH_INFO: `/v3/projects/4144a752f1494a5e964cfb38db5c1d45/users/2458c3818faa409dbb95cd5d7cacc32a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.010340 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:48.021445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e33d6f-1981-4608-a4ca-2e592b55d1b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4144a752f1494a5e964cfb38db5c1d45, user_id=2458c3818faa409dbb95cd5d7cacc32a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.024579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e33d6f-1981-4608-a4ca-2e592b55d1b7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:48.059764 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 893/1784] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:47 2022] PUT /identity/v3/projects/4144a752f1494a5e964cfb38db5c1d45/users/2458c3818faa409dbb95cd5d7cacc32a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:48.060608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e33d6f-1981-4608-a4ca-2e592b55d1b7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:48.083884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c4f8-60a0-499e-bfbc-11ac4bd3919c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:48.214963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e33d6f-1981-4608-a4ca-2e592b55d1b7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:48.226670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf9a9d-b8ab-4efa-ab83-e62498ba0961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:48.227920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf9a9d-b8ab-4efa-ab83-e62498ba0961 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.228618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf9a9d-b8ab-4efa-ab83-e62498ba0961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.228917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf9a9d-b8ab-4efa-ab83-e62498ba0961 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.230041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf9a9d-b8ab-4efa-ab83-e62498ba0961 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.234073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf9a9d-b8ab-4efa-ab83-e62498ba0961 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:48.249225 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 894/1785] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:48.250247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf9a9d-b8ab-4efa-ab83-e62498ba0961 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:48.257611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e82c6-1d48-46b2-b284-09189c1bbcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:48.258316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e82c6-1d48-46b2-b284-09189c1bbcfe admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.258587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e82c6-1d48-46b2-b284-09189c1bbcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.258872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e82c6-1d48-46b2-b284-09189c1bbcfe admin admin] PATH_INFO: `/v3/projects/4a08727684ec4f53adb25eb571a34587/users/5def2c28df594247ac3f16ea18c0c887/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.264561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf9a9d-b8ab-4efa-ab83-e62498ba0961 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:48.265832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e82c6-1d48-46b2-b284-09189c1bbcfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a08727684ec4f53adb25eb571a34587, user_id=5def2c28df594247ac3f16ea18c0c887, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.270476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3e82c6-1d48-46b2-b284-09189c1bbcfe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:48.281275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae725e-9496-4236-aea8-8b63f560c45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:48.283267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae725e-9496-4236-aea8-8b63f560c45b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.283554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae725e-9496-4236-aea8-8b63f560c45b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.286070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fae725e-9496-4236-aea8-8b63f560c45b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.288471 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 892/1786] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:47 2022] PUT /identity/v3/projects/4a08727684ec4f53adb25eb571a34587/users/5def2c28df594247ac3f16ea18c0c887/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:48.289580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae725e-9496-4236-aea8-8b63f560c45b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.290006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e82c6-1d48-46b2-b284-09189c1bbcfe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:48.293568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fae725e-9496-4236-aea8-8b63f560c45b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:48.348128 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 895/1787] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:48 2022] POST /identity/v3/users => generated 304 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:48.351205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae725e-9496-4236-aea8-8b63f560c45b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:48.378096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fae725e-9496-4236-aea8-8b63f560c45b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:48.485519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e82c6-1d48-46b2-b284-09189c1bbcfe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:48.495693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c66830-079b-4220-b2e7-f591ec36198b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:48.496596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c66830-079b-4220-b2e7-f591ec36198b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.497206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c66830-079b-4220-b2e7-f591ec36198b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.497516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c66830-079b-4220-b2e7-f591ec36198b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.498448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c66830-079b-4220-b2e7-f591ec36198b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.501000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c66830-079b-4220-b2e7-f591ec36198b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:48.527466 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 893/1788] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:48.529411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb4cf-fdf2-4194-9ff1-73724b158da9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.529791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb4cf-fdf2-4194-9ff1-73724b158da9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.530266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5eeb4cf-fdf2-4194-9ff1-73724b158da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.536663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c018453-0d7f-4964-9074-02e3b65ceede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:48.538462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c018453-0d7f-4964-9074-02e3b65ceede admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.539000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c018453-0d7f-4964-9074-02e3b65ceede admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.539287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c018453-0d7f-4964-9074-02e3b65ceede admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.547674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c018453-0d7f-4964-9074-02e3b65ceede admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.549448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c018453-0d7f-4964-9074-02e3b65ceede admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:48.565390 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 896/1789] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:48.566381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c018453-0d7f-4964-9074-02e3b65ceede admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:48.571863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c5eeb4cf-fdf2-4194-9ff1-73724b158da9 None None] MFA Rules not processed for user `5def2c28df594247ac3f16ea18c0c887`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:48.574160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c5eeb4cf-fdf2-4194-9ff1-73724b158da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:48.579609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c018453-0d7f-4964-9074-02e3b65ceede admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:48.585182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e305714-f03a-481d-9d47-2c4ccf63e9dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:48.585868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e305714-f03a-481d-9d47-2c4ccf63e9dc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.586155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e305714-f03a-481d-9d47-2c4ccf63e9dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.586436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e305714-f03a-481d-9d47-2c4ccf63e9dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.587088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e305714-f03a-481d-9d47-2c4ccf63e9dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.588717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e305714-f03a-481d-9d47-2c4ccf63e9dc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:48.612011 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 897/1790] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:48 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:48.612011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e305714-f03a-481d-9d47-2c4ccf63e9dc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:48.623726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e305714-f03a-481d-9d47-2c4ccf63e9dc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:48.629379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46a563-9a61-485c-bea6-b5247794748a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:48.630770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46a563-9a61-485c-bea6-b5247794748a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.630770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46a563-9a61-485c-bea6-b5247794748a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.630770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce46a563-9a61-485c-bea6-b5247794748a admin admin] PATH_INFO: `/v3/projects/4144a752f1494a5e964cfb38db5c1d45/users/2458c3818faa409dbb95cd5d7cacc32a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.633337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46a563-9a61-485c-bea6-b5247794748a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4144a752f1494a5e964cfb38db5c1d45, user_id=2458c3818faa409dbb95cd5d7cacc32a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.636553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce46a563-9a61-485c-bea6-b5247794748a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:48.650851 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 898/1791] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:48 2022] PUT /identity/v3/projects/4144a752f1494a5e964cfb38db5c1d45/users/2458c3818faa409dbb95cd5d7cacc32a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:48.651604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46a563-9a61-485c-bea6-b5247794748a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:48.679789 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:48.795333 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 894/1792] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:48.796304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb4cf-fdf2-4194-9ff1-73724b158da9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:48.839576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5eeb4cf-fdf2-4194-9ff1-73724b158da9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:48.845882 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:48.893275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce46a563-9a61-485c-bea6-b5247794748a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:48.910079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca14c04-3e2e-4b76-bdc6-c3ab6518f10b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:48.910942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca14c04-3e2e-4b76-bdc6-c3ab6518f10b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.911286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca14c04-3e2e-4b76-bdc6-c3ab6518f10b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.912309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca14c04-3e2e-4b76-bdc6-c3ab6518f10b admin admin] PATH_INFO: `/v3/projects/246298e703e743809a1a7a89107c61d1/users/22a7aad4f3f648c2ac98ec3668d3ccec/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.954167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca14c04-3e2e-4b76-bdc6-c3ab6518f10b admin admin] RBAC: Authorizing `identity:create_grant(project_id=246298e703e743809a1a7a89107c61d1, user_id=22a7aad4f3f648c2ac98ec3668d3ccec, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.957082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca14c04-3e2e-4b76-bdc6-c3ab6518f10b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:48.969337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615a76-1800-43bc-8ab4-abf633d18655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:48.970211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615a76-1800-43bc-8ab4-abf633d18655 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:48.970754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615a76-1800-43bc-8ab4-abf633d18655 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:48.971135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04615a76-1800-43bc-8ab4-abf633d18655 admin admin] PATH_INFO: `/v3/projects/aeecb4a0890b4e589001bdc3478c7abd/users/1b628bec0ea641c7a9065801eb2f01a6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:48.992470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04615a76-1800-43bc-8ab4-abf633d18655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeecb4a0890b4e589001bdc3478c7abd, user_id=1b628bec0ea641c7a9065801eb2f01a6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:48.995838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04615a76-1800-43bc-8ab4-abf633d18655 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:49.016703 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 899/1793] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:48 2022] PUT /identity/v3/projects/246298e703e743809a1a7a89107c61d1/users/22a7aad4f3f648c2ac98ec3668d3ccec/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:49.016703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4586-7751-4c3c-8de3-f5462ee2773b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:49.016703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4586-7751-4c3c-8de3-f5462ee2773b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:49.016703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bab4586-7751-4c3c-8de3-f5462ee2773b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:49.044061 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 895/1794] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:48 2022] PUT /identity/v3/projects/aeecb4a0890b4e589001bdc3478c7abd/users/1b628bec0ea641c7a9065801eb2f01a6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:49.044061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615a76-1800-43bc-8ab4-abf633d18655 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:49.046837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-04615a76-1800-43bc-8ab4-abf633d18655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:49.053454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0bab4586-7751-4c3c-8de3-f5462ee2773b None None] MFA Rules not processed for user `2458c3818faa409dbb95cd5d7cacc32a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:49.058808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0bab4586-7751-4c3c-8de3-f5462ee2773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:49.160119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04615a76-1800-43bc-8ab4-abf633d18655 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:49.167276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7405173a-9112-4269-91ee-4fc06f5f948f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:49.168252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405173a-9112-4269-91ee-4fc06f5f948f service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:49.168380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405173a-9112-4269-91ee-4fc06f5f948f service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:49.168786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7405173a-9112-4269-91ee-4fc06f5f948f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:49.223623 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 900/1795] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:49 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:49.224872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab4586-7751-4c3c-8de3-f5462ee2773b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:49.233709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0bab4586-7751-4c3c-8de3-f5462ee2773b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:49.270091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bab4586-7751-4c3c-8de3-f5462ee2773b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:49.289090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad285-400d-4fcc-a542-6db5fb1c4718 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:49.289763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad285-400d-4fcc-a542-6db5fb1c4718 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:49.290045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad285-400d-4fcc-a542-6db5fb1c4718 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:49.290317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad285-400d-4fcc-a542-6db5fb1c4718 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:49.299234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-36dad285-400d-4fcc-a542-6db5fb1c4718 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:49.308928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405173a-9112-4269-91ee-4fc06f5f948f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:49.312599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7405173a-9112-4269-91ee-4fc06f5f948f service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:49.338906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 896/1796] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:49 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:49.340248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b63c9-0a90-4f7d-8ada-cb77d5ba2a20 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:49.340667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b63c9-0a90-4f7d-8ada-cb77d5ba2a20 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:49.341236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b63c9-0a90-4f7d-8ada-cb77d5ba2a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:49.421942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fd9b63c9-0a90-4f7d-8ada-cb77d5ba2a20 None None] MFA Rules not processed for user `22a7aad4f3f648c2ac98ec3668d3ccec`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:49.423338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fd9b63c9-0a90-4f7d-8ada-cb77d5ba2a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:49.457429 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:49.472456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad285-400d-4fcc-a542-6db5fb1c4718 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:49.474322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad285-400d-4fcc-a542-6db5fb1c4718 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:49.486504 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 901/1797] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:49 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:49.487429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad285-400d-4fcc-a542-6db5fb1c4718 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:49.498053 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:49.586026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad285-400d-4fcc-a542-6db5fb1c4718 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:49.592967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4b83-9e08-48cf-acaa-4b839c4dc8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:49.594127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4b83-9e08-48cf-acaa-4b839c4dc8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:49.594415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4b83-9e08-48cf-acaa-4b839c4dc8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:49.594687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3e4b83-9e08-48cf-acaa-4b839c4dc8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:49.595334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e4b83-9e08-48cf-acaa-4b839c4dc8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:49.597213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3e4b83-9e08-48cf-acaa-4b839c4dc8d5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:49.613065 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 902/1798] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:49 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:49.614299 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 897/1799] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:49.614882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4b83-9e08-48cf-acaa-4b839c4dc8d5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:49.622927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b63c9-0a90-4f7d-8ada-cb77d5ba2a20 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:49.628149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3e4b83-9e08-48cf-acaa-4b839c4dc8d5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:49.659069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4895e073-c13f-47a0-bb68-4cc41d086fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:49.659583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895e073-c13f-47a0-bb68-4cc41d086fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:49.659861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895e073-c13f-47a0-bb68-4cc41d086fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:49.660132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4895e073-c13f-47a0-bb68-4cc41d086fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:49.660767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895e073-c13f-47a0-bb68-4cc41d086fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:49.662744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4895e073-c13f-47a0-bb68-4cc41d086fe5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:49.676072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9b63c9-0a90-4f7d-8ada-cb77d5ba2a20 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:49.685560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee3d21-fbb4-49dc-8aa8-2e23d494ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:49.686241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee3d21-fbb4-49dc-8aa8-2e23d494ba3b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:49.686517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee3d21-fbb4-49dc-8aa8-2e23d494ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:49.686787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eee3d21-fbb4-49dc-8aa8-2e23d494ba3b admin admin] PATH_INFO: `/v3/projects/aeecb4a0890b4e589001bdc3478c7abd/users/1b628bec0ea641c7a9065801eb2f01a6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:49.698963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee3d21-fbb4-49dc-8aa8-2e23d494ba3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=aeecb4a0890b4e589001bdc3478c7abd, user_id=1b628bec0ea641c7a9065801eb2f01a6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:49.702718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eee3d21-fbb4-49dc-8aa8-2e23d494ba3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:49.737495 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 898/1800] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:49 2022] PUT /identity/v3/projects/aeecb4a0890b4e589001bdc3478c7abd/users/1b628bec0ea641c7a9065801eb2f01a6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:49.740557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee3d21-fbb4-49dc-8aa8-2e23d494ba3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:49.749410 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 903/1801] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:49 2022] POST /identity/v3/projects => generated 395 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:49.751975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4b36a-b39f-4e6c-9eb3-cf119c0f4f3a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:49.755402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4b36a-b39f-4e6c-9eb3-cf119c0f4f3a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:49.756487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f4b36a-b39f-4e6c-9eb3-cf119c0f4f3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:49.826515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f9f4b36a-b39f-4e6c-9eb3-cf119c0f4f3a None None] MFA Rules not processed for user `1b628bec0ea641c7a9065801eb2f01a6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:49.831770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f9f4b36a-b39f-4e6c-9eb3-cf119c0f4f3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:49.907402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eee3d21-fbb4-49dc-8aa8-2e23d494ba3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:49.969425 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 904/1802] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:49 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:49.969425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4b36a-b39f-4e6c-9eb3-cf119c0f4f3a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.064650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87a9a0-bbde-49ff-bb27-821a161def9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.065572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a9a0-bbde-49ff-bb27-821a161def9f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.065915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a9a0-bbde-49ff-bb27-821a161def9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.066379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87a9a0-bbde-49ff-bb27-821a161def9f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.067267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87a9a0-bbde-49ff-bb27-821a161def9f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.070094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e87a9a0-bbde-49ff-bb27-821a161def9f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.116325 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 899/1803] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:49 2022] POST /identity/v3/projects => generated 369 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:50.118565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f4b36a-b39f-4e6c-9eb3-cf119c0f4f3a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:50.118967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325248f-9719-44db-89ec-96db4d92e60c None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.119350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325248f-9719-44db-89ec-96db4d92e60c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.119882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a325248f-9719-44db-89ec-96db4d92e60c None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.122016 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 900/1804] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:51:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:50.123077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325248f-9719-44db-89ec-96db4d92e60c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.125767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a325248f-9719-44db-89ec-96db4d92e60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:50.135100 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:50.167997 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:50.195346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875a3f9-1628-44bf-9f1d-b31c57313f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.195879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875a3f9-1628-44bf-9f1d-b31c57313f4f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.196158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875a3f9-1628-44bf-9f1d-b31c57313f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.196429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875a3f9-1628-44bf-9f1d-b31c57313f4f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.197064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875a3f9-1628-44bf-9f1d-b31c57313f4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.200194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3875a3f9-1628-44bf-9f1d-b31c57313f4f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.219792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a325248f-9719-44db-89ec-96db4d92e60c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:50.226676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.227520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.227944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.228309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] PATH_INFO: `/v3/users/f30ed27bff6c406a987841dcf1ade4a1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.231903 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 905/1805] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:49 2022] POST /identity/v3/users => generated 298 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:50.231903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875a3f9-1628-44bf-9f1d-b31c57313f4f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.232134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=f30ed27bff6c406a987841dcf1ade4a1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.233259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.298058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f30ed27bff6c406a987841dcf1ade4a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:50.314745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f30ed27bff6c406a987841dcf1ade4a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:50.315612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f30ed27bff6c406a987841dcf1ade4a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:50.323997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f30ed27bff6c406a987841dcf1ade4a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:50.328338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875a3f9-1628-44bf-9f1d-b31c57313f4f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:50.332101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f30ed27bff6c406a987841dcf1ade4a1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:50.338615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395b3e7-054f-4dc7-89b3-b5ae82b279e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.339404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395b3e7-054f-4dc7-89b3-b5ae82b279e9 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.339742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395b3e7-054f-4dc7-89b3-b5ae82b279e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.340202 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 901/1806] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:50 2022] DELETE /identity/v3/users/f30ed27bff6c406a987841dcf1ade4a1 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:50.341119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.342824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:50.343465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395b3e7-054f-4dc7-89b3-b5ae82b279e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.346233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c395b3e7-054f-4dc7-89b3-b5ae82b279e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:50.436560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7460174b-2bab-420d-a360-6d5197adcf1c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:50.442442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f83e-79f2-4d54-9e22-10c74e8a3648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.443152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f83e-79f2-4d54-9e22-10c74e8a3648 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.443438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f83e-79f2-4d54-9e22-10c74e8a3648 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.443717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f83e-79f2-4d54-9e22-10c74e8a3648 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.444536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f83e-79f2-4d54-9e22-10c74e8a3648 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.444806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395b3e7-054f-4dc7-89b3-b5ae82b279e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.446604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d053f83e-79f2-4d54-9e22-10c74e8a3648 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.447340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395b3e7-054f-4dc7-89b3-b5ae82b279e9 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.461068 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 906/1807] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:50 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:50.463015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c47e2a-ba8f-4c55-a8d1-62adcb379c04 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.464229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c47e2a-ba8f-4c55-a8d1-62adcb379c04 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.464739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c47e2a-ba8f-4c55-a8d1-62adcb379c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.483174 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 902/1808] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:50 2022] POST /identity/v3/users => generated 291 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:50.483174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f83e-79f2-4d54-9e22-10c74e8a3648 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.491309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d053f83e-79f2-4d54-9e22-10c74e8a3648 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:50.501269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-99c47e2a-ba8f-4c55-a8d1-62adcb379c04 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:50.502867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-99c47e2a-ba8f-4c55-a8d1-62adcb379c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:50.529460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f83e-79f2-4d54-9e22-10c74e8a3648 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:50.547231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862bfcb-ef27-4d5e-8cd8-1a4ecc0c5a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.548246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862bfcb-ef27-4d5e-8cd8-1a4ecc0c5a08 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.549391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862bfcb-ef27-4d5e-8cd8-1a4ecc0c5a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.549958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9862bfcb-ef27-4d5e-8cd8-1a4ecc0c5a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.554108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862bfcb-ef27-4d5e-8cd8-1a4ecc0c5a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.556542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9862bfcb-ef27-4d5e-8cd8-1a4ecc0c5a08 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.568615 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:50.584323 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 903/1809] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:50.586153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862bfcb-ef27-4d5e-8cd8-1a4ecc0c5a08 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.604331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9862bfcb-ef27-4d5e-8cd8-1a4ecc0c5a08 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:50.611137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba5e14-add9-4537-a07a-2caf5cd43aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.612122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba5e14-add9-4537-a07a-2caf5cd43aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.612606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba5e14-add9-4537-a07a-2caf5cd43aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.616193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ba5e14-add9-4537-a07a-2caf5cd43aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.617817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba5e14-add9-4537-a07a-2caf5cd43aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.620478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ba5e14-add9-4537-a07a-2caf5cd43aa5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.640266 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 904/1810] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:50.642065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba5e14-add9-4537-a07a-2caf5cd43aa5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.661609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ba5e14-add9-4537-a07a-2caf5cd43aa5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:50.674857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381da1e-fa82-457c-950e-811a7f68b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.675904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381da1e-fa82-457c-950e-811a7f68b801 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.675904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381da1e-fa82-457c-950e-811a7f68b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.676194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381da1e-fa82-457c-950e-811a7f68b801 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.676832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381da1e-fa82-457c-950e-811a7f68b801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.689031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9381da1e-fa82-457c-950e-811a7f68b801 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.696975 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 907/1811] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:51:50 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:50.696975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c47e2a-ba8f-4c55-a8d1-62adcb379c04 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.714274 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 905/1812] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:50 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:50.722604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381da1e-fa82-457c-950e-811a7f68b801 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.725575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9381da1e-fa82-457c-950e-811a7f68b801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:50.753743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c47e2a-ba8f-4c55-a8d1-62adcb379c04 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:50.758096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381da1e-fa82-457c-950e-811a7f68b801 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:50.759944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0586d-d356-4809-8669-e926a76985dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.760642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0586d-d356-4809-8669-e926a76985dd admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.760922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0586d-d356-4809-8669-e926a76985dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.761198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0586d-d356-4809-8669-e926a76985dd admin admin] PATH_INFO: `/v3/projects/c5fdbbd51a4f483685c97e7b1733ef8e/users/19651967f0e148e2949ae15996d6487d/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.782015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d917c3-2b8b-4137-bb77-3258aabde018 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:50.784963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d917c3-2b8b-4137-bb77-3258aabde018 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:50.785246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d917c3-2b8b-4137-bb77-3258aabde018 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:50.790073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d917c3-2b8b-4137-bb77-3258aabde018 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:50.796720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0586d-d356-4809-8669-e926a76985dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5fdbbd51a4f483685c97e7b1733ef8e, user_id=19651967f0e148e2949ae15996d6487d, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.797472 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:50.802695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0586d-d356-4809-8669-e926a76985dd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.808017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d917c3-2b8b-4137-bb77-3258aabde018 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:50.821011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d917c3-2b8b-4137-bb77-3258aabde018 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:50.830320 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 908/1813] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:50 2022] PUT /identity/v3/projects/c5fdbbd51a4f483685c97e7b1733ef8e/users/19651967f0e148e2949ae15996d6487d/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:50.837271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0586d-d356-4809-8669-e926a76985dd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.841653 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 906/1814] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:50.843271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d917c3-2b8b-4137-bb77-3258aabde018 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:50.845131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-43d917c3-2b8b-4137-bb77-3258aabde018 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:50.864973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d917c3-2b8b-4137-bb77-3258aabde018 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:51.034336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:51.035409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.035779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.036071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] PATH_INFO: `/v3/projects/e306129f54ed47fc8682f46b3cb7c955` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.036747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0586d-d356-4809-8669-e926a76985dd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:51.041921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e306129f54ed47fc8682f46b3cb7c955)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:51.042469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b589aab-255d-40fa-b15f-fbe95333416a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:51.043281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b589aab-255d-40fa-b15f-fbe95333416a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.043573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b589aab-255d-40fa-b15f-fbe95333416a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.043847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b589aab-255d-40fa-b15f-fbe95333416a admin admin] PATH_INFO: `/v3/projects/d676b7239abf444ca090dc4d06dd2db0/users/360d9ace59f846be8521c939ac783e61/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.044365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:51.067468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b589aab-255d-40fa-b15f-fbe95333416a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d676b7239abf444ca090dc4d06dd2db0, user_id=360d9ace59f846be8521c939ac783e61, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:51.071828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b589aab-255d-40fa-b15f-fbe95333416a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:51.092834 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 909/1815] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:50 2022] PUT /identity/v3/projects/d676b7239abf444ca090dc4d06dd2db0/users/360d9ace59f846be8521c939ac783e61/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:51.094089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b589aab-255d-40fa-b15f-fbe95333416a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:51.096880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8b589aab-255d-40fa-b15f-fbe95333416a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.168296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e306129f54ed47fc8682f46b3cb7c955', 'request_id': 'req-42fe8a27-b6bc-4416-a4ce-556313e50149'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.186752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e306129f54ed47fc8682f46b3cb7c955', 'request_id': 'req-42fe8a27-b6bc-4416-a4ce-556313e50149'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.198696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e306129f54ed47fc8682f46b3cb7c955', 'request_id': 'req-42fe8a27-b6bc-4416-a4ce-556313e50149'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.239692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] The token cache is being invalidate because project e306129f54ed47fc8682f46b3cb7c955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:51.245367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.254096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.269040 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 907/1816] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:50 2022] DELETE /identity/v3/projects/e306129f54ed47fc8682f46b3cb7c955 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:51.269926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:51.271929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.274712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b589aab-255d-40fa-b15f-fbe95333416a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:51.332462 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:51.366397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:51.367086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.367358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.367693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] PATH_INFO: `/v3/users/41b9fb1c962048889302667d85c193f5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.369416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b9fb1c962048889302667d85c193f5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:51.374286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:51.392465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fe8a27-b6bc-4416-a4ce-556313e50149 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:51.399197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c13bef-35d8-4ce1-9e43-4ebf97359233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:51.400306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c13bef-35d8-4ce1-9e43-4ebf97359233 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.400848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c13bef-35d8-4ce1-9e43-4ebf97359233 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.401655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c13bef-35d8-4ce1-9e43-4ebf97359233 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.403749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c13bef-35d8-4ce1-9e43-4ebf97359233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:51.406119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c13bef-35d8-4ce1-9e43-4ebf97359233 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:51.420676 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 908/1817] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:51 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:51.422556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a211f-d31f-4e77-9cd7-beb1e1fd8acd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.423085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a211f-d31f-4e77-9cd7-beb1e1fd8acd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.423569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7a211f-d31f-4e77-9cd7-beb1e1fd8acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.460500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b9fb1c962048889302667d85c193f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.465763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2d7a211f-d31f-4e77-9cd7-beb1e1fd8acd None None] MFA Rules not processed for user `360d9ace59f846be8521c939ac783e61`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:51.468422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2d7a211f-d31f-4e77-9cd7-beb1e1fd8acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.484046 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:51.497273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b9fb1c962048889302667d85c193f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.498758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b9fb1c962048889302667d85c193f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.510894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b9fb1c962048889302667d85c193f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.523387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed0f8f6c-6030-4f10-adb8-3dc741537da4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b9fb1c962048889302667d85c193f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:51.536607 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 910/1818] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:51 2022] DELETE /identity/v3/users/41b9fb1c962048889302667d85c193f5 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:51.538378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f737ecd-b952-4348-8b20-60c738182c91 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.538817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f737ecd-b952-4348-8b20-60c738182c91 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.539103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f737ecd-b952-4348-8b20-60c738182c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.577523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5f737ecd-b952-4348-8b20-60c738182c91 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:51.579540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5f737ecd-b952-4348-8b20-60c738182c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.585593 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 909/1819] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:51.587719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d37fd-d74a-4330-acd0-f67dbf930e27 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.588003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d37fd-d74a-4330-acd0-f67dbf930e27 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.589042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d37fd-d74a-4330-acd0-f67dbf930e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.614475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8b8d37fd-d74a-4330-acd0-f67dbf930e27 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:51.616698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b8d37fd-d74a-4330-acd0-f67dbf930e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.673877 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 911/1820] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:51.673877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f737ecd-b952-4348-8b20-60c738182c91 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:51.673877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5f737ecd-b952-4348-8b20-60c738182c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.686556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f737ecd-b952-4348-8b20-60c738182c91 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:51.699933 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 910/1821] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:51.702965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b1657-f2e5-472e-8f1c-2441d776b42e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.703609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b1657-f2e5-472e-8f1c-2441d776b42e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.704128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3b1657-f2e5-472e-8f1c-2441d776b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.714961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31857ef0-b40f-40e8-ae1d-c6bcfd099b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:51.715642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31857ef0-b40f-40e8-ae1d-c6bcfd099b7a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.715924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31857ef0-b40f-40e8-ae1d-c6bcfd099b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.716201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31857ef0-b40f-40e8-ae1d-c6bcfd099b7a admin admin] PATH_INFO: `/v3/projects/c5fdbbd51a4f483685c97e7b1733ef8e/users/19651967f0e148e2949ae15996d6487d/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.719078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31857ef0-b40f-40e8-ae1d-c6bcfd099b7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5fdbbd51a4f483685c97e7b1733ef8e, user_id=19651967f0e148e2949ae15996d6487d, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:51.722284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31857ef0-b40f-40e8-ae1d-c6bcfd099b7a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:51.733551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0e3b1657-f2e5-472e-8f1c-2441d776b42e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:51.735058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0e3b1657-f2e5-472e-8f1c-2441d776b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.743191 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 912/1822] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:51 2022] PUT /identity/v3/projects/c5fdbbd51a4f483685c97e7b1733ef8e/users/19651967f0e148e2949ae15996d6487d/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:51.744594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321a35-e925-42ef-9eee-586f06c0984d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.745084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321a35-e925-42ef-9eee-586f06c0984d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.745392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51321a35-e925-42ef-9eee-586f06c0984d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.765973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-51321a35-e925-42ef-9eee-586f06c0984d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:51.767182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-51321a35-e925-42ef-9eee-586f06c0984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.817345 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 911/1823] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:51.821494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b1657-f2e5-472e-8f1c-2441d776b42e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:51.822983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0e3b1657-f2e5-472e-8f1c-2441d776b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.830335 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:51.864412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 913/1824] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:51.870681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321a35-e925-42ef-9eee-586f06c0984d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:51.872405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-51321a35-e925-42ef-9eee-586f06c0984d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:51.905184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3b1657-f2e5-472e-8f1c-2441d776b42e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:51.909613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b528473a-05d6-48a6-aa4d-d41c6e932454 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:51.910265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528473a-05d6-48a6-aa4d-d41c6e932454 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.910542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528473a-05d6-48a6-aa4d-d41c6e932454 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.910813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b528473a-05d6-48a6-aa4d-d41c6e932454 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.928852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528473a-05d6-48a6-aa4d-d41c6e932454 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:51.932135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b528473a-05d6-48a6-aa4d-d41c6e932454 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:51.946376 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 912/1825] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:51.948182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1973-28e0-46ad-9268-4ef6c0dc6900 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:51.948578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1973-28e0-46ad-9268-4ef6c0dc6900 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:51.948980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455a1973-28e0-46ad-9268-4ef6c0dc6900 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:51.970033 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:52.003238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51321a35-e925-42ef-9eee-586f06c0984d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.008408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-455a1973-28e0-46ad-9268-4ef6c0dc6900 None None] MFA Rules not processed for user `19651967f0e148e2949ae15996d6487d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:52.009991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-455a1973-28e0-46ad-9268-4ef6c0dc6900 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.017437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c152e5a-dc1d-4569-83ab-414c3980124d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.018073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c152e5a-dc1d-4569-83ab-414c3980124d service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.018415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c152e5a-dc1d-4569-83ab-414c3980124d service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.018617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c152e5a-dc1d-4569-83ab-414c3980124d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.024397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c152e5a-dc1d-4569-83ab-414c3980124d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.097367 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 913/1826] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:51 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:52.098436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1973-28e0-46ad-9268-4ef6c0dc6900 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.113135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c152e5a-dc1d-4569-83ab-414c3980124d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.113575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455a1973-28e0-46ad-9268-4ef6c0dc6900 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.114953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c152e5a-dc1d-4569-83ab-414c3980124d service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.118182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425c6a9-2ae6-459d-988c-0936bdd39bc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.119320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425c6a9-2ae6-459d-988c-0936bdd39bc0 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.119320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425c6a9-2ae6-459d-988c-0936bdd39bc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.119511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b425c6a9-2ae6-459d-988c-0936bdd39bc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.129894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425c6a9-2ae6-459d-988c-0936bdd39bc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.131939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b425c6a9-2ae6-459d-988c-0936bdd39bc0 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.133795 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 914/1827] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:51 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:52.134906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c152e5a-dc1d-4569-83ab-414c3980124d service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.143547 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 914/1828] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:52.150657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c152e5a-dc1d-4569-83ab-414c3980124d service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.156275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790817a7-86c9-47d6-9f69-b14a34773a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.156895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790817a7-86c9-47d6-9f69-b14a34773a36 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.157171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790817a7-86c9-47d6-9f69-b14a34773a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.157473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790817a7-86c9-47d6-9f69-b14a34773a36 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.158537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790817a7-86c9-47d6-9f69-b14a34773a36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:52.158846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790817a7-86c9-47d6-9f69-b14a34773a36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.160520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790817a7-86c9-47d6-9f69-b14a34773a36 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.177007 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 915/1829] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:52.181346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425c6a9-2ae6-459d-988c-0936bdd39bc0 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.194210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b425c6a9-2ae6-459d-988c-0936bdd39bc0 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.207476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e07d-cae8-4d76-aed4-9344ed75a588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.208184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e07d-cae8-4d76-aed4-9344ed75a588 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.209066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e07d-cae8-4d76-aed4-9344ed75a588 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.209450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604e07d-cae8-4d76-aed4-9344ed75a588 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.210238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e07d-cae8-4d76-aed4-9344ed75a588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.212439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604e07d-cae8-4d76-aed4-9344ed75a588 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.272376 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 915/1830] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:52 2022] POST /identity/v3/projects => generated 379 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:51:52.277172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790817a7-86c9-47d6-9f69-b14a34773a36 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.284467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e07d-cae8-4d76-aed4-9344ed75a588 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.290072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1604e07d-cae8-4d76-aed4-9344ed75a588 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.293382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790817a7-86c9-47d6-9f69-b14a34773a36 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.394987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587d2b4-4cb5-457e-9f97-b596273994ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.395873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587d2b4-4cb5-457e-9f97-b596273994ed admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.396173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587d2b4-4cb5-457e-9f97-b596273994ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.396604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587d2b4-4cb5-457e-9f97-b596273994ed admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.398044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587d2b4-4cb5-457e-9f97-b596273994ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.401333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3587d2b4-4cb5-457e-9f97-b596273994ed admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.403645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604e07d-cae8-4d76-aed4-9344ed75a588 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.409702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558dfdf-deed-4405-a3a7-359e348bb88f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.409850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558dfdf-deed-4405-a3a7-359e348bb88f service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.410233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558dfdf-deed-4405-a3a7-359e348bb88f service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.410585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558dfdf-deed-4405-a3a7-359e348bb88f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.412468 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:52.414184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b558dfdf-deed-4405-a3a7-359e348bb88f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.429856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558dfdf-deed-4405-a3a7-359e348bb88f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.431643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b558dfdf-deed-4405-a3a7-359e348bb88f service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.434947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 916/1831] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:52 2022] POST /identity/v3/users => generated 290 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:52.436209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587d2b4-4cb5-457e-9f97-b596273994ed admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.438922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3587d2b4-4cb5-457e-9f97-b596273994ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.444956 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 916/1832] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:52.446172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558dfdf-deed-4405-a3a7-359e348bb88f service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.453542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3587d2b4-4cb5-457e-9f97-b596273994ed admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.459503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.460325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.460723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.461005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] PATH_INFO: `/v3/users/501f1daa455e4ebb86f976116219875f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.462835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=501f1daa455e4ebb86f976116219875f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.464930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.505928 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:52.545396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558dfdf-deed-4405-a3a7-359e348bb88f service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.548134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501f1daa455e4ebb86f976116219875f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.559507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a638c9-3dbd-4c6f-aa11-06ad03bb25a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.561687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a638c9-3dbd-4c6f-aa11-06ad03bb25a6 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.562102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a638c9-3dbd-4c6f-aa11-06ad03bb25a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.562414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a638c9-3dbd-4c6f-aa11-06ad03bb25a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.565149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501f1daa455e4ebb86f976116219875f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.566071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501f1daa455e4ebb86f976116219875f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.576005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501f1daa455e4ebb86f976116219875f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.585748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501f1daa455e4ebb86f976116219875f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.596857 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 917/1833] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:52 2022] DELETE /identity/v3/users/501f1daa455e4ebb86f976116219875f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:52.598104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.600499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.655003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a638c9-3dbd-4c6f-aa11-06ad03bb25a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.656597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a638c9-3dbd-4c6f-aa11-06ad03bb25a6 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.676059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aceddb5d-7c77-4406-acc3-d83f74095c0a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.681486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5616ce0-2c53-4227-bd91-0740d0844d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.681758 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 917/1834] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:52.682081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616ce0-2c53-4227-bd91-0740d0844d6b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.682362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616ce0-2c53-4227-bd91-0740d0844d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.682725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a638c9-3dbd-4c6f-aa11-06ad03bb25a6 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.682867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5616ce0-2c53-4227-bd91-0740d0844d6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.683520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5616ce0-2c53-4227-bd91-0740d0844d6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.685139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5616ce0-2c53-4227-bd91-0740d0844d6b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.690505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-84a638c9-3dbd-4c6f-aa11-06ad03bb25a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.701462 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 918/1835] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:52.701462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387247d-ab79-48f6-ae09-6c7c51548612 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.701462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387247d-ab79-48f6-ae09-6c7c51548612 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.701462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387247d-ab79-48f6-ae09-6c7c51548612 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.713782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a638c9-3dbd-4c6f-aa11-06ad03bb25a6 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.720507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.721342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.721771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.722474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] PATH_INFO: `/v3/projects/3ea3398f7cf848c78868f6804fbafbb3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.723673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea3398f7cf848c78868f6804fbafbb3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.726554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.730179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3387247d-ab79-48f6-ae09-6c7c51548612 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:52.731367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3387247d-ab79-48f6-ae09-6c7c51548612 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.745569 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 919/1836] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:52.753193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387247d-ab79-48f6-ae09-6c7c51548612 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.766426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387247d-ab79-48f6-ae09-6c7c51548612 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.772474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0585719-f4ff-404e-a8af-b5cbb85fc97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.773337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0585719-f4ff-404e-a8af-b5cbb85fc97b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.773465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0585719-f4ff-404e-a8af-b5cbb85fc97b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.773720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0585719-f4ff-404e-a8af-b5cbb85fc97b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.774352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0585719-f4ff-404e-a8af-b5cbb85fc97b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.776047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0585719-f4ff-404e-a8af-b5cbb85fc97b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.787873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea3398f7cf848c78868f6804fbafbb3', 'request_id': 'req-3ac031ce-06ab-47ea-b8af-8b2320372818'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.789463 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 920/1837] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:52 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:52.791722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e9337-d7b7-4a0f-82b4-940e2d9be140 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.791946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e9337-d7b7-4a0f-82b4-940e2d9be140 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.792303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e9337-d7b7-4a0f-82b4-940e2d9be140 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.794665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea3398f7cf848c78868f6804fbafbb3', 'request_id': 'req-3ac031ce-06ab-47ea-b8af-8b2320372818'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.798113 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 921/1838] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:52.798930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e9337-d7b7-4a0f-82b4-940e2d9be140 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.800705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-749e9337-d7b7-4a0f-82b4-940e2d9be140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.803465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea3398f7cf848c78868f6804fbafbb3', 'request_id': 'req-3ac031ce-06ab-47ea-b8af-8b2320372818'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.817104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] The token cache is being invalidate because project 3ea3398f7cf848c78868f6804fbafbb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:52.817427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.818133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:52.822733 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 918/1839] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:52 2022] DELETE /identity/v3/projects/3ea3398f7cf848c78868f6804fbafbb3 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:52.823601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.825132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.860654 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:52.876955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e9337-d7b7-4a0f-82b4-940e2d9be140 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.880676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.881319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.881619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.881922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.883695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.909645 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:52.915563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac031ce-06ab-47ea-b8af-8b2320372818 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:52.921822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:52.922668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:52.923125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:52.923579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] PATH_INFO: `/v3/projects/183affc84fd84194961f02ea40a757f3/users/8f26fa5efd704f25a17ca0965944aae5/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:52.940052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=183affc84fd84194961f02ea40a757f3, user_id=8f26fa5efd704f25a17ca0965944aae5, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.942990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.950547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:52.952450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:52.955992 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 919/1840] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:52 2022] PUT /identity/v3/projects/183affc84fd84194961f02ea40a757f3/users/8f26fa5efd704f25a17ca0965944aae5/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:52.956987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:52.963129 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 922/1841] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:52.964010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:52.965543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.971181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:52.977824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2493f86e-56a1-41ce-bcdf-117a9a788c03 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:53.050861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:53.052065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.052065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.052419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] PATH_INFO: `/v3/users/1b628bec0ea641c7a9065801eb2f01a6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.053607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b628bec0ea641c7a9065801eb2f01a6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:53.056103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:53.064260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:53.066109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:53.121208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b628bec0ea641c7a9065801eb2f01a6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.138645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b628bec0ea641c7a9065801eb2f01a6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.139489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b628bec0ea641c7a9065801eb2f01a6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.151794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b628bec0ea641c7a9065801eb2f01a6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.159404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a131ba99-9050-4280-ab01-e6c368a2c5d0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:53.163065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b628bec0ea641c7a9065801eb2f01a6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.168559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1f480d-7812-4faa-85f9-c10559640e61 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2458c3818faa409dbb95cd5d7cacc32a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4144a752f1494a5e964cfb38db5c1d45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:53.169274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f480d-7812-4faa-85f9-c10559640e61 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.169512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f480d-7812-4faa-85f9-c10559640e61 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.169791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1f480d-7812-4faa-85f9-c10559640e61 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] PATH_INFO: `/v3/projects/c7b62320759146fc883679048eac1fec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.170980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f480d-7812-4faa-85f9-c10559640e61 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7b62320759146fc883679048eac1fec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:53.173234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1f480d-7812-4faa-85f9-c10559640e61 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:53.186447 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 920/1843] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:52 2022] GET /identity/v3/projects/c7b62320759146fc883679048eac1fec => generated 395 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:53.188806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2674b84-3b15-4c88-be9f-f0c72bd085d0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.188806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2674b84-3b15-4c88-be9f-f0c72bd085d0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.189174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2674b84-3b15-4c88-be9f-f0c72bd085d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.191259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 923/1843] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:52 2022] DELETE /identity/v3/users/1b628bec0ea641c7a9065801eb2f01a6 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:53.258015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e2674b84-3b15-4c88-be9f-f0c72bd085d0 None None] MFA Rules not processed for user `8f26fa5efd704f25a17ca0965944aae5`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:53.259426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e2674b84-3b15-4c88-be9f-f0c72bd085d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:53.339414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:53.342102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:53.351184 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 921/1844] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:53.367793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2674b84-3b15-4c88-be9f-f0c72bd085d0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:53.369537 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:53.371415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e2674b84-3b15-4c88-be9f-f0c72bd085d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:53.390613 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:53.455274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f1dc3-d99e-43bb-9981-d46a4c3ebebd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:53.468723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:53.469236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.469563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.469840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] PATH_INFO: `/v3/projects/781c653f5d304a85af6266cfafe5fc6e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.471183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=781c653f5d304a85af6266cfafe5fc6e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:53.472257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2674b84-3b15-4c88-be9f-f0c72bd085d0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:53.474704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:53.477520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c0bf8-04bf-4d25-863a-f02fecb2a77b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:53.478532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c0bf8-04bf-4d25-863a-f02fecb2a77b service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.479005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c0bf8-04bf-4d25-863a-f02fecb2a77b service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.480218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c0bf8-04bf-4d25-863a-f02fecb2a77b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.497464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c0bf8-04bf-4d25-863a-f02fecb2a77b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:53.500271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c0bf8-04bf-4d25-863a-f02fecb2a77b service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:53.515225 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 922/1845] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:53.540414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c555f-3ed5-46a4-b743-66bca7ea8b2b None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.540874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c555f-3ed5-46a4-b743-66bca7ea8b2b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.541263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419c555f-3ed5-46a4-b743-66bca7ea8b2b None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.542740 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 923/1846] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:51:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:53.547883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '781c653f5d304a85af6266cfafe5fc6e', 'request_id': 'req-4ea85512-e41b-42fb-87c6-62824eb689c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.557474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2c11-a7ae-446a-bc8d-fb5c6c413c6a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.558118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2c11-a7ae-446a-bc8d-fb5c6c413c6a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.558420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442f2c11-a7ae-446a-bc8d-fb5c6c413c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.560009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '781c653f5d304a85af6266cfafe5fc6e', 'request_id': 'req-4ea85512-e41b-42fb-87c6-62824eb689c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.570095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '781c653f5d304a85af6266cfafe5fc6e', 'request_id': 'req-4ea85512-e41b-42fb-87c6-62824eb689c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.590885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] The token cache is being invalidate because project 781c653f5d304a85af6266cfafe5fc6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:53.591053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-442f2c11-a7ae-446a-bc8d-fb5c6c413c6a None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:53.591166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.591855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.592877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-442f2c11-a7ae-446a-bc8d-fb5c6c413c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:53.596635 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 924/1847] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:53 2022] DELETE /identity/v3/projects/781c653f5d304a85af6266cfafe5fc6e => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:53.597626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:53.599199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:53.717890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea85512-e41b-42fb-87c6-62824eb689c6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:53.728547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:53.729773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.730273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.731339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] PATH_INFO: `/v3/users/5def2c28df594247ac3f16ea18c0c887` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.734091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5def2c28df594247ac3f16ea18c0c887)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:53.736153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:53.761394 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 924/1848] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:51:53.762431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2c11-a7ae-446a-bc8d-fb5c6c413c6a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:53.764977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-442f2c11-a7ae-446a-bc8d-fb5c6c413c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:53.781872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442f2c11-a7ae-446a-bc8d-fb5c6c413c6a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:53.787638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:53.788304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.788617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.788897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] PATH_INFO: `/v3/projects/aeecb4a0890b4e589001bdc3478c7abd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.790110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=aeecb4a0890b4e589001bdc3478c7abd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:53.792045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:53.799188 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:53.801053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5def2c28df594247ac3f16ea18c0c887'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.817250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5def2c28df594247ac3f16ea18c0c887'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.818869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5def2c28df594247ac3f16ea18c0c887'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.830952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5def2c28df594247ac3f16ea18c0c887'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.839969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5def2c28df594247ac3f16ea18c0c887'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.846691 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 925/1849] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:53 2022] DELETE /identity/v3/users/5def2c28df594247ac3f16ea18c0c887 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:53.847643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aeecb4a0890b4e589001bdc3478c7abd', 'request_id': 'req-841d42bd-bc70-4a85-b6e8-91c8c47589ca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.851051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:53.852622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:53.855462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aeecb4a0890b4e589001bdc3478c7abd', 'request_id': 'req-841d42bd-bc70-4a85-b6e8-91c8c47589ca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.871404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aeecb4a0890b4e589001bdc3478c7abd', 'request_id': 'req-841d42bd-bc70-4a85-b6e8-91c8c47589ca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.887024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] The token cache is being invalidate because project aeecb4a0890b4e589001bdc3478c7abd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:53.887365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.888157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-841d42bd-bc70-4a85-b6e8-91c8c47589ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:53.891316 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 925/1850] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:53 2022] DELETE /identity/v3/projects/aeecb4a0890b4e589001bdc3478c7abd => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:53.894970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6820ff-437b-425d-bd24-4c6f7888d916 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.897790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6820ff-437b-425d-bd24-4c6f7888d916 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.898265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6820ff-437b-425d-bd24-4c6f7888d916 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.901070 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 926/1851] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:53 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:53.903063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393af98-5d30-4bb6-bb80-561f0e9443ac None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.903306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393af98-5d30-4bb6-bb80-561f0e9443ac None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.903986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5393af98-5d30-4bb6-bb80-561f0e9443ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.928288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5393af98-5d30-4bb6-bb80-561f0e9443ac None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:53.930091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5393af98-5d30-4bb6-bb80-561f0e9443ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:53.960522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c42a5b6-9ba9-48a4-a53e-5785b4ab2210 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:53.965754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:53.966409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:53.966686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:53.967018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] PATH_INFO: `/v3/users/22a7aad4f3f648c2ac98ec3668d3ccec` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:53.968248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22a7aad4f3f648c2ac98ec3668d3ccec)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:53.970498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:53.978086 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:54.049287 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 927/1852] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:51:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:54.050500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22a7aad4f3f648c2ac98ec3668d3ccec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.050924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393af98-5d30-4bb6-bb80-561f0e9443ac None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:54.053354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5393af98-5d30-4bb6-bb80-561f0e9443ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.081213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22a7aad4f3f648c2ac98ec3668d3ccec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.082446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22a7aad4f3f648c2ac98ec3668d3ccec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.093346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22a7aad4f3f648c2ac98ec3668d3ccec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.105630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e1c2d69-82b8-463c-a30a-2a7a4d44f275 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22a7aad4f3f648c2ac98ec3668d3ccec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.114436 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 926/1853] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:53 2022] DELETE /identity/v3/users/22a7aad4f3f648c2ac98ec3668d3ccec => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:54.119023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.119400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.120119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.144168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:54.145526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.164392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5393af98-5d30-4bb6-bb80-561f0e9443ac None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:54.205055 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:54.233275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:54.233975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.234244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.234528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.236411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.245343 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 927/1854] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:54.245343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:54.245668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.362382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:54.365426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:54.368556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:54.369892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.384985 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 928/1855] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:54.385982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:54.387431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.428643 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:54.453252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d45d91-8ac4-45fc-9e91-05065b0bc8ec None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:54.457999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0da619-7b05-4c69-a268-2cf1c2942a6b tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2458c3818faa409dbb95cd5d7cacc32a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4144a752f1494a5e964cfb38db5c1d45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:54.459217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da619-7b05-4c69-a268-2cf1c2942a6b tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.459503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da619-7b05-4c69-a268-2cf1c2942a6b tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.459778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0da619-7b05-4c69-a268-2cf1c2942a6b tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] PATH_INFO: `/v3/projects/c7b62320759146fc883679048eac1fec` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.460962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da619-7b05-4c69-a268-2cf1c2942a6b tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7b62320759146fc883679048eac1fec)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:54.463134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0da619-7b05-4c69-a268-2cf1c2942a6b tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:54.464748 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 928/1856] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:54 2022] GET /identity/v3/projects/c7b62320759146fc883679048eac1fec => generated 395 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:54.466029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05a23-10b6-45b0-aab9-aa25b2743350 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.466369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05a23-10b6-45b0-aab9-aa25b2743350 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.466648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a05a23-10b6-45b0-aab9-aa25b2743350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.471997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf30d1b-daea-4c70-a412-0b8f417d1f63 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:54.479742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c2330b-5293-4f2f-b2fc-cd146774bd1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:54.480470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2330b-5293-4f2f-b2fc-cd146774bd1b service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.480776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2330b-5293-4f2f-b2fc-cd146774bd1b service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.481050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c2330b-5293-4f2f-b2fc-cd146774bd1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.484095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-85c2330b-5293-4f2f-b2fc-cd146774bd1b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.486858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-28a05a23-10b6-45b0-aab9-aa25b2743350 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:54.488095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-28a05a23-10b6-45b0-aab9-aa25b2743350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.501429 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 929/1857] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:54.501429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9129f-146d-4b9e-a74d-59b71f037b41 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.503676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9129f-146d-4b9e-a74d-59b71f037b41 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.503676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9129f-146d-4b9e-a74d-59b71f037b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.534923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-75c9129f-146d-4b9e-a74d-59b71f037b41 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:54.534923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75c9129f-146d-4b9e-a74d-59b71f037b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.546387 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 930/1858] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:54.547807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9129f-146d-4b9e-a74d-59b71f037b41 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:54.550818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75c9129f-146d-4b9e-a74d-59b71f037b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.565176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9129f-146d-4b9e-a74d-59b71f037b41 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:54.570910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:54.571706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.572046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.572267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] PATH_INFO: `/v3/projects/4a08727684ec4f53adb25eb571a34587` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.573590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a08727684ec4f53adb25eb571a34587)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:54.575421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:54.587729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2330b-5293-4f2f-b2fc-cd146774bd1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:54.589709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c2330b-5293-4f2f-b2fc-cd146774bd1b service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:54.604702 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 929/1859] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:51:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:51:54.606512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d67f-5ece-49fd-b0d4-a005389b23e1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.607029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d67f-5ece-49fd-b0d4-a005389b23e1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.607356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244d67f-5ece-49fd-b0d4-a005389b23e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.630721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3244d67f-5ece-49fd-b0d4-a005389b23e1 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:54.632129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3244d67f-5ece-49fd-b0d4-a005389b23e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.652593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a08727684ec4f53adb25eb571a34587', 'request_id': 'req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.662924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a08727684ec4f53adb25eb571a34587', 'request_id': 'req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.671150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a08727684ec4f53adb25eb571a34587', 'request_id': 'req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.672550 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:54.691115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] The token cache is being invalidate because project 4a08727684ec4f53adb25eb571a34587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:54.691323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.692050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:54.694817 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 931/1860] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:54 2022] DELETE /identity/v3/projects/4a08727684ec4f53adb25eb571a34587 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:54.695419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:54.696809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.715067 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 930/1861] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:54.717054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d67f-5ece-49fd-b0d4-a005389b23e1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:54.718590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3244d67f-5ece-49fd-b0d4-a005389b23e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.789329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ee4802-2d77-45b4-87df-fbfeafd6d2b1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:54.793630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72004f5-e67d-4e5d-879d-8da9f616e4b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:54.794461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72004f5-e67d-4e5d-879d-8da9f616e4b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.794948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72004f5-e67d-4e5d-879d-8da9f616e4b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.795401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72004f5-e67d-4e5d-879d-8da9f616e4b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.798239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c72004f5-e67d-4e5d-879d-8da9f616e4b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.830867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244d67f-5ece-49fd-b0d4-a005389b23e1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:54.836062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc323fa2-956b-4d00-bfaf-c0ca35401332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:54.836462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc323fa2-956b-4d00-bfaf-c0ca35401332 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.836674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc323fa2-956b-4d00-bfaf-c0ca35401332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.836951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc323fa2-956b-4d00-bfaf-c0ca35401332 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.837660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc323fa2-956b-4d00-bfaf-c0ca35401332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:54.837988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc323fa2-956b-4d00-bfaf-c0ca35401332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:54.839662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc323fa2-956b-4d00-bfaf-c0ca35401332 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:54.857141 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 931/1862] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:54.857141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced6b7-225b-4aa7-82ac-71fe1ce4a72d None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.857141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced6b7-225b-4aa7-82ac-71fe1ce4a72d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.857141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ced6b7-225b-4aa7-82ac-71fe1ce4a72d None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.857642 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 932/1863] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:54.858780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e582a7-a2f4-45bb-b34e-5be3395c0f0b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.859068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e582a7-a2f4-45bb-b34e-5be3395c0f0b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.859416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e582a7-a2f4-45bb-b34e-5be3395c0f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.881696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-83e582a7-a2f4-45bb-b34e-5be3395c0f0b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:54.883124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-83e582a7-a2f4-45bb-b34e-5be3395c0f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.892939 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 933/1864] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:54.893890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e582a7-a2f4-45bb-b34e-5be3395c0f0b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:54.897598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72004f5-e67d-4e5d-879d-8da9f616e4b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:54.899682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72004f5-e67d-4e5d-879d-8da9f616e4b4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:54.900496 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:54.905718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e582a7-a2f4-45bb-b34e-5be3395c0f0b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:54.910107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:54.910656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.910940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.911214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.918795 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 932/1865] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:54.922526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:54.924430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:54.930113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72004f5-e67d-4e5d-879d-8da9f616e4b4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:54.935775 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 934/1866] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:54.936576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:54.938351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:54.943264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72004f5-e67d-4e5d-879d-8da9f616e4b4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:54.948818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb19be-9acb-4707-8700-111a6696f638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:54.949479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb19be-9acb-4707-8700-111a6696f638 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:54.949946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb19be-9acb-4707-8700-111a6696f638 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:54.950229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb19be-9acb-4707-8700-111a6696f638 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:54.951067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb19be-9acb-4707-8700-111a6696f638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:54.954043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccb19be-9acb-4707-8700-111a6696f638 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.010767 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 933/1867] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:54 2022] POST /identity/v3/projects => generated 375 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:55.012765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf296353-92e8-4247-8a5d-20776fb9cdf2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.013495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf296353-92e8-4247-8a5d-20776fb9cdf2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.014082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf296353-92e8-4247-8a5d-20776fb9cdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.046681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bf296353-92e8-4247-8a5d-20776fb9cdf2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:55.048141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bf296353-92e8-4247-8a5d-20776fb9cdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:55.082410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.084207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:55.171162 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 934/1868] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:55.173320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf296353-92e8-4247-8a5d-20776fb9cdf2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.178924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2a767-895b-4a1b-bd4b-9f5e940c6ac0 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.191193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf296353-92e8-4247-8a5d-20776fb9cdf2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.198643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a6d15-b09d-4baf-919b-2d9eac80d38b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.200350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6d15-b09d-4baf-919b-2d9eac80d38b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.201488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6d15-b09d-4baf-919b-2d9eac80d38b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.201973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104a6d15-b09d-4baf-919b-2d9eac80d38b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.203408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6d15-b09d-4baf-919b-2d9eac80d38b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.206119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104a6d15-b09d-4baf-919b-2d9eac80d38b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.235351 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:55.249887 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 935/1869] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:55 2022] POST /identity/v3/users => generated 288 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:55.251539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a6d15-b09d-4baf-919b-2d9eac80d38b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.262882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe719f3-3a11-43eb-9768-fc0e714af61d tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2458c3818faa409dbb95cd5d7cacc32a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4144a752f1494a5e964cfb38db5c1d45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.264109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe719f3-3a11-43eb-9768-fc0e714af61d tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.265280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe719f3-3a11-43eb-9768-fc0e714af61d tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.265891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe719f3-3a11-43eb-9768-fc0e714af61d tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] PATH_INFO: `/v3/projects/c7b62320759146fc883679048eac1fec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.267402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104a6d15-b09d-4baf-919b-2d9eac80d38b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.268145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe719f3-3a11-43eb-9768-fc0e714af61d tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7b62320759146fc883679048eac1fec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.271388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe719f3-3a11-43eb-9768-fc0e714af61d tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.274111 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 935/1870] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:54 2022] GET /identity/v3/projects/c7b62320759146fc883679048eac1fec => generated 395 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:55.274575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede46d-9276-454a-b591-8472c28ff556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.275397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede46d-9276-454a-b591-8472c28ff556 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.275696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede46d-9276-454a-b591-8472c28ff556 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.276076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ede46d-9276-454a-b591-8472c28ff556 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.277196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede46d-9276-454a-b591-8472c28ff556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:55.277196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede46d-9276-454a-b591-8472c28ff556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.277498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe719f3-3a11-43eb-9768-fc0e714af61d tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.280282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ede46d-9276-454a-b591-8472c28ff556 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.300111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe719f3-3a11-43eb-9768-fc0e714af61d tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.315311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e9e06-5100-4e6a-bfed-9f272d6fb626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.315311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9e06-5100-4e6a-bfed-9f272d6fb626 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.315311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9e06-5100-4e6a-bfed-9f272d6fb626 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.315311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e9e06-5100-4e6a-bfed-9f272d6fb626 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.315794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e9e06-5100-4e6a-bfed-9f272d6fb626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.320270 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 936/1871] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:55.321485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e9e06-5100-4e6a-bfed-9f272d6fb626 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.325077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede46d-9276-454a-b591-8472c28ff556 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.356054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ede46d-9276-454a-b591-8472c28ff556 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.361839 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 936/1872] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:55.368094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e9e06-5100-4e6a-bfed-9f272d6fb626 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.377823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd34e3-75d9-4c2b-9bf6-2d9754b26c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.378555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd34e3-75d9-4c2b-9bf6-2d9754b26c1a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.379085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd34e3-75d9-4c2b-9bf6-2d9754b26c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.379431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bd34e3-75d9-4c2b-9bf6-2d9754b26c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.380622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd34e3-75d9-4c2b-9bf6-2d9754b26c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.383954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bd34e3-75d9-4c2b-9bf6-2d9754b26c1a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.406470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e9e06-5100-4e6a-bfed-9f272d6fb626 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.419037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5a6b-fe05-4b02-9492-60824ec5387c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.419876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5a6b-fe05-4b02-9492-60824ec5387c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.420236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5a6b-fe05-4b02-9492-60824ec5387c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.420758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14d5a6b-fe05-4b02-9492-60824ec5387c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.421609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d5a6b-fe05-4b02-9492-60824ec5387c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.422648 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 937/1873] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:55 2022] POST /identity/v3/projects => generated 399 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:55.423453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14d5a6b-fe05-4b02-9492-60824ec5387c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.430248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd34e3-75d9-4c2b-9bf6-2d9754b26c1a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.454490 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 937/1874] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:55.456164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5a6b-fe05-4b02-9492-60824ec5387c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.476636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14d5a6b-fe05-4b02-9492-60824ec5387c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.501585 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:55.539217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bd34e3-75d9-4c2b-9bf6-2d9754b26c1a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.548499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc518f8-6490-45bd-8655-ea69d1480fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.549267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc518f8-6490-45bd-8655-ea69d1480fc8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.549545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc518f8-6490-45bd-8655-ea69d1480fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.549836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc518f8-6490-45bd-8655-ea69d1480fc8 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.550920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc518f8-6490-45bd-8655-ea69d1480fc8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.554061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc518f8-6490-45bd-8655-ea69d1480fc8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.596391 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 938/1875] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:55 2022] POST /identity/v3/users => generated 300 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:55.598047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc518f8-6490-45bd-8655-ea69d1480fc8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.613490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc518f8-6490-45bd-8655-ea69d1480fc8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.620168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ec37c-cb9d-478d-8de0-a527bcda086a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.621212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ec37c-cb9d-478d-8de0-a527bcda086a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.621212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ec37c-cb9d-478d-8de0-a527bcda086a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.621562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ec37c-cb9d-478d-8de0-a527bcda086a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.622589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ec37c-cb9d-478d-8de0-a527bcda086a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.624863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985ec37c-cb9d-478d-8de0-a527bcda086a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.650361 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 939/1876] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:51:55.652788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ec37c-cb9d-478d-8de0-a527bcda086a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.656143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fb1a2-b94e-47b2-bad2-bc6d4aba5b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.657909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fb1a2-b94e-47b2-bad2-bc6d4aba5b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.658784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fb1a2-b94e-47b2-bad2-bc6d4aba5b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.659624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fb1a2-b94e-47b2-bad2-bc6d4aba5b8b admin admin] PATH_INFO: `/v3/projects/d1e899ed14ce4df8bbeb38ec6f9aa704/users/13853fd7904c4627924734629545e8f8/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.668163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985ec37c-cb9d-478d-8de0-a527bcda086a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.685432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78d5f-1ba9-4f04-9ab3-220dd1f0f4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.687338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78d5f-1ba9-4f04-9ab3-220dd1f0f4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.688111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78d5f-1ba9-4f04-9ab3-220dd1f0f4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.689103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a78d5f-1ba9-4f04-9ab3-220dd1f0f4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.691589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a78d5f-1ba9-4f04-9ab3-220dd1f0f4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.699718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a78d5f-1ba9-4f04-9ab3-220dd1f0f4a9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.727764 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 940/1877] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:55 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:55.734243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78d5f-1ba9-4f04-9ab3-220dd1f0f4a9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.736624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f2a78d5f-1ba9-4f04-9ab3-220dd1f0f4a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:55.738378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fb1a2-b94e-47b2-bad2-bc6d4aba5b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1e899ed14ce4df8bbeb38ec6f9aa704, user_id=13853fd7904c4627924734629545e8f8, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.745769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6fb1a2-b94e-47b2-bad2-bc6d4aba5b8b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.780727 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 938/1878] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:55 2022] PUT /identity/v3/projects/d1e899ed14ce4df8bbeb38ec6f9aa704/users/13853fd7904c4627924734629545e8f8/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:55.782792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a78d5f-1ba9-4f04-9ab3-220dd1f0f4a9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.791236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fb1a2-b94e-47b2-bad2-bc6d4aba5b8b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:55.910144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.911004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.911415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.911933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] PATH_INFO: `/v3/projects/246298e703e743809a1a7a89107c61d1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:55.913894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] RBAC: Authorizing `identity:delete_project(project_id=246298e703e743809a1a7a89107c61d1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:55.918543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:55.960454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fb1a2-b94e-47b2-bad2-bc6d4aba5b8b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:55.997891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397dfe70-1e94-4512-81b7-966dbc03b7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:55.997891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dfe70-1e94-4512-81b7-966dbc03b7d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:55.997891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dfe70-1e94-4512-81b7-966dbc03b7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:55.997891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397dfe70-1e94-4512-81b7-966dbc03b7d4 admin admin] PATH_INFO: `/v3/projects/b3097fe2baef4179a11083d1adad3edd/users/a7742b2fc8d247ce95d98e7d5babc7e3/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:56.021421 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:56.023842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dfe70-1e94-4512-81b7-966dbc03b7d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3097fe2baef4179a11083d1adad3edd, user_id=a7742b2fc8d247ce95d98e7d5babc7e3, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:56.027609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397dfe70-1e94-4512-81b7-966dbc03b7d4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:56.055189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '246298e703e743809a1a7a89107c61d1', 'request_id': 'req-9e686ea3-e854-4790-9421-939c72816aff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.064666 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 939/1879] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:55 2022] PUT /identity/v3/projects/b3097fe2baef4179a11083d1adad3edd/users/a7742b2fc8d247ce95d98e7d5babc7e3/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:56.066539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84f8a8-e496-41ab-a5c0-db3f2ec15e19 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:56.067117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84f8a8-e496-41ab-a5c0-db3f2ec15e19 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:56.067679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e84f8a8-e496-41ab-a5c0-db3f2ec15e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:56.078385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '246298e703e743809a1a7a89107c61d1', 'request_id': 'req-9e686ea3-e854-4790-9421-939c72816aff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.088414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '246298e703e743809a1a7a89107c61d1', 'request_id': 'req-9e686ea3-e854-4790-9421-939c72816aff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.108976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] The token cache is being invalidate because project 246298e703e743809a1a7a89107c61d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:56.109603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.110764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e686ea3-e854-4790-9421-939c72816aff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.115752 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 941/1880] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:55 2022] DELETE /identity/v3/projects/246298e703e743809a1a7a89107c61d1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:56.117116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77412a-9e72-4109-9431-deb8ee3b84cd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:56.117476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77412a-9e72-4109-9431-deb8ee3b84cd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:56.117761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c77412a-9e72-4109-9431-deb8ee3b84cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:56.134082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5e84f8a8-e496-41ab-a5c0-db3f2ec15e19 None None] MFA Rules not processed for user `13853fd7904c4627924734629545e8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:56.135339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5e84f8a8-e496-41ab-a5c0-db3f2ec15e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:56.205440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5c77412a-9e72-4109-9431-deb8ee3b84cd None None] MFA Rules not processed for user `a7742b2fc8d247ce95d98e7d5babc7e3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:56.207032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5c77412a-9e72-4109-9431-deb8ee3b84cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:56.273968 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 940/1881] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:56.276789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84f8a8-e496-41ab-a5c0-db3f2ec15e19 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:56.278582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5e84f8a8-e496-41ab-a5c0-db3f2ec15e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:56.332911 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:56.345240 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 942/1882] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:56.346486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77412a-9e72-4109-9431-deb8ee3b84cd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:56.348720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5c77412a-9e72-4109-9431-deb8ee3b84cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:56.477417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c77412a-9e72-4109-9431-deb8ee3b84cd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:56.506229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be302e06-d380-4941-9bb6-3ad1591a7a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:56.507022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302e06-d380-4941-9bb6-3ad1591a7a53 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:56.507219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302e06-d380-4941-9bb6-3ad1591a7a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:56.507559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be302e06-d380-4941-9bb6-3ad1591a7a53 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:56.508496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be302e06-d380-4941-9bb6-3ad1591a7a53 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:56.514201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be302e06-d380-4941-9bb6-3ad1591a7a53 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:56.547375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e84f8a8-e496-41ab-a5c0-db3f2ec15e19 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:56.556602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:56.558085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:56.558590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:56.559359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] PATH_INFO: `/v3/users/19651967f0e148e2949ae15996d6487d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:56.562705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19651967f0e148e2949ae15996d6487d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:56.566048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:56.597660 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 943/1883] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:56 2022] POST /identity/v3/projects => generated 373 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:56.599630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be302e06-d380-4941-9bb6-3ad1591a7a53 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:56.605123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-be302e06-d380-4941-9bb6-3ad1591a7a53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:56.663700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19651967f0e148e2949ae15996d6487d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.695662 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:56.706341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19651967f0e148e2949ae15996d6487d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.707240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19651967f0e148e2949ae15996d6487d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.723140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19651967f0e148e2949ae15996d6487d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.736719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19651967f0e148e2949ae15996d6487d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.748029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be302e06-d380-4941-9bb6-3ad1591a7a53 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:56.755281 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 941/1884] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:56 2022] DELETE /identity/v3/users/19651967f0e148e2949ae15996d6487d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:56.755281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:56.755281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:56.760820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:56.761972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:56.762336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:56.764351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] PATH_INFO: `/v3/users/327f1d46d859423982fab017258b9ada` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:56.769383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=327f1d46d859423982fab017258b9ada)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:56.774570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:56.894946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '327f1d46d859423982fab017258b9ada'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.924158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '327f1d46d859423982fab017258b9ada'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.925061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '327f1d46d859423982fab017258b9ada'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.929395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bc7b29-0c29-4d35-8eab-04d548daca64 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:56.938348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ed586-8fca-4499-aae5-52eda84c3b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:56.938980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed586-8fca-4499-aae5-52eda84c3b1e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:56.939259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed586-8fca-4499-aae5-52eda84c3b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:56.939545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ed586-8fca-4499-aae5-52eda84c3b1e admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:56.939830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '327f1d46d859423982fab017258b9ada'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.940291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ed586-8fca-4499-aae5-52eda84c3b1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:56.943193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6ed586-8fca-4499-aae5-52eda84c3b1e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:56.953547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '327f1d46d859423982fab017258b9ada'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:56.968267 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 944/1885] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:56 2022] DELETE /identity/v3/users/327f1d46d859423982fab017258b9ada => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:56.971781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:56.973119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:56.998748 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 942/1886] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:56 2022] POST /identity/v3/projects => generated 399 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:56.999452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ed586-8fca-4499-aae5-52eda84c3b1e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:57.001211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b6ed586-8fca-4499-aae5-52eda84c3b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:57.039919 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:57.158802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ed586-8fca-4499-aae5-52eda84c3b1e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:57.169455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0b7954-737f-4235-a8ef-ae3f7f19933e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:57.170110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b7954-737f-4235-a8ef-ae3f7f19933e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.170395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b7954-737f-4235-a8ef-ae3f7f19933e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.170777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0b7954-737f-4235-a8ef-ae3f7f19933e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.171319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b7954-737f-4235-a8ef-ae3f7f19933e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:57.173468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0b7954-737f-4235-a8ef-ae3f7f19933e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:57.190727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b93504-e504-47eb-a708-319f6bd0f145 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:57.216146 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 943/1887] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:56 2022] POST /identity/v3/users => generated 293 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:57.217669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824ba91-b1f5-44e3-a87b-eac026e255b6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.218062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824ba91-b1f5-44e3-a87b-eac026e255b6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.218439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824ba91-b1f5-44e3-a87b-eac026e255b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.280689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1824ba91-b1f5-44e3-a87b-eac026e255b6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:57.285777 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:57.311085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1824ba91-b1f5-44e3-a87b-eac026e255b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:57.322407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:57.323884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.324601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.325289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.331080 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 944/1888] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:57.332136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824ba91-b1f5-44e3-a87b-eac026e255b6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:57.334446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1824ba91-b1f5-44e3-a87b-eac026e255b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:57.342184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:57.362304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824ba91-b1f5-44e3-a87b-eac026e255b6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:57.367536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a38b70-a890-49df-9bf4-8da57ff52327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:57.368335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a38b70-a890-49df-9bf4-8da57ff52327 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.368678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a38b70-a890-49df-9bf4-8da57ff52327 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.369014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a38b70-a890-49df-9bf4-8da57ff52327 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.370681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a38b70-a890-49df-9bf4-8da57ff52327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:57.373029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a38b70-a890-49df-9bf4-8da57ff52327 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:57.406815 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 945/1889] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:57 2022] POST /identity/v3/users => generated 306 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:57.414741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a38b70-a890-49df-9bf4-8da57ff52327 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:57.433672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a38b70-a890-49df-9bf4-8da57ff52327 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:57.443988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073bf8-e96e-4780-87fb-906bb8cda425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:57.444897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073bf8-e96e-4780-87fb-906bb8cda425 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.445390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073bf8-e96e-4780-87fb-906bb8cda425 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.445983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99073bf8-e96e-4780-87fb-906bb8cda425 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.446989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073bf8-e96e-4780-87fb-906bb8cda425 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:57.449017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99073bf8-e96e-4780-87fb-906bb8cda425 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:57.463451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:57.465196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:57.471057 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 946/1890] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:57.473142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073bf8-e96e-4780-87fb-906bb8cda425 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:57.475865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-99073bf8-e96e-4780-87fb-906bb8cda425 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:57.502458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 945/1891] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:56 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:57.502458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:57.502458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:57.506480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99073bf8-e96e-4780-87fb-906bb8cda425 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:57.517857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:57.518508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.519187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.519187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] PATH_INFO: `/v3/projects/c5fdbbd51a4f483685c97e7b1733ef8e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.520247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5fdbbd51a4f483685c97e7b1733ef8e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:57.522638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:57.626638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13337b2-227b-4dac-909a-44ba262ec620 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:57.628875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5fdbbd51a4f483685c97e7b1733ef8e', 'request_id': 'req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:57.647894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5fdbbd51a4f483685c97e7b1733ef8e', 'request_id': 'req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:57.664438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5fdbbd51a4f483685c97e7b1733ef8e', 'request_id': 'req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:57.698901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] The token cache is being invalidate because project c5fdbbd51a4f483685c97e7b1733ef8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:57.699201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:57.700063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:57.708028 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 947/1892] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:57 2022] DELETE /identity/v3/projects/c5fdbbd51a4f483685c97e7b1733ef8e => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:57.710901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:57.713445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:57.716080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:57.717076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.718199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.718483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.720525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:57.831365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:57.833052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:57.838125 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:57.846834 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 946/1893] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:51:57.847825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:57.849526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:57.858436 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:57.862756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f21d5-4d94-4bf7-b84b-07671fc2a9c3 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:57.869180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b8386-624d-4c95-9193-830fa38fdb62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:57.869943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b8386-624d-4c95-9193-830fa38fdb62 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.870229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b8386-624d-4c95-9193-830fa38fdb62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.870513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b8386-624d-4c95-9193-830fa38fdb62 admin admin] PATH_INFO: `/v3/projects/0606fdd4c5064705b7c2e2c14ea00e4f/users/e7e33d23a5584607a115619667191037/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.899009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b8386-624d-4c95-9193-830fa38fdb62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0606fdd4c5064705b7c2e2c14ea00e4f, user_id=e7e33d23a5584607a115619667191037, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:57.899641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5a3a9c-4660-4b00-a50d-612ad62eb81a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:57.903712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b8386-624d-4c95-9193-830fa38fdb62 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:57.913208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9bd2d6-6e4f-47e5-aaaa-7e02fd394f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:57.915745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd2d6-6e4f-47e5-aaaa-7e02fd394f51 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.915875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd2d6-6e4f-47e5-aaaa-7e02fd394f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.916483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9bd2d6-6e4f-47e5-aaaa-7e02fd394f51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.920577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bd2d6-6e4f-47e5-aaaa-7e02fd394f51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:57.924854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9bd2d6-6e4f-47e5-aaaa-7e02fd394f51 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:57.929101 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 947/1894] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:57 2022] PUT /identity/v3/projects/0606fdd4c5064705b7c2e2c14ea00e4f/users/e7e33d23a5584607a115619667191037/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:57.930651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.930940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.931301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.958777 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 948/1895] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:57.960943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94c96-1d90-4270-8232-f366a8d30b18 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:57.961585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94c96-1d90-4270-8232-f366a8d30b18 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:57.962191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa94c96-1d90-4270-8232-f366a8d30b18 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:57.965223 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 949/1896] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:57.966637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa94c96-1d90-4270-8232-f366a8d30b18 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:57.976741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:57.978329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:58.073500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa94c96-1d90-4270-8232-f366a8d30b18 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:58.081762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec93d6a-51df-48af-b329-4b74bd03488a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:58.082424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93d6a-51df-48af-b329-4b74bd03488a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:58.082648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93d6a-51df-48af-b329-4b74bd03488a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:58.083023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec93d6a-51df-48af-b329-4b74bd03488a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:58.084340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec93d6a-51df-48af-b329-4b74bd03488a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:58.086691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec93d6a-51df-48af-b329-4b74bd03488a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:58.104494 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 950/1897] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:57 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:58.105056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec93d6a-51df-48af-b329-4b74bd03488a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:58.116194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec93d6a-51df-48af-b329-4b74bd03488a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:58.123223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 948/1898] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:58.124248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:58.125517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9621d94-f783-4da6-b172-c757e1dfae10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:58.125947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:58.126215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9621d94-f783-4da6-b172-c757e1dfae10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:58.126500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9621d94-f783-4da6-b172-c757e1dfae10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:58.126785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9621d94-f783-4da6-b172-c757e1dfae10 admin admin] PATH_INFO: `/v3/projects/3efeb744e42e47c8b1ae636da01d5293/users/374c711a83a94c2dabf0376e881f0e4f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:58.162586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9621d94-f783-4da6-b172-c757e1dfae10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efeb744e42e47c8b1ae636da01d5293, user_id=374c711a83a94c2dabf0376e881f0e4f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:58.167967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9621d94-f783-4da6-b172-c757e1dfae10 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:58.203792 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 951/1899] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:58 2022] PUT /identity/v3/projects/3efeb744e42e47c8b1ae636da01d5293/users/374c711a83a94c2dabf0376e881f0e4f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:58.209339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9621d94-f783-4da6-b172-c757e1dfae10 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:58.348091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:58.350549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:58.356954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9621d94-f783-4da6-b172-c757e1dfae10 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:58.364518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd73ff-1446-4b60-8786-6cf026ff6cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:58.365278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd73ff-1446-4b60-8786-6cf026ff6cd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:58.365739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd73ff-1446-4b60-8786-6cf026ff6cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:58.366340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd73ff-1446-4b60-8786-6cf026ff6cd6 admin admin] PATH_INFO: `/v3/projects/0606fdd4c5064705b7c2e2c14ea00e4f/users/e7e33d23a5584607a115619667191037/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:58.369239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd73ff-1446-4b60-8786-6cf026ff6cd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0606fdd4c5064705b7c2e2c14ea00e4f, user_id=e7e33d23a5584607a115619667191037, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:58.373146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd73ff-1446-4b60-8786-6cf026ff6cd6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:58.390098 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 952/1900] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:58 2022] PUT /identity/v3/projects/0606fdd4c5064705b7c2e2c14ea00e4f/users/e7e33d23a5584607a115619667191037/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:58.391889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb5b2a-4242-4ead-8f1d-e85b98a5d8c1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:58.392491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb5b2a-4242-4ead-8f1d-e85b98a5d8c1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:58.393322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eb5b2a-4242-4ead-8f1d-e85b98a5d8c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:58.423234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-04eb5b2a-4242-4ead-8f1d-e85b98a5d8c1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:58.425771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-04eb5b2a-4242-4ead-8f1d-e85b98a5d8c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:58.448875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba86009-8a2a-45a4-9195-b15e5344c531 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:58.475407 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:58.546921 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:58.583029 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 953/1901] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:58.584334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb5b2a-4242-4ead-8f1d-e85b98a5d8c1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:58.614096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8739f56-2a0e-4e9b-8a50-8576a5ee337e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2458c3818faa409dbb95cd5d7cacc32a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4144a752f1494a5e964cfb38db5c1d45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:58.614517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eb5b2a-4242-4ead-8f1d-e85b98a5d8c1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:58.615605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8739f56-2a0e-4e9b-8a50-8576a5ee337e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:58.616031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8739f56-2a0e-4e9b-8a50-8576a5ee337e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:58.616716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8739f56-2a0e-4e9b-8a50-8576a5ee337e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] PATH_INFO: `/v3/projects/c7b62320759146fc883679048eac1fec` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:58.620617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8739f56-2a0e-4e9b-8a50-8576a5ee337e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7b62320759146fc883679048eac1fec)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:58.627880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8739f56-2a0e-4e9b-8a50-8576a5ee337e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:58.628707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1309faba-2270-4185-9006-5fec48c2dc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:58.629606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309faba-2270-4185-9006-5fec48c2dc0f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:58.630684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309faba-2270-4185-9006-5fec48c2dc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:58.631165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1309faba-2270-4185-9006-5fec48c2dc0f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:58.633250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309faba-2270-4185-9006-5fec48c2dc0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:58.634452 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 949/1902] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:58 2022] GET /identity/v3/projects/c7b62320759146fc883679048eac1fec => generated 395 bytes in 510 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:58.636435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8739f56-2a0e-4e9b-8a50-8576a5ee337e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:58.641269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8739f56-2a0e-4e9b-8a50-8576a5ee337e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:58.647362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1309faba-2270-4185-9006-5fec48c2dc0f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:58.666890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8739f56-2a0e-4e9b-8a50-8576a5ee337e tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:58.673900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:58.675489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:58.675689 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 954/1903] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:51:58 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:51:58.675866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:58.675999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] PATH_INFO: `/v3/projects/3d7b9d4b5ef5454fbed4733abbd15bbe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:58.681666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d7b9d4b5ef5454fbed4733abbd15bbe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:58.682686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d05675-6662-430d-9755-5b07307f814b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:58.684288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:58.684834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d05675-6662-430d-9755-5b07307f814b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:58.691755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d05675-6662-430d-9755-5b07307f814b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:58.802566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-87d05675-6662-430d-9755-5b07307f814b None None] MFA Rules not processed for user `e7e33d23a5584607a115619667191037`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:58.803263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'request_id': 'req-8be5891d-c581-473e-aabd-0f7faad6d341'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:58.805109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-87d05675-6662-430d-9755-5b07307f814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:58.822508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'request_id': 'req-8be5891d-c581-473e-aabd-0f7faad6d341'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:58.838131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d7b9d4b5ef5454fbed4733abbd15bbe', 'request_id': 'req-8be5891d-c581-473e-aabd-0f7faad6d341'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:58.851736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] The token cache is being invalidate because project 3d7b9d4b5ef5454fbed4733abbd15bbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:51:58.852329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:58.853378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:58.855428 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 950/1904] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:58 2022] DELETE /identity/v3/projects/3d7b9d4b5ef5454fbed4733abbd15bbe => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:58.856779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:58.860274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:58.928193 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 955/1905] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:58 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:58.929023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d05675-6662-430d-9755-5b07307f814b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:58.931770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-87d05675-6662-430d-9755-5b07307f814b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:59.014689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be5891d-c581-473e-aabd-0f7faad6d341 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.020215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4068c60-04f6-4acd-aa1a-e0fadffb5357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:59.021577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4068c60-04f6-4acd-aa1a-e0fadffb5357 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.021866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4068c60-04f6-4acd-aa1a-e0fadffb5357 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.022143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4068c60-04f6-4acd-aa1a-e0fadffb5357 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.023634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4068c60-04f6-4acd-aa1a-e0fadffb5357 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:59.023956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4068c60-04f6-4acd-aa1a-e0fadffb5357 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:59.025840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4068c60-04f6-4acd-aa1a-e0fadffb5357 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:59.050769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 951/1906] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:59.059877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40ff60-e720-4aa0-837c-0da71cd8d701 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.060267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40ff60-e720-4aa0-837c-0da71cd8d701 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.060549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f40ff60-e720-4aa0-837c-0da71cd8d701 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.067230 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 952/1907] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:51:59 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:51:59.068840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40ff60-e720-4aa0-837c-0da71cd8d701 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:59.070705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0f40ff60-e720-4aa0-837c-0da71cd8d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:59.088997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f40ff60-e720-4aa0-837c-0da71cd8d701 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.097567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:59.098529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.099662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.099951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] PATH_INFO: `/v3/users/1275d5281a5c4efe89cc26d46f3c07c6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.101256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1275d5281a5c4efe89cc26d46f3c07c6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:59.103281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:59.115279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d05675-6662-430d-9755-5b07307f814b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.123144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554184b-e0f4-46b9-84de-5b8d00fc6eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:59.123926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554184b-e0f4-46b9-84de-5b8d00fc6eca admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.124278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554184b-e0f4-46b9-84de-5b8d00fc6eca admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.124630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554184b-e0f4-46b9-84de-5b8d00fc6eca admin admin] PATH_INFO: `/v3/projects/3efeb744e42e47c8b1ae636da01d5293/users/374c711a83a94c2dabf0376e881f0e4f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.127541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554184b-e0f4-46b9-84de-5b8d00fc6eca admin admin] RBAC: Authorizing `identity:create_grant(project_id=3efeb744e42e47c8b1ae636da01d5293, user_id=374c711a83a94c2dabf0376e881f0e4f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:59.130431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554184b-e0f4-46b9-84de-5b8d00fc6eca admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:59.144878 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 956/1908] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:51:58 2022] PUT /identity/v3/projects/3efeb744e42e47c8b1ae636da01d5293/users/374c711a83a94c2dabf0376e881f0e4f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:59.145910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554184b-e0f4-46b9-84de-5b8d00fc6eca admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:59.161128 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:59.183177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1275d5281a5c4efe89cc26d46f3c07c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:59.200650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1275d5281a5c4efe89cc26d46f3c07c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:59.201678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1275d5281a5c4efe89cc26d46f3c07c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:59.211026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1275d5281a5c4efe89cc26d46f3c07c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:59.220384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1275d5281a5c4efe89cc26d46f3c07c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:59.229273 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 953/1909] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:51:59 2022] DELETE /identity/v3/users/1275d5281a5c4efe89cc26d46f3c07c6 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:51:59.230316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:59.231744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:59.258772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554184b-e0f4-46b9-84de-5b8d00fc6eca admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.266477 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:59.354669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d146b33-2d94-4c17-98d5-d930b246a9c0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.360447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:59.361202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.361366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cc327a-56e7-4c1d-9fae-203c5ed38000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:59.361698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.362055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.362638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc327a-56e7-4c1d-9fae-203c5ed38000 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.362929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc327a-56e7-4c1d-9fae-203c5ed38000 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.363041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:51:59.363213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cc327a-56e7-4c1d-9fae-203c5ed38000 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.363500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:59.363858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc327a-56e7-4c1d-9fae-203c5ed38000 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:59.366206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:59.366442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cc327a-56e7-4c1d-9fae-203c5ed38000 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:59.397252 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 957/1910] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:51:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:59.402696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:51:59.405337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:59.437151 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 954/1911] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:59 2022] POST /identity/v3/projects => generated 401 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:59.438866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337590-9493-4ddf-9cae-898181becddd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.439151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337590-9493-4ddf-9cae-898181becddd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.439425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3337590-9493-4ddf-9cae-898181becddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.488025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b3337590-9493-4ddf-9cae-898181becddd None None] MFA Rules not processed for user `374c711a83a94c2dabf0376e881f0e4f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:51:59.489864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b3337590-9493-4ddf-9cae-898181becddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:59.526247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:59.527706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:59.590249 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 955/1912] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:51:59 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:51:59.591808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337590-9493-4ddf-9cae-898181becddd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:59.595250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b3337590-9493-4ddf-9cae-898181becddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:59.622443 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:59.655590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ce6ef9-bf41-4f2a-9d00-2d692cc270ff tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.701564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3337590-9493-4ddf-9cae-898181becddd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.706465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90467413-161b-4717-951f-e515435c14a2 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:59.707099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90467413-161b-4717-951f-e515435c14a2 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.707378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90467413-161b-4717-951f-e515435c14a2 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.707661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90467413-161b-4717-951f-e515435c14a2 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.708826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90467413-161b-4717-951f-e515435c14a2 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:59.709802 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:51:59.710789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90467413-161b-4717-951f-e515435c14a2 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:59.734745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489a3c-2df6-4a00-b79d-c99206380545 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2458c3818faa409dbb95cd5d7cacc32a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4144a752f1494a5e964cfb38db5c1d45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:59.735747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489a3c-2df6-4a00-b79d-c99206380545 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.736159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489a3c-2df6-4a00-b79d-c99206380545 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.736662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e489a3c-2df6-4a00-b79d-c99206380545 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] PATH_INFO: `/v3/projects/c7b62320759146fc883679048eac1fec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.738485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489a3c-2df6-4a00-b79d-c99206380545 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorizing `identity:get_project(project_id=c7b62320759146fc883679048eac1fec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:59.740325 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 956/1913] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:51:59 2022] POST /identity/v3/projects => generated 369 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:59.741144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90467413-161b-4717-951f-e515435c14a2 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:59.742706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e489a3c-2df6-4a00-b79d-c99206380545 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:59.746045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 958/1914] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:51:59 2022] GET /identity/v3/projects/c7b62320759146fc883679048eac1fec => generated 395 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:51:59.747596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489a3c-2df6-4a00-b79d-c99206380545 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:59.750107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4e489a3c-2df6-4a00-b79d-c99206380545 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:59.834031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90467413-161b-4717-951f-e515435c14a2 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.838855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d77e8-693b-4f08-8d26-d1b196b4e222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:59.839586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d77e8-693b-4f08-8d26-d1b196b4e222 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.840117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d77e8-693b-4f08-8d26-d1b196b4e222 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.840321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899d77e8-693b-4f08-8d26-d1b196b4e222 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.840965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d77e8-693b-4f08-8d26-d1b196b4e222 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:59.843017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899d77e8-693b-4f08-8d26-d1b196b4e222 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:59.879185 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 957/1915] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:51:59 2022] POST /identity/v3/users => generated 301 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:51:59.879185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d77e8-693b-4f08-8d26-d1b196b4e222 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:51:59.879185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-899d77e8-693b-4f08-8d26-d1b196b4e222 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:51:59.895624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899d77e8-693b-4f08-8d26-d1b196b4e222 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.900757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:51:59.901438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:51:59.901724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:51:59.902006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] PATH_INFO: `/v3/projects/ca64f62573b843af8904c683c6068497` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:51:59.902433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e489a3c-2df6-4a00-b79d-c99206380545 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:51:59.903369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca64f62573b843af8904c683c6068497)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:51:59.905402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:51:59.977517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca64f62573b843af8904c683c6068497', 'request_id': 'req-523390de-0254-41ca-bb2a-5aecd45478f7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:51:59.991033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca64f62573b843af8904c683c6068497', 'request_id': 'req-523390de-0254-41ca-bb2a-5aecd45478f7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:00.003900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca64f62573b843af8904c683c6068497', 'request_id': 'req-523390de-0254-41ca-bb2a-5aecd45478f7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:00.010895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f768a11-a24b-44b7-9dcf-f56fb2080830 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.011514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f768a11-a24b-44b7-9dcf-f56fb2080830 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.012218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f768a11-a24b-44b7-9dcf-f56fb2080830 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.012385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f768a11-a24b-44b7-9dcf-f56fb2080830 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.014221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9f768a11-a24b-44b7-9dcf-f56fb2080830 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:00.020346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] The token cache is being invalidate because project ca64f62573b843af8904c683c6068497 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:00.020826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:00.021486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:00.022973 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 958/1916] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:51:59 2022] DELETE /identity/v3/projects/ca64f62573b843af8904c683c6068497 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:00.023793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.025193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:00.061627 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:00.147619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f768a11-a24b-44b7-9dcf-f56fb2080830 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:00.155251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523390de-0254-41ca-bb2a-5aecd45478f7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:00.164744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f768a11-a24b-44b7-9dcf-f56fb2080830 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:00.165061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dde8aa0-ce2e-4faf-85f2-5d89ecb9cda6 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.166497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde8aa0-ce2e-4faf-85f2-5d89ecb9cda6 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.166998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde8aa0-ce2e-4faf-85f2-5d89ecb9cda6 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.167537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dde8aa0-ce2e-4faf-85f2-5d89ecb9cda6 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.169606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde8aa0-ce2e-4faf-85f2-5d89ecb9cda6 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:00.170272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde8aa0-ce2e-4faf-85f2-5d89ecb9cda6 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:00.173369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dde8aa0-ce2e-4faf-85f2-5d89ecb9cda6 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:00.192058 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 959/1917] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:51:59 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:00.194285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f768a11-a24b-44b7-9dcf-f56fb2080830 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.196635 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 959/1918] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:00.198752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75f1ae-fa2f-4ec7-91a8-d13f375b08d9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.199222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75f1ae-fa2f-4ec7-91a8-d13f375b08d9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.199916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75f1ae-fa2f-4ec7-91a8-d13f375b08d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.226000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f768a11-a24b-44b7-9dcf-f56fb2080830 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:00.234353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bb75f1ae-fa2f-4ec7-91a8-d13f375b08d9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:00.238587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb75f1ae-fa2f-4ec7-91a8-d13f375b08d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:00.277233 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:00.378217 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 960/1919] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:00.390216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354bdd9-7e89-452e-a322-a22b09b43129 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.390813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354bdd9-7e89-452e-a322-a22b09b43129 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.391098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c354bdd9-7e89-452e-a322-a22b09b43129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.393491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de5f98-db62-43fe-ad51-2a319b850bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.394828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de5f98-db62-43fe-ad51-2a319b850bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.408978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de5f98-db62-43fe-ad51-2a319b850bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.409887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38de5f98-db62-43fe-ad51-2a319b850bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.412374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de5f98-db62-43fe-ad51-2a319b850bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:00.416889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38de5f98-db62-43fe-ad51-2a319b850bc9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:00.443518 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 960/1920] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:00.448185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de5f98-db62-43fe-ad51-2a319b850bc9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.450926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c354bdd9-7e89-452e-a322-a22b09b43129 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:00.452021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-38de5f98-db62-43fe-ad51-2a319b850bc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:00.452382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c354bdd9-7e89-452e-a322-a22b09b43129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:00.462431 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 961/1921] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:00.468998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354bdd9-7e89-452e-a322-a22b09b43129 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.482195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c354bdd9-7e89-452e-a322-a22b09b43129 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:00.491191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71091112-c143-4491-811c-ef8563af4421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.492651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71091112-c143-4491-811c-ef8563af4421 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.493470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71091112-c143-4491-811c-ef8563af4421 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.494163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71091112-c143-4491-811c-ef8563af4421 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.495841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71091112-c143-4491-811c-ef8563af4421 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:00.497447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71091112-c143-4491-811c-ef8563af4421 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:00.498721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38de5f98-db62-43fe-ad51-2a319b850bc9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:00.501552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71091112-c143-4491-811c-ef8563af4421 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:00.505651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cd07d-0498-49cd-b5ac-4e7ad30a186f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.506397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd07d-0498-49cd-b5ac-4e7ad30a186f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.506715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd07d-0498-49cd-b5ac-4e7ad30a186f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.506997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88cd07d-0498-49cd-b5ac-4e7ad30a186f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.508606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cd07d-0498-49cd-b5ac-4e7ad30a186f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:00.510971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88cd07d-0498-49cd-b5ac-4e7ad30a186f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:00.525475 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 961/1922] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:00.527326 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 962/1923] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:52:00.531150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cd07d-0498-49cd-b5ac-4e7ad30a186f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.533530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71091112-c143-4491-811c-ef8563af4421 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.548110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71091112-c143-4491-811c-ef8563af4421 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:00.554707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88cd07d-0498-49cd-b5ac-4e7ad30a186f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:00.557804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256659f2-0a7e-47c3-a288-c2a67e7707b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.559100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256659f2-0a7e-47c3-a288-c2a67e7707b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.559605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256659f2-0a7e-47c3-a288-c2a67e7707b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.560079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256659f2-0a7e-47c3-a288-c2a67e7707b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.561122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bebc2a-608a-4cbc-952f-034cd9b6c4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.561329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256659f2-0a7e-47c3-a288-c2a67e7707b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:00.562450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bebc2a-608a-4cbc-952f-034cd9b6c4b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.563168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bebc2a-608a-4cbc-952f-034cd9b6c4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.563595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bebc2a-608a-4cbc-952f-034cd9b6c4b4 admin admin] PATH_INFO: `/v3/projects/8d2c394d0ceb40f298afa7355102bfd5/users/4099c569c4fe489fa349ee29e6974713/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.565222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256659f2-0a7e-47c3-a288-c2a67e7707b7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:00.584011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bebc2a-608a-4cbc-952f-034cd9b6c4b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d2c394d0ceb40f298afa7355102bfd5, user_id=4099c569c4fe489fa349ee29e6974713, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:00.587398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bebc2a-608a-4cbc-952f-034cd9b6c4b4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:00.609691 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 962/1924] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:00 2022] PUT /identity/v3/projects/8d2c394d0ceb40f298afa7355102bfd5/users/4099c569c4fe489fa349ee29e6974713/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:00.611452 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 963/1925] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:00 2022] POST /identity/v3/projects => generated 403 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:00.616479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256659f2-0a7e-47c3-a288-c2a67e7707b7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.619171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca5c93-db58-4c5c-91bd-bad21e0348cc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.619650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca5c93-db58-4c5c-91bd-bad21e0348cc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.620100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cca5c93-db58-4c5c-91bd-bad21e0348cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.652637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0cca5c93-db58-4c5c-91bd-bad21e0348cc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:00.655049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0cca5c93-db58-4c5c-91bd-bad21e0348cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:00.760099 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 963/1926] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:00.762668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca5c93-db58-4c5c-91bd-bad21e0348cc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.770264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0cca5c93-db58-4c5c-91bd-bad21e0348cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:00.770960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256659f2-0a7e-47c3-a288-c2a67e7707b7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:00.782663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e7f9d-d1e6-43c4-b6af-678881e5d5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.783672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e7f9d-d1e6-43c4-b6af-678881e5d5a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.784160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e7f9d-d1e6-43c4-b6af-678881e5d5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.784765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e7f9d-d1e6-43c4-b6af-678881e5d5a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.785840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e7f9d-d1e6-43c4-b6af-678881e5d5a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:00.790655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e7f9d-d1e6-43c4-b6af-678881e5d5a6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:00.814850 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:00.830806 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 964/1927] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:00 2022] POST /identity/v3/users => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:00.832943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e7f9d-d1e6-43c4-b6af-678881e5d5a6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.834830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b9e7f9d-d1e6-43c4-b6af-678881e5d5a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:00.901662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cca5c93-db58-4c5c-91bd-bad21e0348cc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:00.908706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdeaa0-452d-403f-b4b1-ae1cde14dd20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.909444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdeaa0-452d-403f-b4b1-ae1cde14dd20 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.909730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdeaa0-452d-403f-b4b1-ae1cde14dd20 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.910225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdeaa0-452d-403f-b4b1-ae1cde14dd20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.931797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e7f9d-d1e6-43c4-b6af-678881e5d5a6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:00.936409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6169f-cef2-472b-8510-d3a27d736dce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:00.937000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6169f-cef2-472b-8510-d3a27d736dce service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:00.937350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6169f-cef2-472b-8510-d3a27d736dce service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:00.937792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a6169f-cef2-472b-8510-d3a27d736dce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:00.944106 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:00.955453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6169f-cef2-472b-8510-d3a27d736dce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:00.957113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a6169f-cef2-472b-8510-d3a27d736dce service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:00.975791 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 965/1928] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:00.976846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6169f-cef2-472b-8510-d3a27d736dce service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:00.999813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a6169f-cef2-472b-8510-d3a27d736dce service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.006730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d04650-64db-48a2-9dc9-a2e6ef7a876c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:01.007518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d04650-64db-48a2-9dc9-a2e6ef7a876c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.008726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d04650-64db-48a2-9dc9-a2e6ef7a876c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.009404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d04650-64db-48a2-9dc9-a2e6ef7a876c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.010360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d04650-64db-48a2-9dc9-a2e6ef7a876c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.012139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d04650-64db-48a2-9dc9-a2e6ef7a876c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.029917 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 966/1929] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:00 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:01.032160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d04650-64db-48a2-9dc9-a2e6ef7a876c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:01.044172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d04650-64db-48a2-9dc9-a2e6ef7a876c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.051452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6e3ec0-310f-4088-8071-4ddc8a5775dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:01.056508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3ec0-310f-4088-8071-4ddc8a5775dd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.057030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3ec0-310f-4088-8071-4ddc8a5775dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.057483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6e3ec0-310f-4088-8071-4ddc8a5775dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.058353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e3ec0-310f-4088-8071-4ddc8a5775dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.061122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6e3ec0-310f-4088-8071-4ddc8a5775dd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.063797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdeaa0-452d-403f-b4b1-ae1cde14dd20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.067174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdeaa0-452d-403f-b4b1-ae1cde14dd20 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.091533 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 964/1930] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:01.092698 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 967/1931] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:52:01.093462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdeaa0-452d-403f-b4b1-ae1cde14dd20 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:01.104630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793ca53-a496-468b-bc16-bbf6307d8cf2 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.104916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793ca53-a496-468b-bc16-bbf6307d8cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.105198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d793ca53-a496-468b-bc16-bbf6307d8cf2 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.106620 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 968/1932] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:52:01.112728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793ca53-a496-468b-bc16-bbf6307d8cf2 None None] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:52:01.118960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdeaa0-452d-403f-b4b1-ae1cde14dd20 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.129245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43ba02-ce3e-4280-8865-f20c8e635e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:01.130272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793ca53-a496-468b-bc16-bbf6307d8cf2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:01.130550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43ba02-ce3e-4280-8865-f20c8e635e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.130897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43ba02-ce3e-4280-8865-f20c8e635e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.131232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43ba02-ce3e-4280-8865-f20c8e635e26 admin admin] PATH_INFO: `/v3/projects/ebf4f99c926d4eee8f70a3cd64e87929/users/7358bc8b21184699a0ff8187ebe46aeb/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.156493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d793ca53-a496-468b-bc16-bbf6307d8cf2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.162989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc045f5-f876-4b70-8af1-b69224ab8d7c tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:01.163636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc045f5-f876-4b70-8af1-b69224ab8d7c tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.163947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc045f5-f876-4b70-8af1-b69224ab8d7c tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.164221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc045f5-f876-4b70-8af1-b69224ab8d7c tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.165024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43ba02-ce3e-4280-8865-f20c8e635e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebf4f99c926d4eee8f70a3cd64e87929, user_id=7358bc8b21184699a0ff8187ebe46aeb, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.165763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc045f5-f876-4b70-8af1-b69224ab8d7c tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:get_project(project_id=a743bd48f4bf499ab2b51dd37b9b2d75)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.168036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc045f5-f876-4b70-8af1-b69224ab8d7c tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.169526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d43ba02-ce3e-4280-8865-f20c8e635e26 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.169983 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 969/1933] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:52:01 2022] GET /identity/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75 => generated 369 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:52:01.194626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 965/1934] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:01 2022] PUT /identity/v3/projects/ebf4f99c926d4eee8f70a3cd64e87929/users/7358bc8b21184699a0ff8187ebe46aeb/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:01.217139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc9b5-846f-4896-85c1-29665de481d1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.217752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc9b5-846f-4896-85c1-29665de481d1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.218214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc9b5-846f-4896-85c1-29665de481d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.265742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3f4fc9b5-846f-4896-85c1-29665de481d1 None None] MFA Rules not processed for user `7358bc8b21184699a0ff8187ebe46aeb`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:01.267528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3f4fc9b5-846f-4896-85c1-29665de481d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:01.375643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43ba02-ce3e-4280-8865-f20c8e635e26 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:01.403688 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 970/1935] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:01 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:01.404785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc9b5-846f-4896-85c1-29665de481d1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:01.545063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc9b5-846f-4896-85c1-29665de481d1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.554480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd1c3d-63e5-4d5f-8774-e57fd345d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:01.555250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd1c3d-63e5-4d5f-8774-e57fd345d1cc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.555631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd1c3d-63e5-4d5f-8774-e57fd345d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.556250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd1c3d-63e5-4d5f-8774-e57fd345d1cc admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.557704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd1c3d-63e5-4d5f-8774-e57fd345d1cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.560790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd1c3d-63e5-4d5f-8774-e57fd345d1cc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.560951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43ba02-ce3e-4280-8865-f20c8e635e26 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.567221 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:01.580681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:01.581366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.581622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.581898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.585393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:01.605396 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 971/1936] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:01 2022] POST /identity/v3/projects => generated 403 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:01.606822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d5fe3-04e5-4665-a62d-e0d19ec23d27 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.607109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d5fe3-04e5-4665-a62d-e0d19ec23d27 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.607386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348d5fe3-04e5-4665-a62d-e0d19ec23d27 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.609025 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 972/1937] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:52:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:52:01.609950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d5fe3-04e5-4665-a62d-e0d19ec23d27 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:01.690089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.691906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.711686 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 966/1938] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:01 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:01.713494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348d5fe3-04e5-4665-a62d-e0d19ec23d27 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.719122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba553a-f9c9-4893-b9a8-38cd603ebfa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:01.720252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba553a-f9c9-4893-b9a8-38cd603ebfa7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.720699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba553a-f9c9-4893-b9a8-38cd603ebfa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.721566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fba553a-f9c9-4893-b9a8-38cd603ebfa7 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.722545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba553a-f9c9-4893-b9a8-38cd603ebfa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.724887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:52:01.726341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fba553a-f9c9-4893-b9a8-38cd603ebfa7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.729519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:01.775400 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 973/1939] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:01 2022] POST /identity/v3/users => generated 308 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:01.776487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba553a-f9c9-4893-b9a8-38cd603ebfa7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:01.778313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:01.781522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:01.795222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fba553a-f9c9-4893-b9a8-38cd603ebfa7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.814944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a841a4a-098f-4262-957d-2170b08afdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:01.815884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841a4a-098f-4262-957d-2170b08afdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.816321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841a4a-098f-4262-957d-2170b08afdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.816787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a841a4a-098f-4262-957d-2170b08afdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.817723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a841a4a-098f-4262-957d-2170b08afdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.819920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a841a4a-098f-4262-957d-2170b08afdd7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.828380 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:01.847157 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 974/1940] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:01.850714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a841a4a-098f-4262-957d-2170b08afdd7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:01.883272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a841a4a-098f-4262-957d-2170b08afdd7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.901483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18895a-2fd3-4b56-8f1d-485329770cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:01.902568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18895a-2fd3-4b56-8f1d-485329770cfe admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:01.902960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18895a-2fd3-4b56-8f1d-485329770cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:01.903714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b18895a-2fd3-4b56-8f1d-485329770cfe admin admin] PATH_INFO: `/v3/projects/fdf16fe0aaed4cc9a9902ad18f196131/users/65cc97d97cf4411db950583c39062337/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:01.929683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5cf709-66bf-4db9-bf43-b9a16f00b763 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:01.947054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18895a-2fd3-4b56-8f1d-485329770cfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf16fe0aaed4cc9a9902ad18f196131, user_id=65cc97d97cf4411db950583c39062337, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:01.953335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b18895a-2fd3-4b56-8f1d-485329770cfe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:01.985717 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 975/1941] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:01 2022] PUT /identity/v3/projects/fdf16fe0aaed4cc9a9902ad18f196131/users/65cc97d97cf4411db950583c39062337/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:52:01.990392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18895a-2fd3-4b56-8f1d-485329770cfe admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:02.010682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2fb1c-29d7-4ff4-b7d8-16c3ba9b4bb9 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2458c3818faa409dbb95cd5d7cacc32a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4144a752f1494a5e964cfb38db5c1d45', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:02.011394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2fb1c-29d7-4ff4-b7d8-16c3ba9b4bb9 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.011676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2fb1c-29d7-4ff4-b7d8-16c3ba9b4bb9 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.011948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2fb1c-29d7-4ff4-b7d8-16c3ba9b4bb9 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] PATH_INFO: `/v3/projects/d676b7239abf444ca090dc4d06dd2db0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:02.013584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2fb1c-29d7-4ff4-b7d8-16c3ba9b4bb9 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorizing `identity:get_project(project_id=d676b7239abf444ca090dc4d06dd2db0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:02.015684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed2fb1c-29d7-4ff4-b7d8-16c3ba9b4bb9 tempest-FlavorsAccessNegativeTestJSON-295244454 tempest-FlavorsAccessNegativeTestJSON-295244454-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:02.017735 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 967/1942] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:52:01 2022] GET /identity/v3/projects/d676b7239abf444ca090dc4d06dd2db0 => generated 395 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:02.069504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3be06-2731-41e2-9791-2c2728b282aa None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.069798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3be06-2731-41e2-9791-2c2728b282aa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.070076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac3be06-2731-41e2-9791-2c2728b282aa None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:02.071787 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 968/1943] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:52:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:52:02.077739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3be06-2731-41e2-9791-2c2728b282aa None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:52:02.086372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b18895a-2fd3-4b56-8f1d-485329770cfe admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:02.094140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c742e4-2b9e-476f-be5e-76123a6bfd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:02.094893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c742e4-2b9e-476f-be5e-76123a6bfd78 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.095280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c742e4-2b9e-476f-be5e-76123a6bfd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.096373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c742e4-2b9e-476f-be5e-76123a6bfd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:02.097077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c742e4-2b9e-476f-be5e-76123a6bfd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:02.100266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c742e4-2b9e-476f-be5e-76123a6bfd78 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:02.117354 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 976/1944] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:01 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:02.121441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c742e4-2b9e-476f-be5e-76123a6bfd78 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:02.134695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c742e4-2b9e-476f-be5e-76123a6bfd78 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:02.141413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ddc66a-45b7-4573-868e-152484cbe8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:02.142114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddc66a-45b7-4573-868e-152484cbe8fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.149227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddc66a-45b7-4573-868e-152484cbe8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.149544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ddc66a-45b7-4573-868e-152484cbe8fb admin admin] PATH_INFO: `/v3/projects/fdf16fe0aaed4cc9a9902ad18f196131/users/65cc97d97cf4411db950583c39062337/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:02.153369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddc66a-45b7-4573-868e-152484cbe8fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdf16fe0aaed4cc9a9902ad18f196131, user_id=65cc97d97cf4411db950583c39062337, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:02.156223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ddc66a-45b7-4573-868e-152484cbe8fb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:02.172957 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 977/1945] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:02 2022] PUT /identity/v3/projects/fdf16fe0aaed4cc9a9902ad18f196131/users/65cc97d97cf4411db950583c39062337/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:02.191118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b97a5-05ff-4785-a2c9-42d2e90f87c4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.191118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b97a5-05ff-4785-a2c9-42d2e90f87c4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.191118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15b97a5-05ff-4785-a2c9-42d2e90f87c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:02.194459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3be06-2731-41e2-9791-2c2728b282aa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:02.253076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b15b97a5-05ff-4785-a2c9-42d2e90f87c4 None None] MFA Rules not processed for user `65cc97d97cf4411db950583c39062337`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:02.257010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b15b97a5-05ff-4785-a2c9-42d2e90f87c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:02.276608 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:02.355165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac3be06-2731-41e2-9791-2c2728b282aa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:02.377010 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:02.429882 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 978/1946] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:02 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:02.466099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11399abe-7e0a-4a85-a249-de351764693b tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:02.467126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11399abe-7e0a-4a85-a249-de351764693b tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.467345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11399abe-7e0a-4a85-a249-de351764693b tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.467628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11399abe-7e0a-4a85-a249-de351764693b tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:02.469869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11399abe-7e0a-4a85-a249-de351764693b tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:get_project(project_id=a743bd48f4bf499ab2b51dd37b9b2d75)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:02.472775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11399abe-7e0a-4a85-a249-de351764693b tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:02.474678 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 969/1947] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:52:02 2022] GET /identity/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75 => generated 369 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:02.546617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b97a5-05ff-4785-a2c9-42d2e90f87c4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:02.564440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15b97a5-05ff-4785-a2c9-42d2e90f87c4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:02.576866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db0168-ca72-4316-9fc0-3b431ce6c2c5 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:02.577548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db0168-ca72-4316-9fc0-3b431ce6c2c5 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.577834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db0168-ca72-4316-9fc0-3b431ce6c2c5 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.578114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60db0168-ca72-4316-9fc0-3b431ce6c2c5 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:02.579565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db0168-ca72-4316-9fc0-3b431ce6c2c5 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:02.579884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db0168-ca72-4316-9fc0-3b431ce6c2c5 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:02.584020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60db0168-ca72-4316-9fc0-3b431ce6c2c5 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:02.612242 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 979/1948] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:52:02.620475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11399abe-7e0a-4a85-a249-de351764693b tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:02.639318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11399abe-7e0a-4a85-a249-de351764693b tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:02.646819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf77f-4418-4e1b-9bef-581491dfa6ed tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:02.647979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf77f-4418-4e1b-9bef-581491dfa6ed tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.648702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf77f-4418-4e1b-9bef-581491dfa6ed tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.649126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acf77f-4418-4e1b-9bef-581491dfa6ed tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:02.650111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf77f-4418-4e1b-9bef-581491dfa6ed tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:02.652548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acf77f-4418-4e1b-9bef-581491dfa6ed tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:02.695222 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 970/1949] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:02 2022] POST /identity/v3/users => generated 383 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:52:02.696907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db0168-ca72-4316-9fc0-3b431ce6c2c5 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:02.740230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60db0168-ca72-4316-9fc0-3b431ce6c2c5 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:02.754275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a87030-8343-4ef9-a521-759dff4f8399 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:02.755169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87030-8343-4ef9-a521-759dff4f8399 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.755543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87030-8343-4ef9-a521-759dff4f8399 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.755915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a87030-8343-4ef9-a521-759dff4f8399 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:02.756932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a87030-8343-4ef9-a521-759dff4f8399 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:02.757355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a87030-8343-4ef9-a521-759dff4f8399 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:02.759371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a87030-8343-4ef9-a521-759dff4f8399 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:02.777674 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 980/1950] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:52:02.872647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf77f-4418-4e1b-9bef-581491dfa6ed tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:02.983267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acf77f-4418-4e1b-9bef-581491dfa6ed tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:02.989663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd2ee-cd01-41d0-807e-c26bb2a71817 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:02.990358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdd2ee-cd01-41d0-807e-c26bb2a71817 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:02.990641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdd2ee-cd01-41d0-807e-c26bb2a71817 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:02.990910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdd2ee-cd01-41d0-807e-c26bb2a71817 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:03.001716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdd2ee-cd01-41d0-807e-c26bb2a71817 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:03.003131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdd2ee-cd01-41d0-807e-c26bb2a71817 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:03.016404 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 971/1951] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:02 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:52:03.182518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d0daa-c849-4ce1-b449-3250983bac7e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:03.183260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d0daa-c849-4ce1-b449-3250983bac7e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:03.183260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64d0daa-c849-4ce1-b449-3250983bac7e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:03.184717 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 981/1952] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:52:03.195341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd2ee-cd01-41d0-807e-c26bb2a71817 service nova] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:52:03.210588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd2ee-cd01-41d0-807e-c26bb2a71817 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:03.221840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdd2ee-cd01-41d0-807e-c26bb2a71817 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:03.233420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded85b8-a169-414f-a079-2dc1cfde1865 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:03.234445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded85b8-a169-414f-a079-2dc1cfde1865 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:03.234967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded85b8-a169-414f-a079-2dc1cfde1865 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:03.235360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ded85b8-a169-414f-a079-2dc1cfde1865 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:03.236824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded85b8-a169-414f-a079-2dc1cfde1865 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:get_project(project_id=a743bd48f4bf499ab2b51dd37b9b2d75)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:03.240189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ded85b8-a169-414f-a079-2dc1cfde1865 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:03.242142 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 972/1953] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:52:03 2022] GET /identity/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75 => generated 369 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:52:03.331491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d0daa-c849-4ce1-b449-3250983bac7e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:03.335955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f64d0daa-c849-4ce1-b449-3250983bac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:03.467635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded85b8-a169-414f-a079-2dc1cfde1865 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:03.488974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ded85b8-a169-414f-a079-2dc1cfde1865 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:03.502919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddf5747-2a98-43f7-a336-4c4e2ab95aaa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:03.503694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf5747-2a98-43f7-a336-4c4e2ab95aaa service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:03.504959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf5747-2a98-43f7-a336-4c4e2ab95aaa service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:03.505394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddf5747-2a98-43f7-a336-4c4e2ab95aaa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:03.510047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64d0daa-c849-4ce1-b449-3250983bac7e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:03.527804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:03.529593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:03.533863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:03.534393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] PATH_INFO: `/v3/users/271bfaad0d2c44a1b26f59aece15ebb4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:03.537944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=271bfaad0d2c44a1b26f59aece15ebb4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:03.547811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:03.669964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf5747-2a98-43f7-a336-4c4e2ab95aaa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:03.673555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddf5747-2a98-43f7-a336-4c4e2ab95aaa service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:03.688385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '271bfaad0d2c44a1b26f59aece15ebb4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:03.699027 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 973/1954] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:03 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:03.709946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '271bfaad0d2c44a1b26f59aece15ebb4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:03.711091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '271bfaad0d2c44a1b26f59aece15ebb4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:03.732779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '271bfaad0d2c44a1b26f59aece15ebb4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:03.754701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf503adb-457f-4940-a461-e8e5ae5e85c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '271bfaad0d2c44a1b26f59aece15ebb4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:03.763984 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:03.780775 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 982/1955] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:03 2022] DELETE /identity/v3/users/271bfaad0d2c44a1b26f59aece15ebb4 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:03.790004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207aa3-a1fc-4824-aaab-5af9abedb031 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:03.791266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207aa3-a1fc-4824-aaab-5af9abedb031 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:03.791932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b207aa3-a1fc-4824-aaab-5af9abedb031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:03.841652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7b207aa3-a1fc-4824-aaab-5af9abedb031 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:03.844095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7b207aa3-a1fc-4824-aaab-5af9abedb031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:03.861016 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:03.915268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0bd6e-c23f-433f-90f0-b9e55754e44e None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:03.915831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0bd6e-c23f-433f-90f0-b9e55754e44e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:03.916256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0bd6e-c23f-433f-90f0-b9e55754e44e None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:03.918276 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 983/1956] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:52:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:52:03.924935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0bd6e-c23f-433f-90f0-b9e55754e44e None None] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:52:03.928041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8b0bd6e-c23f-433f-90f0-b9e55754e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:04.008213 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 974/1957] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:04.040138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207aa3-a1fc-4824-aaab-5af9abedb031 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:04.044459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7b207aa3-a1fc-4824-aaab-5af9abedb031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:04.126648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0bd6e-c23f-433f-90f0-b9e55754e44e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:04.132023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8b0bd6e-c23f-433f-90f0-b9e55754e44e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:04.215767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b207aa3-a1fc-4824-aaab-5af9abedb031 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:04.220586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f306d6-e3df-4118-bd96-c568e90ca936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:04.229239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f306d6-e3df-4118-bd96-c568e90ca936 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:04.229473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f306d6-e3df-4118-bd96-c568e90ca936 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:04.229760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f306d6-e3df-4118-bd96-c568e90ca936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:04.248698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f306d6-e3df-4118-bd96-c568e90ca936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:04.251979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f306d6-e3df-4118-bd96-c568e90ca936 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:04.268782 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 975/1958] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:52:04.328501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0bd6e-c23f-433f-90f0-b9e55754e44e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:04.341001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c36d-8506-4d35-8fb7-37ed41cf6851 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:04.342191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c36d-8506-4d35-8fb7-37ed41cf6851 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:04.342822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c36d-8506-4d35-8fb7-37ed41cf6851 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:04.343095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4c36d-8506-4d35-8fb7-37ed41cf6851 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:04.344690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4c36d-8506-4d35-8fb7-37ed41cf6851 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:get_project(project_id=a743bd48f4bf499ab2b51dd37b9b2d75)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:04.348041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f4c36d-8506-4d35-8fb7-37ed41cf6851 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:04.353601 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 984/1959] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:52:03 2022] GET /identity/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75 => generated 369 bytes in 429 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:52:04.404509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f306d6-e3df-4118-bd96-c568e90ca936 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:04.422155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f306d6-e3df-4118-bd96-c568e90ca936 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:04.435110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:04.437626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:04.437626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:04.437626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/users/2723d19a46984e9d8b0b7cda28825e7a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:04.455545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:delete_user(user_id=2723d19a46984e9d8b0b7cda28825e7a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:04.457768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:04.526245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2723d19a46984e9d8b0b7cda28825e7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.549600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2723d19a46984e9d8b0b7cda28825e7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.550460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2723d19a46984e9d8b0b7cda28825e7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.563808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2723d19a46984e9d8b0b7cda28825e7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.579521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2723d19a46984e9d8b0b7cda28825e7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.587941 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 976/1960] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:04 2022] DELETE /identity/v3/users/2723d19a46984e9d8b0b7cda28825e7a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:04.591930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c36d-8506-4d35-8fb7-37ed41cf6851 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:04.593913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-72f4c36d-8506-4d35-8fb7-37ed41cf6851 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:04.608351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f4c36d-8506-4d35-8fb7-37ed41cf6851 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:04.747795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e33d23a5584607a115619667191037', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0606fdd4c5064705b7c2e2c14ea00e4f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:04.751191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:04.751452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:04.751737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] PATH_INFO: `/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:04.756185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a743bd48f4bf499ab2b51dd37b9b2d75)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:04.762028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:04.887569 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:04.908042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a743bd48f4bf499ab2b51dd37b9b2d75', 'request_id': 'req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.928120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a743bd48f4bf499ab2b51dd37b9b2d75', 'request_id': 'req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.938264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a743bd48f4bf499ab2b51dd37b9b2d75', 'request_id': 'req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.952259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:04.953877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:04.959544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] The token cache is being invalidate because project a743bd48f4bf499ab2b51dd37b9b2d75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:04.960140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.961263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:04.970233 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 985/1961] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:04 2022] DELETE /identity/v3/projects/a743bd48f4bf499ab2b51dd37b9b2d75 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:04.976663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:04.980120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:05.020981 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:05.159450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95a4951-c6e6-454d-ad9e-2b3ed3bed672 tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:05.172772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b18ca1-e498-4e39-bc80-aaab5e13836e tempest-QuotasAdminTestV236-912313158 tempest-QuotasAdminTestV236-912313158-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:05.186585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:05.186585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:05.186585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:05.186585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] PATH_INFO: `/v3/users/13853fd7904c4627924734629545e8f8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:05.188427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13853fd7904c4627924734629545e8f8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:05.190838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:05.198520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:05.199558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:05.200027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:05.200313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] PATH_INFO: `/v3/users/a7742b2fc8d247ce95d98e7d5babc7e3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:05.201882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7742b2fc8d247ce95d98e7d5babc7e3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:05.204147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:05.362219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13853fd7904c4627924734629545e8f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.394411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7742b2fc8d247ce95d98e7d5babc7e3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.402067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13853fd7904c4627924734629545e8f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.405184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13853fd7904c4627924734629545e8f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.429184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13853fd7904c4627924734629545e8f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.446819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13853fd7904c4627924734629545e8f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.479991 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 986/1962] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:04 2022] DELETE /identity/v3/users/13853fd7904c4627924734629545e8f8 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:05.481482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7742b2fc8d247ce95d98e7d5babc7e3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.481661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:05.482012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7742b2fc8d247ce95d98e7d5babc7e3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.487291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:05.508120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7742b2fc8d247ce95d98e7d5babc7e3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.519277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1570a83-183f-4723-8a02-b45e1dc972aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7742b2fc8d247ce95d98e7d5babc7e3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:05.527253 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 977/1963] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:04 2022] DELETE /identity/v3/users/a7742b2fc8d247ce95d98e7d5babc7e3 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:52:05.529331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e023b64-1746-4292-a4fa-1d7594c51f17 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:05.529722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e023b64-1746-4292-a4fa-1d7594c51f17 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:05.531020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e023b64-1746-4292-a4fa-1d7594c51f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:05.590479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8e023b64-1746-4292-a4fa-1d7594c51f17 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:05.592771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8e023b64-1746-4292-a4fa-1d7594c51f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:05.628872 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:05.681823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e5d6b5-b312-41c4-8034-2c0b3daee338 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:05.810179 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 978/1964] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:05.811659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68619905-6972-417e-a83a-b90bd4f8f8e3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:05.811943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68619905-6972-417e-a83a-b90bd4f8f8e3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:05.812218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68619905-6972-417e-a83a-b90bd4f8f8e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:05.873796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-68619905-6972-417e-a83a-b90bd4f8f8e3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:05.877694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-68619905-6972-417e-a83a-b90bd4f8f8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:05.907240 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 979/1965] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:05.910942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba66a-6cc9-41e5-9460-75dc29dec39a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:05.911704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba66a-6cc9-41e5-9460-75dc29dec39a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:05.911978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cba66a-6cc9-41e5-9460-75dc29dec39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:05.921339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:05.922011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:05.923287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:05.924749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] PATH_INFO: `/v3/users/7358bc8b21184699a0ff8187ebe46aeb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:05.928017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7358bc8b21184699a0ff8187ebe46aeb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:05.933354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:05.962264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-60cba66a-6cc9-41e5-9460-75dc29dec39a None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:05.963524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-60cba66a-6cc9-41e5-9460-75dc29dec39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:06.038067 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:06.060541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7358bc8b21184699a0ff8187ebe46aeb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.101133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7358bc8b21184699a0ff8187ebe46aeb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.103111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7358bc8b21184699a0ff8187ebe46aeb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.124380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7358bc8b21184699a0ff8187ebe46aeb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.129562 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 980/1966] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 08:52:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:06.131192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba66a-6cc9-41e5-9460-75dc29dec39a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:06.133659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-60cba66a-6cc9-41e5-9460-75dc29dec39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:06.136125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7358bc8b21184699a0ff8187ebe46aeb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.149945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 987/1967] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:05 2022] DELETE /identity/v3/users/7358bc8b21184699a0ff8187ebe46aeb => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:06.149945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:06.153567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:06.305591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cba66a-6cc9-41e5-9460-75dc29dec39a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:06.322666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5885134e-2230-4167-9498-7bbfa8f6f116 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:06.334941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24745e2-f909-4011-8a4a-5d7e715bc843 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:06.335722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24745e2-f909-4011-8a4a-5d7e715bc843 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:06.336055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24745e2-f909-4011-8a4a-5d7e715bc843 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:06.336403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24745e2-f909-4011-8a4a-5d7e715bc843 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:06.339812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e24745e2-f909-4011-8a4a-5d7e715bc843 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:06.410064 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:06.431909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:06.434157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:06.434674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:06.435233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:06.440355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:06.496982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24745e2-f909-4011-8a4a-5d7e715bc843 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:06.498907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24745e2-f909-4011-8a4a-5d7e715bc843 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:06.514177 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 988/1968] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:06.515819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415990cb-c9df-41cd-96d5-c7dc40a2bbd9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:06.516313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415990cb-c9df-41cd-96d5-c7dc40a2bbd9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:06.516695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415990cb-c9df-41cd-96d5-c7dc40a2bbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:06.540224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-415990cb-c9df-41cd-96d5-c7dc40a2bbd9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:06.541793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-415990cb-c9df-41cd-96d5-c7dc40a2bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:06.553930 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 989/1969] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:06.554920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415990cb-c9df-41cd-96d5-c7dc40a2bbd9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:06.556755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-415990cb-c9df-41cd-96d5-c7dc40a2bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:06.595444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:06.597501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:06.613259 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 981/1970] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:06.614409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:06.616681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:06.668458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33128c7-cbe3-4cd9-8889-be049fc6b2bb service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:06.676264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:06.677119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:06.678385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:06.678911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] PATH_INFO: `/v3/projects/c7b62320759146fc883679048eac1fec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:06.680376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7b62320759146fc883679048eac1fec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:06.684687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:06.733473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415990cb-c9df-41cd-96d5-c7dc40a2bbd9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:06.749408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e0fb-d93a-4a7f-9222-bc22923ec430 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:06.751702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e0fb-d93a-4a7f-9222-bc22923ec430 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:06.752599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e0fb-d93a-4a7f-9222-bc22923ec430 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:06.753662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261e0fb-d93a-4a7f-9222-bc22923ec430 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:06.759829 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:06.796315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7b62320759146fc883679048eac1fec', 'request_id': 'req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.805675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7b62320759146fc883679048eac1fec', 'request_id': 'req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.829482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7b62320759146fc883679048eac1fec', 'request_id': 'req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.840171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] The token cache is being invalidate because project c7b62320759146fc883679048eac1fec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:06.840581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.841762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:06.845928 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 982/1971] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:06 2022] DELETE /identity/v3/projects/c7b62320759146fc883679048eac1fec => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:06.846855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:06.849400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:06.939633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e0fb-d93a-4a7f-9222-bc22923ec430 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:06.941340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261e0fb-d93a-4a7f-9222-bc22923ec430 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:06.985548 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 990/1972] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:52:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:52:06.986721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e0fb-d93a-4a7f-9222-bc22923ec430 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:07.013088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261e0fb-d93a-4a7f-9222-bc22923ec430 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:07.065893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22c617-67bf-4ad2-b7be-35a8cbbbd70d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:07.075153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:07.075601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:07.077529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:07.077921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:07.082391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:07.142386 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:07.157995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:07.158546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:07.158875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:07.159150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] PATH_INFO: `/v3/users/2458c3818faa409dbb95cd5d7cacc32a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:07.162983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2458c3818faa409dbb95cd5d7cacc32a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:07.166232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:07.246901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:07.250615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:07.266725 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 983/1973] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:07.268412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:07.271410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:07.290144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8071fbb6-ec18-4baa-91f9-52b7c74b46ec service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:07.297633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:07.298384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:07.298671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:07.298947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] PATH_INFO: `/v3/users/8f26fa5efd704f25a17ca0965944aae5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:07.300357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f26fa5efd704f25a17ca0965944aae5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:07.302920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:07.343609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2458c3818faa409dbb95cd5d7cacc32a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.375750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2458c3818faa409dbb95cd5d7cacc32a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.376529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2458c3818faa409dbb95cd5d7cacc32a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.378083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f26fa5efd704f25a17ca0965944aae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.406439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f26fa5efd704f25a17ca0965944aae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.408709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f26fa5efd704f25a17ca0965944aae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.412081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2458c3818faa409dbb95cd5d7cacc32a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.418229 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:07.428941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f26fa5efd704f25a17ca0965944aae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.433448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf16e542-1d1a-4cf7-9492-f452e342394c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2458c3818faa409dbb95cd5d7cacc32a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.446771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f26fa5efd704f25a17ca0965944aae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:07.455718 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 991/1974] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:06 2022] DELETE /identity/v3/users/2458c3818faa409dbb95cd5d7cacc32a => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:07.466782 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 984/1975] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:07 2022] DELETE /identity/v3/users/8f26fa5efd704f25a17ca0965944aae5 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:07.471429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75efd4-b5cd-464e-ba45-aa9e7cfc8783 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:07.471838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75efd4-b5cd-464e-ba45-aa9e7cfc8783 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:07.472223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a75efd4-b5cd-464e-ba45-aa9e7cfc8783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:07.527725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5a75efd4-b5cd-464e-ba45-aa9e7cfc8783 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:07.529932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a75efd4-b5cd-464e-ba45-aa9e7cfc8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:07.664429 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 992/1976] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:07.682467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:07.684630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:07.857680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31406518-69f7-4c8c-a3e9-3185baa7aea9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:07.862628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec49f1a-5331-4e5f-b849-a7035201a3fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:07.863475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec49f1a-5331-4e5f-b849-a7035201a3fa service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:07.863764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec49f1a-5331-4e5f-b849-a7035201a3fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:07.864139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec49f1a-5331-4e5f-b849-a7035201a3fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:07.882016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec49f1a-5331-4e5f-b849-a7035201a3fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:07.884016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec49f1a-5331-4e5f-b849-a7035201a3fa service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:07.903013 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 985/1977] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:08.198851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75efd4-b5cd-464e-ba45-aa9e7cfc8783 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:08.201229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a75efd4-b5cd-464e-ba45-aa9e7cfc8783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:08.244733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a75efd4-b5cd-464e-ba45-aa9e7cfc8783 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:08.259100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:08.260013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:08.260306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:08.260681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] PATH_INFO: `/v3/projects/b3097fe2baef4179a11083d1adad3edd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:08.264524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3097fe2baef4179a11083d1adad3edd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:08.267745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:08.373648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3097fe2baef4179a11083d1adad3edd', 'request_id': 'req-9bc72db9-043d-4bb2-a611-d464b29bb58b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.387452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3097fe2baef4179a11083d1adad3edd', 'request_id': 'req-9bc72db9-043d-4bb2-a611-d464b29bb58b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.407837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3097fe2baef4179a11083d1adad3edd', 'request_id': 'req-9bc72db9-043d-4bb2-a611-d464b29bb58b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.432794 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:08.438278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] The token cache is being invalidate because project b3097fe2baef4179a11083d1adad3edd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:08.440398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.442682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.447543 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 993/1978] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:08 2022] DELETE /identity/v3/projects/b3097fe2baef4179a11083d1adad3edd => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:08.452679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec49f1a-5331-4e5f-b849-a7035201a3fa service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:08.476731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec49f1a-5331-4e5f-b849-a7035201a3fa service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:08.503644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:08.505195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:08.687668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:08.690884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:08.691217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:08.699050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] PATH_INFO: `/v3/users/374c711a83a94c2dabf0376e881f0e4f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:08.700916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=374c711a83a94c2dabf0376e881f0e4f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:08.703147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:08.714386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc72db9-043d-4bb2-a611-d464b29bb58b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:08.726410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:08.727201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:08.727526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:08.728918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] PATH_INFO: `/v3/projects/d1e899ed14ce4df8bbeb38ec6f9aa704` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:08.732510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1e899ed14ce4df8bbeb38ec6f9aa704)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:08.737380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:08.809863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '374c711a83a94c2dabf0376e881f0e4f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.846475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '374c711a83a94c2dabf0376e881f0e4f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.848861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '374c711a83a94c2dabf0376e881f0e4f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.868692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '374c711a83a94c2dabf0376e881f0e4f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.888441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '374c711a83a94c2dabf0376e881f0e4f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.908684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1e899ed14ce4df8bbeb38ec6f9aa704', 'request_id': 'req-9c13c9a0-fa00-4968-a04e-e92e3899223a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.914149 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 986/1979] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:08 2022] DELETE /identity/v3/users/374c711a83a94c2dabf0376e881f0e4f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:08.917722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:08.921036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:08.924105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1e899ed14ce4df8bbeb38ec6f9aa704', 'request_id': 'req-9c13c9a0-fa00-4968-a04e-e92e3899223a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.933614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1e899ed14ce4df8bbeb38ec6f9aa704', 'request_id': 'req-9c13c9a0-fa00-4968-a04e-e92e3899223a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.954140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] The token cache is being invalidate because project d1e899ed14ce4df8bbeb38ec6f9aa704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:08.954581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.955762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:08.969284 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:08.971385 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 994/1980] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:08 2022] DELETE /identity/v3/projects/d1e899ed14ce4df8bbeb38ec6f9aa704 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:52:08.978795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:08.982582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:09.101108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dbec4f-19e7-4434-82c8-06492c80b7ca admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:09.104380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c13c9a0-fa00-4968-a04e-e92e3899223a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:09.107870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:09.108565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:09.108853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:09.109323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] PATH_INFO: `/v3/users/cc1ba89738f2407abcbc8eb5cbc6d356` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:09.111390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc1ba89738f2407abcbc8eb5cbc6d356)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:09.114127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:09.126602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:09.130761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:09.131481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:09.131831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] PATH_INFO: `/v3/users/e7e33d23a5584607a115619667191037` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:09.134626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e33d23a5584607a115619667191037)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:09.149379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:09.249251 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:09.279618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc1ba89738f2407abcbc8eb5cbc6d356'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.291182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e33d23a5584607a115619667191037'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.316017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc1ba89738f2407abcbc8eb5cbc6d356'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.319858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc1ba89738f2407abcbc8eb5cbc6d356'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.329117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e33d23a5584607a115619667191037'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.330014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e33d23a5584607a115619667191037'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.340870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc1ba89738f2407abcbc8eb5cbc6d356'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.352462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e33d23a5584607a115619667191037'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.368849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc1ba89738f2407abcbc8eb5cbc6d356'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.372738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc500581-becc-4bca-a876-488707004da1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e33d23a5584607a115619667191037'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.381489 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 987/1981] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:08 2022] DELETE /identity/v3/users/cc1ba89738f2407abcbc8eb5cbc6d356 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:09.382582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:09.387083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:09.401413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 995/1982] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:08 2022] DELETE /identity/v3/users/e7e33d23a5584607a115619667191037 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:09.403839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ed9f4-426f-444d-8e55-0ae14231224c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:09.404665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ed9f4-426f-444d-8e55-0ae14231224c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:09.405185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81ed9f4-426f-444d-8e55-0ae14231224c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:09.453714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c81ed9f4-426f-444d-8e55-0ae14231224c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:09.455324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c81ed9f4-426f-444d-8e55-0ae14231224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:09.586279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14c4dfa-fa71-4323-9f4d-39b9937b8692 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:09.620787 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 996/1983] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:09.622744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ed9f4-426f-444d-8e55-0ae14231224c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:09.625875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c81ed9f4-426f-444d-8e55-0ae14231224c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:09.662615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81ed9f4-426f-444d-8e55-0ae14231224c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:09.674485 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:09.678668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:09.679644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:09.680987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:09.682140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] PATH_INFO: `/v3/projects/ebf4f99c926d4eee8f70a3cd64e87929` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:09.686023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebf4f99c926d4eee8f70a3cd64e87929)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:09.689044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:09.758261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:09.759144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:09.759654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:09.760112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] PATH_INFO: `/v3/projects/183affc84fd84194961f02ea40a757f3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:09.768686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=183affc84fd84194961f02ea40a757f3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:09.774283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:09.825566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebf4f99c926d4eee8f70a3cd64e87929', 'request_id': 'req-d7dffcb1-b994-482c-9dea-12c91935551f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.838601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebf4f99c926d4eee8f70a3cd64e87929', 'request_id': 'req-d7dffcb1-b994-482c-9dea-12c91935551f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.862783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebf4f99c926d4eee8f70a3cd64e87929', 'request_id': 'req-d7dffcb1-b994-482c-9dea-12c91935551f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.891662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '183affc84fd84194961f02ea40a757f3', 'request_id': 'req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.910796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '183affc84fd84194961f02ea40a757f3', 'request_id': 'req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.922558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] The token cache is being invalidate because project ebf4f99c926d4eee8f70a3cd64e87929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:09.923910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.931567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.933818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '183affc84fd84194961f02ea40a757f3', 'request_id': 'req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.935688 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 997/1984] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:09 2022] DELETE /identity/v3/projects/ebf4f99c926d4eee8f70a3cd64e87929 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:09.939589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:09.948873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:09.967615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] The token cache is being invalidate because project 183affc84fd84194961f02ea40a757f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:09.968410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.969566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:09.977601 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 988/1985] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:09 2022] DELETE /identity/v3/projects/183affc84fd84194961f02ea40a757f3 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:09.978991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:09.980519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:10.082000 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:10.117891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaebfd2-e899-4dc5-b08f-ea98aba46fb5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:10.123137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:10.124341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:10.124715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:10.125046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:10.128001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:10.178007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dffcb1-b994-482c-9dea-12c91935551f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:10.308225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:10.310744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:10.328118 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 989/1986] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:10.329356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:10.331857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:10.352151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:10.352836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:10.353114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:10.353484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] PATH_INFO: `/v3/projects/4144a752f1494a5e964cfb38db5c1d45` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:10.354120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c9521-2655-49e1-8395-95d468d6a2a4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:10.355976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4144a752f1494a5e964cfb38db5c1d45)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:10.358172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:10.360598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:10.361520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:10.361941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:10.362965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] PATH_INFO: `/v3/users/65cc97d97cf4411db950583c39062337` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:10.363955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65cc97d97cf4411db950583c39062337)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:10.366879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:10.376247 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:10.459257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65cc97d97cf4411db950583c39062337'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.498235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65cc97d97cf4411db950583c39062337'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.506419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65cc97d97cf4411db950583c39062337'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.520491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65cc97d97cf4411db950583c39062337'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.546967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4144a752f1494a5e964cfb38db5c1d45', 'request_id': 'req-ad0005f5-8116-4642-9421-e709f3093584'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.561085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6211c69-e641-4444-a7b1-a757512c1dc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65cc97d97cf4411db950583c39062337'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.567020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4144a752f1494a5e964cfb38db5c1d45', 'request_id': 'req-ad0005f5-8116-4642-9421-e709f3093584'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.573977 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 990/1987] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:10 2022] DELETE /identity/v3/users/65cc97d97cf4411db950583c39062337 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:10.576327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357dc1a-0563-4849-b8b2-45846bdcec73 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:10.576813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357dc1a-0563-4849-b8b2-45846bdcec73 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:10.577268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357dc1a-0563-4849-b8b2-45846bdcec73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:10.600106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4144a752f1494a5e964cfb38db5c1d45', 'request_id': 'req-ad0005f5-8116-4642-9421-e709f3093584'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.627556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1357dc1a-0563-4849-b8b2-45846bdcec73 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:10.629454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1357dc1a-0563-4849-b8b2-45846bdcec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:10.635902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] The token cache is being invalidate because project 4144a752f1494a5e964cfb38db5c1d45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:10.636455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.637604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:10.646167 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 998/1988] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:09 2022] DELETE /identity/v3/projects/4144a752f1494a5e964cfb38db5c1d45 => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:10.648251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:10.651199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:10.826292 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 991/1989] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:10.827300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357dc1a-0563-4849-b8b2-45846bdcec73 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:10.844045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1357dc1a-0563-4849-b8b2-45846bdcec73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:10.876809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357dc1a-0563-4849-b8b2-45846bdcec73 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:10.886767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:10.889354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:10.889649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:10.892121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] PATH_INFO: `/v3/users/360d9ace59f846be8521c939ac783e61` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:10.894776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=360d9ace59f846be8521c939ac783e61)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:10.897372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:10.907546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0005f5-8116-4642-9421-e709f3093584 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:10.922601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:10.923259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:10.923541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:10.923833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] PATH_INFO: `/v3/projects/0606fdd4c5064705b7c2e2c14ea00e4f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:10.930454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0606fdd4c5064705b7c2e2c14ea00e4f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:10.931380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:10.969756 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:11.029860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '360d9ace59f846be8521c939ac783e61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.087814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '360d9ace59f846be8521c939ac783e61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.089688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '360d9ace59f846be8521c939ac783e61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.116700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0606fdd4c5064705b7c2e2c14ea00e4f', 'request_id': 'req-a072b98a-86c8-4023-94c7-aa426dd7c21e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.120029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '360d9ace59f846be8521c939ac783e61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.156419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0606fdd4c5064705b7c2e2c14ea00e4f', 'request_id': 'req-a072b98a-86c8-4023-94c7-aa426dd7c21e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.161831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '360d9ace59f846be8521c939ac783e61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.171698 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:11.184985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0606fdd4c5064705b7c2e2c14ea00e4f', 'request_id': 'req-a072b98a-86c8-4023-94c7-aa426dd7c21e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.197609 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 992/1990] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:10 2022] DELETE /identity/v3/users/360d9ace59f846be8521c939ac783e61 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:11.200775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:11.203260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:11.245690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] The token cache is being invalidate because project 0606fdd4c5064705b7c2e2c14ea00e4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:11.245999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.251845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a072b98a-86c8-4023-94c7-aa426dd7c21e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.255927 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 999/1991] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:10 2022] DELETE /identity/v3/projects/0606fdd4c5064705b7c2e2c14ea00e4f => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:11.263991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9af4-308b-4004-92f6-9f5f0b4b85e6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:11.264313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9af4-308b-4004-92f6-9f5f0b4b85e6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:11.264554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a9af4-308b-4004-92f6-9f5f0b4b85e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:11.337967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-179a9af4-308b-4004-92f6-9f5f0b4b85e6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:11.339386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-179a9af4-308b-4004-92f6-9f5f0b4b85e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:11.447894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e33f1fa-35f1-4853-9ac7-9c3866f6fb0c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:11.463053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:11.465588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:11.466399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:11.477981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] PATH_INFO: `/v3/projects/3efeb744e42e47c8b1ae636da01d5293` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:11.482332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3efeb744e42e47c8b1ae636da01d5293)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:11.484363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:11.530507 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1000/1992] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:11.534186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9af4-308b-4004-92f6-9f5f0b4b85e6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:11.538068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-179a9af4-308b-4004-92f6-9f5f0b4b85e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:11.563789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a9af4-308b-4004-92f6-9f5f0b4b85e6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:11.576200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:11.576978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:11.579522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:11.579522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] PATH_INFO: `/v3/projects/51f58b19f97f4eb7a30c2106758088d6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:11.581453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=51f58b19f97f4eb7a30c2106758088d6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:11.584752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:11.602394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3efeb744e42e47c8b1ae636da01d5293', 'request_id': 'req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.612912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3efeb744e42e47c8b1ae636da01d5293', 'request_id': 'req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.630559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3efeb744e42e47c8b1ae636da01d5293', 'request_id': 'req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.651514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] The token cache is being invalidate because project 3efeb744e42e47c8b1ae636da01d5293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:11.652487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.665979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-107ecc35-cbf0-43a0-ad6f-f055cd8b75d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.677783 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 993/1993] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:11 2022] DELETE /identity/v3/projects/3efeb744e42e47c8b1ae636da01d5293 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:11.679429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0c7ba-38d9-4325-a204-608f73caf112 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:11.679793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0c7ba-38d9-4325-a204-608f73caf112 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:11.679984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a0c7ba-38d9-4325-a204-608f73caf112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:11.695783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51f58b19f97f4eb7a30c2106758088d6', 'request_id': 'req-d829d511-af1b-485b-a9d5-d733f33d8ae2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.713728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51f58b19f97f4eb7a30c2106758088d6', 'request_id': 'req-d829d511-af1b-485b-a9d5-d733f33d8ae2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.726566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51f58b19f97f4eb7a30c2106758088d6', 'request_id': 'req-d829d511-af1b-485b-a9d5-d733f33d8ae2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.732732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-18a0c7ba-38d9-4325-a204-608f73caf112 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:11.734408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-18a0c7ba-38d9-4325-a204-608f73caf112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:11.747770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] The token cache is being invalidate because project 51f58b19f97f4eb7a30c2106758088d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:11.757634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.758426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:11.763297 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1001/1994] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:11 2022] DELETE /identity/v3/projects/51f58b19f97f4eb7a30c2106758088d6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:11.764428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:11.765961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:11.823160 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:11.886803 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 994/1995] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:11.886803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0c7ba-38d9-4325-a204-608f73caf112 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:11.886803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-18a0c7ba-38d9-4325-a204-608f73caf112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:11.888705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d829d511-af1b-485b-a9d5-d733f33d8ae2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:11.895830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b520207-5c12-427a-978e-21b34e7130ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:11.896581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b520207-5c12-427a-978e-21b34e7130ea admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:11.896866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b520207-5c12-427a-978e-21b34e7130ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:11.897145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b520207-5c12-427a-978e-21b34e7130ea admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:11.897892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b520207-5c12-427a-978e-21b34e7130ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:11.898257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b520207-5c12-427a-978e-21b34e7130ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:11.899979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b520207-5c12-427a-978e-21b34e7130ea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:11.918129 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1002/1996] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:11.918668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a0c7ba-38d9-4325-a204-608f73caf112 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:11.920531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def17f-afbe-4bfb-aa80-e34db6f8a3bc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:11.920771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def17f-afbe-4bfb-aa80-e34db6f8a3bc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:11.921054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8def17f-afbe-4bfb-aa80-e34db6f8a3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:11.927200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:11.929019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:11.929416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:11.929782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] PATH_INFO: `/v3/projects/fdf16fe0aaed4cc9a9902ad18f196131` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:11.931193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdf16fe0aaed4cc9a9902ad18f196131)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:11.934198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:11.955461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f8def17f-afbe-4bfb-aa80-e34db6f8a3bc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:11.957550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f8def17f-afbe-4bfb-aa80-e34db6f8a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:11.967624 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1003/1997] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:11.968907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8def17f-afbe-4bfb-aa80-e34db6f8a3bc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:11.970578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f8def17f-afbe-4bfb-aa80-e34db6f8a3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:11.978828 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:11.985345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8def17f-afbe-4bfb-aa80-e34db6f8a3bc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:12.000356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:12.001346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.001783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.002211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] PATH_INFO: `/v3/users/574d00065b2f47d1baf596c611522597` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.013331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] RBAC: Authorizing `identity:delete_user(user_id=574d00065b2f47d1baf596c611522597)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:12.013331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:12.022502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdf16fe0aaed4cc9a9902ad18f196131', 'request_id': 'req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.040717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdf16fe0aaed4cc9a9902ad18f196131', 'request_id': 'req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.069450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdf16fe0aaed4cc9a9902ad18f196131', 'request_id': 'req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.093952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] The token cache is being invalidate because project fdf16fe0aaed4cc9a9902ad18f196131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:12.094776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.095269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '574d00065b2f47d1baf596c611522597'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.096019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9c2273a-cd1d-4b9c-bf72-4f09144679a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.099542 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 995/1998] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:11 2022] DELETE /identity/v3/projects/fdf16fe0aaed4cc9a9902ad18f196131 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:12.101081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661e69f-6c2f-4b30-b6d7-7960896c6751 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.101492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661e69f-6c2f-4b30-b6d7-7960896c6751 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.101954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1661e69f-6c2f-4b30-b6d7-7960896c6751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.116672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '574d00065b2f47d1baf596c611522597'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.118920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '574d00065b2f47d1baf596c611522597'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.136378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '574d00065b2f47d1baf596c611522597'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.139833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1661e69f-6c2f-4b30-b6d7-7960896c6751 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:12.142577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1661e69f-6c2f-4b30-b6d7-7960896c6751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:12.160231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '574d00065b2f47d1baf596c611522597'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.175943 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1004/1999] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:11 2022] DELETE /identity/v3/users/574d00065b2f47d1baf596c611522597 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:12.177333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:12.179003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:12.296545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc189b70-84e3-4cd9-ad55-7d566c232501 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:12.315742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c0e1c7-64fe-4de1-96ed-ec155a1808e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:12.316729 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 996/2000] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:12.320794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7a337-bbb3-47dd-b0aa-4d6b779a1162 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.320794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7a337-bbb3-47dd-b0aa-4d6b779a1162 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.320794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a7a337-bbb3-47dd-b0aa-4d6b779a1162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.321852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0e1c7-64fe-4de1-96ed-ec155a1808e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.323031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0e1c7-64fe-4de1-96ed-ec155a1808e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.324913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c0e1c7-64fe-4de1-96ed-ec155a1808e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.326088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0e1c7-64fe-4de1-96ed-ec155a1808e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:12.328349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c0e1c7-64fe-4de1-96ed-ec155a1808e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:12.369202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-30a7a337-bbb3-47dd-b0aa-4d6b779a1162 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:12.371510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-30a7a337-bbb3-47dd-b0aa-4d6b779a1162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:12.377010 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1005/2001] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:12 2022] POST /identity/v3/projects => generated 395 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:12.378774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9185-fd4c-4f27-815d-8e11d43103ca None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.379255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9185-fd4c-4f27-815d-8e11d43103ca None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.380319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a9185-fd4c-4f27-815d-8e11d43103ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.407641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f58a9185-fd4c-4f27-815d-8e11d43103ca None None] MFA Rules not processed for user `b43a269fe8b746b88c38db6b9e9bfa12`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:12.409876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f58a9185-fd4c-4f27-815d-8e11d43103ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:12.430270 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:12.521266 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 997/2002] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:12.522997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c571c2-0eeb-4a67-ae5c-834103cf39e1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.524969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c571c2-0eeb-4a67-ae5c-834103cf39e1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.526600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c571c2-0eeb-4a67-ae5c-834103cf39e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.564307 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1006/2003] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:12.565380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9185-fd4c-4f27-815d-8e11d43103ca None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:12.567029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f58a9185-fd4c-4f27-815d-8e11d43103ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:12.584987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-05c571c2-0eeb-4a67-ae5c-834103cf39e1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:12.586366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-05c571c2-0eeb-4a67-ae5c-834103cf39e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:12.621021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 998/2004] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:12.621021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c571c2-0eeb-4a67-ae5c-834103cf39e1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:12.622756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a9185-fd4c-4f27-815d-8e11d43103ca None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:12.634203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:12.636935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.637392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.637916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] PATH_INFO: `/v3/projects/d676b7239abf444ca090dc4d06dd2db0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.639934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c571c2-0eeb-4a67-ae5c-834103cf39e1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:12.641251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d676b7239abf444ca090dc4d06dd2db0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:12.644176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:12.648101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34253a94-4558-4442-8960-f8d03cb152b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:12.649338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34253a94-4558-4442-8960-f8d03cb152b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.649828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34253a94-4558-4442-8960-f8d03cb152b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.650296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34253a94-4558-4442-8960-f8d03cb152b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.651648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34253a94-4558-4442-8960-f8d03cb152b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:12.654400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34253a94-4558-4442-8960-f8d03cb152b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:12.658701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34253a94-4558-4442-8960-f8d03cb152b9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:12.729551 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 999/2005] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:12.737497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34253a94-4558-4442-8960-f8d03cb152b9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:12.740627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd676b7239abf444ca090dc4d06dd2db0', 'request_id': 'req-e07a2210-bc05-468a-99fd-b247058287b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.753342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd676b7239abf444ca090dc4d06dd2db0', 'request_id': 'req-e07a2210-bc05-468a-99fd-b247058287b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.765504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34253a94-4558-4442-8960-f8d03cb152b9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:12.782528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd676b7239abf444ca090dc4d06dd2db0', 'request_id': 'req-e07a2210-bc05-468a-99fd-b247058287b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.819529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] The token cache is being invalidate because project d676b7239abf444ca090dc4d06dd2db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:12.819831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.820582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:12.828842 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1007/2006] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:12 2022] DELETE /identity/v3/projects/d676b7239abf444ca090dc4d06dd2db0 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:12.829947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:12.838673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:12.848829 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:12.915551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b596708-c04f-498c-b944-d9937a579be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:12.916262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596708-c04f-498c-b944-d9937a579be9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.916356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596708-c04f-498c-b944-d9937a579be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.916594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b596708-c04f-498c-b944-d9937a579be9 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.917228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b596708-c04f-498c-b944-d9937a579be9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:12.919210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b596708-c04f-498c-b944-d9937a579be9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:12.964902 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1000/2007] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:12 2022] POST /identity/v3/users => generated 298 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:12.966403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2e454-db0d-4840-b3d5-27574a687b52 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.966748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2e454-db0d-4840-b3d5-27574a687b52 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.967169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd2e454-db0d-4840-b3d5-27574a687b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.984257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07a2210-bc05-468a-99fd-b247058287b0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:12.991395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:12.992055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:12.992339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:12.992622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:12.993307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:12.993633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:12.995319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.013485 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1008/2008] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:13.014525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.017166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.024680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5dd2e454-db0d-4840-b3d5-27574a687b52 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:13.026789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5dd2e454-db0d-4840-b3d5-27574a687b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.037099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039fdea4-169b-43fd-87d6-879970f11dac admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.041527 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1001/2009] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:13.047430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2e454-db0d-4840-b3d5-27574a687b52 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.048529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b758c-fc7e-47e3-ad43-4d917be0d915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.049350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b758c-fc7e-47e3-ad43-4d917be0d915 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.049699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b758c-fc7e-47e3-ad43-4d917be0d915 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.050039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b758c-fc7e-47e3-ad43-4d917be0d915 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.050701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b758c-fc7e-47e3-ad43-4d917be0d915 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.051510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5dd2e454-db0d-4840-b3d5-27574a687b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.053121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b758c-fc7e-47e3-ad43-4d917be0d915 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.082271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd2e454-db0d-4840-b3d5-27574a687b52 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.099578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.099578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.099578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.099578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] PATH_INFO: `/v3/projects/ba295e47ad5648c08e6cef9674f5abde` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.100886 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1009/2010] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/projects => generated 411 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:13.102943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31299990-f9bb-440c-be5b-47fe81188058 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.103397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba295e47ad5648c08e6cef9674f5abde)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.103666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31299990-f9bb-440c-be5b-47fe81188058 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.104254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31299990-f9bb-440c-be5b-47fe81188058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.108240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.132980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-31299990-f9bb-440c-be5b-47fe81188058 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:13.134314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-31299990-f9bb-440c-be5b-47fe81188058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.141664 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:13.228674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba295e47ad5648c08e6cef9674f5abde', 'request_id': 'req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:13.234533 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1010/2011] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:13.235464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31299990-f9bb-440c-be5b-47fe81188058 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.236811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba295e47ad5648c08e6cef9674f5abde', 'request_id': 'req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:13.236951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-31299990-f9bb-440c-be5b-47fe81188058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.248837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba295e47ad5648c08e6cef9674f5abde', 'request_id': 'req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:13.252218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31299990-f9bb-440c-be5b-47fe81188058 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.265119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] The token cache is being invalidate because project ba295e47ad5648c08e6cef9674f5abde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:13.265603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:13.266404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:13.273622 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1002/2012] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:13 2022] DELETE /identity/v3/projects/ba295e47ad5648c08e6cef9674f5abde => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:13.273622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.273622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.345598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39032a07-8a0e-40b4-875a-57ae6b2b13d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.346269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39032a07-8a0e-40b4-875a-57ae6b2b13d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.346607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39032a07-8a0e-40b4-875a-57ae6b2b13d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.346931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39032a07-8a0e-40b4-875a-57ae6b2b13d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.347587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39032a07-8a0e-40b4-875a-57ae6b2b13d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.350208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39032a07-8a0e-40b4-875a-57ae6b2b13d8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.364981 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1011/2013] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:13.366121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39032a07-8a0e-40b4-875a-57ae6b2b13d8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.368273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39032a07-8a0e-40b4-875a-57ae6b2b13d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.371294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88139ff-0acb-4d1b-957c-88bfdd0b3dae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.381980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c0c0fe-2df2-43eb-a173-8524c82ba568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.383741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0c0fe-2df2-43eb-a173-8524c82ba568 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.384462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0c0fe-2df2-43eb-a173-8524c82ba568 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.385176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c0c0fe-2df2-43eb-a173-8524c82ba568 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.386033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39032a07-8a0e-40b4-875a-57ae6b2b13d8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.386784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0c0fe-2df2-43eb-a173-8524c82ba568 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.391039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c0c0fe-2df2-43eb-a173-8524c82ba568 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.392898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.393781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.394347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.394734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.395622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:13.396033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.398403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.417243 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1012/2014] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:13.418239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.422529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.436860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c03822a-632a-4a1d-bbe5-122ae72172cb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.441257 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1003/2015] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/projects => generated 397 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:13.449842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b96bb-0230-4075-8fd9-2e204ca8e3c7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.450125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b96bb-0230-4075-8fd9-2e204ca8e3c7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.450402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814b96bb-0230-4075-8fd9-2e204ca8e3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.474158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-814b96bb-0230-4075-8fd9-2e204ca8e3c7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:13.475446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-814b96bb-0230-4075-8fd9-2e204ca8e3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.504396 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:13.536148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec264c90-c93d-480d-b88a-cc1e6b658efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.537185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264c90-c93d-480d-b88a-cc1e6b658efc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.538459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264c90-c93d-480d-b88a-cc1e6b658efc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.539231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec264c90-c93d-480d-b88a-cc1e6b658efc admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.539774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec264c90-c93d-480d-b88a-cc1e6b658efc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.542742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec264c90-c93d-480d-b88a-cc1e6b658efc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.575831 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1013/2016] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/users => generated 306 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:13.577460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ec15e-4e2f-406d-835f-892a32f71a68 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.578024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ec15e-4e2f-406d-835f-892a32f71a68 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.578307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4ec15e-4e2f-406d-835f-892a32f71a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.585963 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1004/2017] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:13.585963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f506f-affd-4dd1-bdc2-27a3cc640dbf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.585963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f506f-affd-4dd1-bdc2-27a3cc640dbf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.585963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90f506f-affd-4dd1-bdc2-27a3cc640dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.607461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0a4ec15e-4e2f-406d-835f-892a32f71a68 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:13.608701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0a4ec15e-4e2f-406d-835f-892a32f71a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.627260 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1014/2018] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:13.628307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ec15e-4e2f-406d-835f-892a32f71a68 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.630540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0a4ec15e-4e2f-406d-835f-892a32f71a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.636510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b90f506f-affd-4dd1-bdc2-27a3cc640dbf None None] MFA Rules not processed for user `4099c569c4fe489fa349ee29e6974713`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:13.638014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b90f506f-affd-4dd1-bdc2-27a3cc640dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.645710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4ec15e-4e2f-406d-835f-892a32f71a68 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.652401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7cb98-3a5a-4e83-965d-74085e383fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.653077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7cb98-3a5a-4e83-965d-74085e383fcf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.653393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7cb98-3a5a-4e83-965d-74085e383fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.653674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7cb98-3a5a-4e83-965d-74085e383fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.654381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7cb98-3a5a-4e83-965d-74085e383fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.656361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7cb98-3a5a-4e83-965d-74085e383fcf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.675792 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1015/2019] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:13.675792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7cb98-3a5a-4e83-965d-74085e383fcf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.687599 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:13.702975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7cb98-3a5a-4e83-965d-74085e383fcf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.716607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39a8b-70c0-4739-88bd-6bfbe959794f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.717456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39a8b-70c0-4739-88bd-6bfbe959794f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.717744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39a8b-70c0-4739-88bd-6bfbe959794f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.718027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b39a8b-70c0-4739-88bd-6bfbe959794f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.721550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b39a8b-70c0-4739-88bd-6bfbe959794f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.724218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b39a8b-70c0-4739-88bd-6bfbe959794f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.752345 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1005/2020] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:13.754098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f506f-affd-4dd1-bdc2-27a3cc640dbf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.766764 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1016/2021] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/projects => generated 375 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:13.766764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39a8b-70c0-4739-88bd-6bfbe959794f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.778154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90f506f-affd-4dd1-bdc2-27a3cc640dbf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.860495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b39a8b-70c0-4739-88bd-6bfbe959794f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.866927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f4efd-781e-4a98-ab4f-1ed572a11f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.867753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f4efd-781e-4a98-ab4f-1ed572a11f22 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.868042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f4efd-781e-4a98-ab4f-1ed572a11f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.868468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f4efd-781e-4a98-ab4f-1ed572a11f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.869167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f4efd-781e-4a98-ab4f-1ed572a11f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.871449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262f4efd-781e-4a98-ab4f-1ed572a11f22 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.884997 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1017/2022] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:13 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:13.886311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f4efd-781e-4a98-ab4f-1ed572a11f22 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.901175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262f4efd-781e-4a98-ab4f-1ed572a11f22 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.907744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fca3a-41a5-4985-b7fd-d6b5216aea4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.908039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fca3a-41a5-4985-b7fd-d6b5216aea4e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.908428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fca3a-41a5-4985-b7fd-d6b5216aea4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.908947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fca3a-41a5-4985-b7fd-d6b5216aea4e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.909869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fca3a-41a5-4985-b7fd-d6b5216aea4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:13.910336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fca3a-41a5-4985-b7fd-d6b5216aea4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.913363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fca3a-41a5-4985-b7fd-d6b5216aea4e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.928411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd026a-5056-4e28-9f28-33d423a61e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.929330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd026a-5056-4e28-9f28-33d423a61e8d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.929728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd026a-5056-4e28-9f28-33d423a61e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.930323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfd026a-5056-4e28-9f28-33d423a61e8d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.931022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd026a-5056-4e28-9f28-33d423a61e8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:13.934197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfd026a-5056-4e28-9f28-33d423a61e8d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:13.943107 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1018/2023] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:13.949437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b502e-5e4e-45ff-bcaf-99d1ab2d4ae8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.949873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b502e-5e4e-45ff-bcaf-99d1ab2d4ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.950153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b502e-5e4e-45ff-bcaf-99d1ab2d4ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:13.969335 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1006/2024] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/users => generated 299 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:13.971109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd026a-5056-4e28-9f28-33d423a61e8d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.977160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-993b502e-5e4e-45ff-bcaf-99d1ab2d4ae8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:13.978661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-993b502e-5e4e-45ff-bcaf-99d1ab2d4ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.987345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfd026a-5056-4e28-9f28-33d423a61e8d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:13.994191 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1019/2025] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:13.995187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b502e-5e4e-45ff-bcaf-99d1ab2d4ae8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:13.996025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04985895-9828-4e22-ba7a-e00bb21c4574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:13.996876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-993b502e-5e4e-45ff-bcaf-99d1ab2d4ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:13.996986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04985895-9828-4e22-ba7a-e00bb21c4574 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:13.997276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04985895-9828-4e22-ba7a-e00bb21c4574 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:13.997686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04985895-9828-4e22-ba7a-e00bb21c4574 admin admin] PATH_INFO: `/v3/projects/7d67aceff3f74eb09e51d10c4a2c2c34/users/ef6d87df863045b4bfa04f6bbec25d85/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.012810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b502e-5e4e-45ff-bcaf-99d1ab2d4ae8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.019799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04985895-9828-4e22-ba7a-e00bb21c4574 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d67aceff3f74eb09e51d10c4a2c2c34, user_id=ef6d87df863045b4bfa04f6bbec25d85, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.020132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8e94-a89d-4e99-b8f9-6e679bb09328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.020907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8e94-a89d-4e99-b8f9-6e679bb09328 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.021361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8e94-a89d-4e99-b8f9-6e679bb09328 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.021721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfe8e94-a89d-4e99-b8f9-6e679bb09328 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.023195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8e94-a89d-4e99-b8f9-6e679bb09328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.023757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04985895-9828-4e22-ba7a-e00bb21c4574 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.026122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfe8e94-a89d-4e99-b8f9-6e679bb09328 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.052148 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1007/2026] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:13 2022] PUT /identity/v3/projects/7d67aceff3f74eb09e51d10c4a2c2c34/users/ef6d87df863045b4bfa04f6bbec25d85/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:14.054358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04985895-9828-4e22-ba7a-e00bb21c4574 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.081273 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1020/2027] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:13 2022] POST /identity/v3/projects => generated 401 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:14.086514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8e94-a89d-4e99-b8f9-6e679bb09328 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.100694 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:14.170513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04985895-9828-4e22-ba7a-e00bb21c4574 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.252776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfe8e94-a89d-4e99-b8f9-6e679bb09328 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.260521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c831700-3eb9-4474-8439-8771e5120974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.261094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831700-3eb9-4474-8439-8771e5120974 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.261481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831700-3eb9-4474-8439-8771e5120974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.262438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c831700-3eb9-4474-8439-8771e5120974 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.263181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c831700-3eb9-4474-8439-8771e5120974 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.264858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c831700-3eb9-4474-8439-8771e5120974 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.278778 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1021/2028] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:14.279885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c831700-3eb9-4474-8439-8771e5120974 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.292825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f901a-2058-4074-bdd8-cd622a124522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.294195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c831700-3eb9-4474-8439-8771e5120974 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.294731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f901a-2058-4074-bdd8-cd622a124522 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.295674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f901a-2058-4074-bdd8-cd622a124522 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.296466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4f901a-2058-4074-bdd8-cd622a124522 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.297925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f901a-2058-4074-bdd8-cd622a124522 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.302782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4f901a-2058-4074-bdd8-cd622a124522 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.303000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9a2c2-559b-4d58-966e-bf12f29b7d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.303638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9a2c2-559b-4d58-966e-bf12f29b7d18 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.303984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9a2c2-559b-4d58-966e-bf12f29b7d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.304347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae9a2c2-559b-4d58-966e-bf12f29b7d18 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.305209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9a2c2-559b-4d58-966e-bf12f29b7d18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.307852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae9a2c2-559b-4d58-966e-bf12f29b7d18 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.348719 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1008/2029] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:14 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:14.350331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f901a-2058-4074-bdd8-cd622a124522 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.354575 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1022/2030] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:14 2022] POST /identity/v3/projects => generated 391 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:14.355323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9a2c2-559b-4d58-966e-bf12f29b7d18 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.371574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4f901a-2058-4074-bdd8-cd622a124522 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.388242 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:14.477916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae9a2c2-559b-4d58-966e-bf12f29b7d18 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.481624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7c23a-9421-4c10-9cfb-08ef71ca8ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.485288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7c23a-9421-4c10-9cfb-08ef71ca8ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.487387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c02a8be-7625-40f5-8ba1-206c4855e530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.487831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7c23a-9421-4c10-9cfb-08ef71ca8ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.488283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc7c23a-9421-4c10-9cfb-08ef71ca8ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.488685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a8be-7625-40f5-8ba1-206c4855e530 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.490067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a8be-7625-40f5-8ba1-206c4855e530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.490648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c02a8be-7625-40f5-8ba1-206c4855e530 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.490818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7c23a-9421-4c10-9cfb-08ef71ca8ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.492751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02a8be-7625-40f5-8ba1-206c4855e530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:14.493471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02a8be-7625-40f5-8ba1-206c4855e530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.497493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c02a8be-7625-40f5-8ba1-206c4855e530 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.500169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc7c23a-9421-4c10-9cfb-08ef71ca8ef6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.520955 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1023/2031] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:14.523329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be189dc8-4e6c-4799-ba70-89e278036e5a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.523628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be189dc8-4e6c-4799-ba70-89e278036e5a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.524011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be189dc8-4e6c-4799-ba70-89e278036e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.534906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1009/2032] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:14.539242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7c23a-9421-4c10-9cfb-08ef71ca8ef6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.567106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc7c23a-9421-4c10-9cfb-08ef71ca8ef6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.577914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-be189dc8-4e6c-4799-ba70-89e278036e5a None None] MFA Rules not processed for user `ef6d87df863045b4bfa04f6bbec25d85`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:14.578675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09f30a-2f12-4aba-8ba0-9d2fb5194845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.579073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09f30a-2f12-4aba-8ba0-9d2fb5194845 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.579271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09f30a-2f12-4aba-8ba0-9d2fb5194845 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.579508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b09f30a-2f12-4aba-8ba0-9d2fb5194845 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.579754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-be189dc8-4e6c-4799-ba70-89e278036e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:14.580143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09f30a-2f12-4aba-8ba0-9d2fb5194845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.582206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b09f30a-2f12-4aba-8ba0-9d2fb5194845 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.608069 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1010/2033] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:14 2022] POST /identity/v3/users => generated 307 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:14.608904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09f30a-2f12-4aba-8ba0-9d2fb5194845 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.621470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b09f30a-2f12-4aba-8ba0-9d2fb5194845 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.637285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea711-a970-4d89-9365-6b1a04809040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.638415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea711-a970-4d89-9365-6b1a04809040 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.638861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea711-a970-4d89-9365-6b1a04809040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.639298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fea711-a970-4d89-9365-6b1a04809040 admin admin] PATH_INFO: `/v3/projects/47f9a6b369c645e6b8cc4216374b303a/users/6c77bcaf1bd040678e9baa743607257b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.660197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fea711-a970-4d89-9365-6b1a04809040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f9a6b369c645e6b8cc4216374b303a, user_id=6c77bcaf1bd040678e9baa743607257b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.663464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fea711-a970-4d89-9365-6b1a04809040 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.684656 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1011/2034] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:14 2022] PUT /identity/v3/projects/47f9a6b369c645e6b8cc4216374b303a/users/6c77bcaf1bd040678e9baa743607257b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:14.686429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea711-a970-4d89-9365-6b1a04809040 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.706778 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:14.712497 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1024/2035] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:14 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:14.713606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be189dc8-4e6c-4799-ba70-89e278036e5a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.727732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be189dc8-4e6c-4799-ba70-89e278036e5a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.821967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fea711-a970-4d89-9365-6b1a04809040 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.828860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc39ef-9e08-49ed-8df6-4b0e1ff7ef09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.829118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda40395-a11b-411d-8c7d-73f60f919ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.829523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc39ef-9e08-49ed-8df6-4b0e1ff7ef09 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.829721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda40395-a11b-411d-8c7d-73f60f919ccd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.829862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc39ef-9e08-49ed-8df6-4b0e1ff7ef09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.829991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda40395-a11b-411d-8c7d-73f60f919ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.830149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdc39ef-9e08-49ed-8df6-4b0e1ff7ef09 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.830277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda40395-a11b-411d-8c7d-73f60f919ccd admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.830688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc39ef-9e08-49ed-8df6-4b0e1ff7ef09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.830954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda40395-a11b-411d-8c7d-73f60f919ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.832328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdc39ef-9e08-49ed-8df6-4b0e1ff7ef09 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.833052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda40395-a11b-411d-8c7d-73f60f919ccd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.846808 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1012/2036] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:14.847887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc39ef-9e08-49ed-8df6-4b0e1ff7ef09 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.860834 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1025/2037] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:14 2022] POST /identity/v3/users => generated 296 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:14.862181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda40395-a11b-411d-8c7d-73f60f919ccd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.862632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdc39ef-9e08-49ed-8df6-4b0e1ff7ef09 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.868125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff404df-d2fe-4d1c-80fb-15cbb1775489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.868737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff404df-d2fe-4d1c-80fb-15cbb1775489 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.869066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff404df-d2fe-4d1c-80fb-15cbb1775489 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.869481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff404df-d2fe-4d1c-80fb-15cbb1775489 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.870121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff404df-d2fe-4d1c-80fb-15cbb1775489 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.872287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff404df-d2fe-4d1c-80fb-15cbb1775489 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.874226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda40395-a11b-411d-8c7d-73f60f919ccd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.879257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d407ce-b98c-44ca-803e-1ee57f2cbfe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:14.880411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d407ce-b98c-44ca-803e-1ee57f2cbfe5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.880715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d407ce-b98c-44ca-803e-1ee57f2cbfe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.881017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d407ce-b98c-44ca-803e-1ee57f2cbfe5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.881701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d407ce-b98c-44ca-803e-1ee57f2cbfe5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:14.883504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d407ce-b98c-44ca-803e-1ee57f2cbfe5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:14.896629 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1026/2038] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:14.898141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d407ce-b98c-44ca-803e-1ee57f2cbfe5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:14.924450 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1013/2039] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:14 2022] POST /identity/v3/projects => generated 395 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:14.924655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d407ce-b98c-44ca-803e-1ee57f2cbfe5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:14.924771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0187-16bf-4320-9d48-b3deb00378ee None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:14.924771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0187-16bf-4320-9d48-b3deb00378ee None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:14.924771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d0187-16bf-4320-9d48-b3deb00378ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:14.939428 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:14.947698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-263d0187-16bf-4320-9d48-b3deb00378ee None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:14.950195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-263d0187-16bf-4320-9d48-b3deb00378ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:15.040274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9a8e2-85f2-41b5-bc90-4070fb86b9b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.041212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a8e2-85f2-41b5-bc90-4070fb86b9b6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.041698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a8e2-85f2-41b5-bc90-4070fb86b9b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.042119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba9a8e2-85f2-41b5-bc90-4070fb86b9b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.042919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9a8e2-85f2-41b5-bc90-4070fb86b9b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.043407 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1014/2040] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:15.044284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d0187-16bf-4320-9d48-b3deb00378ee None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.045438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba9a8e2-85f2-41b5-bc90-4070fb86b9b6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.045714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-263d0187-16bf-4320-9d48-b3deb00378ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:15.064567 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1027/2041] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:14 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:15.065884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9a8e2-85f2-41b5-bc90-4070fb86b9b6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.080386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba9a8e2-85f2-41b5-bc90-4070fb86b9b6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:15.093618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b66b8-0828-4cf1-bab9-dd3c7067ade0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.093618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b66b8-0828-4cf1-bab9-dd3c7067ade0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.093618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b66b8-0828-4cf1-bab9-dd3c7067ade0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.093618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b66b8-0828-4cf1-bab9-dd3c7067ade0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.094019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b66b8-0828-4cf1-bab9-dd3c7067ade0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.094019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b66b8-0828-4cf1-bab9-dd3c7067ade0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.109362 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1028/2042] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:15.110412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b66b8-0828-4cf1-bab9-dd3c7067ade0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.123766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b66b8-0828-4cf1-bab9-dd3c7067ade0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:15.131418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1bc8d-e845-4220-9d02-a572221cecb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.132412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1bc8d-e845-4220-9d02-a572221cecb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.132877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1bc8d-e845-4220-9d02-a572221cecb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.133376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd1bc8d-e845-4220-9d02-a572221cecb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.134721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1bc8d-e845-4220-9d02-a572221cecb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.137896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd1bc8d-e845-4220-9d02-a572221cecb6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.160327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1029/2043] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:15.160327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1bc8d-e845-4220-9d02-a572221cecb6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.170247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d0187-16bf-4320-9d48-b3deb00378ee None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:15.171603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd1bc8d-e845-4220-9d02-a572221cecb6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:15.177571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6b0dc-ac04-4549-9ac9-bbaf7d06cdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.178236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6b0dc-ac04-4549-9ac9-bbaf7d06cdcb admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.178518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6b0dc-ac04-4549-9ac9-bbaf7d06cdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.178669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7f408-0177-4e0c-91b5-e71261c2c523 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.178844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f6b0dc-ac04-4549-9ac9-bbaf7d06cdcb admin admin] PATH_INFO: `/v3/projects/ad4d1fc14f404932ab515a6a4c5a3048/users/cc0be0ed857d4c96b26724144e20d766/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.179200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7f408-0177-4e0c-91b5-e71261c2c523 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.179477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7f408-0177-4e0c-91b5-e71261c2c523 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.179744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc7f408-0177-4e0c-91b5-e71261c2c523 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.198065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6b0dc-ac04-4549-9ac9-bbaf7d06cdcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad4d1fc14f404932ab515a6a4c5a3048, user_id=cc0be0ed857d4c96b26724144e20d766, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.201065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f6b0dc-ac04-4549-9ac9-bbaf7d06cdcb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.208340 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:15.227462 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1030/2044] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:15 2022] PUT /identity/v3/projects/ad4d1fc14f404932ab515a6a4c5a3048/users/cc0be0ed857d4c96b26724144e20d766/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:15.234905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6b0dc-ac04-4549-9ac9-bbaf7d06cdcb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.272528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7f408-0177-4e0c-91b5-e71261c2c523 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.275134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc7f408-0177-4e0c-91b5-e71261c2c523 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.304404 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1015/2045] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:15 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:15.305678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7f408-0177-4e0c-91b5-e71261c2c523 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.307498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bbc7f408-0177-4e0c-91b5-e71261c2c523 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:15.443184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f6b0dc-ac04-4549-9ac9-bbaf7d06cdcb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:15.451310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdfb38-ba07-4371-a4cd-e7ebff9c37f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.452375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdfb38-ba07-4371-a4cd-e7ebff9c37f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.452874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdfb38-ba07-4371-a4cd-e7ebff9c37f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.453410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cdfb38-ba07-4371-a4cd-e7ebff9c37f3 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.454506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdfb38-ba07-4371-a4cd-e7ebff9c37f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.463891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cdfb38-ba07-4371-a4cd-e7ebff9c37f3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.543427 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1031/2046] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:15 2022] POST /identity/v3/users => generated 298 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:15.544701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdfb38-ba07-4371-a4cd-e7ebff9c37f3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.557233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc7f408-0177-4e0c-91b5-e71261c2c523 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:15.570327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cdfb38-ba07-4371-a4cd-e7ebff9c37f3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:15.591313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f50f-a953-44f3-984f-e809329a21e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.592807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f50f-a953-44f3-984f-e809329a21e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.593020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f50f-a953-44f3-984f-e809329a21e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.593525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0549f50f-a953-44f3-984f-e809329a21e3 admin admin] PATH_INFO: `/v3/projects/ea7b38ebd98c4cb7bbc02b5030fcf925/users/f8014c38830c46a6851b9938a6cc1cee/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.643737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549f50f-a953-44f3-984f-e809329a21e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7b38ebd98c4cb7bbc02b5030fcf925, user_id=f8014c38830c46a6851b9938a6cc1cee, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.647613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0549f50f-a953-44f3-984f-e809329a21e3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.687901 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1032/2047] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:15 2022] PUT /identity/v3/projects/ea7b38ebd98c4cb7bbc02b5030fcf925/users/f8014c38830c46a6851b9938a6cc1cee/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:15.692985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f50f-a953-44f3-984f-e809329a21e3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.717596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbf0da-8c5e-40a5-a6fa-43bd78553234 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.717596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf0da-8c5e-40a5-a6fa-43bd78553234 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.717596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf0da-8c5e-40a5-a6fa-43bd78553234 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.717596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbf0da-8c5e-40a5-a6fa-43bd78553234 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.736491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbf0da-8c5e-40a5-a6fa-43bd78553234 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.744572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbbf0da-8c5e-40a5-a6fa-43bd78553234 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.764328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1016/2048] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:15.767046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbf0da-8c5e-40a5-a6fa-43bd78553234 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.783022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbbf0da-8c5e-40a5-a6fa-43bd78553234 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:15.802813 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:15.874433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0549f50f-a953-44f3-984f-e809329a21e3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:15.883893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec03bb-5e68-4b0c-8f4a-6a0567090a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.885102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec03bb-5e68-4b0c-8f4a-6a0567090a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.885628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec03bb-5e68-4b0c-8f4a-6a0567090a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.886091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec03bb-5e68-4b0c-8f4a-6a0567090a7b admin admin] PATH_INFO: `/v3/projects/71587ea8e08641cfbcd7d2982ddb7cb6/users/4ee2164f10104ea59f18473880b1f939/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.905795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e08858-55aa-4e9b-a08f-c93add66b14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:15.906917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08858-55aa-4e9b-a08f-c93add66b14f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.907477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08858-55aa-4e9b-a08f-c93add66b14f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.908021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e08858-55aa-4e9b-a08f-c93add66b14f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.909417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e08858-55aa-4e9b-a08f-c93add66b14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.912921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e08858-55aa-4e9b-a08f-c93add66b14f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.923189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec03bb-5e68-4b0c-8f4a-6a0567090a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71587ea8e08641cfbcd7d2982ddb7cb6, user_id=4ee2164f10104ea59f18473880b1f939, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:15.930372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec03bb-5e68-4b0c-8f4a-6a0567090a7b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:15.935479 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1017/2049] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:15.937983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3921-ef0c-4d87-909f-175f94dbe26a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:15.938815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3921-ef0c-4d87-909f-175f94dbe26a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:15.938815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a3921-ef0c-4d87-909f-175f94dbe26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:15.951474 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1033/2050] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:15 2022] PUT /identity/v3/projects/71587ea8e08641cfbcd7d2982ddb7cb6/users/4ee2164f10104ea59f18473880b1f939/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:15.952121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec03bb-5e68-4b0c-8f4a-6a0567090a7b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:15.981179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-135a3921-ef0c-4d87-909f-175f94dbe26a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:15.983098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-135a3921-ef0c-4d87-909f-175f94dbe26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:16.005400 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:16.075338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec03bb-5e68-4b0c-8f4a-6a0567090a7b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:16.088599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485abc0-6dc7-4138-b09e-cb7dd93b9da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:16.090007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485abc0-6dc7-4138-b09e-cb7dd93b9da3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.093775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485abc0-6dc7-4138-b09e-cb7dd93b9da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.094295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f485abc0-6dc7-4138-b09e-cb7dd93b9da3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.095756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485abc0-6dc7-4138-b09e-cb7dd93b9da3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:16.099330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f485abc0-6dc7-4138-b09e-cb7dd93b9da3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:16.119452 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1018/2051] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:16.120372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3921-ef0c-4d87-909f-175f94dbe26a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:16.125547 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1034/2052] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:15 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:16.125547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485abc0-6dc7-4138-b09e-cb7dd93b9da3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:16.143458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f485abc0-6dc7-4138-b09e-cb7dd93b9da3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:16.146012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a3921-ef0c-4d87-909f-175f94dbe26a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:16.154302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37d679-5a43-4168-a4fc-4062f0432bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:16.154967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37d679-5a43-4168-a4fc-4062f0432bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.155275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37d679-5a43-4168-a4fc-4062f0432bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.155546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c37d679-5a43-4168-a4fc-4062f0432bc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.156223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37d679-5a43-4168-a4fc-4062f0432bc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:16.157909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c37d679-5a43-4168-a4fc-4062f0432bc9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:16.159764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:16.162206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.162678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.163160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] PATH_INFO: `/v3/users/ef6d87df863045b4bfa04f6bbec25d85` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.165346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef6d87df863045b4bfa04f6bbec25d85)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:16.170981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:16.177212 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1019/2053] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:16.177212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37d679-5a43-4168-a4fc-4062f0432bc9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:16.192211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c37d679-5a43-4168-a4fc-4062f0432bc9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:16.200157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc4424e-3196-406c-aad8-49e0840a70cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:16.201285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4424e-3196-406c-aad8-49e0840a70cc admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.201285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4424e-3196-406c-aad8-49e0840a70cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.201750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc4424e-3196-406c-aad8-49e0840a70cc admin admin] PATH_INFO: `/v3/projects/850d2e6fc93e4f08a9caa8a3ec616652/users/eed238809a6e4f909ad9a9611e8390e9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.230917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4424e-3196-406c-aad8-49e0840a70cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=850d2e6fc93e4f08a9caa8a3ec616652, user_id=eed238809a6e4f909ad9a9611e8390e9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:16.234879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc4424e-3196-406c-aad8-49e0840a70cc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:16.275915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef6d87df863045b4bfa04f6bbec25d85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:16.282735 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1020/2054] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:16 2022] PUT /identity/v3/projects/850d2e6fc93e4f08a9caa8a3ec616652/users/eed238809a6e4f909ad9a9611e8390e9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:16.284475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ad8c-54a7-47ff-bfe6-29106b79509b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.290471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ad8c-54a7-47ff-bfe6-29106b79509b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.290885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac2ad8c-54a7-47ff-bfe6-29106b79509b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.310995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef6d87df863045b4bfa04f6bbec25d85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:16.312348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef6d87df863045b4bfa04f6bbec25d85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:16.323080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef6d87df863045b4bfa04f6bbec25d85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:16.326872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6ac2ad8c-54a7-47ff-bfe6-29106b79509b None None] MFA Rules not processed for user `4ee2164f10104ea59f18473880b1f939`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:16.329610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6ac2ad8c-54a7-47ff-bfe6-29106b79509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:16.333867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef6d87df863045b4bfa04f6bbec25d85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:16.343159 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1035/2055] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:16 2022] DELETE /identity/v3/users/ef6d87df863045b4bfa04f6bbec25d85 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:16.344493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:16.346521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:16.393880 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:16.441700 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1021/2056] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:16.443570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2ad8c-54a7-47ff-bfe6-29106b79509b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:16.445026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6ac2ad8c-54a7-47ff-bfe6-29106b79509b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:16.467364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3a02e7-c40c-4ca2-93dc-b92f71634349 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:16.476231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c761504-13a6-471e-866e-38534041cce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:16.477733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c761504-13a6-471e-866e-38534041cce1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.478071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c761504-13a6-471e-866e-38534041cce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.478386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c761504-13a6-471e-866e-38534041cce1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.479243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c761504-13a6-471e-866e-38534041cce1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:16.482166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c761504-13a6-471e-866e-38534041cce1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:16.496610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1036/2057] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:16 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:16.498277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c761504-13a6-471e-866e-38534041cce1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:16.500179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6c761504-13a6-471e-866e-38534041cce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:16.519737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac2ad8c-54a7-47ff-bfe6-29106b79509b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:16.521361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c761504-13a6-471e-866e-38534041cce1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:16.530734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5844247-259d-40c6-bc62-dba3f0a4af7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:16.531768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5844247-259d-40c6-bc62-dba3f0a4af7a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.531768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5844247-259d-40c6-bc62-dba3f0a4af7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.532174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5844247-259d-40c6-bc62-dba3f0a4af7a admin admin] PATH_INFO: `/v3/projects/ea7b38ebd98c4cb7bbc02b5030fcf925/users/f8014c38830c46a6851b9938a6cc1cee/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.534621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5844247-259d-40c6-bc62-dba3f0a4af7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7b38ebd98c4cb7bbc02b5030fcf925, user_id=f8014c38830c46a6851b9938a6cc1cee, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:16.544247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5844247-259d-40c6-bc62-dba3f0a4af7a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:16.575686 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:16.599487 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1037/2058] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:16 2022] PUT /identity/v3/projects/ea7b38ebd98c4cb7bbc02b5030fcf925/users/f8014c38830c46a6851b9938a6cc1cee/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:16.604938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977d582-6882-43fc-8b15-f1592d903799 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.605249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977d582-6882-43fc-8b15-f1592d903799 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.605607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977d582-6882-43fc-8b15-f1592d903799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.658907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49107a9-0f24-49ee-b625-6a9bec842800 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:16.659542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49107a9-0f24-49ee-b625-6a9bec842800 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.659823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49107a9-0f24-49ee-b625-6a9bec842800 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.660096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49107a9-0f24-49ee-b625-6a9bec842800 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.663611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b49107a9-0f24-49ee-b625-6a9bec842800 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:16.677023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1977d582-6882-43fc-8b15-f1592d903799 None None] MFA Rules not processed for user `eed238809a6e4f909ad9a9611e8390e9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:16.678362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1977d582-6882-43fc-8b15-f1592d903799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:16.679137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49107a9-0f24-49ee-b625-6a9bec842800 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:16.682386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49107a9-0f24-49ee-b625-6a9bec842800 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:16.717654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1022/2059] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:16.729986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e85f4-4cfa-4fce-a93e-c7766cd332f2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.730407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e85f4-4cfa-4fce-a93e-c7766cd332f2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.730691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9e85f4-4cfa-4fce-a93e-c7766cd332f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.763435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8f9e85f4-4cfa-4fce-a93e-c7766cd332f2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:16.765078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f9e85f4-4cfa-4fce-a93e-c7766cd332f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:16.811580 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1038/2060] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:16.812564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977d582-6882-43fc-8b15-f1592d903799 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:16.814929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1977d582-6882-43fc-8b15-f1592d903799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:16.922784 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1023/2061] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:16.925561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e85f4-4cfa-4fce-a93e-c7766cd332f2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:16.944941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9e85f4-4cfa-4fce-a93e-c7766cd332f2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:16.960815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efb735-0e0e-43a6-a562-b8484409a73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:16.961743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efb735-0e0e-43a6-a562-b8484409a73a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.962208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efb735-0e0e-43a6-a562-b8484409a73a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.962560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71efb735-0e0e-43a6-a562-b8484409a73a admin admin] PATH_INFO: `/v3/projects/4bf7adacd2ba40e6b67fa07d8baefc4b/users/89ee4538fd234ed7b8137861bfb534d3/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.974653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977d582-6882-43fc-8b15-f1592d903799 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:16.987898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a0098-72cc-407a-8630-6fa777a9bbbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:16.990017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a0098-72cc-407a-8630-6fa777a9bbbf admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:16.990405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a0098-72cc-407a-8630-6fa777a9bbbf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:16.991497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a0098-72cc-407a-8630-6fa777a9bbbf admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:16.992814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a0098-72cc-407a-8630-6fa777a9bbbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:16.995420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a0098-72cc-407a-8630-6fa777a9bbbf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:16.997888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efb735-0e0e-43a6-a562-b8484409a73a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf7adacd2ba40e6b67fa07d8baefc4b, user_id=89ee4538fd234ed7b8137861bfb534d3, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.005408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71efb735-0e0e-43a6-a562-b8484409a73a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.034260 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1024/2062] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:16 2022] PUT /identity/v3/projects/4bf7adacd2ba40e6b67fa07d8baefc4b/users/89ee4538fd234ed7b8137861bfb534d3/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:17.035937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efb735-0e0e-43a6-a562-b8484409a73a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.038598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-71efb735-0e0e-43a6-a562-b8484409a73a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:17.056109 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1039/2063] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:16 2022] POST /identity/v3/projects => generated 375 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:17.057851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a0098-72cc-407a-8630-6fa777a9bbbf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.105658 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:17.204687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a0098-72cc-407a-8630-6fa777a9bbbf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:17.210319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142a0c75-7bf6-4e78-b5ec-58467a087201 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:17.211109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0c75-7bf6-4e78-b5ec-58467a087201 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.211702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0c75-7bf6-4e78-b5ec-58467a087201 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.212086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142a0c75-7bf6-4e78-b5ec-58467a087201 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.213679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71efb735-0e0e-43a6-a562-b8484409a73a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:17.330598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a0c75-7bf6-4e78-b5ec-58467a087201 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.336739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142a0c75-7bf6-4e78-b5ec-58467a087201 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.347783 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:17.364981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca7ae1-cbe4-410a-b622-a3de28f78f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:17.365954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca7ae1-cbe4-410a-b622-a3de28f78f4c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.366394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca7ae1-cbe4-410a-b622-a3de28f78f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.366674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dca7ae1-cbe4-410a-b622-a3de28f78f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.367326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca7ae1-cbe4-410a-b622-a3de28f78f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.368832 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1040/2064] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:17.369263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dca7ae1-cbe4-410a-b622-a3de28f78f4c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.378714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704496a4-f11f-4246-b595-266c2a336b3c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.379009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704496a4-f11f-4246-b595-266c2a336b3c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.379288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704496a4-f11f-4246-b595-266c2a336b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.440631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-704496a4-f11f-4246-b595-266c2a336b3c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:17.442205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-704496a4-f11f-4246-b595-266c2a336b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:17.462746 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1041/2065] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:17.464031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704496a4-f11f-4246-b595-266c2a336b3c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.475088 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1025/2066] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:17 2022] POST /identity/v3/projects => generated 391 bytes in 437 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:17.476185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca7ae1-cbe4-410a-b622-a3de28f78f4c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.492447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704496a4-f11f-4246-b595-266c2a336b3c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:17.587750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329657-027b-49c6-bd51-8ad2af44b68e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:17.588723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329657-027b-49c6-bd51-8ad2af44b68e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.589305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329657-027b-49c6-bd51-8ad2af44b68e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.589777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28329657-027b-49c6-bd51-8ad2af44b68e admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.592678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28329657-027b-49c6-bd51-8ad2af44b68e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.595401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28329657-027b-49c6-bd51-8ad2af44b68e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.635954 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1042/2067] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:17 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:17.637719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329657-027b-49c6-bd51-8ad2af44b68e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.659542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dca7ae1-cbe4-410a-b622-a3de28f78f4c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:17.671591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dbffa-efce-48b7-9551-ee37ce5098de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:17.673280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dbffa-efce-48b7-9551-ee37ce5098de admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.673676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dbffa-efce-48b7-9551-ee37ce5098de admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.673958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660dbffa-efce-48b7-9551-ee37ce5098de admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.674907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dbffa-efce-48b7-9551-ee37ce5098de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.678996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660dbffa-efce-48b7-9551-ee37ce5098de admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.719131 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1026/2068] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:17 2022] POST /identity/v3/users => generated 302 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:52:17.720176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dbffa-efce-48b7-9551-ee37ce5098de admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.736429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660dbffa-efce-48b7-9551-ee37ce5098de admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:17.742848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bb528-4563-414e-a844-012294949bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:17.743634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28329657-027b-49c6-bd51-8ad2af44b68e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:17.743857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bb528-4563-414e-a844-012294949bd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.744237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bb528-4563-414e-a844-012294949bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.745488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262bb528-4563-414e-a844-012294949bd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.747295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bb528-4563-414e-a844-012294949bd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.748178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021e22a-9a66-4c9b-989e-2eb894241a97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:17.748779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021e22a-9a66-4c9b-989e-2eb894241a97 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.749053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021e22a-9a66-4c9b-989e-2eb894241a97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.749435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021e22a-9a66-4c9b-989e-2eb894241a97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.750108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262bb528-4563-414e-a844-012294949bd7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.758570 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:17.768598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021e22a-9a66-4c9b-989e-2eb894241a97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.771114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021e22a-9a66-4c9b-989e-2eb894241a97 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.772462 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1027/2069] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:17.773747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bb528-4563-414e-a844-012294949bd7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.785643 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1043/2070] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:17.787276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262bb528-4563-414e-a844-012294949bd7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:17.787676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021e22a-9a66-4c9b-989e-2eb894241a97 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.792840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403e0d6-9714-4e75-ab08-1bcf4afbef07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:17.793730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e0d6-9714-4e75-ab08-1bcf4afbef07 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.794179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e0d6-9714-4e75-ab08-1bcf4afbef07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.794875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8403e0d6-9714-4e75-ab08-1bcf4afbef07 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.795694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403e0d6-9714-4e75-ab08-1bcf4afbef07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.798637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8403e0d6-9714-4e75-ab08-1bcf4afbef07 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.803016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021e22a-9a66-4c9b-989e-2eb894241a97 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:17.812174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0f951-b502-49a7-b409-b47e82f80c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:17.813005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0f951-b502-49a7-b409-b47e82f80c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.813388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0f951-b502-49a7-b409-b47e82f80c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.813747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0f951-b502-49a7-b409-b47e82f80c91 admin admin] PATH_INFO: `/v3/projects/875171786e3d4a9bba449f80b7d91c9c/users/e51b6737fc8540838f2535f02132d786/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.815071 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1028/2071] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:17.819384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403e0d6-9714-4e75-ab08-1bcf4afbef07 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.835796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8403e0d6-9714-4e75-ab08-1bcf4afbef07 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:17.843339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b3ea6-0a7a-44c5-a23b-dcf90d719da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:17.844244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b3ea6-0a7a-44c5-a23b-dcf90d719da2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:17.844326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0f951-b502-49a7-b409-b47e82f80c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875171786e3d4a9bba449f80b7d91c9c, user_id=e51b6737fc8540838f2535f02132d786, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.844508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b3ea6-0a7a-44c5-a23b-dcf90d719da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:17.845178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b3ea6-0a7a-44c5-a23b-dcf90d719da2 admin admin] PATH_INFO: `/v3/projects/c071400a03ec49f9b8aac6e240abef5d/users/c0ac53a627c848f8bb90f7b00c7a4eaa/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:17.855425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad0f951-b502-49a7-b409-b47e82f80c91 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.875236 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1044/2072] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:17 2022] PUT /identity/v3/projects/875171786e3d4a9bba449f80b7d91c9c/users/e51b6737fc8540838f2535f02132d786/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:17.881081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0f951-b502-49a7-b409-b47e82f80c91 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:17.885025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b3ea6-0a7a-44c5-a23b-dcf90d719da2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c071400a03ec49f9b8aac6e240abef5d, user_id=c0ac53a627c848f8bb90f7b00c7a4eaa, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:17.892135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6b3ea6-0a7a-44c5-a23b-dcf90d719da2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:17.929327 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1029/2073] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:17 2022] PUT /identity/v3/projects/c071400a03ec49f9b8aac6e240abef5d/users/c0ac53a627c848f8bb90f7b00c7a4eaa/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:17.934667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b3ea6-0a7a-44c5-a23b-dcf90d719da2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:18.025260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad0f951-b502-49a7-b409-b47e82f80c91 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:18.051550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6b3ea6-0a7a-44c5-a23b-dcf90d719da2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:18.072216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b2905-f839-49d7-805a-05e69e53c7db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:18.073001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b2905-f839-49d7-805a-05e69e53c7db admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.073866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b2905-f839-49d7-805a-05e69e53c7db admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.075676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b2905-f839-49d7-805a-05e69e53c7db admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.077524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b2905-f839-49d7-805a-05e69e53c7db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:18.080329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097b2905-f839-49d7-805a-05e69e53c7db admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:18.107538 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1030/2074] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:18.118386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b2905-f839-49d7-805a-05e69e53c7db admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:18.139877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b2905-f839-49d7-805a-05e69e53c7db admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:18.145064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf0fac-0897-452c-8ee0-1f7576a04c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:18.146971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf0fac-0897-452c-8ee0-1f7576a04c80 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.147758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c2b512-dbce-4fea-a82d-e95cd6b684e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:18.147912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf0fac-0897-452c-8ee0-1f7576a04c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.148224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaf0fac-0897-452c-8ee0-1f7576a04c80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.148644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2b512-dbce-4fea-a82d-e95cd6b684e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.148833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf0fac-0897-452c-8ee0-1f7576a04c80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:18.149598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2b512-dbce-4fea-a82d-e95cd6b684e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.149598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c2b512-dbce-4fea-a82d-e95cd6b684e5 admin admin] PATH_INFO: `/v3/projects/c071400a03ec49f9b8aac6e240abef5d/users/c0ac53a627c848f8bb90f7b00c7a4eaa/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.150625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaf0fac-0897-452c-8ee0-1f7576a04c80 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:18.153496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2b512-dbce-4fea-a82d-e95cd6b684e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c071400a03ec49f9b8aac6e240abef5d, user_id=c0ac53a627c848f8bb90f7b00c7a4eaa, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:18.156278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c2b512-dbce-4fea-a82d-e95cd6b684e5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:18.169260 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1045/2075] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:17 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:18.171660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf0fac-0897-452c-8ee0-1f7576a04c80 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:18.194556 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1031/2076] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:18 2022] PUT /identity/v3/projects/c071400a03ec49f9b8aac6e240abef5d/users/c0ac53a627c848f8bb90f7b00c7a4eaa/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:18.196022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d30d3-2403-4066-a28e-084706b5328b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.196561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d30d3-2403-4066-a28e-084706b5328b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.197040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d30d3-2403-4066-a28e-084706b5328b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.210270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaf0fac-0897-452c-8ee0-1f7576a04c80 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:18.226566 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:18.261981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-eb3d30d3-2403-4066-a28e-084706b5328b None None] MFA Rules not processed for user `c0ac53a627c848f8bb90f7b00c7a4eaa`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:18.263546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eb3d30d3-2403-4066-a28e-084706b5328b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:18.309742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745da865-eb9a-434b-9479-79fa21114816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:18.310505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da865-eb9a-434b-9479-79fa21114816 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.310794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da865-eb9a-434b-9479-79fa21114816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.311105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745da865-eb9a-434b-9479-79fa21114816 admin admin] PATH_INFO: `/v3/projects/875171786e3d4a9bba449f80b7d91c9c/users/e51b6737fc8540838f2535f02132d786/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.314261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745da865-eb9a-434b-9479-79fa21114816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=875171786e3d4a9bba449f80b7d91c9c, user_id=e51b6737fc8540838f2535f02132d786, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:18.317879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745da865-eb9a-434b-9479-79fa21114816 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:18.335257 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1046/2077] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:18 2022] PUT /identity/v3/projects/875171786e3d4a9bba449f80b7d91c9c/users/e51b6737fc8540838f2535f02132d786/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:18.352869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f50d-84ab-4dc3-b226-53dddf7b58c0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.353981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f50d-84ab-4dc3-b226-53dddf7b58c0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.354348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a4f50d-84ab-4dc3-b226-53dddf7b58c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.381288 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:18.404391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-13a4f50d-84ab-4dc3-b226-53dddf7b58c0 None None] MFA Rules not processed for user `e51b6737fc8540838f2535f02132d786`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:18.406121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-13a4f50d-84ab-4dc3-b226-53dddf7b58c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:18.409975 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1032/2078] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:18.430916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d30d3-2403-4066-a28e-084706b5328b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:18.448866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3d30d3-2403-4066-a28e-084706b5328b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:18.572262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:18.572835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.573117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.573426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] PATH_INFO: `/v3/users/eed238809a6e4f909ad9a9611e8390e9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.576140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eed238809a6e4f909ad9a9611e8390e9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:18.585076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:18.597986 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1047/2079] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:18.616425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4f50d-84ab-4dc3-b226-53dddf7b58c0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:18.617895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-13a4f50d-84ab-4dc3-b226-53dddf7b58c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:18.688384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eed238809a6e4f909ad9a9611e8390e9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:18.721260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eed238809a6e4f909ad9a9611e8390e9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:18.724203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eed238809a6e4f909ad9a9611e8390e9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:18.742324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eed238809a6e4f909ad9a9611e8390e9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:18.760661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9354c216-294a-49b0-bc16-61b36330faf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eed238809a6e4f909ad9a9611e8390e9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:18.786180 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1033/2080] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:18 2022] DELETE /identity/v3/users/eed238809a6e4f909ad9a9611e8390e9 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:18.792116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281185c5-c0c8-4040-85fb-f2d141aadbc7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.792402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281185c5-c0c8-4040-85fb-f2d141aadbc7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.792745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281185c5-c0c8-4040-85fb-f2d141aadbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.812312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a4f50d-84ab-4dc3-b226-53dddf7b58c0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:18.840048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-281185c5-c0c8-4040-85fb-f2d141aadbc7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:18.844604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-281185c5-c0c8-4040-85fb-f2d141aadbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:18.862408 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:18.972673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:18.975216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:18.975725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:18.976687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:18.981819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:18.999693 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1034/2081] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:19.065553 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:19.067995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281185c5-c0c8-4040-85fb-f2d141aadbc7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:19.072861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-281185c5-c0c8-4040-85fb-f2d141aadbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:19.175546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:19.177244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:19.219787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281185c5-c0c8-4040-85fb-f2d141aadbc7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:19.225436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57878de7-795d-4707-bb55-c78dff61f8c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:19.226478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57878de7-795d-4707-bb55-c78dff61f8c2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:19.226916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57878de7-795d-4707-bb55-c78dff61f8c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:19.227200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57878de7-795d-4707-bb55-c78dff61f8c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:19.228039 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1048/2082] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:18 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 612 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:19.239140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57878de7-795d-4707-bb55-c78dff61f8c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:19.240961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57878de7-795d-4707-bb55-c78dff61f8c2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:19.275425 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1035/2083] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:19.293410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:19.295114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:19.319402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06709fb-179d-4976-8025-1fa7563d55cc service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:19.334769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b844d19f-1fad-4cc2-9801-5e614dfc2b12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:19.335586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844d19f-1fad-4cc2-9801-5e614dfc2b12 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:19.336056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844d19f-1fad-4cc2-9801-5e614dfc2b12 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:19.336478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b844d19f-1fad-4cc2-9801-5e614dfc2b12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:19.342429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b844d19f-1fad-4cc2-9801-5e614dfc2b12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:19.501646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844d19f-1fad-4cc2-9801-5e614dfc2b12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:19.503803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b844d19f-1fad-4cc2-9801-5e614dfc2b12 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:19.525147 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1049/2084] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:52:19.635260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57878de7-795d-4707-bb55-c78dff61f8c2 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:19.638511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57878de7-795d-4707-bb55-c78dff61f8c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:19.666959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57878de7-795d-4707-bb55-c78dff61f8c2 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:19.674869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:19.677047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:19.678265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:19.678665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] PATH_INFO: `/v3/projects/7d67aceff3f74eb09e51d10c4a2c2c34` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:19.680186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d67aceff3f74eb09e51d10c4a2c2c34)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:19.682647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:19.813050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d67aceff3f74eb09e51d10c4a2c2c34', 'request_id': 'req-f05e5196-3829-43a2-84d7-f7e4ed1faf27'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:19.825796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d67aceff3f74eb09e51d10c4a2c2c34', 'request_id': 'req-f05e5196-3829-43a2-84d7-f7e4ed1faf27'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:19.847344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d67aceff3f74eb09e51d10c4a2c2c34', 'request_id': 'req-f05e5196-3829-43a2-84d7-f7e4ed1faf27'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:19.875508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] The token cache is being invalidate because project 7d67aceff3f74eb09e51d10c4a2c2c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:19.875810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:19.876556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:19.879402 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1036/2085] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:19 2022] DELETE /identity/v3/projects/7d67aceff3f74eb09e51d10c4a2c2c34 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:19.886215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d289a-4a62-4623-a56a-74be25ecf709 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:19.886712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d289a-4a62-4623-a56a-74be25ecf709 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:19.886898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d289a-4a62-4623-a56a-74be25ecf709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:19.931458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:19.933871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:19.953566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0c7d289a-4a62-4623-a56a-74be25ecf709 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:19.957130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0c7d289a-4a62-4623-a56a-74be25ecf709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:20.096590 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:20.137090 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1050/2086] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:20.138628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e5196-3829-43a2-84d7-f7e4ed1faf27 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:20.138939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070a03b-ea2c-4a7b-a066-0fc6de3c5054 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:20.139350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070a03b-ea2c-4a7b-a066-0fc6de3c5054 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:20.139753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070a03b-ea2c-4a7b-a066-0fc6de3c5054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:20.145520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:20.146099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:20.146434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:20.146703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] PATH_INFO: `/v3/users/4ee2164f10104ea59f18473880b1f939` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:20.147948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ee2164f10104ea59f18473880b1f939)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:20.149983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:20.232769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d070a03b-ea2c-4a7b-a066-0fc6de3c5054 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:20.237538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d070a03b-ea2c-4a7b-a066-0fc6de3c5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:20.265380 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1051/2087] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:20.266040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070a03b-ea2c-4a7b-a066-0fc6de3c5054 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:20.268765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d070a03b-ea2c-4a7b-a066-0fc6de3c5054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:20.273573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ee2164f10104ea59f18473880b1f939'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.303102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ee2164f10104ea59f18473880b1f939'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.305362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ee2164f10104ea59f18473880b1f939'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.306262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070a03b-ea2c-4a7b-a066-0fc6de3c5054 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:20.314342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:20.315178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:20.315471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:20.315755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] PATH_INFO: `/v3/projects/850d2e6fc93e4f08a9caa8a3ec616652` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:20.325839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] RBAC: Authorizing `identity:delete_project(project_id=850d2e6fc93e4f08a9caa8a3ec616652)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:20.328052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:20.328545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ee2164f10104ea59f18473880b1f939'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.354137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ee2164f10104ea59f18473880b1f939'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.375710 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1037/2088] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:19 2022] DELETE /identity/v3/users/4ee2164f10104ea59f18473880b1f939 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:20.378827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:20.383422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:20.449201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '850d2e6fc93e4f08a9caa8a3ec616652', 'request_id': 'req-3699b18b-6018-46d0-ba06-dd6dd8233609'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.452470 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:20.470995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '850d2e6fc93e4f08a9caa8a3ec616652', 'request_id': 'req-3699b18b-6018-46d0-ba06-dd6dd8233609'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.490992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '850d2e6fc93e4f08a9caa8a3ec616652', 'request_id': 'req-3699b18b-6018-46d0-ba06-dd6dd8233609'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.526292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] The token cache is being invalidate because project 850d2e6fc93e4f08a9caa8a3ec616652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:20.527357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.529719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3699b18b-6018-46d0-ba06-dd6dd8233609 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.533958 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1052/2089] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:20 2022] DELETE /identity/v3/projects/850d2e6fc93e4f08a9caa8a3ec616652 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:20.536780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc07fa-6994-4127-94ad-9c9547b6ddaa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:20.538067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc07fa-6994-4127-94ad-9c9547b6ddaa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:20.539977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc07fa-6994-4127-94ad-9c9547b6ddaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:20.574553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb2e4bd-d020-4883-989b-e4d98ed0bfc0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:20.591199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-49fc07fa-6994-4127-94ad-9c9547b6ddaa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:20.592640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-49fc07fa-6994-4127-94ad-9c9547b6ddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:20.711988 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1053/2090] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:20.715750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc07fa-6994-4127-94ad-9c9547b6ddaa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:20.717382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-49fc07fa-6994-4127-94ad-9c9547b6ddaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:20.734792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc07fa-6994-4127-94ad-9c9547b6ddaa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:20.738444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:20.739101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:20.740145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:20.740585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:20.740994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:20.741508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:20.742621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:20.744485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:20.748110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:20.748547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:20.748906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] PATH_INFO: `/v3/users/c0ac53a627c848f8bb90f7b00c7a4eaa` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:20.750731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0ac53a627c848f8bb90f7b00c7a4eaa)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:20.753814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:20.759504 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:20.782101 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1038/2091] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:20.782968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:20.789232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:20.872636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0ac53a627c848f8bb90f7b00c7a4eaa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.917557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0ac53a627c848f8bb90f7b00c7a4eaa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.919181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0ac53a627c848f8bb90f7b00c7a4eaa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.922211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2f377b-6f8e-4b49-af0c-64018081f9ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:20.932538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eba786-d11c-490a-8b4b-3cc7416953cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:20.933777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eba786-d11c-490a-8b4b-3cc7416953cd service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:20.934293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eba786-d11c-490a-8b4b-3cc7416953cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:20.934781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eba786-d11c-490a-8b4b-3cc7416953cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:20.936948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b5eba786-d11c-490a-8b4b-3cc7416953cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:20.941351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0ac53a627c848f8bb90f7b00c7a4eaa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.978801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0ac53a627c848f8bb90f7b00c7a4eaa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:20.990931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eba786-d11c-490a-8b4b-3cc7416953cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:20.993758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eba786-d11c-490a-8b4b-3cc7416953cd service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:21.005715 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1054/2092] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:20 2022] DELETE /identity/v3/users/c0ac53a627c848f8bb90f7b00c7a4eaa => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:21.005715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:21.008300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:21.015892 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1039/2093] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:21.105828 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:21.144268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ede075-9b4a-4893-8dff-d334571e68d5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:21.158040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c747999-e3c8-461f-a316-216a4ee1da0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:21.159555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c747999-e3c8-461f-a316-216a4ee1da0a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:21.159871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c747999-e3c8-461f-a316-216a4ee1da0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:21.164103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c747999-e3c8-461f-a316-216a4ee1da0a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:21.166634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c747999-e3c8-461f-a316-216a4ee1da0a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:21.170920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c747999-e3c8-461f-a316-216a4ee1da0a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:21.268300 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1055/2094] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:21 2022] POST /identity/v3/projects => generated 377 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:21.269736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eba786-d11c-490a-8b4b-3cc7416953cd service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:21.286659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eba786-d11c-490a-8b4b-3cc7416953cd service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:21.391139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d77aed-a6fe-459f-9b1e-250bd96b10e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:21.391798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d77aed-a6fe-459f-9b1e-250bd96b10e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:21.392076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d77aed-a6fe-459f-9b1e-250bd96b10e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:21.392344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d77aed-a6fe-459f-9b1e-250bd96b10e9 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:21.393729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d77aed-a6fe-459f-9b1e-250bd96b10e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:21.396808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d77aed-a6fe-459f-9b1e-250bd96b10e9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:21.448042 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1040/2095] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:21 2022] POST /identity/v3/users => generated 289 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:52:21.451404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c747999-e3c8-461f-a316-216a4ee1da0a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:21.486328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c747999-e3c8-461f-a316-216a4ee1da0a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:21.503563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4440f34-094a-4fcd-82e4-8973fc3c1046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:21.504128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4440f34-094a-4fcd-82e4-8973fc3c1046 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:21.504662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4440f34-094a-4fcd-82e4-8973fc3c1046 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:21.504939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4440f34-094a-4fcd-82e4-8973fc3c1046 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:21.505753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4440f34-094a-4fcd-82e4-8973fc3c1046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:21.508065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4440f34-094a-4fcd-82e4-8973fc3c1046 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:21.540999 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1056/2096] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:21.545191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d77aed-a6fe-459f-9b1e-250bd96b10e9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:21.562050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d77aed-a6fe-459f-9b1e-250bd96b10e9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:21.576191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99da7ac5-c224-4c1e-a320-2de55d2f8c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:21.578388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7ac5-c224-4c1e-a320-2de55d2f8c8a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:21.580860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7ac5-c224-4c1e-a320-2de55d2f8c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:21.581195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99da7ac5-c224-4c1e-a320-2de55d2f8c8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:21.583184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da7ac5-c224-4c1e-a320-2de55d2f8c8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:21.589456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99da7ac5-c224-4c1e-a320-2de55d2f8c8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:21.626283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4440f34-094a-4fcd-82e4-8973fc3c1046 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:21.626844 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1041/2097] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:21.647628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4440f34-094a-4fcd-82e4-8973fc3c1046 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:21.655467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c780fd-a21a-43f7-baae-562b42b62221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:21.656033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c780fd-a21a-43f7-baae-562b42b62221 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:21.656317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c780fd-a21a-43f7-baae-562b42b62221 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:21.656587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c780fd-a21a-43f7-baae-562b42b62221 admin admin] PATH_INFO: `/v3/projects/96ab82000972421c96022c2711beb014/users/c2b9360313da41e1905c695c37020876/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:21.701162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c780fd-a21a-43f7-baae-562b42b62221 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96ab82000972421c96022c2711beb014, user_id=c2b9360313da41e1905c695c37020876, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:21.713554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c780fd-a21a-43f7-baae-562b42b62221 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:21.757363 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1057/2098] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:21 2022] PUT /identity/v3/projects/96ab82000972421c96022c2711beb014/users/c2b9360313da41e1905c695c37020876/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:52:21.769092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc683c9-4041-485c-91aa-9b5581c56941 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:21.769717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc683c9-4041-485c-91aa-9b5581c56941 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:21.770890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc683c9-4041-485c-91aa-9b5581c56941 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:21.846176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bdc683c9-4041-485c-91aa-9b5581c56941 None None] MFA Rules not processed for user `c2b9360313da41e1905c695c37020876`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:21.850760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bdc683c9-4041-485c-91aa-9b5581c56941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:21.952149 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1042/2099] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:21.962678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4438-0970-4555-9d8d-54c500f1a671 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:21.963220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4438-0970-4555-9d8d-54c500f1a671 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:21.963220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af4438-0970-4555-9d8d-54c500f1a671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:21.990071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-75af4438-0970-4555-9d8d-54c500f1a671 None None] MFA Rules not processed for user `c2b9360313da41e1905c695c37020876`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:21.991569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75af4438-0970-4555-9d8d-54c500f1a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:22.007082 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1058/2100] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:22.021707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc683c9-4041-485c-91aa-9b5581c56941 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:22.023809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bdc683c9-4041-485c-91aa-9b5581c56941 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:22.040013 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:22.160107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc683c9-4041-485c-91aa-9b5581c56941 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:22.172579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb291e7-546b-42d9-88ff-99fbdb2446a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:22.173629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb291e7-546b-42d9-88ff-99fbdb2446a8 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:22.173907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb291e7-546b-42d9-88ff-99fbdb2446a8 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:22.174224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb291e7-546b-42d9-88ff-99fbdb2446a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:22.186090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb291e7-546b-42d9-88ff-99fbdb2446a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:22.187875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb291e7-546b-42d9-88ff-99fbdb2446a8 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:22.201824 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1043/2101] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:52:23.004063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af4438-0970-4555-9d8d-54c500f1a671 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:23.007763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75af4438-0970-4555-9d8d-54c500f1a671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:23.170729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb291e7-546b-42d9-88ff-99fbdb2446a8 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:23.173040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7fb291e7-546b-42d9-88ff-99fbdb2446a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:23.231910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af4438-0970-4555-9d8d-54c500f1a671 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:23.250055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:23.251058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:23.251485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:23.251858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] PATH_INFO: `/v3/projects/71587ea8e08641cfbcd7d2982ddb7cb6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:23.254816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71587ea8e08641cfbcd7d2982ddb7cb6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:23.265120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:23.326549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb291e7-546b-42d9-88ff-99fbdb2446a8 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:23.337600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:23.342089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:23.342689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:23.344163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] PATH_INFO: `/v3/projects/c071400a03ec49f9b8aac6e240abef5d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:23.352789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c071400a03ec49f9b8aac6e240abef5d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:23.367752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:23.372634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71587ea8e08641cfbcd7d2982ddb7cb6', 'request_id': 'req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.385535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71587ea8e08641cfbcd7d2982ddb7cb6', 'request_id': 'req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.402480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71587ea8e08641cfbcd7d2982ddb7cb6', 'request_id': 'req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.432102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] The token cache is being invalidate because project 71587ea8e08641cfbcd7d2982ddb7cb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:23.432644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.436007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.442560 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1059/2102] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:23 2022] DELETE /identity/v3/projects/71587ea8e08641cfbcd7d2982ddb7cb6 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:23.448596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:23.455373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:23.518836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c071400a03ec49f9b8aac6e240abef5d', 'request_id': 'req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.533189 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:23.542143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c071400a03ec49f9b8aac6e240abef5d', 'request_id': 'req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.569554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c071400a03ec49f9b8aac6e240abef5d', 'request_id': 'req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.600447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] The token cache is being invalidate because project c071400a03ec49f9b8aac6e240abef5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:23.600740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.604836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6afcf2a0-2ca0-49ab-91ab-e91824e58e00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:23.615624 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1044/2103] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:23 2022] DELETE /identity/v3/projects/c071400a03ec49f9b8aac6e240abef5d => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:23.620882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761a7bd-3465-4f32-91a2-958c3731030a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:23.621167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761a7bd-3465-4f32-91a2-958c3731030a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:23.621471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761a7bd-3465-4f32-91a2-958c3731030a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:23.643652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b57224-fd8e-46a4-b042-9b0aa441a9d4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:23.677441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9761a7bd-3465-4f32-91a2-958c3731030a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:23.678970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9761a7bd-3465-4f32-91a2-958c3731030a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:23.731823 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:23.821644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:23.822313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:23.822597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:23.822874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] PATH_INFO: `/v3/users/e51b6737fc8540838f2535f02132d786` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:23.828685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e51b6737fc8540838f2535f02132d786)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:23.830777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:23.887835 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1045/2104] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:23.892734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859cfe7-179e-45f8-b82c-055d7c875702 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:23.894020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859cfe7-179e-45f8-b82c-055d7c875702 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:23.896488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4859cfe7-179e-45f8-b82c-055d7c875702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:23.970368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4859cfe7-179e-45f8-b82c-055d7c875702 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:23.971849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4859cfe7-179e-45f8-b82c-055d7c875702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:23.972100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e51b6737fc8540838f2535f02132d786'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:24.001974 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1046/2105] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:24.007867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859cfe7-179e-45f8-b82c-055d7c875702 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:24.018419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e51b6737fc8540838f2535f02132d786'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:24.025914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e51b6737fc8540838f2535f02132d786'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:24.039552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e51b6737fc8540838f2535f02132d786'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:24.069278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4859cfe7-179e-45f8-b82c-055d7c875702 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:24.078110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e51b6737fc8540838f2535f02132d786'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:24.111376 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1060/2106] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:23 2022] DELETE /identity/v3/users/e51b6737fc8540838f2535f02132d786 => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:24.113567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5dbc-ee9c-44b9-9e07-7aaf5f9678ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:24.122934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5dbc-ee9c-44b9-9e07-7aaf5f9678ed admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:24.123452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5dbc-ee9c-44b9-9e07-7aaf5f9678ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:24.123952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424a5dbc-ee9c-44b9-9e07-7aaf5f9678ed admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:24.129956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5dbc-ee9c-44b9-9e07-7aaf5f9678ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:24.130556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5dbc-ee9c-44b9-9e07-7aaf5f9678ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:24.133926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424a5dbc-ee9c-44b9-9e07-7aaf5f9678ed admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:24.188496 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1047/2107] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:24.194363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:24.197738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:24.458361 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:24.504582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc9e582-10d2-4865-a24a-e8d67e4a3896 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:24.522148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399129-6c87-4fb6-a598-eacfb6d1b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:24.523764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399129-6c87-4fb6-a598-eacfb6d1b978 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:24.524212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399129-6c87-4fb6-a598-eacfb6d1b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:24.524966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b399129-6c87-4fb6-a598-eacfb6d1b978 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:24.526715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b399129-6c87-4fb6-a598-eacfb6d1b978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:24.532325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b399129-6c87-4fb6-a598-eacfb6d1b978 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:24.589359 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1061/2108] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:24 2022] POST /identity/v3/projects => generated 383 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:24.591356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5dbc-ee9c-44b9-9e07-7aaf5f9678ed admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:24.611940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424a5dbc-ee9c-44b9-9e07-7aaf5f9678ed admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:24.735225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a490a5d-8705-4b68-b4bb-4290306cc171 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:24.737330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a490a5d-8705-4b68-b4bb-4290306cc171 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:24.737805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a490a5d-8705-4b68-b4bb-4290306cc171 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:24.738200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a490a5d-8705-4b68-b4bb-4290306cc171 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:24.739143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a490a5d-8705-4b68-b4bb-4290306cc171 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:24.742598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a490a5d-8705-4b68-b4bb-4290306cc171 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:24.813964 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1048/2109] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:24 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:24.815850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399129-6c87-4fb6-a598-eacfb6d1b978 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:24.834068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b399129-6c87-4fb6-a598-eacfb6d1b978 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:24.845112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6ecb2-547b-48af-a595-acf9fa7741cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:24.846306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6ecb2-547b-48af-a595-acf9fa7741cb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:24.846998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6ecb2-547b-48af-a595-acf9fa7741cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:24.847721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b6ecb2-547b-48af-a595-acf9fa7741cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:24.849867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6ecb2-547b-48af-a595-acf9fa7741cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:24.853375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b6ecb2-547b-48af-a595-acf9fa7741cb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:24.890380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a490a5d-8705-4b68-b4bb-4290306cc171 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:24.895939 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1062/2110] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:24.907281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a490a5d-8705-4b68-b4bb-4290306cc171 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:24.917672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdbb06e-99de-47c7-b3f0-a7c338088123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:24.918307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb06e-99de-47c7-b3f0-a7c338088123 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:24.918591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb06e-99de-47c7-b3f0-a7c338088123 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:24.918868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdbb06e-99de-47c7-b3f0-a7c338088123 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:24.919586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb06e-99de-47c7-b3f0-a7c338088123 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:24.921238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdbb06e-99de-47c7-b3f0-a7c338088123 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:24.947234 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1049/2111] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:24.956864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6ecb2-547b-48af-a595-acf9fa7741cb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:24.997127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b6ecb2-547b-48af-a595-acf9fa7741cb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:25.021076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efa12e-f86d-40a8-93bf-2f0bd699746a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:25.022925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efa12e-f86d-40a8-93bf-2f0bd699746a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:25.023350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efa12e-f86d-40a8-93bf-2f0bd699746a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:25.024716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efa12e-f86d-40a8-93bf-2f0bd699746a admin admin] PATH_INFO: `/v3/projects/1e13dc7c48364c7a90f2b82b36d70992/users/84715f01a99a40f1b6d8866cfb8c5e31/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:25.075465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efa12e-f86d-40a8-93bf-2f0bd699746a admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e13dc7c48364c7a90f2b82b36d70992, user_id=84715f01a99a40f1b6d8866cfb8c5e31, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:25.080007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efa12e-f86d-40a8-93bf-2f0bd699746a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:25.114963 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1063/2112] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:24 2022] PUT /identity/v3/projects/1e13dc7c48364c7a90f2b82b36d70992/users/84715f01a99a40f1b6d8866cfb8c5e31/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:25.129535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416f4b-a45a-491a-bd4e-020817623419 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:25.129820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416f4b-a45a-491a-bd4e-020817623419 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:25.133015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4416f4b-a45a-491a-bd4e-020817623419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:25.261634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c4416f4b-a45a-491a-bd4e-020817623419 None None] MFA Rules not processed for user `84715f01a99a40f1b6d8866cfb8c5e31`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:25.269188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c4416f4b-a45a-491a-bd4e-020817623419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:25.493016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efa12e-f86d-40a8-93bf-2f0bd699746a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:25.495458 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1050/2113] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:25.700639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efa12e-f86d-40a8-93bf-2f0bd699746a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:25.719410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610ab65-25ec-4f44-99db-92a28942b986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:25.720436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610ab65-25ec-4f44-99db-92a28942b986 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:25.721022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610ab65-25ec-4f44-99db-92a28942b986 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:25.721717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2610ab65-25ec-4f44-99db-92a28942b986 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:25.722694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610ab65-25ec-4f44-99db-92a28942b986 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:25.728638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2610ab65-25ec-4f44-99db-92a28942b986 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:25.794340 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1064/2114] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:25 2022] POST /identity/v3/projects => generated 383 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:25.803866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4416f4b-a45a-491a-bd4e-020817623419 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:25.868028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4416f4b-a45a-491a-bd4e-020817623419 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:25.927264 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:26.050355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09badcff-7992-4ea7-a0d2-4c8506d67ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:26.052039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09badcff-7992-4ea7-a0d2-4c8506d67ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:26.052480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09badcff-7992-4ea7-a0d2-4c8506d67ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:26.053558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09badcff-7992-4ea7-a0d2-4c8506d67ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:26.054566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09badcff-7992-4ea7-a0d2-4c8506d67ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:26.064380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09badcff-7992-4ea7-a0d2-4c8506d67ca8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:26.099286 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1051/2115] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:25 2022] POST /identity/v3/users => generated 298 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:26.101317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610ab65-25ec-4f44-99db-92a28942b986 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:26.116559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2610ab65-25ec-4f44-99db-92a28942b986 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:26.122686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8ec9a-82f1-46ca-91cd-d22893d13631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:26.125281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8ec9a-82f1-46ca-91cd-d22893d13631 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:26.128388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8ec9a-82f1-46ca-91cd-d22893d13631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:26.129964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d8ec9a-82f1-46ca-91cd-d22893d13631 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:26.130704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8ec9a-82f1-46ca-91cd-d22893d13631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:26.137832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d8ec9a-82f1-46ca-91cd-d22893d13631 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:26.171365 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1065/2116] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:26.176795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09badcff-7992-4ea7-a0d2-4c8506d67ca8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:26.193076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09badcff-7992-4ea7-a0d2-4c8506d67ca8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:26.217427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b51ed6-3c0a-4da8-a442-6e3f5808ad38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:26.218317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b51ed6-3c0a-4da8-a442-6e3f5808ad38 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:26.218608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b51ed6-3c0a-4da8-a442-6e3f5808ad38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:26.218893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b51ed6-3c0a-4da8-a442-6e3f5808ad38 admin admin] PATH_INFO: `/v3/projects/52cded16f4124c3f8436a2b342d62e43/users/47831ace16344f36ac6c15605f323ef7/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:26.264983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b51ed6-3c0a-4da8-a442-6e3f5808ad38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cded16f4124c3f8436a2b342d62e43, user_id=47831ace16344f36ac6c15605f323ef7, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:26.274501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b51ed6-3c0a-4da8-a442-6e3f5808ad38 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:26.316171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8ec9a-82f1-46ca-91cd-d22893d13631 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:26.319296 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1052/2117] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:26 2022] PUT /identity/v3/projects/52cded16f4124c3f8436a2b342d62e43/users/47831ace16344f36ac6c15605f323ef7/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:26.340599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d8ec9a-82f1-46ca-91cd-d22893d13631 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:26.511499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb2a4d-43ec-4c20-91ff-714b93ccfe21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:26.512136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb2a4d-43ec-4c20-91ff-714b93ccfe21 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:26.512915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb2a4d-43ec-4c20-91ff-714b93ccfe21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:26.513198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb2a4d-43ec-4c20-91ff-714b93ccfe21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:26.516573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb2a4d-43ec-4c20-91ff-714b93ccfe21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:26.518299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4eb2a4d-43ec-4c20-91ff-714b93ccfe21 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:26.568607 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1066/2118] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:26 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:52:26.570035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b51ed6-3c0a-4da8-a442-6e3f5808ad38 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:26.599276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b51ed6-3c0a-4da8-a442-6e3f5808ad38 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:26.623858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c88de-da9d-4ffc-8e84-29c7ad282a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:26.625102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c88de-da9d-4ffc-8e84-29c7ad282a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:26.627702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c88de-da9d-4ffc-8e84-29c7ad282a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:26.628981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c88de-da9d-4ffc-8e84-29c7ad282a78 admin admin] PATH_INFO: `/v3/projects/52cded16f4124c3f8436a2b342d62e43/users/47831ace16344f36ac6c15605f323ef7/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:26.659152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c88de-da9d-4ffc-8e84-29c7ad282a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=52cded16f4124c3f8436a2b342d62e43, user_id=47831ace16344f36ac6c15605f323ef7, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:26.667442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c88de-da9d-4ffc-8e84-29c7ad282a78 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:26.763178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb2a4d-43ec-4c20-91ff-714b93ccfe21 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:26.778085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4eb2a4d-43ec-4c20-91ff-714b93ccfe21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:26.790141 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1053/2119] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:26 2022] PUT /identity/v3/projects/52cded16f4124c3f8436a2b342d62e43/users/47831ace16344f36ac6c15605f323ef7/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:26.792065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6976763-fb30-47cd-9da8-b22c0a255f49 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:26.792658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6976763-fb30-47cd-9da8-b22c0a255f49 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:26.793171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6976763-fb30-47cd-9da8-b22c0a255f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:26.805232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb2a4d-43ec-4c20-91ff-714b93ccfe21 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:26.831073 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:26.868947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d6976763-fb30-47cd-9da8-b22c0a255f49 None None] MFA Rules not processed for user `47831ace16344f36ac6c15605f323ef7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:26.871166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d6976763-fb30-47cd-9da8-b22c0a255f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:26.968232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:26.969061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:26.969523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:26.970360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] PATH_INFO: `/v3/projects/875171786e3d4a9bba449f80b7d91c9c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:26.974160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] RBAC: Authorizing `identity:delete_project(project_id=875171786e3d4a9bba449f80b7d91c9c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:26.976334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:27.001557 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1054/2120] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:27.015393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6976763-fb30-47cd-9da8-b22c0a255f49 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:27.018432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d6976763-fb30-47cd-9da8-b22c0a255f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:27.085460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875171786e3d4a9bba449f80b7d91c9c', 'request_id': 'req-69091f3a-5c1c-45df-9f79-ae4c60f1354b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:27.100373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875171786e3d4a9bba449f80b7d91c9c', 'request_id': 'req-69091f3a-5c1c-45df-9f79-ae4c60f1354b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:27.117571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875171786e3d4a9bba449f80b7d91c9c', 'request_id': 'req-69091f3a-5c1c-45df-9f79-ae4c60f1354b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:27.150654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] The token cache is being invalidate because project 875171786e3d4a9bba449f80b7d91c9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:27.151064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:27.152307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69091f3a-5c1c-45df-9f79-ae4c60f1354b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:27.154936 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1067/2121] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:26 2022] DELETE /identity/v3/projects/875171786e3d4a9bba449f80b7d91c9c => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:27.159684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56dd35-e9e6-49e9-9f38-eb3cc3f6abe1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:27.160149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56dd35-e9e6-49e9-9f38-eb3cc3f6abe1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:27.160679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db56dd35-e9e6-49e9-9f38-eb3cc3f6abe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:27.184170 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:27.197972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-db56dd35-e9e6-49e9-9f38-eb3cc3f6abe1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:27.201577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-db56dd35-e9e6-49e9-9f38-eb3cc3f6abe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:27.255113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6976763-fb30-47cd-9da8-b22c0a255f49 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:27.378380 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1068/2122] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:27.388555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965632a9-ac14-448a-a6b1-4d03b6a8ed80 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:27.389114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965632a9-ac14-448a-a6b1-4d03b6a8ed80 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:27.389569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965632a9-ac14-448a-a6b1-4d03b6a8ed80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:27.440149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-965632a9-ac14-448a-a6b1-4d03b6a8ed80 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:27.441487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-965632a9-ac14-448a-a6b1-4d03b6a8ed80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:27.479841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56c2b1-63c5-4521-9210-25f20d176b11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:27.480563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56c2b1-63c5-4521-9210-25f20d176b11 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:27.486750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56c2b1-63c5-4521-9210-25f20d176b11 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:27.487120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd56c2b1-63c5-4521-9210-25f20d176b11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:27.494970 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1069/2123] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:27.495178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fd56c2b1-63c5-4521-9210-25f20d176b11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:27.497133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965632a9-ac14-448a-a6b1-4d03b6a8ed80 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:27.510130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965632a9-ac14-448a-a6b1-4d03b6a8ed80 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:27.518212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d691468-1868-4ab2-99ae-b38334585ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:27.520546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d691468-1868-4ab2-99ae-b38334585ebd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:27.521236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d691468-1868-4ab2-99ae-b38334585ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:27.521860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d691468-1868-4ab2-99ae-b38334585ebd admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:27.522886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d691468-1868-4ab2-99ae-b38334585ebd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:27.523417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d691468-1868-4ab2-99ae-b38334585ebd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:27.525329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d691468-1868-4ab2-99ae-b38334585ebd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:27.571669 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1070/2124] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:27.574113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d691468-1868-4ab2-99ae-b38334585ebd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:27.590665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d691468-1868-4ab2-99ae-b38334585ebd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:27.598660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574824-c9fe-489e-b161-22845a177ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:27.599707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574824-c9fe-489e-b161-22845a177ab8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:27.600365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574824-c9fe-489e-b161-22845a177ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:27.600875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d574824-c9fe-489e-b161-22845a177ab8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:27.603104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d574824-c9fe-489e-b161-22845a177ab8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:27.606805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d574824-c9fe-489e-b161-22845a177ab8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:27.655309 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:27.672251 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1071/2125] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:27 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:27.673724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56c2b1-63c5-4521-9210-25f20d176b11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:27.674115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574824-c9fe-489e-b161-22845a177ab8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:27.676333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd56c2b1-63c5-4521-9210-25f20d176b11 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:27.700512 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1055/2126] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 685 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:52:27.788634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d574824-c9fe-489e-b161-22845a177ab8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:27.797829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946fe89-185f-4b42-85eb-ba0fa1eb0b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:27.799892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946fe89-185f-4b42-85eb-ba0fa1eb0b8f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:27.801603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946fe89-185f-4b42-85eb-ba0fa1eb0b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:27.802425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946fe89-185f-4b42-85eb-ba0fa1eb0b8f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:27.803568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946fe89-185f-4b42-85eb-ba0fa1eb0b8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:27.805899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946fe89-185f-4b42-85eb-ba0fa1eb0b8f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:27.880100 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1072/2127] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:27 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:27.884423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56c2b1-63c5-4521-9210-25f20d176b11 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:27.902314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd56c2b1-63c5-4521-9210-25f20d176b11 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:27.915801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2b77-c222-4268-b61b-782e1b4f92f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:27.916440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2b77-c222-4268-b61b-782e1b4f92f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:27.916835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2b77-c222-4268-b61b-782e1b4f92f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:27.917121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3d2b77-c222-4268-b61b-782e1b4f92f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:27.917842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d2b77-c222-4268-b61b-782e1b4f92f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:27.919680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3d2b77-c222-4268-b61b-782e1b4f92f4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:27.937498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946fe89-185f-4b42-85eb-ba0fa1eb0b8f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:27.943732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b946fe89-185f-4b42-85eb-ba0fa1eb0b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:27.947970 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1056/2128] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:27.949726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2b77-c222-4268-b61b-782e1b4f92f4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:27.971910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946fe89-185f-4b42-85eb-ba0fa1eb0b8f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:27.978943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:27.984356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:27.984953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:27.985574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] PATH_INFO: `/v3/users/84715f01a99a40f1b6d8866cfb8c5e31` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:27.987595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84715f01a99a40f1b6d8866cfb8c5e31)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:27.990592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:27.990938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3d2b77-c222-4268-b61b-782e1b4f92f4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:28.002637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f742-3c51-48ae-96a5-8f77ac362e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:28.004948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f742-3c51-48ae-96a5-8f77ac362e49 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:28.005703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f742-3c51-48ae-96a5-8f77ac362e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:28.006090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a11f742-3c51-48ae-96a5-8f77ac362e49 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:28.007863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f742-3c51-48ae-96a5-8f77ac362e49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:28.014263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a11f742-3c51-48ae-96a5-8f77ac362e49 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:28.050317 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1057/2129] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:27 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:28.051004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f742-3c51-48ae-96a5-8f77ac362e49 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:28.064203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a11f742-3c51-48ae-96a5-8f77ac362e49 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:28.083160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e77ef-fff2-43cd-9473-6e484aeb9e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:28.083814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e77ef-fff2-43cd-9473-6e484aeb9e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:28.084104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e77ef-fff2-43cd-9473-6e484aeb9e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:28.084383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e77ef-fff2-43cd-9473-6e484aeb9e04 admin admin] PATH_INFO: `/v3/projects/188e938eeccc4bc9bee9c62e7a559c57/users/2d7dd47ce7af41f7aeb855e35dfc322c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:28.111599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84715f01a99a40f1b6d8866cfb8c5e31'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:28.119978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e77ef-fff2-43cd-9473-6e484aeb9e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=188e938eeccc4bc9bee9c62e7a559c57, user_id=2d7dd47ce7af41f7aeb855e35dfc322c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:28.123090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e77ef-fff2-43cd-9473-6e484aeb9e04 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:28.138496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84715f01a99a40f1b6d8866cfb8c5e31'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:28.140108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84715f01a99a40f1b6d8866cfb8c5e31'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:28.153929 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1058/2130] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:28 2022] PUT /identity/v3/projects/188e938eeccc4bc9bee9c62e7a559c57/users/2d7dd47ce7af41f7aeb855e35dfc322c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:28.164857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d7e36-95db-44ba-9e6e-070676b32927 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:28.165125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d7e36-95db-44ba-9e6e-070676b32927 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:28.165708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d7e36-95db-44ba-9e6e-070676b32927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:28.177236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84715f01a99a40f1b6d8866cfb8c5e31'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:28.211679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2816358e-eaff-4c54-8a92-fb4961847a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84715f01a99a40f1b6d8866cfb8c5e31'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:28.235368 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1073/2131] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:27 2022] DELETE /identity/v3/users/84715f01a99a40f1b6d8866cfb8c5e31 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:28.241662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c20e61-f533-4360-998d-f4765da94468 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:28.242000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c20e61-f533-4360-998d-f4765da94468 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:28.242346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c20e61-f533-4360-998d-f4765da94468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:28.254199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-492d7e36-95db-44ba-9e6e-070676b32927 None None] MFA Rules not processed for user `2d7dd47ce7af41f7aeb855e35dfc322c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:28.259705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-492d7e36-95db-44ba-9e6e-070676b32927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:28.309793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a9c20e61-f533-4360-998d-f4765da94468 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:28.311445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a9c20e61-f533-4360-998d-f4765da94468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:28.369171 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:28.499920 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1059/2132] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:28.506417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d7e36-95db-44ba-9e6e-070676b32927 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:28.509639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-492d7e36-95db-44ba-9e6e-070676b32927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:28.520462 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1074/2133] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:28.532880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d7e36-95db-44ba-9e6e-070676b32927 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:28.545366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7b10e-1471-45e2-8a8e-1b2c3bbde55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:28.545998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7b10e-1471-45e2-8a8e-1b2c3bbde55a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:28.546282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7b10e-1471-45e2-8a8e-1b2c3bbde55a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:28.546556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c7b10e-1471-45e2-8a8e-1b2c3bbde55a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:28.553649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7b10e-1471-45e2-8a8e-1b2c3bbde55a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:28.565707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c7b10e-1471-45e2-8a8e-1b2c3bbde55a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:28.580168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c20e61-f533-4360-998d-f4765da94468 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:28.582562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a9c20e61-f533-4360-998d-f4765da94468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:28.589068 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:28.668773 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1060/2134] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:28 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:28.674187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7b10e-1471-45e2-8a8e-1b2c3bbde55a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:28.735721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c20e61-f533-4360-998d-f4765da94468 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:28.840334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293a5c-0eb2-42f6-90f2-ed230146089e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:28.841703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293a5c-0eb2-42f6-90f2-ed230146089e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:28.841998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293a5c-0eb2-42f6-90f2-ed230146089e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:28.842272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b293a5c-0eb2-42f6-90f2-ed230146089e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:28.883559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c7b10e-1471-45e2-8a8e-1b2c3bbde55a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:28.899855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63d568-8f79-43e1-81b1-ef95b449d3bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:28.900703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63d568-8f79-43e1-81b1-ef95b449d3bf admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:28.900992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63d568-8f79-43e1-81b1-ef95b449d3bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:28.901271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e63d568-8f79-43e1-81b1-ef95b449d3bf admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:28.901949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63d568-8f79-43e1-81b1-ef95b449d3bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:28.906360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e63d568-8f79-43e1-81b1-ef95b449d3bf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:28.967079 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1061/2135] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:28 2022] POST /identity/v3/users => generated 294 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:28.973456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63d568-8f79-43e1-81b1-ef95b449d3bf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:29.000719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e63d568-8f79-43e1-81b1-ef95b449d3bf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:29.015205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f09f69-0aa7-4b85-88f1-26bf29e47bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:29.016015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f09f69-0aa7-4b85-88f1-26bf29e47bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:29.016483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f09f69-0aa7-4b85-88f1-26bf29e47bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:29.016920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f09f69-0aa7-4b85-88f1-26bf29e47bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:29.020374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b293a5c-0eb2-42f6-90f2-ed230146089e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:29.024129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f09f69-0aa7-4b85-88f1-26bf29e47bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:29.027793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b293a5c-0eb2-42f6-90f2-ed230146089e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:29.034965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f09f69-0aa7-4b85-88f1-26bf29e47bb2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:29.092413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1075/2136] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:29.105054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293a5c-0eb2-42f6-90f2-ed230146089e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:29.107777 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1062/2137] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:28 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:29.126080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b293a5c-0eb2-42f6-90f2-ed230146089e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:29.132195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5de4-1109-4a00-8b1b-2f663e701a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:29.133048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5de4-1109-4a00-8b1b-2f663e701a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:29.133370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5de4-1109-4a00-8b1b-2f663e701a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:29.133655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0c5de4-1109-4a00-8b1b-2f663e701a0a admin admin] PATH_INFO: `/v3/projects/03bbc3cfc8984dd2bbd91e6a317217f1/users/ae49a2eebc544887b943f88d58e55fc1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:29.159205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c5de4-1109-4a00-8b1b-2f663e701a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bbc3cfc8984dd2bbd91e6a317217f1, user_id=ae49a2eebc544887b943f88d58e55fc1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:29.162969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0c5de4-1109-4a00-8b1b-2f663e701a0a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:29.193715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f09f69-0aa7-4b85-88f1-26bf29e47bb2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:29.194288 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1076/2138] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:29 2022] PUT /identity/v3/projects/03bbc3cfc8984dd2bbd91e6a317217f1/users/ae49a2eebc544887b943f88d58e55fc1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:29.223985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f09f69-0aa7-4b85-88f1-26bf29e47bb2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:29.430706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b3b14d-9915-4385-b375-b94132366f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:29.431562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b14d-9915-4385-b375-b94132366f3f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:29.432121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b14d-9915-4385-b375-b94132366f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:29.432629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b3b14d-9915-4385-b375-b94132366f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:29.433975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3b14d-9915-4385-b375-b94132366f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:29.444067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b3b14d-9915-4385-b375-b94132366f3f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:29.484983 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1063/2139] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:29 2022] GET /identity/v3/roles => generated 1420 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:29.492910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5de4-1109-4a00-8b1b-2f663e701a0a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:29.519271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0c5de4-1109-4a00-8b1b-2f663e701a0a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:29.525289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f50b06-2bab-41d4-b177-c92086db24f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:29.526153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f50b06-2bab-41d4-b177-c92086db24f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:29.526484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f50b06-2bab-41d4-b177-c92086db24f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:29.526944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f50b06-2bab-41d4-b177-c92086db24f1 admin admin] PATH_INFO: `/v3/projects/03bbc3cfc8984dd2bbd91e6a317217f1/users/ae49a2eebc544887b943f88d58e55fc1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:29.529143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f50b06-2bab-41d4-b177-c92086db24f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03bbc3cfc8984dd2bbd91e6a317217f1, user_id=ae49a2eebc544887b943f88d58e55fc1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:29.532029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f50b06-2bab-41d4-b177-c92086db24f1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:29.559159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9ee7-6beb-4426-8fec-fa5766224720 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:29.559696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9ee7-6beb-4426-8fec-fa5766224720 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:29.559696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e9ee7-6beb-4426-8fec-fa5766224720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:29.576093 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1077/2140] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:29 2022] PUT /identity/v3/projects/03bbc3cfc8984dd2bbd91e6a317217f1/users/ae49a2eebc544887b943f88d58e55fc1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:29.607712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ff3e9ee7-6beb-4426-8fec-fa5766224720 None None] MFA Rules not processed for user `ae49a2eebc544887b943f88d58e55fc1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:29.608978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ff3e9ee7-6beb-4426-8fec-fa5766224720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:29.616321 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:29.768226 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1064/2141] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:29 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:29.775630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f50b06-2bab-41d4-b177-c92086db24f1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:29.778414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-20f50b06-2bab-41d4-b177-c92086db24f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:29.860663 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:29.971890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f50b06-2bab-41d4-b177-c92086db24f1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:29.987340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0049-93ce-4143-9a81-50cad4f86bae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:29.988104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0049-93ce-4143-9a81-50cad4f86bae service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:29.988346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0049-93ce-4143-9a81-50cad4f86bae service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:29.988627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625a0049-93ce-4143-9a81-50cad4f86bae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:30.012604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a0049-93ce-4143-9a81-50cad4f86bae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:30.014291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625a0049-93ce-4143-9a81-50cad4f86bae service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:30.050552 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1078/2142] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:30.453364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9ee7-6beb-4426-8fec-fa5766224720 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:30.484356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e9ee7-6beb-4426-8fec-fa5766224720 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:30.505353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54438884-ccb5-40a8-a3eb-03b5d6a3f126 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:30.506061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54438884-ccb5-40a8-a3eb-03b5d6a3f126 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:30.506346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54438884-ccb5-40a8-a3eb-03b5d6a3f126 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:30.506623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54438884-ccb5-40a8-a3eb-03b5d6a3f126 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:30.673559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54438884-ccb5-40a8-a3eb-03b5d6a3f126 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:30.675255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54438884-ccb5-40a8-a3eb-03b5d6a3f126 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:30.709144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1065/2143] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:31.151157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0049-93ce-4143-9a81-50cad4f86bae service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:31.152796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-625a0049-93ce-4143-9a81-50cad4f86bae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:31.169099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54438884-ccb5-40a8-a3eb-03b5d6a3f126 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:31.266975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54438884-ccb5-40a8-a3eb-03b5d6a3f126 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:31.281860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:31.284741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:31.286823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:31.287361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] PATH_INFO: `/v3/users/2d7dd47ce7af41f7aeb855e35dfc322c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:31.289962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d7dd47ce7af41f7aeb855e35dfc322c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:31.295412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:31.379445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625a0049-93ce-4143-9a81-50cad4f86bae service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:31.395259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:31.396016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:31.396299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:31.396854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] PATH_INFO: `/v3/projects/1e13dc7c48364c7a90f2b82b36d70992` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:31.400579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e13dc7c48364c7a90f2b82b36d70992)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:31.405431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:31.451691 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:31.479644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d7dd47ce7af41f7aeb855e35dfc322c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.553947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d7dd47ce7af41f7aeb855e35dfc322c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.555439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d7dd47ce7af41f7aeb855e35dfc322c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.599571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d7dd47ce7af41f7aeb855e35dfc322c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.599947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e13dc7c48364c7a90f2b82b36d70992', 'request_id': 'req-8afbdb81-7c56-492d-a93d-503e9ab4e20e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.624898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e13dc7c48364c7a90f2b82b36d70992', 'request_id': 'req-8afbdb81-7c56-492d-a93d-503e9ab4e20e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.635809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-82f81851-1383-4047-a403-a3932ed913ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d7dd47ce7af41f7aeb855e35dfc322c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.660823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e13dc7c48364c7a90f2b82b36d70992', 'request_id': 'req-8afbdb81-7c56-492d-a93d-503e9ab4e20e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.696495 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1066/2144] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:31 2022] DELETE /identity/v3/users/2d7dd47ce7af41f7aeb855e35dfc322c => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:31.701870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4b0c-6708-4c0e-a641-9557c10d869b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:31.703554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4b0c-6708-4c0e-a641-9557c10d869b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:31.704775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ae4b0c-6708-4c0e-a641-9557c10d869b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:31.709510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] The token cache is being invalidate because project 1e13dc7c48364c7a90f2b82b36d70992 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:31.722241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.729781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:31.746027 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1079/2145] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:31 2022] DELETE /identity/v3/projects/1e13dc7c48364c7a90f2b82b36d70992 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:31.748589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:31.753523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:31.824457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-72ae4b0c-6708-4c0e-a641-9557c10d869b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:31.830013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-72ae4b0c-6708-4c0e-a641-9557c10d869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:32.008404 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:32.069729 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1067/2146] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:32.105242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afbdb81-7c56-492d-a93d-503e9ab4e20e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:32.122692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:32.123713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:32.124226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:32.125779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] PATH_INFO: `/v3/users/47831ace16344f36ac6c15605f323ef7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:32.133838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47831ace16344f36ac6c15605f323ef7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:32.138848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:32.159336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4b0c-6708-4c0e-a641-9557c10d869b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:32.163589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-72ae4b0c-6708-4c0e-a641-9557c10d869b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:32.279958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47831ace16344f36ac6c15605f323ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:32.317895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47831ace16344f36ac6c15605f323ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:32.318987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47831ace16344f36ac6c15605f323ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:32.339157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47831ace16344f36ac6c15605f323ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:32.365360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ae4b0c-6708-4c0e-a641-9557c10d869b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:32.380926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47831ace16344f36ac6c15605f323ef7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:32.389835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f000-af98-4647-b18a-4dc2b160b7ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:32.390560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f000-af98-4647-b18a-4dc2b160b7ec service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:32.391071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f000-af98-4647-b18a-4dc2b160b7ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:32.391239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b6f000-af98-4647-b18a-4dc2b160b7ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:32.395314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7b6f000-af98-4647-b18a-4dc2b160b7ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:32.423305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f000-af98-4647-b18a-4dc2b160b7ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:32.428667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b6f000-af98-4647-b18a-4dc2b160b7ec service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:32.431235 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1080/2147] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:31 2022] DELETE /identity/v3/users/47831ace16344f36ac6c15605f323ef7 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:52:32.450552 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1068/2148] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:33.889279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:33.892623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:34.282274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4548bb-5ccd-47ef-b0f9-6def5696b512 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:34.302629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:34.303519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:34.303987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:34.304697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] PATH_INFO: `/v3/projects/188e938eeccc4bc9bee9c62e7a559c57` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:34.306949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=188e938eeccc4bc9bee9c62e7a559c57)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:34.309184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:34.402693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '188e938eeccc4bc9bee9c62e7a559c57', 'request_id': 'req-ab2b8385-fdde-45eb-af64-4de5c6180c81'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.459427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '188e938eeccc4bc9bee9c62e7a559c57', 'request_id': 'req-ab2b8385-fdde-45eb-af64-4de5c6180c81'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.470886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '188e938eeccc4bc9bee9c62e7a559c57', 'request_id': 'req-ab2b8385-fdde-45eb-af64-4de5c6180c81'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.478675 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:34.492207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] The token cache is being invalidate because project 188e938eeccc4bc9bee9c62e7a559c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:34.497324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.498333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.501446 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1081/2149] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:33 2022] DELETE /identity/v3/projects/188e938eeccc4bc9bee9c62e7a559c57 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:34.508403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f000-af98-4647-b18a-4dc2b160b7ec service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:34.535618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b6f000-af98-4647-b18a-4dc2b160b7ec service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:34.570418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:34.572121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:34.723863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:34.724465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:34.726922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:34.727242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] PATH_INFO: `/v3/users/ae49a2eebc544887b943f88d58e55fc1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:34.731052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae49a2eebc544887b943f88d58e55fc1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:34.737451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:34.769931 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:34.773453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2b8385-fdde-45eb-af64-4de5c6180c81 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:34.794378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:34.795211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:34.796184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:34.797182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] PATH_INFO: `/v3/projects/52cded16f4124c3f8436a2b342d62e43` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:34.803063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=52cded16f4124c3f8436a2b342d62e43)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:34.811899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:34.923429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52cded16f4124c3f8436a2b342d62e43', 'request_id': 'req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.945932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52cded16f4124c3f8436a2b342d62e43', 'request_id': 'req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.961995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52cded16f4124c3f8436a2b342d62e43', 'request_id': 'req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.970636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae49a2eebc544887b943f88d58e55fc1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.989201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] The token cache is being invalidate because project 52cded16f4124c3f8436a2b342d62e43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:34.989786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.993617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6ab383f-0d54-45c7-8240-eb4c4a271dfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:34.995730 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1082/2150] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:34 2022] DELETE /identity/v3/projects/52cded16f4124c3f8436a2b342d62e43 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:35.001992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b332155-d222-4fa1-8813-0eaaf1f02732 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:35.002447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b332155-d222-4fa1-8813-0eaaf1f02732 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:35.002887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b332155-d222-4fa1-8813-0eaaf1f02732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:35.031527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae49a2eebc544887b943f88d58e55fc1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:35.035457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae49a2eebc544887b943f88d58e55fc1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:35.066689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0b332155-d222-4fa1-8813-0eaaf1f02732 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:35.067975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0b332155-d222-4fa1-8813-0eaaf1f02732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:35.069466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae49a2eebc544887b943f88d58e55fc1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:35.097400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9bff0efd-0a79-41e8-9822-79c068b2340e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae49a2eebc544887b943f88d58e55fc1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:35.119166 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1069/2151] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:52:34 2022] DELETE /identity/v3/users/ae49a2eebc544887b943f88d58e55fc1 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:35.250540 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1083/2152] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:35.260157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb36c5-01c4-4721-adf2-975f6e2197be None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:35.261002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb36c5-01c4-4721-adf2-975f6e2197be None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:35.261725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb36c5-01c4-4721-adf2-975f6e2197be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:35.343277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ddeb36c5-01c4-4721-adf2-975f6e2197be None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:35.345513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ddeb36c5-01c4-4721-adf2-975f6e2197be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:35.513340 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1070/2153] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:35.518455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b332155-d222-4fa1-8813-0eaaf1f02732 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:35.534156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b332155-d222-4fa1-8813-0eaaf1f02732 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:35.539804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab953-506e-4828-a8c0-e9063ac52d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:35.541250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab953-506e-4828-a8c0-e9063ac52d8f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:35.541688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab953-506e-4828-a8c0-e9063ac52d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:35.542314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16ab953-506e-4828-a8c0-e9063ac52d8f admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:35.543462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab953-506e-4828-a8c0-e9063ac52d8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:35.544439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab953-506e-4828-a8c0-e9063ac52d8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:35.548801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16ab953-506e-4828-a8c0-e9063ac52d8f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:35.570952 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1084/2154] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:35.575677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb36c5-01c4-4721-adf2-975f6e2197be None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:35.594021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb36c5-01c4-4721-adf2-975f6e2197be None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:35.610661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ebff9-e00d-44c0-8769-6c12ccade67d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:35.617260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ebff9-e00d-44c0-8769-6c12ccade67d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:35.619509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ebff9-e00d-44c0-8769-6c12ccade67d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:35.620285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9ebff9-e00d-44c0-8769-6c12ccade67d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:35.625148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ebff9-e00d-44c0-8769-6c12ccade67d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:35.638208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9ebff9-e00d-44c0-8769-6c12ccade67d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:35.725704 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1071/2155] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:35 2022] POST /identity/v3/projects => generated 393 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:35.730049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab953-506e-4828-a8c0-e9063ac52d8f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:35.752490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16ab953-506e-4828-a8c0-e9063ac52d8f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:35.813100 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:35.983348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b6b14-5b0f-493b-9969-420ec5b75713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:35.984229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b6b14-5b0f-493b-9969-420ec5b75713 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:35.984763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b6b14-5b0f-493b-9969-420ec5b75713 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:35.985099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959b6b14-5b0f-493b-9969-420ec5b75713 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:35.987062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b6b14-5b0f-493b-9969-420ec5b75713 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:35.990467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959b6b14-5b0f-493b-9969-420ec5b75713 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:36.031295 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1085/2156] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:35 2022] POST /identity/v3/users => generated 297 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:36.035842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ebff9-e00d-44c0-8769-6c12ccade67d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:36.068029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9ebff9-e00d-44c0-8769-6c12ccade67d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:36.095235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eeffe-d155-411d-a76e-97474bba31e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:36.096508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eeffe-d155-411d-a76e-97474bba31e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:36.097132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eeffe-d155-411d-a76e-97474bba31e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:36.098148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639eeffe-d155-411d-a76e-97474bba31e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:36.099124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eeffe-d155-411d-a76e-97474bba31e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:36.101131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639eeffe-d155-411d-a76e-97474bba31e8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:36.145862 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1072/2157] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:36.154731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b6b14-5b0f-493b-9969-420ec5b75713 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:36.171291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959b6b14-5b0f-493b-9969-420ec5b75713 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:36.188671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7efd33-d418-47be-98c1-15f8ce3ad6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:36.189311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7efd33-d418-47be-98c1-15f8ce3ad6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:36.189603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7efd33-d418-47be-98c1-15f8ce3ad6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:36.189883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7efd33-d418-47be-98c1-15f8ce3ad6d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:36.190544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7efd33-d418-47be-98c1-15f8ce3ad6d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:36.192745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7efd33-d418-47be-98c1-15f8ce3ad6d2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:36.220523 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1086/2158] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:36 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:36.225326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eeffe-d155-411d-a76e-97474bba31e8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:36.245451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639eeffe-d155-411d-a76e-97474bba31e8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:36.259755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6ea547-5d2e-4c33-9476-cc24833c40e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:36.260453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea547-5d2e-4c33-9476-cc24833c40e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:36.260738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea547-5d2e-4c33-9476-cc24833c40e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:36.261021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6ea547-5d2e-4c33-9476-cc24833c40e4 admin admin] PATH_INFO: `/v3/projects/961eeb9727ed45d9874a81d495c0069a/users/f6e3382f1fcd40108c9d79cfbdf4337a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:36.305198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7efd33-d418-47be-98c1-15f8ce3ad6d2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:36.306983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b7efd33-d418-47be-98c1-15f8ce3ad6d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:36.308249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ea547-5d2e-4c33-9476-cc24833c40e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=961eeb9727ed45d9874a81d495c0069a, user_id=f6e3382f1fcd40108c9d79cfbdf4337a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:36.311118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6ea547-5d2e-4c33-9476-cc24833c40e4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:36.336033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7efd33-d418-47be-98c1-15f8ce3ad6d2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:36.343582 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1073/2159] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:36 2022] PUT /identity/v3/projects/961eeb9727ed45d9874a81d495c0069a/users/f6e3382f1fcd40108c9d79cfbdf4337a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:36.355958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6476-8e8c-4b3e-b785-4dec51746917 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:36.356353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6476-8e8c-4b3e-b785-4dec51746917 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:36.356532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1db6476-8e8c-4b3e-b785-4dec51746917 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:36.395376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c1db6476-8e8c-4b3e-b785-4dec51746917 None None] MFA Rules not processed for user `f6e3382f1fcd40108c9d79cfbdf4337a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:36.397436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1db6476-8e8c-4b3e-b785-4dec51746917 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:36.438680 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:36.475370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:36.476501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:36.476827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:36.477072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] PATH_INFO: `/v3/projects/03bbc3cfc8984dd2bbd91e6a317217f1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:36.480735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03bbc3cfc8984dd2bbd91e6a317217f1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:36.482875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:36.588121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03bbc3cfc8984dd2bbd91e6a317217f1', 'request_id': 'req-1d39b303-4344-4a25-8941-9083abaf6df0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:36.613546 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1074/2160] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:36.614299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03bbc3cfc8984dd2bbd91e6a317217f1', 'request_id': 'req-1d39b303-4344-4a25-8941-9083abaf6df0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:36.615694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6476-8e8c-4b3e-b785-4dec51746917 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:36.625878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03bbc3cfc8984dd2bbd91e6a317217f1', 'request_id': 'req-1d39b303-4344-4a25-8941-9083abaf6df0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:36.636792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1db6476-8e8c-4b3e-b785-4dec51746917 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:36.655557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] The token cache is being invalidate because project 03bbc3cfc8984dd2bbd91e6a317217f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:52:36.655882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:36.657734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d39b303-4344-4a25-8941-9083abaf6df0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:52:36.662740 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1087/2161] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:52:36 2022] DELETE /identity/v3/projects/03bbc3cfc8984dd2bbd91e6a317217f1 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:52:36.669212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d0af4-4074-475b-9689-c86477db8e99 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:36.669605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d0af4-4074-475b-9689-c86477db8e99 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:36.669891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d0af4-4074-475b-9689-c86477db8e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:36.723698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-175d0af4-4074-475b-9689-c86477db8e99 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:36.728069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-175d0af4-4074-475b-9689-c86477db8e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:36.815852 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:36.888536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be34f0-72af-4f93-ab52-f8249ccaa283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:36.890344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be34f0-72af-4f93-ab52-f8249ccaa283 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:36.892790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be34f0-72af-4f93-ab52-f8249ccaa283 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:36.893248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be34f0-72af-4f93-ab52-f8249ccaa283 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:36.895431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be34f0-72af-4f93-ab52-f8249ccaa283 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:36.903085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43be34f0-72af-4f93-ab52-f8249ccaa283 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:37.001402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1088/2162] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:37.015678 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1075/2163] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:36 2022] POST /identity/v3/projects => generated 391 bytes in 401 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:37.016763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d0af4-4074-475b-9689-c86477db8e99 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:37.017076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eee69d-5688-45a2-9c25-35fbf16d2aed None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:37.017390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eee69d-5688-45a2-9c25-35fbf16d2aed None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:37.017668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52eee69d-5688-45a2-9c25-35fbf16d2aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:37.019198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-175d0af4-4074-475b-9689-c86477db8e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:37.040604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d0af4-4074-475b-9689-c86477db8e99 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:37.084132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-52eee69d-5688-45a2-9c25-35fbf16d2aed None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:37.087650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52eee69d-5688-45a2-9c25-35fbf16d2aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:37.213510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53110e-5df5-4bf3-aeda-1e6a95d6c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:37.214744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53110e-5df5-4bf3-aeda-1e6a95d6c41b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:37.215790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53110e-5df5-4bf3-aeda-1e6a95d6c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:37.215790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53110e-5df5-4bf3-aeda-1e6a95d6c41b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:37.217316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53110e-5df5-4bf3-aeda-1e6a95d6c41b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:37.227228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca53110e-5df5-4bf3-aeda-1e6a95d6c41b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:37.298714 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1089/2164] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:37 2022] POST /identity/v3/users => generated 302 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:52:37.304447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53110e-5df5-4bf3-aeda-1e6a95d6c41b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:37.314183 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1076/2165] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:37.315909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eee69d-5688-45a2-9c25-35fbf16d2aed None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:37.340708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53110e-5df5-4bf3-aeda-1e6a95d6c41b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:37.342769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52eee69d-5688-45a2-9c25-35fbf16d2aed None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:37.347756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb28ae-0e0c-4959-9fa2-76186f38fecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:37.348438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb28ae-0e0c-4959-9fa2-76186f38fecc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:37.348884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb28ae-0e0c-4959-9fa2-76186f38fecc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:37.349283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cb28ae-0e0c-4959-9fa2-76186f38fecc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:37.349977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb28ae-0e0c-4959-9fa2-76186f38fecc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:37.357101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cb28ae-0e0c-4959-9fa2-76186f38fecc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:37.357761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400029d-ad6a-435c-8fe0-c25f2d0c8de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:37.358706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400029d-ad6a-435c-8fe0-c25f2d0c8de9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:37.359084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400029d-ad6a-435c-8fe0-c25f2d0c8de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:37.359578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f400029d-ad6a-435c-8fe0-c25f2d0c8de9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:37.370185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400029d-ad6a-435c-8fe0-c25f2d0c8de9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:52:37.375765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400029d-ad6a-435c-8fe0-c25f2d0c8de9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:37.382232 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1090/2166] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:37.382933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f400029d-ad6a-435c-8fe0-c25f2d0c8de9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:37.386347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb28ae-0e0c-4959-9fa2-76186f38fecc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:37.419326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cb28ae-0e0c-4959-9fa2-76186f38fecc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:37.434987 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1077/2167] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:52:37.435921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8feb1-d873-44cb-a255-b4f596cc8b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:37.436635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8feb1-d873-44cb-a255-b4f596cc8b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:37.436924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8feb1-d873-44cb-a255-b4f596cc8b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:37.437064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400029d-ad6a-435c-8fe0-c25f2d0c8de9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:37.437232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec8feb1-d873-44cb-a255-b4f596cc8b41 admin admin] PATH_INFO: `/v3/projects/bb51316d29514a1092aa662ee0875f04/users/3cf59bb388b348268df3b67e9dfae7cc/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:37.467276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f400029d-ad6a-435c-8fe0-c25f2d0c8de9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:37.482306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8feb1-d873-44cb-a255-b4f596cc8b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb51316d29514a1092aa662ee0875f04, user_id=3cf59bb388b348268df3b67e9dfae7cc, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:37.485106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec8feb1-d873-44cb-a255-b4f596cc8b41 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:37.509266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce20c81-6731-4cd0-a1d0-5d6b160e2a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:37.510987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce20c81-6731-4cd0-a1d0-5d6b160e2a7c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:37.511733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce20c81-6731-4cd0-a1d0-5d6b160e2a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:37.512444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce20c81-6731-4cd0-a1d0-5d6b160e2a7c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:37.513898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce20c81-6731-4cd0-a1d0-5d6b160e2a7c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:37.543920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce20c81-6731-4cd0-a1d0-5d6b160e2a7c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:37.549388 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1091/2168] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:37 2022] PUT /identity/v3/projects/bb51316d29514a1092aa662ee0875f04/users/3cf59bb388b348268df3b67e9dfae7cc/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:52:37.554765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8feb1-d873-44cb-a255-b4f596cc8b41 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:37.686304 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1078/2169] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:37 2022] POST /identity/v3/projects => generated 405 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:37.688830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce20c81-6731-4cd0-a1d0-5d6b160e2a7c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:37.703804 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:37.873864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce20c81-6731-4cd0-a1d0-5d6b160e2a7c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:37.881450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e7604-f6a8-416f-bcdf-874dd1fe776f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:37.883379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e7604-f6a8-416f-bcdf-874dd1fe776f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:37.885378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e7604-f6a8-416f-bcdf-874dd1fe776f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:37.886006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e7604-f6a8-416f-bcdf-874dd1fe776f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:37.886936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e7604-f6a8-416f-bcdf-874dd1fe776f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:37.889633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e7604-f6a8-416f-bcdf-874dd1fe776f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:37.947411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec8feb1-d873-44cb-a255-b4f596cc8b41 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:37.948504 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1079/2170] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:37 2022] POST /identity/v3/users => generated 303 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:37.949897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e7604-f6a8-416f-bcdf-874dd1fe776f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:37.957998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745fbad-4400-457e-b635-a2b695b77b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:37.959034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745fbad-4400-457e-b635-a2b695b77b6b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:37.959508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745fbad-4400-457e-b635-a2b695b77b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:37.959979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f745fbad-4400-457e-b635-a2b695b77b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:37.961175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745fbad-4400-457e-b635-a2b695b77b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:37.978138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e7604-f6a8-416f-bcdf-874dd1fe776f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:37.991273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f745fbad-4400-457e-b635-a2b695b77b6b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:38.013288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ec1f-ad4a-45af-964b-6dabdbdd0ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:38.014322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ec1f-ad4a-45af-964b-6dabdbdd0ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.014797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ec1f-ad4a-45af-964b-6dabdbdd0ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.015268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d4ec1f-ad4a-45af-964b-6dabdbdd0ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.018009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4ec1f-ad4a-45af-964b-6dabdbdd0ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:38.021533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d4ec1f-ad4a-45af-964b-6dabdbdd0ff0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:38.036885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1092/2171] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 483 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:52:38.039515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745fbad-4400-457e-b635-a2b695b77b6b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:38.044520 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1080/2172] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:38.048399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ec1f-ad4a-45af-964b-6dabdbdd0ff0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:38.059639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f745fbad-4400-457e-b635-a2b695b77b6b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:38.063492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d4ec1f-ad4a-45af-964b-6dabdbdd0ff0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:38.076637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f6b2a-df97-4e02-8489-7dcf0ef15d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:38.077072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f6b2a-df97-4e02-8489-7dcf0ef15d61 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.077382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f6b2a-df97-4e02-8489-7dcf0ef15d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.077646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864f6b2a-df97-4e02-8489-7dcf0ef15d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.079959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f6b2a-df97-4e02-8489-7dcf0ef15d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:38.081693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864f6b2a-df97-4e02-8489-7dcf0ef15d61 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:38.085977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce2735-b5c3-489a-91a5-dd71eca042a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:38.087568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce2735-b5c3-489a-91a5-dd71eca042a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.088067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce2735-b5c3-489a-91a5-dd71eca042a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.088510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce2735-b5c3-489a-91a5-dd71eca042a2 admin admin] PATH_INFO: `/v3/projects/bb51316d29514a1092aa662ee0875f04/users/3cf59bb388b348268df3b67e9dfae7cc/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.091824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce2735-b5c3-489a-91a5-dd71eca042a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb51316d29514a1092aa662ee0875f04, user_id=3cf59bb388b348268df3b67e9dfae7cc, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:38.096508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce2735-b5c3-489a-91a5-dd71eca042a2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:38.112124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1081/2173] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:38.113547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f6b2a-df97-4e02-8489-7dcf0ef15d61 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:38.131012 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:38.135954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864f6b2a-df97-4e02-8489-7dcf0ef15d61 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:38.141530 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1093/2174] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:38 2022] PUT /identity/v3/projects/bb51316d29514a1092aa662ee0875f04/users/3cf59bb388b348268df3b67e9dfae7cc/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:52:38.157366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6dcf0-0244-4b62-87d7-18e170fc66ab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.157854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6dcf0-0244-4b62-87d7-18e170fc66ab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.158864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d6dcf0-0244-4b62-87d7-18e170fc66ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.248228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-99d6dcf0-0244-4b62-87d7-18e170fc66ab None None] MFA Rules not processed for user `3cf59bb388b348268df3b67e9dfae7cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:38.255434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-99d6dcf0-0244-4b62-87d7-18e170fc66ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:38.331348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2522485-db47-4200-bc63-4db43b9109e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:38.332596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2522485-db47-4200-bc63-4db43b9109e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.332872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2522485-db47-4200-bc63-4db43b9109e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.333145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2522485-db47-4200-bc63-4db43b9109e3 admin admin] PATH_INFO: `/v3/projects/c939d2bbd9bf44a6851bb04ba3ee73a6/users/6ab35e03b5534edc84fc473b75379025/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.370722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2522485-db47-4200-bc63-4db43b9109e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c939d2bbd9bf44a6851bb04ba3ee73a6, user_id=6ab35e03b5534edc84fc473b75379025, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:38.374025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2522485-db47-4200-bc63-4db43b9109e3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:38.411508 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1082/2175] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:38 2022] PUT /identity/v3/projects/c939d2bbd9bf44a6851bb04ba3ee73a6/users/6ab35e03b5534edc84fc473b75379025/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:38.417227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29551108-89ba-4309-9362-463af4f152a2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.417227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29551108-89ba-4309-9362-463af4f152a2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.417227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29551108-89ba-4309-9362-463af4f152a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.462411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-29551108-89ba-4309-9362-463af4f152a2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:38.463668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-29551108-89ba-4309-9362-463af4f152a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:38.489405 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1094/2176] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 324 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:38.496287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e674-59cc-4140-9098-e62fc2ecc61f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.497184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e674-59cc-4140-9098-e62fc2ecc61f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.497872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf2e674-59cc-4140-9098-e62fc2ecc61f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.539434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6cf2e674-59cc-4140-9098-e62fc2ecc61f None None] MFA Rules not processed for user `f6e3382f1fcd40108c9d79cfbdf4337a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:38.541239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6cf2e674-59cc-4140-9098-e62fc2ecc61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:38.598246 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:38.621984 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1083/2177] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:38.634068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12110006-c3cc-4a01-b2bf-21f4c0711f8b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.634612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12110006-c3cc-4a01-b2bf-21f4c0711f8b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.635153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12110006-c3cc-4a01-b2bf-21f4c0711f8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.677345 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1095/2178] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:38.683213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e674-59cc-4140-9098-e62fc2ecc61f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:38.683213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6cf2e674-59cc-4140-9098-e62fc2ecc61f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:38.700595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-12110006-c3cc-4a01-b2bf-21f4c0711f8b None None] MFA Rules not processed for user `89ee4538fd234ed7b8137861bfb534d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:38.701889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-12110006-c3cc-4a01-b2bf-21f4c0711f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:38.880952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf2e674-59cc-4140-9098-e62fc2ecc61f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:38.888599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b987e1ea-7997-465a-b262-fc1798d29e8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:38.889469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987e1ea-7997-465a-b262-fc1798d29e8e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.889761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987e1ea-7997-465a-b262-fc1798d29e8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.890042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b987e1ea-7997-465a-b262-fc1798d29e8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.905728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987e1ea-7997-465a-b262-fc1798d29e8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:38.910433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b987e1ea-7997-465a-b262-fc1798d29e8e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:38.921246 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1084/2179] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:52:38.922632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12110006-c3cc-4a01-b2bf-21f4c0711f8b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:38.927437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-12110006-c3cc-4a01-b2bf-21f4c0711f8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:38.941259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1096/2180] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:38.944196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69283e12-fee7-4a23-bdb9-8219a6e94dba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:38.946535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69283e12-fee7-4a23-bdb9-8219a6e94dba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:38.947612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69283e12-fee7-4a23-bdb9-8219a6e94dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:38.990271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-69283e12-fee7-4a23-bdb9-8219a6e94dba None None] MFA Rules not processed for user `89ee4538fd234ed7b8137861bfb534d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:38.991704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-69283e12-fee7-4a23-bdb9-8219a6e94dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:39.004574 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1097/2181] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:38 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:39.091805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12110006-c3cc-4a01-b2bf-21f4c0711f8b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:39.101117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:39.101885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:39.102233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:39.102576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:39.106226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:39.127175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96494555-0abd-4c88-ada2-9ad87ac2cd6e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:39.127663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96494555-0abd-4c88-ada2-9ad87ac2cd6e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:39.128548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96494555-0abd-4c88-ada2-9ad87ac2cd6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:39.182671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:39.184354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:39.223924 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1085/2182] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:39.226856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:39.233910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:39.248783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-96494555-0abd-4c88-ada2-9ad87ac2cd6e None None] MFA Rules not processed for user `6c77bcaf1bd040678e9baa743607257b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:39.254038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-96494555-0abd-4c88-ada2-9ad87ac2cd6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:39.276611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaef40b-7ab5-4a74-a3b1-c5eca275961a service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:39.289529 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:39.291422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937fed9d-8304-4cb0-af2b-c5ccebeaccf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:39.295649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fed9d-8304-4cb0-af2b-c5ccebeaccf6 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:39.296029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fed9d-8304-4cb0-af2b-c5ccebeaccf6 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:39.296642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937fed9d-8304-4cb0-af2b-c5ccebeaccf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:39.332336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fed9d-8304-4cb0-af2b-c5ccebeaccf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:39.338439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937fed9d-8304-4cb0-af2b-c5ccebeaccf6 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:39.366493 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1086/2183] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:39 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:39.368503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f28b4-44f4-422c-8f17-28d71cac4435 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:39.368726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f28b4-44f4-422c-8f17-28d71cac4435 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:39.369003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877f28b4-44f4-422c-8f17-28d71cac4435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:39.433205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-877f28b4-44f4-422c-8f17-28d71cac4435 None None] MFA Rules not processed for user `cc0be0ed857d4c96b26724144e20d766`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:39.434656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-877f28b4-44f4-422c-8f17-28d71cac4435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:39.471938 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1098/2184] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:39 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:39.471938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3ecfc-723c-4b73-8008-6d2f0c9adfce None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:39.471938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3ecfc-723c-4b73-8008-6d2f0c9adfce None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:39.471938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3ecfc-723c-4b73-8008-6d2f0c9adfce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:39.565369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-42e3ecfc-723c-4b73-8008-6d2f0c9adfce None None] MFA Rules not processed for user `f8014c38830c46a6851b9938a6cc1cee`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:39.569442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42e3ecfc-723c-4b73-8008-6d2f0c9adfce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:39.592515 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:39.665073 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1087/2185] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:39.666627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d5b6-4756-4dfd-bbf3-f936e41c9839 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:39.666913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d5b6-4756-4dfd-bbf3-f936e41c9839 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:39.667199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d0d5b6-4756-4dfd-bbf3-f936e41c9839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:39.724627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b6d0d5b6-4756-4dfd-bbf3-f936e41c9839 None None] MFA Rules not processed for user `6c77bcaf1bd040678e9baa743607257b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:39.738085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b6d0d5b6-4756-4dfd-bbf3-f936e41c9839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:39.766229 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1088/2186] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:39 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:39.767899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0d5b6-4756-4dfd-bbf3-f936e41c9839 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:39.770732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b6d0d5b6-4756-4dfd-bbf3-f936e41c9839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:39.809848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d0d5b6-4756-4dfd-bbf3-f936e41c9839 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:39.825747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f315b4-3e4c-4e39-b14e-59886b736e24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:39.826542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f315b4-3e4c-4e39-b14e-59886b736e24 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:39.827147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f315b4-3e4c-4e39-b14e-59886b736e24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:39.827502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f315b4-3e4c-4e39-b14e-59886b736e24 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:39.828392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f315b4-3e4c-4e39-b14e-59886b736e24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:39.830518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f315b4-3e4c-4e39-b14e-59886b736e24 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:39.877798 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1099/2187] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:39 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:39.935777 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1089/2188] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:39 2022] POST /identity/v3/projects => generated 395 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:39.940746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3ecfc-723c-4b73-8008-6d2f0c9adfce None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:39.976714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3ecfc-723c-4b73-8008-6d2f0c9adfce None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:40.137900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02247fa1-b86f-4e40-951b-1d0c6daa8c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:40.138988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02247fa1-b86f-4e40-951b-1d0c6daa8c40 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:40.138988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02247fa1-b86f-4e40-951b-1d0c6daa8c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:40.139486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02247fa1-b86f-4e40-951b-1d0c6daa8c40 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:40.140223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02247fa1-b86f-4e40-951b-1d0c6daa8c40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:40.142287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02247fa1-b86f-4e40-951b-1d0c6daa8c40 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:40.184720 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1100/2189] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:39 2022] POST /identity/v3/users => generated 304 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:40.186589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f315b4-3e4c-4e39-b14e-59886b736e24 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:40.198356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f315b4-3e4c-4e39-b14e-59886b736e24 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:40.221647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1fdc5-2326-4533-9854-c4c3c8180a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:40.222285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1fdc5-2326-4533-9854-c4c3c8180a26 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:40.223130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1fdc5-2326-4533-9854-c4c3c8180a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:40.223410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da1fdc5-2326-4533-9854-c4c3c8180a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:40.224079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1fdc5-2326-4533-9854-c4c3c8180a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:40.225790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da1fdc5-2326-4533-9854-c4c3c8180a26 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:40.248709 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1090/2190] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:40.254180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02247fa1-b86f-4e40-951b-1d0c6daa8c40 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:40.271114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02247fa1-b86f-4e40-951b-1d0c6daa8c40 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:40.283196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794d9fa-04d1-4b0c-88f3-e3dcc08c700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:40.283910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794d9fa-04d1-4b0c-88f3-e3dcc08c700f admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:40.284195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794d9fa-04d1-4b0c-88f3-e3dcc08c700f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:40.284474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794d9fa-04d1-4b0c-88f3-e3dcc08c700f admin admin] PATH_INFO: `/v3/projects/62672bde0bd84f6892e27ee13fe282f6/users/2b8194e0c6d34a9eb2d70595e8c80569/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:40.334124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794d9fa-04d1-4b0c-88f3-e3dcc08c700f admin admin] RBAC: Authorizing `identity:create_grant(project_id=62672bde0bd84f6892e27ee13fe282f6, user_id=2b8194e0c6d34a9eb2d70595e8c80569, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:40.336745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7794d9fa-04d1-4b0c-88f3-e3dcc08c700f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:40.366585 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1101/2191] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:40 2022] PUT /identity/v3/projects/62672bde0bd84f6892e27ee13fe282f6/users/2b8194e0c6d34a9eb2d70595e8c80569/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:40.371523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1fdc5-2326-4533-9854-c4c3c8180a26 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:40.411079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da1fdc5-2326-4533-9854-c4c3c8180a26 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:40.605404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc562b3-fd95-489b-ae87-fd287fafc197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:40.606041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc562b3-fd95-489b-ae87-fd287fafc197 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:40.606326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc562b3-fd95-489b-ae87-fd287fafc197 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:40.606605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc562b3-fd95-489b-ae87-fd287fafc197 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:40.607272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc562b3-fd95-489b-ae87-fd287fafc197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:40.609059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc562b3-fd95-489b-ae87-fd287fafc197 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:40.640426 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1091/2192] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:40 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:40.641728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794d9fa-04d1-4b0c-88f3-e3dcc08c700f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:40.660473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7794d9fa-04d1-4b0c-88f3-e3dcc08c700f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:40.673603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f54ca1-8c84-4d3d-b66f-2cb085a3673e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:40.674597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54ca1-8c84-4d3d-b66f-2cb085a3673e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:40.675015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54ca1-8c84-4d3d-b66f-2cb085a3673e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:40.675300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f54ca1-8c84-4d3d-b66f-2cb085a3673e admin admin] PATH_INFO: `/v3/projects/62672bde0bd84f6892e27ee13fe282f6/users/2b8194e0c6d34a9eb2d70595e8c80569/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:40.681542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f54ca1-8c84-4d3d-b66f-2cb085a3673e admin admin] RBAC: Authorizing `identity:create_grant(project_id=62672bde0bd84f6892e27ee13fe282f6, user_id=2b8194e0c6d34a9eb2d70595e8c80569, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:40.688684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f54ca1-8c84-4d3d-b66f-2cb085a3673e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:40.692604 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:40.717769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1102/2193] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:40 2022] PUT /identity/v3/projects/62672bde0bd84f6892e27ee13fe282f6/users/2b8194e0c6d34a9eb2d70595e8c80569/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:40.837925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc562b3-fd95-489b-ae87-fd287fafc197 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:41.028272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc562b3-fd95-489b-ae87-fd287fafc197 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:41.096986 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:41.139435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2524bb9-500b-430c-bb5d-de99ed41e890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:41.140258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2524bb9-500b-430c-bb5d-de99ed41e890 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:41.140620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2524bb9-500b-430c-bb5d-de99ed41e890 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:41.140967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2524bb9-500b-430c-bb5d-de99ed41e890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:41.269995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2524bb9-500b-430c-bb5d-de99ed41e890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:41.271995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2524bb9-500b-430c-bb5d-de99ed41e890 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:41.290114 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1092/2194] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:40 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:41.907458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f54ca1-8c84-4d3d-b66f-2cb085a3673e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:41.931754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f54ca1-8c84-4d3d-b66f-2cb085a3673e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:41.953562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08f1cf2-6a4b-4a87-9879-e148f6ecf3b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:41.955454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f1cf2-6a4b-4a87-9879-e148f6ecf3b7 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:41.955979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f1cf2-6a4b-4a87-9879-e148f6ecf3b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:41.957430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08f1cf2-6a4b-4a87-9879-e148f6ecf3b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:41.962555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b08f1cf2-6a4b-4a87-9879-e148f6ecf3b7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:42.130979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f1cf2-6a4b-4a87-9879-e148f6ecf3b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:42.132939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08f1cf2-6a4b-4a87-9879-e148f6ecf3b7 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:42.177360 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1103/2195] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:41 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:42.662397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2524bb9-500b-430c-bb5d-de99ed41e890 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:42.679054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2524bb9-500b-430c-bb5d-de99ed41e890 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:42.690594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7f0b8-8458-42ca-bc9b-502487d748d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:42.691806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f0b8-8458-42ca-bc9b-502487d748d0 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:42.692168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f0b8-8458-42ca-bc9b-502487d748d0 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:42.692456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7f0b8-8458-42ca-bc9b-502487d748d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:42.854564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7f0b8-8458-42ca-bc9b-502487d748d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:42.864114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c7f0b8-8458-42ca-bc9b-502487d748d0 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:42.892833 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1093/2196] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:52:42 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:52:52.155310 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=1,keystone:SELECT=30 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:52.872472 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=66 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:55.615211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d85d3-720d-4012-9a3b-186695e7d4de None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:55.615692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d85d3-720d-4012-9a3b-186695e7d4de None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:55.615807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586d85d3-720d-4012-9a3b-186695e7d4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:55.663369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-586d85d3-720d-4012-9a3b-186695e7d4de None None] MFA Rules not processed for user `4099c569c4fe489fa349ee29e6974713`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:55.669266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-586d85d3-720d-4012-9a3b-186695e7d4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:55.684205 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1104/2197] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:55 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:58.549642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4389e3d-5b81-42d6-a5ad-76aaf824e84f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:58.550151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4389e3d-5b81-42d6-a5ad-76aaf824e84f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:58.551015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4389e3d-5b81-42d6-a5ad-76aaf824e84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:58.626008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f4389e3d-5b81-42d6-a5ad-76aaf824e84f None None] MFA Rules not processed for user `6ab35e03b5534edc84fc473b75379025`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:58.627490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f4389e3d-5b81-42d6-a5ad-76aaf824e84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:58.779248 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1094/2198] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:58 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:58.783495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d85d3-720d-4012-9a3b-186695e7d4de None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:59.038674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586d85d3-720d-4012-9a3b-186695e7d4de None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:59.052241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d13ee-0aca-4397-82c2-0a871f83dc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:59.053841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d13ee-0aca-4397-82c2-0a871f83dc47 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:59.055024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d13ee-0aca-4397-82c2-0a871f83dc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:59.055708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d13ee-0aca-4397-82c2-0a871f83dc47 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:59.057758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d13ee-0aca-4397-82c2-0a871f83dc47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:59.064818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3d13ee-0aca-4397-82c2-0a871f83dc47 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:59.135838 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1105/2199] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:52:58 2022] POST /identity/v3/projects => generated 401 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:59.139704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4389e3d-5b81-42d6-a5ad-76aaf824e84f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:59.156684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4389e3d-5b81-42d6-a5ad-76aaf824e84f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:59.286331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7956-0870-4da0-941a-c45dcb39b272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:59.287407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7956-0870-4da0-941a-c45dcb39b272 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:59.287932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7956-0870-4da0-941a-c45dcb39b272 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:59.288424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5b7956-0870-4da0-941a-c45dcb39b272 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:59.293468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7956-0870-4da0-941a-c45dcb39b272 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:59.305789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5b7956-0870-4da0-941a-c45dcb39b272 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:59.357088 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1095/2200] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:52:59 2022] POST /identity/v3/users => generated 307 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:52:59.360096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d13ee-0aca-4397-82c2-0a871f83dc47 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:59.375502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d13ee-0aca-4397-82c2-0a871f83dc47 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:59.390064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab5f3e-d337-4e77-8d9c-80f7bf91c79c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:59.391296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab5f3e-d337-4e77-8d9c-80f7bf91c79c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:59.391731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab5f3e-d337-4e77-8d9c-80f7bf91c79c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:59.392156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab5f3e-d337-4e77-8d9c-80f7bf91c79c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:59.393078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab5f3e-d337-4e77-8d9c-80f7bf91c79c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:59.395642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab5f3e-d337-4e77-8d9c-80f7bf91c79c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:59.415402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1106/2201] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:59.419235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7956-0870-4da0-941a-c45dcb39b272 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:59.437241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5b7956-0870-4da0-941a-c45dcb39b272 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:59.450103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f2350a-f0c9-42d0-b640-fd8ce276bbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:59.450768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2350a-f0c9-42d0-b640-fd8ce276bbc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:59.451054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2350a-f0c9-42d0-b640-fd8ce276bbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:59.451399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f2350a-f0c9-42d0-b640-fd8ce276bbc9 admin admin] PATH_INFO: `/v3/projects/e44dce276d1a48158927b2bf8a124123/users/622f51584e0146358707146e2214c005/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:59.481442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2350a-f0c9-42d0-b640-fd8ce276bbc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44dce276d1a48158927b2bf8a124123, user_id=622f51584e0146358707146e2214c005, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:59.484500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f2350a-f0c9-42d0-b640-fd8ce276bbc9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:59.508568 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1096/2202] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:59 2022] PUT /identity/v3/projects/e44dce276d1a48158927b2bf8a124123/users/622f51584e0146358707146e2214c005/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:59.512612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab5f3e-d337-4e77-8d9c-80f7bf91c79c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:59.530817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab5f3e-d337-4e77-8d9c-80f7bf91c79c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:59.602232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b1266-bff3-416c-9f25-c6c03622d175 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:59.602762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b1266-bff3-416c-9f25-c6c03622d175 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:59.602762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165b1266-bff3-416c-9f25-c6c03622d175 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:59.634663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-165b1266-bff3-416c-9f25-c6c03622d175 None None] MFA Rules not processed for user `2b8194e0c6d34a9eb2d70595e8c80569`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:59.635885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-165b1266-bff3-416c-9f25-c6c03622d175 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:52:59.645771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27894415-ca09-4778-976b-8ed397439611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:59.646619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27894415-ca09-4778-976b-8ed397439611 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:59.646907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27894415-ca09-4778-976b-8ed397439611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:59.647186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27894415-ca09-4778-976b-8ed397439611 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:59.647841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27894415-ca09-4778-976b-8ed397439611 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:59.650523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27894415-ca09-4778-976b-8ed397439611 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:59.674618 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1107/2203] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:52:59.675801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27894415-ca09-4778-976b-8ed397439611 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:52:59.687301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27894415-ca09-4778-976b-8ed397439611 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:52:59.694189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300317bd-9d2f-45f1-aa0d-196aa67cb575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:52:59.695115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300317bd-9d2f-45f1-aa0d-196aa67cb575 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:59.695582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300317bd-9d2f-45f1-aa0d-196aa67cb575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:59.696027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300317bd-9d2f-45f1-aa0d-196aa67cb575 admin admin] PATH_INFO: `/v3/projects/e44dce276d1a48158927b2bf8a124123/users/622f51584e0146358707146e2214c005/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:59.696319 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:52:59.698087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300317bd-9d2f-45f1-aa0d-196aa67cb575 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e44dce276d1a48158927b2bf8a124123, user_id=622f51584e0146358707146e2214c005, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:52:59.701620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300317bd-9d2f-45f1-aa0d-196aa67cb575 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:52:59.724315 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1108/2204] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:52:59 2022] PUT /identity/v3/projects/e44dce276d1a48158927b2bf8a124123/users/622f51584e0146358707146e2214c005/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:52:59.785162 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1097/2205] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:52:59.786615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9636d8-7a7a-4154-ba43-47ee27e87f3b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:52:59.787477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9636d8-7a7a-4154-ba43-47ee27e87f3b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:52:59.787913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9636d8-7a7a-4154-ba43-47ee27e87f3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:52:59.843183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8f9636d8-7a7a-4154-ba43-47ee27e87f3b None None] MFA Rules not processed for user `cc0be0ed857d4c96b26724144e20d766`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:52:59.852095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8f9636d8-7a7a-4154-ba43-47ee27e87f3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:00.021820 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:00.043185 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1109/2206] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:52:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:53:00.447474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b1266-bff3-416c-9f25-c6c03622d175 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:00.551627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165b1266-bff3-416c-9f25-c6c03622d175 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:00.728834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425975f5-9ccc-4583-aecf-45ce5e6b16bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:00.730488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425975f5-9ccc-4583-aecf-45ce5e6b16bd service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:00.731080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425975f5-9ccc-4583-aecf-45ce5e6b16bd service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:00.732276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425975f5-9ccc-4583-aecf-45ce5e6b16bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:00.743439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425975f5-9ccc-4583-aecf-45ce5e6b16bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:00.745740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425975f5-9ccc-4583-aecf-45ce5e6b16bd service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:00.761560 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1098/2207] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:00 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:03.798519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc0986-56c8-4bc4-b46e-40785f04f6a3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:03.799749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc0986-56c8-4bc4-b46e-40785f04f6a3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:03.800795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc0986-56c8-4bc4-b46e-40785f04f6a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:03.843315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bdcc0986-56c8-4bc4-b46e-40785f04f6a3 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:03.847897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bdcc0986-56c8-4bc4-b46e-40785f04f6a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:03.974026 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1110/2208] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:53:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:04.012568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425975f5-9ccc-4583-aecf-45ce5e6b16bd service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:04.014309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-425975f5-9ccc-4583-aecf-45ce5e6b16bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:04.211711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425975f5-9ccc-4583-aecf-45ce5e6b16bd service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:04.229641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ca82c-0096-4a80-af20-1dcced244cfa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:04.230282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ca82c-0096-4a80-af20-1dcced244cfa service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:04.230566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ca82c-0096-4a80-af20-1dcced244cfa service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:04.230834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ca82c-0096-4a80-af20-1dcced244cfa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:04.238810 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:04.250162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ca82c-0096-4a80-af20-1dcced244cfa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:04.258416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197ca82c-0096-4a80-af20-1dcced244cfa service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:04.283156 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1099/2209] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:53:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:53:04.801160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc0986-56c8-4bc4-b46e-40785f04f6a3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:04.821568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc0986-56c8-4bc4-b46e-40785f04f6a3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:04.836993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c50c1-5525-4575-ad0c-693ead0584c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:04.838028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c50c1-5525-4575-ad0c-693ead0584c1 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:04.838884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c50c1-5525-4575-ad0c-693ead0584c1 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:04.839335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c50c1-5525-4575-ad0c-693ead0584c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:05.030690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c50c1-5525-4575-ad0c-693ead0584c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:05.033507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c50c1-5525-4575-ad0c-693ead0584c1 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:05.086596 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1111/2210] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:04 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:05.126621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128df6-ad13-4010-ba95-03c95729ee66 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:05.127264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128df6-ad13-4010-ba95-03c95729ee66 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:05.127264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58128df6-ad13-4010-ba95-03c95729ee66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:05.219829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-58128df6-ad13-4010-ba95-03c95729ee66 None None] MFA Rules not processed for user `f6e3382f1fcd40108c9d79cfbdf4337a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:05.227718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-58128df6-ad13-4010-ba95-03c95729ee66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:05.442746 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1100/2211] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:15.051806 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=57 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:15.411984 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=28 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:16.906917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44c66-a8ad-4cc8-93f1-3c60d276037f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:16.907912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44c66-a8ad-4cc8-93f1-3c60d276037f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:16.908441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c44c66-a8ad-4cc8-93f1-3c60d276037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:16.982380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e0c44c66-a8ad-4cc8-93f1-3c60d276037f None None] MFA Rules not processed for user `622f51584e0146358707146e2214c005`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:16.983656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e0c44c66-a8ad-4cc8-93f1-3c60d276037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:17.149932 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1112/2212] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:16 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:18.543545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afeea1-e0e3-4a1e-9a12-5e2c569839e4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:18.544207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afeea1-e0e3-4a1e-9a12-5e2c569839e4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:18.544801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9afeea1-e0e3-4a1e-9a12-5e2c569839e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:18.613732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c9afeea1-e0e3-4a1e-9a12-5e2c569839e4 None None] MFA Rules not processed for user `89ee4538fd234ed7b8137861bfb534d3`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:18.615365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c9afeea1-e0e3-4a1e-9a12-5e2c569839e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:18.740075 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1101/2213] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:18 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:27.146101 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=34 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:27.412804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c44c66-a8ad-4cc8-93f1-3c60d276037f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:27.426834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c44c66-a8ad-4cc8-93f1-3c60d276037f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:27.432732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940c25aa-6d2f-4e00-9954-3e2b579bb959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:27.433503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c25aa-6d2f-4e00-9954-3e2b579bb959 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:27.433892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c25aa-6d2f-4e00-9954-3e2b579bb959 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:27.434272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940c25aa-6d2f-4e00-9954-3e2b579bb959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:27.524781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c25aa-6d2f-4e00-9954-3e2b579bb959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:27.526685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940c25aa-6d2f-4e00-9954-3e2b579bb959 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:27.539696 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1113/2214] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:28.724884 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=25 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:28.760977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb029c-3cbf-4c9d-9078-0ca9c349b34c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:28.761255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb029c-3cbf-4c9d-9078-0ca9c349b34c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:28.761720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb029c-3cbf-4c9d-9078-0ca9c349b34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:28.805975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-13bb029c-3cbf-4c9d-9078-0ca9c349b34c None None] MFA Rules not processed for user `b43a269fe8b746b88c38db6b9e9bfa12`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:28.807311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-13bb029c-3cbf-4c9d-9078-0ca9c349b34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:28.884893 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1102/2215] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:29.545967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265fd02-a65e-4675-a339-5e3ca5a52998 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:29.546420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265fd02-a65e-4675-a339-5e3ca5a52998 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:29.546420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0265fd02-a65e-4675-a339-5e3ca5a52998 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:29.548617 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1114/2216] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:53:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:53:29.556032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f529e-da63-40f1-8009-20248b446d1d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:29.556601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f529e-da63-40f1-8009-20248b446d1d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:29.557124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086f529e-da63-40f1-8009-20248b446d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:29.592338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-086f529e-da63-40f1-8009-20248b446d1d None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:29.593648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-086f529e-da63-40f1-8009-20248b446d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:29.738005 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1103/2217] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:53:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:53:29.776994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265fd02-a65e-4675-a339-5e3ca5a52998 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:29.779125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0265fd02-a65e-4675-a339-5e3ca5a52998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:29.807710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0265fd02-a65e-4675-a339-5e3ca5a52998 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:29.827210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165b6e9-bb62-40fe-8d60-f964f50104a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:29.828025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165b6e9-bb62-40fe-8d60-f964f50104a9 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:29.829193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165b6e9-bb62-40fe-8d60-f964f50104a9 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:29.830845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f165b6e9-bb62-40fe-8d60-f964f50104a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:29.851750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165b6e9-bb62-40fe-8d60-f964f50104a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:29.853481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f165b6e9-bb62-40fe-8d60-f964f50104a9 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:29.870654 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1115/2218] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:34.301872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8b6ca-b75b-4c63-a381-e84e7de79164 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:34.302393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8b6ca-b75b-4c63-a381-e84e7de79164 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:34.302393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb8b6ca-b75b-4c63-a381-e84e7de79164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:34.336079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ddb8b6ca-b75b-4c63-a381-e84e7de79164 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:34.337395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ddb8b6ca-b75b-4c63-a381-e84e7de79164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:34.367964 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1104/2219] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 08:53:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:34.388939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165b6e9-bb62-40fe-8d60-f964f50104a9 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:34.415573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f165b6e9-bb62-40fe-8d60-f964f50104a9 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:34.427195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578258-7336-4290-ae63-ab24d2b62532 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:34.427816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578258-7336-4290-ae63-ab24d2b62532 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:34.428092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578258-7336-4290-ae63-ab24d2b62532 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:34.428363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35578258-7336-4290-ae63-ab24d2b62532 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:34.441192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35578258-7336-4290-ae63-ab24d2b62532 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:34.443487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35578258-7336-4290-ae63-ab24d2b62532 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:34.457665 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1116/2220] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:53:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:53:36.176904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8b6ca-b75b-4c63-a381-e84e7de79164 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:36.259064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb8b6ca-b75b-4c63-a381-e84e7de79164 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:36.264027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:36.264859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:36.265354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:36.265792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] PATH_INFO: `/v3/users/6ab35e03b5534edc84fc473b75379025` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:36.267792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ab35e03b5534edc84fc473b75379025)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:36.270068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:36.328734 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:36.340172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ab35e03b5534edc84fc473b75379025'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:36.355830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ab35e03b5534edc84fc473b75379025'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:36.356705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ab35e03b5534edc84fc473b75379025'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:36.369422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ab35e03b5534edc84fc473b75379025'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:36.381087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ab35e03b5534edc84fc473b75379025'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:36.399734 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1105/2221] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:53:36 2022] DELETE /identity/v3/users/6ab35e03b5534edc84fc473b75379025 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:36.779393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578258-7336-4290-ae63-ab24d2b62532 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:36.799563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35578258-7336-4290-ae63-ab24d2b62532 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:37.030136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:37.031544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:37.032009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:37.032278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] PATH_INFO: `/v3/projects/c939d2bbd9bf44a6851bb04ba3ee73a6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:37.036113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c939d2bbd9bf44a6851bb04ba3ee73a6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:37.048305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:37.157710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c939d2bbd9bf44a6851bb04ba3ee73a6', 'request_id': 'req-a61367a5-2ae3-4faf-9857-ece9772e366f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.172075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c939d2bbd9bf44a6851bb04ba3ee73a6', 'request_id': 'req-a61367a5-2ae3-4faf-9857-ece9772e366f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.200862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c939d2bbd9bf44a6851bb04ba3ee73a6', 'request_id': 'req-a61367a5-2ae3-4faf-9857-ece9772e366f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.211034 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:37.226108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] The token cache is being invalidate because project c939d2bbd9bf44a6851bb04ba3ee73a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:53:37.226800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.227740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.230977 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1117/2222] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:36 2022] DELETE /identity/v3/projects/c939d2bbd9bf44a6851bb04ba3ee73a6 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:37.236966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:37.238607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:37.260377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc1a471-278b-4884-8342-93eff310ba3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:37.345588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:37.346435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:37.346952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:37.347298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] PATH_INFO: `/v3/users/622f51584e0146358707146e2214c005` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:37.348561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=622f51584e0146358707146e2214c005)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:37.351159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:37.425507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '622f51584e0146358707146e2214c005'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.445619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '622f51584e0146358707146e2214c005'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.448136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '622f51584e0146358707146e2214c005'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.461768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '622f51584e0146358707146e2214c005'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.480153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dddee1-34c8-4c45-a6d2-b88cd56d1ad0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '622f51584e0146358707146e2214c005'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:37.502523 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1106/2223] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:53:37 2022] DELETE /identity/v3/users/622f51584e0146358707146e2214c005 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:53:38.084222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:38.086514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:38.129395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61367a5-2ae3-4faf-9857-ece9772e366f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:38.229701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:38.231001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.231511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.231971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] PATH_INFO: `/v3/projects/e44dce276d1a48158927b2bf8a124123` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.233663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=e44dce276d1a48158927b2bf8a124123)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:38.237567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:38.320060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e44dce276d1a48158927b2bf8a124123', 'request_id': 'req-37d17128-fc3c-434f-aea0-4437d01ca3ba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:38.332000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e44dce276d1a48158927b2bf8a124123', 'request_id': 'req-37d17128-fc3c-434f-aea0-4437d01ca3ba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:38.340064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e44dce276d1a48158927b2bf8a124123', 'request_id': 'req-37d17128-fc3c-434f-aea0-4437d01ca3ba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:38.354311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] The token cache is being invalidate because project e44dce276d1a48158927b2bf8a124123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:53:38.354768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:38.355451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37d17128-fc3c-434f-aea0-4437d01ca3ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:38.357319 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1118/2224] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:38 2022] DELETE /identity/v3/projects/e44dce276d1a48158927b2bf8a124123 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:38.362224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7ac7e-b133-423a-850e-1808ed3a43e2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.362729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7ac7e-b133-423a-850e-1808ed3a43e2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.362821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a7ac7e-b133-423a-850e-1808ed3a43e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.402027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-07a7ac7e-b133-423a-850e-1808ed3a43e2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:38.403401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-07a7ac7e-b133-423a-850e-1808ed3a43e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:38.456324 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:38.499652 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1107/2225] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:38.508107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe4f9a-6785-45f3-b167-7f1241660147 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.508652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe4f9a-6785-45f3-b167-7f1241660147 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.508930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe4f9a-6785-45f3-b167-7f1241660147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.531522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-04fe4f9a-6785-45f3-b167-7f1241660147 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:38.532901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-04fe4f9a-6785-45f3-b167-7f1241660147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:38.542209 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1119/2226] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:53:38.546668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7ac7e-b133-423a-850e-1808ed3a43e2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:38.558181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a7ac7e-b133-423a-850e-1808ed3a43e2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:38.563014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ec0df-304e-4ad3-9e70-8d8cbbf499fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:38.563620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ec0df-304e-4ad3-9e70-8d8cbbf499fb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.563895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ec0df-304e-4ad3-9e70-8d8cbbf499fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.564225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ec0df-304e-4ad3-9e70-8d8cbbf499fb admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.565536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ec0df-304e-4ad3-9e70-8d8cbbf499fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:53:38.565856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ec0df-304e-4ad3-9e70-8d8cbbf499fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:38.567586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ec0df-304e-4ad3-9e70-8d8cbbf499fb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:38.584770 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1108/2227] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:53:38.585675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe4f9a-6785-45f3-b167-7f1241660147 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:38.597507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe4f9a-6785-45f3-b167-7f1241660147 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:38.604195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce95e6-fc90-45d7-9150-1942b624261f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:38.604818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce95e6-fc90-45d7-9150-1942b624261f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.605092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce95e6-fc90-45d7-9150-1942b624261f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.605401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecce95e6-fc90-45d7-9150-1942b624261f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.606202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce95e6-fc90-45d7-9150-1942b624261f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:38.608240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecce95e6-fc90-45d7-9150-1942b624261f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:38.669145 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1120/2228] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:53:38 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:38.673233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ec0df-304e-4ad3-9e70-8d8cbbf499fb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:38.684160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ec0df-304e-4ad3-9e70-8d8cbbf499fb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:38.758653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95483129-ecb3-40fb-ad46-53377a6bbf03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:38.759281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95483129-ecb3-40fb-ad46-53377a6bbf03 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.759560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95483129-ecb3-40fb-ad46-53377a6bbf03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.759831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95483129-ecb3-40fb-ad46-53377a6bbf03 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.760470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95483129-ecb3-40fb-ad46-53377a6bbf03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:38.762466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95483129-ecb3-40fb-ad46-53377a6bbf03 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:38.787658 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1109/2229] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:53:38 2022] POST /identity/v3/users => generated 292 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:38.791767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce95e6-fc90-45d7-9150-1942b624261f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:38.803310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecce95e6-fc90-45d7-9150-1942b624261f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:38.808768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115dd90-867f-404d-b995-9be44a53c65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:38.809423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115dd90-867f-404d-b995-9be44a53c65d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.809835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115dd90-867f-404d-b995-9be44a53c65d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.810030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6115dd90-867f-404d-b995-9be44a53c65d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.810851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115dd90-867f-404d-b995-9be44a53c65d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:38.812473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6115dd90-867f-404d-b995-9be44a53c65d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:38.823842 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1121/2230] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:38.827911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95483129-ecb3-40fb-ad46-53377a6bbf03 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:38.839284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95483129-ecb3-40fb-ad46-53377a6bbf03 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:38.845243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2407c5-cf1a-41bf-9579-82f53b63a3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:38.845243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2407c5-cf1a-41bf-9579-82f53b63a3b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.845243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2407c5-cf1a-41bf-9579-82f53b63a3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.845243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2407c5-cf1a-41bf-9579-82f53b63a3b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.848527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2407c5-cf1a-41bf-9579-82f53b63a3b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:38.848527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2407c5-cf1a-41bf-9579-82f53b63a3b7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:38.871210 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1110/2231] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:38.871746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115dd90-867f-404d-b995-9be44a53c65d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:38.889370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6115dd90-867f-404d-b995-9be44a53c65d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:38.901975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90851ba1-ef34-43aa-a6d7-1284c81e2a33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:38.902865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851ba1-ef34-43aa-a6d7-1284c81e2a33 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.903178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851ba1-ef34-43aa-a6d7-1284c81e2a33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.903544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90851ba1-ef34-43aa-a6d7-1284c81e2a33 admin admin] PATH_INFO: `/v3/projects/b52db9de3ab9470faff3ae61da73b2fe/users/2035157c6720483bad24031615f73354/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.920671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90851ba1-ef34-43aa-a6d7-1284c81e2a33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52db9de3ab9470faff3ae61da73b2fe, user_id=2035157c6720483bad24031615f73354, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:38.923472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90851ba1-ef34-43aa-a6d7-1284c81e2a33 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:38.941367 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1122/2232] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:38 2022] PUT /identity/v3/projects/b52db9de3ab9470faff3ae61da73b2fe/users/2035157c6720483bad24031615f73354/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:38.952102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57725d62-c4f1-4588-abde-51d953101601 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:38.952397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57725d62-c4f1-4588-abde-51d953101601 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:38.952677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57725d62-c4f1-4588-abde-51d953101601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:38.990731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-57725d62-c4f1-4588-abde-51d953101601 None None] MFA Rules not processed for user `2035157c6720483bad24031615f73354`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:38.990731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57725d62-c4f1-4588-abde-51d953101601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:39.074175 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1111/2233] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:38 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:39.078780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90851ba1-ef34-43aa-a6d7-1284c81e2a33 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:39.113710 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:39.163776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90851ba1-ef34-43aa-a6d7-1284c81e2a33 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:39.169262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f28f1a-073d-45da-8a4b-a8b956bc68fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:39.170183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f28f1a-073d-45da-8a4b-a8b956bc68fb admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:39.170651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f28f1a-073d-45da-8a4b-a8b956bc68fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:39.170924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f28f1a-073d-45da-8a4b-a8b956bc68fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:39.171666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f28f1a-073d-45da-8a4b-a8b956bc68fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:39.174284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f28f1a-073d-45da-8a4b-a8b956bc68fb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:39.209575 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1123/2234] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:53:39 2022] POST /identity/v3/projects => generated 383 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:39.213382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57725d62-c4f1-4588-abde-51d953101601 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:39.237572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57725d62-c4f1-4588-abde-51d953101601 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:39.263065 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:39.305231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60091c91-eb4b-4a48-85eb-99c47ce21e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:39.305750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60091c91-eb4b-4a48-85eb-99c47ce21e74 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:39.306029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60091c91-eb4b-4a48-85eb-99c47ce21e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:39.306302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60091c91-eb4b-4a48-85eb-99c47ce21e74 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:39.306938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60091c91-eb4b-4a48-85eb-99c47ce21e74 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:39.308894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60091c91-eb4b-4a48-85eb-99c47ce21e74 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:39.335834 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1112/2235] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:53:39 2022] POST /identity/v3/users => generated 298 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:39.337134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f28f1a-073d-45da-8a4b-a8b956bc68fb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:39.353116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f28f1a-073d-45da-8a4b-a8b956bc68fb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:39.360473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960e9f2-a2de-4864-bee4-198f83e1d939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:39.361170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960e9f2-a2de-4864-bee4-198f83e1d939 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:39.361491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960e9f2-a2de-4864-bee4-198f83e1d939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:39.361769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960e9f2-a2de-4864-bee4-198f83e1d939 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:39.362589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960e9f2-a2de-4864-bee4-198f83e1d939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:39.364710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960e9f2-a2de-4864-bee4-198f83e1d939 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:39.396005 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1124/2236] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:39.402950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60091c91-eb4b-4a48-85eb-99c47ce21e74 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:39.418374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60091c91-eb4b-4a48-85eb-99c47ce21e74 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:39.428937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a60d49-85dd-465b-89e9-a47cf739ae87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:39.429935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a60d49-85dd-465b-89e9-a47cf739ae87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:39.430397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a60d49-85dd-465b-89e9-a47cf739ae87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:39.430845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a60d49-85dd-465b-89e9-a47cf739ae87 admin admin] PATH_INFO: `/v3/projects/94d227f6bdd648ad901b226fe25deb87/users/4708dd47148a43ddaf2ac43931db58b7/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:39.452603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a60d49-85dd-465b-89e9-a47cf739ae87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d227f6bdd648ad901b226fe25deb87, user_id=4708dd47148a43ddaf2ac43931db58b7, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:39.456061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a60d49-85dd-465b-89e9-a47cf739ae87 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:39.472441 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1113/2237] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:39 2022] PUT /identity/v3/projects/94d227f6bdd648ad901b226fe25deb87/users/4708dd47148a43ddaf2ac43931db58b7/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:39.478333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960e9f2-a2de-4864-bee4-198f83e1d939 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:39.489263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960e9f2-a2de-4864-bee4-198f83e1d939 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:39.565936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73464c4-6dd8-4f21-a3d8-52bfc81cee45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:39.566546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73464c4-6dd8-4f21-a3d8-52bfc81cee45 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:39.566821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73464c4-6dd8-4f21-a3d8-52bfc81cee45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:39.567094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73464c4-6dd8-4f21-a3d8-52bfc81cee45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:39.567731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73464c4-6dd8-4f21-a3d8-52bfc81cee45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:39.569336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73464c4-6dd8-4f21-a3d8-52bfc81cee45 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:39.580174 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1125/2238] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:39 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:39.583985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a60d49-85dd-465b-89e9-a47cf739ae87 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:39.594327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a60d49-85dd-465b-89e9-a47cf739ae87 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:39.599627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508bbf1-3f1c-46cf-8584-523425c4b236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:39.600276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508bbf1-3f1c-46cf-8584-523425c4b236 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:39.600553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508bbf1-3f1c-46cf-8584-523425c4b236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:39.600826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508bbf1-3f1c-46cf-8584-523425c4b236 admin admin] PATH_INFO: `/v3/projects/94d227f6bdd648ad901b226fe25deb87/users/4708dd47148a43ddaf2ac43931db58b7/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:39.602828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508bbf1-3f1c-46cf-8584-523425c4b236 admin admin] RBAC: Authorizing `identity:create_grant(project_id=94d227f6bdd648ad901b226fe25deb87, user_id=4708dd47148a43ddaf2ac43931db58b7, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:39.605656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b508bbf1-3f1c-46cf-8584-523425c4b236 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:39.616113 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1114/2239] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:39 2022] PUT /identity/v3/projects/94d227f6bdd648ad901b226fe25deb87/users/4708dd47148a43ddaf2ac43931db58b7/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:39.628145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c0b71-11d6-484e-8e38-a64a3befcfae None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:39.628145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c0b71-11d6-484e-8e38-a64a3befcfae None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:39.629231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336c0b71-11d6-484e-8e38-a64a3befcfae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:39.658833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-336c0b71-11d6-484e-8e38-a64a3befcfae None None] MFA Rules not processed for user `4708dd47148a43ddaf2ac43931db58b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:39.660263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-336c0b71-11d6-484e-8e38-a64a3befcfae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:39.738302 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1126/2240] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:39 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:39.750534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508bbf1-3f1c-46cf-8584-523425c4b236 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:39.752891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b508bbf1-3f1c-46cf-8584-523425c4b236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:39.833935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508bbf1-3f1c-46cf-8584-523425c4b236 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:39.839894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766918c7-c1eb-4d44-9e1b-af1e82c3c3fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:39.840496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766918c7-c1eb-4d44-9e1b-af1e82c3c3fa service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:39.840775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766918c7-c1eb-4d44-9e1b-af1e82c3c3fa service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:39.841047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766918c7-c1eb-4d44-9e1b-af1e82c3c3fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:39.850646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766918c7-c1eb-4d44-9e1b-af1e82c3c3fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:39.852344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766918c7-c1eb-4d44-9e1b-af1e82c3c3fa service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:39.863130 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1115/2241] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:39 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:40.846047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c0b71-11d6-484e-8e38-a64a3befcfae None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:40.872668 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:40.930667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336c0b71-11d6-484e-8e38-a64a3befcfae None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:40.938544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:40.939843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:40.940185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:40.940466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] PATH_INFO: `/v3/users/2035157c6720483bad24031615f73354` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:40.941662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2035157c6720483bad24031615f73354)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:40.943717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:41.012923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2035157c6720483bad24031615f73354'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:41.036473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2035157c6720483bad24031615f73354'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:41.037322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2035157c6720483bad24031615f73354'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:41.052694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2035157c6720483bad24031615f73354'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:41.077183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2035157c6720483bad24031615f73354'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:41.086138 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1127/2242] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:53:40 2022] DELETE /identity/v3/users/2035157c6720483bad24031615f73354 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:41.091294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e4d6-fb6b-4157-bf2b-cfe008cab368 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:41.091868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e4d6-fb6b-4157-bf2b-cfe008cab368 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:41.092314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9e4d6-fb6b-4157-bf2b-cfe008cab368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:41.122177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-11b9e4d6-fb6b-4157-bf2b-cfe008cab368 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:41.123661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11b9e4d6-fb6b-4157-bf2b-cfe008cab368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:41.281116 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1116/2243] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:41.296635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:41.298130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:41.462657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bb547-deb3-4f58-b69f-acc0370c4b2d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:41.472967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97304ee-ec4b-4b6c-9fd4-98411ef3234a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:41.475263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97304ee-ec4b-4b6c-9fd4-98411ef3234a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:41.475576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97304ee-ec4b-4b6c-9fd4-98411ef3234a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:41.475857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97304ee-ec4b-4b6c-9fd4-98411ef3234a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:41.525226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97304ee-ec4b-4b6c-9fd4-98411ef3234a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:41.535001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97304ee-ec4b-4b6c-9fd4-98411ef3234a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:41.567341 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1128/2244] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:42.785524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9e4d6-fb6b-4157-bf2b-cfe008cab368 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:42.787621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11b9e4d6-fb6b-4157-bf2b-cfe008cab368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:42.809472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9e4d6-fb6b-4157-bf2b-cfe008cab368 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:42.814787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:42.816957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:42.817451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:42.817892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] PATH_INFO: `/v3/projects/b52db9de3ab9470faff3ae61da73b2fe` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:42.820493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52db9de3ab9470faff3ae61da73b2fe)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:42.822713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:42.825270 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:42.895523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52db9de3ab9470faff3ae61da73b2fe', 'request_id': 'req-0b8a2a2c-4199-440b-93fe-32e607ebf60e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:42.905592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52db9de3ab9470faff3ae61da73b2fe', 'request_id': 'req-0b8a2a2c-4199-440b-93fe-32e607ebf60e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:42.918344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52db9de3ab9470faff3ae61da73b2fe', 'request_id': 'req-0b8a2a2c-4199-440b-93fe-32e607ebf60e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:42.937144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] The token cache is being invalidate because project b52db9de3ab9470faff3ae61da73b2fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:53:42.937681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:42.940559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:42.943351 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1117/2245] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:42 2022] DELETE /identity/v3/projects/b52db9de3ab9470faff3ae61da73b2fe => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:42.947045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97304ee-ec4b-4b6c-9fd4-98411ef3234a service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:42.960824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97304ee-ec4b-4b6c-9fd4-98411ef3234a service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:43.068755 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:43.099970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:43.101144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:43.101144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:43.101394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] PATH_INFO: `/v3/users/4708dd47148a43ddaf2ac43931db58b7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:43.102599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4708dd47148a43ddaf2ac43931db58b7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:43.104789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:43.177507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4708dd47148a43ddaf2ac43931db58b7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:43.194308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4708dd47148a43ddaf2ac43931db58b7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:43.195213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4708dd47148a43ddaf2ac43931db58b7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:43.207200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4708dd47148a43ddaf2ac43931db58b7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:43.230429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19fdadbf-2f1e-4d32-98ea-cb8aa369b182 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4708dd47148a43ddaf2ac43931db58b7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:43.247815 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1129/2246] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:53:42 2022] DELETE /identity/v3/users/4708dd47148a43ddaf2ac43931db58b7 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:44.170175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:44.171729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:44.200930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a2a2c-4199-440b-93fe-32e607ebf60e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:44.380803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:44.381541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:44.381821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:44.382094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] PATH_INFO: `/v3/projects/94d227f6bdd648ad901b226fe25deb87` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:44.387549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=94d227f6bdd648ad901b226fe25deb87)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:44.389555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:44.478972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94d227f6bdd648ad901b226fe25deb87', 'request_id': 'req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:44.509015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94d227f6bdd648ad901b226fe25deb87', 'request_id': 'req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:44.521390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94d227f6bdd648ad901b226fe25deb87', 'request_id': 'req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:44.537541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] The token cache is being invalidate because project 94d227f6bdd648ad901b226fe25deb87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:53:44.537833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:44.538545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7f7309a6-29c5-433c-a8f1-62e5bac1e4cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:44.544688 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1118/2247] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:44 2022] DELETE /identity/v3/projects/94d227f6bdd648ad901b226fe25deb87 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:44.545955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698d027-c005-45bd-aa5a-a21310c5d99e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:44.546406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698d027-c005-45bd-aa5a-a21310c5d99e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:44.546657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9698d027-c005-45bd-aa5a-a21310c5d99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:44.571043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9698d027-c005-45bd-aa5a-a21310c5d99e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:44.573066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9698d027-c005-45bd-aa5a-a21310c5d99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:44.653336 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1130/2248] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:53:44.661859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c33f2-560b-44a0-b46d-f1f835971861 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:44.662253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c33f2-560b-44a0-b46d-f1f835971861 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:44.662623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c33f2-560b-44a0-b46d-f1f835971861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:44.687872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-340c33f2-560b-44a0-b46d-f1f835971861 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:44.689263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-340c33f2-560b-44a0-b46d-f1f835971861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:44.698406 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1119/2249] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:44.709344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698d027-c005-45bd-aa5a-a21310c5d99e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:44.716776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9698d027-c005-45bd-aa5a-a21310c5d99e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:44.728980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5d4c-3988-4ca9-af04-c8b026f56c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:44.729638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5d4c-3988-4ca9-af04-c8b026f56c91 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:44.729919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5d4c-3988-4ca9-af04-c8b026f56c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:44.730782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43e5d4c-3988-4ca9-af04-c8b026f56c91 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:44.731626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5d4c-3988-4ca9-af04-c8b026f56c91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:53:44.732160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5d4c-3988-4ca9-af04-c8b026f56c91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:44.734467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43e5d4c-3988-4ca9-af04-c8b026f56c91 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:44.753673 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1131/2250] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:53:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:53:44.755179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c33f2-560b-44a0-b46d-f1f835971861 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:44.768340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c33f2-560b-44a0-b46d-f1f835971861 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:44.774574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb8332-9b9b-46cc-a3f1-2a161cdddd77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:44.776197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb8332-9b9b-46cc-a3f1-2a161cdddd77 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:44.776843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb8332-9b9b-46cc-a3f1-2a161cdddd77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:44.777347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb8332-9b9b-46cc-a3f1-2a161cdddd77 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:44.778183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb8332-9b9b-46cc-a3f1-2a161cdddd77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:44.780313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb8332-9b9b-46cc-a3f1-2a161cdddd77 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:44.796792 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:44.819399 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1120/2251] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:53:44 2022] POST /identity/v3/projects => generated 409 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:44.823525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5d4c-3988-4ca9-af04-c8b026f56c91 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:44.836604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43e5d4c-3988-4ca9-af04-c8b026f56c91 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:44.907540 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:44.928715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325d8e9-ea10-432d-a692-e922c4284397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:44.929694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325d8e9-ea10-432d-a692-e922c4284397 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:44.930078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325d8e9-ea10-432d-a692-e922c4284397 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:44.930450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d325d8e9-ea10-432d-a692-e922c4284397 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:44.931193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325d8e9-ea10-432d-a692-e922c4284397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:44.934170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d325d8e9-ea10-432d-a692-e922c4284397 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:44.964351 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1132/2252] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:53:44 2022] POST /identity/v3/users => generated 305 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:53:44.970895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb8332-9b9b-46cc-a3f1-2a161cdddd77 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:45.001557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb8332-9b9b-46cc-a3f1-2a161cdddd77 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:45.018110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1e170-4083-4ac8-a8f6-afd4c41fa5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:45.020603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1e170-4083-4ac8-a8f6-afd4c41fa5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:45.021077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1e170-4083-4ac8-a8f6-afd4c41fa5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:45.022516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1e170-4083-4ac8-a8f6-afd4c41fa5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:45.024329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1e170-4083-4ac8-a8f6-afd4c41fa5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:45.027651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1e170-4083-4ac8-a8f6-afd4c41fa5f7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:45.053433 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1121/2253] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:53:45.057619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325d8e9-ea10-432d-a692-e922c4284397 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:45.072018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d325d8e9-ea10-432d-a692-e922c4284397 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:45.086211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669bebe-0451-42c4-9d75-b2b76ddd9464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:45.087406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669bebe-0451-42c4-9d75-b2b76ddd9464 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:45.087759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669bebe-0451-42c4-9d75-b2b76ddd9464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:45.088040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669bebe-0451-42c4-9d75-b2b76ddd9464 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:45.092605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669bebe-0451-42c4-9d75-b2b76ddd9464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:45.095055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4669bebe-0451-42c4-9d75-b2b76ddd9464 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:45.113991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fef8f-2d53-49c6-938f-4ca8f0ad8de7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:45.114540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fef8f-2d53-49c6-938f-4ca8f0ad8de7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:45.115104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160fef8f-2d53-49c6-938f-4ca8f0ad8de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:45.123878 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1133/2254] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:45.124863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669bebe-0451-42c4-9d75-b2b76ddd9464 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:45.135704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4669bebe-0451-42c4-9d75-b2b76ddd9464 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:45.141686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-160fef8f-2d53-49c6-938f-4ca8f0ad8de7 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:45.143666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-160fef8f-2d53-49c6-938f-4ca8f0ad8de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:45.150079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67fa30f-edc8-48bf-a036-e8cf6f4a162e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:45.150866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa30f-edc8-48bf-a036-e8cf6f4a162e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:45.151665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa30f-edc8-48bf-a036-e8cf6f4a162e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:45.151665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67fa30f-edc8-48bf-a036-e8cf6f4a162e admin admin] PATH_INFO: `/v3/projects/824e1f383b93404297b7febbc7f2447a/users/c16b206016704fb48d001774c4f3baa3/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:45.190831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fa30f-edc8-48bf-a036-e8cf6f4a162e admin admin] RBAC: Authorizing `identity:create_grant(project_id=824e1f383b93404297b7febbc7f2447a, user_id=c16b206016704fb48d001774c4f3baa3, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:45.192201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67fa30f-edc8-48bf-a036-e8cf6f4a162e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:45.210394 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1134/2255] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:45 2022] PUT /identity/v3/projects/824e1f383b93404297b7febbc7f2447a/users/c16b206016704fb48d001774c4f3baa3/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:45.221061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ebf1-52c9-4b57-9b0c-55c38e02be3c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:45.221470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ebf1-52c9-4b57-9b0c-55c38e02be3c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:45.221828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864ebf1-52c9-4b57-9b0c-55c38e02be3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:45.254587 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1122/2256] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:53:45 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:53:45.261507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0864ebf1-52c9-4b57-9b0c-55c38e02be3c None None] MFA Rules not processed for user `c16b206016704fb48d001774c4f3baa3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:45.263284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0864ebf1-52c9-4b57-9b0c-55c38e02be3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:45.269970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fef8f-2d53-49c6-938f-4ca8f0ad8de7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:45.272685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-160fef8f-2d53-49c6-938f-4ca8f0ad8de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:45.406514 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1135/2257] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:45 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:53:45.412332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ebf1-52c9-4b57-9b0c-55c38e02be3c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:45.465505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160fef8f-2d53-49c6-938f-4ca8f0ad8de7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:45.622629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864ebf1-52c9-4b57-9b0c-55c38e02be3c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:45.634512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207814b-e337-4c6b-a098-168b82d75398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:45.636267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207814b-e337-4c6b-a098-168b82d75398 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:45.642992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207814b-e337-4c6b-a098-168b82d75398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:45.644066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6207814b-e337-4c6b-a098-168b82d75398 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:45.645126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207814b-e337-4c6b-a098-168b82d75398 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:45.648506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6207814b-e337-4c6b-a098-168b82d75398 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:45.660047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51ba9a-b8d4-476e-8df1-46179e01dc4b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:45.660769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51ba9a-b8d4-476e-8df1-46179e01dc4b service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:45.660971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51ba9a-b8d4-476e-8df1-46179e01dc4b service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:45.661255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51ba9a-b8d4-476e-8df1-46179e01dc4b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:45.721614 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1136/2258] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:53:45 2022] POST /identity/v3/projects => generated 409 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:45.722865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207814b-e337-4c6b-a098-168b82d75398 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:45.748756 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:45.809343 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:45.824559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51ba9a-b8d4-476e-8df1-46179e01dc4b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:45.826246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d51ba9a-b8d4-476e-8df1-46179e01dc4b service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:45.851422 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1123/2259] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:53:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 582 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 08:53:46.011650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6207814b-e337-4c6b-a098-168b82d75398 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:46.043361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13007153-7ccf-4f99-93d3-d2f6ecc416a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:46.044045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13007153-7ccf-4f99-93d3-d2f6ecc416a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:46.044268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13007153-7ccf-4f99-93d3-d2f6ecc416a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:46.044536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13007153-7ccf-4f99-93d3-d2f6ecc416a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:46.045189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13007153-7ccf-4f99-93d3-d2f6ecc416a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:46.062253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13007153-7ccf-4f99-93d3-d2f6ecc416a4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:46.155881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51ba9a-b8d4-476e-8df1-46179e01dc4b service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:46.160587 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1137/2260] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:53:45 2022] POST /identity/v3/users => generated 311 bytes in 438 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:46.180344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51ba9a-b8d4-476e-8df1-46179e01dc4b service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:46.210380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019e55-74c8-4507-b564-937ba64dd85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:46.211064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019e55-74c8-4507-b564-937ba64dd85d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:46.211352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019e55-74c8-4507-b564-937ba64dd85d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:46.211639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c019e55-74c8-4507-b564-937ba64dd85d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:46.213025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c019e55-74c8-4507-b564-937ba64dd85d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:46.217592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c019e55-74c8-4507-b564-937ba64dd85d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:46.255332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13007153-7ccf-4f99-93d3-d2f6ecc416a4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:46.261401 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1124/2261] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:53:46.270326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13007153-7ccf-4f99-93d3-d2f6ecc416a4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:46.294837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16ced7-878a-48e1-941b-456962215f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:46.295733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16ced7-878a-48e1-941b-456962215f54 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:46.296021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16ced7-878a-48e1-941b-456962215f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:46.296304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec16ced7-878a-48e1-941b-456962215f54 admin admin] PATH_INFO: `/v3/projects/1e1e95a6a96f49d8be46f4a1e6fa1754/users/b46107f242a5410e95a484ac2ccf1308/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:46.332991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16ced7-878a-48e1-941b-456962215f54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1e95a6a96f49d8be46f4a1e6fa1754, user_id=b46107f242a5410e95a484ac2ccf1308, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:46.336613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec16ced7-878a-48e1-941b-456962215f54 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:46.365081 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1138/2262] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:46 2022] PUT /identity/v3/projects/1e1e95a6a96f49d8be46f4a1e6fa1754/users/b46107f242a5410e95a484ac2ccf1308/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:46.366057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019e55-74c8-4507-b564-937ba64dd85d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:46.383469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c019e55-74c8-4507-b564-937ba64dd85d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:46.658538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeceb43-c39f-4c6e-9a46-474ad3e59ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:46.659278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeceb43-c39f-4c6e-9a46-474ad3e59ae2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:46.659470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeceb43-c39f-4c6e-9a46-474ad3e59ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:46.659741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeceb43-c39f-4c6e-9a46-474ad3e59ae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:46.660390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeceb43-c39f-4c6e-9a46-474ad3e59ae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:46.669409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeceb43-c39f-4c6e-9a46-474ad3e59ae2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:46.713115 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1125/2263] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:46 2022] GET /identity/v3/roles => generated 1420 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:46.717973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16ced7-878a-48e1-941b-456962215f54 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:46.739274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec16ced7-878a-48e1-941b-456962215f54 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:46.753862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea31e0-c922-47c6-86f0-fd71782092f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:46.754558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea31e0-c922-47c6-86f0-fd71782092f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:46.754844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea31e0-c922-47c6-86f0-fd71782092f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:46.755125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ea31e0-c922-47c6-86f0-fd71782092f0 admin admin] PATH_INFO: `/v3/projects/1e1e95a6a96f49d8be46f4a1e6fa1754/users/b46107f242a5410e95a484ac2ccf1308/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:46.757138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea31e0-c922-47c6-86f0-fd71782092f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1e95a6a96f49d8be46f4a1e6fa1754, user_id=b46107f242a5410e95a484ac2ccf1308, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:46.759977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ea31e0-c922-47c6-86f0-fd71782092f0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:46.799085 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1139/2264] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:46 2022] PUT /identity/v3/projects/1e1e95a6a96f49d8be46f4a1e6fa1754/users/b46107f242a5410e95a484ac2ccf1308/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:46.865096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ffe7a-bf6a-4091-a347-86fd3a6c3330 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:46.865538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ffe7a-bf6a-4091-a347-86fd3a6c3330 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:46.865849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9ffe7a-bf6a-4091-a347-86fd3a6c3330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:46.957754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8a9ffe7a-bf6a-4091-a347-86fd3a6c3330 None None] MFA Rules not processed for user `b46107f242a5410e95a484ac2ccf1308`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:46.964101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8a9ffe7a-bf6a-4091-a347-86fd3a6c3330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:47.184461 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1126/2265] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:46 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:47.191901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea31e0-c922-47c6-86f0-fd71782092f0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:47.382283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ea31e0-c922-47c6-86f0-fd71782092f0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:47.396963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15539236-6d81-463e-935a-01325837adce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:47.397721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15539236-6d81-463e-935a-01325837adce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:47.398225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15539236-6d81-463e-935a-01325837adce admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:47.400777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15539236-6d81-463e-935a-01325837adce admin admin] PATH_INFO: `/v3/users/c16b206016704fb48d001774c4f3baa3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:47.403333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15539236-6d81-463e-935a-01325837adce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c16b206016704fb48d001774c4f3baa3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:47.410570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15539236-6d81-463e-935a-01325837adce admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:47.531631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15539236-6d81-463e-935a-01325837adce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c16b206016704fb48d001774c4f3baa3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:47.553188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15539236-6d81-463e-935a-01325837adce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c16b206016704fb48d001774c4f3baa3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:47.554961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15539236-6d81-463e-935a-01325837adce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c16b206016704fb48d001774c4f3baa3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:47.569907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15539236-6d81-463e-935a-01325837adce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c16b206016704fb48d001774c4f3baa3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:47.572869 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:47.584214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15539236-6d81-463e-935a-01325837adce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c16b206016704fb48d001774c4f3baa3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:47.594205 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1140/2266] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:53:47 2022] DELETE /identity/v3/users/c16b206016704fb48d001774c4f3baa3 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:47.598562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a377309-3e54-4584-8b58-596170a3fa87 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:47.602845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a377309-3e54-4584-8b58-596170a3fa87 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:47.603495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a377309-3e54-4584-8b58-596170a3fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:47.678871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4a377309-3e54-4584-8b58-596170a3fa87 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:47.681737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a377309-3e54-4584-8b58-596170a3fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:47.787765 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:47.844098 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1127/2267] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:53:47.921495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15539236-6d81-463e-935a-01325837adce admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:47.924020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-15539236-6d81-463e-935a-01325837adce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:48.138554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15539236-6d81-463e-935a-01325837adce admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:48.152281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2c3ac-5a82-44f0-9821-4fb7e3ab8894 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:48.153671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2c3ac-5a82-44f0-9821-4fb7e3ab8894 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:48.153671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2c3ac-5a82-44f0-9821-4fb7e3ab8894 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:48.153997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb2c3ac-5a82-44f0-9821-4fb7e3ab8894 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:48.193065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2c3ac-5a82-44f0-9821-4fb7e3ab8894 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:48.194936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb2c3ac-5a82-44f0-9821-4fb7e3ab8894 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:48.254057 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1141/2268] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:48.307963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a377309-3e54-4584-8b58-596170a3fa87 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:48.310868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a377309-3e54-4584-8b58-596170a3fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:48.511530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a377309-3e54-4584-8b58-596170a3fa87 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:48.522424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65febac-6939-496b-a5f4-afd0936f75b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:48.523074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65febac-6939-496b-a5f4-afd0936f75b7 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:48.523358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65febac-6939-496b-a5f4-afd0936f75b7 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:48.523655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65febac-6939-496b-a5f4-afd0936f75b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:48.531065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b65febac-6939-496b-a5f4-afd0936f75b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:48.582601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65febac-6939-496b-a5f4-afd0936f75b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:48.586939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65febac-6939-496b-a5f4-afd0936f75b7 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:48.620361 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1128/2269] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:53:49.878714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2c3ac-5a82-44f0-9821-4fb7e3ab8894 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:49.882437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-feb2c3ac-5a82-44f0-9821-4fb7e3ab8894 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:49.965431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb2c3ac-5a82-44f0-9821-4fb7e3ab8894 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:49.978732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:49.979396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:49.979674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:49.979949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] PATH_INFO: `/v3/projects/824e1f383b93404297b7febbc7f2447a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:49.986686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] RBAC: Authorizing `identity:delete_project(project_id=824e1f383b93404297b7febbc7f2447a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:49.991112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:50.210548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '824e1f383b93404297b7febbc7f2447a', 'request_id': 'req-9452053b-437e-4ff0-acfc-c908803d2921'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.241054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '824e1f383b93404297b7febbc7f2447a', 'request_id': 'req-9452053b-437e-4ff0-acfc-c908803d2921'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.269089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '824e1f383b93404297b7febbc7f2447a', 'request_id': 'req-9452053b-437e-4ff0-acfc-c908803d2921'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.354763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] The token cache is being invalidate because project 824e1f383b93404297b7febbc7f2447a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:53:50.355063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.365337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.389548 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1142/2270] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:49 2022] DELETE /identity/v3/projects/824e1f383b93404297b7febbc7f2447a => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:50.391667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65febac-6939-496b-a5f4-afd0936f75b7 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:50.409200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65febac-6939-496b-a5f4-afd0936f75b7 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:50.630287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:50.631131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:50.631448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:50.634078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] PATH_INFO: `/v3/users/b46107f242a5410e95a484ac2ccf1308` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:50.638320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b46107f242a5410e95a484ac2ccf1308)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:50.647073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:50.786900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b46107f242a5410e95a484ac2ccf1308'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.815501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b46107f242a5410e95a484ac2ccf1308'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.816347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b46107f242a5410e95a484ac2ccf1308'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.845853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b46107f242a5410e95a484ac2ccf1308'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.847756 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:50.862963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b56b1116-9141-464a-902f-7f76c66f254d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b46107f242a5410e95a484ac2ccf1308'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:50.883157 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1129/2271] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:53:50 2022] DELETE /identity/v3/users/b46107f242a5410e95a484ac2ccf1308 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:50.971247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:50.974362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:51.020843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9452053b-437e-4ff0-acfc-c908803d2921 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:51.284075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:51.284972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:51.285184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:51.285492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] PATH_INFO: `/v3/users/f6e3382f1fcd40108c9d79cfbdf4337a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:51.290181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6e3382f1fcd40108c9d79cfbdf4337a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:51.292222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:51.336152 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:51.421449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6e3382f1fcd40108c9d79cfbdf4337a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:51.448090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6e3382f1fcd40108c9d79cfbdf4337a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:51.450096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6e3382f1fcd40108c9d79cfbdf4337a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:51.466225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6e3382f1fcd40108c9d79cfbdf4337a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:51.478094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6e3382f1fcd40108c9d79cfbdf4337a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:51.494604 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1143/2272] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:53:50 2022] DELETE /identity/v3/users/f6e3382f1fcd40108c9d79cfbdf4337a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:51.496076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7768c-4288-48fa-9ccd-326171a29733 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:51.496864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7768c-4288-48fa-9ccd-326171a29733 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:51.497028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a7768c-4288-48fa-9ccd-326171a29733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:51.599430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-31a7768c-4288-48fa-9ccd-326171a29733 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:51.600985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31a7768c-4288-48fa-9ccd-326171a29733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:51.790109 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1130/2273] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:51.996820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:51.998347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:52.164112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e180f3a-71b2-4b61-8262-24de93fe9291 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:52.174077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671f87e7-ea6f-42b1-bc45-cb08021a6392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:52.174716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f87e7-ea6f-42b1-bc45-cb08021a6392 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:52.174996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f87e7-ea6f-42b1-bc45-cb08021a6392 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:52.175270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671f87e7-ea6f-42b1-bc45-cb08021a6392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:52.202273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f87e7-ea6f-42b1-bc45-cb08021a6392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:52.204030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671f87e7-ea6f-42b1-bc45-cb08021a6392 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:52.223776 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1144/2274] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:53.680992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7768c-4288-48fa-9ccd-326171a29733 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:53.682799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31a7768c-4288-48fa-9ccd-326171a29733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:53.714189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a7768c-4288-48fa-9ccd-326171a29733 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:53.734807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:53.740332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:53.741320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:53.743813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] PATH_INFO: `/v3/projects/1e1e95a6a96f49d8be46f4a1e6fa1754` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:53.748551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1e95a6a96f49d8be46f4a1e6fa1754)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:53.754713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:53.960775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1e95a6a96f49d8be46f4a1e6fa1754', 'request_id': 'req-d72fe147-a762-40a8-8898-5fde148623b0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:53.977771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1e95a6a96f49d8be46f4a1e6fa1754', 'request_id': 'req-d72fe147-a762-40a8-8898-5fde148623b0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:54.004492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1e95a6a96f49d8be46f4a1e6fa1754', 'request_id': 'req-d72fe147-a762-40a8-8898-5fde148623b0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:54.025097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] The token cache is being invalidate because project 1e1e95a6a96f49d8be46f4a1e6fa1754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:53:54.025838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:54.026751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d72fe147-a762-40a8-8898-5fde148623b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:54.029711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1131/2275] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:53 2022] DELETE /identity/v3/projects/1e1e95a6a96f49d8be46f4a1e6fa1754 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:54.037864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48257f-1e37-4e10-bec7-5f189e2dc5ce None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:54.038440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48257f-1e37-4e10-bec7-5f189e2dc5ce None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:54.044822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a48257f-1e37-4e10-bec7-5f189e2dc5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:54.136649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0a48257f-1e37-4e10-bec7-5f189e2dc5ce None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:54.158449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0a48257f-1e37-4e10-bec7-5f189e2dc5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:54.417403 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1145/2276] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:54.425522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2588-fe19-4e5e-b153-f975ef8421b4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:54.426798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2588-fe19-4e5e-b153-f975ef8421b4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:54.427030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a2588-fe19-4e5e-b153-f975ef8421b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:54.435521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48257f-1e37-4e10-bec7-5f189e2dc5ce None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:54.437248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0a48257f-1e37-4e10-bec7-5f189e2dc5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:54.479596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-485a2588-fe19-4e5e-b153-f975ef8421b4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:54.483463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-485a2588-fe19-4e5e-b153-f975ef8421b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:54.497840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a48257f-1e37-4e10-bec7-5f189e2dc5ce None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:54.509759 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1132/2277] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:54.511671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2588-fe19-4e5e-b153-f975ef8421b4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:54.519506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:54.520218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:54.520534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:54.520786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] PATH_INFO: `/v3/projects/961eeb9727ed45d9874a81d495c0069a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:54.527287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=961eeb9727ed45d9874a81d495c0069a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:54.534527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:54.536343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a2588-fe19-4e5e-b153-f975ef8421b4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:54.548157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6881c-1a41-4906-8f1e-ae993f701332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:54.548787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6881c-1a41-4906-8f1e-ae993f701332 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:54.549089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6881c-1a41-4906-8f1e-ae993f701332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:54.549382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d6881c-1a41-4906-8f1e-ae993f701332 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:54.550076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6881c-1a41-4906-8f1e-ae993f701332 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:53:54.550386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6881c-1a41-4906-8f1e-ae993f701332 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:54.558657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d6881c-1a41-4906-8f1e-ae993f701332 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:54.598721 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1133/2278] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:53:54.600229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6881c-1a41-4906-8f1e-ae993f701332 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:54.625882 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:54.629532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d6881c-1a41-4906-8f1e-ae993f701332 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:54.670213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '961eeb9727ed45d9874a81d495c0069a', 'request_id': 'req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:54.684995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '961eeb9727ed45d9874a81d495c0069a', 'request_id': 'req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:54.693171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '961eeb9727ed45d9874a81d495c0069a', 'request_id': 'req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:54.721198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] The token cache is being invalidate because project 961eeb9727ed45d9874a81d495c0069a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:53:54.721523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:54.722536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:54.724650 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1146/2279] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:54 2022] DELETE /identity/v3/projects/961eeb9727ed45d9874a81d495c0069a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:54.729076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:54.747639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:54.841445 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:54.880526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d66dd-281a-4a28-9b5e-6cf459f5ff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:54.882736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d66dd-281a-4a28-9b5e-6cf459f5ff0d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:54.884786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d66dd-281a-4a28-9b5e-6cf459f5ff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:54.885366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194d66dd-281a-4a28-9b5e-6cf459f5ff0d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:54.888134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d66dd-281a-4a28-9b5e-6cf459f5ff0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:54.897565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194d66dd-281a-4a28-9b5e-6cf459f5ff0d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:54.975444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f8ac1b-820e-4b8b-b9da-a23948d799c0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:54.986579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:54.988398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:54.988703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:54.988982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:54.993012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:55.006398 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1134/2280] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:53:54 2022] POST /identity/v3/projects => generated 391 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:55.007085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d66dd-281a-4a28-9b5e-6cf459f5ff0d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:55.008713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-194d66dd-281a-4a28-9b5e-6cf459f5ff0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:55.035213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:55.037580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:55.068182 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1147/2281] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:55.068795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:55.075629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:55.108850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c4a2ac-865c-4688-aa92-8ae668c35926 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:55.162226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194d66dd-281a-4a28-9b5e-6cf459f5ff0d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:55.176719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:55.178129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:55.181367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:55.181783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] PATH_INFO: `/v3/users/3cf59bb388b348268df3b67e9dfae7cc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:55.187898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cf59bb388b348268df3b67e9dfae7cc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:55.193114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:55.281689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88736-2f3e-4cf0-9f5b-0b6c01c42515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:55.284997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88736-2f3e-4cf0-9f5b-0b6c01c42515 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:55.285487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88736-2f3e-4cf0-9f5b-0b6c01c42515 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:55.285840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d88736-2f3e-4cf0-9f5b-0b6c01c42515 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:55.286611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88736-2f3e-4cf0-9f5b-0b6c01c42515 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:55.294492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d88736-2f3e-4cf0-9f5b-0b6c01c42515 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:55.449970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cf59bb388b348268df3b67e9dfae7cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:55.457664 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1148/2282] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:53:55 2022] POST /identity/v3/users => generated 296 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:55.461953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88736-2f3e-4cf0-9f5b-0b6c01c42515 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:55.501621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cf59bb388b348268df3b67e9dfae7cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:55.503314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cf59bb388b348268df3b67e9dfae7cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:55.515741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d88736-2f3e-4cf0-9f5b-0b6c01c42515 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:55.519904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cf59bb388b348268df3b67e9dfae7cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:55.530787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d442d70-03c0-49aa-b568-d1306418e529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:55.533630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d442d70-03c0-49aa-b568-d1306418e529 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:55.533941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d442d70-03c0-49aa-b568-d1306418e529 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:55.534274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d442d70-03c0-49aa-b568-d1306418e529 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:55.535122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d442d70-03c0-49aa-b568-d1306418e529 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:55.539122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cf59bb388b348268df3b67e9dfae7cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:55.540124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d442d70-03c0-49aa-b568-d1306418e529 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:55.557117 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1135/2283] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:53:55 2022] DELETE /identity/v3/users/3cf59bb388b348268df3b67e9dfae7cc => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:55.561769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1149/2284] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:55.565711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:55.567320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:55.648209 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:55.652954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cef228c-bed5-46e3-aa8a-9a90180978da admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:55.662774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56d02ee-a99b-43db-966e-e039146bb3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:55.663729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d02ee-a99b-43db-966e-e039146bb3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:55.664241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d02ee-a99b-43db-966e-e039146bb3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:55.665494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56d02ee-a99b-43db-966e-e039146bb3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:55.666731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d02ee-a99b-43db-966e-e039146bb3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:55.669418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56d02ee-a99b-43db-966e-e039146bb3e0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:55.687487 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1136/2285] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:55 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:55.690600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d442d70-03c0-49aa-b568-d1306418e529 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:55.705812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d442d70-03c0-49aa-b568-d1306418e529 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:55.711603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886ea5-3c47-4c8e-8aff-acc0cebf1b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:55.712606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886ea5-3c47-4c8e-8aff-acc0cebf1b60 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:55.712897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886ea5-3c47-4c8e-8aff-acc0cebf1b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:55.713178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886ea5-3c47-4c8e-8aff-acc0cebf1b60 admin admin] PATH_INFO: `/v3/projects/22fe645c49214c7d84b9081e3f481de9/users/9fa08ec12fa74ec3af765850e8bbc609/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:55.743789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f886ea5-3c47-4c8e-8aff-acc0cebf1b60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22fe645c49214c7d84b9081e3f481de9, user_id=9fa08ec12fa74ec3af765850e8bbc609, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:55.748080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f886ea5-3c47-4c8e-8aff-acc0cebf1b60 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:55.780105 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1150/2286] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:55 2022] PUT /identity/v3/projects/22fe645c49214c7d84b9081e3f481de9/users/9fa08ec12fa74ec3af765850e8bbc609/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:55.792751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95ed8f-6c12-4974-803a-86c19f8cbbf0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:55.793238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95ed8f-6c12-4974-803a-86c19f8cbbf0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:55.793859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95ed8f-6c12-4974-803a-86c19f8cbbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:55.863793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cd95ed8f-6c12-4974-803a-86c19f8cbbf0 None None] MFA Rules not processed for user `9fa08ec12fa74ec3af765850e8bbc609`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:55.865847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cd95ed8f-6c12-4974-803a-86c19f8cbbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:56.064726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886ea5-3c47-4c8e-8aff-acc0cebf1b60 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:56.065714 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1137/2287] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:55 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:56.070864 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:56.205791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886ea5-3c47-4c8e-8aff-acc0cebf1b60 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:56.220084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c649602-0eb3-496e-aebe-5095f921b4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:56.220738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c649602-0eb3-496e-aebe-5095f921b4b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:56.221023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c649602-0eb3-496e-aebe-5095f921b4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:56.221330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c649602-0eb3-496e-aebe-5095f921b4b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:56.221985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c649602-0eb3-496e-aebe-5095f921b4b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:56.223994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c649602-0eb3-496e-aebe-5095f921b4b3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:56.305673 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1151/2288] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:53:56 2022] POST /identity/v3/projects => generated 393 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:53:56.309228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95ed8f-6c12-4974-803a-86c19f8cbbf0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:56.331331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95ed8f-6c12-4974-803a-86c19f8cbbf0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:56.456679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c649602-0eb3-496e-aebe-5095f921b4b3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:56.460213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2c649602-0eb3-496e-aebe-5095f921b4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:56.500742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b53af-86a8-40bf-a6c0-f53537a2848f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:56.511363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b53af-86a8-40bf-a6c0-f53537a2848f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:56.511842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b53af-86a8-40bf-a6c0-f53537a2848f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:56.514556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0b53af-86a8-40bf-a6c0-f53537a2848f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:56.521123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b53af-86a8-40bf-a6c0-f53537a2848f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:56.527485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c649602-0eb3-496e-aebe-5095f921b4b3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:56.532385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0b53af-86a8-40bf-a6c0-f53537a2848f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:56.555381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:56.556326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:56.556612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:56.556915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] PATH_INFO: `/v3/projects/bb51316d29514a1092aa662ee0875f04` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:56.566712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb51316d29514a1092aa662ee0875f04)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:56.573433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:56.664569 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1138/2289] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:53:56 2022] POST /identity/v3/users => generated 303 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:56.665684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b53af-86a8-40bf-a6c0-f53537a2848f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:56.697957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb51316d29514a1092aa662ee0875f04', 'request_id': 'req-81906fa4-90ec-4416-81d4-0e0509395bef'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:56.708282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb51316d29514a1092aa662ee0875f04', 'request_id': 'req-81906fa4-90ec-4416-81d4-0e0509395bef'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:56.722003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0b53af-86a8-40bf-a6c0-f53537a2848f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:56.725404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb51316d29514a1092aa662ee0875f04', 'request_id': 'req-81906fa4-90ec-4416-81d4-0e0509395bef'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:56.752516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] The token cache is being invalidate because project bb51316d29514a1092aa662ee0875f04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:53:56.752817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:56.753849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-81906fa4-90ec-4416-81d4-0e0509395bef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:56.755887 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1152/2290] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:53:56 2022] DELETE /identity/v3/projects/bb51316d29514a1092aa662ee0875f04 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:53:56.762401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5310b54-7cfd-4c4d-b82d-996a2f7b3f49 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:56.762686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5310b54-7cfd-4c4d-b82d-996a2f7b3f49 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:56.762963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5310b54-7cfd-4c4d-b82d-996a2f7b3f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:56.806178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d5310b54-7cfd-4c4d-b82d-996a2f7b3f49 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:56.807436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d5310b54-7cfd-4c4d-b82d-996a2f7b3f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:56.865638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bd736-2670-4e5e-9410-678246a23517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:56.867399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bd736-2670-4e5e-9410-678246a23517 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:56.869120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bd736-2670-4e5e-9410-678246a23517 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:56.869434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896bd736-2670-4e5e-9410-678246a23517 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:56.870122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bd736-2670-4e5e-9410-678246a23517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:56.879992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896bd736-2670-4e5e-9410-678246a23517 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:56.903134 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1139/2291] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:56 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:56.904098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bd736-2670-4e5e-9410-678246a23517 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:56.916970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-896bd736-2670-4e5e-9410-678246a23517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:56.988925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896bd736-2670-4e5e-9410-678246a23517 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:57.008447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537d29-db98-436b-9c3e-fe40b1836c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:57.009638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537d29-db98-436b-9c3e-fe40b1836c7d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:57.009929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537d29-db98-436b-9c3e-fe40b1836c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:57.010213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9537d29-db98-436b-9c3e-fe40b1836c7d admin admin] PATH_INFO: `/v3/projects/ad5d5af8bc2f4bfe94b6379b077f4b8f/users/3d973cbb5ff44a53bda0971ceb9285ad/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:57.025041 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:57.064808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9537d29-db98-436b-9c3e-fe40b1836c7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5d5af8bc2f4bfe94b6379b077f4b8f, user_id=3d973cbb5ff44a53bda0971ceb9285ad, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:57.074235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9537d29-db98-436b-9c3e-fe40b1836c7d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:57.093357 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1153/2292] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:57.095054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7789ff-30cc-4873-b589-2b657062414c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:57.095560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7789ff-30cc-4873-b589-2b657062414c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:57.095982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7789ff-30cc-4873-b589-2b657062414c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:57.112285 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1140/2293] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:56 2022] PUT /identity/v3/projects/ad5d5af8bc2f4bfe94b6379b077f4b8f/users/3d973cbb5ff44a53bda0971ceb9285ad/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:57.114157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537d29-db98-436b-9c3e-fe40b1836c7d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:57.160319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7d7789ff-30cc-4873-b589-2b657062414c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:57.161636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7d7789ff-30cc-4873-b589-2b657062414c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:57.196898 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:57.345526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9537d29-db98-436b-9c3e-fe40b1836c7d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:57.374746 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1154/2294] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:57.381118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7789ff-30cc-4873-b589-2b657062414c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:57.403360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7789ff-30cc-4873-b589-2b657062414c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:57.403579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f7e3-41e2-4297-b569-7fc8b8db58c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:57.404149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f7e3-41e2-4297-b569-7fc8b8db58c0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:57.404455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f7e3-41e2-4297-b569-7fc8b8db58c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:57.404734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a0f7e3-41e2-4297-b569-7fc8b8db58c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:57.405428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0f7e3-41e2-4297-b569-7fc8b8db58c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:57.415853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67559291-05b6-4879-8cf4-3a489a40d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:57.416481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67559291-05b6-4879-8cf4-3a489a40d3df admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:57.416685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a0f7e3-41e2-4297-b569-7fc8b8db58c0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:57.416810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67559291-05b6-4879-8cf4-3a489a40d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:57.417019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67559291-05b6-4879-8cf4-3a489a40d3df admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:57.417705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67559291-05b6-4879-8cf4-3a489a40d3df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:53:57.418018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67559291-05b6-4879-8cf4-3a489a40d3df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:57.419654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67559291-05b6-4879-8cf4-3a489a40d3df admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:57.452696 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1155/2295] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:53:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:53:57.453719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67559291-05b6-4879-8cf4-3a489a40d3df admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:57.471068 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1141/2296] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:57 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:57.474412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f7e3-41e2-4297-b569-7fc8b8db58c0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:57.488526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67559291-05b6-4879-8cf4-3a489a40d3df admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:57.512282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093370b-92f9-4954-9887-bf5091c7edd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:57.513030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093370b-92f9-4954-9887-bf5091c7edd7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:57.513331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093370b-92f9-4954-9887-bf5091c7edd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:57.513612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4093370b-92f9-4954-9887-bf5091c7edd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:57.514264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093370b-92f9-4954-9887-bf5091c7edd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:57.516220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4093370b-92f9-4954-9887-bf5091c7edd7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:57.531004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a0f7e3-41e2-4297-b569-7fc8b8db58c0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:57.554143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33df022-1bce-4e86-87ca-d5e96870f2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:57.558670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33df022-1bce-4e86-87ca-d5e96870f2d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:57.561380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33df022-1bce-4e86-87ca-d5e96870f2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:57.561713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33df022-1bce-4e86-87ca-d5e96870f2d1 admin admin] PATH_INFO: `/v3/projects/ad5d5af8bc2f4bfe94b6379b077f4b8f/users/3d973cbb5ff44a53bda0971ceb9285ad/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:57.570876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33df022-1bce-4e86-87ca-d5e96870f2d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad5d5af8bc2f4bfe94b6379b077f4b8f, user_id=3d973cbb5ff44a53bda0971ceb9285ad, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:57.586459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33df022-1bce-4e86-87ca-d5e96870f2d1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:57.588823 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1156/2297] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:53:57 2022] POST /identity/v3/projects => generated 385 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:53:57.593923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093370b-92f9-4954-9887-bf5091c7edd7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:57.634998 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1142/2298] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:57 2022] PUT /identity/v3/projects/ad5d5af8bc2f4bfe94b6379b077f4b8f/users/3d973cbb5ff44a53bda0971ceb9285ad/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:57.649913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03788e-ae20-4dd1-98f0-62f8a7df970f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:57.650233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03788e-ae20-4dd1-98f0-62f8a7df970f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:57.650722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a03788e-ae20-4dd1-98f0-62f8a7df970f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:57.740955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4093370b-92f9-4954-9887-bf5091c7edd7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:57.741637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4a03788e-ae20-4dd1-98f0-62f8a7df970f None None] MFA Rules not processed for user `3d973cbb5ff44a53bda0971ceb9285ad`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:57.742974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a03788e-ae20-4dd1-98f0-62f8a7df970f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:57.869644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4aebb-2137-4f82-a496-1bd4abf46498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:57.870873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4aebb-2137-4f82-a496-1bd4abf46498 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:57.871882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4aebb-2137-4f82-a496-1bd4abf46498 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:57.873087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4aebb-2137-4f82-a496-1bd4abf46498 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:57.883850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4aebb-2137-4f82-a496-1bd4abf46498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:57.891453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4aebb-2137-4f82-a496-1bd4abf46498 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:58.004441 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1157/2299] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:53:57 2022] POST /identity/v3/users => generated 293 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:53:58.023211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae563a1-706b-4403-80b7-341dbbf577e2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:58.023991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae563a1-706b-4403-80b7-341dbbf577e2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:58.025219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae563a1-706b-4403-80b7-341dbbf577e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:58.056919 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1143/2300] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:57 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:58.065564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03788e-ae20-4dd1-98f0-62f8a7df970f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:58.117851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a03788e-ae20-4dd1-98f0-62f8a7df970f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:58.122705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cae563a1-706b-4403-80b7-341dbbf577e2 None None] MFA Rules not processed for user `cc0be0ed857d4c96b26724144e20d766`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:58.126818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cae563a1-706b-4403-80b7-341dbbf577e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:58.148893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c446b7c4-1084-4f02-8033-851e44c75860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:58.149892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b7c4-1084-4f02-8033-851e44c75860 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:58.150376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b7c4-1084-4f02-8033-851e44c75860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:58.151027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c446b7c4-1084-4f02-8033-851e44c75860 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:58.151692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446b7c4-1084-4f02-8033-851e44c75860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:58.153492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c446b7c4-1084-4f02-8033-851e44c75860 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:58.156209 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:58.173664 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1144/2301] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:58.175183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83823d-9a2f-4f78-ab65-50b5ad90c821 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:58.175433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83823d-9a2f-4f78-ab65-50b5ad90c821 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:58.175713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83823d-9a2f-4f78-ab65-50b5ad90c821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:58.215032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ab83823d-9a2f-4f78-ab65-50b5ad90c821 None None] MFA Rules not processed for user `9fa08ec12fa74ec3af765850e8bbc609`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:58.216296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab83823d-9a2f-4f78-ab65-50b5ad90c821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:58.267991 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1158/2302] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:58.270743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae563a1-706b-4403-80b7-341dbbf577e2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:58.325363 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:58.326211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae563a1-706b-4403-80b7-341dbbf577e2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:58.337733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2140c-5da2-4be9-9647-c11a33659738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:58.338500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2140c-5da2-4be9-9647-c11a33659738 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:58.338930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2140c-5da2-4be9-9647-c11a33659738 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:58.339309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2140c-5da2-4be9-9647-c11a33659738 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:58.340074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2140c-5da2-4be9-9647-c11a33659738 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:58.344067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2140c-5da2-4be9-9647-c11a33659738 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:58.367013 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1159/2303] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:53:58 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:53:58.374596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2140c-5da2-4be9-9647-c11a33659738 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:58.395950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2140c-5da2-4be9-9647-c11a33659738 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:58.404390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1145/2304] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:58.411557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae00d70-28c3-4e8c-b3b7-5c68585710fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:58.412340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae00d70-28c3-4e8c-b3b7-5c68585710fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:58.412700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae00d70-28c3-4e8c-b3b7-5c68585710fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:58.413045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae00d70-28c3-4e8c-b3b7-5c68585710fd admin admin] PATH_INFO: `/v3/projects/178ccdbda089491a92f2c97d4437433c/users/83d393f7341e402a80a50b822b3f0f94/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:58.454823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae00d70-28c3-4e8c-b3b7-5c68585710fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=178ccdbda089491a92f2c97d4437433c, user_id=83d393f7341e402a80a50b822b3f0f94, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:58.457798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae00d70-28c3-4e8c-b3b7-5c68585710fd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:58.487234 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1160/2305] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:53:58 2022] PUT /identity/v3/projects/178ccdbda089491a92f2c97d4437433c/users/83d393f7341e402a80a50b822b3f0f94/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:58.492344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604ee4-2f9b-4d71-91d7-cf850a6e97f4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:58.493520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604ee4-2f9b-4d71-91d7-cf850a6e97f4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:58.493999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b604ee4-2f9b-4d71-91d7-cf850a6e97f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:58.522177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4b604ee4-2f9b-4d71-91d7-cf850a6e97f4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:53:58.526540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4b604ee4-2f9b-4d71-91d7-cf850a6e97f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:58.647669 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1146/2306] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:53:58.697620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae00d70-28c3-4e8c-b3b7-5c68585710fd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:58.701245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8ae00d70-28c3-4e8c-b3b7-5c68585710fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:58.784356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b604ee4-2f9b-4d71-91d7-cf850a6e97f4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:58.786329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4b604ee4-2f9b-4d71-91d7-cf850a6e97f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:58.827093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b604ee4-2f9b-4d71-91d7-cf850a6e97f4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:58.834952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:58.836213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:58.836690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:58.837160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] PATH_INFO: `/v3/users/6c77bcaf1bd040678e9baa743607257b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:58.838877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c77bcaf1bd040678e9baa743607257b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:58.841627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:58.862815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae00d70-28c3-4e8c-b3b7-5c68585710fd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:58.872975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d3587-2656-4447-b5ee-93a071acf8bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:58.873640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d3587-2656-4447-b5ee-93a071acf8bf service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:58.873920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d3587-2656-4447-b5ee-93a071acf8bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:58.874263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d3587-2656-4447-b5ee-93a071acf8bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:58.893765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d3587-2656-4447-b5ee-93a071acf8bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:58.896664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d3587-2656-4447-b5ee-93a071acf8bf service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:58.918679 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1161/2307] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:53:58.947052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c77bcaf1bd040678e9baa743607257b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:58.979027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c77bcaf1bd040678e9baa743607257b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:58.981288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c77bcaf1bd040678e9baa743607257b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:59.012552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c77bcaf1bd040678e9baa743607257b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:59.032001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c77bcaf1bd040678e9baa743607257b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:53:59.046295 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1147/2308] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:53:58 2022] DELETE /identity/v3/users/6c77bcaf1bd040678e9baa743607257b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:53:59.336682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d3587-2656-4447-b5ee-93a071acf8bf service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:53:59.343014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-434d3587-2656-4447-b5ee-93a071acf8bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:59.583534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d3587-2656-4447-b5ee-93a071acf8bf service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:53:59.658315 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:53:59.723507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab461aed-f8e4-4aa8-8faf-d4d3a6fa0fd1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:53:59.724138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461aed-f8e4-4aa8-8faf-d4d3a6fa0fd1 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:53:59.724419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461aed-f8e4-4aa8-8faf-d4d3a6fa0fd1 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:53:59.724886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab461aed-f8e4-4aa8-8faf-d4d3a6fa0fd1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:53:59.726867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ab461aed-f8e4-4aa8-8faf-d4d3a6fa0fd1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:53:59.903440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461aed-f8e4-4aa8-8faf-d4d3a6fa0fd1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:53:59.911561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab461aed-f8e4-4aa8-8faf-d4d3a6fa0fd1 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:53:59.969090 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1162/2309] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:53:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:00.204275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:00.206050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:00.403568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe07ad-dac2-451d-9e5b-bca4bc6630bf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:00.412975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:00.413736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:00.414018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:00.415449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] PATH_INFO: `/v3/projects/47f9a6b369c645e6b8cc4216374b303a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:00.418977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f9a6b369c645e6b8cc4216374b303a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:00.424066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:00.430211 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:00.534933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f9a6b369c645e6b8cc4216374b303a', 'request_id': 'req-db537d59-1612-4a27-aa93-40d97c9edee4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:00.549568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f9a6b369c645e6b8cc4216374b303a', 'request_id': 'req-db537d59-1612-4a27-aa93-40d97c9edee4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:00.577893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f9a6b369c645e6b8cc4216374b303a', 'request_id': 'req-db537d59-1612-4a27-aa93-40d97c9edee4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:00.625051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] The token cache is being invalidate because project 47f9a6b369c645e6b8cc4216374b303a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:54:00.628762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:00.632419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db537d59-1612-4a27-aa93-40d97c9edee4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:00.638939 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1148/2310] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:00 2022] DELETE /identity/v3/projects/47f9a6b369c645e6b8cc4216374b303a => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:00.645657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c23b-002f-47cb-acf8-4b52725ea968 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:00.646507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c23b-002f-47cb-acf8-4b52725ea968 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:00.646680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a120c23b-002f-47cb-acf8-4b52725ea968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:00.743490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a120c23b-002f-47cb-acf8-4b52725ea968 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:00.745605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a120c23b-002f-47cb-acf8-4b52725ea968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:01.015591 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1163/2311] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:01.024797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75c5e2-bb84-4157-9d21-c8e530a103c6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:01.025621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75c5e2-bb84-4157-9d21-c8e530a103c6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:01.026440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75c5e2-bb84-4157-9d21-c8e530a103c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:01.064675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cd75c5e2-bb84-4157-9d21-c8e530a103c6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:01.066498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cd75c5e2-bb84-4157-9d21-c8e530a103c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:01.095486 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1149/2312] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:01.099597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c23b-002f-47cb-acf8-4b52725ea968 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:01.116251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a120c23b-002f-47cb-acf8-4b52725ea968 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:01.123668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd15bad-1d55-44d5-9456-2fa4f3eb7580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:01.124988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15bad-1d55-44d5-9456-2fa4f3eb7580 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:01.125395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15bad-1d55-44d5-9456-2fa4f3eb7580 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:01.125814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd15bad-1d55-44d5-9456-2fa4f3eb7580 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:01.128684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd15bad-1d55-44d5-9456-2fa4f3eb7580 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:54:01.128930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd15bad-1d55-44d5-9456-2fa4f3eb7580 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:01.135895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd15bad-1d55-44d5-9456-2fa4f3eb7580 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:01.172195 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1164/2313] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:54:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:54:01.177327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75c5e2-bb84-4157-9d21-c8e530a103c6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:01.193201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75c5e2-bb84-4157-9d21-c8e530a103c6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:01.213118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793f1d0-8995-46c3-b8b8-7b0415d9c067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:01.215516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793f1d0-8995-46c3-b8b8-7b0415d9c067 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:01.219286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793f1d0-8995-46c3-b8b8-7b0415d9c067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:01.220335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a793f1d0-8995-46c3-b8b8-7b0415d9c067 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:01.224670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793f1d0-8995-46c3-b8b8-7b0415d9c067 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:01.229597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a793f1d0-8995-46c3-b8b8-7b0415d9c067 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:01.367701 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1150/2314] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:54:01 2022] POST /identity/v3/projects => generated 371 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:54:01.372020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd15bad-1d55-44d5-9456-2fa4f3eb7580 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:01.397086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd15bad-1d55-44d5-9456-2fa4f3eb7580 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:01.499214 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:01.518112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e69a39-5a44-495a-8b85-3e1e033c0e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:01.519366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e69a39-5a44-495a-8b85-3e1e033c0e34 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:01.519897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e69a39-5a44-495a-8b85-3e1e033c0e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:01.520674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e69a39-5a44-495a-8b85-3e1e033c0e34 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:01.522356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e69a39-5a44-495a-8b85-3e1e033c0e34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:01.524502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e69a39-5a44-495a-8b85-3e1e033c0e34 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:01.581124 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1165/2315] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:54:01 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:54:01.586391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793f1d0-8995-46c3-b8b8-7b0415d9c067 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:01.635903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a793f1d0-8995-46c3-b8b8-7b0415d9c067 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:01.656699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc6452-b4f0-41f0-8f7c-fda94e2e3700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:01.659098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc6452-b4f0-41f0-8f7c-fda94e2e3700 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:01.660127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc6452-b4f0-41f0-8f7c-fda94e2e3700 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:01.663347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfc6452-b4f0-41f0-8f7c-fda94e2e3700 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:01.664690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc6452-b4f0-41f0-8f7c-fda94e2e3700 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:01.667985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bfc6452-b4f0-41f0-8f7c-fda94e2e3700 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:01.683103 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1151/2316] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:54:01.686909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e69a39-5a44-495a-8b85-3e1e033c0e34 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:01.704272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e69a39-5a44-495a-8b85-3e1e033c0e34 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:01.732548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf00e0-5c5d-4d9e-a951-b124003f1a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:01.733180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf00e0-5c5d-4d9e-a951-b124003f1a6d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:01.733523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf00e0-5c5d-4d9e-a951-b124003f1a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:01.733805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf00e0-5c5d-4d9e-a951-b124003f1a6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:01.734647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf00e0-5c5d-4d9e-a951-b124003f1a6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:01.741806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf00e0-5c5d-4d9e-a951-b124003f1a6d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:01.771678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc6452-b4f0-41f0-8f7c-fda94e2e3700 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:01.773246 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1166/2317] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:01 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:54:01.786731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfc6452-b4f0-41f0-8f7c-fda94e2e3700 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:01.814069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49de398-50bd-488f-a932-fd7beb011ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:01.814839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49de398-50bd-488f-a932-fd7beb011ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:01.815160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49de398-50bd-488f-a932-fd7beb011ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:01.815443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49de398-50bd-488f-a932-fd7beb011ad6 admin admin] PATH_INFO: `/v3/projects/2c527c5590394ccda4a913dba9b39203/users/1c101f994ba94a4e81c994065c09c787/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:01.874351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49de398-50bd-488f-a932-fd7beb011ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c527c5590394ccda4a913dba9b39203, user_id=1c101f994ba94a4e81c994065c09c787, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:01.893339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49de398-50bd-488f-a932-fd7beb011ad6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:02.020119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df7294-a6e7-4ffe-b406-cf22b4331414 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:02.020854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df7294-a6e7-4ffe-b406-cf22b4331414 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:02.020982 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1152/2318] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:54:01 2022] PUT /identity/v3/projects/2c527c5590394ccda4a913dba9b39203/users/1c101f994ba94a4e81c994065c09c787/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:54:02.021538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df7294-a6e7-4ffe-b406-cf22b4331414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:02.096110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-06df7294-a6e7-4ffe-b406-cf22b4331414 None None] MFA Rules not processed for user `1c101f994ba94a4e81c994065c09c787`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:02.097379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-06df7294-a6e7-4ffe-b406-cf22b4331414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:02.474784 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1167/2319] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 455 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:03.002963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49de398-50bd-488f-a932-fd7beb011ad6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:03.006124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a49de398-50bd-488f-a932-fd7beb011ad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:03.221431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49de398-50bd-488f-a932-fd7beb011ad6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:03.249534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34de44-02ab-423a-aaa0-1998215bf601 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:03.250166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34de44-02ab-423a-aaa0-1998215bf601 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:03.250448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34de44-02ab-423a-aaa0-1998215bf601 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:03.250749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34de44-02ab-423a-aaa0-1998215bf601 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:03.285160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34de44-02ab-423a-aaa0-1998215bf601 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:03.286724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34de44-02ab-423a-aaa0-1998215bf601 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:03.315968 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1153/2320] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:03 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:04.530207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df7294-a6e7-4ffe-b406-cf22b4331414 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:04.820804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df7294-a6e7-4ffe-b406-cf22b4331414 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:04.857948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:04.858691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:04.859088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:04.859352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] PATH_INFO: `/v3/users/1c101f994ba94a4e81c994065c09c787` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:04.863168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c101f994ba94a4e81c994065c09c787)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:04.867564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:05.046519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c101f994ba94a4e81c994065c09c787'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:05.078077 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:05.082959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c101f994ba94a4e81c994065c09c787'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:05.084823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c101f994ba94a4e81c994065c09c787'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:05.119616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c101f994ba94a4e81c994065c09c787'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:05.139246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c101f994ba94a4e81c994065c09c787'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:05.153601 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1168/2321] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:54:04 2022] DELETE /identity/v3/users/1c101f994ba94a4e81c994065c09c787 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:05.155182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d674f0-546d-4492-a19f-e22f1298fec6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:05.156001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d674f0-546d-4492-a19f-e22f1298fec6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:05.156442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d674f0-546d-4492-a19f-e22f1298fec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:05.210452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-20d674f0-546d-4492-a19f-e22f1298fec6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:05.211731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20d674f0-546d-4492-a19f-e22f1298fec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:05.240670 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:05.403853 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1154/2322] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:05.417057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:05.418696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:05.600520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bfc9fa-330a-43d4-9403-c60803a108dc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:05.607780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52aef819-4762-401e-a026-fc1756b84459 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:05.610127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef819-4762-401e-a026-fc1756b84459 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:05.610831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef819-4762-401e-a026-fc1756b84459 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:05.611266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52aef819-4762-401e-a026-fc1756b84459 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:05.627874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef819-4762-401e-a026-fc1756b84459 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:05.630535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52aef819-4762-401e-a026-fc1756b84459 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:05.652069 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1169/2323] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:06.215045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d674f0-546d-4492-a19f-e22f1298fec6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:06.217417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20d674f0-546d-4492-a19f-e22f1298fec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:06.247583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d674f0-546d-4492-a19f-e22f1298fec6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:06.263958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:06.264954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:06.265542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:06.266106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] PATH_INFO: `/v3/projects/2c527c5590394ccda4a913dba9b39203` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:06.279973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c527c5590394ccda4a913dba9b39203)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:06.283179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:06.472227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c527c5590394ccda4a913dba9b39203', 'request_id': 'req-0690f252-d99b-4e44-b366-9ed0779bed51'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:06.491307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c527c5590394ccda4a913dba9b39203', 'request_id': 'req-0690f252-d99b-4e44-b366-9ed0779bed51'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:06.515025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c527c5590394ccda4a913dba9b39203', 'request_id': 'req-0690f252-d99b-4e44-b366-9ed0779bed51'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:06.542238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] The token cache is being invalidate because project 2c527c5590394ccda4a913dba9b39203 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:54:06.543925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:06.545490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0690f252-d99b-4e44-b366-9ed0779bed51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:06.549629 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1155/2324] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:06 2022] DELETE /identity/v3/projects/2c527c5590394ccda4a913dba9b39203 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:06.556195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83e8d-1eed-4f58-bb2f-0504496d29b5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:06.556650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83e8d-1eed-4f58-bb2f-0504496d29b5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:06.557181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db83e8d-1eed-4f58-bb2f-0504496d29b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:06.595865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3db83e8d-1eed-4f58-bb2f-0504496d29b5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:06.600066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3db83e8d-1eed-4f58-bb2f-0504496d29b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:06.774565 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1170/2325] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:06.785852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d41b4d-1074-485b-a415-419fbf3b8108 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:06.787902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d41b4d-1074-485b-a415-419fbf3b8108 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:06.790025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d41b4d-1074-485b-a415-419fbf3b8108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:06.819710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-06d41b4d-1074-485b-a415-419fbf3b8108 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:06.821380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06d41b4d-1074-485b-a415-419fbf3b8108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:06.836224 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1156/2326] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:06.842487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db83e8d-1eed-4f58-bb2f-0504496d29b5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:06.877971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db83e8d-1eed-4f58-bb2f-0504496d29b5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:06.892665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f156d55-4d38-4424-9b5a-c554011a8e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:06.893263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f156d55-4d38-4424-9b5a-c554011a8e49 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:06.893582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f156d55-4d38-4424-9b5a-c554011a8e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:06.893853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f156d55-4d38-4424-9b5a-c554011a8e49 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:06.894518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f156d55-4d38-4424-9b5a-c554011a8e49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:54:06.894823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f156d55-4d38-4424-9b5a-c554011a8e49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:06.897002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f156d55-4d38-4424-9b5a-c554011a8e49 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:06.922269 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1171/2327] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:54:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:54:06.924872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d41b4d-1074-485b-a415-419fbf3b8108 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:06.937050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d41b4d-1074-485b-a415-419fbf3b8108 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:06.943847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952916f-b8f1-4a77-940f-3ddc91d3200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:06.944363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952916f-b8f1-4a77-940f-3ddc91d3200d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:06.946718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952916f-b8f1-4a77-940f-3ddc91d3200d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:06.946718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952916f-b8f1-4a77-940f-3ddc91d3200d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:06.949737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952916f-b8f1-4a77-940f-3ddc91d3200d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:06.951823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952916f-b8f1-4a77-940f-3ddc91d3200d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:07.030769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f156d55-4d38-4424-9b5a-c554011a8e49 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:07.049290 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1157/2328] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:54:06 2022] POST /identity/v3/projects => generated 383 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:54:07.054570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f156d55-4d38-4424-9b5a-c554011a8e49 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:07.187115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf5099-05ba-48cc-9232-d585c60ae194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:07.188008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf5099-05ba-48cc-9232-d585c60ae194 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:07.188496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf5099-05ba-48cc-9232-d585c60ae194 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:07.188979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf5099-05ba-48cc-9232-d585c60ae194 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:07.190198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf5099-05ba-48cc-9232-d585c60ae194 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:07.193025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf5099-05ba-48cc-9232-d585c60ae194 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:07.223122 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:07.268905 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1172/2329] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:54:07 2022] POST /identity/v3/users => generated 292 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:54:07.275598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952916f-b8f1-4a77-940f-3ddc91d3200d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:07.297001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952916f-b8f1-4a77-940f-3ddc91d3200d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:07.304852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3ac3-9d81-45c7-a309-fa3d23b0f4cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:07.306063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3ac3-9d81-45c7-a309-fa3d23b0f4cb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:07.306562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3ac3-9d81-45c7-a309-fa3d23b0f4cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:07.307738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036f3ac3-9d81-45c7-a309-fa3d23b0f4cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:07.309014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f3ac3-9d81-45c7-a309-fa3d23b0f4cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:07.311073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036f3ac3-9d81-45c7-a309-fa3d23b0f4cb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:07.336798 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1158/2330] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:54:07.337687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf5099-05ba-48cc-9232-d585c60ae194 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:07.360569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf5099-05ba-48cc-9232-d585c60ae194 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:07.389737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532ac55-1904-4466-8669-b0da8b2a8405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:07.390396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ac55-1904-4466-8669-b0da8b2a8405 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:07.391844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ac55-1904-4466-8669-b0da8b2a8405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:07.392153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532ac55-1904-4466-8669-b0da8b2a8405 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:07.392829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ac55-1904-4466-8669-b0da8b2a8405 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:07.397276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532ac55-1904-4466-8669-b0da8b2a8405 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:07.433164 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1173/2331] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:07 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:54:07.435959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3ac3-9d81-45c7-a309-fa3d23b0f4cb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:07.479859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036f3ac3-9d81-45c7-a309-fa3d23b0f4cb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:07.488040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c4d33-6fd4-4de8-8dfd-e4e12025bfac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:07.489286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c4d33-6fd4-4de8-8dfd-e4e12025bfac admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:07.489892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c4d33-6fd4-4de8-8dfd-e4e12025bfac admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:07.490385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c4d33-6fd4-4de8-8dfd-e4e12025bfac admin admin] PATH_INFO: `/v3/projects/c25289f0047040a393894b2eec720066/users/aec89a12c88145e4b34615836b7a690b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:07.542416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c4d33-6fd4-4de8-8dfd-e4e12025bfac admin admin] RBAC: Authorizing `identity:create_grant(project_id=c25289f0047040a393894b2eec720066, user_id=aec89a12c88145e4b34615836b7a690b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:07.545660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c4d33-6fd4-4de8-8dfd-e4e12025bfac admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:07.574423 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1159/2332] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:54:07 2022] PUT /identity/v3/projects/c25289f0047040a393894b2eec720066/users/aec89a12c88145e4b34615836b7a690b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:07.576712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62782d-8026-4964-aea0-7bf804362eb9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:07.577214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62782d-8026-4964-aea0-7bf804362eb9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:07.577853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62782d-8026-4964-aea0-7bf804362eb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:07.606413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3d62782d-8026-4964-aea0-7bf804362eb9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:07.608395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3d62782d-8026-4964-aea0-7bf804362eb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:07.715532 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1174/2333] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:07.746243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c4d33-6fd4-4de8-8dfd-e4e12025bfac admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:07.749370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c29c4d33-6fd4-4de8-8dfd-e4e12025bfac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:07.792583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb73850-0e5e-424d-aca1-c78f418db2de None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:07.793178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb73850-0e5e-424d-aca1-c78f418db2de None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:07.793178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb73850-0e5e-424d-aca1-c78f418db2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:07.844579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1fb73850-0e5e-424d-aca1-c78f418db2de None None] MFA Rules not processed for user `4099c569c4fe489fa349ee29e6974713`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:07.853482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1fb73850-0e5e-424d-aca1-c78f418db2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:07.894266 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:07.967032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c4d33-6fd4-4de8-8dfd-e4e12025bfac admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:07.978051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a1951-4321-4895-ba26-aa884270a6cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:07.978663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1951-4321-4895-ba26-aa884270a6cf service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:07.978942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1951-4321-4895-ba26-aa884270a6cf service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:07.979225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a1951-4321-4895-ba26-aa884270a6cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:08.006574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a1951-4321-4895-ba26-aa884270a6cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:08.011247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13a1951-4321-4895-ba26-aa884270a6cf service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:08.029902 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1175/2334] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:07 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:08.039034 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1160/2335] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:12.675832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb73850-0e5e-424d-aca1-c78f418db2de None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:12.678603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1fb73850-0e5e-424d-aca1-c78f418db2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:12.959107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb73850-0e5e-424d-aca1-c78f418db2de None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:12.973568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:12.974401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:12.977434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:12.977929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:12.981579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:13.060344 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:13.132622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:13.138386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:13.169760 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1176/2336] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:15.315652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb0fff-1540-4dc0-9f21-67db5a25fc79 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:15.316225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb0fff-1540-4dc0-9f21-67db5a25fc79 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:15.316225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbb0fff-1540-4dc0-9f21-67db5a25fc79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:15.355078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ffbb0fff-1540-4dc0-9f21-67db5a25fc79 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:15.356310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ffbb0fff-1540-4dc0-9f21-67db5a25fc79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:15.474170 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1161/2337] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 08:54:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:15.501995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:15.503756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:15.635029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5525121-14ee-4938-a4c2-89c489fd0df5 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:15.640860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534e34a-e50f-4421-bec5-762b5a3036a7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:15.642325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534e34a-e50f-4421-bec5-762b5a3036a7 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:15.643154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534e34a-e50f-4421-bec5-762b5a3036a7 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:15.643154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9534e34a-e50f-4421-bec5-762b5a3036a7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:15.652757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534e34a-e50f-4421-bec5-762b5a3036a7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:15.654406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9534e34a-e50f-4421-bec5-762b5a3036a7 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:15.667164 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1177/2338] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:54:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:18.551335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b6cf1-5557-49e7-b778-b101baf399fb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:18.551802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b6cf1-5557-49e7-b778-b101baf399fb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:18.551955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063b6cf1-5557-49e7-b778-b101baf399fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:18.616981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-063b6cf1-5557-49e7-b778-b101baf399fb None None] MFA Rules not processed for user `83d393f7341e402a80a50b822b3f0f94`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:18.623428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-063b6cf1-5557-49e7-b778-b101baf399fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:18.834700 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1162/2339] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:18.841687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534e34a-e50f-4421-bec5-762b5a3036a7 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:18.843502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9534e34a-e50f-4421-bec5-762b5a3036a7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:18.861208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9534e34a-e50f-4421-bec5-762b5a3036a7 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:18.866784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd960e-55f0-4eec-818a-2a5666be8d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:18.867607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd960e-55f0-4eec-818a-2a5666be8d34 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:18.868041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd960e-55f0-4eec-818a-2a5666be8d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:18.868465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd960e-55f0-4eec-818a-2a5666be8d34 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:18.869436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd960e-55f0-4eec-818a-2a5666be8d34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:18.872172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd960e-55f0-4eec-818a-2a5666be8d34 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:18.949002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b6cf1-5557-49e7-b778-b101baf399fb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:18.950643 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1178/2340] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:54:18 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:54:18.969226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063b6cf1-5557-49e7-b778-b101baf399fb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:19.123302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc8316-9dcc-4222-b310-741d513787ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:19.123939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8316-9dcc-4222-b310-741d513787ec admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:19.124201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8316-9dcc-4222-b310-741d513787ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:19.124472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fc8316-9dcc-4222-b310-741d513787ec admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:19.126109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc8316-9dcc-4222-b310-741d513787ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:19.127652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fc8316-9dcc-4222-b310-741d513787ec admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:19.178490 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:19.191391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd960e-55f0-4eec-818a-2a5666be8d34 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:19.191746 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1163/2341] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:54:18 2022] POST /identity/v3/users => generated 299 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:54:19.208099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd960e-55f0-4eec-818a-2a5666be8d34 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:19.225183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81abbbd-7917-46cd-88fd-171f1237ba74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:19.226111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81abbbd-7917-46cd-88fd-171f1237ba74 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:19.226572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81abbbd-7917-46cd-88fd-171f1237ba74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:19.226999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81abbbd-7917-46cd-88fd-171f1237ba74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:19.227819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81abbbd-7917-46cd-88fd-171f1237ba74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:19.229745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81abbbd-7917-46cd-88fd-171f1237ba74 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:19.250028 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1179/2342] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:54:19.250309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc8316-9dcc-4222-b310-741d513787ec admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:19.266947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fc8316-9dcc-4222-b310-741d513787ec admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:19.288897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc3b9d-123c-488e-9a6c-e3ca18ec8b2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:19.289610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc3b9d-123c-488e-9a6c-e3ca18ec8b2a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:19.289905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc3b9d-123c-488e-9a6c-e3ca18ec8b2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:19.290157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabc3b9d-123c-488e-9a6c-e3ca18ec8b2a admin admin] PATH_INFO: `/v3/projects/48da367ebcc5487e831262d1a17ff648/users/af2fa719af7d407095dfeacfff248d18/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:19.324995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc3b9d-123c-488e-9a6c-e3ca18ec8b2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=48da367ebcc5487e831262d1a17ff648, user_id=af2fa719af7d407095dfeacfff248d18, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:19.327757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabc3b9d-123c-488e-9a6c-e3ca18ec8b2a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:19.374670 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1164/2343] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:54:19 2022] PUT /identity/v3/projects/48da367ebcc5487e831262d1a17ff648/users/af2fa719af7d407095dfeacfff248d18/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:54:19.383934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81abbbd-7917-46cd-88fd-171f1237ba74 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:19.401987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81abbbd-7917-46cd-88fd-171f1237ba74 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:19.544722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfaa881-10d1-4335-b272-b92f1cffafe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:19.545702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaa881-10d1-4335-b272-b92f1cffafe0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:19.546265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaa881-10d1-4335-b272-b92f1cffafe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:19.546697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfaa881-10d1-4335-b272-b92f1cffafe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:19.547815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaa881-10d1-4335-b272-b92f1cffafe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:19.550194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfaa881-10d1-4335-b272-b92f1cffafe0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:19.570648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc3b9d-123c-488e-9a6c-e3ca18ec8b2a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:19.571688 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1180/2344] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:19 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:54:19.584142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabc3b9d-123c-488e-9a6c-e3ca18ec8b2a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:19.595949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a29d9fa-5504-4623-9e44-e820bd3e072b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:19.596987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d9fa-5504-4623-9e44-e820bd3e072b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:19.597444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d9fa-5504-4623-9e44-e820bd3e072b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:19.597901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a29d9fa-5504-4623-9e44-e820bd3e072b admin admin] PATH_INFO: `/v3/projects/48da367ebcc5487e831262d1a17ff648/users/af2fa719af7d407095dfeacfff248d18/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:19.602663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d9fa-5504-4623-9e44-e820bd3e072b admin admin] RBAC: Authorizing `identity:create_grant(project_id=48da367ebcc5487e831262d1a17ff648, user_id=af2fa719af7d407095dfeacfff248d18, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:19.610649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a29d9fa-5504-4623-9e44-e820bd3e072b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:19.637074 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1165/2345] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:54:19 2022] PUT /identity/v3/projects/48da367ebcc5487e831262d1a17ff648/users/af2fa719af7d407095dfeacfff248d18/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:54:20.755786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b01af-5c0b-4618-90f4-c86e4f479172 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:20.757350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b01af-5c0b-4618-90f4-c86e4f479172 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:20.757955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269b01af-5c0b-4618-90f4-c86e4f479172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:20.817218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-269b01af-5c0b-4618-90f4-c86e4f479172 None None] MFA Rules not processed for user `aec89a12c88145e4b34615836b7a690b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:20.818476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-269b01af-5c0b-4618-90f4-c86e4f479172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:20.830938 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:21.042515 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1181/2346] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:20 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:21.053454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a8f0-6868-4bab-97da-2c9fbe339418 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:21.054349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a8f0-6868-4bab-97da-2c9fbe339418 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:21.054776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f1a8f0-6868-4bab-97da-2c9fbe339418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:21.096776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d9f1a8f0-6868-4bab-97da-2c9fbe339418 None None] MFA Rules not processed for user `aec89a12c88145e4b34615836b7a690b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:21.098049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d9f1a8f0-6868-4bab-97da-2c9fbe339418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:21.118456 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1166/2347] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:21.479404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b01af-5c0b-4618-90f4-c86e4f479172 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:21.688449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269b01af-5c0b-4618-90f4-c86e4f479172 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:21.703948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680765db-a7c0-40a1-a26d-45d61b2477e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:21.706912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680765db-a7c0-40a1-a26d-45d61b2477e4 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:21.707234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680765db-a7c0-40a1-a26d-45d61b2477e4 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:21.707522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680765db-a7c0-40a1-a26d-45d61b2477e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:21.722258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680765db-a7c0-40a1-a26d-45d61b2477e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:21.723884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680765db-a7c0-40a1-a26d-45d61b2477e4 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:21.779471 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1182/2348] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:25.158881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a8f0-6868-4bab-97da-2c9fbe339418 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:25.160448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d9f1a8f0-6868-4bab-97da-2c9fbe339418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:25.359019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f1a8f0-6868-4bab-97da-2c9fbe339418 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:25.397866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:25.398332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:25.398655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:25.398938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] PATH_INFO: `/v3/users/c2b9360313da41e1905c695c37020876` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:25.400264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b9360313da41e1905c695c37020876)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:25.408651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:25.510892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b9360313da41e1905c695c37020876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:25.540423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b9360313da41e1905c695c37020876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:25.541183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b9360313da41e1905c695c37020876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:25.558194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b9360313da41e1905c695c37020876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:25.587531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b9360313da41e1905c695c37020876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:25.612457 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1167/2349] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:54:25 2022] DELETE /identity/v3/users/c2b9360313da41e1905c695c37020876 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:25.616931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e017c16-ddb9-47f1-9b75-33a325fd2576 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:25.617789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e017c16-ddb9-47f1-9b75-33a325fd2576 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:25.618248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e017c16-ddb9-47f1-9b75-33a325fd2576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:25.679828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4e017c16-ddb9-47f1-9b75-33a325fd2576 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:25.681114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e017c16-ddb9-47f1-9b75-33a325fd2576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:25.878164 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1183/2350] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:25.922990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:25.924693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:26.040080 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:26.122913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1fac82-f61a-4e2c-a477-9a6a195a5686 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:26.128626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac718646-9924-408a-a085-5663cc7dfdad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:26.129378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac718646-9924-408a-a085-5663cc7dfdad service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:26.129660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac718646-9924-408a-a085-5663cc7dfdad service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:26.129932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac718646-9924-408a-a085-5663cc7dfdad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:26.147254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac718646-9924-408a-a085-5663cc7dfdad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:26.154525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac718646-9924-408a-a085-5663cc7dfdad service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:26.171112 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1168/2351] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:27.467380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e017c16-ddb9-47f1-9b75-33a325fd2576 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:27.472205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e017c16-ddb9-47f1-9b75-33a325fd2576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:27.493895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e017c16-ddb9-47f1-9b75-33a325fd2576 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:27.522734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:27.527740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:27.530329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:27.530836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] PATH_INFO: `/v3/projects/96ab82000972421c96022c2711beb014` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:27.535668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96ab82000972421c96022c2711beb014)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:27.544675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:27.677089 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:27.738685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96ab82000972421c96022c2711beb014', 'request_id': 'req-80f5899e-a81b-4add-8a65-d4729d9d01e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.763090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96ab82000972421c96022c2711beb014', 'request_id': 'req-80f5899e-a81b-4add-8a65-d4729d9d01e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.778054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96ab82000972421c96022c2711beb014', 'request_id': 'req-80f5899e-a81b-4add-8a65-d4729d9d01e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.809039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] The token cache is being invalidate because project 96ab82000972421c96022c2711beb014 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:54:27.809388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.810695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-80f5899e-a81b-4add-8a65-d4729d9d01e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:27.821437 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1184/2352] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:27 2022] DELETE /identity/v3/projects/96ab82000972421c96022c2711beb014 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:27.825791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a780a-f244-4986-bb7e-4efa9835a313 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:27.826286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a780a-f244-4986-bb7e-4efa9835a313 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:27.826730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a780a-f244-4986-bb7e-4efa9835a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:27.878734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-974a780a-f244-4986-bb7e-4efa9835a313 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:27.882213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-974a780a-f244-4986-bb7e-4efa9835a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:28.075593 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1169/2353] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:28.173915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eb04f-7940-47a9-a5db-8f7fa90723c3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:28.174256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eb04f-7940-47a9-a5db-8f7fa90723c3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:28.174542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22eb04f-7940-47a9-a5db-8f7fa90723c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:28.231569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a22eb04f-7940-47a9-a5db-8f7fa90723c3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:28.232813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a22eb04f-7940-47a9-a5db-8f7fa90723c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:28.260001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1185/2354] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:28.264363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a780a-f244-4986-bb7e-4efa9835a313 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:28.275934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a780a-f244-4986-bb7e-4efa9835a313 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:28.299167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a838ac3-ec9d-4286-857a-a92d207ee5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:28.299810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a838ac3-ec9d-4286-857a-a92d207ee5ad admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:28.300091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a838ac3-ec9d-4286-857a-a92d207ee5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:28.300366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a838ac3-ec9d-4286-857a-a92d207ee5ad admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:28.301035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a838ac3-ec9d-4286-857a-a92d207ee5ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:54:28.301370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a838ac3-ec9d-4286-857a-a92d207ee5ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:28.303151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a838ac3-ec9d-4286-857a-a92d207ee5ad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:28.324889 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1170/2355] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:54:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:54:28.329699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22eb04f-7940-47a9-a5db-8f7fa90723c3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:28.342217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22eb04f-7940-47a9-a5db-8f7fa90723c3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:28.350390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858edb4-bd17-4c9b-a325-4f6d77c128fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:28.351429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858edb4-bd17-4c9b-a325-4f6d77c128fc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:28.351949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858edb4-bd17-4c9b-a325-4f6d77c128fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:28.352437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d858edb4-bd17-4c9b-a325-4f6d77c128fc admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:28.353353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858edb4-bd17-4c9b-a325-4f6d77c128fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:28.355799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d858edb4-bd17-4c9b-a325-4f6d77c128fc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:28.452490 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1186/2356] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:54:28 2022] POST /identity/v3/projects => generated 391 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:54:28.457071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a838ac3-ec9d-4286-857a-a92d207ee5ad admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:28.503669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a838ac3-ec9d-4286-857a-a92d207ee5ad admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:28.681074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f867610-28a4-4bba-8d26-d1e450de2694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:28.682018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f867610-28a4-4bba-8d26-d1e450de2694 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:28.684717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f867610-28a4-4bba-8d26-d1e450de2694 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:28.685169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f867610-28a4-4bba-8d26-d1e450de2694 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:28.686137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f867610-28a4-4bba-8d26-d1e450de2694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:28.691353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f867610-28a4-4bba-8d26-d1e450de2694 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:28.760138 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1171/2357] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:54:28 2022] POST /identity/v3/users => generated 296 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:54:28.764267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858edb4-bd17-4c9b-a325-4f6d77c128fc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:28.791007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d858edb4-bd17-4c9b-a325-4f6d77c128fc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:28.810379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6779b34-7de3-47a0-bb56-9decaee13b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:28.811653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6779b34-7de3-47a0-bb56-9decaee13b4c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:28.812138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6779b34-7de3-47a0-bb56-9decaee13b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:28.813430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6779b34-7de3-47a0-bb56-9decaee13b4c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:28.814355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6779b34-7de3-47a0-bb56-9decaee13b4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:28.816324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6779b34-7de3-47a0-bb56-9decaee13b4c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:28.830725 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1187/2358] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:54:28.834593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f867610-28a4-4bba-8d26-d1e450de2694 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:28.851514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f867610-28a4-4bba-8d26-d1e450de2694 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:28.857398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3f25c-8dc9-40e6-940f-ab592282d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:28.858400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3f25c-8dc9-40e6-940f-ab592282d66d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:28.859066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3f25c-8dc9-40e6-940f-ab592282d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:28.860079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3f25c-8dc9-40e6-940f-ab592282d66d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:28.861679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3f25c-8dc9-40e6-940f-ab592282d66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:28.870707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3f25c-8dc9-40e6-940f-ab592282d66d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:28.917067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6779b34-7de3-47a0-bb56-9decaee13b4c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:28.925266 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1172/2359] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:28 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:54:28.930167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6779b34-7de3-47a0-bb56-9decaee13b4c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:28.949358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa2efe-5a25-4c12-88db-444f49cc9768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:28.949358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa2efe-5a25-4c12-88db-444f49cc9768 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:28.949358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa2efe-5a25-4c12-88db-444f49cc9768 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:28.949789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa2efe-5a25-4c12-88db-444f49cc9768 admin admin] PATH_INFO: `/v3/projects/4dfcb820b7984314b29f347ecd2b9141/users/c01bf3d88a2f4f6faaa46071612460c9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:28.974858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa2efe-5a25-4c12-88db-444f49cc9768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dfcb820b7984314b29f347ecd2b9141, user_id=c01bf3d88a2f4f6faaa46071612460c9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:28.977866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fa2efe-5a25-4c12-88db-444f49cc9768 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:29.022848 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1188/2360] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:54:28 2022] PUT /identity/v3/projects/4dfcb820b7984314b29f347ecd2b9141/users/c01bf3d88a2f4f6faaa46071612460c9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:54:29.025207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb884e2-92ec-4182-ba8a-4cb97dbe860f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:29.025663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb884e2-92ec-4182-ba8a-4cb97dbe860f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:29.026262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb884e2-92ec-4182-ba8a-4cb97dbe860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:29.072350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ccb884e2-92ec-4182-ba8a-4cb97dbe860f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:29.074332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ccb884e2-92ec-4182-ba8a-4cb97dbe860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:29.273270 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:29.352215 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1173/2361] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:54:29.375057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa2efe-5a25-4c12-88db-444f49cc9768 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:29.375057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4fa2efe-5a25-4c12-88db-444f49cc9768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:29.613374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa2efe-5a25-4c12-88db-444f49cc9768 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:29.628389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec25c3a-93c0-4853-b56d-aa5ece410fc5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:29.629490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec25c3a-93c0-4853-b56d-aa5ece410fc5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:29.630177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec25c3a-93c0-4853-b56d-aa5ece410fc5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:29.630677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec25c3a-93c0-4853-b56d-aa5ece410fc5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:29.681357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec25c3a-93c0-4853-b56d-aa5ece410fc5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:29.691890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec25c3a-93c0-4853-b56d-aa5ece410fc5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:29.730409 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1189/2362] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:31.235164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73b15c-7b40-4484-9a1a-1671d30f06e1 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:31.235671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73b15c-7b40-4484-9a1a-1671d30f06e1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:31.235671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73b15c-7b40-4484-9a1a-1671d30f06e1 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:31.237705 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1174/2363] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 08:54:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:54:31.246854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fcf75-28aa-420c-b481-80d20b4fa617 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:31.247624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fcf75-28aa-420c-b481-80d20b4fa617 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:31.247624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47fcf75-28aa-420c-b481-80d20b4fa617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:31.287734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d47fcf75-28aa-420c-b481-80d20b4fa617 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:31.289030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d47fcf75-28aa-420c-b481-80d20b4fa617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:31.366477 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:31.442472 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1190/2364] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:54:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:54:31.501196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73b15c-7b40-4484-9a1a-1671d30f06e1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:31.503451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a73b15c-7b40-4484-9a1a-1671d30f06e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:31.541051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73b15c-7b40-4484-9a1a-1671d30f06e1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:31.559021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690ad62-9454-41e8-9396-a4bf3f10cac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:31.560293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690ad62-9454-41e8-9396-a4bf3f10cac6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:31.560803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690ad62-9454-41e8-9396-a4bf3f10cac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:31.561383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1690ad62-9454-41e8-9396-a4bf3f10cac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:31.587525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690ad62-9454-41e8-9396-a4bf3f10cac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:31.589412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1690ad62-9454-41e8-9396-a4bf3f10cac6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:31.611236 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1175/2365] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:31.676000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad7ea8-deb9-4770-8810-0a8d95c858d6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:31.676471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad7ea8-deb9-4770-8810-0a8d95c858d6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:31.676913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ad7ea8-deb9-4770-8810-0a8d95c858d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:31.742076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f3ad7ea8-deb9-4770-8810-0a8d95c858d6 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:31.743837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f3ad7ea8-deb9-4770-8810-0a8d95c858d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:31.768444 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1191/2366] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 08:54:31 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:31.845585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690ad62-9454-41e8-9396-a4bf3f10cac6 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:31.911283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1690ad62-9454-41e8-9396-a4bf3f10cac6 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:31.927284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfd55c-2093-4951-bec3-a596f93316f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:31.928276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfd55c-2093-4951-bec3-a596f93316f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:31.929463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfd55c-2093-4951-bec3-a596f93316f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:31.939209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cfd55c-2093-4951-bec3-a596f93316f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:31.954991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfd55c-2093-4951-bec3-a596f93316f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:31.956456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cfd55c-2093-4951-bec3-a596f93316f6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:31.968204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1176/2367] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:37.610701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044f91-1a94-45fa-88a3-36e066bc2c7f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:37.611706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044f91-1a94-45fa-88a3-36e066bc2c7f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:37.612222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02044f91-1a94-45fa-88a3-36e066bc2c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:37.699364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-02044f91-1a94-45fa-88a3-36e066bc2c7f None None] MFA Rules not processed for user `af2fa719af7d407095dfeacfff248d18`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:37.703939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-02044f91-1a94-45fa-88a3-36e066bc2c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:37.820774 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1192/2368] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:37.820975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfd55c-2093-4951-bec3-a596f93316f6 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:37.823147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b0cfd55c-2093-4951-bec3-a596f93316f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:37.928923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cfd55c-2093-4951-bec3-a596f93316f6 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:37.933732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9ce56-5a50-43ed-8753-e3cc3e4ad34c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:37.935206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9ce56-5a50-43ed-8753-e3cc3e4ad34c service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:37.935723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9ce56-5a50-43ed-8753-e3cc3e4ad34c service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:37.936585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9ce56-5a50-43ed-8753-e3cc3e4ad34c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:37.952885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9ce56-5a50-43ed-8753-e3cc3e4ad34c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:37.955933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9ce56-5a50-43ed-8753-e3cc3e4ad34c service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:37.971435 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1177/2369] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:37 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:54:42.667305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b8239-7165-497f-a18b-b6347418cabd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:42.667961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b8239-7165-497f-a18b-b6347418cabd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:42.677640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b8239-7165-497f-a18b-b6347418cabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:42.764490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-486b8239-7165-497f-a18b-b6347418cabd None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:42.768485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-486b8239-7165-497f-a18b-b6347418cabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:43.028091 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1193/2370] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:54:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:43.043607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9ce56-5a50-43ed-8753-e3cc3e4ad34c service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:43.045249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-65e9ce56-5a50-43ed-8753-e3cc3e4ad34c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:43.335763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9ce56-5a50-43ed-8753-e3cc3e4ad34c service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:43.348361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329299c-776a-46a2-a11b-57f01805496b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:43.349037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329299c-776a-46a2-a11b-57f01805496b service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:43.349517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329299c-776a-46a2-a11b-57f01805496b service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:43.349796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329299c-776a-46a2-a11b-57f01805496b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:43.376387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329299c-776a-46a2-a11b-57f01805496b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:43.395807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329299c-776a-46a2-a11b-57f01805496b service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:43.433852 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1178/2371] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:54:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:51.745412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87747b1-8e5f-467c-a65d-7b073a7a3b2b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:51.745996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87747b1-8e5f-467c-a65d-7b073a7a3b2b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:51.745996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87747b1-8e5f-467c-a65d-7b073a7a3b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:51.851637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b87747b1-8e5f-467c-a65d-7b073a7a3b2b None None] MFA Rules not processed for user `c01bf3d88a2f4f6faaa46071612460c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:51.857545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b87747b1-8e5f-467c-a65d-7b073a7a3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:52.179726 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:52.209121 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1194/2372] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:52.354541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329299c-776a-46a2-a11b-57f01805496b service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:52.357083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7329299c-776a-46a2-a11b-57f01805496b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:52.423282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329299c-776a-46a2-a11b-57f01805496b service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:52.451948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950b3cd1-c368-4793-837f-7be67411759c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:52.452681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b3cd1-c368-4793-837f-7be67411759c service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:52.452972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b3cd1-c368-4793-837f-7be67411759c service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:52.453255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950b3cd1-c368-4793-837f-7be67411759c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:52.504622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b3cd1-c368-4793-837f-7be67411759c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:52.508619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87747b1-8e5f-467c-a65d-7b073a7a3b2b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:52.510252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b87747b1-8e5f-467c-a65d-7b073a7a3b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:52.513668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950b3cd1-c368-4793-837f-7be67411759c service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:52.541318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87747b1-8e5f-467c-a65d-7b073a7a3b2b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:52.560255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:52.561380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:52.564118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:52.564679 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1179/2373] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:52 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:54:52.565129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] PATH_INFO: `/v3/users/89ee4538fd234ed7b8137861bfb534d3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:52.566746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ee4538fd234ed7b8137861bfb534d3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:52.570326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:52.728018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ee4538fd234ed7b8137861bfb534d3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:52.782024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ee4538fd234ed7b8137861bfb534d3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:52.783187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ee4538fd234ed7b8137861bfb534d3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:52.800078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ee4538fd234ed7b8137861bfb534d3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:52.825678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ee4538fd234ed7b8137861bfb534d3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:52.841669 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1195/2374] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:54:52 2022] DELETE /identity/v3/users/89ee4538fd234ed7b8137861bfb534d3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:54:53.013728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c4937-2589-4718-8428-e92e3eeb1d5f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:53.014009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c4937-2589-4718-8428-e92e3eeb1d5f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:53.014534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c4937-2589-4718-8428-e92e3eeb1d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:53.050270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-558c4937-2589-4718-8428-e92e3eeb1d5f None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:53.052101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-558c4937-2589-4718-8428-e92e3eeb1d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:53.128438 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:53.204920 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1180/2375] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:54:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:53.274670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:53.278641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:53.462459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e843fe41-f368-4880-a586-02e226c5f907 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:53.478235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a850e3-7106-4f98-afd0-4ed9459acce8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:53.478874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a850e3-7106-4f98-afd0-4ed9459acce8 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:53.479154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a850e3-7106-4f98-afd0-4ed9459acce8 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:53.479426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a850e3-7106-4f98-afd0-4ed9459acce8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:53.491845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a850e3-7106-4f98-afd0-4ed9459acce8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:53.494090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a850e3-7106-4f98-afd0-4ed9459acce8 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:53.519819 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1196/2376] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:54:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:54:53.608302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c4937-2589-4718-8428-e92e3eeb1d5f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:53.611166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-558c4937-2589-4718-8428-e92e3eeb1d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:53.836965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c4937-2589-4718-8428-e92e3eeb1d5f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:53.845978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:53.847033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:53.847584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:53.848007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] PATH_INFO: `/v3/projects/4bf7adacd2ba40e6b67fa07d8baefc4b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:53.849368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf7adacd2ba40e6b67fa07d8baefc4b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:53.853349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:53.987627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'request_id': 'req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:54.011092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'request_id': 'req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:54.025204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf7adacd2ba40e6b67fa07d8baefc4b', 'request_id': 'req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:54.042396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] The token cache is being invalidate because project 4bf7adacd2ba40e6b67fa07d8baefc4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:54:54.042804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:54.044223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30dfa8ba-fb3c-433d-a0b0-5edefd2a1f1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:54:54.053415 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1181/2377] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:54:53 2022] DELETE /identity/v3/projects/4bf7adacd2ba40e6b67fa07d8baefc4b => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:54.062144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f308b6-515f-4380-b74a-94fe8c5f9d9d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:54.063371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f308b6-515f-4380-b74a-94fe8c5f9d9d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:54.063823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f308b6-515f-4380-b74a-94fe8c5f9d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:54.127789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-52f308b6-515f-4380-b74a-94fe8c5f9d9d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:54.130096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-52f308b6-515f-4380-b74a-94fe8c5f9d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:54.350828 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1197/2378] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:54.358977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3086-11ce-44c5-94e5-9e21134d1079 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:54.359284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3086-11ce-44c5-94e5-9e21134d1079 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:54.359559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038d3086-11ce-44c5-94e5-9e21134d1079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:54.426761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-038d3086-11ce-44c5-94e5-9e21134d1079 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:54.428210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-038d3086-11ce-44c5-94e5-9e21134d1079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:54.460857 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1182/2379] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:54.466802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f308b6-515f-4380-b74a-94fe8c5f9d9d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:54.474032 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:54.492893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f308b6-515f-4380-b74a-94fe8c5f9d9d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:54.516166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a8d7e-f1a0-40c0-8dc6-5d55996e71dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:54.519692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a8d7e-f1a0-40c0-8dc6-5d55996e71dd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:54.520001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a8d7e-f1a0-40c0-8dc6-5d55996e71dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:54.520288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88a8d7e-f1a0-40c0-8dc6-5d55996e71dd admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:54.520974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a8d7e-f1a0-40c0-8dc6-5d55996e71dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:54:54.524593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a8d7e-f1a0-40c0-8dc6-5d55996e71dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:54.531273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88a8d7e-f1a0-40c0-8dc6-5d55996e71dd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:54.603054 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1198/2380] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:54:54.607588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3086-11ce-44c5-94e5-9e21134d1079 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:54.622543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038d3086-11ce-44c5-94e5-9e21134d1079 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:54.648392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe083d6-06bc-4020-bfdd-aa4349691996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:54.650507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe083d6-06bc-4020-bfdd-aa4349691996 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:54.650794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe083d6-06bc-4020-bfdd-aa4349691996 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:54.653227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe083d6-06bc-4020-bfdd-aa4349691996 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:54.657270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe083d6-06bc-4020-bfdd-aa4349691996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:54.666405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe083d6-06bc-4020-bfdd-aa4349691996 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:54.763467 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1183/2381] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:54:54 2022] POST /identity/v3/projects => generated 379 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:54:54.766828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a8d7e-f1a0-40c0-8dc6-5d55996e71dd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:54.787276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88a8d7e-f1a0-40c0-8dc6-5d55996e71dd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:55.148885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e43154-4e72-4095-a3dc-260f03f47d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:55.154049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e43154-4e72-4095-a3dc-260f03f47d82 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:55.155180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e43154-4e72-4095-a3dc-260f03f47d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:55.156775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e43154-4e72-4095-a3dc-260f03f47d82 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:55.157646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e43154-4e72-4095-a3dc-260f03f47d82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:55.175547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e43154-4e72-4095-a3dc-260f03f47d82 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:55.239689 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1199/2382] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:54:54 2022] POST /identity/v3/users => generated 290 bytes in 471 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:54:55.241172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe083d6-06bc-4020-bfdd-aa4349691996 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:55.257585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe083d6-06bc-4020-bfdd-aa4349691996 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:55.265461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66833a-df20-46e0-942e-232c84cd9520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:55.266510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66833a-df20-46e0-942e-232c84cd9520 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:55.267044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66833a-df20-46e0-942e-232c84cd9520 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:55.267578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66833a-df20-46e0-942e-232c84cd9520 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:55.268483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66833a-df20-46e0-942e-232c84cd9520 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:55.270890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66833a-df20-46e0-942e-232c84cd9520 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:55.285104 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1184/2383] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:54:55.289126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e43154-4e72-4095-a3dc-260f03f47d82 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:55.303193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e43154-4e72-4095-a3dc-260f03f47d82 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:55.313342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67520406-d03f-4490-b199-552932e2f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:55.317490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520406-d03f-4490-b199-552932e2f87d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:55.320319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520406-d03f-4490-b199-552932e2f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:55.320836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67520406-d03f-4490-b199-552932e2f87d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:55.321868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520406-d03f-4490-b199-552932e2f87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:55.323790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67520406-d03f-4490-b199-552932e2f87d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:55.353388 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1200/2384] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:54:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:54:55.355065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66833a-df20-46e0-942e-232c84cd9520 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:55.371034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66833a-df20-46e0-942e-232c84cd9520 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:55.383399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ba534-e591-4d26-9fc4-739d4f98919e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:55.384257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ba534-e591-4d26-9fc4-739d4f98919e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:55.384660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ba534-e591-4d26-9fc4-739d4f98919e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:55.385114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55ba534-e591-4d26-9fc4-739d4f98919e admin admin] PATH_INFO: `/v3/projects/6e21cf10d74849ad9f86efee0a5bd4df/users/bea1fba85548404ca535fc5889752511/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:55.418060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ba534-e591-4d26-9fc4-739d4f98919e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e21cf10d74849ad9f86efee0a5bd4df, user_id=bea1fba85548404ca535fc5889752511, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:55.421070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55ba534-e591-4d26-9fc4-739d4f98919e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:55.456706 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1185/2385] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:54:55 2022] PUT /identity/v3/projects/6e21cf10d74849ad9f86efee0a5bd4df/users/bea1fba85548404ca535fc5889752511/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:54:55.462338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c244-d3aa-4edf-9147-028c64e008fd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:55.462338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c244-d3aa-4edf-9147-028c64e008fd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:55.462713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98c244-d3aa-4edf-9147-028c64e008fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:55.508037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9b98c244-d3aa-4edf-9147-028c64e008fd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:54:55.512456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b98c244-d3aa-4edf-9147-028c64e008fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:55.707982 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1201/2386] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:54:55.716611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ba534-e591-4d26-9fc4-739d4f98919e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:54:55.718904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b55ba534-e591-4d26-9fc4-739d4f98919e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:54:55.744849 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:54:55.888128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55ba534-e591-4d26-9fc4-739d4f98919e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:54:55.900230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b719d-b1f3-4aaf-9d49-c64c71158716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:54:55.901676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b719d-b1f3-4aaf-9d49-c64c71158716 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:54:55.902397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b719d-b1f3-4aaf-9d49-c64c71158716 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:54:55.904891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b719d-b1f3-4aaf-9d49-c64c71158716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:54:55.939323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b719d-b1f3-4aaf-9d49-c64c71158716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:54:55.945093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5b719d-b1f3-4aaf-9d49-c64c71158716 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:54:55.961526 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1186/2387] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:54:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:03.987990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959cd62-8c88-4565-b8d0-93c12366b0f5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:03.988535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959cd62-8c88-4565-b8d0-93c12366b0f5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:03.988770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4959cd62-8c88-4565-b8d0-93c12366b0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:04.065193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4959cd62-8c88-4565-b8d0-93c12366b0f5 None None] MFA Rules not processed for user `cc0be0ed857d4c96b26724144e20d766`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:04.068061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4959cd62-8c88-4565-b8d0-93c12366b0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:04.273992 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1202/2388] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:03 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:05.956398 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=23 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:10.035869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b719d-b1f3-4aaf-9d49-c64c71158716 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:10.037482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ef5b719d-b1f3-4aaf-9d49-c64c71158716 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:10.074227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b719d-b1f3-4aaf-9d49-c64c71158716 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:10.103765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:10.104530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:10.104946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:10.107503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] PATH_INFO: `/v3/users/c01bf3d88a2f4f6faaa46071612460c9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:10.111711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c01bf3d88a2f4f6faaa46071612460c9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:10.118573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:10.301962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c01bf3d88a2f4f6faaa46071612460c9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:10.357766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c01bf3d88a2f4f6faaa46071612460c9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:10.358810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c01bf3d88a2f4f6faaa46071612460c9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:10.376287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c01bf3d88a2f4f6faaa46071612460c9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:10.391558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d84efc23-71a9-425f-8971-50ff0cb2e4d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c01bf3d88a2f4f6faaa46071612460c9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:10.408532 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1187/2389] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:55:10 2022] DELETE /identity/v3/users/c01bf3d88a2f4f6faaa46071612460c9 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:12.584918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959cd62-8c88-4565-b8d0-93c12366b0f5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:12.604589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4959cd62-8c88-4565-b8d0-93c12366b0f5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:12.648520 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:12.819513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:12.820066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:12.820987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:12.821279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] PATH_INFO: `/v3/projects/4dfcb820b7984314b29f347ecd2b9141` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:12.822506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dfcb820b7984314b29f347ecd2b9141)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:12.824477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:12.933536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dfcb820b7984314b29f347ecd2b9141', 'request_id': 'req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:12.948952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dfcb820b7984314b29f347ecd2b9141', 'request_id': 'req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:12.961105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dfcb820b7984314b29f347ecd2b9141', 'request_id': 'req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:12.986149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] The token cache is being invalidate because project 4dfcb820b7984314b29f347ecd2b9141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:55:12.986523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:12.987231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-14a5c63f-51b7-43c0-96e1-4baf6b4f8410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:12.994900 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1203/2390] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:55:12 2022] DELETE /identity/v3/projects/4dfcb820b7984314b29f347ecd2b9141 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:12.996675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71865656-d0ed-4313-8ea8-c90e8ae7880a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:12.997124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71865656-d0ed-4313-8ea8-c90e8ae7880a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:12.997207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71865656-d0ed-4313-8ea8-c90e8ae7880a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:13.049185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-71865656-d0ed-4313-8ea8-c90e8ae7880a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:13.050460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-71865656-d0ed-4313-8ea8-c90e8ae7880a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:13.263867 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1188/2391] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:13.271978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5470-fcc8-49e4-8c13-27fd3c9191a9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:13.272316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5470-fcc8-49e4-8c13-27fd3c9191a9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:13.272538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990d5470-fcc8-49e4-8c13-27fd3c9191a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:13.350977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-990d5470-fcc8-49e4-8c13-27fd3c9191a9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:13.356650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-990d5470-fcc8-49e4-8c13-27fd3c9191a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:13.397335 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1204/2392] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:13.401821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71865656-d0ed-4313-8ea8-c90e8ae7880a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:13.441520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71865656-d0ed-4313-8ea8-c90e8ae7880a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:13.470363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada97f-0f9b-478a-80f6-3f9d9eab8396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:13.471321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada97f-0f9b-478a-80f6-3f9d9eab8396 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:13.471321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada97f-0f9b-478a-80f6-3f9d9eab8396 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:13.471561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada97f-0f9b-478a-80f6-3f9d9eab8396 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:13.472377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada97f-0f9b-478a-80f6-3f9d9eab8396 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:55:13.472753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada97f-0f9b-478a-80f6-3f9d9eab8396 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:13.474507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada97f-0f9b-478a-80f6-3f9d9eab8396 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:13.489080 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1189/2393] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:55:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:55:13.494005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d5470-fcc8-49e4-8c13-27fd3c9191a9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:13.507518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990d5470-fcc8-49e4-8c13-27fd3c9191a9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:13.522098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ef33f-5578-48bb-bc52-eaebad60ea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:13.522817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef33f-5578-48bb-bc52-eaebad60ea6b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:13.523814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef33f-5578-48bb-bc52-eaebad60ea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:13.526152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8ef33f-5578-48bb-bc52-eaebad60ea6b admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:13.527063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ef33f-5578-48bb-bc52-eaebad60ea6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:13.533346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8ef33f-5578-48bb-bc52-eaebad60ea6b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:13.624628 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1205/2394] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:55:13 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:55:13.628822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada97f-0f9b-478a-80f6-3f9d9eab8396 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:13.643615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada97f-0f9b-478a-80f6-3f9d9eab8396 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:13.851403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d155-cdf7-414b-8901-cf0f73130e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:13.852046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d155-cdf7-414b-8901-cf0f73130e44 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:13.852332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d155-cdf7-414b-8901-cf0f73130e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:13.852612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4690d155-cdf7-414b-8901-cf0f73130e44 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:13.853259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d155-cdf7-414b-8901-cf0f73130e44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:13.855266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4690d155-cdf7-414b-8901-cf0f73130e44 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:13.864167 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:13.895952 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1190/2395] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:55:13 2022] POST /identity/v3/users => generated 290 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:55:13.897059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ef33f-5578-48bb-bc52-eaebad60ea6b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:13.929755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8ef33f-5578-48bb-bc52-eaebad60ea6b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:13.965534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0d3f2-dac2-423a-8888-af329ae428f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:13.974102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0d3f2-dac2-423a-8888-af329ae428f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:13.974837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0d3f2-dac2-423a-8888-af329ae428f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:13.975109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb0d3f2-dac2-423a-8888-af329ae428f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:13.975784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0d3f2-dac2-423a-8888-af329ae428f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:13.977763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb0d3f2-dac2-423a-8888-af329ae428f0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:13.998923 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1206/2396] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:55:13 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:55:14.002894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d155-cdf7-414b-8901-cf0f73130e44 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:14.038155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4690d155-cdf7-414b-8901-cf0f73130e44 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:14.052503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ca8ade-f323-4565-ae29-4adb21c05b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:14.064516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca8ade-f323-4565-ae29-4adb21c05b62 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:14.064808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca8ade-f323-4565-ae29-4adb21c05b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:14.065098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ca8ade-f323-4565-ae29-4adb21c05b62 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:14.070375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca8ade-f323-4565-ae29-4adb21c05b62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:14.082223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ca8ade-f323-4565-ae29-4adb21c05b62 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:14.114953 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1191/2397] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:55:14 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:55:14.116237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0d3f2-dac2-423a-8888-af329ae428f0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:14.136649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb0d3f2-dac2-423a-8888-af329ae428f0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:14.165067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c0585-0329-4b30-a572-590fbea0e201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:14.165067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0585-0329-4b30-a572-590fbea0e201 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:14.165575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0585-0329-4b30-a572-590fbea0e201 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:14.165960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c0585-0329-4b30-a572-590fbea0e201 admin admin] PATH_INFO: `/v3/projects/8296bcb4ff034194b66485ce116bb18a/users/0a5f0704d95640a99457ddd8652f83ca/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:14.229823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c0585-0329-4b30-a572-590fbea0e201 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8296bcb4ff034194b66485ce116bb18a, user_id=0a5f0704d95640a99457ddd8652f83ca, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:14.233307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c0585-0329-4b30-a572-590fbea0e201 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:14.273933 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1207/2398] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:55:14 2022] PUT /identity/v3/projects/8296bcb4ff034194b66485ce116bb18a/users/0a5f0704d95640a99457ddd8652f83ca/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:14.275819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0185bb-2c6e-47f2-be94-428ffda3acab None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:14.276110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0185bb-2c6e-47f2-be94-428ffda3acab None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:14.276389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0185bb-2c6e-47f2-be94-428ffda3acab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:14.329730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6c0185bb-2c6e-47f2-be94-428ffda3acab None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:14.333108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c0185bb-2c6e-47f2-be94-428ffda3acab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:14.511144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1192/2399] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:14.570474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c0585-0329-4b30-a572-590fbea0e201 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:14.572712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef4c0585-0329-4b30-a572-590fbea0e201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:14.671127 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:14.709708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c0585-0329-4b30-a572-590fbea0e201 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:14.719381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412543eb-21f6-4e5e-9b7b-2530f0362844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:14.720191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412543eb-21f6-4e5e-9b7b-2530f0362844 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:14.720578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412543eb-21f6-4e5e-9b7b-2530f0362844 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:14.721093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412543eb-21f6-4e5e-9b7b-2530f0362844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:14.746359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412543eb-21f6-4e5e-9b7b-2530f0362844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:14.748310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412543eb-21f6-4e5e-9b7b-2530f0362844 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:14.795014 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1208/2400] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:15.757672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce8ae-b21f-4c1a-b288-4247c55d6a8d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:15.758218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce8ae-b21f-4c1a-b288-4247c55d6a8d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:15.758218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cce8ae-b21f-4c1a-b288-4247c55d6a8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:15.872124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e5cce8ae-b21f-4c1a-b288-4247c55d6a8d None None] MFA Rules not processed for user `bea1fba85548404ca535fc5889752511`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:15.873935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5cce8ae-b21f-4c1a-b288-4247c55d6a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:16.175954 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1193/2401] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 424 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:16.186978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e7229-d0e1-4e74-b562-f52307c161b1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:16.188278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e7229-d0e1-4e74-b562-f52307c161b1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:16.189897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e7229-d0e1-4e74-b562-f52307c161b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:16.267297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f89e7229-d0e1-4e74-b562-f52307c161b1 None None] MFA Rules not processed for user `bea1fba85548404ca535fc5889752511`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:16.268881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f89e7229-d0e1-4e74-b562-f52307c161b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:16.280487 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1209/2402] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:16.292022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce8ae-b21f-4c1a-b288-4247c55d6a8d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:16.293770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5cce8ae-b21f-4c1a-b288-4247c55d6a8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:16.512525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cce8ae-b21f-4c1a-b288-4247c55d6a8d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:16.545791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33601274-3338-4689-b7b2-2476c08f64a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:16.552939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33601274-3338-4689-b7b2-2476c08f64a1 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:16.554710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33601274-3338-4689-b7b2-2476c08f64a1 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:16.556973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33601274-3338-4689-b7b2-2476c08f64a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:16.580410 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:16.594130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33601274-3338-4689-b7b2-2476c08f64a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:16.618301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33601274-3338-4689-b7b2-2476c08f64a1 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:16.672883 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1194/2403] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:16 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:21.182837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e7229-d0e1-4e74-b562-f52307c161b1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:21.223457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e7229-d0e1-4e74-b562-f52307c161b1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:21.244954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c2a5a-00b0-4d8e-949f-88a6d3d81bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:21.245687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c2a5a-00b0-4d8e-949f-88a6d3d81bf6 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:21.246226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c2a5a-00b0-4d8e-949f-88a6d3d81bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:21.246554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772c2a5a-00b0-4d8e-949f-88a6d3d81bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:21.258572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-772c2a5a-00b0-4d8e-949f-88a6d3d81bf6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:21.389768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33601274-3338-4689-b7b2-2476c08f64a1 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:21.392168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-33601274-3338-4689-b7b2-2476c08f64a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:21.429082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33601274-3338-4689-b7b2-2476c08f64a1 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:21.434683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c2a5a-00b0-4d8e-949f-88a6d3d81bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:21.446567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772c2a5a-00b0-4d8e-949f-88a6d3d81bf6 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:21.454382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:21.458372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:21.459381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:21.459820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] PATH_INFO: `/v3/users/aec89a12c88145e4b34615836b7a690b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:21.461612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=aec89a12c88145e4b34615836b7a690b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:21.468463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:21.481387 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1210/2404] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:21.668659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aec89a12c88145e4b34615836b7a690b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:21.759370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aec89a12c88145e4b34615836b7a690b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:21.760310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aec89a12c88145e4b34615836b7a690b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:21.783705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aec89a12c88145e4b34615836b7a690b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:21.806439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb1ff620-f641-4a9a-8ba7-16bdafcd6dcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aec89a12c88145e4b34615836b7a690b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:21.819742 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1195/2405] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:55:21 2022] DELETE /identity/v3/users/aec89a12c88145e4b34615836b7a690b => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:23.273035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c2a5a-00b0-4d8e-949f-88a6d3d81bf6 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:23.292239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772c2a5a-00b0-4d8e-949f-88a6d3d81bf6 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:23.405340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f5e86-8c55-4e89-9159-ee527c243cd1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:23.405877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f5e86-8c55-4e89-9159-ee527c243cd1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:23.406109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f5e86-8c55-4e89-9159-ee527c243cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:23.412950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:23.413848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:23.414308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:23.415124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] PATH_INFO: `/v3/projects/c25289f0047040a393894b2eec720066` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:23.420490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c25289f0047040a393894b2eec720066)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:23.425272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:23.447708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1b6f5e86-8c55-4e89-9159-ee527c243cd1 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:23.451204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b6f5e86-8c55-4e89-9159-ee527c243cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:23.555625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c25289f0047040a393894b2eec720066', 'request_id': 'req-67d069a8-a98a-4172-9d3f-490a789a66a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:23.582120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c25289f0047040a393894b2eec720066', 'request_id': 'req-67d069a8-a98a-4172-9d3f-490a789a66a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:23.592340 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1196/2406] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:55:23.596183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c25289f0047040a393894b2eec720066', 'request_id': 'req-67d069a8-a98a-4172-9d3f-490a789a66a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:23.606797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f5e86-8c55-4e89-9159-ee527c243cd1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:23.608567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b6f5e86-8c55-4e89-9159-ee527c243cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:23.633438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] The token cache is being invalidate because project c25289f0047040a393894b2eec720066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:55:23.636894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:23.646836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67d069a8-a98a-4172-9d3f-490a789a66a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:23.654076 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1211/2407] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:55:23 2022] DELETE /identity/v3/projects/c25289f0047040a393894b2eec720066 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:23.659245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0d43e-f0a3-4227-8321-3b4586274ef1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:23.659537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0d43e-f0a3-4227-8321-3b4586274ef1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:23.659812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0d43e-f0a3-4227-8321-3b4586274ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:23.678396 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:23.702908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-78d0d43e-f0a3-4227-8321-3b4586274ef1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:23.709065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-78d0d43e-f0a3-4227-8321-3b4586274ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:23.793856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f5e86-8c55-4e89-9159-ee527c243cd1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:23.806140 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:23.875080 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1212/2408] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:55:23.882976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95567ceb-43a5-4c16-af61-5ad8a941673b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:23.883773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95567ceb-43a5-4c16-af61-5ad8a941673b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:23.884247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95567ceb-43a5-4c16-af61-5ad8a941673b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:23.898087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c7910-b9ec-46ca-8029-7d4a5f1d3c69 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:23.899534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c7910-b9ec-46ca-8029-7d4a5f1d3c69 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:23.900436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c7910-b9ec-46ca-8029-7d4a5f1d3c69 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:23.900866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c7910-b9ec-46ca-8029-7d4a5f1d3c69 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:23.903140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-584c7910-b9ec-46ca-8029-7d4a5f1d3c69 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:23.925730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-95567ceb-43a5-4c16-af61-5ad8a941673b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:23.926966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-95567ceb-43a5-4c16-af61-5ad8a941673b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:23.961354 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1213/2409] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:55:23.962905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95567ceb-43a5-4c16-af61-5ad8a941673b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:23.981782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95567ceb-43a5-4c16-af61-5ad8a941673b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:23.995633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a6381-58a8-41fd-9ca6-d93dad1cb03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:23.997061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a6381-58a8-41fd-9ca6-d93dad1cb03f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:23.997388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a6381-58a8-41fd-9ca6-d93dad1cb03f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:23.997945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1a6381-58a8-41fd-9ca6-d93dad1cb03f admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:23.999382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a6381-58a8-41fd-9ca6-d93dad1cb03f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:55:23.999705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a6381-58a8-41fd-9ca6-d93dad1cb03f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:24.005654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1a6381-58a8-41fd-9ca6-d93dad1cb03f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:24.012085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c7910-b9ec-46ca-8029-7d4a5f1d3c69 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:24.015372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c7910-b9ec-46ca-8029-7d4a5f1d3c69 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:24.032861 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1214/2410] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:55:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:55:24.039361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a6381-58a8-41fd-9ca6-d93dad1cb03f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:24.044272 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1197/2411] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:55:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:24.089139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1a6381-58a8-41fd-9ca6-d93dad1cb03f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:24.115134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf59e-651e-4e09-9fa4-c85c7c0b9ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:24.115683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf59e-651e-4e09-9fa4-c85c7c0b9ff8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:24.116101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf59e-651e-4e09-9fa4-c85c7c0b9ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:24.116385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acdf59e-651e-4e09-9fa4-c85c7c0b9ff8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:24.117043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdf59e-651e-4e09-9fa4-c85c7c0b9ff8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:24.119359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acdf59e-651e-4e09-9fa4-c85c7c0b9ff8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:24.205371 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1215/2412] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:55:24 2022] POST /identity/v3/projects => generated 397 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:55:24.208891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c7910-b9ec-46ca-8029-7d4a5f1d3c69 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:24.226241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c7910-b9ec-46ca-8029-7d4a5f1d3c69 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:24.448635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25787cc8-7ba9-4994-9def-54934b359cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:24.451338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25787cc8-7ba9-4994-9def-54934b359cd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:24.451920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25787cc8-7ba9-4994-9def-54934b359cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:24.452489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25787cc8-7ba9-4994-9def-54934b359cd6 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:24.454292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25787cc8-7ba9-4994-9def-54934b359cd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:24.458088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25787cc8-7ba9-4994-9def-54934b359cd6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:24.495754 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1198/2413] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:55:24 2022] POST /identity/v3/users => generated 299 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:55:24.500399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf59e-651e-4e09-9fa4-c85c7c0b9ff8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:24.528814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acdf59e-651e-4e09-9fa4-c85c7c0b9ff8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:24.553496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf7ce2-a073-4371-922f-b3c137e2b5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:24.557199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7ce2-a073-4371-922f-b3c137e2b5c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:24.559500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7ce2-a073-4371-922f-b3c137e2b5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:24.561475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daf7ce2-a073-4371-922f-b3c137e2b5c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:24.569382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf7ce2-a073-4371-922f-b3c137e2b5c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:24.577381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1daf7ce2-a073-4371-922f-b3c137e2b5c9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:24.644147 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1216/2414] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:55:24.649217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25787cc8-7ba9-4994-9def-54934b359cd6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:24.676732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25787cc8-7ba9-4994-9def-54934b359cd6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:24.705259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eda17a-1b24-4623-9857-723b923b8509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:24.705865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eda17a-1b24-4623-9857-723b923b8509 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:24.706147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eda17a-1b24-4623-9857-723b923b8509 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:24.715821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eda17a-1b24-4623-9857-723b923b8509 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:24.716552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eda17a-1b24-4623-9857-723b923b8509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:24.722292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eda17a-1b24-4623-9857-723b923b8509 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:24.775075 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1199/2415] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:55:24 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:55:24.780626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf7ce2-a073-4371-922f-b3c137e2b5c9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:24.792683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daf7ce2-a073-4371-922f-b3c137e2b5c9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:24.815724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a626c-c141-4fd4-a0aa-0996a469be83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:24.822942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a626c-c141-4fd4-a0aa-0996a469be83 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:24.824968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a626c-c141-4fd4-a0aa-0996a469be83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:24.827462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a626c-c141-4fd4-a0aa-0996a469be83 admin admin] PATH_INFO: `/v3/projects/946a17ccefa7499e8e6753cda6710cf8/users/549b0b8da68647e3b968e80ab7e48022/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:24.890902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a626c-c141-4fd4-a0aa-0996a469be83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=946a17ccefa7499e8e6753cda6710cf8, user_id=549b0b8da68647e3b968e80ab7e48022, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:24.898392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a626c-c141-4fd4-a0aa-0996a469be83 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:24.942060 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1217/2416] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:55:24 2022] PUT /identity/v3/projects/946a17ccefa7499e8e6753cda6710cf8/users/549b0b8da68647e3b968e80ab7e48022/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:24.948306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e28db-5317-4fae-8fb4-ef3c5d3efcbb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:24.948306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e28db-5317-4fae-8fb4-ef3c5d3efcbb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:24.948306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e28db-5317-4fae-8fb4-ef3c5d3efcbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:24.993178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-791e28db-5317-4fae-8fb4-ef3c5d3efcbb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:24.994573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-791e28db-5317-4fae-8fb4-ef3c5d3efcbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:25.095314 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:25.205532 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1200/2417] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:25.347641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a626c-c141-4fd4-a0aa-0996a469be83 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:25.353960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8e3a626c-c141-4fd4-a0aa-0996a469be83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:25.609830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a626c-c141-4fd4-a0aa-0996a469be83 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:25.622645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0630a2-3824-4cc9-9e6b-43bf1a83b45d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:25.623444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0630a2-3824-4cc9-9e6b-43bf1a83b45d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:25.624684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0630a2-3824-4cc9-9e6b-43bf1a83b45d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:25.626114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0630a2-3824-4cc9-9e6b-43bf1a83b45d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:25.662830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0630a2-3824-4cc9-9e6b-43bf1a83b45d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:25.678311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0630a2-3824-4cc9-9e6b-43bf1a83b45d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:25.724438 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1218/2418] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:32.074681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c2a34-ae33-4ec5-acf7-2cfdc1b9e0fa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:32.075243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c2a34-ae33-4ec5-acf7-2cfdc1b9e0fa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:32.075243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5c2a34-ae33-4ec5-acf7-2cfdc1b9e0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:32.135080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1e5c2a34-ae33-4ec5-acf7-2cfdc1b9e0fa None None] MFA Rules not processed for user `83d393f7341e402a80a50b822b3f0f94`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:32.138301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e5c2a34-ae33-4ec5-acf7-2cfdc1b9e0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:32.352504 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1201/2419] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:35.710066 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:36.214632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7679d9-55e2-4ac9-83e4-ac6445cee338 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:36.214917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7679d9-55e2-4ac9-83e4-ac6445cee338 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:36.215196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7679d9-55e2-4ac9-83e4-ac6445cee338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:36.299203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fd7679d9-55e2-4ac9-83e4-ac6445cee338 None None] MFA Rules not processed for user `0a5f0704d95640a99457ddd8652f83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:36.300952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fd7679d9-55e2-4ac9-83e4-ac6445cee338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:36.480774 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1219/2420] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:36.491584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf713cc-f8f8-41ca-ade8-3080536e6880 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:36.492234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf713cc-f8f8-41ca-ade8-3080536e6880 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:36.492234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf713cc-f8f8-41ca-ade8-3080536e6880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:36.538787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bdf713cc-f8f8-41ca-ade8-3080536e6880 None None] MFA Rules not processed for user `0a5f0704d95640a99457ddd8652f83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:36.540128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bdf713cc-f8f8-41ca-ade8-3080536e6880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:36.560814 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1202/2421] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:36.917074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7679d9-55e2-4ac9-83e4-ac6445cee338 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:36.918805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fd7679d9-55e2-4ac9-83e4-ac6445cee338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:37.110389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7679d9-55e2-4ac9-83e4-ac6445cee338 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:37.121662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271f73f-abc1-4c5b-b54b-7d85c40f53c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:37.123131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f73f-abc1-4c5b-b54b-7d85c40f53c4 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:37.123905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f73f-abc1-4c5b-b54b-7d85c40f53c4 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:37.124504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271f73f-abc1-4c5b-b54b-7d85c40f53c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:37.150430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271f73f-abc1-4c5b-b54b-7d85c40f53c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:37.152124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d271f73f-abc1-4c5b-b54b-7d85c40f53c4 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:37.191948 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1220/2422] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:38.298135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9ebd5-9784-4e85-a21e-d49eb6c80714 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:38.299189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9ebd5-9784-4e85-a21e-d49eb6c80714 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:38.299627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9ebd5-9784-4e85-a21e-d49eb6c80714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:38.354046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0ad9ebd5-9784-4e85-a21e-d49eb6c80714 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:38.355490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ad9ebd5-9784-4e85-a21e-d49eb6c80714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:38.572330 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1203/2423] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:55:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:38.584366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271f73f-abc1-4c5b-b54b-7d85c40f53c4 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:38.586083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d271f73f-abc1-4c5b-b54b-7d85c40f53c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:38.711122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271f73f-abc1-4c5b-b54b-7d85c40f53c4 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:38.727878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d15bda-e043-417b-8d14-cbe9c033b908 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:38.728703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d15bda-e043-417b-8d14-cbe9c033b908 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:38.729125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d15bda-e043-417b-8d14-cbe9c033b908 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:38.729428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d15bda-e043-417b-8d14-cbe9c033b908 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:38.750033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d15bda-e043-417b-8d14-cbe9c033b908 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:38.751832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d15bda-e043-417b-8d14-cbe9c033b908 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:38.785288 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1221/2424] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:55:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:42.770282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a21392-ca1c-4834-b796-006b48581520 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:42.771059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a21392-ca1c-4834-b796-006b48581520 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:42.772457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a21392-ca1c-4834-b796-006b48581520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:42.811064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-20a21392-ca1c-4834-b796-006b48581520 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:42.813248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20a21392-ca1c-4834-b796-006b48581520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:42.848445 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1204/2425] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 08:55:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:42.898717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d15bda-e043-417b-8d14-cbe9c033b908 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:42.908056 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:42.924114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d15bda-e043-417b-8d14-cbe9c033b908 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:42.930055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519705b-5157-4d34-9767-683738f77095 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:42.930714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519705b-5157-4d34-9767-683738f77095 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:42.930994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519705b-5157-4d34-9767-683738f77095 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:42.931267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519705b-5157-4d34-9767-683738f77095 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:42.972444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519705b-5157-4d34-9767-683738f77095 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:42.974229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519705b-5157-4d34-9767-683738f77095 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:42.999917 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1222/2426] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:55:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:55:52.496646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e1fab-dec5-4c36-96e6-8cf999aa2483 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:52.498237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e1fab-dec5-4c36-96e6-8cf999aa2483 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:52.499529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4e1fab-dec5-4c36-96e6-8cf999aa2483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:52.649121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5c4e1fab-dec5-4c36-96e6-8cf999aa2483 None None] MFA Rules not processed for user `549b0b8da68647e3b968e80ab7e48022`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:52.652542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5c4e1fab-dec5-4c36-96e6-8cf999aa2483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:52.703110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519705b-5157-4d34-9767-683738f77095 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:52.716773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519705b-5157-4d34-9767-683738f77095 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:52.725151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3d7c05-2a93-4c6f-b7d9-bf18c295a53c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:52.726179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d7c05-2a93-4c6f-b7d9-bf18c295a53c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:52.726712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d7c05-2a93-4c6f-b7d9-bf18c295a53c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:52.727217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3d7c05-2a93-4c6f-b7d9-bf18c295a53c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:52.730297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fc3d7c05-2a93-4c6f-b7d9-bf18c295a53c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:52.774146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d7c05-2a93-4c6f-b7d9-bf18c295a53c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:52.776051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3d7c05-2a93-4c6f-b7d9-bf18c295a53c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:52.802800 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1223/2427] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:52.913919 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:52.922401 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1205/2428] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 428 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:52.934362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb943f6-78ca-4468-8f66-83fb2f3efcfe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:52.934809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb943f6-78ca-4468-8f66-83fb2f3efcfe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:52.935544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb943f6-78ca-4468-8f66-83fb2f3efcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:52.974534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8bb943f6-78ca-4468-8f66-83fb2f3efcfe None None] MFA Rules not processed for user `549b0b8da68647e3b968e80ab7e48022`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:52.975962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8bb943f6-78ca-4468-8f66-83fb2f3efcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:53.000647 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1224/2429] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:52 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:55:53.013778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e1fab-dec5-4c36-96e6-8cf999aa2483 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:53.038479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4e1fab-dec5-4c36-96e6-8cf999aa2483 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:53.051254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918900f-4750-4170-b70e-cd9461f426bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:53.051254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918900f-4750-4170-b70e-cd9461f426bc service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:53.051254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918900f-4750-4170-b70e-cd9461f426bc service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:53.051254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918900f-4750-4170-b70e-cd9461f426bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:53.066436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918900f-4750-4170-b70e-cd9461f426bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:53.068487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a918900f-4750-4170-b70e-cd9461f426bc service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:53.106973 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1206/2430] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:53 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:53.518450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb943f6-78ca-4468-8f66-83fb2f3efcfe None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:53.521789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8bb943f6-78ca-4468-8f66-83fb2f3efcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:53.546821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb943f6-78ca-4468-8f66-83fb2f3efcfe None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:53.552224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:53.553185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:53.553738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:53.554253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:53.556586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:53.580910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:53.583006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:53.597104 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1225/2431] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:55.392397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918900f-4750-4170-b70e-cd9461f426bc service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:55.394497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a918900f-4750-4170-b70e-cd9461f426bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:55.525788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918900f-4750-4170-b70e-cd9461f426bc service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:55.534151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c533e-c113-4f49-92ac-3fe421d4c7c4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:55.535014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c533e-c113-4f49-92ac-3fe421d4c7c4 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:55.536763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c533e-c113-4f49-92ac-3fe421d4c7c4 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:55.537246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5c533e-c113-4f49-92ac-3fe421d4c7c4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:55.539642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2c5c533e-c113-4f49-92ac-3fe421d4c7c4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:55.555430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c533e-c113-4f49-92ac-3fe421d4c7c4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:55.557745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5c533e-c113-4f49-92ac-3fe421d4c7c4 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:55.576048 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1207/2432] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:56.867525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:56.869755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:56.899924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb22094d-49de-40dd-9a12-f00ce78a747e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:56.914086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:56.915042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:56.915585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:56.916071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] PATH_INFO: `/v3/users/4099c569c4fe489fa349ee29e6974713` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:56.917614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4099c569c4fe489fa349ee29e6974713)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:56.920545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:57.014746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4099c569c4fe489fa349ee29e6974713'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:57.033864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4099c569c4fe489fa349ee29e6974713'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:57.034950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4099c569c4fe489fa349ee29e6974713'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:57.048690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4099c569c4fe489fa349ee29e6974713'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:57.077443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4099c569c4fe489fa349ee29e6974713'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:57.096254 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1226/2433] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:55:56 2022] DELETE /identity/v3/users/4099c569c4fe489fa349ee29e6974713 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:57.693101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c533e-c113-4f49-92ac-3fe421d4c7c4 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:57.712893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5c533e-c113-4f49-92ac-3fe421d4c7c4 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:57.916194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:57.921125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:57.921732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:57.922384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] PATH_INFO: `/v3/projects/8d2c394d0ceb40f298afa7355102bfd5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:57.924591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d2c394d0ceb40f298afa7355102bfd5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:57.926787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:58.101322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d2c394d0ceb40f298afa7355102bfd5', 'request_id': 'req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.115754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d2c394d0ceb40f298afa7355102bfd5', 'request_id': 'req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.142588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d2c394d0ceb40f298afa7355102bfd5', 'request_id': 'req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.179340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] The token cache is being invalidate because project 8d2c394d0ceb40f298afa7355102bfd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:55:58.179834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.181620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.186664 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1208/2434] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:55:57 2022] DELETE /identity/v3/projects/8d2c394d0ceb40f298afa7355102bfd5 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:58.190820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:58.193589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:58.224534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ad8eae-be5a-4349-a6b1-a0fc10d38a4f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:58.401227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:58.401915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:58.402201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:58.402475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] PATH_INFO: `/v3/users/f8014c38830c46a6851b9938a6cc1cee` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:58.408725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8014c38830c46a6851b9938a6cc1cee)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:58.414650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:58.515213 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:58.550733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8014c38830c46a6851b9938a6cc1cee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.591946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8014c38830c46a6851b9938a6cc1cee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.592329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8014c38830c46a6851b9938a6cc1cee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.604048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8014c38830c46a6851b9938a6cc1cee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.622913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8014c38830c46a6851b9938a6cc1cee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:58.644493 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1227/2435] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:55:58 2022] DELETE /identity/v3/users/f8014c38830c46a6851b9938a6cc1cee => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:59.177023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:59.178520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:59.199522 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:55:59.319099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a8c7d5-26ca-48c0-b674-362cac2d39f2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:59.427598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ecfddca-e2a5-48b1-8e23-4526f64b7560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:59.428253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfddca-e2a5-48b1-8e23-4526f64b7560 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:59.428605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfddca-e2a5-48b1-8e23-4526f64b7560 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:59.429178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ecfddca-e2a5-48b1-8e23-4526f64b7560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:59.432532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2ecfddca-e2a5-48b1-8e23-4526f64b7560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:59.454024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfddca-e2a5-48b1-8e23-4526f64b7560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:59.456896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ecfddca-e2a5-48b1-8e23-4526f64b7560 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:59.476769 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1209/2436] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:55:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:55:59.599257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:55:59.601382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:55:59.774012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f7e326-5236-4e0c-b282-3e14243533da admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:55:59.782945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:55:59.783869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:59.784316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:59.784753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] PATH_INFO: `/v3/projects/ea7b38ebd98c4cb7bbc02b5030fcf925` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:59.786632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7b38ebd98c4cb7bbc02b5030fcf925)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:55:59.788786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:55:59.865981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7b38ebd98c4cb7bbc02b5030fcf925', 'request_id': 'req-facc96a6-194a-408a-9dd8-724304048a12'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:59.885174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7b38ebd98c4cb7bbc02b5030fcf925', 'request_id': 'req-facc96a6-194a-408a-9dd8-724304048a12'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:59.899296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7b38ebd98c4cb7bbc02b5030fcf925', 'request_id': 'req-facc96a6-194a-408a-9dd8-724304048a12'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:59.930230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] The token cache is being invalidate because project ea7b38ebd98c4cb7bbc02b5030fcf925 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:55:59.930545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:59.932597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-facc96a6-194a-408a-9dd8-724304048a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:55:59.935371 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1228/2437] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:55:59 2022] DELETE /identity/v3/projects/ea7b38ebd98c4cb7bbc02b5030fcf925 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:55:59.940328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6575e-1f5c-4876-baed-aab24ffa4a57 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:55:59.940685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6575e-1f5c-4876-baed-aab24ffa4a57 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:55:59.941033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee6575e-1f5c-4876-baed-aab24ffa4a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:55:59.972963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dee6575e-1f5c-4876-baed-aab24ffa4a57 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:55:59.974323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dee6575e-1f5c-4876-baed-aab24ffa4a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:00.145264 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1210/2438] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:55:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:00.159271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8f916-de3f-40cd-98c6-31a06b39869f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:00.159565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8f916-de3f-40cd-98c6-31a06b39869f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:00.159843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a8f916-de3f-40cd-98c6-31a06b39869f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:00.196244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b5a8f916-de3f-40cd-98c6-31a06b39869f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:00.197531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b5a8f916-de3f-40cd-98c6-31a06b39869f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:00.227004 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1229/2439] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:56:00.231746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6575e-1f5c-4876-baed-aab24ffa4a57 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:00.249732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee6575e-1f5c-4876-baed-aab24ffa4a57 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:00.274583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17d81-7ca1-4f80-bfdd-c3a3955c1a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:00.274811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17d81-7ca1-4f80-bfdd-c3a3955c1a9f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:00.275008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17d81-7ca1-4f80-bfdd-c3a3955c1a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:00.275457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e17d81-7ca1-4f80-bfdd-c3a3955c1a9f admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:00.276423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17d81-7ca1-4f80-bfdd-c3a3955c1a9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:56:00.276834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17d81-7ca1-4f80-bfdd-c3a3955c1a9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:00.279346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e17d81-7ca1-4f80-bfdd-c3a3955c1a9f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:00.329088 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1211/2440] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:56:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:56:00.333558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8f916-de3f-40cd-98c6-31a06b39869f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:00.349801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a8f916-de3f-40cd-98c6-31a06b39869f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:00.364383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e008c-4ad3-4d3e-8da8-b42d2c252539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:00.365016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e008c-4ad3-4d3e-8da8-b42d2c252539 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:00.365412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e008c-4ad3-4d3e-8da8-b42d2c252539 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:00.365606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073e008c-4ad3-4d3e-8da8-b42d2c252539 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:00.366293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e008c-4ad3-4d3e-8da8-b42d2c252539 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:00.368170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073e008c-4ad3-4d3e-8da8-b42d2c252539 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:00.452462 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1230/2441] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:00 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:56:00.457606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17d81-7ca1-4f80-bfdd-c3a3955c1a9f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:00.468793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e17d81-7ca1-4f80-bfdd-c3a3955c1a9f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:00.645689 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:00.660472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9239667-7d80-4c96-aa58-34f56cc8517c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:00.661111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9239667-7d80-4c96-aa58-34f56cc8517c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:00.661417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9239667-7d80-4c96-aa58-34f56cc8517c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:00.661715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9239667-7d80-4c96-aa58-34f56cc8517c admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:00.662472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9239667-7d80-4c96-aa58-34f56cc8517c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:00.664586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9239667-7d80-4c96-aa58-34f56cc8517c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:00.706052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e008c-4ad3-4d3e-8da8-b42d2c252539 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:00.706634 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1212/2442] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:00 2022] POST /identity/v3/users => generated 293 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:00.717823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073e008c-4ad3-4d3e-8da8-b42d2c252539 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:00.723029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a36d1-97a1-4a97-94d3-4c9f3d91eb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:00.723782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a36d1-97a1-4a97-94d3-4c9f3d91eb93 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:00.724052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a36d1-97a1-4a97-94d3-4c9f3d91eb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:00.724408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a36d1-97a1-4a97-94d3-4c9f3d91eb93 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:00.725147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a36d1-97a1-4a97-94d3-4c9f3d91eb93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:00.726974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a36d1-97a1-4a97-94d3-4c9f3d91eb93 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:00.733856 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:00.746465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9239667-7d80-4c96-aa58-34f56cc8517c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:00.761020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9239667-7d80-4c96-aa58-34f56cc8517c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:00.761390 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1231/2443] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:56:00.777634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2986b-cc45-473d-98d6-77ef764ffb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:00.779003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2986b-cc45-473d-98d6-77ef764ffb16 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:00.779278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2986b-cc45-473d-98d6-77ef764ffb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:00.779550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2986b-cc45-473d-98d6-77ef764ffb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:00.780204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2986b-cc45-473d-98d6-77ef764ffb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:00.787491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2986b-cc45-473d-98d6-77ef764ffb16 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:00.816900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a36d1-97a1-4a97-94d3-4c9f3d91eb93 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:00.818077 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1213/2444] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:00 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:56:00.830888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a36d1-97a1-4a97-94d3-4c9f3d91eb93 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:00.838696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385ec45-7b5a-4d58-9caf-fedd0098dc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:00.839680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385ec45-7b5a-4d58-9caf-fedd0098dc2e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:00.840174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385ec45-7b5a-4d58-9caf-fedd0098dc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:00.840895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385ec45-7b5a-4d58-9caf-fedd0098dc2e admin admin] PATH_INFO: `/v3/projects/600649b7cea34e9ca5a8da4c6aaca080/users/9f2474428af640909799dbe6a01e6e55/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:00.874588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385ec45-7b5a-4d58-9caf-fedd0098dc2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=600649b7cea34e9ca5a8da4c6aaca080, user_id=9f2474428af640909799dbe6a01e6e55, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:00.879102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d385ec45-7b5a-4d58-9caf-fedd0098dc2e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:00.915026 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1232/2445] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:00 2022] PUT /identity/v3/projects/600649b7cea34e9ca5a8da4c6aaca080/users/9f2474428af640909799dbe6a01e6e55/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:00.927170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f97e4-94a4-4bd8-ad18-7e1a947cf0c3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:00.927467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f97e4-94a4-4bd8-ad18-7e1a947cf0c3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:00.927736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6f97e4-94a4-4bd8-ad18-7e1a947cf0c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:00.973083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4b6f97e4-94a4-4bd8-ad18-7e1a947cf0c3 None None] MFA Rules not processed for user `9f2474428af640909799dbe6a01e6e55`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:00.974543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4b6f97e4-94a4-4bd8-ad18-7e1a947cf0c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:01.103934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1214/2446] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:01.104647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385ec45-7b5a-4d58-9caf-fedd0098dc2e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:01.369534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385ec45-7b5a-4d58-9caf-fedd0098dc2e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:01.388917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f46d07-3962-47a0-b3fe-dfde7570d11f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:01.391545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f46d07-3962-47a0-b3fe-dfde7570d11f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:01.392126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f46d07-3962-47a0-b3fe-dfde7570d11f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:01.392422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f46d07-3962-47a0-b3fe-dfde7570d11f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:01.393273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f46d07-3962-47a0-b3fe-dfde7570d11f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:01.395284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f46d07-3962-47a0-b3fe-dfde7570d11f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:01.482676 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1233/2447] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:01 2022] POST /identity/v3/projects => generated 383 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:56:01.487220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f97e4-94a4-4bd8-ad18-7e1a947cf0c3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:01.499217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f46d07-3962-47a0-b3fe-dfde7570d11f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:01.501151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-44f46d07-3962-47a0-b3fe-dfde7570d11f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:01.505153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6f97e4-94a4-4bd8-ad18-7e1a947cf0c3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:01.610256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac5720-14b9-40a2-87f0-55600a2ffd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:01.610898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac5720-14b9-40a2-87f0-55600a2ffd0c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:01.611180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac5720-14b9-40a2-87f0-55600a2ffd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:01.611744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ac5720-14b9-40a2-87f0-55600a2ffd0c admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:01.612397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac5720-14b9-40a2-87f0-55600a2ffd0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:01.614580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ac5720-14b9-40a2-87f0-55600a2ffd0c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:01.647064 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1215/2448] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:01 2022] POST /identity/v3/users => generated 298 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:01.648859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac5720-14b9-40a2-87f0-55600a2ffd0c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:01.665860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f46d07-3962-47a0-b3fe-dfde7570d11f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:01.680860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a28509-3a99-4421-bed8-9d47dd92b016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:01.681532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28509-3a99-4421-bed8-9d47dd92b016 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:01.681674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ac5720-14b9-40a2-87f0-55600a2ffd0c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:01.690087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28509-3a99-4421-bed8-9d47dd92b016 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:01.690517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a28509-3a99-4421-bed8-9d47dd92b016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:01.697731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-90a28509-3a99-4421-bed8-9d47dd92b016 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:01.698370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709664d3-d01d-4296-b63c-791c71166155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:01.699275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709664d3-d01d-4296-b63c-791c71166155 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:01.699808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709664d3-d01d-4296-b63c-791c71166155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:01.700315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709664d3-d01d-4296-b63c-791c71166155 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:01.701511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709664d3-d01d-4296-b63c-791c71166155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:01.704008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709664d3-d01d-4296-b63c-791c71166155 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:01.729144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1216/2449] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:01.734067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709664d3-d01d-4296-b63c-791c71166155 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:01.754013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709664d3-d01d-4296-b63c-791c71166155 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:01.768615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a28509-3a99-4421-bed8-9d47dd92b016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:01.769609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f78b6-58bb-4bf2-84df-6fb134723054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:01.770366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f78b6-58bb-4bf2-84df-6fb134723054 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:01.770721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f78b6-58bb-4bf2-84df-6fb134723054 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:01.771068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783f78b6-58bb-4bf2-84df-6fb134723054 admin admin] PATH_INFO: `/v3/projects/dc7f50ca49634d1db41908c17faca682/users/0611e7c231744f7eb53a5f47ee349022/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:01.771249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a28509-3a99-4421-bed8-9d47dd92b016 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:01.804418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f78b6-58bb-4bf2-84df-6fb134723054 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7f50ca49634d1db41908c17faca682, user_id=0611e7c231744f7eb53a5f47ee349022, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:01.810229 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1234/2450] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:01.817720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783f78b6-58bb-4bf2-84df-6fb134723054 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:01.836537 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1217/2451] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:01 2022] PUT /identity/v3/projects/dc7f50ca49634d1db41908c17faca682/users/0611e7c231744f7eb53a5f47ee349022/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:01.845673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a28509-3a99-4421-bed8-9d47dd92b016 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:01.864654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a28509-3a99-4421-bed8-9d47dd92b016 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:01.964337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd53c61-c79e-424c-933f-0a9d6d0898d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:01.964811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd53c61-c79e-424c-933f-0a9d6d0898d2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:01.965160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd53c61-c79e-424c-933f-0a9d6d0898d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:01.966230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd53c61-c79e-424c-933f-0a9d6d0898d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:01.967179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd53c61-c79e-424c-933f-0a9d6d0898d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:01.969894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd53c61-c79e-424c-933f-0a9d6d0898d2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:01.976861 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:01.987742 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1235/2452] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:01 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:01.991601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f78b6-58bb-4bf2-84df-6fb134723054 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:02.008151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783f78b6-58bb-4bf2-84df-6fb134723054 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:02.023910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bdd0c-7b81-4b55-a9c0-a634a84785f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:02.024843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bdd0c-7b81-4b55-a9c0-a634a84785f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:02.025196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bdd0c-7b81-4b55-a9c0-a634a84785f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:02.025529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68bdd0c-7b81-4b55-a9c0-a634a84785f4 admin admin] PATH_INFO: `/v3/projects/dc7f50ca49634d1db41908c17faca682/users/0611e7c231744f7eb53a5f47ee349022/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:02.028555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bdd0c-7b81-4b55-a9c0-a634a84785f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7f50ca49634d1db41908c17faca682, user_id=0611e7c231744f7eb53a5f47ee349022, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:02.031318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68bdd0c-7b81-4b55-a9c0-a634a84785f4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:02.062272 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1218/2453] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:01 2022] PUT /identity/v3/projects/dc7f50ca49634d1db41908c17faca682/users/0611e7c231744f7eb53a5f47ee349022/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:02.073053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d3253-ed5d-4bf3-a074-e8fedb26c556 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:02.073444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d3253-ed5d-4bf3-a074-e8fedb26c556 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:02.073638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d3253-ed5d-4bf3-a074-e8fedb26c556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:02.178328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-513d3253-ed5d-4bf3-a074-e8fedb26c556 None None] MFA Rules not processed for user `0611e7c231744f7eb53a5f47ee349022`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:02.179575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-513d3253-ed5d-4bf3-a074-e8fedb26c556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:02.373034 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1236/2454] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:02.507791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bdd0c-7b81-4b55-a9c0-a634a84785f4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:02.510503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a68bdd0c-7b81-4b55-a9c0-a634a84785f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:02.517982 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:02.627499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68bdd0c-7b81-4b55-a9c0-a634a84785f4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:02.627712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d3253-ed5d-4bf3-a074-e8fedb26c556 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:02.638717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-513d3253-ed5d-4bf3-a074-e8fedb26c556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:02.646450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeac00f-34e7-4a89-9392-02d76c2da225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:02.647241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac00f-34e7-4a89-9392-02d76c2da225 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:02.647523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac00f-34e7-4a89-9392-02d76c2da225 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:02.647794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aeac00f-34e7-4a89-9392-02d76c2da225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:02.652283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0aeac00f-34e7-4a89-9392-02d76c2da225 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:02.663131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d3253-ed5d-4bf3-a074-e8fedb26c556 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:02.676351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ded261-42f7-4952-b890-36dbd0d4cdf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:02.678023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ded261-42f7-4952-b890-36dbd0d4cdf4 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:02.679249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ded261-42f7-4952-b890-36dbd0d4cdf4 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:02.679603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ded261-42f7-4952-b890-36dbd0d4cdf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:02.681785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeac00f-34e7-4a89-9392-02d76c2da225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:02.686548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aeac00f-34e7-4a89-9392-02d76c2da225 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:02.698660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ded261-42f7-4952-b890-36dbd0d4cdf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:02.700849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ded261-42f7-4952-b890-36dbd0d4cdf4 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:02.703416 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1219/2455] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:02.737815 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1237/2456] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:02 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:03.265105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeac00f-34e7-4a89-9392-02d76c2da225 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:03.403439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aeac00f-34e7-4a89-9392-02d76c2da225 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:03.416899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:03.418005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:03.418538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:03.419049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] PATH_INFO: `/v3/users/9f2474428af640909799dbe6a01e6e55` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:03.423210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2474428af640909799dbe6a01e6e55)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:03.428349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:03.546981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2474428af640909799dbe6a01e6e55'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:03.572803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2474428af640909799dbe6a01e6e55'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:03.577388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2474428af640909799dbe6a01e6e55'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:03.592618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2474428af640909799dbe6a01e6e55'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:03.614731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2474428af640909799dbe6a01e6e55'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:03.630560 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1220/2457] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:03 2022] DELETE /identity/v3/users/9f2474428af640909799dbe6a01e6e55 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:03.638886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586627a-8826-4c8e-b0ba-2c2093d9da1d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:03.639705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586627a-8826-4c8e-b0ba-2c2093d9da1d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:03.639705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586627a-8826-4c8e-b0ba-2c2093d9da1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:03.674681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4586627a-8826-4c8e-b0ba-2c2093d9da1d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:03.675932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4586627a-8826-4c8e-b0ba-2c2093d9da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:03.829698 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1238/2458] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:03.869196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:03.871290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:03.902041 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:04.024812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfabea99-ee52-44f7-97f7-3e4c5e8736c4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:04.039263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8a564-a672-4098-8a65-ea19f57b6206 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:04.040287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8a564-a672-4098-8a65-ea19f57b6206 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:04.041003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8a564-a672-4098-8a65-ea19f57b6206 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:04.041660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d8a564-a672-4098-8a65-ea19f57b6206 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:04.070241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8a564-a672-4098-8a65-ea19f57b6206 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:04.074731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d8a564-a672-4098-8a65-ea19f57b6206 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:04.100991 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1221/2459] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:04.891622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586627a-8826-4c8e-b0ba-2c2093d9da1d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:04.894203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4586627a-8826-4c8e-b0ba-2c2093d9da1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:04.920080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586627a-8826-4c8e-b0ba-2c2093d9da1d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:04.929629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:04.930303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:04.930589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:04.930922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] PATH_INFO: `/v3/projects/600649b7cea34e9ca5a8da4c6aaca080` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:04.932336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=600649b7cea34e9ca5a8da4c6aaca080)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:04.947201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8a564-a672-4098-8a65-ea19f57b6206 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:04.950350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-64d8a564-a672-4098-8a65-ea19f57b6206 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:04.964775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:04.975826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d8a564-a672-4098-8a65-ea19f57b6206 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:04.991356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:04.992150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:04.992488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:04.992767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] PATH_INFO: `/v3/users/bea1fba85548404ca535fc5889752511` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:04.996791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bea1fba85548404ca535fc5889752511)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:05.000725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:05.109796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bea1fba85548404ca535fc5889752511'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.144458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bea1fba85548404ca535fc5889752511'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.149449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bea1fba85548404ca535fc5889752511'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.156789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '600649b7cea34e9ca5a8da4c6aaca080', 'request_id': 'req-a2f2bdb3-63bf-40de-9173-8697d959dd60'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.166131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bea1fba85548404ca535fc5889752511'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.176357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '600649b7cea34e9ca5a8da4c6aaca080', 'request_id': 'req-a2f2bdb3-63bf-40de-9173-8697d959dd60'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.187144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bea1fba85548404ca535fc5889752511'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.195361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '600649b7cea34e9ca5a8da4c6aaca080', 'request_id': 'req-a2f2bdb3-63bf-40de-9173-8697d959dd60'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.210676 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1222/2460] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:04 2022] DELETE /identity/v3/users/bea1fba85548404ca535fc5889752511 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:05.212270 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:05.221544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] The token cache is being invalidate because project 600649b7cea34e9ca5a8da4c6aaca080 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:05.229638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.243915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.247905 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1239/2461] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:04 2022] DELETE /identity/v3/projects/600649b7cea34e9ca5a8da4c6aaca080 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:05.252275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:05.254252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:05.379308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091a1c55-e37b-4277-a7b9-e784d8643683 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:05.386008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:05.386666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:05.387151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:05.388117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] PATH_INFO: `/v3/users/0611e7c231744f7eb53a5f47ee349022` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:05.389424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0611e7c231744f7eb53a5f47ee349022)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:05.391799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:05.444710 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:05.507447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:05.508996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:05.550415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0611e7c231744f7eb53a5f47ee349022'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.584778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0611e7c231744f7eb53a5f47ee349022'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.587328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0611e7c231744f7eb53a5f47ee349022'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.603508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0611e7c231744f7eb53a5f47ee349022'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.621405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0611e7c231744f7eb53a5f47ee349022'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:05.637872 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1223/2462] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:05 2022] DELETE /identity/v3/users/0611e7c231744f7eb53a5f47ee349022 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:05.695667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f2bdb3-63bf-40de-9173-8697d959dd60 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:05.755424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:05.757438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:05.908627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857399e7-2409-4400-b7e5-8b7c043b27c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:05.909271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857399e7-2409-4400-b7e5-8b7c043b27c5 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:05.909583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857399e7-2409-4400-b7e5-8b7c043b27c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:05.909862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857399e7-2409-4400-b7e5-8b7c043b27c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:05.912471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-857399e7-2409-4400-b7e5-8b7c043b27c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:05.938472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49f0478-4e35-4ac1-a556-68b9d0327a9b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:05.945591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:05.946347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:05.946631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:05.946966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] PATH_INFO: `/v3/projects/6e21cf10d74849ad9f86efee0a5bd4df` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:05.948893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e21cf10d74849ad9f86efee0a5bd4df)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:05.952416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:05.953812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857399e7-2409-4400-b7e5-8b7c043b27c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:05.956944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857399e7-2409-4400-b7e5-8b7c043b27c5 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:05.998423 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1240/2463] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:06.037480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e21cf10d74849ad9f86efee0a5bd4df', 'request_id': 'req-fe7b2baa-513f-45b4-9729-672438799417'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.070069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e21cf10d74849ad9f86efee0a5bd4df', 'request_id': 'req-fe7b2baa-513f-45b4-9729-672438799417'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.090904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e21cf10d74849ad9f86efee0a5bd4df', 'request_id': 'req-fe7b2baa-513f-45b4-9729-672438799417'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.116326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] The token cache is being invalidate because project 6e21cf10d74849ad9f86efee0a5bd4df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:06.116623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.117964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fe7b2baa-513f-45b4-9729-672438799417 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.124691 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1224/2464] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:05 2022] DELETE /identity/v3/projects/6e21cf10d74849ad9f86efee0a5bd4df => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:06.129719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78863-0e76-41ee-9d76-8598652b3113 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.130146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78863-0e76-41ee-9d76-8598652b3113 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.130418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f78863-0e76-41ee-9d76-8598652b3113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.158286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-29f78863-0e76-41ee-9d76-8598652b3113 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:06.159960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-29f78863-0e76-41ee-9d76-8598652b3113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:06.275501 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1241/2465] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:06.283507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3c23f-c138-495d-9586-86133bb052f8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.283822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3c23f-c138-495d-9586-86133bb052f8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.284068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e3c23f-c138-495d-9586-86133bb052f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.313345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-11e3c23f-c138-495d-9586-86133bb052f8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:06.313345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11e3c23f-c138-495d-9586-86133bb052f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:06.323293 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1225/2466] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:06.329104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78863-0e76-41ee-9d76-8598652b3113 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:06.345695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f78863-0e76-41ee-9d76-8598652b3113 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:06.350657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1d93-3e24-4449-8c41-38ed39fd5926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:06.351346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1d93-3e24-4449-8c41-38ed39fd5926 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.351624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1d93-3e24-4449-8c41-38ed39fd5926 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.351907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373c1d93-3e24-4449-8c41-38ed39fd5926 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.352558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1d93-3e24-4449-8c41-38ed39fd5926 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:56:06.352861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1d93-3e24-4449-8c41-38ed39fd5926 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:06.354636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373c1d93-3e24-4449-8c41-38ed39fd5926 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:06.368023 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1242/2467] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:56:06.373834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3c23f-c138-495d-9586-86133bb052f8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:06.385021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e3c23f-c138-495d-9586-86133bb052f8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:06.391238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96276-a7f4-4486-a957-a4a92cfdb91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:06.392563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96276-a7f4-4486-a957-a4a92cfdb91f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.392812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96276-a7f4-4486-a957-a4a92cfdb91f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.393085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e96276-a7f4-4486-a957-a4a92cfdb91f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.393843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e96276-a7f4-4486-a957-a4a92cfdb91f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:06.395835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e96276-a7f4-4486-a957-a4a92cfdb91f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:06.440387 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1226/2468] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:06 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:06.441514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1d93-3e24-4449-8c41-38ed39fd5926 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:06.455376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373c1d93-3e24-4449-8c41-38ed39fd5926 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:06.460081 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:06.554563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79838425-52bf-4b5a-b3b1-d5cb4ccb2b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:06.555267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838425-52bf-4b5a-b3b1-d5cb4ccb2b38 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.555568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838425-52bf-4b5a-b3b1-d5cb4ccb2b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.555933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79838425-52bf-4b5a-b3b1-d5cb4ccb2b38 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.556708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79838425-52bf-4b5a-b3b1-d5cb4ccb2b38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:06.560589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79838425-52bf-4b5a-b3b1-d5cb4ccb2b38 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:06.579558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96276-a7f4-4486-a957-a4a92cfdb91f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:06.588080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b3e96276-a7f4-4486-a957-a4a92cfdb91f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:06.602754 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:06.614254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e96276-a7f4-4486-a957-a4a92cfdb91f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:06.625903 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1243/2469] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:06 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:06.627455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:06.628436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.628738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.628885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79838425-52bf-4b5a-b3b1-d5cb4ccb2b38 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:06.630108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] PATH_INFO: `/v3/projects/dc7f50ca49634d1db41908c17faca682` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.631398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7f50ca49634d1db41908c17faca682)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:06.636178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:06.654685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79838425-52bf-4b5a-b3b1-d5cb4ccb2b38 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:06.661520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e073e-a5fa-488c-9299-4e6f95b27e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:06.662603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e073e-a5fa-488c-9299-4e6f95b27e54 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.663108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e073e-a5fa-488c-9299-4e6f95b27e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.663760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3e073e-a5fa-488c-9299-4e6f95b27e54 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.664661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e073e-a5fa-488c-9299-4e6f95b27e54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:06.667391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3e073e-a5fa-488c-9299-4e6f95b27e54 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:06.688610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1244/2470] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:06.689661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e073e-a5fa-488c-9299-4e6f95b27e54 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:06.718909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3e073e-a5fa-488c-9299-4e6f95b27e54 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:06.728029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3c3f-f008-4765-b07f-83029df968f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:06.728877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3c3f-f008-4765-b07f-83029df968f1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.730068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3c3f-f008-4765-b07f-83029df968f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.730656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dc3c3f-f008-4765-b07f-83029df968f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.731330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3c3f-f008-4765-b07f-83029df968f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:06.732946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dc3c3f-f008-4765-b07f-83029df968f1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:06.758991 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1245/2471] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:06 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:06.760176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3c3f-f008-4765-b07f-83029df968f1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:06.760278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7f50ca49634d1db41908c17faca682', 'request_id': 'req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.771687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7f50ca49634d1db41908c17faca682', 'request_id': 'req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.774500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dc3c3f-f008-4765-b07f-83029df968f1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:06.798678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7f50ca49634d1db41908c17faca682', 'request_id': 'req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.825800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] The token cache is being invalidate because project dc7f50ca49634d1db41908c17faca682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:06.826097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.826994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2e77d7db-50c4-4d4c-9e32-e99fe5a9b9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:06.833379 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1227/2472] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:06 2022] DELETE /identity/v3/projects/dc7f50ca49634d1db41908c17faca682 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:06.835194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bb8d3-7199-41d7-9c5b-866b177fa104 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.835984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bb8d3-7199-41d7-9c5b-866b177fa104 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.835984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68bb8d3-7199-41d7-9c5b-866b177fa104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.866282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d68bb8d3-7199-41d7-9c5b-866b177fa104 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:06.868015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d68bb8d3-7199-41d7-9c5b-866b177fa104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:06.894358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8c6038-bad6-49a5-9eb8-1d012dcd6275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:06.895259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6038-bad6-49a5-9eb8-1d012dcd6275 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.895619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6038-bad6-49a5-9eb8-1d012dcd6275 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.895988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8c6038-bad6-49a5-9eb8-1d012dcd6275 admin admin] PATH_INFO: `/v3/projects/ed3cdf857fdd4948a1135c2fe4cb3c7c/users/9056e70b4e694aa7b487cc9e66c57e76/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.914682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c6038-bad6-49a5-9eb8-1d012dcd6275 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed3cdf857fdd4948a1135c2fe4cb3c7c, user_id=9056e70b4e694aa7b487cc9e66c57e76, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:06.917551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8c6038-bad6-49a5-9eb8-1d012dcd6275 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:06.934077 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1246/2473] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:06 2022] PUT /identity/v3/projects/ed3cdf857fdd4948a1135c2fe4cb3c7c/users/9056e70b4e694aa7b487cc9e66c57e76/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:06.935811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f48848-ba71-47ce-af3a-48a9b79f61fc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.936160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f48848-ba71-47ce-af3a-48a9b79f61fc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.936513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f48848-ba71-47ce-af3a-48a9b79f61fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:06.960621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-58f48848-ba71-47ce-af3a-48a9b79f61fc None None] MFA Rules not processed for user `b43a269fe8b746b88c38db6b9e9bfa12`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:06.961939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-58f48848-ba71-47ce-af3a-48a9b79f61fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:06.968563 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1228/2474] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:06.970066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababca1b-300f-4975-83b0-5d7d61657327 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:06.970362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababca1b-300f-4975-83b0-5d7d61657327 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:06.970642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ababca1b-300f-4975-83b0-5d7d61657327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.017006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ababca1b-300f-4975-83b0-5d7d61657327 None None] MFA Rules not processed for user `9056e70b4e694aa7b487cc9e66c57e76`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:07.018667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ababca1b-300f-4975-83b0-5d7d61657327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:07.059651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1247/2475] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:07.059651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbf90-3eee-427d-842c-7bb8609a523e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:07.059651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbf90-3eee-427d-842c-7bb8609a523e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:07.059651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7fbf90-3eee-427d-842c-7bb8609a523e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.069389 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:07.096177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5c7fbf90-3eee-427d-842c-7bb8609a523e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:07.098382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5c7fbf90-3eee-427d-842c-7bb8609a523e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:07.165891 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1229/2476] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:07.183592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababca1b-300f-4975-83b0-5d7d61657327 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:07.200617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ababca1b-300f-4975-83b0-5d7d61657327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:07.204565 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1248/2477] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:07.212823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fbf90-3eee-427d-842c-7bb8609a523e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:07.226000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7fbf90-3eee-427d-842c-7bb8609a523e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:07.232721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f7175-e3d3-4f2f-8286-4c7d33b86912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:07.233364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f7175-e3d3-4f2f-8286-4c7d33b86912 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:07.233649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f7175-e3d3-4f2f-8286-4c7d33b86912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:07.233938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f7175-e3d3-4f2f-8286-4c7d33b86912 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.234551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f7175-e3d3-4f2f-8286-4c7d33b86912 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:56:07.234893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f7175-e3d3-4f2f-8286-4c7d33b86912 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:07.237199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f7175-e3d3-4f2f-8286-4c7d33b86912 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:07.244776 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:07.252498 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1249/2478] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:56:07.258411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f7175-e3d3-4f2f-8286-4c7d33b86912 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:07.283777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f7175-e3d3-4f2f-8286-4c7d33b86912 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:07.296428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab474c3-6cff-4120-af30-c58a6fac449e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:07.297479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab474c3-6cff-4120-af30-c58a6fac449e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:07.297994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab474c3-6cff-4120-af30-c58a6fac449e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:07.298482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab474c3-6cff-4120-af30-c58a6fac449e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.299482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab474c3-6cff-4120-af30-c58a6fac449e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:07.301671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab474c3-6cff-4120-af30-c58a6fac449e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:07.367842 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1250/2479] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:07 2022] POST /identity/v3/projects => generated 391 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:07.368955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab474c3-6cff-4120-af30-c58a6fac449e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:07.377958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ababca1b-300f-4975-83b0-5d7d61657327 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:07.500861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab474c3-6cff-4120-af30-c58a6fac449e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:07.507314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53653dd-504a-465d-bc32-3f0e7556ad83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:07.515935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1347a9-5343-47a2-96ef-43d096b87181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:07.516574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1347a9-5343-47a2-96ef-43d096b87181 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:07.516860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1347a9-5343-47a2-96ef-43d096b87181 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:07.517231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1347a9-5343-47a2-96ef-43d096b87181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.520752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53653dd-504a-465d-bc32-3f0e7556ad83 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:07.521532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53653dd-504a-465d-bc32-3f0e7556ad83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:07.522279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53653dd-504a-465d-bc32-3f0e7556ad83 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.523244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53653dd-504a-465d-bc32-3f0e7556ad83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:07.525881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53653dd-504a-465d-bc32-3f0e7556ad83 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:07.566222 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1251/2480] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:07 2022] POST /identity/v3/users => generated 296 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:07.568454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53653dd-504a-465d-bc32-3f0e7556ad83 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:07.581983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53653dd-504a-465d-bc32-3f0e7556ad83 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:07.588504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65eaa04-7165-4c93-9a1e-eb51479c744c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:07.589678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65eaa04-7165-4c93-9a1e-eb51479c744c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:07.590366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65eaa04-7165-4c93-9a1e-eb51479c744c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:07.590939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65eaa04-7165-4c93-9a1e-eb51479c744c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.592451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65eaa04-7165-4c93-9a1e-eb51479c744c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:07.597665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65eaa04-7165-4c93-9a1e-eb51479c744c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:07.600742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1347a9-5343-47a2-96ef-43d096b87181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:07.603006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1347a9-5343-47a2-96ef-43d096b87181 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:07.614660 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1252/2481] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:07.615838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65eaa04-7165-4c93-9a1e-eb51479c744c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:07.630245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65eaa04-7165-4c93-9a1e-eb51479c744c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:07.630647 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1230/2482] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:07.639385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40f0a9c-6ce6-4454-ac35-6fa4b37e8cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:07.639953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f0a9c-6ce6-4454-ac35-6fa4b37e8cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:07.640237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f0a9c-6ce6-4454-ac35-6fa4b37e8cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:07.640575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40f0a9c-6ce6-4454-ac35-6fa4b37e8cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.641456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f0a9c-6ce6-4454-ac35-6fa4b37e8cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:07.643152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40f0a9c-6ce6-4454-ac35-6fa4b37e8cb7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:07.660465 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1253/2483] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:07.661702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1347a9-5343-47a2-96ef-43d096b87181 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:07.675772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1347a9-5343-47a2-96ef-43d096b87181 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:07.684550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f9358-78c2-4483-888b-c5a8a289bcaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:07.685573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f9358-78c2-4483-888b-c5a8a289bcaf admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:07.686790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f9358-78c2-4483-888b-c5a8a289bcaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:07.687847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832f9358-78c2-4483-888b-c5a8a289bcaf admin admin] PATH_INFO: `/v3/projects/fad5ec49570d43de8a36ffb830b0cb5a/users/c2463750e3a14bcbaabcb84cd5baebf2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.718294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f9358-78c2-4483-888b-c5a8a289bcaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad5ec49570d43de8a36ffb830b0cb5a, user_id=c2463750e3a14bcbaabcb84cd5baebf2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:07.723340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832f9358-78c2-4483-888b-c5a8a289bcaf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:07.761345 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1231/2484] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:07 2022] PUT /identity/v3/projects/fad5ec49570d43de8a36ffb830b0cb5a/users/c2463750e3a14bcbaabcb84cd5baebf2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:07.762450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18220abe-e4a8-4536-9049-63b7dcb74a0c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:07.762450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18220abe-e4a8-4536-9049-63b7dcb74a0c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:07.762450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18220abe-e4a8-4536-9049-63b7dcb74a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:07.825995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-18220abe-e4a8-4536-9049-63b7dcb74a0c None None] MFA Rules not processed for user `c2463750e3a14bcbaabcb84cd5baebf2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:07.827514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-18220abe-e4a8-4536-9049-63b7dcb74a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:07.892016 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:08.013521 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1254/2485] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:08.014436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f9358-78c2-4483-888b-c5a8a289bcaf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:08.078968 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:08.144748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832f9358-78c2-4483-888b-c5a8a289bcaf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:08.175960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63538e4c-4e60-40a3-a3ce-246272615601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:08.176597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538e4c-4e60-40a3-a3ce-246272615601 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:08.176881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538e4c-4e60-40a3-a3ce-246272615601 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:08.177157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63538e4c-4e60-40a3-a3ce-246272615601 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:08.184505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63538e4c-4e60-40a3-a3ce-246272615601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:08.210256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63538e4c-4e60-40a3-a3ce-246272615601 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:08.316895 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1232/2486] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:08 2022] POST /identity/v3/projects => generated 393 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:08.321381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18220abe-e4a8-4536-9049-63b7dcb74a0c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:08.351294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18220abe-e4a8-4536-9049-63b7dcb74a0c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:08.505587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ad628-29bd-471e-8eb8-6959d341d495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:08.506217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ad628-29bd-471e-8eb8-6959d341d495 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:08.506637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ad628-29bd-471e-8eb8-6959d341d495 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:08.506789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ad628-29bd-471e-8eb8-6959d341d495 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:08.507391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ad628-29bd-471e-8eb8-6959d341d495 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:08.509359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4ad628-29bd-471e-8eb8-6959d341d495 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:08.551982 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1255/2487] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:08 2022] POST /identity/v3/users => generated 303 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:08.552295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63538e4c-4e60-40a3-a3ce-246272615601 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:08.572058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63538e4c-4e60-40a3-a3ce-246272615601 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:08.578417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb36f15-3853-4723-a815-cee2b5f3a14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:08.591228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb36f15-3853-4723-a815-cee2b5f3a14b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:08.591228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb36f15-3853-4723-a815-cee2b5f3a14b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:08.591228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb36f15-3853-4723-a815-cee2b5f3a14b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:08.591228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb36f15-3853-4723-a815-cee2b5f3a14b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:08.591228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb36f15-3853-4723-a815-cee2b5f3a14b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:08.591746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ad628-29bd-471e-8eb8-6959d341d495 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:08.591746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ad4ad628-29bd-471e-8eb8-6959d341d495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:08.602324 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1233/2488] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:08.604451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb36f15-3853-4723-a815-cee2b5f3a14b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:08.613440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ad628-29bd-471e-8eb8-6959d341d495 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:08.619559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:08.619750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb36f15-3853-4723-a815-cee2b5f3a14b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:08.620196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:08.621003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:08.621382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] PATH_INFO: `/v3/users/9056e70b4e694aa7b487cc9e66c57e76` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:08.623222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9056e70b4e694aa7b487cc9e66c57e76)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:08.625145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:08.625265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd335475-4c81-4692-9c99-cc92ce9a5361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:08.625990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd335475-4c81-4692-9c99-cc92ce9a5361 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:08.626335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd335475-4c81-4692-9c99-cc92ce9a5361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:08.626679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd335475-4c81-4692-9c99-cc92ce9a5361 admin admin] PATH_INFO: `/v3/projects/8bffa80035e44b0fa2d8e92312bb1eb5/users/09b4c90edf444f63b88ddb39d1002a0b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:08.646530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd335475-4c81-4692-9c99-cc92ce9a5361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bffa80035e44b0fa2d8e92312bb1eb5, user_id=09b4c90edf444f63b88ddb39d1002a0b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:08.650192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd335475-4c81-4692-9c99-cc92ce9a5361 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:08.673373 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1234/2489] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:08 2022] PUT /identity/v3/projects/8bffa80035e44b0fa2d8e92312bb1eb5/users/09b4c90edf444f63b88ddb39d1002a0b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:08.676072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd335475-4c81-4692-9c99-cc92ce9a5361 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:08.710805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9056e70b4e694aa7b487cc9e66c57e76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:08.734383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9056e70b4e694aa7b487cc9e66c57e76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:08.735151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9056e70b4e694aa7b487cc9e66c57e76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:08.748166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9056e70b4e694aa7b487cc9e66c57e76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:08.763347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0f31e81-e5a6-49aa-9f76-3206de7fdca4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9056e70b4e694aa7b487cc9e66c57e76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:08.776869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd335475-4c81-4692-9c99-cc92ce9a5361 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:08.780547 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1256/2490] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:08 2022] DELETE /identity/v3/users/9056e70b4e694aa7b487cc9e66c57e76 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:08.784581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d17a-ce49-45ca-863d-21782ac24997 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:08.784973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d17a-ce49-45ca-863d-21782ac24997 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:08.785381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0058d17a-ce49-45ca-863d-21782ac24997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:08.786247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4f46-68e0-40d8-a4f0-6f552a0d39f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:08.787730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4f46-68e0-40d8-a4f0-6f552a0d39f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:08.788298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4f46-68e0-40d8-a4f0-6f552a0d39f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:08.788909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b4f46-68e0-40d8-a4f0-6f552a0d39f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:08.789597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4f46-68e0-40d8-a4f0-6f552a0d39f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:08.791532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b4f46-68e0-40d8-a4f0-6f552a0d39f3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:08.806424 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1235/2491] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:08 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:56:08.807411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0058d17a-ce49-45ca-863d-21782ac24997 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:08.808738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0058d17a-ce49-45ca-863d-21782ac24997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:08.808949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4f46-68e0-40d8-a4f0-6f552a0d39f3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:08.811411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-de7b4f46-68e0-40d8-a4f0-6f552a0d39f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:08.829354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b4f46-68e0-40d8-a4f0-6f552a0d39f3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:08.843073 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:08.923524 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1257/2492] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:08.933212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058d17a-ce49-45ca-863d-21782ac24997 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:08.934722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0058d17a-ce49-45ca-863d-21782ac24997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:08.944106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b98bf4f-65b7-484b-971b-2bbf819809f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:08.944665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98bf4f-65b7-484b-971b-2bbf819809f5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:08.944972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98bf4f-65b7-484b-971b-2bbf819809f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:08.946582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b98bf4f-65b7-484b-971b-2bbf819809f5 admin admin] PATH_INFO: `/v3/projects/8bffa80035e44b0fa2d8e92312bb1eb5/users/09b4c90edf444f63b88ddb39d1002a0b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:08.957803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98bf4f-65b7-484b-971b-2bbf819809f5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bffa80035e44b0fa2d8e92312bb1eb5, user_id=09b4c90edf444f63b88ddb39d1002a0b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:08.962990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b98bf4f-65b7-484b-971b-2bbf819809f5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:08.992739 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1236/2493] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:08 2022] PUT /identity/v3/projects/8bffa80035e44b0fa2d8e92312bb1eb5/users/09b4c90edf444f63b88ddb39d1002a0b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:09.003772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d393b-e83e-49e3-a9df-e51ebd25bd81 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:09.004136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d393b-e83e-49e3-a9df-e51ebd25bd81 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:09.004364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656d393b-e83e-49e3-a9df-e51ebd25bd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:09.037757 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:09.076378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-656d393b-e83e-49e3-a9df-e51ebd25bd81 None None] MFA Rules not processed for user `09b4c90edf444f63b88ddb39d1002a0b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:09.078809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-656d393b-e83e-49e3-a9df-e51ebd25bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:09.123935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0058d17a-ce49-45ca-863d-21782ac24997 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:09.234595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd45907b-f133-42bd-bc66-bbe634b6ef36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:09.235372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45907b-f133-42bd-bc66-bbe634b6ef36 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:09.235659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45907b-f133-42bd-bc66-bbe634b6ef36 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:09.236726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd45907b-f133-42bd-bc66-bbe634b6ef36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:09.267564 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1237/2494] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:09 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:09.279730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d393b-e83e-49e3-a9df-e51ebd25bd81 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:09.281849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-656d393b-e83e-49e3-a9df-e51ebd25bd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:09.338669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45907b-f133-42bd-bc66-bbe634b6ef36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:09.339734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd45907b-f133-42bd-bc66-bbe634b6ef36 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:09.354124 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1258/2495] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:56:09.443772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656d393b-e83e-49e3-a9df-e51ebd25bd81 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:09.457026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08873-66cc-4982-9e4f-8e5aa45365c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:09.457964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08873-66cc-4982-9e4f-8e5aa45365c5 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:09.458493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08873-66cc-4982-9e4f-8e5aa45365c5 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:09.459028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f08873-66cc-4982-9e4f-8e5aa45365c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:09.472946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f08873-66cc-4982-9e4f-8e5aa45365c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:09.475355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f08873-66cc-4982-9e4f-8e5aa45365c5 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:09.497496 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1238/2496] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:09 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:09.553610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfa714-8423-4555-9dc6-c875702ef279 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:09.553924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfa714-8423-4555-9dc6-c875702ef279 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:09.554192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cfa714-8423-4555-9dc6-c875702ef279 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:09.605801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-11cfa714-8423-4555-9dc6-c875702ef279 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:09.609560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-11cfa714-8423-4555-9dc6-c875702ef279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:09.662026 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:09.706072 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1259/2497] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:56:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:09.720371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08873-66cc-4982-9e4f-8e5aa45365c5 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:09.722666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1f08873-66cc-4982-9e4f-8e5aa45365c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:09.753184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfa714-8423-4555-9dc6-c875702ef279 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:09.768446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cfa714-8423-4555-9dc6-c875702ef279 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:09.794513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:09.797322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:09.798695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:09.798969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] PATH_INFO: `/v3/users/c2463750e3a14bcbaabcb84cd5baebf2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:09.801321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2463750e3a14bcbaabcb84cd5baebf2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:09.803276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:09.868923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f08873-66cc-4982-9e4f-8e5aa45365c5 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:09.881137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e48ac-b303-41bf-88de-4c1ab4e47faf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:09.882321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e48ac-b303-41bf-88de-4c1ab4e47faf service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:09.882739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e48ac-b303-41bf-88de-4c1ab4e47faf service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:09.883342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e48ac-b303-41bf-88de-4c1ab4e47faf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:09.894586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e48ac-b303-41bf-88de-4c1ab4e47faf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:09.897549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19e48ac-b303-41bf-88de-4c1ab4e47faf service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:09.910872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2463750e3a14bcbaabcb84cd5baebf2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:09.912622 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1239/2498] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:56:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 08:56:09.913778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e48ac-b303-41bf-88de-4c1ab4e47faf service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:09.915670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d19e48ac-b303-41bf-88de-4c1ab4e47faf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:09.942194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e48ac-b303-41bf-88de-4c1ab4e47faf service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:09.942966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2463750e3a14bcbaabcb84cd5baebf2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:09.944086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2463750e3a14bcbaabcb84cd5baebf2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:09.970583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:09.972827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:09.976562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:09.976927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] PATH_INFO: `/v3/projects/ed3cdf857fdd4948a1135c2fe4cb3c7c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:09.979970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed3cdf857fdd4948a1135c2fe4cb3c7c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:09.982949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:09.985625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2463750e3a14bcbaabcb84cd5baebf2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:09.993337 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:09.998462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e682744-a30b-4f66-9e53-b2d00760bcdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2463750e3a14bcbaabcb84cd5baebf2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:10.016525 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1260/2499] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:09 2022] DELETE /identity/v3/users/c2463750e3a14bcbaabcb84cd5baebf2 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:10.016525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711bec9-9fb6-4572-ab3a-c1c3f6c4efcb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:10.016525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711bec9-9fb6-4572-ab3a-c1c3f6c4efcb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:10.016525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5711bec9-9fb6-4572-ab3a-c1c3f6c4efcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:10.050609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5711bec9-9fb6-4572-ab3a-c1c3f6c4efcb None None] MFA Rules not processed for user `0a5f0704d95640a99457ddd8652f83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:10.056797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5711bec9-9fb6-4572-ab3a-c1c3f6c4efcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:10.164344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed3cdf857fdd4948a1135c2fe4cb3c7c', 'request_id': 'req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:10.190704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed3cdf857fdd4948a1135c2fe4cb3c7c', 'request_id': 'req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:10.211164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed3cdf857fdd4948a1135c2fe4cb3c7c', 'request_id': 'req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:10.223529 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1261/2500] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:10.225074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730fd4-560c-4b90-a474-fe7c409d46ab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:10.225397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730fd4-560c-4b90-a474-fe7c409d46ab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:10.225681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05730fd4-560c-4b90-a474-fe7c409d46ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:10.244639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] The token cache is being invalidate because project ed3cdf857fdd4948a1135c2fe4cb3c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:10.247486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:10.249717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a1824ba4-5f5d-4f9d-8daf-48f306cf271b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:10.249856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-05730fd4-560c-4b90-a474-fe7c409d46ab None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:10.257883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-05730fd4-560c-4b90-a474-fe7c409d46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:10.259051 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1240/2501] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:09 2022] DELETE /identity/v3/projects/ed3cdf857fdd4948a1135c2fe4cb3c7c => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:10.270220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae4acd-2fe7-4470-ad1d-c9e54e529ffe None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:10.271554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae4acd-2fe7-4470-ad1d-c9e54e529ffe None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:10.272059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ae4acd-2fe7-4470-ad1d-c9e54e529ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:10.316140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-45ae4acd-2fe7-4470-ad1d-c9e54e529ffe None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:10.322918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-45ae4acd-2fe7-4470-ad1d-c9e54e529ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:10.359313 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:10.396691 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1262/2502] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:10.406481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730fd4-560c-4b90-a474-fe7c409d46ab None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:10.408411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-05730fd4-560c-4b90-a474-fe7c409d46ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:10.528352 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1241/2503] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:10.530298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddbfe1-ca0b-4484-8182-b6eb8fb9407c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:10.530298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddbfe1-ca0b-4484-8182-b6eb8fb9407c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:10.530583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ddbfe1-ca0b-4484-8182-b6eb8fb9407c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:10.589581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05730fd4-560c-4b90-a474-fe7c409d46ab None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:10.596061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465a8c-51d6-4e06-8b80-7972d117285d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:10.599746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465a8c-51d6-4e06-8b80-7972d117285d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:10.600032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465a8c-51d6-4e06-8b80-7972d117285d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:10.600314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0465a8c-51d6-4e06-8b80-7972d117285d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:10.614281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e9ddbfe1-ca0b-4484-8182-b6eb8fb9407c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:10.615618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e9ddbfe1-ca0b-4484-8182-b6eb8fb9407c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:10.651617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0465a8c-51d6-4e06-8b80-7972d117285d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:10.655392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0465a8c-51d6-4e06-8b80-7972d117285d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:10.658689 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1242/2504] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:10.664598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddbfe1-ca0b-4484-8182-b6eb8fb9407c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:10.688528 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1263/2505] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:56:10.690897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ddbfe1-ca0b-4484-8182-b6eb8fb9407c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:10.707205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dbd81-2b82-41da-855c-8c1ee864ecaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:10.707856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dbd81-2b82-41da-855c-8c1ee864ecaa admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:10.708656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dbd81-2b82-41da-855c-8c1ee864ecaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:10.708939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942dbd81-2b82-41da-855c-8c1ee864ecaa admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:10.709749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dbd81-2b82-41da-855c-8c1ee864ecaa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:56:10.710060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dbd81-2b82-41da-855c-8c1ee864ecaa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:10.711699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942dbd81-2b82-41da-855c-8c1ee864ecaa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:10.746780 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1243/2506] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:56:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:56:10.752643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465a8c-51d6-4e06-8b80-7972d117285d service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:10.768211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0465a8c-51d6-4e06-8b80-7972d117285d service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:10.777234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c207870-4bbf-4bac-ae53-177bd1b8059b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:10.779467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207870-4bbf-4bac-ae53-177bd1b8059b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:10.780413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207870-4bbf-4bac-ae53-177bd1b8059b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:10.780806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c207870-4bbf-4bac-ae53-177bd1b8059b admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:10.781607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c207870-4bbf-4bac-ae53-177bd1b8059b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:10.784056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c207870-4bbf-4bac-ae53-177bd1b8059b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:10.836464 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1264/2507] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:10 2022] POST /identity/v3/projects => generated 389 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:10.838440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dbd81-2b82-41da-855c-8c1ee864ecaa admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:10.868179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942dbd81-2b82-41da-855c-8c1ee864ecaa admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:11.016485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6556-c00b-4384-9f93-d4175f4feebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:11.017409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6556-c00b-4384-9f93-d4175f4feebe admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:11.018310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6556-c00b-4384-9f93-d4175f4feebe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:11.018593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbe6556-c00b-4384-9f93-d4175f4feebe admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:11.019370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6556-c00b-4384-9f93-d4175f4feebe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:11.022319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbe6556-c00b-4384-9f93-d4175f4feebe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:11.051565 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:11.064247 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1244/2508] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:10 2022] POST /identity/v3/users => generated 295 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:11.064566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c207870-4bbf-4bac-ae53-177bd1b8059b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:11.078949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c207870-4bbf-4bac-ae53-177bd1b8059b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:11.086961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b355-f13b-472d-ae4e-05bdea70c0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:11.087618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b355-f13b-472d-ae4e-05bdea70c0dc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:11.087876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b355-f13b-472d-ae4e-05bdea70c0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:11.088150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8197b355-f13b-472d-ae4e-05bdea70c0dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:11.088795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197b355-f13b-472d-ae4e-05bdea70c0dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:11.091106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8197b355-f13b-472d-ae4e-05bdea70c0dc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:11.108220 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1265/2509] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:11.110160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6556-c00b-4384-9f93-d4175f4feebe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:11.127377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbe6556-c00b-4384-9f93-d4175f4feebe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:11.140916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4e463-d689-4d18-bbf6-acaa91044a3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:11.141959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4e463-d689-4d18-bbf6-acaa91044a3b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:11.142343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4e463-d689-4d18-bbf6-acaa91044a3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:11.142716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4e463-d689-4d18-bbf6-acaa91044a3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:11.143495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4e463-d689-4d18-bbf6-acaa91044a3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:11.145220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4e463-d689-4d18-bbf6-acaa91044a3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:11.174709 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1245/2510] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:11 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:11.175279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b355-f13b-472d-ae4e-05bdea70c0dc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:11.179639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4e463-d689-4d18-bbf6-acaa91044a3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:11.183390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4ec4e463-d689-4d18-bbf6-acaa91044a3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:11.187193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8197b355-f13b-472d-ae4e-05bdea70c0dc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:11.204212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6802c98-d4b5-4922-b367-925f93e30172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:11.207249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6802c98-d4b5-4922-b367-925f93e30172 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:11.207533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6802c98-d4b5-4922-b367-925f93e30172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:11.207812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6802c98-d4b5-4922-b367-925f93e30172 admin admin] PATH_INFO: `/v3/projects/71e2648d2b6748339745098a79d87f56/users/c1f9da09bd824bd79c6adb316f1fd41b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:11.226933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4e463-d689-4d18-bbf6-acaa91044a3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:11.235815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6802c98-d4b5-4922-b367-925f93e30172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71e2648d2b6748339745098a79d87f56, user_id=c1f9da09bd824bd79c6adb316f1fd41b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:11.238725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:11.239274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:11.239568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:11.239860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] PATH_INFO: `/v3/projects/fad5ec49570d43de8a36ffb830b0cb5a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:11.242007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad5ec49570d43de8a36ffb830b0cb5a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:11.242229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6802c98-d4b5-4922-b367-925f93e30172 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:11.248084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:11.265619 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1266/2511] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:11 2022] PUT /identity/v3/projects/71e2648d2b6748339745098a79d87f56/users/c1f9da09bd824bd79c6adb316f1fd41b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:11.272986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561eb9a-c01e-45c3-adf0-e3a111f64728 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:11.273351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561eb9a-c01e-45c3-adf0-e3a111f64728 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:11.273718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4561eb9a-c01e-45c3-adf0-e3a111f64728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:11.307354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4561eb9a-c01e-45c3-adf0-e3a111f64728 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:11.308631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4561eb9a-c01e-45c3-adf0-e3a111f64728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:11.338720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad5ec49570d43de8a36ffb830b0cb5a', 'request_id': 'req-18fc470f-99e5-4f57-86ff-8f7828444041'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.347045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad5ec49570d43de8a36ffb830b0cb5a', 'request_id': 'req-18fc470f-99e5-4f57-86ff-8f7828444041'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.357013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad5ec49570d43de8a36ffb830b0cb5a', 'request_id': 'req-18fc470f-99e5-4f57-86ff-8f7828444041'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.376580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] The token cache is being invalidate because project fad5ec49570d43de8a36ffb830b0cb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:11.376902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.378248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.380278 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1246/2512] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:11 2022] DELETE /identity/v3/projects/fad5ec49570d43de8a36ffb830b0cb5a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:11.384395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:11.387564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:11.415761 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1267/2513] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:11.422712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561eb9a-c01e-45c3-adf0-e3a111f64728 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:11.424575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4561eb9a-c01e-45c3-adf0-e3a111f64728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:11.483969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fc470f-99e5-4f57-86ff-8f7828444041 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:11.489862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:11.490514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:11.490930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:11.491218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] PATH_INFO: `/v3/users/09b4c90edf444f63b88ddb39d1002a0b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:11.492403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b4c90edf444f63b88ddb39d1002a0b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:11.494856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:11.508072 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:11.540458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4561eb9a-c01e-45c3-adf0-e3a111f64728 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:11.570264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b4c90edf444f63b88ddb39d1002a0b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.608765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b4c90edf444f63b88ddb39d1002a0b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.609760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b4c90edf444f63b88ddb39d1002a0b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.644755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b4c90edf444f63b88ddb39d1002a0b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.651667 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:11.663202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b4c90edf444f63b88ddb39d1002a0b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:11.682807 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1247/2514] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:11 2022] DELETE /identity/v3/users/09b4c90edf444f63b88ddb39d1002a0b => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:11.711732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d27fb4-c52d-4838-9bc0-cd55c3d85f26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:11.712515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27fb4-c52d-4838-9bc0-cd55c3d85f26 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:11.712917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27fb4-c52d-4838-9bc0-cd55c3d85f26 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:11.717743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d27fb4-c52d-4838-9bc0-cd55c3d85f26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:11.723184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-29d27fb4-c52d-4838-9bc0-cd55c3d85f26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:11.749258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d27fb4-c52d-4838-9bc0-cd55c3d85f26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:11.752508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d27fb4-c52d-4838-9bc0-cd55c3d85f26 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:11.784254 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1268/2515] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:56:12.186903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:12.189114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:12.338146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13154fb5-5767-4883-8620-9735f16fdaad admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:12.351076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:12.352410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:12.352696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:12.352976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] PATH_INFO: `/v3/projects/8bffa80035e44b0fa2d8e92312bb1eb5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:12.360304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bffa80035e44b0fa2d8e92312bb1eb5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:12.365771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:12.478024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bffa80035e44b0fa2d8e92312bb1eb5', 'request_id': 'req-6165602f-6287-4eb9-b29d-a552731269ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:12.496795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bffa80035e44b0fa2d8e92312bb1eb5', 'request_id': 'req-6165602f-6287-4eb9-b29d-a552731269ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:12.510608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bffa80035e44b0fa2d8e92312bb1eb5', 'request_id': 'req-6165602f-6287-4eb9-b29d-a552731269ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:12.532925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] The token cache is being invalidate because project 8bffa80035e44b0fa2d8e92312bb1eb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:12.533381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:12.534285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6165602f-6287-4eb9-b29d-a552731269ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:12.537363 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1248/2516] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:12 2022] DELETE /identity/v3/projects/8bffa80035e44b0fa2d8e92312bb1eb5 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:12.541745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b2b5-50be-43dc-b7f6-f271ad4c3e0d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:12.542242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b2b5-50be-43dc-b7f6-f271ad4c3e0d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:12.542328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98b2b5-50be-43dc-b7f6-f271ad4c3e0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:12.588789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bb98b2b5-50be-43dc-b7f6-f271ad4c3e0d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:12.596968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb98b2b5-50be-43dc-b7f6-f271ad4c3e0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:12.701178 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1269/2517] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:12.702992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929602fe-cf64-4b2a-b6ce-27a91b9e5080 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:12.703308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929602fe-cf64-4b2a-b6ce-27a91b9e5080 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:12.703586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929602fe-cf64-4b2a-b6ce-27a91b9e5080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:12.734344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-929602fe-cf64-4b2a-b6ce-27a91b9e5080 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:12.738916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-929602fe-cf64-4b2a-b6ce-27a91b9e5080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:12.773435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b2b5-50be-43dc-b7f6-f271ad4c3e0d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:12.797351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98b2b5-50be-43dc-b7f6-f271ad4c3e0d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:12.801706 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1249/2518] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:12.806259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba908cdd-a64f-4308-81ff-f624bd3166de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:12.806735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908cdd-a64f-4308-81ff-f624bd3166de admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:12.807019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908cdd-a64f-4308-81ff-f624bd3166de admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:12.807295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba908cdd-a64f-4308-81ff-f624bd3166de admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:12.807954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba908cdd-a64f-4308-81ff-f624bd3166de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:56:12.808260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba908cdd-a64f-4308-81ff-f624bd3166de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:12.809955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba908cdd-a64f-4308-81ff-f624bd3166de admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:12.833069 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1270/2519] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:56:12.836670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929602fe-cf64-4b2a-b6ce-27a91b9e5080 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:12.876762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929602fe-cf64-4b2a-b6ce-27a91b9e5080 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:12.889425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5cd8-e8ef-4f61-955c-3de1f2c0a867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:12.891668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5cd8-e8ef-4f61-955c-3de1f2c0a867 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:12.892795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5cd8-e8ef-4f61-955c-3de1f2c0a867 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:12.893229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a5cd8-e8ef-4f61-955c-3de1f2c0a867 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:12.895195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a5cd8-e8ef-4f61-955c-3de1f2c0a867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:12.899516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a5cd8-e8ef-4f61-955c-3de1f2c0a867 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:12.972231 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1250/2520] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:12 2022] POST /identity/v3/projects => generated 411 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:12.974163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba908cdd-a64f-4308-81ff-f624bd3166de admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:12.989037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba908cdd-a64f-4308-81ff-f624bd3166de admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:13.117031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5911f-3ddb-442e-92c9-525d827a4c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:13.119359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5911f-3ddb-442e-92c9-525d827a4c65 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:13.119656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5911f-3ddb-442e-92c9-525d827a4c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:13.119937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa5911f-3ddb-442e-92c9-525d827a4c65 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:13.120594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5911f-3ddb-442e-92c9-525d827a4c65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:13.133241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa5911f-3ddb-442e-92c9-525d827a4c65 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:13.174822 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1271/2521] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:12 2022] POST /identity/v3/users => generated 306 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:13.179076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5cd8-e8ef-4f61-955c-3de1f2c0a867 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:13.194470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a5cd8-e8ef-4f61-955c-3de1f2c0a867 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:13.204488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631f446-5919-420c-8bd2-a5ffd033801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:13.206164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631f446-5919-420c-8bd2-a5ffd033801c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:13.206468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631f446-5919-420c-8bd2-a5ffd033801c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:13.206748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1631f446-5919-420c-8bd2-a5ffd033801c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:13.207695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631f446-5919-420c-8bd2-a5ffd033801c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:13.212675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1631f446-5919-420c-8bd2-a5ffd033801c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:13.228515 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1251/2522] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:13.232572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5911f-3ddb-442e-92c9-525d827a4c65 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:13.250337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa5911f-3ddb-442e-92c9-525d827a4c65 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:13.257226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b41c863-cd3f-4d35-b0e3-540031c1026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:13.258125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41c863-cd3f-4d35-b0e3-540031c1026e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:13.258683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41c863-cd3f-4d35-b0e3-540031c1026e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:13.259136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b41c863-cd3f-4d35-b0e3-540031c1026e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:13.259984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41c863-cd3f-4d35-b0e3-540031c1026e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:13.263138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b41c863-cd3f-4d35-b0e3-540031c1026e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:13.283196 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1272/2523] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:13.287340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631f446-5919-420c-8bd2-a5ffd033801c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:13.301090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1631f446-5919-420c-8bd2-a5ffd033801c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:13.318119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae333b-d948-43ad-92b9-e79fd95bc39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:13.319881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae333b-d948-43ad-92b9-e79fd95bc39c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:13.320931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae333b-d948-43ad-92b9-e79fd95bc39c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:13.322040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae333b-d948-43ad-92b9-e79fd95bc39c admin admin] PATH_INFO: `/v3/projects/a69703cd88a84f07af0facdb7202c9e5/users/3e32a18dd54a4f1fa2a7d5bb064497f8/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:13.361971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae333b-d948-43ad-92b9-e79fd95bc39c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a69703cd88a84f07af0facdb7202c9e5, user_id=3e32a18dd54a4f1fa2a7d5bb064497f8, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:13.368916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae333b-d948-43ad-92b9-e79fd95bc39c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:13.458624 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1252/2524] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:13 2022] PUT /identity/v3/projects/a69703cd88a84f07af0facdb7202c9e5/users/3e32a18dd54a4f1fa2a7d5bb064497f8/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:13.472458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8d4c-1921-4a85-a6c6-0a4a6749d6b1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:13.473705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8d4c-1921-4a85-a6c6-0a4a6749d6b1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:13.474219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db8d4c-1921-4a85-a6c6-0a4a6749d6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:13.505934 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:13.556207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-64db8d4c-1921-4a85-a6c6-0a4a6749d6b1 None None] MFA Rules not processed for user `3e32a18dd54a4f1fa2a7d5bb064497f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:13.560486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-64db8d4c-1921-4a85-a6c6-0a4a6749d6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:13.740240 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1273/2525] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:13 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:13.748037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae333b-d948-43ad-92b9-e79fd95bc39c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:13.795893 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:13.967623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae333b-d948-43ad-92b9-e79fd95bc39c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:13.981629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868be13-2d9b-4589-96a5-32deacc8dfad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:13.982273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868be13-2d9b-4589-96a5-32deacc8dfad admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:13.982556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868be13-2d9b-4589-96a5-32deacc8dfad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:13.982832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5868be13-2d9b-4589-96a5-32deacc8dfad admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:13.983485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868be13-2d9b-4589-96a5-32deacc8dfad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:13.985483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5868be13-2d9b-4589-96a5-32deacc8dfad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:14.056266 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1253/2526] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:13 2022] POST /identity/v3/projects => generated 409 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:14.060981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db8d4c-1921-4a85-a6c6-0a4a6749d6b1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:14.077125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db8d4c-1921-4a85-a6c6-0a4a6749d6b1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:14.285424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed73fc-3ed9-4e8b-a537-b92d39f9ac43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:14.285872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed73fc-3ed9-4e8b-a537-b92d39f9ac43 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:14.286176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed73fc-3ed9-4e8b-a537-b92d39f9ac43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:14.286432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceed73fc-3ed9-4e8b-a537-b92d39f9ac43 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:14.288749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed73fc-3ed9-4e8b-a537-b92d39f9ac43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:14.291867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceed73fc-3ed9-4e8b-a537-b92d39f9ac43 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:14.351316 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1274/2527] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:14 2022] POST /identity/v3/users => generated 311 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:14.364130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868be13-2d9b-4589-96a5-32deacc8dfad admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:14.431048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5868be13-2d9b-4589-96a5-32deacc8dfad admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:14.437931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ca93-978b-4774-9042-d115ab8d3632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:14.438661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ca93-978b-4774-9042-d115ab8d3632 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:14.439091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ca93-978b-4774-9042-d115ab8d3632 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:14.439427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188ca93-978b-4774-9042-d115ab8d3632 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:14.440472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188ca93-978b-4774-9042-d115ab8d3632 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:14.442433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188ca93-978b-4774-9042-d115ab8d3632 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:14.474813 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1254/2528] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:14.478351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed73fc-3ed9-4e8b-a537-b92d39f9ac43 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:14.499280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceed73fc-3ed9-4e8b-a537-b92d39f9ac43 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:14.523485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609bf6c-551c-4bd8-a479-fd23711032df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:14.527094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609bf6c-551c-4bd8-a479-fd23711032df admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:14.528316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609bf6c-551c-4bd8-a479-fd23711032df admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:14.528922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d609bf6c-551c-4bd8-a479-fd23711032df admin admin] PATH_INFO: `/v3/projects/8e042f14a0c049f1af2f0f26a1da58ec/users/1f06078de46f417d8c865dde7597b374/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:14.608869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609bf6c-551c-4bd8-a479-fd23711032df admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e042f14a0c049f1af2f0f26a1da58ec, user_id=1f06078de46f417d8c865dde7597b374, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:14.611730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d609bf6c-551c-4bd8-a479-fd23711032df admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:14.633377 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1275/2529] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:14 2022] PUT /identity/v3/projects/8e042f14a0c049f1af2f0f26a1da58ec/users/1f06078de46f417d8c865dde7597b374/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:14.638150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ca93-978b-4774-9042-d115ab8d3632 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:14.652042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188ca93-978b-4774-9042-d115ab8d3632 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:14.808849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b827409e-da0b-4fa4-ac47-c54c2b3ecb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:14.810018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827409e-da0b-4fa4-ac47-c54c2b3ecb68 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:14.810457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827409e-da0b-4fa4-ac47-c54c2b3ecb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:14.810885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b827409e-da0b-4fa4-ac47-c54c2b3ecb68 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:14.812024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827409e-da0b-4fa4-ac47-c54c2b3ecb68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:14.813848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b827409e-da0b-4fa4-ac47-c54c2b3ecb68 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:14.863064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609bf6c-551c-4bd8-a479-fd23711032df admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:14.877515 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1255/2530] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:14 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:14.880146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d609bf6c-551c-4bd8-a479-fd23711032df admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:14.907317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823fc09-285f-48bd-8260-e69c1032580f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:14.910262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823fc09-285f-48bd-8260-e69c1032580f admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:14.910582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823fc09-285f-48bd-8260-e69c1032580f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:14.910824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6823fc09-285f-48bd-8260-e69c1032580f admin admin] PATH_INFO: `/v3/projects/8e042f14a0c049f1af2f0f26a1da58ec/users/1f06078de46f417d8c865dde7597b374/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:14.918009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823fc09-285f-48bd-8260-e69c1032580f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e042f14a0c049f1af2f0f26a1da58ec, user_id=1f06078de46f417d8c865dde7597b374, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:14.922549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6823fc09-285f-48bd-8260-e69c1032580f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:14.969142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585aa41-9a7d-45d8-9960-56ff9d6bdfe8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:14.969458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585aa41-9a7d-45d8-9960-56ff9d6bdfe8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:14.969740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d585aa41-9a7d-45d8-9960-56ff9d6bdfe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:14.978053 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1276/2531] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:14 2022] PUT /identity/v3/projects/8e042f14a0c049f1af2f0f26a1da58ec/users/1f06078de46f417d8c865dde7597b374/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:15.034188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d585aa41-9a7d-45d8-9960-56ff9d6bdfe8 None None] MFA Rules not processed for user `1f06078de46f417d8c865dde7597b374`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:15.035574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d585aa41-9a7d-45d8-9960-56ff9d6bdfe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:15.228119 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1256/2532] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:14 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:15.240401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823fc09-285f-48bd-8260-e69c1032580f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:15.242533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6823fc09-285f-48bd-8260-e69c1032580f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:15.318987 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:15.373394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6823fc09-285f-48bd-8260-e69c1032580f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:15.383988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49563038-077e-40cf-8fd5-6e30a32c1e68 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:15.384637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49563038-077e-40cf-8fd5-6e30a32c1e68 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:15.385172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49563038-077e-40cf-8fd5-6e30a32c1e68 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:15.385711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49563038-077e-40cf-8fd5-6e30a32c1e68 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:15.413912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49563038-077e-40cf-8fd5-6e30a32c1e68 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:15.415557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49563038-077e-40cf-8fd5-6e30a32c1e68 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:15.429757 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1277/2533] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:15 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:15.478369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585aa41-9a7d-45d8-9960-56ff9d6bdfe8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:15.503040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d585aa41-9a7d-45d8-9960-56ff9d6bdfe8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:15.511248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c675df-e393-4bfc-87f9-c2e60a025aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:15.512778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c675df-e393-4bfc-87f9-c2e60a025aba service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:15.513231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c675df-e393-4bfc-87f9-c2e60a025aba service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:15.513717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c675df-e393-4bfc-87f9-c2e60a025aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:15.528583 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:15.632093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c675df-e393-4bfc-87f9-c2e60a025aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:15.633902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c675df-e393-4bfc-87f9-c2e60a025aba service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:15.666334 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1257/2534] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:15 2022] GET /identity/v3/auth/tokens => generated 3288 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:15.707522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49563038-077e-40cf-8fd5-6e30a32c1e68 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:15.925210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49563038-077e-40cf-8fd5-6e30a32c1e68 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:15.941376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:15.942016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:15.943476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:15.945714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] PATH_INFO: `/v3/users/3e32a18dd54a4f1fa2a7d5bb064497f8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:15.948841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e32a18dd54a4f1fa2a7d5bb064497f8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:15.955317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:16.096627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e32a18dd54a4f1fa2a7d5bb064497f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:16.146664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e32a18dd54a4f1fa2a7d5bb064497f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:16.150106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e32a18dd54a4f1fa2a7d5bb064497f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:16.174528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e32a18dd54a4f1fa2a7d5bb064497f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:16.191114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e32a18dd54a4f1fa2a7d5bb064497f8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:16.216922 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1278/2535] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:15 2022] DELETE /identity/v3/users/3e32a18dd54a4f1fa2a7d5bb064497f8 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:16.222046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b948-b86b-444b-b652-32ec5841a620 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:16.222373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b948-b86b-444b-b652-32ec5841a620 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:16.222606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d774b948-b86b-444b-b652-32ec5841a620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:16.269728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d774b948-b86b-444b-b652-32ec5841a620 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:16.272981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d774b948-b86b-444b-b652-32ec5841a620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:16.455532 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1258/2536] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:16.466203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:16.469424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:16.628777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67f6d0-cb9f-4d06-a1d8-e9d7efc51e51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:16.638656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ec11-8776-4eec-90e9-85418c4a49f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:16.647784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ec11-8776-4eec-90e9-85418c4a49f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:16.648120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ec11-8776-4eec-90e9-85418c4a49f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:16.648410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd2ec11-8776-4eec-90e9-85418c4a49f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:16.662798 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:16.672806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ec11-8776-4eec-90e9-85418c4a49f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:16.675037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd2ec11-8776-4eec-90e9-85418c4a49f0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:16.701881 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1279/2537] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:17.827308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b948-b86b-444b-b652-32ec5841a620 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:17.829339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d774b948-b86b-444b-b652-32ec5841a620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:17.853622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d774b948-b86b-444b-b652-32ec5841a620 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:17.870681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:17.871871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:17.872193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:17.872903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] PATH_INFO: `/v3/projects/a69703cd88a84f07af0facdb7202c9e5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:17.878530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a69703cd88a84f07af0facdb7202c9e5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:17.880401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:18.026979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a69703cd88a84f07af0facdb7202c9e5', 'request_id': 'req-96a26312-1394-4438-ba26-16363282eaf7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.038396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a69703cd88a84f07af0facdb7202c9e5', 'request_id': 'req-96a26312-1394-4438-ba26-16363282eaf7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.060959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a69703cd88a84f07af0facdb7202c9e5', 'request_id': 'req-96a26312-1394-4438-ba26-16363282eaf7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.104903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] The token cache is being invalidate because project a69703cd88a84f07af0facdb7202c9e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:18.106215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.112001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.114663 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1259/2538] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:17 2022] DELETE /identity/v3/projects/a69703cd88a84f07af0facdb7202c9e5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:18.118759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ec11-8776-4eec-90e9-85418c4a49f0 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:18.136080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd2ec11-8776-4eec-90e9-85418c4a49f0 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:18.340735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:18.341437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:18.341722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:18.342032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] PATH_INFO: `/v3/users/1f06078de46f417d8c865dde7597b374` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:18.343291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f06078de46f417d8c865dde7597b374)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:18.345982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:18.460766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f06078de46f417d8c865dde7597b374'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.494605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f06078de46f417d8c865dde7597b374'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.496452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f06078de46f417d8c865dde7597b374'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.514088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f06078de46f417d8c865dde7597b374'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.527249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4f86f1b-afd7-43ee-9ea5-66961c795b2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f06078de46f417d8c865dde7597b374'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:18.548575 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1280/2539] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:18 2022] DELETE /identity/v3/users/1f06078de46f417d8c865dde7597b374 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:19.681470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:19.688301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:19.718531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a26312-1394-4438-ba26-16363282eaf7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:19.813461 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:19.902111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:19.902760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:19.903044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:19.906228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] PATH_INFO: `/v3/projects/8e042f14a0c049f1af2f0f26a1da58ec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:19.908646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e042f14a0c049f1af2f0f26a1da58ec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:19.917711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:20.041983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e042f14a0c049f1af2f0f26a1da58ec', 'request_id': 'req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:20.053803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e042f14a0c049f1af2f0f26a1da58ec', 'request_id': 'req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:20.076688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e042f14a0c049f1af2f0f26a1da58ec', 'request_id': 'req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:20.114143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] The token cache is being invalidate because project 8e042f14a0c049f1af2f0f26a1da58ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:20.117182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:20.118464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f64529b-49a8-4ed7-9be4-5c2aba1871fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:20.125727 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1260/2540] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:19 2022] DELETE /identity/v3/projects/8e042f14a0c049f1af2f0f26a1da58ec => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:20.130485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30b5e5-a5fd-4e81-b201-01e9d4a0d8ff None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:20.131049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30b5e5-a5fd-4e81-b201-01e9d4a0d8ff None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:20.131263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d30b5e5-a5fd-4e81-b201-01e9d4a0d8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:20.202276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7d30b5e5-a5fd-4e81-b201-01e9d4a0d8ff None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:20.202276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7d30b5e5-a5fd-4e81-b201-01e9d4a0d8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:20.447459 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1281/2541] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:20.454855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce1672-4190-4b68-8cc4-9e02493673c8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:20.457327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce1672-4190-4b68-8cc4-9e02493673c8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:20.459033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce1672-4190-4b68-8cc4-9e02493673c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:20.533560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-efce1672-4190-4b68-8cc4-9e02493673c8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:20.535623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-efce1672-4190-4b68-8cc4-9e02493673c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:20.577093 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1261/2542] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:20.582101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30b5e5-a5fd-4e81-b201-01e9d4a0d8ff None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:20.606617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d30b5e5-a5fd-4e81-b201-01e9d4a0d8ff None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:20.624505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e7180-697a-48d6-8e3e-c97a3504917b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:20.625138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e7180-697a-48d6-8e3e-c97a3504917b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:20.625461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e7180-697a-48d6-8e3e-c97a3504917b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:20.626555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481e7180-697a-48d6-8e3e-c97a3504917b admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:20.629545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e7180-697a-48d6-8e3e-c97a3504917b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:56:20.629858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e7180-697a-48d6-8e3e-c97a3504917b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:20.637325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481e7180-697a-48d6-8e3e-c97a3504917b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:20.680324 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1282/2543] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:56:20.686473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce1672-4190-4b68-8cc4-9e02493673c8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:20.712510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce1672-4190-4b68-8cc4-9e02493673c8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:20.727521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8144fc-98db-4d2c-ad0d-3a086791c0d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:20.728146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8144fc-98db-4d2c-ad0d-3a086791c0d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:20.732921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8144fc-98db-4d2c-ad0d-3a086791c0d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:20.733284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8144fc-98db-4d2c-ad0d-3a086791c0d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:20.734005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8144fc-98db-4d2c-ad0d-3a086791c0d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:20.757872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8144fc-98db-4d2c-ad0d-3a086791c0d9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:20.853239 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1262/2544] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:20 2022] POST /identity/v3/projects => generated 393 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:20.854198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e7180-697a-48d6-8e3e-c97a3504917b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:20.861450 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:20.882510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481e7180-697a-48d6-8e3e-c97a3504917b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:21.003375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd652842-64eb-4dcf-9574-a22a08615c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:21.004009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd652842-64eb-4dcf-9574-a22a08615c2a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:21.004292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd652842-64eb-4dcf-9574-a22a08615c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:21.004664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd652842-64eb-4dcf-9574-a22a08615c2a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:21.005331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd652842-64eb-4dcf-9574-a22a08615c2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:21.007952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd652842-64eb-4dcf-9574-a22a08615c2a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:21.062084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8144fc-98db-4d2c-ad0d-3a086791c0d9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:21.064639 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1283/2545] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:20 2022] POST /identity/v3/users => generated 297 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:21.082789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8144fc-98db-4d2c-ad0d-3a086791c0d9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:21.099331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a3bf4-3266-4ad1-bb97-247f00e47d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:21.099957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3bf4-3266-4ad1-bb97-247f00e47d28 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:21.100236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3bf4-3266-4ad1-bb97-247f00e47d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:21.100512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264a3bf4-3266-4ad1-bb97-247f00e47d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:21.101164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a3bf4-3266-4ad1-bb97-247f00e47d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:21.102825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264a3bf4-3266-4ad1-bb97-247f00e47d28 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:21.133389 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1263/2546] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:21.138644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd652842-64eb-4dcf-9574-a22a08615c2a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:21.164612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd652842-64eb-4dcf-9574-a22a08615c2a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:21.178589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d42c0e-a44c-4975-995f-11f1163648cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:21.179186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42c0e-a44c-4975-995f-11f1163648cc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:21.179480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42c0e-a44c-4975-995f-11f1163648cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:21.179830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d42c0e-a44c-4975-995f-11f1163648cc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:21.180501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d42c0e-a44c-4975-995f-11f1163648cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:21.182978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d42c0e-a44c-4975-995f-11f1163648cc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:21.208627 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1284/2547] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:21 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:56:21.209940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a3bf4-3266-4ad1-bb97-247f00e47d28 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:21.225698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264a3bf4-3266-4ad1-bb97-247f00e47d28 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:21.248006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658f4f6-4c4a-4515-98db-5a74ffebb4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:21.249135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f4f6-4c4a-4515-98db-5a74ffebb4d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:21.250198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f4f6-4c4a-4515-98db-5a74ffebb4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:21.250827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658f4f6-4c4a-4515-98db-5a74ffebb4d1 admin admin] PATH_INFO: `/v3/projects/b9cbcc43399d48b984b47037806c396a/users/f378809e7d6e41ef862b7d5c12286f57/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:21.289766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658f4f6-4c4a-4515-98db-5a74ffebb4d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9cbcc43399d48b984b47037806c396a, user_id=f378809e7d6e41ef862b7d5c12286f57, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:21.303660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658f4f6-4c4a-4515-98db-5a74ffebb4d1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:21.397374 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1264/2548] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:21 2022] PUT /identity/v3/projects/b9cbcc43399d48b984b47037806c396a/users/f378809e7d6e41ef862b7d5c12286f57/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:21.399455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48703c4-3aa6-4822-b52d-317a0c7486ed None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:21.399766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48703c4-3aa6-4822-b52d-317a0c7486ed None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:21.400045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48703c4-3aa6-4822-b52d-317a0c7486ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:21.470088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e48703c4-3aa6-4822-b52d-317a0c7486ed None None] MFA Rules not processed for user `f378809e7d6e41ef862b7d5c12286f57`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:21.472421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e48703c4-3aa6-4822-b52d-317a0c7486ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:21.656036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658f4f6-4c4a-4515-98db-5a74ffebb4d1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:21.665053 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1285/2549] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:21 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:21.834879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658f4f6-4c4a-4515-98db-5a74ffebb4d1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:21.858630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791509f-c1be-40aa-9976-03c7b9baf4b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:21.860675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791509f-c1be-40aa-9976-03c7b9baf4b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:21.865762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791509f-c1be-40aa-9976-03c7b9baf4b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:21.867299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3791509f-c1be-40aa-9976-03c7b9baf4b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:21.878122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791509f-c1be-40aa-9976-03c7b9baf4b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:21.880216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3791509f-c1be-40aa-9976-03c7b9baf4b9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:21.955746 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:22.059750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48703c4-3aa6-4822-b52d-317a0c7486ed None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:22.061434 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1265/2550] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:21 2022] POST /identity/v3/projects => generated 395 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:56:22.082578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48703c4-3aa6-4822-b52d-317a0c7486ed None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:22.387758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50122865-076f-4657-ad95-b827c1069276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:22.388489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122865-076f-4657-ad95-b827c1069276 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:22.388586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122865-076f-4657-ad95-b827c1069276 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:22.393016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50122865-076f-4657-ad95-b827c1069276 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:22.393800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50122865-076f-4657-ad95-b827c1069276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:22.403413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50122865-076f-4657-ad95-b827c1069276 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:22.448775 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:22.510134 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1286/2551] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:22 2022] POST /identity/v3/users => generated 304 bytes in 451 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:22.530326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791509f-c1be-40aa-9976-03c7b9baf4b9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:22.547695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3791509f-c1be-40aa-9976-03c7b9baf4b9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:22.578813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad72593-8e9e-4983-874e-57b9def9e9c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:22.579473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72593-8e9e-4983-874e-57b9def9e9c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:22.579757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72593-8e9e-4983-874e-57b9def9e9c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:22.580409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad72593-8e9e-4983-874e-57b9def9e9c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:22.582498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad72593-8e9e-4983-874e-57b9def9e9c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:22.584185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad72593-8e9e-4983-874e-57b9def9e9c8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:22.612676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50122865-076f-4657-ad95-b827c1069276 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:22.613629 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1266/2552] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:22.653898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50122865-076f-4657-ad95-b827c1069276 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:22.669659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a8e0-25bf-4ef9-a7bd-8aa6ce132c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:22.676202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a8e0-25bf-4ef9-a7bd-8aa6ce132c72 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:22.687522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a8e0-25bf-4ef9-a7bd-8aa6ce132c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:22.688387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a8e0-25bf-4ef9-a7bd-8aa6ce132c72 admin admin] PATH_INFO: `/v3/projects/e967d7109a194214a827c5635c27118c/users/e5b6d596734044068ad883518519a4bf/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:22.773816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71a8e0-25bf-4ef9-a7bd-8aa6ce132c72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e967d7109a194214a827c5635c27118c, user_id=e5b6d596734044068ad883518519a4bf, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:22.810956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71a8e0-25bf-4ef9-a7bd-8aa6ce132c72 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:22.845428 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1287/2553] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:22 2022] PUT /identity/v3/projects/e967d7109a194214a827c5635c27118c/users/e5b6d596734044068ad883518519a4bf/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:22.850774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad72593-8e9e-4983-874e-57b9def9e9c8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:22.889609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad72593-8e9e-4983-874e-57b9def9e9c8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:23.096588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f16331-0aa3-45f3-adb2-46eb694b63dd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:23.096877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f16331-0aa3-45f3-adb2-46eb694b63dd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:23.097158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f16331-0aa3-45f3-adb2-46eb694b63dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:23.138233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9aa5f0-e334-457c-8ac7-2ccc5fdf29ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:23.140182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aa5f0-e334-457c-8ac7-2ccc5fdf29ba admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:23.140957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aa5f0-e334-457c-8ac7-2ccc5fdf29ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:23.148067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9aa5f0-e334-457c-8ac7-2ccc5fdf29ba admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:23.150669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9aa5f0-e334-457c-8ac7-2ccc5fdf29ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:23.166550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9aa5f0-e334-457c-8ac7-2ccc5fdf29ba admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:23.211952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d5f16331-0aa3-45f3-adb2-46eb694b63dd None None] MFA Rules not processed for user `c1f9da09bd824bd79c6adb316f1fd41b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:23.213334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d5f16331-0aa3-45f3-adb2-46eb694b63dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:23.223277 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1267/2554] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:22 2022] GET /identity/v3/roles => generated 1420 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:56:23.224977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9aa5f0-e334-457c-8ac7-2ccc5fdf29ba admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:23.262243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9aa5f0-e334-457c-8ac7-2ccc5fdf29ba admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:23.279851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30b241a-75d5-4b93-bc33-baa5793d1b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:23.280922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b241a-75d5-4b93-bc33-baa5793d1b11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:23.281989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b241a-75d5-4b93-bc33-baa5793d1b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:23.284219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30b241a-75d5-4b93-bc33-baa5793d1b11 admin admin] PATH_INFO: `/v3/projects/e967d7109a194214a827c5635c27118c/users/e5b6d596734044068ad883518519a4bf/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:23.289668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b241a-75d5-4b93-bc33-baa5793d1b11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e967d7109a194214a827c5635c27118c, user_id=e5b6d596734044068ad883518519a4bf, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:23.298763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30b241a-75d5-4b93-bc33-baa5793d1b11 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:23.338283 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1268/2555] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:23 2022] PUT /identity/v3/projects/e967d7109a194214a827c5635c27118c/users/e5b6d596734044068ad883518519a4bf/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:23.349668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797cbb-5bbd-4cb0-bc9a-bcc734971413 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:23.350562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797cbb-5bbd-4cb0-bc9a-bcc734971413 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:23.350863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a797cbb-5bbd-4cb0-bc9a-bcc734971413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:23.436524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1a797cbb-5bbd-4cb0-bc9a-bcc734971413 None None] MFA Rules not processed for user `e5b6d596734044068ad883518519a4bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:23.444874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a797cbb-5bbd-4cb0-bc9a-bcc734971413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:23.464121 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1288/2556] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:23.478858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f16331-0aa3-45f3-adb2-46eb694b63dd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:23.481614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d5f16331-0aa3-45f3-adb2-46eb694b63dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:23.711608 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1269/2557] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:23 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:23.788620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f16331-0aa3-45f3-adb2-46eb694b63dd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:24.009716 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:24.029710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccb69b-7380-45e0-a2f4-8db68172f9f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:24.030752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccb69b-7380-45e0-a2f4-8db68172f9f6 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:24.030752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccb69b-7380-45e0-a2f4-8db68172f9f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:24.031046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ccb69b-7380-45e0-a2f4-8db68172f9f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:24.267637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccb69b-7380-45e0-a2f4-8db68172f9f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:24.269965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ccb69b-7380-45e0-a2f4-8db68172f9f6 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:24.300636 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1289/2558] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:23 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 822 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:24.827994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797cbb-5bbd-4cb0-bc9a-bcc734971413 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:24.853185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a797cbb-5bbd-4cb0-bc9a-bcc734971413 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:24.874103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd01ce-f497-4bea-b107-002cfb80a358 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:24.874787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd01ce-f497-4bea-b107-002cfb80a358 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:24.875023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd01ce-f497-4bea-b107-002cfb80a358 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:24.875302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfd01ce-f497-4bea-b107-002cfb80a358 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:24.899854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd01ce-f497-4bea-b107-002cfb80a358 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:24.901868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfd01ce-f497-4bea-b107-002cfb80a358 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:24.927593 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1270/2559] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:24 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:56:28.173512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccb69b-7380-45e0-a2f4-8db68172f9f6 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:28.175014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-71ccb69b-7380-45e0-a2f4-8db68172f9f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:28.434634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ccb69b-7380-45e0-a2f4-8db68172f9f6 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:28.450336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:28.451525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:28.455975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:28.457075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] PATH_INFO: `/v3/users/549b0b8da68647e3b968e80ab7e48022` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:28.460875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] RBAC: Authorizing `identity:delete_user(user_id=549b0b8da68647e3b968e80ab7e48022)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:28.464858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:28.581405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '549b0b8da68647e3b968e80ab7e48022'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:28.602765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '549b0b8da68647e3b968e80ab7e48022'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:28.603648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '549b0b8da68647e3b968e80ab7e48022'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:28.616884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '549b0b8da68647e3b968e80ab7e48022'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:28.646853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '549b0b8da68647e3b968e80ab7e48022'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:28.660395 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1290/2560] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:28 2022] DELETE /identity/v3/users/549b0b8da68647e3b968e80ab7e48022 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:28.700261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd01ce-f497-4bea-b107-002cfb80a358 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:28.702104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bdfd01ce-f497-4bea-b107-002cfb80a358 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:28.803454 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:28.959422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfd01ce-f497-4bea-b107-002cfb80a358 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:29.107595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:29.109218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:29.135636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa3b5d2-101a-4939-9bff-b8df3a9a55ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:29.136236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b5d2-101a-4939-9bff-b8df3a9a55ba service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:29.136499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b5d2-101a-4939-9bff-b8df3a9a55ba service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:29.136776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa3b5d2-101a-4939-9bff-b8df3a9a55ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:29.141666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8aa3b5d2-101a-4939-9bff-b8df3a9a55ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:29.174800 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:29.306353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6fcb6a-6bfe-4532-b369-4a81539dd130 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:29.311171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b5d2-101a-4939-9bff-b8df3a9a55ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:29.312821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa3b5d2-101a-4939-9bff-b8df3a9a55ba service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:29.320750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:29.321448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:29.321734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:29.322552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] PATH_INFO: `/v3/projects/946a17ccefa7499e8e6753cda6710cf8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:29.324578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=946a17ccefa7499e8e6753cda6710cf8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:29.329892 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1271/2561] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:28 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 628 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:29.339962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:29.505621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '946a17ccefa7499e8e6753cda6710cf8', 'request_id': 'req-e8afb75a-e326-41b8-9ede-a0db37d85757'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:29.530670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '946a17ccefa7499e8e6753cda6710cf8', 'request_id': 'req-e8afb75a-e326-41b8-9ede-a0db37d85757'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:29.549267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '946a17ccefa7499e8e6753cda6710cf8', 'request_id': 'req-e8afb75a-e326-41b8-9ede-a0db37d85757'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:29.582287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] The token cache is being invalidate because project 946a17ccefa7499e8e6753cda6710cf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:29.582866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:29.583726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:29.585979 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1291/2562] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:29 2022] DELETE /identity/v3/projects/946a17ccefa7499e8e6753cda6710cf8 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:29.592695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ba7e8-7bf5-4466-b5eb-baa62a5b5ae3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:29.593008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ba7e8-7bf5-4466-b5eb-baa62a5b5ae3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:29.593321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784ba7e8-7bf5-4466-b5eb-baa62a5b5ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:29.634328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-784ba7e8-7bf5-4466-b5eb-baa62a5b5ae3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:29.635588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-784ba7e8-7bf5-4466-b5eb-baa62a5b5ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:29.766330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:29.767932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:29.920215 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1272/2563] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:29.928649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040540b3-cefb-4908-93d9-5d5795928043 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:29.929084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040540b3-cefb-4908-93d9-5d5795928043 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:29.929502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040540b3-cefb-4908-93d9-5d5795928043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:29.945603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afb75a-e326-41b8-9ede-a0db37d85757 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:29.957325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2b465-a4d8-456a-9e42-901cd206adcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:29.958282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2b465-a4d8-456a-9e42-901cd206adcf service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:29.958793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2b465-a4d8-456a-9e42-901cd206adcf service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:29.959171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2b465-a4d8-456a-9e42-901cd206adcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:29.966252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-040540b3-cefb-4908-93d9-5d5795928043 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:29.969633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-040540b3-cefb-4908-93d9-5d5795928043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:29.976483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0c2b465-a4d8-456a-9e42-901cd206adcf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:29.997132 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1273/2564] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:56:29.998153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040540b3-cefb-4908-93d9-5d5795928043 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:30.023301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040540b3-cefb-4908-93d9-5d5795928043 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:30.057578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307a56b-613d-4604-ad3c-c6636fd608e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:30.059307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307a56b-613d-4604-ad3c-c6636fd608e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:30.059463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307a56b-613d-4604-ad3c-c6636fd608e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:30.059829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307a56b-613d-4604-ad3c-c6636fd608e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:30.060654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307a56b-613d-4604-ad3c-c6636fd608e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:56:30.061258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307a56b-613d-4604-ad3c-c6636fd608e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:30.062920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307a56b-613d-4604-ad3c-c6636fd608e0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:30.087300 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1274/2565] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:56:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:56:30.099391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307a56b-613d-4604-ad3c-c6636fd608e0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:30.109744 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:30.118158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307a56b-613d-4604-ad3c-c6636fd608e0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:30.139406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869124a-efa7-4ffc-a228-ed4ab8820e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:30.141702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869124a-efa7-4ffc-a228-ed4ab8820e19 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:30.142536 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:30.144248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869124a-efa7-4ffc-a228-ed4ab8820e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:30.144901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1869124a-efa7-4ffc-a228-ed4ab8820e19 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:30.146529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869124a-efa7-4ffc-a228-ed4ab8820e19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:30.149218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1869124a-efa7-4ffc-a228-ed4ab8820e19 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:30.190451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2b465-a4d8-456a-9e42-901cd206adcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:30.192726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2b465-a4d8-456a-9e42-901cd206adcf service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:30.206344 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1292/2566] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:56:30.234086 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1275/2567] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:30 2022] POST /identity/v3/projects => generated 393 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:30.238165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2b465-a4d8-456a-9e42-901cd206adcf service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:30.257851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869124a-efa7-4ffc-a228-ed4ab8820e19 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:30.259931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1869124a-efa7-4ffc-a228-ed4ab8820e19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:30.282996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2b465-a4d8-456a-9e42-901cd206adcf service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:30.448543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874f0aa-51be-416d-8f53-fefe570cfe44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:30.449224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874f0aa-51be-416d-8f53-fefe570cfe44 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:30.451442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874f0aa-51be-416d-8f53-fefe570cfe44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:30.451762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874f0aa-51be-416d-8f53-fefe570cfe44 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:30.453262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874f0aa-51be-416d-8f53-fefe570cfe44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:30.455307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874f0aa-51be-416d-8f53-fefe570cfe44 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:30.464389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1869124a-efa7-4ffc-a228-ed4ab8820e19 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:30.479766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:30.481106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:30.481435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:30.481796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] PATH_INFO: `/v3/users/f378809e7d6e41ef862b7d5c12286f57` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:30.484881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f378809e7d6e41ef862b7d5c12286f57)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:30.490461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:30.520235 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1293/2568] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:30 2022] POST /identity/v3/users => generated 297 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:56:30.527138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874f0aa-51be-416d-8f53-fefe570cfe44 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:30.556103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874f0aa-51be-416d-8f53-fefe570cfe44 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:30.581913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bbb09-baa8-410d-bf1b-f56494232deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:30.582506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bbb09-baa8-410d-bf1b-f56494232deb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:30.582782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bbb09-baa8-410d-bf1b-f56494232deb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:30.583054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bbb09-baa8-410d-bf1b-f56494232deb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:30.583818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bbb09-baa8-410d-bf1b-f56494232deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:30.586018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bbb09-baa8-410d-bf1b-f56494232deb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:30.623107 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1294/2569] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:30.628872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bbb09-baa8-410d-bf1b-f56494232deb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:30.653246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f378809e7d6e41ef862b7d5c12286f57'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:30.655839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bbb09-baa8-410d-bf1b-f56494232deb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:30.673381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b303a1d-8da6-4cae-8efe-92cfcd2ecdf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:30.673904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b303a1d-8da6-4cae-8efe-92cfcd2ecdf0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:30.674188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b303a1d-8da6-4cae-8efe-92cfcd2ecdf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:30.674460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b303a1d-8da6-4cae-8efe-92cfcd2ecdf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:30.675176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b303a1d-8da6-4cae-8efe-92cfcd2ecdf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:30.676749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b303a1d-8da6-4cae-8efe-92cfcd2ecdf0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:30.696894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f378809e7d6e41ef862b7d5c12286f57'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:30.700058 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1295/2570] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:30 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:30.700741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f378809e7d6e41ef862b7d5c12286f57'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:30.704553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b303a1d-8da6-4cae-8efe-92cfcd2ecdf0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:30.711333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1b303a1d-8da6-4cae-8efe-92cfcd2ecdf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:30.722376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f378809e7d6e41ef862b7d5c12286f57'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:30.735365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8feb1735-f185-4ab6-8d68-1602af9e1432 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f378809e7d6e41ef862b7d5c12286f57'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:30.752210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b303a1d-8da6-4cae-8efe-92cfcd2ecdf0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:30.778959 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1276/2571] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:30 2022] DELETE /identity/v3/users/f378809e7d6e41ef862b7d5c12286f57 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:30.781036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e48bb71-e8a7-449b-955c-1e948f37efac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:30.781560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48bb71-e8a7-449b-955c-1e948f37efac admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:30.781827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48bb71-e8a7-449b-955c-1e948f37efac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:30.782164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e48bb71-e8a7-449b-955c-1e948f37efac admin admin] PATH_INFO: `/v3/projects/b90fabc24c5d4f509e45e0eec0b323a7/users/7e709503bbff4c239491b0f109673264/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:30.789940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3b5ac-e7ef-4a00-81f3-31c9a7ee8e1e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:30.790520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3b5ac-e7ef-4a00-81f3-31c9a7ee8e1e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:30.790973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b3b5ac-e7ef-4a00-81f3-31c9a7ee8e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:30.818747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48bb71-e8a7-449b-955c-1e948f37efac admin admin] RBAC: Authorizing `identity:create_grant(project_id=b90fabc24c5d4f509e45e0eec0b323a7, user_id=7e709503bbff4c239491b0f109673264, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:30.821811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e48bb71-e8a7-449b-955c-1e948f37efac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:30.848634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e9b3b5ac-e7ef-4a00-81f3-31c9a7ee8e1e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:30.852080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e9b3b5ac-e7ef-4a00-81f3-31c9a7ee8e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:30.875463 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1296/2572] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:30 2022] PUT /identity/v3/projects/b90fabc24c5d4f509e45e0eec0b323a7/users/7e709503bbff4c239491b0f109673264/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:30.887396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929c5f8-2407-4552-b687-df15d9f23518 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:30.887705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929c5f8-2407-4552-b687-df15d9f23518 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:30.889877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b929c5f8-2407-4552-b687-df15d9f23518 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:30.947614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b929c5f8-2407-4552-b687-df15d9f23518 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:30.960288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b929c5f8-2407-4552-b687-df15d9f23518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:31.017617 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:31.052772 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1277/2573] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:31.061081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3b5ac-e7ef-4a00-81f3-31c9a7ee8e1e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:31.061081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e9b3b5ac-e7ef-4a00-81f3-31c9a7ee8e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:31.135816 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1297/2574] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:31.135816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929c5f8-2407-4552-b687-df15d9f23518 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:31.136838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b929c5f8-2407-4552-b687-df15d9f23518 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:31.219103 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:31.236939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b3b5ac-e7ef-4a00-81f3-31c9a7ee8e1e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:31.243380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4f7d9-32af-4847-97fb-9899dd308415 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:31.244087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4f7d9-32af-4847-97fb-9899dd308415 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:31.244449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4f7d9-32af-4847-97fb-9899dd308415 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:31.244785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a4f7d9-32af-4847-97fb-9899dd308415 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:31.250346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-47a4f7d9-32af-4847-97fb-9899dd308415 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:31.264447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b929c5f8-2407-4552-b687-df15d9f23518 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:31.272157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d09d9-788c-499a-bf9e-3021d229c3f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:31.272858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d09d9-788c-499a-bf9e-3021d229c3f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:31.273287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d09d9-788c-499a-bf9e-3021d229c3f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:31.273730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800d09d9-788c-499a-bf9e-3021d229c3f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:31.279739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4f7d9-32af-4847-97fb-9899dd308415 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:31.282180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a4f7d9-32af-4847-97fb-9899dd308415 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:31.291901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d09d9-788c-499a-bf9e-3021d229c3f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:31.293462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800d09d9-788c-499a-bf9e-3021d229c3f3 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:31.307547 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1278/2575] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:31.309035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4f7d9-32af-4847-97fb-9899dd308415 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:31.329764 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1298/2576] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:31.336577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a4f7d9-32af-4847-97fb-9899dd308415 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:31.350193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1ea9-dad4-4be0-b930-afebd3c2aa8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:31.350934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1ea9-dad4-4be0-b930-afebd3c2aa8f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:31.351226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1ea9-dad4-4be0-b930-afebd3c2aa8f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:31.351504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1ea9-dad4-4be0-b930-afebd3c2aa8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:31.367250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1ea9-dad4-4be0-b930-afebd3c2aa8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:31.368923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1ea9-dad4-4be0-b930-afebd3c2aa8f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:31.392428 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1279/2577] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:32.622578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d09d9-788c-499a-bf9e-3021d229c3f3 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:32.630536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-800d09d9-788c-499a-bf9e-3021d229c3f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:32.671659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800d09d9-788c-499a-bf9e-3021d229c3f3 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:32.688512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:32.689464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:32.689742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:32.690198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] PATH_INFO: `/v3/projects/b9cbcc43399d48b984b47037806c396a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:32.694895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9cbcc43399d48b984b47037806c396a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:32.697280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:32.822741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9cbcc43399d48b984b47037806c396a', 'request_id': 'req-d040e118-d2e6-4784-b49e-f753fd9dd65f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:32.834302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9cbcc43399d48b984b47037806c396a', 'request_id': 'req-d040e118-d2e6-4784-b49e-f753fd9dd65f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:32.856750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9cbcc43399d48b984b47037806c396a', 'request_id': 'req-d040e118-d2e6-4784-b49e-f753fd9dd65f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:32.897064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] The token cache is being invalidate because project b9cbcc43399d48b984b47037806c396a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:32.899343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:32.900896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:32.910993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1299/2578] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:32 2022] DELETE /identity/v3/projects/b9cbcc43399d48b984b47037806c396a => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:32.915288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1ea9-dad4-4be0-b930-afebd3c2aa8f service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:32.927096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1ea9-dad4-4be0-b930-afebd3c2aa8f service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:33.066125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:33.070490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:33.071021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:33.072060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] PATH_INFO: `/v3/users/e5b6d596734044068ad883518519a4bf` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:33.079157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5b6d596734044068ad883518519a4bf)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:33.088164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:33.251293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5b6d596734044068ad883518519a4bf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:33.315835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5b6d596734044068ad883518519a4bf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:33.317281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5b6d596734044068ad883518519a4bf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:33.352525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5b6d596734044068ad883518519a4bf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:33.392511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2b24d68-203d-48d8-9216-08cce5e734dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5b6d596734044068ad883518519a4bf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:33.405185 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1280/2579] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:56:32 2022] DELETE /identity/v3/users/e5b6d596734044068ad883518519a4bf => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:34.307993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:34.309694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:34.343266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d040e118-d2e6-4784-b49e-f753fd9dd65f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:34.526442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:34.527888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:34.528235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:34.528622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] PATH_INFO: `/v3/projects/e967d7109a194214a827c5635c27118c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:34.529902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e967d7109a194214a827c5635c27118c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:34.531893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:34.674932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e967d7109a194214a827c5635c27118c', 'request_id': 'req-364a5519-2972-4d50-8e7a-358d0ece8ad7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:34.692411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e967d7109a194214a827c5635c27118c', 'request_id': 'req-364a5519-2972-4d50-8e7a-358d0ece8ad7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:34.701968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e967d7109a194214a827c5635c27118c', 'request_id': 'req-364a5519-2972-4d50-8e7a-358d0ece8ad7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:34.706295 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:34.723508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] The token cache is being invalidate because project e967d7109a194214a827c5635c27118c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:56:34.723862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:34.724616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-364a5519-2972-4d50-8e7a-358d0ece8ad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:56:34.726910 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1300/2580] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:56:34 2022] DELETE /identity/v3/projects/e967d7109a194214a827c5635c27118c => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:34.732620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edc5d6-f5fc-405c-a391-0cadea0e8891 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:34.733530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edc5d6-f5fc-405c-a391-0cadea0e8891 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:34.734027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60edc5d6-f5fc-405c-a391-0cadea0e8891 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:34.772966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-60edc5d6-f5fc-405c-a391-0cadea0e8891 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:34.774544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-60edc5d6-f5fc-405c-a391-0cadea0e8891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:34.784537 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:34.884985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98397d-c167-479e-bf9f-4ae1b47d9b90 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:34.885273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98397d-c167-479e-bf9f-4ae1b47d9b90 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:34.885477 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1281/2581] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:34.885605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb98397d-c167-479e-bf9f-4ae1b47d9b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:34.952523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bb98397d-c167-479e-bf9f-4ae1b47d9b90 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:34.954184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb98397d-c167-479e-bf9f-4ae1b47d9b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:34.979160 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1301/2582] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:56:34.983818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edc5d6-f5fc-405c-a391-0cadea0e8891 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:35.008725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60edc5d6-f5fc-405c-a391-0cadea0e8891 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:35.029228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d72b-37ae-437f-b072-d296106566e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:35.029987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d72b-37ae-437f-b072-d296106566e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:35.030386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d72b-37ae-437f-b072-d296106566e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:35.030733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d72b-37ae-437f-b072-d296106566e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:35.031702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291d72b-37ae-437f-b072-d296106566e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:56:35.032081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291d72b-37ae-437f-b072-d296106566e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:35.033930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291d72b-37ae-437f-b072-d296106566e3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:35.075809 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1282/2583] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:56:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:56:35.130746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98397d-c167-479e-bf9f-4ae1b47d9b90 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:35.147502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb98397d-c167-479e-bf9f-4ae1b47d9b90 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:35.175365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9052c-97e0-4648-b606-5e3aa35facb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:35.176182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9052c-97e0-4648-b606-5e3aa35facb1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:35.176590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9052c-97e0-4648-b606-5e3aa35facb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:35.176988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b9052c-97e0-4648-b606-5e3aa35facb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:35.177815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9052c-97e0-4648-b606-5e3aa35facb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:35.179945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b9052c-97e0-4648-b606-5e3aa35facb1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:35.287542 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1302/2584] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:35 2022] POST /identity/v3/projects => generated 375 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:35.301150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d72b-37ae-437f-b072-d296106566e3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:35.322250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d72b-37ae-437f-b072-d296106566e3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:35.430864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d560399-6d2a-409a-aba3-95d04bc371cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:35.431661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d560399-6d2a-409a-aba3-95d04bc371cf admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:35.432050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d560399-6d2a-409a-aba3-95d04bc371cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:35.432428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d560399-6d2a-409a-aba3-95d04bc371cf admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:35.433832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d560399-6d2a-409a-aba3-95d04bc371cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:35.435458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d560399-6d2a-409a-aba3-95d04bc371cf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:35.460962 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1283/2585] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:35 2022] POST /identity/v3/users => generated 288 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:35.465323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9052c-97e0-4648-b606-5e3aa35facb1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:35.478539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b9052c-97e0-4648-b606-5e3aa35facb1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:35.487286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079377-2a85-4401-b203-6aade6ee53f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:35.488162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079377-2a85-4401-b203-6aade6ee53f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:35.488506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079377-2a85-4401-b203-6aade6ee53f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:35.488952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47079377-2a85-4401-b203-6aade6ee53f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:35.490094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079377-2a85-4401-b203-6aade6ee53f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:35.494101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47079377-2a85-4401-b203-6aade6ee53f9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:35.508432 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1303/2586] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:35.513573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d560399-6d2a-409a-aba3-95d04bc371cf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:35.536197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d560399-6d2a-409a-aba3-95d04bc371cf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:35.544310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4470dc-7587-41cc-9db4-e1dd21df6e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:35.545004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4470dc-7587-41cc-9db4-e1dd21df6e94 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:35.545475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4470dc-7587-41cc-9db4-e1dd21df6e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:35.545823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4470dc-7587-41cc-9db4-e1dd21df6e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:35.546540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4470dc-7587-41cc-9db4-e1dd21df6e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:35.550913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4470dc-7587-41cc-9db4-e1dd21df6e94 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:35.576615 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1284/2587] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:56:35.577967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079377-2a85-4401-b203-6aade6ee53f9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:35.627396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47079377-2a85-4401-b203-6aade6ee53f9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:35.639299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ea54d-917a-410d-8aae-5538e3290fe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:35.641189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea54d-917a-410d-8aae-5538e3290fe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:35.642515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea54d-917a-410d-8aae-5538e3290fe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:35.643176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ea54d-917a-410d-8aae-5538e3290fe8 admin admin] PATH_INFO: `/v3/projects/f6376cfd719142a58ac589d96c89f6e4/users/aff5064287e54352b298041c4b0c37ec/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:35.715452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ea54d-917a-410d-8aae-5538e3290fe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6376cfd719142a58ac589d96c89f6e4, user_id=aff5064287e54352b298041c4b0c37ec, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:35.722820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614ea54d-917a-410d-8aae-5538e3290fe8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:35.809083 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1304/2588] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:35 2022] PUT /identity/v3/projects/f6376cfd719142a58ac589d96c89f6e4/users/aff5064287e54352b298041c4b0c37ec/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:35.819768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e420d-8942-4a43-b430-e3d922bfedb7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:35.821335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e420d-8942-4a43-b430-e3d922bfedb7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:35.821774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e420d-8942-4a43-b430-e3d922bfedb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:35.946581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b77e420d-8942-4a43-b430-e3d922bfedb7 None None] MFA Rules not processed for user `aff5064287e54352b298041c4b0c37ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:35.948028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b77e420d-8942-4a43-b430-e3d922bfedb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:36.117347 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1285/2589] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:36.121240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ea54d-917a-410d-8aae-5538e3290fe8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:36.418098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ea54d-917a-410d-8aae-5538e3290fe8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:36.427300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f02b17-c43c-46b2-a0fe-34dd87fec642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:36.427938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02b17-c43c-46b2-a0fe-34dd87fec642 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:36.428227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02b17-c43c-46b2-a0fe-34dd87fec642 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:36.428505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f02b17-c43c-46b2-a0fe-34dd87fec642 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:36.429149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f02b17-c43c-46b2-a0fe-34dd87fec642 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:36.431149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f02b17-c43c-46b2-a0fe-34dd87fec642 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:36.507996 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1305/2590] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:56:36 2022] POST /identity/v3/projects => generated 375 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:36.512208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e420d-8942-4a43-b430-e3d922bfedb7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:36.533111 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:36.545797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e420d-8942-4a43-b430-e3d922bfedb7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:36.709164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedce82-fd80-4e99-9db2-cc882aa5a330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:36.709894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedce82-fd80-4e99-9db2-cc882aa5a330 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:36.712794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedce82-fd80-4e99-9db2-cc882aa5a330 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:36.713078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedce82-fd80-4e99-9db2-cc882aa5a330 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:36.713781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedce82-fd80-4e99-9db2-cc882aa5a330 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:36.716299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedce82-fd80-4e99-9db2-cc882aa5a330 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:36.748046 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1286/2591] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:56:36 2022] POST /identity/v3/users => generated 294 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:56:36.748790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f02b17-c43c-46b2-a0fe-34dd87fec642 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:36.764110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f02b17-c43c-46b2-a0fe-34dd87fec642 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:36.777569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c59df9-998f-43d4-b915-58268167ded5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:36.778318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c59df9-998f-43d4-b915-58268167ded5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:36.778691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c59df9-998f-43d4-b915-58268167ded5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:36.779049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c59df9-998f-43d4-b915-58268167ded5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:36.793389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c59df9-998f-43d4-b915-58268167ded5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:36.795562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c59df9-998f-43d4-b915-58268167ded5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:36.844803 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1306/2592] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:56:36.850424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedce82-fd80-4e99-9db2-cc882aa5a330 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:36.879143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedce82-fd80-4e99-9db2-cc882aa5a330 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:36.898565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acef6c-5d71-45e6-a58b-573445507ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:36.903121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acef6c-5d71-45e6-a58b-573445507ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:36.905662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acef6c-5d71-45e6-a58b-573445507ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:36.906459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6acef6c-5d71-45e6-a58b-573445507ab9 admin admin] PATH_INFO: `/v3/projects/825e0fead9774b21a8d1b5ac617bd4f1/users/fe93c6427710461280972902fae65cd8/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:36.961876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acef6c-5d71-45e6-a58b-573445507ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=825e0fead9774b21a8d1b5ac617bd4f1, user_id=fe93c6427710461280972902fae65cd8, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:36.969436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6acef6c-5d71-45e6-a58b-573445507ab9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:36.996024 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1287/2593] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:36 2022] PUT /identity/v3/projects/825e0fead9774b21a8d1b5ac617bd4f1/users/fe93c6427710461280972902fae65cd8/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:56:36.996926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c59df9-998f-43d4-b915-58268167ded5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:37.021795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c59df9-998f-43d4-b915-58268167ded5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:37.109121 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:37.122710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206811d6-6b6a-4af8-8f58-b66bf02b4655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:37.124692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206811d6-6b6a-4af8-8f58-b66bf02b4655 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:37.126623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206811d6-6b6a-4af8-8f58-b66bf02b4655 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:37.127255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206811d6-6b6a-4af8-8f58-b66bf02b4655 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:37.130911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206811d6-6b6a-4af8-8f58-b66bf02b4655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:37.137762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206811d6-6b6a-4af8-8f58-b66bf02b4655 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:37.180926 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1307/2594] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:56:36 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:56:37.184563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acef6c-5d71-45e6-a58b-573445507ab9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:37.212148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6acef6c-5d71-45e6-a58b-573445507ab9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:37.248605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be476-d8c7-4dc5-9fc9-8281d3d240bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:37.249597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be476-d8c7-4dc5-9fc9-8281d3d240bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:37.250106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be476-d8c7-4dc5-9fc9-8281d3d240bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:37.250599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be476-d8c7-4dc5-9fc9-8281d3d240bf admin admin] PATH_INFO: `/v3/projects/825e0fead9774b21a8d1b5ac617bd4f1/users/fe93c6427710461280972902fae65cd8/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:37.254053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01be476-d8c7-4dc5-9fc9-8281d3d240bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=825e0fead9774b21a8d1b5ac617bd4f1, user_id=fe93c6427710461280972902fae65cd8, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:37.266799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01be476-d8c7-4dc5-9fc9-8281d3d240bf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:37.311763 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1288/2595] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:56:37 2022] PUT /identity/v3/projects/825e0fead9774b21a8d1b5ac617bd4f1/users/fe93c6427710461280972902fae65cd8/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:56:37.322817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d51f4c-691b-443a-af2e-b9443552ff96 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:37.323159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d51f4c-691b-443a-af2e-b9443552ff96 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:37.323430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d51f4c-691b-443a-af2e-b9443552ff96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:37.422103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-93d51f4c-691b-443a-af2e-b9443552ff96 None None] MFA Rules not processed for user `fe93c6427710461280972902fae65cd8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:37.427469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93d51f4c-691b-443a-af2e-b9443552ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:37.602936 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1308/2596] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:37 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:37.614853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3a07a-e381-4012-ab52-85078a013777 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:37.615133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3a07a-e381-4012-ab52-85078a013777 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:37.615412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f3a07a-e381-4012-ab52-85078a013777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:37.658725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-61f3a07a-e381-4012-ab52-85078a013777 None None] MFA Rules not processed for user `aff5064287e54352b298041c4b0c37ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:37.662781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-61f3a07a-e381-4012-ab52-85078a013777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:37.859267 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1289/2597] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:38.149115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d51f4c-691b-443a-af2e-b9443552ff96 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:38.151000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93d51f4c-691b-443a-af2e-b9443552ff96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:38.300113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d51f4c-691b-443a-af2e-b9443552ff96 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:38.307046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f40f8-e022-46fe-8d0b-d6689865382d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:38.308461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f40f8-e022-46fe-8d0b-d6689865382d service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:38.308962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f40f8-e022-46fe-8d0b-d6689865382d service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:38.309470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1f40f8-e022-46fe-8d0b-d6689865382d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:38.320026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f40f8-e022-46fe-8d0b-d6689865382d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:38.322291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1f40f8-e022-46fe-8d0b-d6689865382d service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:38.336463 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1309/2598] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:39.163520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f9ece-1880-4c9d-9546-86660504d24e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:39.164058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f9ece-1880-4c9d-9546-86660504d24e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:39.164162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0f9ece-1880-4c9d-9546-86660504d24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:39.207210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3a0f9ece-1880-4c9d-9546-86660504d24e None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:39.208427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3a0f9ece-1880-4c9d-9546-86660504d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:39.375427 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1290/2599] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:56:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:39.389939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f40f8-e022-46fe-8d0b-d6689865382d service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:39.391793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc1f40f8-e022-46fe-8d0b-d6689865382d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:39.551325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1f40f8-e022-46fe-8d0b-d6689865382d service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:39.562377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efd7d3c-128d-497e-a912-21897fce1241 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:39.562963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7d3c-128d-497e-a912-21897fce1241 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:39.563238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7d3c-128d-497e-a912-21897fce1241 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:39.564977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efd7d3c-128d-497e-a912-21897fce1241 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:39.606682 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:39.609953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd7d3c-128d-497e-a912-21897fce1241 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:39.617958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efd7d3c-128d-497e-a912-21897fce1241 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:39.662788 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1310/2600] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:56:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:56:49.361430 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:49.644659 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:56:50.298724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2c33-59bb-4b65-8e8d-5038f8e4723d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:50.299229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2c33-59bb-4b65-8e8d-5038f8e4723d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:50.299668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f2c33-59bb-4b65-8e8d-5038f8e4723d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:50.379092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f63f2c33-59bb-4b65-8e8d-5038f8e4723d None None] MFA Rules not processed for user `7e709503bbff4c239491b0f109673264`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:50.381472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f63f2c33-59bb-4b65-8e8d-5038f8e4723d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:50.580161 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1291/2601] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:50.581359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354ddfe-a59b-4615-b617-b9244a0b637e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:50.581688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354ddfe-a59b-4615-b617-b9244a0b637e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:50.582083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354ddfe-a59b-4615-b617-b9244a0b637e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:50.684128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0354ddfe-a59b-4615-b617-b9244a0b637e None None] MFA Rules not processed for user `7e709503bbff4c239491b0f109673264`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:50.686078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0354ddfe-a59b-4615-b617-b9244a0b637e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:50.706071 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1311/2602] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:51.391764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f2c33-59bb-4b65-8e8d-5038f8e4723d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:51.426774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f2c33-59bb-4b65-8e8d-5038f8e4723d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:51.434521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d903f7a-c006-4a5d-81fe-73ddc8b705db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:51.435426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d903f7a-c006-4a5d-81fe-73ddc8b705db service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:51.435896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d903f7a-c006-4a5d-81fe-73ddc8b705db service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:51.436334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d903f7a-c006-4a5d-81fe-73ddc8b705db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:51.445835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d903f7a-c006-4a5d-81fe-73ddc8b705db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:51.447717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d903f7a-c006-4a5d-81fe-73ddc8b705db service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:51.486384 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1292/2603] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:51 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:54.947849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8d556-582a-40a2-99df-54d0ccd19e17 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:54.948904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8d556-582a-40a2-99df-54d0ccd19e17 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:54.949099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f8d556-582a-40a2-99df-54d0ccd19e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:54.987764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c3f8d556-582a-40a2-99df-54d0ccd19e17 None None] MFA Rules not processed for user `7e709503bbff4c239491b0f109673264`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:54.989030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c3f8d556-582a-40a2-99df-54d0ccd19e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:55.029578 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1312/2604] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:56:54 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:56.601385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d903f7a-c006-4a5d-81fe-73ddc8b705db service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:56.602963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1d903f7a-c006-4a5d-81fe-73ddc8b705db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:56.632615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d903f7a-c006-4a5d-81fe-73ddc8b705db service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:56.657057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f99f73-4cb2-4d02-a81a-1a7046fae4c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:56.657866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f99f73-4cb2-4d02-a81a-1a7046fae4c0 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:56.659339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f99f73-4cb2-4d02-a81a-1a7046fae4c0 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:56.659339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f99f73-4cb2-4d02-a81a-1a7046fae4c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:56.662284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31f99f73-4cb2-4d02-a81a-1a7046fae4c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:56.690610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f99f73-4cb2-4d02-a81a-1a7046fae4c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:56.695289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f99f73-4cb2-4d02-a81a-1a7046fae4c0 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:56.713567 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1293/2605] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:56:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:56:59.235298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a213ab-c491-44d3-a6e4-53235e84f632 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:59.235824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a213ab-c491-44d3-a6e4-53235e84f632 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:59.235824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a213ab-c491-44d3-a6e4-53235e84f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:59.292534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d7a213ab-c491-44d3-a6e4-53235e84f632 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:56:59.298926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d7a213ab-c491-44d3-a6e4-53235e84f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:56:59.316827 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1313/2606] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 08:56:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:56:59.337390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f99f73-4cb2-4d02-a81a-1a7046fae4c0 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:56:59.353957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f99f73-4cb2-4d02-a81a-1a7046fae4c0 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:56:59.362936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2d76a-f0d8-48bd-b4aa-c28a39a9f1f2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:56:59.364194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2d76a-f0d8-48bd-b4aa-c28a39a9f1f2 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:56:59.364643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2d76a-f0d8-48bd-b4aa-c28a39a9f1f2 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:56:59.366148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2d76a-f0d8-48bd-b4aa-c28a39a9f1f2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:56:59.379124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2d76a-f0d8-48bd-b4aa-c28a39a9f1f2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:56:59.381177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2d76a-f0d8-48bd-b4aa-c28a39a9f1f2 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:56:59.393113 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1294/2607] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:56:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:00.193328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a213ab-c491-44d3-a6e4-53235e84f632 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:00.194862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d7a213ab-c491-44d3-a6e4-53235e84f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:00.388830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a213ab-c491-44d3-a6e4-53235e84f632 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:00.394906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed5c3c-9b7e-4133-a168-a9f90362c6c7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:00.395212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed5c3c-9b7e-4133-a168-a9f90362c6c7 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:00.395568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed5c3c-9b7e-4133-a168-a9f90362c6c7 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:00.395914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed5c3c-9b7e-4133-a168-a9f90362c6c7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:00.428113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b5ed5c3c-9b7e-4133-a168-a9f90362c6c7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:00.453435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed5c3c-9b7e-4133-a168-a9f90362c6c7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:00.455302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed5c3c-9b7e-4133-a168-a9f90362c6c7 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:00.475664 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1314/2608] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:00.578714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2d76a-f0d8-48bd-b4aa-c28a39a9f1f2 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:00.581389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d0a2d76a-f0d8-48bd-b4aa-c28a39a9f1f2 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:00.672255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2d76a-f0d8-48bd-b4aa-c28a39a9f1f2 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:00.678385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:00.679457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:00.679971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:00.680501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] PATH_INFO: `/v3/users/c1f9da09bd824bd79c6adb316f1fd41b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:00.681942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1f9da09bd824bd79c6adb316f1fd41b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:00.683971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:00.769951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1f9da09bd824bd79c6adb316f1fd41b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:00.786051 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:00.847266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1f9da09bd824bd79c6adb316f1fd41b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:00.856461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1f9da09bd824bd79c6adb316f1fd41b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:00.886261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1f9da09bd824bd79c6adb316f1fd41b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:00.913702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa323841-bf5c-47ce-8996-c8ca66782ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1f9da09bd824bd79c6adb316f1fd41b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:00.950586 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1295/2609] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:00 2022] DELETE /identity/v3/users/c1f9da09bd824bd79c6adb316f1fd41b => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:01.298927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed5c3c-9b7e-4133-a168-a9f90362c6c7 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:01.318384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed5c3c-9b7e-4133-a168-a9f90362c6c7 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:01.463604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:01.465092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:01.465614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:01.466103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] PATH_INFO: `/v3/projects/71e2648d2b6748339745098a79d87f56` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:01.467886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71e2648d2b6748339745098a79d87f56)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:01.470256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:01.554097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71e2648d2b6748339745098a79d87f56', 'request_id': 'req-9f209c99-b454-49aa-b799-3232201fc871'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:01.568991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71e2648d2b6748339745098a79d87f56', 'request_id': 'req-9f209c99-b454-49aa-b799-3232201fc871'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:01.579745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71e2648d2b6748339745098a79d87f56', 'request_id': 'req-9f209c99-b454-49aa-b799-3232201fc871'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:01.604527 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:01.610764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] The token cache is being invalidate because project 71e2648d2b6748339745098a79d87f56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:01.612140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:01.613349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f209c99-b454-49aa-b799-3232201fc871 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:01.615327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1315/2610] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:01 2022] DELETE /identity/v3/projects/71e2648d2b6748339745098a79d87f56 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:01.624074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98cfc5-7f5f-4561-a3b6-3804a09e18da None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:01.624659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98cfc5-7f5f-4561-a3b6-3804a09e18da None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:01.624659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98cfc5-7f5f-4561-a3b6-3804a09e18da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:01.660467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ed98cfc5-7f5f-4561-a3b6-3804a09e18da None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:01.661922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ed98cfc5-7f5f-4561-a3b6-3804a09e18da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:01.820571 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1296/2611] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:01.830950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1d78-ef3e-4333-83b9-3a79c4480773 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:01.831298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1d78-ef3e-4333-83b9-3a79c4480773 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:01.831505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1d78-ef3e-4333-83b9-3a79c4480773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:01.861806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fa7d1d78-ef3e-4333-83b9-3a79c4480773 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:01.863035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa7d1d78-ef3e-4333-83b9-3a79c4480773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:01.873344 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1316/2612] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:01.876636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98cfc5-7f5f-4561-a3b6-3804a09e18da None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:01.890687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98cfc5-7f5f-4561-a3b6-3804a09e18da None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:01.896670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452557d-1868-4fa1-88c3-b039245b9e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:01.897543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452557d-1868-4fa1-88c3-b039245b9e75 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:01.897930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452557d-1868-4fa1-88c3-b039245b9e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:01.898328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4452557d-1868-4fa1-88c3-b039245b9e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:01.899091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452557d-1868-4fa1-88c3-b039245b9e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:57:01.899665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452557d-1868-4fa1-88c3-b039245b9e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:01.902278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4452557d-1868-4fa1-88c3-b039245b9e75 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:01.918900 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1297/2613] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:57:01.923079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d1d78-ef3e-4333-83b9-3a79c4480773 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:01.935521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d1d78-ef3e-4333-83b9-3a79c4480773 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:01.940673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fed38-0642-41c2-bf89-0363250305be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:01.941521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fed38-0642-41c2-bf89-0363250305be admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:01.941805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fed38-0642-41c2-bf89-0363250305be admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:01.942082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fed38-0642-41c2-bf89-0363250305be admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:01.942732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fed38-0642-41c2-bf89-0363250305be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:01.944843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fed38-0642-41c2-bf89-0363250305be admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:02.006786 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1317/2614] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:57:01 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:02.013940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452557d-1868-4fa1-88c3-b039245b9e75 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:02.042980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4452557d-1868-4fa1-88c3-b039245b9e75 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:02.160134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d15eea-1ad7-406d-8462-04382b45d24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:02.162101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d15eea-1ad7-406d-8462-04382b45d24e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:02.162101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d15eea-1ad7-406d-8462-04382b45d24e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:02.162101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d15eea-1ad7-406d-8462-04382b45d24e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:02.163701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d15eea-1ad7-406d-8462-04382b45d24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:02.167775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d15eea-1ad7-406d-8462-04382b45d24e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:02.221473 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1298/2615] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:57:02 2022] POST /identity/v3/users => generated 284 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:02.225671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fed38-0642-41c2-bf89-0363250305be admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:02.243551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fed38-0642-41c2-bf89-0363250305be admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:02.254419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc72b9-c1e3-42e4-a3cb-c3907b8db706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:02.255208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc72b9-c1e3-42e4-a3cb-c3907b8db706 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:02.256036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc72b9-c1e3-42e4-a3cb-c3907b8db706 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:02.256036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc72b9-c1e3-42e4-a3cb-c3907b8db706 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:02.256596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc72b9-c1e3-42e4-a3cb-c3907b8db706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:02.259234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc72b9-c1e3-42e4-a3cb-c3907b8db706 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:02.274319 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1318/2616] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:02.278318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d15eea-1ad7-406d-8462-04382b45d24e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:02.299144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d15eea-1ad7-406d-8462-04382b45d24e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:02.323265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e10e3-d5d3-48ec-8847-345c0c76a663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:02.323937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e10e3-d5d3-48ec-8847-345c0c76a663 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:02.324717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e10e3-d5d3-48ec-8847-345c0c76a663 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:02.324853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e10e3-d5d3-48ec-8847-345c0c76a663 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:02.325550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e10e3-d5d3-48ec-8847-345c0c76a663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:02.328667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3e10e3-d5d3-48ec-8847-345c0c76a663 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:02.361580 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1299/2617] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:02.365945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc72b9-c1e3-42e4-a3cb-c3907b8db706 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:02.384655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc72b9-c1e3-42e4-a3cb-c3907b8db706 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:02.407145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de2cb2-8efe-487b-a45b-6aff1eaf4e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:02.407145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2cb2-8efe-487b-a45b-6aff1eaf4e6c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:02.407145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2cb2-8efe-487b-a45b-6aff1eaf4e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:02.407145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95de2cb2-8efe-487b-a45b-6aff1eaf4e6c admin admin] PATH_INFO: `/v3/projects/01d49a667f134a8283ea56977bc33572/users/b9785b058f4849e28c1fe25af094bef5/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:02.437917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de2cb2-8efe-487b-a45b-6aff1eaf4e6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d49a667f134a8283ea56977bc33572, user_id=b9785b058f4849e28c1fe25af094bef5, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:02.443166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95de2cb2-8efe-487b-a45b-6aff1eaf4e6c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:02.466413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1319/2618] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:57:02 2022] PUT /identity/v3/projects/01d49a667f134a8283ea56977bc33572/users/b9785b058f4849e28c1fe25af094bef5/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:02.472629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26a8c2-68a2-4d15-9e50-3a8aee70686d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:02.472978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26a8c2-68a2-4d15-9e50-3a8aee70686d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:02.473954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a26a8c2-68a2-4d15-9e50-3a8aee70686d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:02.505921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8a26a8c2-68a2-4d15-9e50-3a8aee70686d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:02.507470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8a26a8c2-68a2-4d15-9e50-3a8aee70686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:02.561663 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=3,keystone:SELECT=93,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:02.622093 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1300/2619] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:57:02.627968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de2cb2-8efe-487b-a45b-6aff1eaf4e6c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:02.638614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-95de2cb2-8efe-487b-a45b-6aff1eaf4e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:02.752181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95de2cb2-8efe-487b-a45b-6aff1eaf4e6c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:02.756633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8b82-ef11-48a3-8825-6fec475d2736 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:02.757367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8b82-ef11-48a3-8825-6fec475d2736 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:02.757652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8b82-ef11-48a3-8825-6fec475d2736 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:02.757921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d8b82-ef11-48a3-8825-6fec475d2736 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:02.773050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8b82-ef11-48a3-8825-6fec475d2736 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:02.775812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d8b82-ef11-48a3-8825-6fec475d2736 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:02.801246 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1320/2620] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:06.796518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26a8c2-68a2-4d15-9e50-3a8aee70686d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:06.798916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8a26a8c2-68a2-4d15-9e50-3a8aee70686d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:06.901608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a26a8c2-68a2-4d15-9e50-3a8aee70686d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:06.908694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:06.909325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:06.909623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:06.909899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:06.912465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:06.933662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:06.936005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:06.971368 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1301/2621] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:07.256186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8b82-ef11-48a3-8825-6fec475d2736 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:07.259026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c41d8b82-ef11-48a3-8825-6fec475d2736 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:07.433214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d8b82-ef11-48a3-8825-6fec475d2736 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:07.445352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77669b-25c5-4229-83c8-15deb3b6d76b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:07.447199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77669b-25c5-4229-83c8-15deb3b6d76b service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:07.448310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77669b-25c5-4229-83c8-15deb3b6d76b service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:07.449337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77669b-25c5-4229-83c8-15deb3b6d76b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:07.453272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2d77669b-25c5-4229-83c8-15deb3b6d76b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:07.524707 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:07.567012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77669b-25c5-4229-83c8-15deb3b6d76b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:07.569047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d77669b-25c5-4229-83c8-15deb3b6d76b service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:07.589785 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1321/2622] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:07 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:08.364018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:08.366115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:08.390012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428138d4-5921-4152-a9a8-f3d2bc935785 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:08.405533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:08.406143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:08.406623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:08.406903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] PATH_INFO: `/v3/users/9fa08ec12fa74ec3af765850e8bbc609` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:08.408348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fa08ec12fa74ec3af765850e8bbc609)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:08.410319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:08.495191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fa08ec12fa74ec3af765850e8bbc609'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:08.512146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fa08ec12fa74ec3af765850e8bbc609'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:08.512966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fa08ec12fa74ec3af765850e8bbc609'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:08.526429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fa08ec12fa74ec3af765850e8bbc609'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:08.546666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fa08ec12fa74ec3af765850e8bbc609'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:08.567532 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1302/2623] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:08 2022] DELETE /identity/v3/users/9fa08ec12fa74ec3af765850e8bbc609 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:08.572190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae482c50-15ad-4c42-a6cc-df5a71936385 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:08.573736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae482c50-15ad-4c42-a6cc-df5a71936385 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:08.574258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae482c50-15ad-4c42-a6cc-df5a71936385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:08.596452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ae482c50-15ad-4c42-a6cc-df5a71936385 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:08.597918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ae482c50-15ad-4c42-a6cc-df5a71936385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:08.725276 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1322/2624] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:08.736127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:08.737814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:08.817467 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:08.852503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d70f02d-1fdf-4e36-9db4-8107e2f33455 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:08.862960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6bbdc-f923-4407-bd02-8e3d3886e536 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:08.862960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6bbdc-f923-4407-bd02-8e3d3886e536 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:08.863221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6bbdc-f923-4407-bd02-8e3d3886e536 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:08.863697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe6bbdc-f923-4407-bd02-8e3d3886e536 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:08.879769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6bbdc-f923-4407-bd02-8e3d3886e536 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:08.882641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe6bbdc-f923-4407-bd02-8e3d3886e536 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:08.901044 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1303/2625] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:09.527529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae482c50-15ad-4c42-a6cc-df5a71936385 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:09.529512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ae482c50-15ad-4c42-a6cc-df5a71936385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:09.557810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae482c50-15ad-4c42-a6cc-df5a71936385 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:09.576208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:09.579845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:09.580446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:09.581079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] PATH_INFO: `/v3/projects/22fe645c49214c7d84b9081e3f481de9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:09.589800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22fe645c49214c7d84b9081e3f481de9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:09.595575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:09.714894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22fe645c49214c7d84b9081e3f481de9', 'request_id': 'req-c431e45d-7ed1-49e3-8c19-431be888f953'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:09.734105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22fe645c49214c7d84b9081e3f481de9', 'request_id': 'req-c431e45d-7ed1-49e3-8c19-431be888f953'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:09.743862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22fe645c49214c7d84b9081e3f481de9', 'request_id': 'req-c431e45d-7ed1-49e3-8c19-431be888f953'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:09.778963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] The token cache is being invalidate because project 22fe645c49214c7d84b9081e3f481de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:09.779267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:09.780808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:09.782869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1323/2626] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:09 2022] DELETE /identity/v3/projects/22fe645c49214c7d84b9081e3f481de9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:09.789020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6bbdc-f923-4407-bd02-8e3d3886e536 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:09.805940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe6bbdc-f923-4407-bd02-8e3d3886e536 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:09.901660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:09.902551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:09.902989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:09.903421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] PATH_INFO: `/v3/users/3d973cbb5ff44a53bda0971ceb9285ad` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:09.904767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d973cbb5ff44a53bda0971ceb9285ad)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:09.907177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:09.991792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d973cbb5ff44a53bda0971ceb9285ad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:10.010739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d973cbb5ff44a53bda0971ceb9285ad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:10.014997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d973cbb5ff44a53bda0971ceb9285ad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:10.028371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d973cbb5ff44a53bda0971ceb9285ad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:10.048614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-72166478-02b9-4f10-b6b6-f22a4a752e73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d973cbb5ff44a53bda0971ceb9285ad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:10.061054 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1304/2627] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:09 2022] DELETE /identity/v3/users/3d973cbb5ff44a53bda0971ceb9285ad => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:10.738385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:10.739950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:10.767108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c431e45d-7ed1-49e3-8c19-431be888f953 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:10.900644 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:10.917523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:10.919422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:10.919929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:10.920439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] PATH_INFO: `/v3/projects/ad5d5af8bc2f4bfe94b6379b077f4b8f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:10.924934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad5d5af8bc2f4bfe94b6379b077f4b8f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:10.930270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:11.039813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad5d5af8bc2f4bfe94b6379b077f4b8f', 'request_id': 'req-70b01af5-00c4-45de-9291-7b41e151d0ac'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:11.053531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad5d5af8bc2f4bfe94b6379b077f4b8f', 'request_id': 'req-70b01af5-00c4-45de-9291-7b41e151d0ac'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:11.070315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad5d5af8bc2f4bfe94b6379b077f4b8f', 'request_id': 'req-70b01af5-00c4-45de-9291-7b41e151d0ac'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:11.097332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] The token cache is being invalidate because project ad5d5af8bc2f4bfe94b6379b077f4b8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:11.097332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:11.098395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-70b01af5-00c4-45de-9291-7b41e151d0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:11.102455 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1324/2628] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:10 2022] DELETE /identity/v3/projects/ad5d5af8bc2f4bfe94b6379b077f4b8f => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:11.108163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe79d4-6011-4485-8510-0ed6042a5729 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:11.108703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe79d4-6011-4485-8510-0ed6042a5729 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:11.108857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebe79d4-6011-4485-8510-0ed6042a5729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:11.162411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cebe79d4-6011-4485-8510-0ed6042a5729 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:11.164167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cebe79d4-6011-4485-8510-0ed6042a5729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:11.282288 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:11.304974 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1305/2629] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:11.323422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c80991-663c-4341-a696-6553b8fb8982 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:11.328662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c80991-663c-4341-a696-6553b8fb8982 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:11.330047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c80991-663c-4341-a696-6553b8fb8982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:11.358965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a1c80991-663c-4341-a696-6553b8fb8982 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:11.360402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a1c80991-663c-4341-a696-6553b8fb8982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:11.373947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1325/2630] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:11.377902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe79d4-6011-4485-8510-0ed6042a5729 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:11.390276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebe79d4-6011-4485-8510-0ed6042a5729 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:11.396295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2cb32-61dd-4c12-a9e1-b677364ebae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:11.396985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2cb32-61dd-4c12-a9e1-b677364ebae7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:11.397379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2cb32-61dd-4c12-a9e1-b677364ebae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:11.397730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d2cb32-61dd-4c12-a9e1-b677364ebae7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:11.398420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2cb32-61dd-4c12-a9e1-b677364ebae7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:57:11.398737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2cb32-61dd-4c12-a9e1-b677364ebae7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:11.401101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d2cb32-61dd-4c12-a9e1-b677364ebae7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:11.422206 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1306/2631] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:57:11.423321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c80991-663c-4341-a696-6553b8fb8982 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:11.440202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c80991-663c-4341-a696-6553b8fb8982 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:11.453491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e60d0-574f-4092-a5a0-ba0c7b1413a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:11.454107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e60d0-574f-4092-a5a0-ba0c7b1413a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:11.454386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e60d0-574f-4092-a5a0-ba0c7b1413a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:11.454657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e60d0-574f-4092-a5a0-ba0c7b1413a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:11.455309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e60d0-574f-4092-a5a0-ba0c7b1413a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:11.461506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e60d0-574f-4092-a5a0-ba0c7b1413a4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:11.519440 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1326/2632] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:57:11 2022] POST /identity/v3/projects => generated 401 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:11.523698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2cb32-61dd-4c12-a9e1-b677364ebae7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:11.544075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d2cb32-61dd-4c12-a9e1-b677364ebae7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:11.653074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ff33b-e76d-401a-9255-bea9d354ea0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:11.654038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ff33b-e76d-401a-9255-bea9d354ea0d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:11.654597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ff33b-e76d-401a-9255-bea9d354ea0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:11.655024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ff33b-e76d-401a-9255-bea9d354ea0d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:11.656064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ff33b-e76d-401a-9255-bea9d354ea0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:11.659212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ff33b-e76d-401a-9255-bea9d354ea0d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:11.718976 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1307/2633] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:57:11 2022] POST /identity/v3/users => generated 301 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:11.722889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e60d0-574f-4092-a5a0-ba0c7b1413a4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:11.733995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e60d0-574f-4092-a5a0-ba0c7b1413a4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:11.751077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bbf81-b406-435a-be7c-0170348c0e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:11.751752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bbf81-b406-435a-be7c-0170348c0e48 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:11.752122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bbf81-b406-435a-be7c-0170348c0e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:11.752495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62bbf81-b406-435a-be7c-0170348c0e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:11.753257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bbf81-b406-435a-be7c-0170348c0e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:11.755227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62bbf81-b406-435a-be7c-0170348c0e48 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:11.782369 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1327/2634] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:11.786257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ff33b-e76d-401a-9255-bea9d354ea0d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:11.800688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ff33b-e76d-401a-9255-bea9d354ea0d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:11.813768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1f4896-159d-4634-901f-439baf826f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:11.814926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f4896-159d-4634-901f-439baf826f3b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:11.815416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f4896-159d-4634-901f-439baf826f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:11.815908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1f4896-159d-4634-901f-439baf826f3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:11.817228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f4896-159d-4634-901f-439baf826f3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:11.821744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1f4896-159d-4634-901f-439baf826f3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:11.854473 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1308/2635] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:11.858345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bbf81-b406-435a-be7c-0170348c0e48 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:11.872001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62bbf81-b406-435a-be7c-0170348c0e48 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:11.878153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca37c1e-b51e-450d-a3da-14d99bc56567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:11.879689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca37c1e-b51e-450d-a3da-14d99bc56567 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:11.880190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca37c1e-b51e-450d-a3da-14d99bc56567 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:11.880677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca37c1e-b51e-450d-a3da-14d99bc56567 admin admin] PATH_INFO: `/v3/projects/5bf2fd195bba468095d4cb1501e9922f/users/a59f9fcc21c44410af62e5833b0d70ff/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:11.900018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca37c1e-b51e-450d-a3da-14d99bc56567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bf2fd195bba468095d4cb1501e9922f, user_id=a59f9fcc21c44410af62e5833b0d70ff, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:11.904979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca37c1e-b51e-450d-a3da-14d99bc56567 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:11.932863 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1328/2636] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:57:11 2022] PUT /identity/v3/projects/5bf2fd195bba468095d4cb1501e9922f/users/a59f9fcc21c44410af62e5833b0d70ff/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:11.944665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e32c-9c56-42c8-aa87-41a7d0ffee8d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:11.946963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e32c-9c56-42c8-aa87-41a7d0ffee8d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:11.947883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd1e32c-9c56-42c8-aa87-41a7d0ffee8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:12.018870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ddd1e32c-9c56-42c8-aa87-41a7d0ffee8d None None] MFA Rules not processed for user `a59f9fcc21c44410af62e5833b0d70ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:12.020411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ddd1e32c-9c56-42c8-aa87-41a7d0ffee8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:12.105457 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1309/2637] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:11 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:12.109789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca37c1e-b51e-450d-a3da-14d99bc56567 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:12.235594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca37c1e-b51e-450d-a3da-14d99bc56567 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:12.251064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263125f2-182a-4469-aa65-6660cb633ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:12.251948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263125f2-182a-4469-aa65-6660cb633ca5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:12.252563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263125f2-182a-4469-aa65-6660cb633ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:12.252913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263125f2-182a-4469-aa65-6660cb633ca5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:12.253957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263125f2-182a-4469-aa65-6660cb633ca5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:12.255949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263125f2-182a-4469-aa65-6660cb633ca5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:12.330142 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1329/2638] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:57:12 2022] POST /identity/v3/projects => generated 403 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:12.334869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e32c-9c56-42c8-aa87-41a7d0ffee8d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:12.371239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd1e32c-9c56-42c8-aa87-41a7d0ffee8d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:12.529629 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:12.540304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1501ef8-b741-48ba-b0ce-34affe251c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:12.542005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1501ef8-b741-48ba-b0ce-34affe251c4b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:12.546875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1501ef8-b741-48ba-b0ce-34affe251c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:12.547593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1501ef8-b741-48ba-b0ce-34affe251c4b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:12.548523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1501ef8-b741-48ba-b0ce-34affe251c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:12.551971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1501ef8-b741-48ba-b0ce-34affe251c4b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:12.621573 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1310/2639] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:57:12 2022] POST /identity/v3/users => generated 308 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:12.625240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263125f2-182a-4469-aa65-6660cb633ca5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:12.638375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263125f2-182a-4469-aa65-6660cb633ca5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:12.660687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2deeb-faa8-4ac3-ab8c-f1927220b687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:12.661340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2deeb-faa8-4ac3-ab8c-f1927220b687 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:12.661688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2deeb-faa8-4ac3-ab8c-f1927220b687 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:12.661900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a2deeb-faa8-4ac3-ab8c-f1927220b687 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:12.662799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2deeb-faa8-4ac3-ab8c-f1927220b687 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:12.664774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a2deeb-faa8-4ac3-ab8c-f1927220b687 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:12.666398 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:12.693187 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1330/2640] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:57:12.698640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1501ef8-b741-48ba-b0ce-34affe251c4b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:12.718751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1501ef8-b741-48ba-b0ce-34affe251c4b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:12.768403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b00c-5114-4051-a0f8-6fde32fdec5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:12.769627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b00c-5114-4051-a0f8-6fde32fdec5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:12.769627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b00c-5114-4051-a0f8-6fde32fdec5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:12.769867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e15b00c-5114-4051-a0f8-6fde32fdec5f admin admin] PATH_INFO: `/v3/projects/6a46c38ffdcb48d89245d502d7851231/users/fbf03b170727417487ae0ad514c639ef/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:12.821768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15b00c-5114-4051-a0f8-6fde32fdec5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a46c38ffdcb48d89245d502d7851231, user_id=fbf03b170727417487ae0ad514c639ef, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:12.825786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e15b00c-5114-4051-a0f8-6fde32fdec5f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:12.852493 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1311/2641] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:57:12 2022] PUT /identity/v3/projects/6a46c38ffdcb48d89245d502d7851231/users/fbf03b170727417487ae0ad514c639ef/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:12.856726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2deeb-faa8-4ac3-ab8c-f1927220b687 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:12.871885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a2deeb-faa8-4ac3-ab8c-f1927220b687 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:13.036012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7c12da-350e-4bcb-b56d-089d0dbf7745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:13.036964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c12da-350e-4bcb-b56d-089d0dbf7745 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:13.037480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c12da-350e-4bcb-b56d-089d0dbf7745 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:13.041452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7c12da-350e-4bcb-b56d-089d0dbf7745 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:13.042418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c12da-350e-4bcb-b56d-089d0dbf7745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:13.044541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7c12da-350e-4bcb-b56d-089d0dbf7745 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:13.084566 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1331/2642] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:12 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:13.089049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b00c-5114-4051-a0f8-6fde32fdec5f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:13.130495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e15b00c-5114-4051-a0f8-6fde32fdec5f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:13.174137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0fca-25bb-4b8e-906f-c792b6c35dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:13.174906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0fca-25bb-4b8e-906f-c792b6c35dc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:13.175187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0fca-25bb-4b8e-906f-c792b6c35dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:13.175468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedd0fca-25bb-4b8e-906f-c792b6c35dc3 admin admin] PATH_INFO: `/v3/projects/6a46c38ffdcb48d89245d502d7851231/users/fbf03b170727417487ae0ad514c639ef/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:13.179181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd0fca-25bb-4b8e-906f-c792b6c35dc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a46c38ffdcb48d89245d502d7851231, user_id=fbf03b170727417487ae0ad514c639ef, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:13.181989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedd0fca-25bb-4b8e-906f-c792b6c35dc3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:13.218204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1312/2643] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:57:13 2022] PUT /identity/v3/projects/6a46c38ffdcb48d89245d502d7851231/users/fbf03b170727417487ae0ad514c639ef/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:13.229498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c1c4-6718-443f-af98-c39e28c6ef65 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:13.230133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c1c4-6718-443f-af98-c39e28c6ef65 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:13.230617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add8c1c4-6718-443f-af98-c39e28c6ef65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:13.317491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-add8c1c4-6718-443f-af98-c39e28c6ef65 None None] MFA Rules not processed for user `fbf03b170727417487ae0ad514c639ef`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:13.319633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-add8c1c4-6718-443f-af98-c39e28c6ef65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:13.526158 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1332/2644] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:13 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:13.660053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0fca-25bb-4b8e-906f-c792b6c35dc3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:13.662498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bedd0fca-25bb-4b8e-906f-c792b6c35dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:13.875531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedd0fca-25bb-4b8e-906f-c792b6c35dc3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:13.897541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9693a80-f3b3-47cb-9c35-92ed767823a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:13.898402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9693a80-f3b3-47cb-9c35-92ed767823a3 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:13.899141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9693a80-f3b3-47cb-9c35-92ed767823a3 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:13.904049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9693a80-f3b3-47cb-9c35-92ed767823a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:13.927899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9693a80-f3b3-47cb-9c35-92ed767823a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:13.930434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9693a80-f3b3-47cb-9c35-92ed767823a3 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:13.941479 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1313/2645] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:14.871718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c1c4-6718-443f-af98-c39e28c6ef65 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:14.892168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add8c1c4-6718-443f-af98-c39e28c6ef65 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:14.899243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422077-60ba-4c8e-b81c-3b54496ac6e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:14.900209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422077-60ba-4c8e-b81c-3b54496ac6e2 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:14.900670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422077-60ba-4c8e-b81c-3b54496ac6e2 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:14.901111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3422077-60ba-4c8e-b81c-3b54496ac6e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:15.029663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422077-60ba-4c8e-b81c-3b54496ac6e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:15.032523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3422077-60ba-4c8e-b81c-3b54496ac6e2 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:15.045953 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1333/2646] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:14 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:15.074038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9693a80-f3b3-47cb-9c35-92ed767823a3 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:15.133677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422077-60ba-4c8e-b81c-3b54496ac6e2 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:15.134700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b3422077-60ba-4c8e-b81c-3b54496ac6e2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:15.174243 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:15.212924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9693a80-f3b3-47cb-9c35-92ed767823a3 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:15.225492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:15.229336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:15.229967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:15.230406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] PATH_INFO: `/v3/users/a59f9fcc21c44410af62e5833b0d70ff` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:15.233644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a59f9fcc21c44410af62e5833b0d70ff)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:15.237661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:15.291765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3422077-60ba-4c8e-b81c-3b54496ac6e2 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:15.309484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:15.310136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:15.310422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:15.310697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] PATH_INFO: `/v3/users/aff5064287e54352b298041c4b0c37ec` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:15.312871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff5064287e54352b298041c4b0c37ec)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:15.314836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:15.327000 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:15.347400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a59f9fcc21c44410af62e5833b0d70ff'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.374489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a59f9fcc21c44410af62e5833b0d70ff'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.375360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a59f9fcc21c44410af62e5833b0d70ff'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.397486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a59f9fcc21c44410af62e5833b0d70ff'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.411513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e122bd1-2604-4e2d-84f9-42054b20c925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a59f9fcc21c44410af62e5833b0d70ff'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.413790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff5064287e54352b298041c4b0c37ec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.425142 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1314/2647] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:15 2022] DELETE /identity/v3/users/a59f9fcc21c44410af62e5833b0d70ff => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:15.427448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58db77-044a-44d1-9475-3f8924512bc5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:15.427892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58db77-044a-44d1-9475-3f8924512bc5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:15.428420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c58db77-044a-44d1-9475-3f8924512bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:15.433729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff5064287e54352b298041c4b0c37ec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.434665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff5064287e54352b298041c4b0c37ec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.445512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff5064287e54352b298041c4b0c37ec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.453729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9c58db77-044a-44d1-9475-3f8924512bc5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:15.454966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9c58db77-044a-44d1-9475-3f8924512bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:15.455727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5d438698-81bb-45e3-a923-eb2d964de462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff5064287e54352b298041c4b0c37ec'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:15.465344 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1334/2648] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:15 2022] DELETE /identity/v3/users/aff5064287e54352b298041c4b0c37ec => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:57:15.468135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453985aa-0bf6-4f75-8e4c-3d422d374990 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:15.468602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453985aa-0bf6-4f75-8e4c-3d422d374990 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:15.469181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453985aa-0bf6-4f75-8e4c-3d422d374990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:15.494658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-453985aa-0bf6-4f75-8e4c-3d422d374990 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:15.496789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-453985aa-0bf6-4f75-8e4c-3d422d374990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:15.573559 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1315/2649] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:15.583781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58db77-044a-44d1-9475-3f8924512bc5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:15.586868 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1335/2650] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:15.596500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9c58db77-044a-44d1-9475-3f8924512bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:15.599570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453985aa-0bf6-4f75-8e4c-3d422d374990 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:15.602060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-453985aa-0bf6-4f75-8e4c-3d422d374990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:15.694694 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:15.720194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453985aa-0bf6-4f75-8e4c-3d422d374990 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:15.726059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba90b5b4-bc7e-432b-893a-fa9529f4d4ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:15.727150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90b5b4-bc7e-432b-893a-fa9529f4d4ce service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:15.727150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90b5b4-bc7e-432b-893a-fa9529f4d4ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:15.727359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba90b5b4-bc7e-432b-893a-fa9529f4d4ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:15.742252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90b5b4-bc7e-432b-893a-fa9529f4d4ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:15.744078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba90b5b4-bc7e-432b-893a-fa9529f4d4ce service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:15.761536 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1336/2651] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:15.763332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b51ee-5529-4abb-9fd5-1c91997457fc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:15.763665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b51ee-5529-4abb-9fd5-1c91997457fc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:15.764107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b51ee-5529-4abb-9fd5-1c91997457fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:15.771400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c58db77-044a-44d1-9475-3f8924512bc5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:15.787584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b12632-cab7-4ec6-8601-f04c04075c9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:15.788218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b12632-cab7-4ec6-8601-f04c04075c9e service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:15.788560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b12632-cab7-4ec6-8601-f04c04075c9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:15.788843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b12632-cab7-4ec6-8601-f04c04075c9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:15.805398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0d6b51ee-5529-4abb-9fd5-1c91997457fc None None] MFA Rules not processed for user `b9785b058f4849e28c1fe25af094bef5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:15.806859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d6b51ee-5529-4abb-9fd5-1c91997457fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:15.826118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b12632-cab7-4ec6-8601-f04c04075c9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:15.829731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b12632-cab7-4ec6-8601-f04c04075c9e service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:15.843206 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1316/2652] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:15.975396 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1337/2653] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:15.997648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b12632-cab7-4ec6-8601-f04c04075c9e service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:15.999180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52b12632-cab7-4ec6-8601-f04c04075c9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:16.170060 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:16.204918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b12632-cab7-4ec6-8601-f04c04075c9e service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:16.224503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f847-081e-4d75-9c8b-bb7894e12739 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:16.225211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f847-081e-4d75-9c8b-bb7894e12739 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:16.225520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f847-081e-4d75-9c8b-bb7894e12739 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:16.225791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4995f847-081e-4d75-9c8b-bb7894e12739 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:16.244881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995f847-081e-4d75-9c8b-bb7894e12739 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:16.246794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4995f847-081e-4d75-9c8b-bb7894e12739 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:16.264310 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1317/2654] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:15 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:16.386697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b51ee-5529-4abb-9fd5-1c91997457fc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:16.390254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d6b51ee-5529-4abb-9fd5-1c91997457fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:16.435340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b51ee-5529-4abb-9fd5-1c91997457fc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:16.449645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:16.450978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:16.452418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:16.452822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] PATH_INFO: `/v3/projects/f6376cfd719142a58ac589d96c89f6e4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:16.455706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6376cfd719142a58ac589d96c89f6e4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:16.464816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:16.582323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f847-081e-4d75-9c8b-bb7894e12739 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:16.584031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4995f847-081e-4d75-9c8b-bb7894e12739 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:16.611185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6376cfd719142a58ac589d96c89f6e4', 'request_id': 'req-10404e33-6c80-442d-9c71-51b9177dcd29'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.622900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6376cfd719142a58ac589d96c89f6e4', 'request_id': 'req-10404e33-6c80-442d-9c71-51b9177dcd29'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.623481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4995f847-081e-4d75-9c8b-bb7894e12739 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:16.631543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6376cfd719142a58ac589d96c89f6e4', 'request_id': 'req-10404e33-6c80-442d-9c71-51b9177dcd29'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.646694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] The token cache is being invalidate because project f6376cfd719142a58ac589d96c89f6e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:16.647018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.648123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.651436 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1338/2655] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:16 2022] DELETE /identity/v3/projects/f6376cfd719142a58ac589d96c89f6e4 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:16.656110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:16.672782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:16.740865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:16.741533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:16.741817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:16.742294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] PATH_INFO: `/v3/projects/5bf2fd195bba468095d4cb1501e9922f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:16.746842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bf2fd195bba468095d4cb1501e9922f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:16.748927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:16.774643 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:16.839217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10404e33-6c80-442d-9c71-51b9177dcd29 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:16.875407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bf2fd195bba468095d4cb1501e9922f', 'request_id': 'req-5def1d93-2b3a-4d78-810a-811b4b68e913'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.882893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bf2fd195bba468095d4cb1501e9922f', 'request_id': 'req-5def1d93-2b3a-4d78-810a-811b4b68e913'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.903794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bf2fd195bba468095d4cb1501e9922f', 'request_id': 'req-5def1d93-2b3a-4d78-810a-811b4b68e913'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.924103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] The token cache is being invalidate because project 5bf2fd195bba468095d4cb1501e9922f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:16.924716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.927515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:16.929735 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1318/2656] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:16 2022] DELETE /identity/v3/projects/5bf2fd195bba468095d4cb1501e9922f => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:57:16.933446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:16.936128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:16.984783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:16.985714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:16.986300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:16.986588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] PATH_INFO: `/v3/users/fe93c6427710461280972902fae65cd8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:16.988920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe93c6427710461280972902fae65cd8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:16.991394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:17.111467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe93c6427710461280972902fae65cd8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.114532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5def1d93-2b3a-4d78-810a-811b4b68e913 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:17.135214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:17.135867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:17.136147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:17.136422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] PATH_INFO: `/v3/users/fbf03b170727417487ae0ad514c639ef` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:17.138945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe93c6427710461280972902fae65cd8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.141568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe93c6427710461280972902fae65cd8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.146279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbf03b170727417487ae0ad514c639ef)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:17.148872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:17.159234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe93c6427710461280972902fae65cd8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.174547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe93c6427710461280972902fae65cd8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.189462 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1339/2657] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:16 2022] DELETE /identity/v3/users/fe93c6427710461280972902fae65cd8 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:17.193482 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:17.271628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbf03b170727417487ae0ad514c639ef'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.299214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbf03b170727417487ae0ad514c639ef'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.301267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbf03b170727417487ae0ad514c639ef'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.317933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbf03b170727417487ae0ad514c639ef'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.365874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbf03b170727417487ae0ad514c639ef'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:17.382965 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1319/2658] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:16 2022] DELETE /identity/v3/users/fbf03b170727417487ae0ad514c639ef => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:17.926479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:17.928070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:18.010188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:18.012094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:18.068347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98a27b2-6b39-4768-ba4c-2679db55959b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:18.116549 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:18.156422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dcf0fc-8548-49e9-bd0e-d3e1953bb20e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:18.165123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:18.166779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:18.167283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:18.167826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] PATH_INFO: `/v3/projects/825e0fead9774b21a8d1b5ac617bd4f1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:18.172661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=825e0fead9774b21a8d1b5ac617bd4f1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:18.174640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:18.210879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:18.211609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:18.211893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:18.212165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] PATH_INFO: `/v3/projects/6a46c38ffdcb48d89245d502d7851231` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:18.213900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a46c38ffdcb48d89245d502d7851231)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:18.215827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:18.283489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '825e0fead9774b21a8d1b5ac617bd4f1', 'request_id': 'req-afa7f375-d49d-432a-8faf-eef6c3a08ba7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.292551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '825e0fead9774b21a8d1b5ac617bd4f1', 'request_id': 'req-afa7f375-d49d-432a-8faf-eef6c3a08ba7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.305635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '825e0fead9774b21a8d1b5ac617bd4f1', 'request_id': 'req-afa7f375-d49d-432a-8faf-eef6c3a08ba7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.327870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a46c38ffdcb48d89245d502d7851231', 'request_id': 'req-5496e097-aa8d-4651-af92-8baf65ab65e7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.332298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] The token cache is being invalidate because project 825e0fead9774b21a8d1b5ac617bd4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:18.332593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.333274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-afa7f375-d49d-432a-8faf-eef6c3a08ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.356576 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1320/2659] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:18 2022] DELETE /identity/v3/projects/825e0fead9774b21a8d1b5ac617bd4f1 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:57:18.358826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b1ba3-0485-41d6-87ab-a1472262a441 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:18.358939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b1ba3-0485-41d6-87ab-a1472262a441 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:18.359215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42b1ba3-0485-41d6-87ab-a1472262a441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:18.361498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a46c38ffdcb48d89245d502d7851231', 'request_id': 'req-5496e097-aa8d-4651-af92-8baf65ab65e7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.368772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a46c38ffdcb48d89245d502d7851231', 'request_id': 'req-5496e097-aa8d-4651-af92-8baf65ab65e7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.394290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] The token cache is being invalidate because project 6a46c38ffdcb48d89245d502d7851231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:18.394585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.395266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5496e097-aa8d-4651-af92-8baf65ab65e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:18.397158 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1340/2660] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:17 2022] DELETE /identity/v3/projects/6a46c38ffdcb48d89245d502d7851231 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:18.401337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e42b1ba3-0485-41d6-87ab-a1472262a441 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:18.402557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e42b1ba3-0485-41d6-87ab-a1472262a441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:18.402703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1a9fd-1a9c-4619-b4f7-35fbec1b4818 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:18.402973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1a9fd-1a9c-4619-b4f7-35fbec1b4818 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:18.403499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1a9fd-1a9c-4619-b4f7-35fbec1b4818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:18.459652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-10b1a9fd-1a9c-4619-b4f7-35fbec1b4818 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:18.461395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-10b1a9fd-1a9c-4619-b4f7-35fbec1b4818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:18.463657 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:18.581238 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1321/2661] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:18.590126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65012-3a63-44d8-aef7-6b253002fbcf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:18.590310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65012-3a63-44d8-aef7-6b253002fbcf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:18.590595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f65012-3a63-44d8-aef7-6b253002fbcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:18.616825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-55f65012-3a63-44d8-aef7-6b253002fbcf None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:18.618612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-55f65012-3a63-44d8-aef7-6b253002fbcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:18.624270 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1341/2662] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:18.635114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4132612-8cf1-4136-9d8e-7eb09c34775a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:18.635114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4132612-8cf1-4136-9d8e-7eb09c34775a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:18.635114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4132612-8cf1-4136-9d8e-7eb09c34775a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:18.636006 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1322/2663] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:18.637282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f65012-3a63-44d8-aef7-6b253002fbcf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:18.649269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f65012-3a63-44d8-aef7-6b253002fbcf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:18.656736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a48529-56e6-4a1e-928c-1535749f6a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:18.658448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a48529-56e6-4a1e-928c-1535749f6a08 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:18.658950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a48529-56e6-4a1e-928c-1535749f6a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:18.659606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a48529-56e6-4a1e-928c-1535749f6a08 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:18.660661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a48529-56e6-4a1e-928c-1535749f6a08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:57:18.661317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a48529-56e6-4a1e-928c-1535749f6a08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:18.663497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a48529-56e6-4a1e-928c-1535749f6a08 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:18.685369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d4132612-8cf1-4136-9d8e-7eb09c34775a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:18.686627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d4132612-8cf1-4136-9d8e-7eb09c34775a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:18.699089 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1323/2664] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:57:18.705057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a48529-56e6-4a1e-928c-1535749f6a08 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:18.717624 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1342/2665] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:57:18.725459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4132612-8cf1-4136-9d8e-7eb09c34775a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:18.734420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a48529-56e6-4a1e-928c-1535749f6a08 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:18.748240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4132612-8cf1-4136-9d8e-7eb09c34775a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:18.756423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc11d3-f791-4edf-8841-9b5ab8daedc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:18.757573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc11d3-f791-4edf-8841-9b5ab8daedc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:18.758065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc11d3-f791-4edf-8841-9b5ab8daedc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:18.758540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bc11d3-f791-4edf-8841-9b5ab8daedc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:18.759403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc11d3-f791-4edf-8841-9b5ab8daedc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:18.761350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e4689-b418-472d-828e-d7872ac1aeb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:18.761496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bc11d3-f791-4edf-8841-9b5ab8daedc1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:18.761974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e4689-b418-472d-828e-d7872ac1aeb3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:18.762255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e4689-b418-472d-828e-d7872ac1aeb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:18.762526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e4689-b418-472d-828e-d7872ac1aeb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:18.763177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e4689-b418-472d-828e-d7872ac1aeb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:57:18.763477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e4689-b418-472d-828e-d7872ac1aeb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:18.765086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e4689-b418-472d-828e-d7872ac1aeb3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:18.829094 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1343/2666] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:57:18.830744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e4689-b418-472d-828e-d7872ac1aeb3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:18.852066 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1324/2667] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:57:18 2022] POST /identity/v3/projects => generated 381 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:18.853020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc11d3-f791-4edf-8841-9b5ab8daedc1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:18.859275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e4689-b418-472d-828e-d7872ac1aeb3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:18.971517 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:19.030815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1df9-b78b-4605-82de-2e76bfb4a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.031491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1df9-b78b-4605-82de-2e76bfb4a756 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.031760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1df9-b78b-4605-82de-2e76bfb4a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.032039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579b1df9-b78b-4605-82de-2e76bfb4a756 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.032678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b1df9-b78b-4605-82de-2e76bfb4a756 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:19.035955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579b1df9-b78b-4605-82de-2e76bfb4a756 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:19.064635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bc11d3-f791-4edf-8841-9b5ab8daedc1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:19.071393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933b821-3beb-4500-bfd8-3e9c1cffde09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.073537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933b821-3beb-4500-bfd8-3e9c1cffde09 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.074424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933b821-3beb-4500-bfd8-3e9c1cffde09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.074813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1933b821-3beb-4500-bfd8-3e9c1cffde09 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.076033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933b821-3beb-4500-bfd8-3e9c1cffde09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:19.078716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1933b821-3beb-4500-bfd8-3e9c1cffde09 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:19.157480 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1344/2668] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:57:18 2022] POST /identity/v3/projects => generated 401 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:19.159167 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1325/2669] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:57:18 2022] POST /identity/v3/users => generated 291 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:19.161158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1df9-b78b-4605-82de-2e76bfb4a756 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:19.167970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933b821-3beb-4500-bfd8-3e9c1cffde09 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:19.196701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1933b821-3beb-4500-bfd8-3e9c1cffde09 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:19.287963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579b1df9-b78b-4605-82de-2e76bfb4a756 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:19.293711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c39d27-a344-4f39-8d88-a6fbedaa36b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.294334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c39d27-a344-4f39-8d88-a6fbedaa36b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.294611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c39d27-a344-4f39-8d88-a6fbedaa36b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.294882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c39d27-a344-4f39-8d88-a6fbedaa36b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.295529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c39d27-a344-4f39-8d88-a6fbedaa36b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:19.297162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c39d27-a344-4f39-8d88-a6fbedaa36b2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:19.309001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1345/2670] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:57:19.310281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a89b-6df0-49ff-9fd2-73c0af522148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.311805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a89b-6df0-49ff-9fd2-73c0af522148 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.312400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a89b-6df0-49ff-9fd2-73c0af522148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.312747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c39d27-a344-4f39-8d88-a6fbedaa36b2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:19.312996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554a89b-6df0-49ff-9fd2-73c0af522148 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.314396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554a89b-6df0-49ff-9fd2-73c0af522148 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:19.318744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554a89b-6df0-49ff-9fd2-73c0af522148 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:19.334685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c39d27-a344-4f39-8d88-a6fbedaa36b2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:19.340809 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:19.347193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94d75a-428b-412f-a46b-fb297cebdf30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.347859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94d75a-428b-412f-a46b-fb297cebdf30 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.348098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94d75a-428b-412f-a46b-fb297cebdf30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.348368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc94d75a-428b-412f-a46b-fb297cebdf30 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.349013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94d75a-428b-412f-a46b-fb297cebdf30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:19.351259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc94d75a-428b-412f-a46b-fb297cebdf30 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:19.354366 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1326/2671] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:57:19 2022] POST /identity/v3/users => generated 301 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:19.358440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a89b-6df0-49ff-9fd2-73c0af522148 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:19.371953 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1346/2672] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:19.373712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554a89b-6df0-49ff-9fd2-73c0af522148 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:19.377095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94d75a-428b-412f-a46b-fb297cebdf30 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:19.381805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dfe55-ef49-4234-8b64-73cd60faee42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.382781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dfe55-ef49-4234-8b64-73cd60faee42 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.383228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dfe55-ef49-4234-8b64-73cd60faee42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.383684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310dfe55-ef49-4234-8b64-73cd60faee42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.385045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dfe55-ef49-4234-8b64-73cd60faee42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:19.388363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310dfe55-ef49-4234-8b64-73cd60faee42 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:19.397277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc94d75a-428b-412f-a46b-fb297cebdf30 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:19.408643 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1327/2673] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:19.409625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51b079-1ed5-4153-949d-e9ce64be0148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.410311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51b079-1ed5-4153-949d-e9ce64be0148 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.410679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51b079-1ed5-4153-949d-e9ce64be0148 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.410962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51b079-1ed5-4153-949d-e9ce64be0148 admin admin] PATH_INFO: `/v3/projects/c229d0d4780449dd9b751ffb8b1b734d/users/9f3fa66a009149e8b5cec58e4b24a788/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.415053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dfe55-ef49-4234-8b64-73cd60faee42 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:19.428932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310dfe55-ef49-4234-8b64-73cd60faee42 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:19.436405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686fdea-e910-41e6-8034-419c9e7cd14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.437567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686fdea-e910-41e6-8034-419c9e7cd14f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.438037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686fdea-e910-41e6-8034-419c9e7cd14f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.438406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a686fdea-e910-41e6-8034-419c9e7cd14f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.439261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686fdea-e910-41e6-8034-419c9e7cd14f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:19.440979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a686fdea-e910-41e6-8034-419c9e7cd14f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:19.449760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51b079-1ed5-4153-949d-e9ce64be0148 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c229d0d4780449dd9b751ffb8b1b734d, user_id=9f3fa66a009149e8b5cec58e4b24a788, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:19.454509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be51b079-1ed5-4153-949d-e9ce64be0148 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:19.459931 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1328/2674] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:19.464708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686fdea-e910-41e6-8034-419c9e7cd14f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:19.490201 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1347/2675] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:57:19 2022] PUT /identity/v3/projects/c229d0d4780449dd9b751ffb8b1b734d/users/9f3fa66a009149e8b5cec58e4b24a788/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:57:19.495827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2a9e-baf3-43f1-baf5-5578e1fb8a28 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.496118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2a9e-baf3-43f1-baf5-5578e1fb8a28 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.496395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fe2a9e-baf3-43f1-baf5-5578e1fb8a28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.519641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a686fdea-e910-41e6-8034-419c9e7cd14f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:19.543113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a7fe2a9e-baf3-43f1-baf5-5578e1fb8a28 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:19.544256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7fe2a9e-baf3-43f1-baf5-5578e1fb8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:19.649514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b5d30-17fb-4ed0-aea8-a05af620fa3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.650991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b5d30-17fb-4ed0-aea8-a05af620fa3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.651719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b5d30-17fb-4ed0-aea8-a05af620fa3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.652798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b5d30-17fb-4ed0-aea8-a05af620fa3d admin admin] PATH_INFO: `/v3/projects/b444615dfc8f436db3a7310a43ca6622/users/b3795b2dee9a4ef29f6f218c4a251876/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.671840 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1348/2676] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:19.696387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2a9e-baf3-43f1-baf5-5578e1fb8a28 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:19.698991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7fe2a9e-baf3-43f1-baf5-5578e1fb8a28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:19.702065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b5d30-17fb-4ed0-aea8-a05af620fa3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b444615dfc8f436db3a7310a43ca6622, user_id=b3795b2dee9a4ef29f6f218c4a251876, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:19.710032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b5d30-17fb-4ed0-aea8-a05af620fa3d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:19.752494 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1329/2677] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:57:19 2022] PUT /identity/v3/projects/b444615dfc8f436db3a7310a43ca6622/users/b3795b2dee9a4ef29f6f218c4a251876/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:57:19.755839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753923-03f9-403e-acfc-2e3677f615c6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.761883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753923-03f9-403e-acfc-2e3677f615c6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.762902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753923-03f9-403e-acfc-2e3677f615c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.792194 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:19.806091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-16753923-03f9-403e-acfc-2e3677f615c6 None None] MFA Rules not processed for user `b9785b058f4849e28c1fe25af094bef5`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:19.807866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16753923-03f9-403e-acfc-2e3677f615c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:19.862702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fe2a9e-baf3-43f1-baf5-5578e1fb8a28 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:19.892197 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1330/2678] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:19.893905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdf532-778e-4441-af79-6e18160e1ea3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.894291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdf532-778e-4441-af79-6e18160e1ea3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.894671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abdf532-778e-4441-af79-6e18160e1ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.933483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaa8d6-2b47-4083-b9d2-0bdf52bb05d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:19.934448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa8d6-2b47-4083-b9d2-0bdf52bb05d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:19.934896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa8d6-2b47-4083-b9d2-0bdf52bb05d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:19.935322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04eaa8d6-2b47-4083-b9d2-0bdf52bb05d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:19.983197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8abdf532-778e-4441-af79-6e18160e1ea3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:19.984597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8abdf532-778e-4441-af79-6e18160e1ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:20.073510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaa8d6-2b47-4083-b9d2-0bdf52bb05d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:20.075192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04eaa8d6-2b47-4083-b9d2-0bdf52bb05d4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:20.089802 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1349/2679] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:20.122709 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1331/2680] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:20.140347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaa8d6-2b47-4083-b9d2-0bdf52bb05d4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:20.142111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-04eaa8d6-2b47-4083-b9d2-0bdf52bb05d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:20.159558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04eaa8d6-2b47-4083-b9d2-0bdf52bb05d4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:20.169825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaefd4a5-99cd-4dc7-ac13-37e60d7998b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:20.172509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefd4a5-99cd-4dc7-ac13-37e60d7998b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:20.173086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefd4a5-99cd-4dc7-ac13-37e60d7998b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:20.174226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaefd4a5-99cd-4dc7-ac13-37e60d7998b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:20.192064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefd4a5-99cd-4dc7-ac13-37e60d7998b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:20.194431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaefd4a5-99cd-4dc7-ac13-37e60d7998b5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:20.217080 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1350/2681] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:21.809835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdf532-778e-4441-af79-6e18160e1ea3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:21.812076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8abdf532-778e-4441-af79-6e18160e1ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:21.827972 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:21.985774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abdf532-778e-4441-af79-6e18160e1ea3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:21.999944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:22.000575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:22.000857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:22.001130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:22.004400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:22.141937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:22.143849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:22.168773 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1332/2682] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:30.205233 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=66 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:32.090823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c2e8-c340-428d-a158-c5592d582f79 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:32.091423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c2e8-c340-428d-a158-c5592d582f79 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:32.091423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1047c2e8-c340-428d-a158-c5592d582f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:32.157651 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=56 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:32.201566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1047c2e8-c340-428d-a158-c5592d582f79 None None] MFA Rules not processed for user `b3795b2dee9a4ef29f6f218c4a251876`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:32.207189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1047c2e8-c340-428d-a158-c5592d582f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:32.402338 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1351/2683] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:32 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:33.662343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:33.663912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:33.725927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce26e61-9c98-4173-8b6a-592451a7198d service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:33.735242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29372-8660-49d0-a85f-ae61598745d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:33.737041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29372-8660-49d0-a85f-ae61598745d2 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:33.738169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29372-8660-49d0-a85f-ae61598745d2 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:33.738705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd29372-8660-49d0-a85f-ae61598745d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:33.758681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd29372-8660-49d0-a85f-ae61598745d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:33.760585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd29372-8660-49d0-a85f-ae61598745d2 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:33.801587 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1333/2684] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:33 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:35.371432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba942-6ac2-4f2d-9c52-438fadcff2a0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:35.371969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba942-6ac2-4f2d-9c52-438fadcff2a0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:35.372298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85ba942-6ac2-4f2d-9c52-438fadcff2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:35.402400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b85ba942-6ac2-4f2d-9c52-438fadcff2a0 None None] MFA Rules not processed for user `9f3fa66a009149e8b5cec58e4b24a788`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:35.403623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b85ba942-6ac2-4f2d-9c52-438fadcff2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:35.482141 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1352/2685] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:35.487386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29372-8660-49d0-a85f-ae61598745d2 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:35.501064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd29372-8660-49d0-a85f-ae61598745d2 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:35.506261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768ce81-bf80-412d-bf31-543eaa5a1cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:35.507124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768ce81-bf80-412d-bf31-543eaa5a1cb1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:35.507593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768ce81-bf80-412d-bf31-543eaa5a1cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:35.507866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e768ce81-bf80-412d-bf31-543eaa5a1cb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:35.508661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768ce81-bf80-412d-bf31-543eaa5a1cb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:35.511366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e768ce81-bf80-412d-bf31-543eaa5a1cb1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:35.545350 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1334/2686] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:57:35 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:35.549221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba942-6ac2-4f2d-9c52-438fadcff2a0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:35.561663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85ba942-6ac2-4f2d-9c52-438fadcff2a0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:35.637582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851291-82d3-4440-9a22-74b98944377d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:35.638275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851291-82d3-4440-9a22-74b98944377d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:35.638567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851291-82d3-4440-9a22-74b98944377d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:35.638843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851291-82d3-4440-9a22-74b98944377d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:35.639570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e851291-82d3-4440-9a22-74b98944377d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:35.641824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e851291-82d3-4440-9a22-74b98944377d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:35.674461 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1353/2687] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:57:35 2022] POST /identity/v3/users => generated 298 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:57:35.678891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768ce81-bf80-412d-bf31-543eaa5a1cb1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:35.697814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e768ce81-bf80-412d-bf31-543eaa5a1cb1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:35.710601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a2d4e-a674-4203-bf75-66fa0883412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:35.711254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a2d4e-a674-4203-bf75-66fa0883412d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:35.711539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a2d4e-a674-4203-bf75-66fa0883412d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:35.711817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a2d4e-a674-4203-bf75-66fa0883412d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:35.713226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a2d4e-a674-4203-bf75-66fa0883412d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:35.714866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a2d4e-a674-4203-bf75-66fa0883412d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:35.738876 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1335/2688] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:35.743279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851291-82d3-4440-9a22-74b98944377d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:35.761443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851291-82d3-4440-9a22-74b98944377d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:35.773406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3336d-23b4-4692-8f7f-637ef81d0cd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:35.774231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3336d-23b4-4692-8f7f-637ef81d0cd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:35.775171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3336d-23b4-4692-8f7f-637ef81d0cd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:35.775624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd3336d-23b4-4692-8f7f-637ef81d0cd2 admin admin] PATH_INFO: `/v3/projects/50d8e630279847609d36865cdfb1bf96/users/d0ac6c6a70544337a25ab96d25156a07/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:35.790453 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:35.816036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3336d-23b4-4692-8f7f-637ef81d0cd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d8e630279847609d36865cdfb1bf96, user_id=d0ac6c6a70544337a25ab96d25156a07, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:35.819027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd3336d-23b4-4692-8f7f-637ef81d0cd2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:35.851131 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1354/2689] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:57:35 2022] PUT /identity/v3/projects/50d8e630279847609d36865cdfb1bf96/users/d0ac6c6a70544337a25ab96d25156a07/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:35.855443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a2d4e-a674-4203-bf75-66fa0883412d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:35.877797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a2d4e-a674-4203-bf75-66fa0883412d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:36.036143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2c413-76db-4551-97e4-a7d2db1faa86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:36.037168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c413-76db-4551-97e4-a7d2db1faa86 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:36.037727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c413-76db-4551-97e4-a7d2db1faa86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:36.038233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2c413-76db-4551-97e4-a7d2db1faa86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:36.040933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c413-76db-4551-97e4-a7d2db1faa86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:36.046287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2c413-76db-4551-97e4-a7d2db1faa86 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:36.081242 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1336/2690] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:35 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:36.082716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3336d-23b4-4692-8f7f-637ef81d0cd2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:36.099759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd3336d-23b4-4692-8f7f-637ef81d0cd2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:36.112801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa0177-ecc4-4091-ad9c-d2d67165db05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:36.113677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa0177-ecc4-4091-ad9c-d2d67165db05 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:36.114072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa0177-ecc4-4091-ad9c-d2d67165db05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:36.114460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa0177-ecc4-4091-ad9c-d2d67165db05 admin admin] PATH_INFO: `/v3/projects/50d8e630279847609d36865cdfb1bf96/users/d0ac6c6a70544337a25ab96d25156a07/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:36.121573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa0177-ecc4-4091-ad9c-d2d67165db05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=50d8e630279847609d36865cdfb1bf96, user_id=d0ac6c6a70544337a25ab96d25156a07, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:36.124396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa0177-ecc4-4091-ad9c-d2d67165db05 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:36.161060 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1355/2691] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:57:36 2022] PUT /identity/v3/projects/50d8e630279847609d36865cdfb1bf96/users/d0ac6c6a70544337a25ab96d25156a07/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:57:37.821454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de8194-eba6-429c-ad14-f8d2589be8a3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:37.822431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de8194-eba6-429c-ad14-f8d2589be8a3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:37.822930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de8194-eba6-429c-ad14-f8d2589be8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:37.896016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f1de8194-eba6-429c-ad14-f8d2589be8a3 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:37.901818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f1de8194-eba6-429c-ad14-f8d2589be8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:38.063668 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1337/2692] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 08:57:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:38.088158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa0177-ecc4-4091-ad9c-d2d67165db05 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:38.092666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-31fa0177-ecc4-4091-ad9c-d2d67165db05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:38.306216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa0177-ecc4-4091-ad9c-d2d67165db05 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:38.326324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6744e-d1b3-40e2-9ab3-c816a28235a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:38.326968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6744e-d1b3-40e2-9ab3-c816a28235a9 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:38.327257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6744e-d1b3-40e2-9ab3-c816a28235a9 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:38.328016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e6744e-d1b3-40e2-9ab3-c816a28235a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:38.356127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6744e-d1b3-40e2-9ab3-c816a28235a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:38.357800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e6744e-d1b3-40e2-9ab3-c816a28235a9 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:38.382682 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1356/2693] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:57:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:57:43.547315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de8194-eba6-429c-ad14-f8d2589be8a3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:43.662796 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:43.675531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de8194-eba6-429c-ad14-f8d2589be8a3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:43.684320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:43.684966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:43.687368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:43.687645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] PATH_INFO: `/v3/users/b3795b2dee9a4ef29f6f218c4a251876` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:43.689947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3795b2dee9a4ef29f6f218c4a251876)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:43.696304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:43.794816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3795b2dee9a4ef29f6f218c4a251876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:43.826280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3795b2dee9a4ef29f6f218c4a251876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:43.827061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3795b2dee9a4ef29f6f218c4a251876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:43.841238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3795b2dee9a4ef29f6f218c4a251876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:43.860055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d78f3d6-0a11-4618-bf5b-3b059b039d65 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3795b2dee9a4ef29f6f218c4a251876'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:43.873285 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1338/2694] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:57:43 2022] DELETE /identity/v3/users/b3795b2dee9a4ef29f6f218c4a251876 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:57:44.542529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6744e-d1b3-40e2-9ab3-c816a28235a9 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:44.560414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e6744e-d1b3-40e2-9ab3-c816a28235a9 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:44.685485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:44.686068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:44.686646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:44.687323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] PATH_INFO: `/v3/projects/b444615dfc8f436db3a7310a43ca6622` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:44.688693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b444615dfc8f436db3a7310a43ca6622)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:44.693224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:44.825058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b444615dfc8f436db3a7310a43ca6622', 'request_id': 'req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:44.849893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b444615dfc8f436db3a7310a43ca6622', 'request_id': 'req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:44.864314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b444615dfc8f436db3a7310a43ca6622', 'request_id': 'req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:44.890758 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:44.951125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] The token cache is being invalidate because project b444615dfc8f436db3a7310a43ca6622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:57:44.961490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:44.963615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eb0a3ea-4c36-42c9-bcb7-d49014157ba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:57:44.979767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeffef-2912-4b6f-a1b5-8824bbc8de65 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:44.980341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeffef-2912-4b6f-a1b5-8824bbc8de65 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:44.980341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06aeffef-2912-4b6f-a1b5-8824bbc8de65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:44.983837 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1357/2695] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:57:44 2022] DELETE /identity/v3/projects/b444615dfc8f436db3a7310a43ca6622 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:57:45.037484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-06aeffef-2912-4b6f-a1b5-8824bbc8de65 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:45.053406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06aeffef-2912-4b6f-a1b5-8824bbc8de65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:45.217220 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1339/2696] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:57:45.228864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcd3a3-9531-40c8-97e4-ee74570d6c6d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:45.229161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcd3a3-9531-40c8-97e4-ee74570d6c6d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:45.229493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fcd3a3-9531-40c8-97e4-ee74570d6c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:45.288606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e0fcd3a3-9531-40c8-97e4-ee74570d6c6d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:45.295677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e0fcd3a3-9531-40c8-97e4-ee74570d6c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:45.319526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeffef-2912-4b6f-a1b5-8824bbc8de65 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:45.319774 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1358/2697] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:45.337619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06aeffef-2912-4b6f-a1b5-8824bbc8de65 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:45.348992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19755a-a4a8-459c-bab1-7f92e849f5d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:45.368027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19755a-a4a8-459c-bab1-7f92e849f5d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:45.368706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19755a-a4a8-459c-bab1-7f92e849f5d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:45.369166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca19755a-a4a8-459c-bab1-7f92e849f5d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:45.370084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19755a-a4a8-459c-bab1-7f92e849f5d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:57:45.370816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19755a-a4a8-459c-bab1-7f92e849f5d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:45.372827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca19755a-a4a8-459c-bab1-7f92e849f5d7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:45.389977 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1340/2698] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:57:45.394428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcd3a3-9531-40c8-97e4-ee74570d6c6d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:45.408958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fcd3a3-9531-40c8-97e4-ee74570d6c6d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:45.416574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8d8fa-5c3d-4621-a2ac-0481c4eb6093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:45.417221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d8fa-5c3d-4621-a2ac-0481c4eb6093 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:45.417574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d8fa-5c3d-4621-a2ac-0481c4eb6093 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:45.419227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b8d8fa-5c3d-4621-a2ac-0481c4eb6093 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:45.419227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8d8fa-5c3d-4621-a2ac-0481c4eb6093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:45.420682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b8d8fa-5c3d-4621-a2ac-0481c4eb6093 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:45.457624 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1359/2699] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:57:45 2022] POST /identity/v3/projects => generated 365 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:45.461126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19755a-a4a8-459c-bab1-7f92e849f5d7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:45.479138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca19755a-a4a8-459c-bab1-7f92e849f5d7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:45.578936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11f32e-c3f1-46f4-9984-390debec3eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:45.580558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11f32e-c3f1-46f4-9984-390debec3eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:45.581168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11f32e-c3f1-46f4-9984-390debec3eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:45.582509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d11f32e-c3f1-46f4-9984-390debec3eb5 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:45.583371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11f32e-c3f1-46f4-9984-390debec3eb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:45.588934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d11f32e-c3f1-46f4-9984-390debec3eb5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:45.612837 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:45.634592 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1341/2700] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:57:45 2022] POST /identity/v3/users => generated 283 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:57:45.638150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8d8fa-5c3d-4621-a2ac-0481c4eb6093 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:45.673472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b8d8fa-5c3d-4621-a2ac-0481c4eb6093 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:45.700001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e7b09-19e5-441f-bacc-a562066a5f9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:45.701723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e7b09-19e5-441f-bacc-a562066a5f9f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:45.702434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e7b09-19e5-441f-bacc-a562066a5f9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:45.705242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1e7b09-19e5-441f-bacc-a562066a5f9f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:45.708069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e7b09-19e5-441f-bacc-a562066a5f9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:45.712651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1e7b09-19e5-441f-bacc-a562066a5f9f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:45.750728 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1360/2701] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:45.752413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11f32e-c3f1-46f4-9984-390debec3eb5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:45.787506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d11f32e-c3f1-46f4-9984-390debec3eb5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:45.823077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5fc0f0-613a-4787-978e-ee7d352a1caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:45.823716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fc0f0-613a-4787-978e-ee7d352a1caa admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:45.824472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fc0f0-613a-4787-978e-ee7d352a1caa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:45.824472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5fc0f0-613a-4787-978e-ee7d352a1caa admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:45.831068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fc0f0-613a-4787-978e-ee7d352a1caa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:45.834989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5fc0f0-613a-4787-978e-ee7d352a1caa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:45.865017 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1342/2702] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:57:45 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:57:45.872067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e7b09-19e5-441f-bacc-a562066a5f9f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:45.897055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1e7b09-19e5-441f-bacc-a562066a5f9f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:45.905800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598946b0-8331-427b-8079-98eb7f90cac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:45.907023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598946b0-8331-427b-8079-98eb7f90cac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:45.907494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598946b0-8331-427b-8079-98eb7f90cac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:45.907938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598946b0-8331-427b-8079-98eb7f90cac5 admin admin] PATH_INFO: `/v3/projects/af6b3d4f42c447a083ecf6d7b6618b92/users/ca932e5866274fc78b04689811e72746/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:45.931228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598946b0-8331-427b-8079-98eb7f90cac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6b3d4f42c447a083ecf6d7b6618b92, user_id=ca932e5866274fc78b04689811e72746, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:45.936261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598946b0-8331-427b-8079-98eb7f90cac5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:45.976703 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1361/2703] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:57:45 2022] PUT /identity/v3/projects/af6b3d4f42c447a083ecf6d7b6618b92/users/ca932e5866274fc78b04689811e72746/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:57:45.982365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5287-f690-4475-ab82-1696ce8f3f0c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:45.982902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5287-f690-4475-ab82-1696ce8f3f0c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:45.983027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ea5287-f690-4475-ab82-1696ce8f3f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:46.018719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-29ea5287-f690-4475-ab82-1696ce8f3f0c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:46.019998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-29ea5287-f690-4475-ab82-1696ce8f3f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:46.155184 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1343/2704] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:46.259880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598946b0-8331-427b-8079-98eb7f90cac5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:46.261854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-598946b0-8331-427b-8079-98eb7f90cac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:46.451586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598946b0-8331-427b-8079-98eb7f90cac5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:46.460679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02993f1d-6086-4e6a-b0f8-c82f0ff308f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:46.463506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02993f1d-6086-4e6a-b0f8-c82f0ff308f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:46.464032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02993f1d-6086-4e6a-b0f8-c82f0ff308f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:46.465186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02993f1d-6086-4e6a-b0f8-c82f0ff308f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:46.483947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02993f1d-6086-4e6a-b0f8-c82f0ff308f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:46.490484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02993f1d-6086-4e6a-b0f8-c82f0ff308f2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:46.514435 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1362/2705] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:48.673593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381f70-2cdd-45bf-9fd0-686202f6dc91 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:48.674476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381f70-2cdd-45bf-9fd0-686202f6dc91 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:48.674929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38381f70-2cdd-45bf-9fd0-686202f6dc91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:48.769671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-38381f70-2cdd-45bf-9fd0-686202f6dc91 None None] MFA Rules not processed for user `d0ac6c6a70544337a25ab96d25156a07`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:48.771194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-38381f70-2cdd-45bf-9fd0-686202f6dc91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:48.963450 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1344/2706] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:48 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:48.983553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02993f1d-6086-4e6a-b0f8-c82f0ff308f2 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:48.986236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-02993f1d-6086-4e6a-b0f8-c82f0ff308f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:49.127117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02993f1d-6086-4e6a-b0f8-c82f0ff308f2 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:49.133858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:49.134504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:49.134788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:49.135065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:49.137264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:49.173869 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:49.237445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:49.239999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:49.270784 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1363/2707] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:49.954635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e631c4b-2a93-4ff5-afa6-ac3166355156 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:49.955746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e631c4b-2a93-4ff5-afa6-ac3166355156 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:49.956241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e631c4b-2a93-4ff5-afa6-ac3166355156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:49.997052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9e631c4b-2a93-4ff5-afa6-ac3166355156 None None] MFA Rules not processed for user `0a5f0704d95640a99457ddd8652f83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:49.998804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9e631c4b-2a93-4ff5-afa6-ac3166355156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:50.166365 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1345/2708] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:52.184577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:52.186102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:52.390538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9f68f5-dac1-4194-8b6d-9a97ae664b9b service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:52.403400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e09ba92-5b77-4da8-b327-60891efa50db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:52.404039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ba92-5b77-4da8-b327-60891efa50db service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:52.404369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ba92-5b77-4da8-b327-60891efa50db service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:52.404702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e09ba92-5b77-4da8-b327-60891efa50db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:52.413963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6e09ba92-5b77-4da8-b327-60891efa50db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:52.435834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09ba92-5b77-4da8-b327-60891efa50db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:52.438008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e09ba92-5b77-4da8-b327-60891efa50db service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:52.457674 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1364/2709] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:57:52.968892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff3af-027a-4e07-965d-6894c2da247c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:52.970054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff3af-027a-4e07-965d-6894c2da247c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:52.970578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eff3af-027a-4e07-965d-6894c2da247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:53.015676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f7eff3af-027a-4e07-965d-6894c2da247c None None] MFA Rules not processed for user `0a5f0704d95640a99457ddd8652f83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:53.020192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f7eff3af-027a-4e07-965d-6894c2da247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:53.036573 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1346/2710] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:55.765745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee1710-f3aa-4aec-a080-eb5f9299a6fa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:55.766335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee1710-f3aa-4aec-a080-eb5f9299a6fa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:55.766335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faee1710-f3aa-4aec-a080-eb5f9299a6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:55.832877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-faee1710-f3aa-4aec-a080-eb5f9299a6fa None None] MFA Rules not processed for user `9f3fa66a009149e8b5cec58e4b24a788`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:57:55.833924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-faee1710-f3aa-4aec-a080-eb5f9299a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:55.864641 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1365/2711] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:57:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:57:57.962930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eff3af-027a-4e07-965d-6894c2da247c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:57:57.971532 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:57:57.981899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eff3af-027a-4e07-965d-6894c2da247c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:57:57.999384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57965492-ffc6-4bc0-a710-05460fafd023 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:57:58.000501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57965492-ffc6-4bc0-a710-05460fafd023 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:57:58.003855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57965492-ffc6-4bc0-a710-05460fafd023 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:57:58.005048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57965492-ffc6-4bc0-a710-05460fafd023 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:57:58.012043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57965492-ffc6-4bc0-a710-05460fafd023 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:57:58.050603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57965492-ffc6-4bc0-a710-05460fafd023 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:57:58.052479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57965492-ffc6-4bc0-a710-05460fafd023 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:57:58.076897 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1347/2712] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:57:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:58:00.317583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee1710-f3aa-4aec-a080-eb5f9299a6fa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:00.319967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-faee1710-f3aa-4aec-a080-eb5f9299a6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:00.348655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faee1710-f3aa-4aec-a080-eb5f9299a6fa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:00.354000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39754e87-7a9e-4830-875d-782a05e38224 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:00.356312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39754e87-7a9e-4830-875d-782a05e38224 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:00.356842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39754e87-7a9e-4830-875d-782a05e38224 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:00.357340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39754e87-7a9e-4830-875d-782a05e38224 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:00.360206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39754e87-7a9e-4830-875d-782a05e38224 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:00.513960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39754e87-7a9e-4830-875d-782a05e38224 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:00.517008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39754e87-7a9e-4830-875d-782a05e38224 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:00.557050 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1366/2713] 10.222.0.25 () {60 vars in 1396 bytes} [Mon Oct 24 08:58:00 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3274 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:58:02.514730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78c2f7-d3fa-45c4-bf1c-126f8b6b7b84 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:02.515456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78c2f7-d3fa-45c4-bf1c-126f8b6b7b84 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:02.515456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd78c2f7-d3fa-45c4-bf1c-126f8b6b7b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:02.573251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fd78c2f7-d3fa-45c4-bf1c-126f8b6b7b84 None None] MFA Rules not processed for user `ca932e5866274fc78b04689811e72746`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:02.574728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fd78c2f7-d3fa-45c4-bf1c-126f8b6b7b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:02.789458 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1348/2714] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:02.802966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2c26-d046-43e2-a034-d68f1572d39f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:02.803601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2c26-d046-43e2-a034-d68f1572d39f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:02.803967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f2c26-d046-43e2-a034-d68f1572d39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:02.843976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4e7f2c26-d046-43e2-a034-d68f1572d39f None None] MFA Rules not processed for user `ca932e5866274fc78b04689811e72746`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:02.847826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e7f2c26-d046-43e2-a034-d68f1572d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:02.865102 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1367/2715] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:02.902516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78c2f7-d3fa-45c4-bf1c-126f8b6b7b84 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:02.942151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd78c2f7-d3fa-45c4-bf1c-126f8b6b7b84 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:02.960321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392cbf-ff86-4999-bca4-bf4f56ede7cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:02.961673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392cbf-ff86-4999-bca4-bf4f56ede7cb service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:02.962634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392cbf-ff86-4999-bca4-bf4f56ede7cb service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:02.963115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392cbf-ff86-4999-bca4-bf4f56ede7cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:02.973780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392cbf-ff86-4999-bca4-bf4f56ede7cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:02.975665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392cbf-ff86-4999-bca4-bf4f56ede7cb service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:03.005139 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1349/2716] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:58:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:58:12.826855 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:12.986480 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=42 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:15.042466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f2c26-d046-43e2-a034-d68f1572d39f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:15.044718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e7f2c26-d046-43e2-a034-d68f1572d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:15.067467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f2c26-d046-43e2-a034-d68f1572d39f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:15.095381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:15.096347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:15.099533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:15.100214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] PATH_INFO: `/v3/users/83d393f7341e402a80a50b822b3f0f94` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:15.104633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=83d393f7341e402a80a50b822b3f0f94)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:15.107900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:15.219572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83d393f7341e402a80a50b822b3f0f94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.249071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83d393f7341e402a80a50b822b3f0f94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.251120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83d393f7341e402a80a50b822b3f0f94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.265802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83d393f7341e402a80a50b822b3f0f94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.286335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83d393f7341e402a80a50b822b3f0f94'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.298121 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1368/2717] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:58:15 2022] DELETE /identity/v3/users/83d393f7341e402a80a50b822b3f0f94 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:58:15.609032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392cbf-ff86-4999-bca4-bf4f56ede7cb service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:15.639570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392cbf-ff86-4999-bca4-bf4f56ede7cb service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:15.743703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:15.744785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:15.745878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:15.746392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] PATH_INFO: `/v3/projects/178ccdbda089491a92f2c97d4437433c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:15.748210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] RBAC: Authorizing `identity:delete_project(project_id=178ccdbda089491a92f2c97d4437433c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:15.750633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:15.834566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178ccdbda089491a92f2c97d4437433c', 'request_id': 'req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.843949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178ccdbda089491a92f2c97d4437433c', 'request_id': 'req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.867147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178ccdbda089491a92f2c97d4437433c', 'request_id': 'req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.881804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] The token cache is being invalidate because project 178ccdbda089491a92f2c97d4437433c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:58:15.882101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.882880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:15.884683 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1350/2718] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:15 2022] DELETE /identity/v3/projects/178ccdbda089491a92f2c97d4437433c => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:58:15.888702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:15.890488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:15.913125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76834a1d-b36c-4a59-ad13-a2c614d92b1d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:16.031137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:16.031777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:16.032118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:16.032395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] PATH_INFO: `/v3/users/af2fa719af7d407095dfeacfff248d18` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:16.033676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] RBAC: Authorizing `identity:delete_user(user_id=af2fa719af7d407095dfeacfff248d18)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:16.035740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:16.104841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af2fa719af7d407095dfeacfff248d18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.117374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af2fa719af7d407095dfeacfff248d18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.117996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af2fa719af7d407095dfeacfff248d18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.126093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af2fa719af7d407095dfeacfff248d18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.128284 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:16.135297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-716a5fee-40c9-4d05-9e67-25488c3f561a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af2fa719af7d407095dfeacfff248d18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.147568 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1369/2719] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:58:15 2022] DELETE /identity/v3/users/af2fa719af7d407095dfeacfff248d18 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:58:16.726829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:16.728923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:16.743454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dfe8e2-ef67-4d5b-ac0e-753cf820615a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:16.853917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:16.854566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:16.854852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:16.855131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] PATH_INFO: `/v3/projects/48da367ebcc5487e831262d1a17ff648` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:16.856293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=48da367ebcc5487e831262d1a17ff648)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:16.858269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:16.906893 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:16.929437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48da367ebcc5487e831262d1a17ff648', 'request_id': 'req-ca49cc5c-3914-4d99-b39f-c43fcec790bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.936405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48da367ebcc5487e831262d1a17ff648', 'request_id': 'req-ca49cc5c-3914-4d99-b39f-c43fcec790bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.945311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48da367ebcc5487e831262d1a17ff648', 'request_id': 'req-ca49cc5c-3914-4d99-b39f-c43fcec790bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.963870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] The token cache is being invalidate because project 48da367ebcc5487e831262d1a17ff648 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:58:16.964164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.964819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49cc5c-3914-4d99-b39f-c43fcec790bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:16.970127 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1351/2720] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:16 2022] DELETE /identity/v3/projects/48da367ebcc5487e831262d1a17ff648 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:58:16.971623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5a965-87f3-4a58-abf4-b23bde656f33 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:16.971913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5a965-87f3-4a58-abf4-b23bde656f33 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:16.972188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5a965-87f3-4a58-abf4-b23bde656f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.007138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-04c5a965-87f3-4a58-abf4-b23bde656f33 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:17.009192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-04c5a965-87f3-4a58-abf4-b23bde656f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:17.102598 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1370/2721] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:58:17.109886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7913-6f34-407f-9f65-ff41ba2416bd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.110169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7913-6f34-407f-9f65-ff41ba2416bd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.110448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfb7913-6f34-407f-9f65-ff41ba2416bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.145405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ebfb7913-6f34-407f-9f65-ff41ba2416bd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:17.145405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ebfb7913-6f34-407f-9f65-ff41ba2416bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:17.158353 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1352/2722] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:17.159666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5a965-87f3-4a58-abf4-b23bde656f33 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:17.170296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5a965-87f3-4a58-abf4-b23bde656f33 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:17.175419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd55c8-981a-41c3-9d50-bcc3dc831b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:17.176040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd55c8-981a-41c3-9d50-bcc3dc831b1e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.176729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd55c8-981a-41c3-9d50-bcc3dc831b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.177010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacd55c8-981a-41c3-9d50-bcc3dc831b1e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.177768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd55c8-981a-41c3-9d50-bcc3dc831b1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:58:17.178076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd55c8-981a-41c3-9d50-bcc3dc831b1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:17.180394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bacd55c8-981a-41c3-9d50-bcc3dc831b1e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:17.197345 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1371/2723] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:58:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:58:17.199115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7913-6f34-407f-9f65-ff41ba2416bd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:17.208720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfb7913-6f34-407f-9f65-ff41ba2416bd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:17.213857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ee3e-df0f-4f7f-b40a-b19c9c7851e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:17.214767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ee3e-df0f-4f7f-b40a-b19c9c7851e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.215056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ee3e-df0f-4f7f-b40a-b19c9c7851e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.215520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b7ee3e-df0f-4f7f-b40a-b19c9c7851e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.216139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ee3e-df0f-4f7f-b40a-b19c9c7851e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:17.218090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b7ee3e-df0f-4f7f-b40a-b19c9c7851e8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:17.254390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1353/2724] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:58:17 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:58:17.258679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd55c8-981a-41c3-9d50-bcc3dc831b1e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:17.269456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bacd55c8-981a-41c3-9d50-bcc3dc831b1e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:17.334869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26454c9f-aa01-4706-98c1-c652cec3a367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:17.334869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454c9f-aa01-4706-98c1-c652cec3a367 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.335187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454c9f-aa01-4706-98c1-c652cec3a367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.335518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26454c9f-aa01-4706-98c1-c652cec3a367 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.336147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26454c9f-aa01-4706-98c1-c652cec3a367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:17.338110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26454c9f-aa01-4706-98c1-c652cec3a367 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:17.362587 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1372/2725] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:58:17 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:58:17.367357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ee3e-df0f-4f7f-b40a-b19c9c7851e8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:17.378709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b7ee3e-df0f-4f7f-b40a-b19c9c7851e8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:17.383995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08bc7c-75df-496e-bfa5-c1302f0f16d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:17.384602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08bc7c-75df-496e-bfa5-c1302f0f16d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.384884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08bc7c-75df-496e-bfa5-c1302f0f16d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.385163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d08bc7c-75df-496e-bfa5-c1302f0f16d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.385853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08bc7c-75df-496e-bfa5-c1302f0f16d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:17.387488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d08bc7c-75df-496e-bfa5-c1302f0f16d3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:17.398256 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1354/2726] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:58:17.402225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26454c9f-aa01-4706-98c1-c652cec3a367 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:17.413534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26454c9f-aa01-4706-98c1-c652cec3a367 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:17.418363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07835f-bebe-4f96-a395-3ccd03759697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:17.418969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07835f-bebe-4f96-a395-3ccd03759697 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.419250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07835f-bebe-4f96-a395-3ccd03759697 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.419525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07835f-bebe-4f96-a395-3ccd03759697 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.420194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07835f-bebe-4f96-a395-3ccd03759697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:17.421877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07835f-bebe-4f96-a395-3ccd03759697 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:17.433779 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1373/2727] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:58:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:58:17.438182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08bc7c-75df-496e-bfa5-c1302f0f16d3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:17.449201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d08bc7c-75df-496e-bfa5-c1302f0f16d3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:17.454081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae4301-9ddc-4be4-8ebf-6c2b4c1ea273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:17.454748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4301-9ddc-4be4-8ebf-6c2b4c1ea273 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.455031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4301-9ddc-4be4-8ebf-6c2b4c1ea273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.455315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddae4301-9ddc-4be4-8ebf-6c2b4c1ea273 admin admin] PATH_INFO: `/v3/projects/1b649fda281a461490da66bde72b3042/users/4a156abb1c2f486388806138cc370cc6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.472101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae4301-9ddc-4be4-8ebf-6c2b4c1ea273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b649fda281a461490da66bde72b3042, user_id=4a156abb1c2f486388806138cc370cc6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:17.474850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddae4301-9ddc-4be4-8ebf-6c2b4c1ea273 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:17.495515 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1355/2728] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:58:17 2022] PUT /identity/v3/projects/1b649fda281a461490da66bde72b3042/users/4a156abb1c2f486388806138cc370cc6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:58:17.501578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93e82-c0fc-4ae4-9af7-f45a1855741d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.501966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93e82-c0fc-4ae4-9af7-f45a1855741d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.502294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c93e82-c0fc-4ae4-9af7-f45a1855741d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.524812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-75c93e82-c0fc-4ae4-9af7-f45a1855741d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:17.526214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75c93e82-c0fc-4ae4-9af7-f45a1855741d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:17.597250 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:17.610287 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1374/2729] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:17.621245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae4301-9ddc-4be4-8ebf-6c2b4c1ea273 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:17.623268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ddae4301-9ddc-4be4-8ebf-6c2b4c1ea273 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:17.695807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddae4301-9ddc-4be4-8ebf-6c2b4c1ea273 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:17.699946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9caa3972-0309-4fc5-b262-7d453d6ac1f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:17.700569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3972-0309-4fc5-b262-7d453d6ac1f6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.701082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3972-0309-4fc5-b262-7d453d6ac1f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.701082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caa3972-0309-4fc5-b262-7d453d6ac1f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.713907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3972-0309-4fc5-b262-7d453d6ac1f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:17.715598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9caa3972-0309-4fc5-b262-7d453d6ac1f6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:17.726110 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1356/2730] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:58:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:58:17.843110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709b8e0-3957-4972-9496-eeb77c57a753 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:17.843375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709b8e0-3957-4972-9496-eeb77c57a753 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:17.843687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709b8e0-3957-4972-9496-eeb77c57a753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:17.865871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d709b8e0-3957-4972-9496-eeb77c57a753 None None] MFA Rules not processed for user `cc0be0ed857d4c96b26724144e20d766`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:17.867590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d709b8e0-3957-4972-9496-eeb77c57a753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:17.986187 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1375/2731] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:20.267674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba90c16-a328-4ad4-bf5f-222143850eb6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:20.268868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba90c16-a328-4ad4-bf5f-222143850eb6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:20.269347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba90c16-a328-4ad4-bf5f-222143850eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:20.328023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9ba90c16-a328-4ad4-bf5f-222143850eb6 None None] MFA Rules not processed for user `0a5f0704d95640a99457ddd8652f83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:20.329804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9ba90c16-a328-4ad4-bf5f-222143850eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:20.478463 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1357/2732] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:27.973478 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=26 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:29.404778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a454e2-e823-477c-9126-0c2b90b5e637 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:29.405383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a454e2-e823-477c-9126-0c2b90b5e637 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:29.405500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a454e2-e823-477c-9126-0c2b90b5e637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:29.439334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-25a454e2-e823-477c-9126-0c2b90b5e637 None None] MFA Rules not processed for user `4a156abb1c2f486388806138cc370cc6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:29.441019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-25a454e2-e823-477c-9126-0c2b90b5e637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:29.648744 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1376/2733] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:29.746046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba90c16-a328-4ad4-bf5f-222143850eb6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:29.747717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9ba90c16-a328-4ad4-bf5f-222143850eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:29.756835 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:29.883628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba90c16-a328-4ad4-bf5f-222143850eb6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:29.895247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5820a-304a-425a-923c-1eaa4d5e2420 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:29.896426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5820a-304a-425a-923c-1eaa4d5e2420 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:29.896881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5820a-304a-425a-923c-1eaa4d5e2420 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:29.897836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a5820a-304a-425a-923c-1eaa4d5e2420 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:29.912098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5820a-304a-425a-923c-1eaa4d5e2420 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:29.917249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a5820a-304a-425a-923c-1eaa4d5e2420 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:29.945632 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1358/2734] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:58:29 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:58:31.039583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f1ac7-6d10-4b6c-9270-1ae75c56240f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:31.040128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f1ac7-6d10-4b6c-9270-1ae75c56240f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:31.040578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255f1ac7-6d10-4b6c-9270-1ae75c56240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:31.091637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-255f1ac7-6d10-4b6c-9270-1ae75c56240f None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:31.093539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-255f1ac7-6d10-4b6c-9270-1ae75c56240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:31.229651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1377/2735] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:58:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:31.248412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5820a-304a-425a-923c-1eaa4d5e2420 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:31.249948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-27a5820a-304a-425a-923c-1eaa4d5e2420 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:31.386271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a5820a-304a-425a-923c-1eaa4d5e2420 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:31.395270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a075f32-fd9e-443b-a632-e32844dbc08e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:31.396416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a075f32-fd9e-443b-a632-e32844dbc08e service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:31.396896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a075f32-fd9e-443b-a632-e32844dbc08e service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:31.397426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a075f32-fd9e-443b-a632-e32844dbc08e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:31.415717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a075f32-fd9e-443b-a632-e32844dbc08e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:31.417449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a075f32-fd9e-443b-a632-e32844dbc08e service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:31.431256 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1359/2736] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:58:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:58:41.220429 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=57 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:41.424257 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=64 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:48.009453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f1ac7-6d10-4b6c-9270-1ae75c56240f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:48.011701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-255f1ac7-6d10-4b6c-9270-1ae75c56240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:48.212038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255f1ac7-6d10-4b6c-9270-1ae75c56240f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:48.239346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:48.240013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:48.240305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:48.241224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] PATH_INFO: `/v3/users/b9785b058f4849e28c1fe25af094bef5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:48.253346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9785b058f4849e28c1fe25af094bef5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:48.253346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:48.411413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9785b058f4849e28c1fe25af094bef5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:48.432707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9785b058f4849e28c1fe25af094bef5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:48.434129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9785b058f4849e28c1fe25af094bef5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:48.445874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9785b058f4849e28c1fe25af094bef5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:48.456043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9785b058f4849e28c1fe25af094bef5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:48.491663 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1378/2737] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:58:48 2022] DELETE /identity/v3/users/b9785b058f4849e28c1fe25af094bef5 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:58:48.834643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a075f32-fd9e-443b-a632-e32844dbc08e service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:48.836090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3a075f32-fd9e-443b-a632-e32844dbc08e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:49.305942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a075f32-fd9e-443b-a632-e32844dbc08e service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:49.419824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:49.421274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:49.527043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebecb54-9b6a-4a7a-a20b-e5b7f17e6436 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:49.529004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebecb54-9b6a-4a7a-a20b-e5b7f17e6436 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:49.529595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebecb54-9b6a-4a7a-a20b-e5b7f17e6436 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:49.530197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebecb54-9b6a-4a7a-a20b-e5b7f17e6436 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:49.539115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aebecb54-9b6a-4a7a-a20b-e5b7f17e6436 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:49.591247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebecb54-9b6a-4a7a-a20b-e5b7f17e6436 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:49.597029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebecb54-9b6a-4a7a-a20b-e5b7f17e6436 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:49.633016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c839c4-eb61-4c80-9a68-4bf0cd15a2b4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:49.642281 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1360/2738] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:58:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 807 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:58:49.645828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:49.646572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:49.647716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:49.648814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] PATH_INFO: `/v3/projects/01d49a667f134a8283ea56977bc33572` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:49.650828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d49a667f134a8283ea56977bc33572)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:49.652968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:49.823872 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:49.842652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d49a667f134a8283ea56977bc33572', 'request_id': 'req-3ccccaf9-bb82-42c3-82ba-1f508a76abed'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:49.860612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d49a667f134a8283ea56977bc33572', 'request_id': 'req-3ccccaf9-bb82-42c3-82ba-1f508a76abed'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:49.882251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d49a667f134a8283ea56977bc33572', 'request_id': 'req-3ccccaf9-bb82-42c3-82ba-1f508a76abed'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:49.900270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] The token cache is being invalidate because project 01d49a667f134a8283ea56977bc33572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:58:49.900857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:49.901879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ccccaf9-bb82-42c3-82ba-1f508a76abed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:58:49.908378 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1379/2739] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:58:49 2022] DELETE /identity/v3/projects/01d49a667f134a8283ea56977bc33572 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:58:49.909625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc53b4-c980-466e-a913-070236a65cc3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:49.910111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc53b4-c980-466e-a913-070236a65cc3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:49.910216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc53b4-c980-466e-a913-070236a65cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:49.982063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-31fc53b4-c980-466e-a913-070236a65cc3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:49.983330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31fc53b4-c980-466e-a913-070236a65cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:50.061171 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:50.191153 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1361/2740] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:58:50.192450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682385d6-e90a-4940-8f25-74759ab4d30d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:50.195407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682385d6-e90a-4940-8f25-74759ab4d30d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:50.195820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682385d6-e90a-4940-8f25-74759ab4d30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:50.262207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-682385d6-e90a-4940-8f25-74759ab4d30d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:50.263677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-682385d6-e90a-4940-8f25-74759ab4d30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:50.273329 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1380/2741] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:50.277948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc53b4-c980-466e-a913-070236a65cc3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:50.293725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc53b4-c980-466e-a913-070236a65cc3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:50.307202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935986e-4630-4af7-97a9-c342f571a939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:50.307827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935986e-4630-4af7-97a9-c342f571a939 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:50.308106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935986e-4630-4af7-97a9-c342f571a939 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:50.308380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b935986e-4630-4af7-97a9-c342f571a939 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:50.309041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935986e-4630-4af7-97a9-c342f571a939 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:58:50.309376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935986e-4630-4af7-97a9-c342f571a939 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:50.310991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b935986e-4630-4af7-97a9-c342f571a939 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:50.343039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682385d6-e90a-4940-8f25-74759ab4d30d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:50.350708 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1362/2742] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:58:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:58:50.353171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682385d6-e90a-4940-8f25-74759ab4d30d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:50.362440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26de9-5331-4541-aec5-884f07f437c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:50.363061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26de9-5331-4541-aec5-884f07f437c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:50.363342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26de9-5331-4541-aec5-884f07f437c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:50.363617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e26de9-5331-4541-aec5-884f07f437c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:50.364756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e26de9-5331-4541-aec5-884f07f437c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:50.368202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e26de9-5331-4541-aec5-884f07f437c9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:50.450034 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1381/2743] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:58:50 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:58:50.451839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935986e-4630-4af7-97a9-c342f571a939 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:50.470326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b935986e-4630-4af7-97a9-c342f571a939 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:50.605244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d0ed-b5f2-40f2-bae1-45c81ee733f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:50.606073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d0ed-b5f2-40f2-bae1-45c81ee733f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:50.606364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d0ed-b5f2-40f2-bae1-45c81ee733f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:50.606639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876d0ed-b5f2-40f2-bae1-45c81ee733f3 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:50.607386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876d0ed-b5f2-40f2-bae1-45c81ee733f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:50.630211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876d0ed-b5f2-40f2-bae1-45c81ee733f3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:50.677671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26de9-5331-4541-aec5-884f07f437c9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:50.678644 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1363/2744] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:58:50 2022] POST /identity/v3/users => generated 295 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:58:50.696731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e26de9-5331-4541-aec5-884f07f437c9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:50.712562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbade0-0165-4205-9f81-9217b169067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:50.713623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbade0-0165-4205-9f81-9217b169067d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:50.714091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbade0-0165-4205-9f81-9217b169067d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:50.714688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbade0-0165-4205-9f81-9217b169067d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:50.715593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbade0-0165-4205-9f81-9217b169067d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:50.717428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dbade0-0165-4205-9f81-9217b169067d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:50.753753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d0ed-b5f2-40f2-bae1-45c81ee733f3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:50.754434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1382/2745] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:58:50.767615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876d0ed-b5f2-40f2-bae1-45c81ee733f3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:50.784987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c72452-91e3-4347-9de2-24c8c4fcbf06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:50.785640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72452-91e3-4347-9de2-24c8c4fcbf06 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:50.785924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72452-91e3-4347-9de2-24c8c4fcbf06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:50.786197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c72452-91e3-4347-9de2-24c8c4fcbf06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:50.786843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c72452-91e3-4347-9de2-24c8c4fcbf06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:50.789194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c72452-91e3-4347-9de2-24c8c4fcbf06 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:50.814882 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1364/2746] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:58:50 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:58:50.819383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbade0-0165-4205-9f81-9217b169067d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:50.839820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbade0-0165-4205-9f81-9217b169067d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:50.852537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc6a47-9ac2-4c83-80ba-4957b69ec386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:50.853551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6a47-9ac2-4c83-80ba-4957b69ec386 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:50.854001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6a47-9ac2-4c83-80ba-4957b69ec386 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:50.854705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fc6a47-9ac2-4c83-80ba-4957b69ec386 admin admin] PATH_INFO: `/v3/projects/3c86dafe5aca46ecac15a54389270136/users/b245555254674c8eac74a684b9da59cc/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:50.884675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc6a47-9ac2-4c83-80ba-4957b69ec386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c86dafe5aca46ecac15a54389270136, user_id=b245555254674c8eac74a684b9da59cc, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:50.887850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6fc6a47-9ac2-4c83-80ba-4957b69ec386 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:50.921655 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1383/2747] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:58:50 2022] PUT /identity/v3/projects/3c86dafe5aca46ecac15a54389270136/users/b245555254674c8eac74a684b9da59cc/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:58:50.923422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aebb3-50e4-45de-9d0e-462f8321a228 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:50.923947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aebb3-50e4-45de-9d0e-462f8321a228 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:50.923947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963aebb3-50e4-45de-9d0e-462f8321a228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:50.964153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-963aebb3-50e4-45de-9d0e-462f8321a228 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:50.965740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-963aebb3-50e4-45de-9d0e-462f8321a228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:51.100649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1365/2748] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:51.128072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc6a47-9ac2-4c83-80ba-4957b69ec386 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:51.130049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c6fc6a47-9ac2-4c83-80ba-4957b69ec386 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:51.277892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6fc6a47-9ac2-4c83-80ba-4957b69ec386 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:51.286678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094bcad7-49e8-48c1-bf71-70a26e8e9fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:51.287502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bcad7-49e8-48c1-bf71-70a26e8e9fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:51.287660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bcad7-49e8-48c1-bf71-70a26e8e9fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:51.288006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094bcad7-49e8-48c1-bf71-70a26e8e9fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:51.352962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bcad7-49e8-48c1-bf71-70a26e8e9fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:51.360445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094bcad7-49e8-48c1-bf71-70a26e8e9fd7 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:51.392945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1384/2749] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:58:53.589732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf437ba-3824-4c0c-be16-df1a597ae368 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:53.591527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf437ba-3824-4c0c-be16-df1a597ae368 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:53.591997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf437ba-3824-4c0c-be16-df1a597ae368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:53.646318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fbf437ba-3824-4c0c-be16-df1a597ae368 None None] MFA Rules not processed for user `7e709503bbff4c239491b0f109673264`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:53.654784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fbf437ba-3824-4c0c-be16-df1a597ae368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:53.713651 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:53.795483 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1366/2750] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:53 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:57.904662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45579-d37b-4798-a55c-34ccfc17c069 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:57.905998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45579-d37b-4798-a55c-34ccfc17c069 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:57.906711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c45579-d37b-4798-a55c-34ccfc17c069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:57.987242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-68c45579-d37b-4798-a55c-34ccfc17c069 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:57.989007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-68c45579-d37b-4798-a55c-34ccfc17c069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:58.124888 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1385/2751] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 08:58:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:58:58.131421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf437ba-3824-4c0c-be16-df1a597ae368 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:58.133676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fbf437ba-3824-4c0c-be16-df1a597ae368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:58.316736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf437ba-3824-4c0c-be16-df1a597ae368 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:58.325824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3783dad-298c-4b40-be30-2aa925ca0233 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:58.326758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3783dad-298c-4b40-be30-2aa925ca0233 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:58.327764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3783dad-298c-4b40-be30-2aa925ca0233 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:58.328201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3783dad-298c-4b40-be30-2aa925ca0233 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:58.344882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3783dad-298c-4b40-be30-2aa925ca0233 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:58.348397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3783dad-298c-4b40-be30-2aa925ca0233 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:58.375372 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1367/2752] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:58:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:58:59.246241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45579-d37b-4798-a55c-34ccfc17c069 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:58:59.247694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-68c45579-d37b-4798-a55c-34ccfc17c069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:59.256829 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:58:59.420529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c45579-d37b-4798-a55c-34ccfc17c069 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:58:59.434687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:58:59.435336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:59.435604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:59.435882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:59.437972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:59.464925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:58:59.467459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:58:59.492642 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1386/2753] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:58:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:58:59.691828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46b21b-8f7a-4805-84e8-1f2b6a8fb5dd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:58:59.692802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46b21b-8f7a-4805-84e8-1f2b6a8fb5dd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:58:59.693861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b46b21b-8f7a-4805-84e8-1f2b6a8fb5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:58:59.720343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3b46b21b-8f7a-4805-84e8-1f2b6a8fb5dd None None] MFA Rules not processed for user `ca932e5866274fc78b04689811e72746`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:58:59.722227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3b46b21b-8f7a-4805-84e8-1f2b6a8fb5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:58:59.826012 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1368/2754] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:58:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:00.020710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:00.023090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:00.071058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12e6618-83b3-4b6a-928e-6f23eeace216 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:00.093101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0802d6f-b03b-43b1-84ea-8f141facabe2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:00.094036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0802d6f-b03b-43b1-84ea-8f141facabe2 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:00.094567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0802d6f-b03b-43b1-84ea-8f141facabe2 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:00.095084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0802d6f-b03b-43b1-84ea-8f141facabe2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:00.097453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e0802d6f-b03b-43b1-84ea-8f141facabe2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:00.151192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0802d6f-b03b-43b1-84ea-8f141facabe2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:00.153851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0802d6f-b03b-43b1-84ea-8f141facabe2 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:00.195461 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1387/2755] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:00.445828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46b21b-8f7a-4805-84e8-1f2b6a8fb5dd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:00.448183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3b46b21b-8f7a-4805-84e8-1f2b6a8fb5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:00.475382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b46b21b-8f7a-4805-84e8-1f2b6a8fb5dd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:00.491331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:00.492623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:00.492924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:00.493209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] PATH_INFO: `/v3/users/4a156abb1c2f486388806138cc370cc6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:00.498073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a156abb1c2f486388806138cc370cc6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:00.501821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:00.629106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a156abb1c2f486388806138cc370cc6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:00.680844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a156abb1c2f486388806138cc370cc6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:00.683263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a156abb1c2f486388806138cc370cc6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:00.689810 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:00.709948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a156abb1c2f486388806138cc370cc6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:00.731046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23936227-908a-453b-9096-73dcec6cbd8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a156abb1c2f486388806138cc370cc6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:00.742668 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1369/2756] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:59:00 2022] DELETE /identity/v3/users/4a156abb1c2f486388806138cc370cc6 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:01.546209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0802d6f-b03b-43b1-84ea-8f141facabe2 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:01.566201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0802d6f-b03b-43b1-84ea-8f141facabe2 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:01.696257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:01.697081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:01.697505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:01.698167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] PATH_INFO: `/v3/projects/1b649fda281a461490da66bde72b3042` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:01.704287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b649fda281a461490da66bde72b3042)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:01.706551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:01.837543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b649fda281a461490da66bde72b3042', 'request_id': 'req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:01.853990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b649fda281a461490da66bde72b3042', 'request_id': 'req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:01.874206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b649fda281a461490da66bde72b3042', 'request_id': 'req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:01.937473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] The token cache is being invalidate because project 1b649fda281a461490da66bde72b3042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:59:01.937734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:01.939118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-84c6a1ee-f5d8-442e-9f5b-b5e849ceaae4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:01.963758 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1388/2757] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:01 2022] DELETE /identity/v3/projects/1b649fda281a461490da66bde72b3042 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:01.965447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810d03e-9685-443a-88ee-b38560c4ed45 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:01.966032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810d03e-9685-443a-88ee-b38560c4ed45 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:01.966032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810d03e-9685-443a-88ee-b38560c4ed45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:02.023680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8810d03e-9685-443a-88ee-b38560c4ed45 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:02.025362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8810d03e-9685-443a-88ee-b38560c4ed45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:02.179431 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1370/2758] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:02.187064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5351b7-1f89-4350-9d58-9ed153c89edc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:02.189816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5351b7-1f89-4350-9d58-9ed153c89edc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:02.190297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5351b7-1f89-4350-9d58-9ed153c89edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:02.258149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ff5351b7-1f89-4350-9d58-9ed153c89edc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:02.259870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff5351b7-1f89-4350-9d58-9ed153c89edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:02.274955 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1389/2759] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:59:02.276321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810d03e-9685-443a-88ee-b38560c4ed45 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:02.297934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810d03e-9685-443a-88ee-b38560c4ed45 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:02.313938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50716184-62f6-4ac4-b28d-408e8f727253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:02.314775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716184-62f6-4ac4-b28d-408e8f727253 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:02.315235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716184-62f6-4ac4-b28d-408e8f727253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:02.315672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50716184-62f6-4ac4-b28d-408e8f727253 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:02.316490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50716184-62f6-4ac4-b28d-408e8f727253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:59:02.316968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50716184-62f6-4ac4-b28d-408e8f727253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:02.320218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50716184-62f6-4ac4-b28d-408e8f727253 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:02.354347 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1371/2760] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:59:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:59:02.356630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5351b7-1f89-4350-9d58-9ed153c89edc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:02.366194 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:02.372829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5351b7-1f89-4350-9d58-9ed153c89edc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:02.388381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b3b01-46c0-46b4-8e8f-3974660d0225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:02.389251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b3b01-46c0-46b4-8e8f-3974660d0225 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:02.390615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b3b01-46c0-46b4-8e8f-3974660d0225 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:02.391390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95b3b01-46c0-46b4-8e8f-3974660d0225 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:02.392807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b3b01-46c0-46b4-8e8f-3974660d0225 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:02.397744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95b3b01-46c0-46b4-8e8f-3974660d0225 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:02.495637 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1390/2761] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:59:02 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:02.499967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50716184-62f6-4ac4-b28d-408e8f727253 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:02.522546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50716184-62f6-4ac4-b28d-408e8f727253 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:02.711893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aed077-6e38-4be4-8bb1-114df9aead98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:02.712933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed077-6e38-4be4-8bb1-114df9aead98 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:02.714024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed077-6e38-4be4-8bb1-114df9aead98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:02.714498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aed077-6e38-4be4-8bb1-114df9aead98 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:02.715651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aed077-6e38-4be4-8bb1-114df9aead98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:02.718706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aed077-6e38-4be4-8bb1-114df9aead98 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:02.782013 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1372/2762] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:59:02 2022] POST /identity/v3/users => generated 288 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:02.785137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b3b01-46c0-46b4-8e8f-3974660d0225 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:02.816812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95b3b01-46c0-46b4-8e8f-3974660d0225 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:02.835758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90027e-5fa8-47fd-ac4c-894947dc2af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:02.835758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90027e-5fa8-47fd-ac4c-894947dc2af2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:02.838809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90027e-5fa8-47fd-ac4c-894947dc2af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:02.839142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f90027e-5fa8-47fd-ac4c-894947dc2af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:02.839820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90027e-5fa8-47fd-ac4c-894947dc2af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:02.844323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f90027e-5fa8-47fd-ac4c-894947dc2af2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:02.903729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aed077-6e38-4be4-8bb1-114df9aead98 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:02.905092 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1391/2763] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:02.929626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aed077-6e38-4be4-8bb1-114df9aead98 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:02.948835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe54650-34cd-4c39-ba95-1fd13c9a41bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:02.953613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe54650-34cd-4c39-ba95-1fd13c9a41bb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:02.953975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe54650-34cd-4c39-ba95-1fd13c9a41bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:02.954273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe54650-34cd-4c39-ba95-1fd13c9a41bb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:02.961980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe54650-34cd-4c39-ba95-1fd13c9a41bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:02.966112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe54650-34cd-4c39-ba95-1fd13c9a41bb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:03.019710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90027e-5fa8-47fd-ac4c-894947dc2af2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:03.028977 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1373/2764] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:02 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:03.047490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f90027e-5fa8-47fd-ac4c-894947dc2af2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:03.054410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b135a52-15cb-4720-9a1b-d2ff27e10d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:03.055267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b135a52-15cb-4720-9a1b-d2ff27e10d82 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:03.055621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b135a52-15cb-4720-9a1b-d2ff27e10d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:03.055975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b135a52-15cb-4720-9a1b-d2ff27e10d82 admin admin] PATH_INFO: `/v3/projects/11b3b6dbce33484a949b672037a86f36/users/06e8633f24fd4e06b3a249c19b144604/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:03.102446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b135a52-15cb-4720-9a1b-d2ff27e10d82 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11b3b6dbce33484a949b672037a86f36, user_id=06e8633f24fd4e06b3a249c19b144604, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:03.105227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b135a52-15cb-4720-9a1b-d2ff27e10d82 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:03.134712 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1392/2765] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:59:03 2022] PUT /identity/v3/projects/11b3b6dbce33484a949b672037a86f36/users/06e8633f24fd4e06b3a249c19b144604/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:59:03.145725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439f846-73fb-4fd5-b7f3-316651dba412 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:03.146084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439f846-73fb-4fd5-b7f3-316651dba412 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:03.147053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1439f846-73fb-4fd5-b7f3-316651dba412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:03.221555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1439f846-73fb-4fd5-b7f3-316651dba412 None None] MFA Rules not processed for user `06e8633f24fd4e06b3a249c19b144604`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:03.222895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1439f846-73fb-4fd5-b7f3-316651dba412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:03.361524 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:03.436697 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1374/2766] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:03 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:03.719584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b135a52-15cb-4720-9a1b-d2ff27e10d82 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:03.722117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b135a52-15cb-4720-9a1b-d2ff27e10d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:03.903391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b135a52-15cb-4720-9a1b-d2ff27e10d82 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:03.918953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d25031-2291-44f7-b61e-04f051906add service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:03.919775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d25031-2291-44f7-b61e-04f051906add service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:03.920161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d25031-2291-44f7-b61e-04f051906add service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:03.920545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d25031-2291-44f7-b61e-04f051906add service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:03.938411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d25031-2291-44f7-b61e-04f051906add service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:03.940392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d25031-2291-44f7-b61e-04f051906add service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:03.981144 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1393/2767] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:03 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:08.581700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439f846-73fb-4fd5-b7f3-316651dba412 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:08.712517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1439f846-73fb-4fd5-b7f3-316651dba412 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:08.724778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:08.726016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:08.726806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:08.727267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] PATH_INFO: `/v3/users/06e8633f24fd4e06b3a249c19b144604` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:08.728874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06e8633f24fd4e06b3a249c19b144604)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:08.731099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:08.843011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06e8633f24fd4e06b3a249c19b144604'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:08.860772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06e8633f24fd4e06b3a249c19b144604'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:08.861711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06e8633f24fd4e06b3a249c19b144604'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:08.873572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06e8633f24fd4e06b3a249c19b144604'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:08.889317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06e8633f24fd4e06b3a249c19b144604'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:08.898229 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1375/2768] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:59:08 2022] DELETE /identity/v3/users/06e8633f24fd4e06b3a249c19b144604 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:08.902564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa45589-0375-4f55-b10f-ef65298e7f50 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:08.903557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa45589-0375-4f55-b10f-ef65298e7f50 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:08.904069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa45589-0375-4f55-b10f-ef65298e7f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:08.952103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-faa45589-0375-4f55-b10f-ef65298e7f50 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:08.956479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-faa45589-0375-4f55-b10f-ef65298e7f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:09.081520 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1394/2769] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:59:09.182816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:09.184769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:09.307500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e869db11-1e34-408f-a769-8c150bf7c7e0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:09.319476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ac13-db16-4bbe-936f-835d3bf07e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:09.320287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ac13-db16-4bbe-936f-835d3bf07e85 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:09.323536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ac13-db16-4bbe-936f-835d3bf07e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:09.324264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a58ac13-db16-4bbe-936f-835d3bf07e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:09.342263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ac13-db16-4bbe-936f-835d3bf07e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:09.343879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a58ac13-db16-4bbe-936f-835d3bf07e85 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:09.352166 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:09.363713 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1376/2770] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:10.078750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc182-70b3-4461-ab41-16ab71a1ddde None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:10.079313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc182-70b3-4461-ab41-16ab71a1ddde None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:10.079518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bc182-70b3-4461-ab41-16ab71a1ddde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:10.151514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a41bc182-70b3-4461-ab41-16ab71a1ddde None None] MFA Rules not processed for user `b245555254674c8eac74a684b9da59cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:10.152795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a41bc182-70b3-4461-ab41-16ab71a1ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:10.209687 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:10.353949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ac13-db16-4bbe-936f-835d3bf07e85 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:10.355294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a58ac13-db16-4bbe-936f-835d3bf07e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:10.390800 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1395/2771] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:10.396699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc182-70b3-4461-ab41-16ab71a1ddde None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:10.402927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a41bc182-70b3-4461-ab41-16ab71a1ddde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:10.407136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a58ac13-db16-4bbe-936f-835d3bf07e85 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:10.421692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:10.422416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:10.422765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:10.423141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] PATH_INFO: `/v3/projects/11b3b6dbce33484a949b672037a86f36` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:10.426940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] RBAC: Authorizing `identity:delete_project(project_id=11b3b6dbce33484a949b672037a86f36)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:10.443791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:10.459360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bc182-70b3-4461-ab41-16ab71a1ddde None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:10.477307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61534c8-319f-47ac-906e-6a6f051a665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:10.480868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61534c8-319f-47ac-906e-6a6f051a665a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:10.481233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61534c8-319f-47ac-906e-6a6f051a665a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:10.482537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61534c8-319f-47ac-906e-6a6f051a665a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:10.486350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61534c8-319f-47ac-906e-6a6f051a665a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:10.492827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61534c8-319f-47ac-906e-6a6f051a665a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:10.594346 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1396/2772] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:59:10 2022] POST /identity/v3/projects => generated 387 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:10.600153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61534c8-319f-47ac-906e-6a6f051a665a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:10.637001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11b3b6dbce33484a949b672037a86f36', 'request_id': 'req-bedeb405-efb2-43b3-aabb-122df100135a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:10.682753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11b3b6dbce33484a949b672037a86f36', 'request_id': 'req-bedeb405-efb2-43b3-aabb-122df100135a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:10.700287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11b3b6dbce33484a949b672037a86f36', 'request_id': 'req-bedeb405-efb2-43b3-aabb-122df100135a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:10.736174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] The token cache is being invalidate because project 11b3b6dbce33484a949b672037a86f36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:59:10.736922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:10.738919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bedeb405-efb2-43b3-aabb-122df100135a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:10.744124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1377/2773] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:10 2022] DELETE /identity/v3/projects/11b3b6dbce33484a949b672037a86f36 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:59:10.749122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6279b6-d373-490c-9d0e-efdf5395f025 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:10.750276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6279b6-d373-490c-9d0e-efdf5395f025 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:10.750724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6279b6-d373-490c-9d0e-efdf5395f025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:10.800437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7e6279b6-d373-490c-9d0e-efdf5395f025 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:10.801719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e6279b6-d373-490c-9d0e-efdf5395f025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:10.852182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61534c8-319f-47ac-906e-6a6f051a665a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:10.865932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e20f8-0eac-4ec3-9d97-2f50b2be6689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:10.868309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e20f8-0eac-4ec3-9d97-2f50b2be6689 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:10.868309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e20f8-0eac-4ec3-9d97-2f50b2be6689 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:10.870268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6e20f8-0eac-4ec3-9d97-2f50b2be6689 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:10.871146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e20f8-0eac-4ec3-9d97-2f50b2be6689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:10.877105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6e20f8-0eac-4ec3-9d97-2f50b2be6689 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:10.939463 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1378/2774] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:10.950079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4f8f9-9ba4-4969-9d24-6362d18c0073 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:10.950722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4f8f9-9ba4-4969-9d24-6362d18c0073 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:10.951267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d4f8f9-9ba4-4969-9d24-6362d18c0073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:10.976824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-31d4f8f9-9ba4-4969-9d24-6362d18c0073 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:10.979352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31d4f8f9-9ba4-4969-9d24-6362d18c0073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:10.991194 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1397/2775] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:59:10 2022] POST /identity/v3/users => generated 300 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:10.993089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e20f8-0eac-4ec3-9d97-2f50b2be6689 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:11.001271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff6e20f8-0eac-4ec3-9d97-2f50b2be6689 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:11.007165 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1379/2776] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:11.013236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4f8f9-9ba4-4969-9d24-6362d18c0073 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:11.040535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6e20f8-0eac-4ec3-9d97-2f50b2be6689 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:11.063661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92111752-a45c-407b-a16b-34f30e538db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:11.064298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92111752-a45c-407b-a16b-34f30e538db3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:11.064582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92111752-a45c-407b-a16b-34f30e538db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:11.064860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92111752-a45c-407b-a16b-34f30e538db3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:11.065542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92111752-a45c-407b-a16b-34f30e538db3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:11.067172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d4f8f9-9ba4-4969-9d24-6362d18c0073 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:11.072765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92111752-a45c-407b-a16b-34f30e538db3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:11.086138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235c3f3-45d8-40de-a9fa-aeb05bcc0b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:11.088628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235c3f3-45d8-40de-a9fa-aeb05bcc0b3b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:11.088941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235c3f3-45d8-40de-a9fa-aeb05bcc0b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:11.089219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c235c3f3-45d8-40de-a9fa-aeb05bcc0b3b admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:11.094158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235c3f3-45d8-40de-a9fa-aeb05bcc0b3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:59:11.096053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235c3f3-45d8-40de-a9fa-aeb05bcc0b3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:11.098614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c235c3f3-45d8-40de-a9fa-aeb05bcc0b3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:11.115574 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1398/2777] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:10 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:11.119245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92111752-a45c-407b-a16b-34f30e538db3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:11.140234 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1380/2778] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:59:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:59:11.143908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92111752-a45c-407b-a16b-34f30e538db3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:11.144562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235c3f3-45d8-40de-a9fa-aeb05bcc0b3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:11.157839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658947f6-3a9e-45ec-b50e-d93248a99ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:11.159036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658947f6-3a9e-45ec-b50e-d93248a99ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:11.159602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658947f6-3a9e-45ec-b50e-d93248a99ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:11.160102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658947f6-3a9e-45ec-b50e-d93248a99ebd admin admin] PATH_INFO: `/v3/projects/a11faf4fdc2e47faab6c0f0b0df5858c/users/72840d50401e45fca15c0a521b6a1ea6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:11.175819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c235c3f3-45d8-40de-a9fa-aeb05bcc0b3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:11.189124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b2f8-f0e4-4a32-9425-bd15c32ee1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:11.189787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b2f8-f0e4-4a32-9425-bd15c32ee1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:11.190248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b2f8-f0e4-4a32-9425-bd15c32ee1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:11.190619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b2f8-f0e4-4a32-9425-bd15c32ee1c5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:11.191470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b2f8-f0e4-4a32-9425-bd15c32ee1c5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:11.197742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b2f8-f0e4-4a32-9425-bd15c32ee1c5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:11.201791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658947f6-3a9e-45ec-b50e-d93248a99ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11faf4fdc2e47faab6c0f0b0df5858c, user_id=72840d50401e45fca15c0a521b6a1ea6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:11.207325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658947f6-3a9e-45ec-b50e-d93248a99ebd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:11.238664 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1399/2779] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:59:11 2022] PUT /identity/v3/projects/a11faf4fdc2e47faab6c0f0b0df5858c/users/72840d50401e45fca15c0a521b6a1ea6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:59:11.244646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658947f6-3a9e-45ec-b50e-d93248a99ebd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:11.270306 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1381/2780] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:59:11 2022] POST /identity/v3/projects => generated 395 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:11.271419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b2f8-f0e4-4a32-9425-bd15c32ee1c5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:11.348418 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:11.359964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658947f6-3a9e-45ec-b50e-d93248a99ebd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:11.393589 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:11.502284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b2f8-f0e4-4a32-9425-bd15c32ee1c5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:11.524843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a82035-6862-4791-9482-09eeec84aac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:11.534146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a82035-6862-4791-9482-09eeec84aac5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:11.534739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a82035-6862-4791-9482-09eeec84aac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:11.535202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a82035-6862-4791-9482-09eeec84aac5 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:11.536040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a82035-6862-4791-9482-09eeec84aac5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:11.540541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a82035-6862-4791-9482-09eeec84aac5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:11.550074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef370e4b-9706-4045-b0c6-e805189bbee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:11.550880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef370e4b-9706-4045-b0c6-e805189bbee8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:11.551308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef370e4b-9706-4045-b0c6-e805189bbee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:11.551824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef370e4b-9706-4045-b0c6-e805189bbee8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:11.552910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef370e4b-9706-4045-b0c6-e805189bbee8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:11.556327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef370e4b-9706-4045-b0c6-e805189bbee8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:11.592981 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1400/2781] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:11.597960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef370e4b-9706-4045-b0c6-e805189bbee8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:11.627223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef370e4b-9706-4045-b0c6-e805189bbee8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:11.642542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c3e79-4e44-4f7d-9de3-631540fbc754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:11.645242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3e79-4e44-4f7d-9de3-631540fbc754 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:11.645950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3e79-4e44-4f7d-9de3-631540fbc754 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:11.647837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26c3e79-4e44-4f7d-9de3-631540fbc754 admin admin] PATH_INFO: `/v3/projects/a11faf4fdc2e47faab6c0f0b0df5858c/users/72840d50401e45fca15c0a521b6a1ea6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:11.655391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c3e79-4e44-4f7d-9de3-631540fbc754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a11faf4fdc2e47faab6c0f0b0df5858c, user_id=72840d50401e45fca15c0a521b6a1ea6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:11.663296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26c3e79-4e44-4f7d-9de3-631540fbc754 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:11.676193 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1382/2782] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:59:11 2022] POST /identity/v3/users => generated 298 bytes in 405 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:11.680543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a82035-6862-4791-9482-09eeec84aac5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:11.698452 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1401/2783] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:59:11 2022] PUT /identity/v3/projects/a11faf4fdc2e47faab6c0f0b0df5858c/users/72840d50401e45fca15c0a521b6a1ea6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:11.718221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a82035-6862-4791-9482-09eeec84aac5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:11.899017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6b5b5-8989-41c7-b7d1-d9040e4c4dc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:11.899944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6b5b5-8989-41c7-b7d1-d9040e4c4dc5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:11.900955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6b5b5-8989-41c7-b7d1-d9040e4c4dc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:11.901594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6b5b5-8989-41c7-b7d1-d9040e4c4dc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:11.902627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6b5b5-8989-41c7-b7d1-d9040e4c4dc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:11.914685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6b5b5-8989-41c7-b7d1-d9040e4c4dc5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:11.944123 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1383/2784] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:11.948432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c3e79-4e44-4f7d-9de3-631540fbc754 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:11.973228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26c3e79-4e44-4f7d-9de3-631540fbc754 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:11.991675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8423a-3e20-43e8-8cf6-d2f4e21f481c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:11.993509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8423a-3e20-43e8-8cf6-d2f4e21f481c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:11.994224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8423a-3e20-43e8-8cf6-d2f4e21f481c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:11.994755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8423a-3e20-43e8-8cf6-d2f4e21f481c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:11.996404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8423a-3e20-43e8-8cf6-d2f4e21f481c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:11.998374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a8423a-3e20-43e8-8cf6-d2f4e21f481c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:12.016768 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1402/2785] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:11 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:12.017034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6b5b5-8989-41c7-b7d1-d9040e4c4dc5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:12.035014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6b5b5-8989-41c7-b7d1-d9040e4c4dc5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:12.042712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a91e8e-1a70-4757-949e-8cd5e91d1a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:12.043937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a91e8e-1a70-4757-949e-8cd5e91d1a6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:12.043937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a91e8e-1a70-4757-949e-8cd5e91d1a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:12.044173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a91e8e-1a70-4757-949e-8cd5e91d1a6e admin admin] PATH_INFO: `/v3/projects/6d9720b209c74e2a884fb61f8a44ab3e/users/9f4cab290a6c4c5abe2e096fde3f2653/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:12.062772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a91e8e-1a70-4757-949e-8cd5e91d1a6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d9720b209c74e2a884fb61f8a44ab3e, user_id=9f4cab290a6c4c5abe2e096fde3f2653, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:12.065468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a91e8e-1a70-4757-949e-8cd5e91d1a6e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:12.085716 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1384/2786] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:59:12 2022] PUT /identity/v3/projects/6d9720b209c74e2a884fb61f8a44ab3e/users/9f4cab290a6c4c5abe2e096fde3f2653/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:59:12.098759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9b4f-86dc-4f5d-8ac6-04738eeac511 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:12.099752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9b4f-86dc-4f5d-8ac6-04738eeac511 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:12.100229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9b4f-86dc-4f5d-8ac6-04738eeac511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:12.168972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0d1a9b4f-86dc-4f5d-8ac6-04738eeac511 None None] MFA Rules not processed for user `9f4cab290a6c4c5abe2e096fde3f2653`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:12.171758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d1a9b4f-86dc-4f5d-8ac6-04738eeac511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:12.314273 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1403/2787] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:12.882203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a91e8e-1a70-4757-949e-8cd5e91d1a6e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:12.884220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-27a91e8e-1a70-4757-949e-8cd5e91d1a6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:13.061866 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:13.143774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a91e8e-1a70-4757-949e-8cd5e91d1a6e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:13.170854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6cb5-db9a-46fb-8cd5-72b6df309db3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:13.171620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6cb5-db9a-46fb-8cd5-72b6df309db3 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:13.171997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6cb5-db9a-46fb-8cd5-72b6df309db3 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:13.172388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425a6cb5-db9a-46fb-8cd5-72b6df309db3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:13.182748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a6cb5-db9a-46fb-8cd5-72b6df309db3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:13.184731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425a6cb5-db9a-46fb-8cd5-72b6df309db3 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:13.195927 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1385/2788] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:12 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:13.270150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b20ea-4884-4bb8-a35a-8f3228a4933b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:13.270150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b20ea-4884-4bb8-a35a-8f3228a4933b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:13.270769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45b20ea-4884-4bb8-a35a-8f3228a4933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:13.322964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b45b20ea-4884-4bb8-a35a-8f3228a4933b None None] MFA Rules not processed for user `9f4cab290a6c4c5abe2e096fde3f2653`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:13.324246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b45b20ea-4884-4bb8-a35a-8f3228a4933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:13.333030 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1404/2789] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:13 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:14.458111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6cb5-db9a-46fb-8cd5-72b6df309db3 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:14.646865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425a6cb5-db9a-46fb-8cd5-72b6df309db3 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:14.662655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:14.663632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:14.664098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:14.664548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] PATH_INFO: `/v3/users/9f4cab290a6c4c5abe2e096fde3f2653` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:14.666057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f4cab290a6c4c5abe2e096fde3f2653)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:14.668179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:14.765905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f4cab290a6c4c5abe2e096fde3f2653'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:14.798348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f4cab290a6c4c5abe2e096fde3f2653'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:14.799366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f4cab290a6c4c5abe2e096fde3f2653'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:14.832791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f4cab290a6c4c5abe2e096fde3f2653'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:14.859956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f4cab290a6c4c5abe2e096fde3f2653'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:14.887045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1386/2790] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:59:14 2022] DELETE /identity/v3/users/9f4cab290a6c4c5abe2e096fde3f2653 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:14.888787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dae53-f6df-4af1-b630-5c6ee6773918 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:14.889634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dae53-f6df-4af1-b630-5c6ee6773918 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:14.890164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83dae53-f6df-4af1-b630-5c6ee6773918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:14.956952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c83dae53-f6df-4af1-b630-5c6ee6773918 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:14.959783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c83dae53-f6df-4af1-b630-5c6ee6773918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:15.113237 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:15.165440 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1405/2791] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:59:15.186092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:15.188094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:15.402403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac93bfa0-b8e8-402f-b762-d002a59e7168 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:15.410625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0731578-a7b2-408d-9584-dc6b913621fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:15.411248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731578-a7b2-408d-9584-dc6b913621fd service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:15.411776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731578-a7b2-408d-9584-dc6b913621fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:15.412170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0731578-a7b2-408d-9584-dc6b913621fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:15.440210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731578-a7b2-408d-9584-dc6b913621fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:15.441822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0731578-a7b2-408d-9584-dc6b913621fd service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:15.463049 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:15.483431 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1387/2792] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:16.557550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dae53-f6df-4af1-b630-5c6ee6773918 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:16.559906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c83dae53-f6df-4af1-b630-5c6ee6773918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:16.596789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83dae53-f6df-4af1-b630-5c6ee6773918 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:16.615975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:16.616781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:16.617224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:16.617637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] PATH_INFO: `/v3/projects/6d9720b209c74e2a884fb61f8a44ab3e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:16.619078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d9720b209c74e2a884fb61f8a44ab3e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:16.621650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:16.713352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d9720b209c74e2a884fb61f8a44ab3e', 'request_id': 'req-0e2654ba-81c4-4365-bdc5-46fce017742b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:16.725731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d9720b209c74e2a884fb61f8a44ab3e', 'request_id': 'req-0e2654ba-81c4-4365-bdc5-46fce017742b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:16.734181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d9720b209c74e2a884fb61f8a44ab3e', 'request_id': 'req-0e2654ba-81c4-4365-bdc5-46fce017742b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:16.751730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] The token cache is being invalidate because project 6d9720b209c74e2a884fb61f8a44ab3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:59:16.751730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:16.752036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e2654ba-81c4-4365-bdc5-46fce017742b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:16.753804 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1406/2793] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:16 2022] DELETE /identity/v3/projects/6d9720b209c74e2a884fb61f8a44ab3e => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:16.759487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2df18-e12a-430b-8ab4-ce3b85c889af None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:16.759996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2df18-e12a-430b-8ab4-ce3b85c889af None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:16.760101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd2df18-e12a-430b-8ab4-ce3b85c889af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:16.829980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ebd2df18-e12a-430b-8ab4-ce3b85c889af None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:16.831286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ebd2df18-e12a-430b-8ab4-ce3b85c889af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:17.006580 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1388/2794] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:17.015566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef9d9a-9f7b-43f1-afd8-90b8cdfd9877 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:17.016158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef9d9a-9f7b-43f1-afd8-90b8cdfd9877 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:17.016578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ef9d9a-9f7b-43f1-afd8-90b8cdfd9877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:17.050773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c5ef9d9a-9f7b-43f1-afd8-90b8cdfd9877 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:17.053913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c5ef9d9a-9f7b-43f1-afd8-90b8cdfd9877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:17.067957 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1407/2795] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:17.070878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2df18-e12a-430b-8ab4-ce3b85c889af None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:17.087549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd2df18-e12a-430b-8ab4-ce3b85c889af None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:17.114052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870e6a-215c-4271-85a3-77eda608817a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:17.115732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870e6a-215c-4271-85a3-77eda608817a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:17.123156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870e6a-215c-4271-85a3-77eda608817a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:17.123719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e870e6a-215c-4271-85a3-77eda608817a admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:17.124616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870e6a-215c-4271-85a3-77eda608817a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:59:17.125141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870e6a-215c-4271-85a3-77eda608817a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:17.127135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e870e6a-215c-4271-85a3-77eda608817a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:17.156643 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1389/2796] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:59:17.159638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef9d9a-9f7b-43f1-afd8-90b8cdfd9877 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:17.171506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ef9d9a-9f7b-43f1-afd8-90b8cdfd9877 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:17.182277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432f773-8096-4aa1-8f09-8ea4728b88dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:17.183016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432f773-8096-4aa1-8f09-8ea4728b88dc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:17.183373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432f773-8096-4aa1-8f09-8ea4728b88dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:17.183724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7432f773-8096-4aa1-8f09-8ea4728b88dc admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:17.184468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432f773-8096-4aa1-8f09-8ea4728b88dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:17.186694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7432f773-8096-4aa1-8f09-8ea4728b88dc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:17.237646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1408/2797] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:59:17 2022] POST /identity/v3/projects => generated 379 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:17.242778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870e6a-215c-4271-85a3-77eda608817a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:17.259659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e870e6a-215c-4271-85a3-77eda608817a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:17.443832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728d345-36d8-429e-851c-eb913d54d8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:17.444611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728d345-36d8-429e-851c-eb913d54d8b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:17.444901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728d345-36d8-429e-851c-eb913d54d8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:17.445180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3728d345-36d8-429e-851c-eb913d54d8b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:17.445861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728d345-36d8-429e-851c-eb913d54d8b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:17.448684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3728d345-36d8-429e-851c-eb913d54d8b8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:17.503959 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1390/2798] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:59:17 2022] POST /identity/v3/users => generated 290 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 08:59:17.511288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432f773-8096-4aa1-8f09-8ea4728b88dc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:17.544259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7432f773-8096-4aa1-8f09-8ea4728b88dc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:17.571828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57ff8-c44b-48b9-b0cd-ef859d224588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:17.572493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57ff8-c44b-48b9-b0cd-ef859d224588 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:17.572493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57ff8-c44b-48b9-b0cd-ef859d224588 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:17.572688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa57ff8-c44b-48b9-b0cd-ef859d224588 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:17.573341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa57ff8-c44b-48b9-b0cd-ef859d224588 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:17.574934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa57ff8-c44b-48b9-b0cd-ef859d224588 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:17.608753 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1409/2799] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:17.618506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728d345-36d8-429e-851c-eb913d54d8b8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:17.642020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3728d345-36d8-429e-851c-eb913d54d8b8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:17.671990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b874443c-b3ff-4601-8d90-00640e01bcb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:17.673067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874443c-b3ff-4601-8d90-00640e01bcb6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:17.673624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874443c-b3ff-4601-8d90-00640e01bcb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:17.675752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b874443c-b3ff-4601-8d90-00640e01bcb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:17.676658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874443c-b3ff-4601-8d90-00640e01bcb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:17.686344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b874443c-b3ff-4601-8d90-00640e01bcb6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:17.727521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57ff8-c44b-48b9-b0cd-ef859d224588 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:17.731677 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1391/2800] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:17 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:17.750086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa57ff8-c44b-48b9-b0cd-ef859d224588 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:17.769055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d807408-fc92-4eb9-b88f-3cb9ec652b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:17.769754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d807408-fc92-4eb9-b88f-3cb9ec652b8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:17.770032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d807408-fc92-4eb9-b88f-3cb9ec652b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:17.770304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d807408-fc92-4eb9-b88f-3cb9ec652b8d admin admin] PATH_INFO: `/v3/projects/92fabbee6f184b9b8ebff84ca55c3c67/users/f381609a3c0d4583804a70c89d288881/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:17.819781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d807408-fc92-4eb9-b88f-3cb9ec652b8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=92fabbee6f184b9b8ebff84ca55c3c67, user_id=f381609a3c0d4583804a70c89d288881, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:17.822500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d807408-fc92-4eb9-b88f-3cb9ec652b8d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:17.853246 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1410/2801] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:59:17 2022] PUT /identity/v3/projects/92fabbee6f184b9b8ebff84ca55c3c67/users/f381609a3c0d4583804a70c89d288881/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:17.860078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10082d3-082f-44b6-b27c-e0d63666b494 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:17.860649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10082d3-082f-44b6-b27c-e0d63666b494 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:17.860751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10082d3-082f-44b6-b27c-e0d63666b494 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:17.920395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d10082d3-082f-44b6-b27c-e0d63666b494 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:17.921998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d10082d3-082f-44b6-b27c-e0d63666b494 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:18.063918 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:18.110041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d807408-fc92-4eb9-b88f-3cb9ec652b8d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:18.111883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d807408-fc92-4eb9-b88f-3cb9ec652b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:18.113942 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1392/2802] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:18.217284 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:18.235870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d807408-fc92-4eb9-b88f-3cb9ec652b8d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:18.240000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813176c-90d5-4f6a-8273-c532f1245c1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:18.240650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813176c-90d5-4f6a-8273-c532f1245c1e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:18.240991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813176c-90d5-4f6a-8273-c532f1245c1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:18.241323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813176c-90d5-4f6a-8273-c532f1245c1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:18.257166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813176c-90d5-4f6a-8273-c532f1245c1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:18.259506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813176c-90d5-4f6a-8273-c532f1245c1e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:18.328763 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1411/2803] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:59:19.607064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ca58-a31e-4aa9-9291-f3d70494d4d8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:19.607546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ca58-a31e-4aa9-9291-f3d70494d4d8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:19.607680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b4ca58-a31e-4aa9-9291-f3d70494d4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:19.679246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e7b4ca58-a31e-4aa9-9291-f3d70494d4d8 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:19.681471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e7b4ca58-a31e-4aa9-9291-f3d70494d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:19.860934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1393/2804] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:59:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:19.873496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813176c-90d5-4f6a-8273-c532f1245c1e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:19.875851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b813176c-90d5-4f6a-8273-c532f1245c1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:20.051220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813176c-90d5-4f6a-8273-c532f1245c1e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:20.060264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe12892-9b48-4bfd-b5e3-13c4d04d5b0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:20.061218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe12892-9b48-4bfd-b5e3-13c4d04d5b0c service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:20.062438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe12892-9b48-4bfd-b5e3-13c4d04d5b0c service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:20.062906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe12892-9b48-4bfd-b5e3-13c4d04d5b0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:20.105368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe12892-9b48-4bfd-b5e3-13c4d04d5b0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:20.107912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe12892-9b48-4bfd-b5e3-13c4d04d5b0c service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:20.137151 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1412/2805] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:59:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:25.538218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4ca58-a31e-4aa9-9291-f3d70494d4d8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:25.540001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e7b4ca58-a31e-4aa9-9291-f3d70494d4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:25.790096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b4ca58-a31e-4aa9-9291-f3d70494d4d8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:25.799743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:25.800686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:25.801132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:25.801699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:25.803752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:25.947617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:25.950137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:25.967772 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1394/2806] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:25 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:27.599563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbd8d7-ff2c-4797-948d-90c00a3e5cb0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:27.600004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbd8d7-ff2c-4797-948d-90c00a3e5cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:27.600106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dbd8d7-ff2c-4797-948d-90c00a3e5cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:27.709200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-24dbd8d7-ff2c-4797-948d-90c00a3e5cb0 None None] MFA Rules not processed for user `72840d50401e45fca15c0a521b6a1ea6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:27.710485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-24dbd8d7-ff2c-4797-948d-90c00a3e5cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:27.824368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:27.826263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:27.855753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06220350-1654-49e3-aea2-23d4855e8b21 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:27.865916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:27.866984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:27.867514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:27.868028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:27.872529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:27.908801 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1413/2807] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:27 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:27.921931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbd8d7-ff2c-4797-948d-90c00a3e5cb0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:27.923829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-24dbd8d7-ff2c-4797-948d-90c00a3e5cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:28.026476 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:28.186093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dbd8d7-ff2c-4797-948d-90c00a3e5cb0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:28.193103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:28.194610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac37384-f7a0-4e97-8d74-72bb6ada5ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:28.195246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac37384-f7a0-4e97-8d74-72bb6ada5ace service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:28.195528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac37384-f7a0-4e97-8d74-72bb6ada5ace service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:28.195803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac37384-f7a0-4e97-8d74-72bb6ada5ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:28.201922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8ac37384-f7a0-4e97-8d74-72bb6ada5ace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:28.216757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:28.244558 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:28.267001 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1395/2808] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:27 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:59:28.422998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac37384-f7a0-4e97-8d74-72bb6ada5ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:28.424840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac37384-f7a0-4e97-8d74-72bb6ada5ace service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:28.452159 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1414/2809] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:27 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:31.468379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:31.469831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:31.497193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41213b4e-9594-47f0-a87f-e7d9663fbf87 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:31.504624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0bdcf-3138-44d3-b71c-ee2bc67db4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:31.522229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0bdcf-3138-44d3-b71c-ee2bc67db4fc service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:31.523171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0bdcf-3138-44d3-b71c-ee2bc67db4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:31.523171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee0bdcf-3138-44d3-b71c-ee2bc67db4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:31.527971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ee0bdcf-3138-44d3-b71c-ee2bc67db4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:31.610225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0bdcf-3138-44d3-b71c-ee2bc67db4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:31.611686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee0bdcf-3138-44d3-b71c-ee2bc67db4fc service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:31.698624 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1396/2810] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:32.837369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac37384-f7a0-4e97-8d74-72bb6ada5ace service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:32.861850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac37384-f7a0-4e97-8d74-72bb6ada5ace service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:32.882948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df71afd-20ab-47ae-b105-d147594ae776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:32.883753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71afd-20ab-47ae-b105-d147594ae776 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:32.884040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71afd-20ab-47ae-b105-d147594ae776 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:32.884322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df71afd-20ab-47ae-b105-d147594ae776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:32.894764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5df71afd-20ab-47ae-b105-d147594ae776 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:32.960841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df71afd-20ab-47ae-b105-d147594ae776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:32.967946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df71afd-20ab-47ae-b105-d147594ae776 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:33.043652 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1415/2811] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:33.141145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0bdcf-3138-44d3-b71c-ee2bc67db4fc service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:33.155279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee0bdcf-3138-44d3-b71c-ee2bc67db4fc service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:33.171321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3a818-63cb-4206-a1f2-98d8f724dbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:33.172083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3a818-63cb-4206-a1f2-98d8f724dbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:33.172367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3a818-63cb-4206-a1f2-98d8f724dbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:33.173055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e3a818-63cb-4206-a1f2-98d8f724dbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:33.180776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46e3a818-63cb-4206-a1f2-98d8f724dbd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:33.221430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3a818-63cb-4206-a1f2-98d8f724dbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:33.222917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e3a818-63cb-4206-a1f2-98d8f724dbd5 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:33.245027 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1397/2812] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:36.033608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6456d2-c8bc-4987-b153-615919435d93 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:36.034798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6456d2-c8bc-4987-b153-615919435d93 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:36.035304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6456d2-c8bc-4987-b153-615919435d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:36.129878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-da6456d2-c8bc-4987-b153-615919435d93 None None] MFA Rules not processed for user `f381609a3c0d4583804a70c89d288881`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:36.132443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da6456d2-c8bc-4987-b153-615919435d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:36.347299 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1416/2813] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:36 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:36.356449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3a818-63cb-4206-a1f2-98d8f724dbd5 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:36.382055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e3a818-63cb-4206-a1f2-98d8f724dbd5 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:36.399094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1558c66-fcae-4d1b-8649-1013394c0ad9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:36.400050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1558c66-fcae-4d1b-8649-1013394c0ad9 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:36.400584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1558c66-fcae-4d1b-8649-1013394c0ad9 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:36.401086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1558c66-fcae-4d1b-8649-1013394c0ad9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:36.416659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1558c66-fcae-4d1b-8649-1013394c0ad9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:36.418849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1558c66-fcae-4d1b-8649-1013394c0ad9 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:36.443219 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1398/2814] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:40.649152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1c56-4a42-49a8-9325-563ed532a00a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:40.649780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1c56-4a42-49a8-9325-563ed532a00a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:40.649991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d1c56-4a42-49a8-9325-563ed532a00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:40.711558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f00d1c56-4a42-49a8-9325-563ed532a00a None None] MFA Rules not processed for user `9f3fa66a009149e8b5cec58e4b24a788`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:40.715742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f00d1c56-4a42-49a8-9325-563ed532a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:40.783328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb24bb-9db6-48ab-be0f-ccdbe300143a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:40.783916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb24bb-9db6-48ab-be0f-ccdbe300143a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:40.783916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb24bb-9db6-48ab-be0f-ccdbe300143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:40.886540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-08eb24bb-9db6-48ab-be0f-ccdbe300143a None None] MFA Rules not processed for user `f381609a3c0d4583804a70c89d288881`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:40.890160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-08eb24bb-9db6-48ab-be0f-ccdbe300143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:40.914593 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1417/2815] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:40 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:40.937215 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1399/2816] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:40 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:59:50.765120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1c56-4a42-49a8-9325-563ed532a00a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:50.766860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f00d1c56-4a42-49a8-9325-563ed532a00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:50.796144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d1c56-4a42-49a8-9325-563ed532a00a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:50.818552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:50.821261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:50.821591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:50.821916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] PATH_INFO: `/v3/users/b43a269fe8b746b88c38db6b9e9bfa12` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:50.826239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] RBAC: Authorizing `identity:delete_user(user_id=b43a269fe8b746b88c38db6b9e9bfa12)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:50.834311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:50.854875 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=39 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:50.941116 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:50.988573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b43a269fe8b746b88c38db6b9e9bfa12'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.025457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b43a269fe8b746b88c38db6b9e9bfa12'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.026920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b43a269fe8b746b88c38db6b9e9bfa12'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.076705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b43a269fe8b746b88c38db6b9e9bfa12'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.094446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b43a269fe8b746b88c38db6b9e9bfa12'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.122164 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1418/2817] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:59:50 2022] DELETE /identity/v3/users/b43a269fe8b746b88c38db6b9e9bfa12 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:51.598790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb24bb-9db6-48ab-be0f-ccdbe300143a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:51.630531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb24bb-9db6-48ab-be0f-ccdbe300143a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:51.776507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:51.777549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:51.777822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:51.778128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] PATH_INFO: `/v3/projects/bdb9aeb0656347798749c2b8e4434c56` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:51.779358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb9aeb0656347798749c2b8e4434c56)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:51.781353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:51.850429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb9aeb0656347798749c2b8e4434c56', 'request_id': 'req-a97e09e0-6db6-4045-a118-4f9feb56fdda'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.875048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb9aeb0656347798749c2b8e4434c56', 'request_id': 'req-a97e09e0-6db6-4045-a118-4f9feb56fdda'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.895486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb9aeb0656347798749c2b8e4434c56', 'request_id': 'req-a97e09e0-6db6-4045-a118-4f9feb56fdda'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.927105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] The token cache is being invalidate because project bdb9aeb0656347798749c2b8e4434c56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:59:51.927790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.928827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:51.936067 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1400/2818] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:51 2022] DELETE /identity/v3/projects/bdb9aeb0656347798749c2b8e4434c56 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:51.936845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:51.938473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:51.960899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed5de35-74e3-4f89-a8ec-0c30345a91df admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:52.065627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:52.066305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:52.066643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:52.066925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] PATH_INFO: `/v3/users/4ddd42bac53f4b43a7d3b7ff317a175b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:52.068225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ddd42bac53f4b43a7d3b7ff317a175b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:52.070225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:52.146219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ddd42bac53f4b43a7d3b7ff317a175b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.158731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ddd42bac53f4b43a7d3b7ff317a175b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.159462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ddd42bac53f4b43a7d3b7ff317a175b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.169831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ddd42bac53f4b43a7d3b7ff317a175b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.177989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-466343f1-12e1-4b28-a490-1fd3fed71d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ddd42bac53f4b43a7d3b7ff317a175b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.184629 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1419/2819] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 08:59:51 2022] DELETE /identity/v3/users/4ddd42bac53f4b43a7d3b7ff317a175b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:52.394860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:52.396950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:52.414475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97e09e0-6db6-4045-a118-4f9feb56fdda admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:52.488110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:52.489044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:52.493608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:52.495249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] PATH_INFO: `/v3/projects/0e89b067267b4fc1979432f328b7b5ec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:52.497111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e89b067267b4fc1979432f328b7b5ec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:52.499685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:52.566804 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:52.585085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e89b067267b4fc1979432f328b7b5ec', 'request_id': 'req-5fe62596-f548-4344-9d77-bbd8953c460c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.598844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e89b067267b4fc1979432f328b7b5ec', 'request_id': 'req-5fe62596-f548-4344-9d77-bbd8953c460c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.612954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e89b067267b4fc1979432f328b7b5ec', 'request_id': 'req-5fe62596-f548-4344-9d77-bbd8953c460c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.634870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] The token cache is being invalidate because project 0e89b067267b4fc1979432f328b7b5ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 08:59:52.635167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.635832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5fe62596-f548-4344-9d77-bbd8953c460c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 08:59:52.641311 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1401/2820] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 08:59:52 2022] DELETE /identity/v3/projects/0e89b067267b4fc1979432f328b7b5ec => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:52.642816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345adbd-f9a8-4572-a15f-257ba5cf78b1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:52.643231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345adbd-f9a8-4572-a15f-257ba5cf78b1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:52.643589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345adbd-f9a8-4572-a15f-257ba5cf78b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:52.681264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b345adbd-f9a8-4572-a15f-257ba5cf78b1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:52.682563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b345adbd-f9a8-4572-a15f-257ba5cf78b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:52.723236 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:52.804359 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1420/2821] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:59:52.813405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8301c61-7fe8-44a3-8901-188e420ffb03 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:52.813731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8301c61-7fe8-44a3-8901-188e420ffb03 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:52.813997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8301c61-7fe8-44a3-8901-188e420ffb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:52.849235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b8301c61-7fe8-44a3-8901-188e420ffb03 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:52.850511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b8301c61-7fe8-44a3-8901-188e420ffb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:52.863020 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1402/2822] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:52.867504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345adbd-f9a8-4572-a15f-257ba5cf78b1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:52.880474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345adbd-f9a8-4572-a15f-257ba5cf78b1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:52.886968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8923b-fa73-4a30-9cb1-dee3f6a05573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:52.887608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8923b-fa73-4a30-9cb1-dee3f6a05573 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:52.887888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8923b-fa73-4a30-9cb1-dee3f6a05573 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:52.888228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a8923b-fa73-4a30-9cb1-dee3f6a05573 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:52.888955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8923b-fa73-4a30-9cb1-dee3f6a05573 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 08:59:52.889261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8923b-fa73-4a30-9cb1-dee3f6a05573 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:52.891178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a8923b-fa73-4a30-9cb1-dee3f6a05573 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:52.914988 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1421/2823] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 08:59:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:59:52.919539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8301c61-7fe8-44a3-8901-188e420ffb03 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:52.932974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8301c61-7fe8-44a3-8901-188e420ffb03 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:52.940650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43747999-67c3-4eae-b19a-a6b899f7f075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:52.941072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43747999-67c3-4eae-b19a-a6b899f7f075 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:52.941195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43747999-67c3-4eae-b19a-a6b899f7f075 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:52.941942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43747999-67c3-4eae-b19a-a6b899f7f075 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:52.942379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43747999-67c3-4eae-b19a-a6b899f7f075 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:52.944760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43747999-67c3-4eae-b19a-a6b899f7f075 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:52.981013 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1403/2824] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:59:52 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:52.987523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8923b-fa73-4a30-9cb1-dee3f6a05573 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:53.004072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a8923b-fa73-4a30-9cb1-dee3f6a05573 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:53.113656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c739b44-122e-487c-a9b6-6319bfb8d69c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:53.114784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739b44-122e-487c-a9b6-6319bfb8d69c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:53.115339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739b44-122e-487c-a9b6-6319bfb8d69c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:53.115721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c739b44-122e-487c-a9b6-6319bfb8d69c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:53.116645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c739b44-122e-487c-a9b6-6319bfb8d69c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:53.119337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c739b44-122e-487c-a9b6-6319bfb8d69c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:53.152302 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1422/2825] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:59:52 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:53.160182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43747999-67c3-4eae-b19a-a6b899f7f075 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:53.177693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43747999-67c3-4eae-b19a-a6b899f7f075 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:53.190587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7a785-e512-4b0e-a5fe-d6732f9f6067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:53.191224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a785-e512-4b0e-a5fe-d6732f9f6067 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:53.193015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a785-e512-4b0e-a5fe-d6732f9f6067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:53.193618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f7a785-e512-4b0e-a5fe-d6732f9f6067 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:53.194787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7a785-e512-4b0e-a5fe-d6732f9f6067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:53.196824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f7a785-e512-4b0e-a5fe-d6732f9f6067 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:53.231604 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1404/2826] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:53.235743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c739b44-122e-487c-a9b6-6319bfb8d69c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:53.247158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c739b44-122e-487c-a9b6-6319bfb8d69c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:53.253563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64172f84-396f-4078-acd0-6686e2ca9eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:53.255259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172f84-396f-4078-acd0-6686e2ca9eb2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:53.255749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172f84-396f-4078-acd0-6686e2ca9eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:53.256019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64172f84-396f-4078-acd0-6686e2ca9eb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:53.256669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64172f84-396f-4078-acd0-6686e2ca9eb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:53.258295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64172f84-396f-4078-acd0-6686e2ca9eb2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:53.274893 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1423/2827] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:53.279566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7a785-e512-4b0e-a5fe-d6732f9f6067 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:53.290919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f7a785-e512-4b0e-a5fe-d6732f9f6067 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:53.299593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e451a-045a-4b6a-a8b1-fa71e87e079b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:53.300907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e451a-045a-4b6a-a8b1-fa71e87e079b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:53.302138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e451a-045a-4b6a-a8b1-fa71e87e079b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:53.303377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e451a-045a-4b6a-a8b1-fa71e87e079b admin admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3/users/76e4055dc1f849e9a58e0fcc9bd6a98c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:53.373084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e451a-045a-4b6a-a8b1-fa71e87e079b admin admin] RBAC: Authorizing `identity:create_grant(project_id=485b239908a64ef29e1cab5773aee8e3, user_id=76e4055dc1f849e9a58e0fcc9bd6a98c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:53.376307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e451a-045a-4b6a-a8b1-fa71e87e079b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:53.416473 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1405/2828] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:59:53 2022] PUT /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3/users/76e4055dc1f849e9a58e0fcc9bd6a98c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:59:53.417646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3f6a1-39b5-4882-8929-64760180333e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:53.417936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3f6a1-39b5-4882-8929-64760180333e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:53.418231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba3f6a1-39b5-4882-8929-64760180333e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:53.485352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4ba3f6a1-39b5-4882-8929-64760180333e None None] MFA Rules not processed for user `76e4055dc1f849e9a58e0fcc9bd6a98c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:53.485925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4ba3f6a1-39b5-4882-8929-64760180333e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:53.605592 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1424/2829] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 08:59:53.610182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e451a-045a-4b6a-a8b1-fa71e87e079b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:53.738415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e451a-045a-4b6a-a8b1-fa71e87e079b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:53.743618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec11bac-abe2-4ef2-a3df-85536b192541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:53.745158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11bac-abe2-4ef2-a3df-85536b192541 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:53.745158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11bac-abe2-4ef2-a3df-85536b192541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:53.745158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec11bac-abe2-4ef2-a3df-85536b192541 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:53.747310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11bac-abe2-4ef2-a3df-85536b192541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:53.749845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec11bac-abe2-4ef2-a3df-85536b192541 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:53.813353 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1406/2830] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 08:59:53 2022] POST /identity/v3/projects => generated 381 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:53.813941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3f6a1-39b5-4882-8929-64760180333e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:53.829575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba3f6a1-39b5-4882-8929-64760180333e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:53.872817 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:53.973256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f483243-7a51-4968-a49d-eba6cea50d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:53.973938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f483243-7a51-4968-a49d-eba6cea50d60 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:53.974223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f483243-7a51-4968-a49d-eba6cea50d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:53.974498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f483243-7a51-4968-a49d-eba6cea50d60 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:53.975153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f483243-7a51-4968-a49d-eba6cea50d60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:53.977137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f483243-7a51-4968-a49d-eba6cea50d60 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:54.029479 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1425/2831] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 08:59:53 2022] POST /identity/v3/users => generated 297 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 08:59:54.033604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec11bac-abe2-4ef2-a3df-85536b192541 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:54.050803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec11bac-abe2-4ef2-a3df-85536b192541 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:54.065993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be85f0-fd3d-4857-97ca-fc93e3c0a8e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:54.067377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be85f0-fd3d-4857-97ca-fc93e3c0a8e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:54.067795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be85f0-fd3d-4857-97ca-fc93e3c0a8e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:54.069765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9be85f0-fd3d-4857-97ca-fc93e3c0a8e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:54.073335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be85f0-fd3d-4857-97ca-fc93e3c0a8e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:54.075116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9be85f0-fd3d-4857-97ca-fc93e3c0a8e5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:54.101470 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1407/2832] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 08:59:54.106123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f483243-7a51-4968-a49d-eba6cea50d60 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:54.122485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f483243-7a51-4968-a49d-eba6cea50d60 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:54.137465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c131684-9ce9-412f-814f-74503adbd7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:54.139365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c131684-9ce9-412f-814f-74503adbd7e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:54.139727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c131684-9ce9-412f-814f-74503adbd7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:54.140081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c131684-9ce9-412f-814f-74503adbd7e7 admin admin] PATH_INFO: `/v3/projects/b663fb20d40a48f997d5656000dc4155/users/9612fab75102474794f9cb6c5e450e91/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:54.187417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c131684-9ce9-412f-814f-74503adbd7e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b663fb20d40a48f997d5656000dc4155, user_id=9612fab75102474794f9cb6c5e450e91, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:54.190725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c131684-9ce9-412f-814f-74503adbd7e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:54.225212 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1426/2833] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:59:54 2022] PUT /identity/v3/projects/b663fb20d40a48f997d5656000dc4155/users/9612fab75102474794f9cb6c5e450e91/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 08:59:54.229945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be85f0-fd3d-4857-97ca-fc93e3c0a8e5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:54.256530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9be85f0-fd3d-4857-97ca-fc93e3c0a8e5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:54.314191 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:54.407862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a26c139-f4fe-4b2b-bf6b-194df126f5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:54.408488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26c139-f4fe-4b2b-bf6b-194df126f5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:54.408769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26c139-f4fe-4b2b-bf6b-194df126f5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:54.409065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a26c139-f4fe-4b2b-bf6b-194df126f5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:54.409763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26c139-f4fe-4b2b-bf6b-194df126f5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:54.411456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a26c139-f4fe-4b2b-bf6b-194df126f5d6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:54.444370 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1408/2834] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 08:59:54 2022] GET /identity/v3/roles => generated 1420 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 08:59:54.448781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c131684-9ce9-412f-814f-74503adbd7e7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:54.484275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c131684-9ce9-412f-814f-74503adbd7e7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:54.508323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440cb8fb-bc1f-42db-85ad-978947a4ea73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:54.509052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cb8fb-bc1f-42db-85ad-978947a4ea73 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:54.509363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cb8fb-bc1f-42db-85ad-978947a4ea73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:54.509632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440cb8fb-bc1f-42db-85ad-978947a4ea73 admin admin] PATH_INFO: `/v3/projects/b663fb20d40a48f997d5656000dc4155/users/9612fab75102474794f9cb6c5e450e91/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:54.515940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cb8fb-bc1f-42db-85ad-978947a4ea73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b663fb20d40a48f997d5656000dc4155, user_id=9612fab75102474794f9cb6c5e450e91, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:54.527117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440cb8fb-bc1f-42db-85ad-978947a4ea73 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:54.550564 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1427/2835] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 08:59:54 2022] PUT /identity/v3/projects/b663fb20d40a48f997d5656000dc4155/users/9612fab75102474794f9cb6c5e450e91/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 08:59:54.560743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbda74a-20b0-4b34-91c5-8184c0d8e188 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:54.560971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbda74a-20b0-4b34-91c5-8184c0d8e188 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:54.561242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbda74a-20b0-4b34-91c5-8184c0d8e188 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:54.641773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0bbda74a-20b0-4b34-91c5-8184c0d8e188 None None] MFA Rules not processed for user `9612fab75102474794f9cb6c5e450e91`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:54.643490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0bbda74a-20b0-4b34-91c5-8184c0d8e188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:54.754810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c712cb-cc55-489b-b5e1-f1525decf7f8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:54.755096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c712cb-cc55-489b-b5e1-f1525decf7f8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:54.755373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c712cb-cc55-489b-b5e1-f1525decf7f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:54.779413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b8c712cb-cc55-489b-b5e1-f1525decf7f8 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:54.780857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b8c712cb-cc55-489b-b5e1-f1525decf7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:54.864612 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1409/2836] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:54 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:54.878282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbda74a-20b0-4b34-91c5-8184c0d8e188 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:54.880232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0bbda74a-20b0-4b34-91c5-8184c0d8e188 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:54.914810 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1428/2837] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 08:59:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:54.916566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c712cb-cc55-489b-b5e1-f1525decf7f8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:54.920153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b8c712cb-cc55-489b-b5e1-f1525decf7f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:55.026116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c712cb-cc55-489b-b5e1-f1525decf7f8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:55.031942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9275ab2e-7fc5-448a-8b8a-3aad67d761ef service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:55.033843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275ab2e-7fc5-448a-8b8a-3aad67d761ef service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:55.034663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275ab2e-7fc5-448a-8b8a-3aad67d761ef service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:55.034947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9275ab2e-7fc5-448a-8b8a-3aad67d761ef service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:55.046254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275ab2e-7fc5-448a-8b8a-3aad67d761ef service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:55.048124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9275ab2e-7fc5-448a-8b8a-3aad67d761ef service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:55.064737 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1429/2838] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:59:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:55.090244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbda74a-20b0-4b34-91c5-8184c0d8e188 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:55.128876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20aad5-b6df-43bb-b220-2ce5943e28ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:55.129489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20aad5-b6df-43bb-b220-2ce5943e28ad service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:55.129810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20aad5-b6df-43bb-b220-2ce5943e28ad service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:55.130036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20aad5-b6df-43bb-b220-2ce5943e28ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:55.150605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20aad5-b6df-43bb-b220-2ce5943e28ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:55.153731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20aad5-b6df-43bb-b220-2ce5943e28ad service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:55.181174 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1410/2839] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:54 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 08:59:55.222347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c3c35-e406-44a1-88fa-6594d69aba8d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:55.222641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c3c35-e406-44a1-88fa-6594d69aba8d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:55.222909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c3c35-e406-44a1-88fa-6594d69aba8d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:55.225223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1430/2840] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:59:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:59:55.241884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20aad5-b6df-43bb-b220-2ce5943e28ad service nova] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:59:55.264402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20aad5-b6df-43bb-b220-2ce5943e28ad service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:55.290937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20aad5-b6df-43bb-b220-2ce5943e28ad service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:55.303053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3994d-b72b-450f-b6ee-243e7f0bb07c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9612fab75102474794f9cb6c5e450e91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b663fb20d40a48f997d5656000dc4155', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:55.303686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3994d-b72b-450f-b6ee-243e7f0bb07c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:55.303965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3994d-b72b-450f-b6ee-243e7f0bb07c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:55.304256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d3994d-b72b-450f-b6ee-243e7f0bb07c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:55.306350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3994d-b72b-450f-b6ee-243e7f0bb07c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:55.310862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d3994d-b72b-450f-b6ee-243e7f0bb07c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:55.315103 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1411/2841] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:59:55 2022] GET /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 383 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:59:56.078637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c7096-1684-4309-9308-42c60f15ea20 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:56.079142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c7096-1684-4309-9308-42c60f15ea20 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:56.079142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c7096-1684-4309-9308-42c60f15ea20 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:56.080510 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1431/2842] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:59:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:59:56.088753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3994d-b72b-450f-b6ee-243e7f0bb07c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:59:56.115297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3994d-b72b-450f-b6ee-243e7f0bb07c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:56.134010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d3994d-b72b-450f-b6ee-243e7f0bb07c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:56.149385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f358b0-6b78-41ae-a12c-e6f153ddceb6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9612fab75102474794f9cb6c5e450e91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b663fb20d40a48f997d5656000dc4155', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:56.152977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f358b0-6b78-41ae-a12c-e6f153ddceb6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:56.153326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f358b0-6b78-41ae-a12c-e6f153ddceb6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:56.153645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f358b0-6b78-41ae-a12c-e6f153ddceb6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:56.158132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f358b0-6b78-41ae-a12c-e6f153ddceb6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:56.162290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f358b0-6b78-41ae-a12c-e6f153ddceb6 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:56.165600 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1412/2843] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:59:56 2022] GET /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 383 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:59:56.294125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930501-497b-4a66-bcef-459e83f3c3f4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:56.294409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930501-497b-4a66-bcef-459e83f3c3f4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:56.294683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa930501-497b-4a66-bcef-459e83f3c3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:56.329710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fa930501-497b-4a66-bcef-459e83f3c3f4 None None] MFA Rules not processed for user `76e4055dc1f849e9a58e0fcc9bd6a98c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:56.332995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa930501-497b-4a66-bcef-459e83f3c3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:56.344466 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:56.505769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1432/2844] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:56.715049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c23c-6acf-4e27-8595-f78910876a0c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:56.715344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c23c-6acf-4e27-8595-f78910876a0c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:56.715627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1c23c-6acf-4e27-8595-f78910876a0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:56.762652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa930501-497b-4a66-bcef-459e83f3c3f4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:56.771447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0ad1c23c-6acf-4e27-8595-f78910876a0c None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:56.772819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ad1c23c-6acf-4e27-8595-f78910876a0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:56.784836 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1413/2845] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 08:59:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:56.798097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa930501-497b-4a66-bcef-459e83f3c3f4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:56.803300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c23c-6acf-4e27-8595-f78910876a0c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:56.805897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8983b66c-8323-4504-a0e7-84fd4cdcfd3a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:56.806728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983b66c-8323-4504-a0e7-84fd4cdcfd3a service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:56.807212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983b66c-8323-4504-a0e7-84fd4cdcfd3a service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:56.807718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8983b66c-8323-4504-a0e7-84fd4cdcfd3a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:56.820773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983b66c-8323-4504-a0e7-84fd4cdcfd3a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:56.824564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8983b66c-8323-4504-a0e7-84fd4cdcfd3a service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:56.825424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1c23c-6acf-4e27-8595-f78910876a0c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:56.843686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a2341-5c91-4857-8055-79a07c89a444 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:56.845192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2341-5c91-4857-8055-79a07c89a444 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:56.845753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2341-5c91-4857-8055-79a07c89a444 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:56.846232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a2341-5c91-4857-8055-79a07c89a444 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:56.853198 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1433/2846] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 08:59:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 08:59:56.858223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a2341-5c91-4857-8055-79a07c89a444 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:56.861222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610a2341-5c91-4857-8055-79a07c89a444 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:56.872491 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 08:59:56.880154 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1414/2847] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 08:59:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 08:59:58.937887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1278e0f-022e-4874-ae1b-46f7f5eb8b8d None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:58.938986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1278e0f-022e-4874-ae1b-46f7f5eb8b8d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:58.939536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1278e0f-022e-4874-ae1b-46f7f5eb8b8d None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:58.941647 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1434/2848] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:59:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 08:59:58.947072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a2341-5c91-4857-8055-79a07c89a444 service swift] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:59:58.962990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a2341-5c91-4857-8055-79a07c89a444 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:58.976320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610a2341-5c91-4857-8055-79a07c89a444 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:58.983954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3668a54e-c375-4779-93a4-29d07e828677 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9612fab75102474794f9cb6c5e450e91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b663fb20d40a48f997d5656000dc4155', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:58.984653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668a54e-c375-4779-93a4-29d07e828677 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:58.984921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668a54e-c375-4779-93a4-29d07e828677 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:58.985138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3668a54e-c375-4779-93a4-29d07e828677 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:58.986469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668a54e-c375-4779-93a4-29d07e828677 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:58.988771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3668a54e-c375-4779-93a4-29d07e828677 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:59.003927 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1415/2849] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:59:58 2022] GET /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 383 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:59:59.129839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e9d39-e862-4b51-81f8-1dfa675913dc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:59.130381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e9d39-e862-4b51-81f8-1dfa675913dc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:59.130736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9e9d39-e862-4b51-81f8-1dfa675913dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:59.173060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bc9e9d39-e862-4b51-81f8-1dfa675913dc None None] MFA Rules not processed for user `0a5f0704d95640a99457ddd8652f83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:59.174598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc9e9d39-e862-4b51-81f8-1dfa675913dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:59.179841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbba03c-d9fd-4d5a-8667-2de803594b28 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:59.180207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbba03c-d9fd-4d5a-8667-2de803594b28 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:59.180569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbba03c-d9fd-4d5a-8667-2de803594b28 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:59.182021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1416/2850] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:59:59.189717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbba03c-d9fd-4d5a-8667-2de803594b28 None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:59:59.192898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2bbba03c-d9fd-4d5a-8667-2de803594b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:59.220331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbba03c-d9fd-4d5a-8667-2de803594b28 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:59.235481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbba03c-d9fd-4d5a-8667-2de803594b28 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:59.241578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8d14d0-3d05-4bdf-a04d-4f55facfbe7a tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9612fab75102474794f9cb6c5e450e91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b663fb20d40a48f997d5656000dc4155', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:59.242212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d14d0-3d05-4bdf-a04d-4f55facfbe7a tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:59.242734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d14d0-3d05-4bdf-a04d-4f55facfbe7a tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:59.243022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8d14d0-3d05-4bdf-a04d-4f55facfbe7a tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:59.244380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d14d0-3d05-4bdf-a04d-4f55facfbe7a tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:59.247018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8d14d0-3d05-4bdf-a04d-4f55facfbe7a tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:59.258995 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1417/2851] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:59:59 2022] GET /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 383 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 08:59:59.308642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac0b9-1a1c-4f6f-ab09-cf2358158c54 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:59.309665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac0b9-1a1c-4f6f-ab09-cf2358158c54 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:59.310191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8ac0b9-1a1c-4f6f-ab09-cf2358158c54 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:59.311893 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1418/2852] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 08:59:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 08:59:59.317115 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1435/2853] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 08:59:59.324096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac0b9-1a1c-4f6f-ab09-cf2358158c54 None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 08:59:59.346553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac0b9-1a1c-4f6f-ab09-cf2358158c54 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 08:59:59.363118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8ac0b9-1a1c-4f6f-ab09-cf2358158c54 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 08:59:59.373059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f1782-e8d9-4cdd-8d2b-98c67e015e27 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9612fab75102474794f9cb6c5e450e91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b663fb20d40a48f997d5656000dc4155', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 08:59:59.376244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f1782-e8d9-4cdd-8d2b-98c67e015e27 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:59.376244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f1782-e8d9-4cdd-8d2b-98c67e015e27 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:59.376244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f1782-e8d9-4cdd-8d2b-98c67e015e27 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:59.377947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f1782-e8d9-4cdd-8d2b-98c67e015e27 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 08:59:59.386701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f1782-e8d9-4cdd-8d2b-98c67e015e27 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 08:59:59.401888 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1419/2854] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 08:59:59 2022] GET /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 383 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 08:59:59.551209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765591-a3fa-4227-ae59-0eb1a86f1249 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 08:59:59.551431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765591-a3fa-4227-ae59-0eb1a86f1249 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 08:59:59.551654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8765591-a3fa-4227-ae59-0eb1a86f1249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 08:59:59.594511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a8765591-a3fa-4227-ae59-0eb1a86f1249 None None] MFA Rules not processed for user `76e4055dc1f849e9a58e0fcc9bd6a98c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 08:59:59.597091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a8765591-a3fa-4227-ae59-0eb1a86f1249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 08:59:59.616852 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1436/2855] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 08:59:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:01.291574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246789cb-e978-4d48-bca1-f1f4814351bc None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:01.292074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246789cb-e978-4d48-bca1-f1f4814351bc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:01.292150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246789cb-e978-4d48-bca1-f1f4814351bc None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:01.293837 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1420/2856] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:00:01.313402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8765591-a3fa-4227-ae59-0eb1a86f1249 None None] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:00:01.353657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8765591-a3fa-4227-ae59-0eb1a86f1249 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:01.414677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8765591-a3fa-4227-ae59-0eb1a86f1249 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:01.447437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216e219-5e11-4167-8f51-7e52ac3568ee tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9612fab75102474794f9cb6c5e450e91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b663fb20d40a48f997d5656000dc4155', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:01.447437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216e219-5e11-4167-8f51-7e52ac3568ee tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:01.449328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216e219-5e11-4167-8f51-7e52ac3568ee tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:01.449328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2216e219-5e11-4167-8f51-7e52ac3568ee tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:01.454653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216e219-5e11-4167-8f51-7e52ac3568ee tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:01.456796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2216e219-5e11-4167-8f51-7e52ac3568ee tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:01.463095 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1437/2857] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:00:01 2022] GET /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 383 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:00:02.460384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26712850-807a-44ef-82ac-267b927eb670 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:02.461219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26712850-807a-44ef-82ac-267b927eb670 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:02.461705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26712850-807a-44ef-82ac-267b927eb670 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:02.463521 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1421/2858] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:00:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:00:02.469733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216e219-5e11-4167-8f51-7e52ac3568ee tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:00:02.511958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216e219-5e11-4167-8f51-7e52ac3568ee tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:02.564044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2216e219-5e11-4167-8f51-7e52ac3568ee tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:02.590205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8925ef3-f68e-48ee-8e28-71eb0b6b9be0 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9612fab75102474794f9cb6c5e450e91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b663fb20d40a48f997d5656000dc4155', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:02.592351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8925ef3-f68e-48ee-8e28-71eb0b6b9be0 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:02.592651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8925ef3-f68e-48ee-8e28-71eb0b6b9be0 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:02.593551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8925ef3-f68e-48ee-8e28-71eb0b6b9be0 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:02.595562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8925ef3-f68e-48ee-8e28-71eb0b6b9be0 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:02.600495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8925ef3-f68e-48ee-8e28-71eb0b6b9be0 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:02.615051 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1438/2859] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:00:02 2022] GET /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 383 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:00:03.096406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f87ee-d298-4ed2-87fe-13c89c83067e None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:03.097037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f87ee-d298-4ed2-87fe-13c89c83067e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:03.098344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f87ee-d298-4ed2-87fe-13c89c83067e None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:03.100269 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1422/2860] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:00:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:00:03.105429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8925ef3-f68e-48ee-8e28-71eb0b6b9be0 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:00:03.126225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8925ef3-f68e-48ee-8e28-71eb0b6b9be0 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:03.157834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8925ef3-f68e-48ee-8e28-71eb0b6b9be0 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:03.166037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138b318f-d748-486e-b070-c3fe82941168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9612fab75102474794f9cb6c5e450e91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b663fb20d40a48f997d5656000dc4155', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:03.166699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b318f-d748-486e-b070-c3fe82941168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:03.166985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b318f-d748-486e-b070-c3fe82941168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:03.167252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138b318f-d748-486e-b070-c3fe82941168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:03.178478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b318f-d748-486e-b070-c3fe82941168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:03.180592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138b318f-d748-486e-b070-c3fe82941168 tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:03.193648 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1439/2861] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:00:03 2022] GET /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 383 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:00:03.335302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615a564-fd2c-4c79-a2f9-c11f51daee85 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:03.335581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615a564-fd2c-4c79-a2f9-c11f51daee85 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:03.335856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615a564-fd2c-4c79-a2f9-c11f51daee85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:03.423044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f615a564-fd2c-4c79-a2f9-c11f51daee85 None None] MFA Rules not processed for user `76e4055dc1f849e9a58e0fcc9bd6a98c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:03.424342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f615a564-fd2c-4c79-a2f9-c11f51daee85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:03.455519 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1423/2862] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:04.541534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a07e4-9548-4e18-86ae-e14169ae1b1b None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:04.542391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a07e4-9548-4e18-86ae-e14169ae1b1b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:04.542837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8a07e4-9548-4e18-86ae-e14169ae1b1b None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:04.544859 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1440/2863] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:00:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:00:04.562993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615a564-fd2c-4c79-a2f9-c11f51daee85 None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:00:04.584256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615a564-fd2c-4c79-a2f9-c11f51daee85 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:04.622803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615a564-fd2c-4c79-a2f9-c11f51daee85 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:04.635001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7469540c-1bc1-4b51-9195-a2c9cfe6ff3c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9612fab75102474794f9cb6c5e450e91', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b663fb20d40a48f997d5656000dc4155', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:04.635870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469540c-1bc1-4b51-9195-a2c9cfe6ff3c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:04.636294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469540c-1bc1-4b51-9195-a2c9cfe6ff3c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:04.636722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7469540c-1bc1-4b51-9195-a2c9cfe6ff3c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:04.638325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469540c-1bc1-4b51-9195-a2c9cfe6ff3c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorizing `identity:get_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:04.641505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7469540c-1bc1-4b51-9195-a2c9cfe6ff3c tempest-QuotasAdminNegativeTest-186575167 tempest-QuotasAdminNegativeTest-186575167-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:04.647172 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1424/2864] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:00:04 2022] GET /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 383 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:00:04.861707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a07e4-9548-4e18-86ae-e14169ae1b1b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:05.077070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8a07e4-9548-4e18-86ae-e14169ae1b1b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:05.083804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:05.084502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:05.084833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:05.085128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] PATH_INFO: `/v3/users/76e4055dc1f849e9a58e0fcc9bd6a98c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:05.086978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76e4055dc1f849e9a58e0fcc9bd6a98c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:05.088673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:05.107567 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:05.200413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76e4055dc1f849e9a58e0fcc9bd6a98c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:05.221166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76e4055dc1f849e9a58e0fcc9bd6a98c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:05.222060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76e4055dc1f849e9a58e0fcc9bd6a98c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:05.237468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76e4055dc1f849e9a58e0fcc9bd6a98c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:05.273318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76e4055dc1f849e9a58e0fcc9bd6a98c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:05.295841 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1441/2865] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:00:04 2022] DELETE /identity/v3/users/76e4055dc1f849e9a58e0fcc9bd6a98c => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:05.300122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786176b0-e909-4506-a69e-78bd18283642 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:05.300536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786176b0-e909-4506-a69e-78bd18283642 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:05.300981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786176b0-e909-4506-a69e-78bd18283642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:05.362745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-786176b0-e909-4506-a69e-78bd18283642 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:05.364843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-786176b0-e909-4506-a69e-78bd18283642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:05.529439 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1425/2866] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:00:05.541401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:05.544387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:05.702008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa38674a-2d18-4b90-8d82-c13015246722 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:05.712569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166fe34-0211-4231-95eb-ccdabac3a92e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:05.713310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166fe34-0211-4231-95eb-ccdabac3a92e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:05.713612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166fe34-0211-4231-95eb-ccdabac3a92e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:05.713884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166fe34-0211-4231-95eb-ccdabac3a92e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:05.729675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166fe34-0211-4231-95eb-ccdabac3a92e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:05.731225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166fe34-0211-4231-95eb-ccdabac3a92e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:05.744646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1442/2867] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:00:06.584391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786176b0-e909-4506-a69e-78bd18283642 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:06.586746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-786176b0-e909-4506-a69e-78bd18283642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:06.615480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786176b0-e909-4506-a69e-78bd18283642 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:06.643460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:06.647414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:06.650520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:06.651633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] PATH_INFO: `/v3/projects/485b239908a64ef29e1cab5773aee8e3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:06.656234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] RBAC: Authorizing `identity:delete_project(project_id=485b239908a64ef29e1cab5773aee8e3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:06.666420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:06.838218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '485b239908a64ef29e1cab5773aee8e3', 'request_id': 'req-c356abe7-642a-4194-a469-d62a0c181040'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:06.855442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '485b239908a64ef29e1cab5773aee8e3', 'request_id': 'req-c356abe7-642a-4194-a469-d62a0c181040'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:06.877410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '485b239908a64ef29e1cab5773aee8e3', 'request_id': 'req-c356abe7-642a-4194-a469-d62a0c181040'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:06.912477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] The token cache is being invalidate because project 485b239908a64ef29e1cab5773aee8e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:00:06.913009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:06.913902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:06.919350 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1426/2868] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:06 2022] DELETE /identity/v3/projects/485b239908a64ef29e1cab5773aee8e3 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:06.920700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166fe34-0211-4231-95eb-ccdabac3a92e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:06.939309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166fe34-0211-4231-95eb-ccdabac3a92e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:07.074466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:07.075336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:07.075939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:07.076404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] PATH_INFO: `/v3/users/9612fab75102474794f9cb6c5e450e91` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:07.078542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9612fab75102474794f9cb6c5e450e91)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:07.091835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:07.194377 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:07.219423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9612fab75102474794f9cb6c5e450e91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:07.276851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9612fab75102474794f9cb6c5e450e91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:07.280351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9612fab75102474794f9cb6c5e450e91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:07.295377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9612fab75102474794f9cb6c5e450e91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:07.314005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a1be483b-c7c2-481c-b9f5-8ab5adcc6fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9612fab75102474794f9cb6c5e450e91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:07.329613 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1443/2869] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:00:06 2022] DELETE /identity/v3/users/9612fab75102474794f9cb6c5e450e91 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:00:09.816280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:09.820139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:09.844513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c356abe7-642a-4194-a469-d62a0c181040 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:10.006614 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:10.103659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:10.104338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:10.105470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:10.105760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] PATH_INFO: `/v3/projects/b663fb20d40a48f997d5656000dc4155` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:10.122338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b663fb20d40a48f997d5656000dc4155)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:10.136317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:10.283107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b663fb20d40a48f997d5656000dc4155', 'request_id': 'req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:10.291424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b663fb20d40a48f997d5656000dc4155', 'request_id': 'req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:10.307209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b663fb20d40a48f997d5656000dc4155', 'request_id': 'req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:10.325972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] The token cache is being invalidate because project b663fb20d40a48f997d5656000dc4155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:00:10.326266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:10.329240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6b0fe45-378e-40f7-a3e2-ef2f139e2001 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:10.336101 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1427/2870] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:09 2022] DELETE /identity/v3/projects/b663fb20d40a48f997d5656000dc4155 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:10.339636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27813-6a01-427b-864a-87fc6a186029 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:10.340090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27813-6a01-427b-864a-87fc6a186029 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:10.340192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d27813-6a01-427b-864a-87fc6a186029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:10.402279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-27d27813-6a01-427b-864a-87fc6a186029 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:10.406372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-27d27813-6a01-427b-864a-87fc6a186029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:10.636106 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1444/2871] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:10.717799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d7708-71a5-4fe1-a04f-2a44dfa0377c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:10.717799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d7708-71a5-4fe1-a04f-2a44dfa0377c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:10.717799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852d7708-71a5-4fe1-a04f-2a44dfa0377c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:10.752806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-852d7708-71a5-4fe1-a04f-2a44dfa0377c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:10.753972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-852d7708-71a5-4fe1-a04f-2a44dfa0377c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:10.778956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d27813-6a01-427b-864a-87fc6a186029 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:10.786578 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1428/2872] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:10.794344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d27813-6a01-427b-864a-87fc6a186029 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:10.804232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1c72e-b396-4f04-a0eb-82aa012431df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:10.804797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1c72e-b396-4f04-a0eb-82aa012431df admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:10.805077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1c72e-b396-4f04-a0eb-82aa012431df admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:10.805940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b1c72e-b396-4f04-a0eb-82aa012431df admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:10.806807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1c72e-b396-4f04-a0eb-82aa012431df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:00:10.806807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1c72e-b396-4f04-a0eb-82aa012431df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:10.808653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b1c72e-b396-4f04-a0eb-82aa012431df admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:10.829250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d7708-71a5-4fe1-a04f-2a44dfa0377c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:10.836474 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1445/2873] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:00:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:00:10.843069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852d7708-71a5-4fe1-a04f-2a44dfa0377c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:10.849559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867fc04-452c-45e0-b8e6-eabc3de9e35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:10.850755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867fc04-452c-45e0-b8e6-eabc3de9e35c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:10.851332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867fc04-452c-45e0-b8e6-eabc3de9e35c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:10.851645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2867fc04-452c-45e0-b8e6-eabc3de9e35c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:10.852288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867fc04-452c-45e0-b8e6-eabc3de9e35c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:10.854529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2867fc04-452c-45e0-b8e6-eabc3de9e35c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:10.915405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1c72e-b396-4f04-a0eb-82aa012431df admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:10.927610 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1429/2874] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:00:10 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:00:10.931950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b1c72e-b396-4f04-a0eb-82aa012431df admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:11.131619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc4092-7390-4e6c-8df1-6614515e1d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:11.132258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc4092-7390-4e6c-8df1-6614515e1d2f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:11.132558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc4092-7390-4e6c-8df1-6614515e1d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:11.132960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bc4092-7390-4e6c-8df1-6614515e1d2f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:11.135866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc4092-7390-4e6c-8df1-6614515e1d2f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:11.139622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bc4092-7390-4e6c-8df1-6614515e1d2f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:11.228337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867fc04-452c-45e0-b8e6-eabc3de9e35c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:11.237352 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1446/2875] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:00:10 2022] POST /identity/v3/users => generated 295 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:00:11.251101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2867fc04-452c-45e0-b8e6-eabc3de9e35c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:11.283315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e1a3-adf0-4fa2-ba41-ed98b3fa4a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:11.283971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e1a3-adf0-4fa2-ba41-ed98b3fa4a9e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:11.284252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e1a3-adf0-4fa2-ba41-ed98b3fa4a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:11.284535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146e1a3-adf0-4fa2-ba41-ed98b3fa4a9e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:11.294567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146e1a3-adf0-4fa2-ba41-ed98b3fa4a9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:11.306822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146e1a3-adf0-4fa2-ba41-ed98b3fa4a9e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:11.381375 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1430/2876] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:00:11.382985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc4092-7390-4e6c-8df1-6614515e1d2f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:11.409323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bc4092-7390-4e6c-8df1-6614515e1d2f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:11.435416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5d501d-e914-498a-af92-365852cf0dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:11.436075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d501d-e914-498a-af92-365852cf0dab admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:11.440274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d501d-e914-498a-af92-365852cf0dab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:11.440563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5d501d-e914-498a-af92-365852cf0dab admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:11.441256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d501d-e914-498a-af92-365852cf0dab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:11.451794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5d501d-e914-498a-af92-365852cf0dab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:11.500572 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1447/2877] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:00:11 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:00:11.502587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e1a3-adf0-4fa2-ba41-ed98b3fa4a9e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:11.520256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146e1a3-adf0-4fa2-ba41-ed98b3fa4a9e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:11.545156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a30d2f-30a8-4e7d-8740-3f1fbf32c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:11.545876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a30d2f-30a8-4e7d-8740-3f1fbf32c6fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:11.553678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a30d2f-30a8-4e7d-8740-3f1fbf32c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:11.556067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a30d2f-30a8-4e7d-8740-3f1fbf32c6fb admin admin] PATH_INFO: `/v3/projects/897f1f7b22754bd6b4a94a7fc248c2f7/users/a82657f02b6640de939a15ce70840989/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:11.622521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a30d2f-30a8-4e7d-8740-3f1fbf32c6fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=897f1f7b22754bd6b4a94a7fc248c2f7, user_id=a82657f02b6640de939a15ce70840989, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:11.636327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a30d2f-30a8-4e7d-8740-3f1fbf32c6fb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:11.698236 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1431/2878] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:00:11 2022] PUT /identity/v3/projects/897f1f7b22754bd6b4a94a7fc248c2f7/users/a82657f02b6640de939a15ce70840989/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:11.710103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286ec0-b68d-4356-b05d-19b10740492a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:11.710440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286ec0-b68d-4356-b05d-19b10740492a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:11.711398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c286ec0-b68d-4356-b05d-19b10740492a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:11.830404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8c286ec0-b68d-4356-b05d-19b10740492a None None] MFA Rules not processed for user `a82657f02b6640de939a15ce70840989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:11.831767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8c286ec0-b68d-4356-b05d-19b10740492a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:11.895833 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:12.166881 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1448/2879] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:11 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:12.171883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a30d2f-30a8-4e7d-8740-3f1fbf32c6fb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:12.310317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a30d2f-30a8-4e7d-8740-3f1fbf32c6fb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:12.318383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ec8b-25f4-40e3-abd9-c7465705ba07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:12.319367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ec8b-25f4-40e3-abd9-c7465705ba07 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:12.320126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ec8b-25f4-40e3-abd9-c7465705ba07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:12.320556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e855ec8b-25f4-40e3-abd9-c7465705ba07 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:12.321494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855ec8b-25f4-40e3-abd9-c7465705ba07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:12.323921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e855ec8b-25f4-40e3-abd9-c7465705ba07 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:12.354496 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:12.389178 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1432/2880] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:00:12 2022] POST /identity/v3/projects => generated 389 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:00:12.393455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286ec0-b68d-4356-b05d-19b10740492a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:12.409904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c286ec0-b68d-4356-b05d-19b10740492a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:12.537317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febce5-b3ac-4c7d-9325-ea03900e8571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:12.538476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febce5-b3ac-4c7d-9325-ea03900e8571 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:12.538780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febce5-b3ac-4c7d-9325-ea03900e8571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:12.539095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5febce5-b3ac-4c7d-9325-ea03900e8571 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:12.540534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febce5-b3ac-4c7d-9325-ea03900e8571 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:12.544120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5febce5-b3ac-4c7d-9325-ea03900e8571 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:12.583267 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1449/2881] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:00:12 2022] POST /identity/v3/users => generated 301 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:00:12.585621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ec8b-25f4-40e3-abd9-c7465705ba07 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:12.643044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e855ec8b-25f4-40e3-abd9-c7465705ba07 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:12.674338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4e606-8a20-4b61-aee0-62d075e2323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:12.675274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e606-8a20-4b61-aee0-62d075e2323c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:12.675569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e606-8a20-4b61-aee0-62d075e2323c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:12.675900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4e606-8a20-4b61-aee0-62d075e2323c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:12.677143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4e606-8a20-4b61-aee0-62d075e2323c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:12.679001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4e606-8a20-4b61-aee0-62d075e2323c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:12.711626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1433/2882] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:00:12.716358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febce5-b3ac-4c7d-9325-ea03900e8571 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:12.735363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5febce5-b3ac-4c7d-9325-ea03900e8571 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:12.747859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264551-b515-40a6-8552-baee9195f421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:12.749891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264551-b515-40a6-8552-baee9195f421 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:12.750939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264551-b515-40a6-8552-baee9195f421 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:12.751242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7264551-b515-40a6-8552-baee9195f421 admin admin] PATH_INFO: `/v3/projects/447ec8c97bfe4acfa6b8697d437ed603/users/76fadbbc3a924430ab62ce9735c8a79d/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:12.795859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7264551-b515-40a6-8552-baee9195f421 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447ec8c97bfe4acfa6b8697d437ed603, user_id=76fadbbc3a924430ab62ce9735c8a79d, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:12.807288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7264551-b515-40a6-8552-baee9195f421 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:12.860215 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1450/2883] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:00:12 2022] PUT /identity/v3/projects/447ec8c97bfe4acfa6b8697d437ed603/users/76fadbbc3a924430ab62ce9735c8a79d/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:12.866544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4e606-8a20-4b61-aee0-62d075e2323c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:12.894236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4e606-8a20-4b61-aee0-62d075e2323c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:13.130244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1034c270-9bc6-417f-9014-649fb4c7679f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:13.130979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c270-9bc6-417f-9014-649fb4c7679f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:13.132653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c270-9bc6-417f-9014-649fb4c7679f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:13.132964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1034c270-9bc6-417f-9014-649fb4c7679f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:13.139091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c270-9bc6-417f-9014-649fb4c7679f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:13.145989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1034c270-9bc6-417f-9014-649fb4c7679f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:13.177934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1434/2884] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:00:12 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:00:13.179532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264551-b515-40a6-8552-baee9195f421 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:13.192728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7264551-b515-40a6-8552-baee9195f421 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:13.230917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d993ee-019c-4493-bc96-d65317f0db64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:13.231830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d993ee-019c-4493-bc96-d65317f0db64 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:13.232332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d993ee-019c-4493-bc96-d65317f0db64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:13.233000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d993ee-019c-4493-bc96-d65317f0db64 admin admin] PATH_INFO: `/v3/projects/447ec8c97bfe4acfa6b8697d437ed603/users/76fadbbc3a924430ab62ce9735c8a79d/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:13.251811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d993ee-019c-4493-bc96-d65317f0db64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=447ec8c97bfe4acfa6b8697d437ed603, user_id=76fadbbc3a924430ab62ce9735c8a79d, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:13.255810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d993ee-019c-4493-bc96-d65317f0db64 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:13.295631 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1451/2885] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:00:13 2022] PUT /identity/v3/projects/447ec8c97bfe4acfa6b8697d437ed603/users/76fadbbc3a924430ab62ce9735c8a79d/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:13.307617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ead1d8-d252-441c-a9a7-51fbd49fc649 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:13.307966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ead1d8-d252-441c-a9a7-51fbd49fc649 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:13.308244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ead1d8-d252-441c-a9a7-51fbd49fc649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:13.413264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-48ead1d8-d252-441c-a9a7-51fbd49fc649 None None] MFA Rules not processed for user `76fadbbc3a924430ab62ce9735c8a79d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:13.414636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-48ead1d8-d252-441c-a9a7-51fbd49fc649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:13.784816 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1435/2886] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:13 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 477 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:13.844106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d993ee-019c-4493-bc96-d65317f0db64 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:13.851200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-34d993ee-019c-4493-bc96-d65317f0db64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:14.228921 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:14.266404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d993ee-019c-4493-bc96-d65317f0db64 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:14.284271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf8c14-e9c3-4903-ae61-501ac6d89d24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:14.284926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf8c14-e9c3-4903-ae61-501ac6d89d24 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:14.285772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf8c14-e9c3-4903-ae61-501ac6d89d24 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:14.286054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facf8c14-e9c3-4903-ae61-501ac6d89d24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:14.402651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf8c14-e9c3-4903-ae61-501ac6d89d24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:14.404778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facf8c14-e9c3-4903-ae61-501ac6d89d24 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:14.419922 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1452/2887] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:13 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:00:17.241578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ead1d8-d252-441c-a9a7-51fbd49fc649 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:17.243548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-48ead1d8-d252-441c-a9a7-51fbd49fc649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:17.291092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ead1d8-d252-441c-a9a7-51fbd49fc649 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:17.337118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d208c07-5c54-443b-93b8-671df950797c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:17.338713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d208c07-5c54-443b-93b8-671df950797c service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:17.339364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d208c07-5c54-443b-93b8-671df950797c service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:17.339840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d208c07-5c54-443b-93b8-671df950797c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:17.371744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d208c07-5c54-443b-93b8-671df950797c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:17.374475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d208c07-5c54-443b-93b8-671df950797c service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:17.393682 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1436/2888] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:17 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:00:24.413766 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=28 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:27.197963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf8c14-e9c3-4903-ae61-501ac6d89d24 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:27.346547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facf8c14-e9c3-4903-ae61-501ac6d89d24 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:27.364611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:27.365270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:27.365583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:27.365913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] PATH_INFO: `/v3/users/a82657f02b6640de939a15ce70840989` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:27.368326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82657f02b6640de939a15ce70840989)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:27.373001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:27.386563 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=1,keystone:SELECT=76 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:27.469655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82657f02b6640de939a15ce70840989'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:27.491955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82657f02b6640de939a15ce70840989'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:27.493088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82657f02b6640de939a15ce70840989'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:27.506000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82657f02b6640de939a15ce70840989'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:27.519374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52480d01-56a0-40bc-b51a-c1087d3d3858 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82657f02b6640de939a15ce70840989'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:27.532738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e0e66-2ef9-4483-b2f0-9d7dc54a4de6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:27.533062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e0e66-2ef9-4483-b2f0-9d7dc54a4de6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:27.533493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337e0e66-2ef9-4483-b2f0-9d7dc54a4de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:27.544787 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1453/2889] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:00:27 2022] DELETE /identity/v3/users/a82657f02b6640de939a15ce70840989 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:27.573671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-337e0e66-2ef9-4483-b2f0-9d7dc54a4de6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:27.575423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87576c98-5dce-456c-b126-36963c3146e1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:27.575857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87576c98-5dce-456c-b126-36963c3146e1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:27.576265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87576c98-5dce-456c-b126-36963c3146e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:27.588594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-337e0e66-2ef9-4483-b2f0-9d7dc54a4de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:27.610850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-87576c98-5dce-456c-b126-36963c3146e1 None None] MFA Rules not processed for user `b245555254674c8eac74a684b9da59cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:27.612568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-87576c98-5dce-456c-b126-36963c3146e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:27.727983 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1454/2890] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:27.751710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cde6fb-a919-4ff8-b85c-374daa9d4466 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:27.752527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cde6fb-a919-4ff8-b85c-374daa9d4466 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:27.752527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cde6fb-a919-4ff8-b85c-374daa9d4466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:27.781263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-56cde6fb-a919-4ff8-b85c-374daa9d4466 None None] MFA Rules not processed for user `b245555254674c8eac74a684b9da59cc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:27.782482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56cde6fb-a919-4ff8-b85c-374daa9d4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:27.793344 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1455/2891] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:27.804563 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1437/2892] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:27.814847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cde6fb-a919-4ff8-b85c-374daa9d4466 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:27.818133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56cde6fb-a919-4ff8-b85c-374daa9d4466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:27.847285 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:27.875854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac166865-2535-486b-ad34-d80b77028222 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:27.876145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac166865-2535-486b-ad34-d80b77028222 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:27.876628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac166865-2535-486b-ad34-d80b77028222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:27.898593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ac166865-2535-486b-ad34-d80b77028222 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:27.899927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ac166865-2535-486b-ad34-d80b77028222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:27.922862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cde6fb-a919-4ff8-b85c-374daa9d4466 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:27.927328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1cec-257f-4833-9e59-18ec47e6f009 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:27.928498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1cec-257f-4833-9e59-18ec47e6f009 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:27.928775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1cec-257f-4833-9e59-18ec47e6f009 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:27.929026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075a1cec-257f-4833-9e59-18ec47e6f009 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:27.940986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a1cec-257f-4833-9e59-18ec47e6f009 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:27.942970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075a1cec-257f-4833-9e59-18ec47e6f009 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:27.955129 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1456/2893] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:00:27.979621 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1438/2894] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:00:27 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:00:27.996911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1cec-257f-4833-9e59-18ec47e6f009 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:27.998364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-075a1cec-257f-4833-9e59-18ec47e6f009 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:28.091136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075a1cec-257f-4833-9e59-18ec47e6f009 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:28.097120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00094cd-a0f4-44a0-94c1-1cc0c1dbfa43 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:28.098525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00094cd-a0f4-44a0-94c1-1cc0c1dbfa43 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:28.099089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00094cd-a0f4-44a0-94c1-1cc0c1dbfa43 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:28.099427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00094cd-a0f4-44a0-94c1-1cc0c1dbfa43 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:28.114255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00094cd-a0f4-44a0-94c1-1cc0c1dbfa43 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:28.116138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00094cd-a0f4-44a0-94c1-1cc0c1dbfa43 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:28.125999 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1457/2895] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:00:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:00:28.474823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac166865-2535-486b-ad34-d80b77028222 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:28.476320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ac166865-2535-486b-ad34-d80b77028222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:28.503359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac166865-2535-486b-ad34-d80b77028222 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:28.520663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:28.528615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:28.529045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:28.529318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] PATH_INFO: `/v3/projects/897f1f7b22754bd6b4a94a7fc248c2f7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:28.537917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] RBAC: Authorizing `identity:delete_project(project_id=897f1f7b22754bd6b4a94a7fc248c2f7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:28.540023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:28.661354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '897f1f7b22754bd6b4a94a7fc248c2f7', 'request_id': 'req-c0bfe8c4-5b21-4df6-a028-b7eec477c781'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:28.668846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '897f1f7b22754bd6b4a94a7fc248c2f7', 'request_id': 'req-c0bfe8c4-5b21-4df6-a028-b7eec477c781'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:28.678309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '897f1f7b22754bd6b4a94a7fc248c2f7', 'request_id': 'req-c0bfe8c4-5b21-4df6-a028-b7eec477c781'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:28.690562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] The token cache is being invalidate because project 897f1f7b22754bd6b4a94a7fc248c2f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:00:28.691090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:28.692429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0bfe8c4-5b21-4df6-a028-b7eec477c781 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:28.698858 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1439/2896] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:28 2022] DELETE /identity/v3/projects/897f1f7b22754bd6b4a94a7fc248c2f7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:28.699716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00094cd-a0f4-44a0-94c1-1cc0c1dbfa43 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:28.712458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00094cd-a0f4-44a0-94c1-1cc0c1dbfa43 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:28.863010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:28.864897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:28.865399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:28.865902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] PATH_INFO: `/v3/users/76fadbbc3a924430ab62ce9735c8a79d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:28.867594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=76fadbbc3a924430ab62ce9735c8a79d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:28.869849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:28.956019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76fadbbc3a924430ab62ce9735c8a79d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:28.967604 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:28.985624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76fadbbc3a924430ab62ce9735c8a79d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:28.987860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76fadbbc3a924430ab62ce9735c8a79d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:29.000241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76fadbbc3a924430ab62ce9735c8a79d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:29.021441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76fadbbc3a924430ab62ce9735c8a79d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:29.039311 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1458/2897] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:00:28 2022] DELETE /identity/v3/users/76fadbbc3a924430ab62ce9735c8a79d => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:29.104061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054289e1-ba3a-42ce-8b4a-29b572681ec0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:29.104353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054289e1-ba3a-42ce-8b4a-29b572681ec0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:29.104782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054289e1-ba3a-42ce-8b4a-29b572681ec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:29.152798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-054289e1-ba3a-42ce-8b4a-29b572681ec0 None None] MFA Rules not processed for user `ca932e5866274fc78b04689811e72746`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:29.154147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-054289e1-ba3a-42ce-8b4a-29b572681ec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:29.189774 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:29.260061 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1440/2898] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:29.376404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:29.379943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:29.552970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bc93f4-7537-419a-9283-3a488caece23 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:29.565228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:29.567991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:29.568349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:29.568704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] PATH_INFO: `/v3/projects/447ec8c97bfe4acfa6b8697d437ed603` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:29.570812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] RBAC: Authorizing `identity:delete_project(project_id=447ec8c97bfe4acfa6b8697d437ed603)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:29.577194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:29.678535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '447ec8c97bfe4acfa6b8697d437ed603', 'request_id': 'req-eeec5a51-3075-4aed-a8e5-86179c9e028f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:29.692746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '447ec8c97bfe4acfa6b8697d437ed603', 'request_id': 'req-eeec5a51-3075-4aed-a8e5-86179c9e028f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:29.706699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '447ec8c97bfe4acfa6b8697d437ed603', 'request_id': 'req-eeec5a51-3075-4aed-a8e5-86179c9e028f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:29.734521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] The token cache is being invalidate because project 447ec8c97bfe4acfa6b8697d437ed603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:00:29.734933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:29.736357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eeec5a51-3075-4aed-a8e5-86179c9e028f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:00:29.742564 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1459/2899] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:00:29 2022] DELETE /identity/v3/projects/447ec8c97bfe4acfa6b8697d437ed603 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:29.744296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc982094-366b-45d3-8b4f-9c1b6b65c06c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:29.745105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc982094-366b-45d3-8b4f-9c1b6b65c06c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:29.745608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc982094-366b-45d3-8b4f-9c1b6b65c06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:29.781998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fc982094-366b-45d3-8b4f-9c1b6b65c06c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:29.783567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fc982094-366b-45d3-8b4f-9c1b6b65c06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:29.902934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1441/2900] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:29.911929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe080e-010c-4b93-87b7-ab68ccc2baed None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:29.912143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe080e-010c-4b93-87b7-ab68ccc2baed None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:29.912378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe080e-010c-4b93-87b7-ab68ccc2baed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:29.956857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c3fe080e-010c-4b93-87b7-ab68ccc2baed None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:29.963526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c3fe080e-010c-4b93-87b7-ab68ccc2baed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:29.981557 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1460/2901] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:29.983029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc982094-366b-45d3-8b4f-9c1b6b65c06c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:29.993266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc982094-366b-45d3-8b4f-9c1b6b65c06c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:30.009337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cadaec-7076-43ea-bb4b-f17305854777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:30.010015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cadaec-7076-43ea-bb4b-f17305854777 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:30.010353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cadaec-7076-43ea-bb4b-f17305854777 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:30.010664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cadaec-7076-43ea-bb4b-f17305854777 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:30.011406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cadaec-7076-43ea-bb4b-f17305854777 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:00:30.011720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cadaec-7076-43ea-bb4b-f17305854777 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:30.013372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cadaec-7076-43ea-bb4b-f17305854777 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:30.046434 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1442/2902] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:00:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:00:30.047581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe080e-010c-4b93-87b7-ab68ccc2baed None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:30.059832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe080e-010c-4b93-87b7-ab68ccc2baed None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:30.072008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1a82e-b8aa-449f-893f-c72249fbdc80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:30.074587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1a82e-b8aa-449f-893f-c72249fbdc80 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:30.074880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1a82e-b8aa-449f-893f-c72249fbdc80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:30.077488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1a82e-b8aa-449f-893f-c72249fbdc80 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:30.078220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1a82e-b8aa-449f-893f-c72249fbdc80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:30.080305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1a82e-b8aa-449f-893f-c72249fbdc80 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:30.166664 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1461/2903] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:00:30 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:00:30.168734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cadaec-7076-43ea-bb4b-f17305854777 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:30.179012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cadaec-7076-43ea-bb4b-f17305854777 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:30.313592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db5ef9-21b9-479b-9515-c519f40c32af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:30.314154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db5ef9-21b9-479b-9515-c519f40c32af admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:30.314435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db5ef9-21b9-479b-9515-c519f40c32af admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:30.314707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51db5ef9-21b9-479b-9515-c519f40c32af admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:30.315362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db5ef9-21b9-479b-9515-c519f40c32af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:30.317384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51db5ef9-21b9-479b-9515-c519f40c32af admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:30.365479 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1443/2904] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:00:30 2022] POST /identity/v3/users => generated 288 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:00:30.366850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1a82e-b8aa-449f-893f-c72249fbdc80 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:30.388648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1a82e-b8aa-449f-893f-c72249fbdc80 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:30.407234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f627525-e575-4fd5-a301-9b1c8ca43f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:30.408197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f627525-e575-4fd5-a301-9b1c8ca43f81 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:30.408688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f627525-e575-4fd5-a301-9b1c8ca43f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:30.409171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f627525-e575-4fd5-a301-9b1c8ca43f81 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:30.411683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f627525-e575-4fd5-a301-9b1c8ca43f81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:30.413647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f627525-e575-4fd5-a301-9b1c8ca43f81 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:30.455566 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1462/2905] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:00:30.460236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db5ef9-21b9-479b-9515-c519f40c32af admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:30.479914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51db5ef9-21b9-479b-9515-c519f40c32af admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:30.485771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89184962-a4d8-42fe-aef9-f0e1a838040d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:30.486377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89184962-a4d8-42fe-aef9-f0e1a838040d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:30.486656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89184962-a4d8-42fe-aef9-f0e1a838040d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:30.486924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89184962-a4d8-42fe-aef9-f0e1a838040d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:30.487656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89184962-a4d8-42fe-aef9-f0e1a838040d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:30.494585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89184962-a4d8-42fe-aef9-f0e1a838040d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:30.507543 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1444/2906] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:00:30.511411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f627525-e575-4fd5-a301-9b1c8ca43f81 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:30.525436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f627525-e575-4fd5-a301-9b1c8ca43f81 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:30.539946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a295-5841-4341-9e8c-5476cdce47bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:30.540918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a295-5841-4341-9e8c-5476cdce47bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:30.541440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a295-5841-4341-9e8c-5476cdce47bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:30.541922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d8a295-5841-4341-9e8c-5476cdce47bd admin admin] PATH_INFO: `/v3/projects/72bbfc5e1e574b689ef044341663b776/users/0fd6766aed02437eb254480dba23f9db/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:30.577853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8a295-5841-4341-9e8c-5476cdce47bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=72bbfc5e1e574b689ef044341663b776, user_id=0fd6766aed02437eb254480dba23f9db, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:30.580766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d8a295-5841-4341-9e8c-5476cdce47bd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:30.588799 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:30.605699 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1463/2907] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:00:30 2022] PUT /identity/v3/projects/72bbfc5e1e574b689ef044341663b776/users/0fd6766aed02437eb254480dba23f9db/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:30.616631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2042ab2-f07e-40c8-b4e7-0dd2e33c3843 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:30.616969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2042ab2-f07e-40c8-b4e7-0dd2e33c3843 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:30.617189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2042ab2-f07e-40c8-b4e7-0dd2e33c3843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:30.725637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a2042ab2-f07e-40c8-b4e7-0dd2e33c3843 None None] MFA Rules not processed for user `0fd6766aed02437eb254480dba23f9db`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:30.727800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a2042ab2-f07e-40c8-b4e7-0dd2e33c3843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:30.782769 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:30.894543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a295-5841-4341-9e8c-5476cdce47bd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:30.896187 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1445/2908] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:00:31.062519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d8a295-5841-4341-9e8c-5476cdce47bd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:31.071695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9a02-41b7-409b-a2e8-ebe40484d748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:31.072556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9a02-41b7-409b-a2e8-ebe40484d748 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:31.072923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9a02-41b7-409b-a2e8-ebe40484d748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:31.073767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5a9a02-41b7-409b-a2e8-ebe40484d748 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:31.076399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a9a02-41b7-409b-a2e8-ebe40484d748 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:31.078469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5a9a02-41b7-409b-a2e8-ebe40484d748 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:31.149665 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1464/2909] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:00:30 2022] POST /identity/v3/projects => generated 377 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:00:31.151199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2042ab2-f07e-40c8-b4e7-0dd2e33c3843 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:31.167903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2042ab2-f07e-40c8-b4e7-0dd2e33c3843 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:31.344279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9adf43-9d7b-41e9-8150-03d2aa51549a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:31.345489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9adf43-9d7b-41e9-8150-03d2aa51549a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:31.345926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9adf43-9d7b-41e9-8150-03d2aa51549a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:31.346369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9adf43-9d7b-41e9-8150-03d2aa51549a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:31.347446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9adf43-9d7b-41e9-8150-03d2aa51549a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:31.350814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9adf43-9d7b-41e9-8150-03d2aa51549a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:31.402043 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1446/2910] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:00:31 2022] POST /identity/v3/users => generated 295 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:00:31.406249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9a02-41b7-409b-a2e8-ebe40484d748 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:31.429418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5a9a02-41b7-409b-a2e8-ebe40484d748 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:31.440724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28687a-9b89-4d6b-965c-fc2ea9b3802a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:31.449540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28687a-9b89-4d6b-965c-fc2ea9b3802a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:31.450043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28687a-9b89-4d6b-965c-fc2ea9b3802a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:31.450450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f28687a-9b89-4d6b-965c-fc2ea9b3802a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:31.451229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28687a-9b89-4d6b-965c-fc2ea9b3802a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:31.453113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f28687a-9b89-4d6b-965c-fc2ea9b3802a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:31.529005 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1465/2911] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:00:31.534171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9adf43-9d7b-41e9-8150-03d2aa51549a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:31.561176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9adf43-9d7b-41e9-8150-03d2aa51549a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:31.587664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe0f0-e9a5-4bcf-b1e5-ae22e3b99c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:31.588618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe0f0-e9a5-4bcf-b1e5-ae22e3b99c1a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:31.589077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe0f0-e9a5-4bcf-b1e5-ae22e3b99c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:31.589553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bffe0f0-e9a5-4bcf-b1e5-ae22e3b99c1a admin admin] PATH_INFO: `/v3/projects/3044fc3726124c13980277eda94bbd3e/users/5bf6db6e2b53482cb4a38b1319ba971f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:31.642429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe0f0-e9a5-4bcf-b1e5-ae22e3b99c1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3044fc3726124c13980277eda94bbd3e, user_id=5bf6db6e2b53482cb4a38b1319ba971f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:31.645622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bffe0f0-e9a5-4bcf-b1e5-ae22e3b99c1a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:31.685851 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1447/2912] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:00:31 2022] PUT /identity/v3/projects/3044fc3726124c13980277eda94bbd3e/users/5bf6db6e2b53482cb4a38b1319ba971f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:31.690013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28687a-9b89-4d6b-965c-fc2ea9b3802a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:31.706006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f28687a-9b89-4d6b-965c-fc2ea9b3802a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:31.841815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b043ed-5329-4e80-a037-f0454ba0ecc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:31.842651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b043ed-5329-4e80-a037-f0454ba0ecc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:31.843097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b043ed-5329-4e80-a037-f0454ba0ecc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:31.843457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b043ed-5329-4e80-a037-f0454ba0ecc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:31.844220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b043ed-5329-4e80-a037-f0454ba0ecc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:31.845998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b043ed-5329-4e80-a037-f0454ba0ecc9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:31.873358 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1466/2913] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:00:31.874955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe0f0-e9a5-4bcf-b1e5-ae22e3b99c1a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:31.891026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bffe0f0-e9a5-4bcf-b1e5-ae22e3b99c1a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:31.905349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45e0dd-fde6-4e24-9d66-171bd1beb84e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:31.906307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45e0dd-fde6-4e24-9d66-171bd1beb84e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:31.906739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45e0dd-fde6-4e24-9d66-171bd1beb84e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:31.907174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45e0dd-fde6-4e24-9d66-171bd1beb84e admin admin] PATH_INFO: `/v3/projects/3044fc3726124c13980277eda94bbd3e/users/5bf6db6e2b53482cb4a38b1319ba971f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:31.918520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45e0dd-fde6-4e24-9d66-171bd1beb84e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3044fc3726124c13980277eda94bbd3e, user_id=5bf6db6e2b53482cb4a38b1319ba971f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:31.922765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45e0dd-fde6-4e24-9d66-171bd1beb84e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:31.954841 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1448/2914] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:00:31 2022] PUT /identity/v3/projects/3044fc3726124c13980277eda94bbd3e/users/5bf6db6e2b53482cb4a38b1319ba971f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:00:31.956622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d843c0-056a-454a-956a-274e6360db51 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:31.957104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d843c0-056a-454a-956a-274e6360db51 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:31.957445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d843c0-056a-454a-956a-274e6360db51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:32.010153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-99d843c0-056a-454a-956a-274e6360db51 None None] MFA Rules not processed for user `5bf6db6e2b53482cb4a38b1319ba971f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:32.011507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-99d843c0-056a-454a-956a-274e6360db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:32.144348 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:32.232600 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1467/2915] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:31 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:32.242184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb808-a283-477c-87fe-1820ae963f40 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:32.242469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb808-a283-477c-87fe-1820ae963f40 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:32.243041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cbb808-a283-477c-87fe-1820ae963f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:32.284975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-79cbb808-a283-477c-87fe-1820ae963f40 None None] MFA Rules not processed for user `0fd6766aed02437eb254480dba23f9db`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:32.289560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-79cbb808-a283-477c-87fe-1820ae963f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:32.486878 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1449/2916] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:32.753179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d843c0-056a-454a-956a-274e6360db51 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:32.755353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-99d843c0-056a-454a-956a-274e6360db51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:32.965433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d843c0-056a-454a-956a-274e6360db51 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:32.984668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b8f65b-4ee5-41c4-9723-424b46a5b4b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:32.985789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f65b-4ee5-41c4-9723-424b46a5b4b7 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:32.986957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f65b-4ee5-41c4-9723-424b46a5b4b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:32.989333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b8f65b-4ee5-41c4-9723-424b46a5b4b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:33.011230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8f65b-4ee5-41c4-9723-424b46a5b4b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:33.014904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b8f65b-4ee5-41c4-9723-424b46a5b4b7 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:33.030535 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1468/2917] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:00:33.555772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fce7b4-66a7-4a19-9f4f-1e3fd8bf9109 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:33.556386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fce7b4-66a7-4a19-9f4f-1e3fd8bf9109 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:33.556386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fce7b4-66a7-4a19-9f4f-1e3fd8bf9109 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:33.558583 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1450/2918] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 09:00:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:00:33.566593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609ef28-2127-4d4e-8be7-a34713e20866 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:33.566861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609ef28-2127-4d4e-8be7-a34713e20866 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:33.567147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2609ef28-2127-4d4e-8be7-a34713e20866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:33.595824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2609ef28-2127-4d4e-8be7-a34713e20866 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:33.597437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2609ef28-2127-4d4e-8be7-a34713e20866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:33.624721 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1469/2919] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:00:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:33.641991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fce7b4-66a7-4a19-9f4f-1e3fd8bf9109 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:33.644407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2fce7b4-66a7-4a19-9f4f-1e3fd8bf9109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:33.717835 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:33.795607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fce7b4-66a7-4a19-9f4f-1e3fd8bf9109 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:33.804465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38800bfe-01c2-43c5-8d11-5133dac83dde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:33.805289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38800bfe-01c2-43c5-8d11-5133dac83dde service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:33.805724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38800bfe-01c2-43c5-8d11-5133dac83dde service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:33.806204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38800bfe-01c2-43c5-8d11-5133dac83dde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:33.810238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c501-3367-4ccc-b447-6616d150bb70 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:33.810753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c501-3367-4ccc-b447-6616d150bb70 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:33.811178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc57c501-3367-4ccc-b447-6616d150bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:33.855336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bc57c501-3367-4ccc-b447-6616d150bb70 None None] MFA Rules not processed for user `0fd6766aed02437eb254480dba23f9db`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:33.856824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc57c501-3367-4ccc-b447-6616d150bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:33.867718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38800bfe-01c2-43c5-8d11-5133dac83dde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:33.869235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38800bfe-01c2-43c5-8d11-5133dac83dde service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:33.872445 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1470/2920] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:00:33.929908 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1451/2921] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:00:36.306916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c501-3367-4ccc-b447-6616d150bb70 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:36.323706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc57c501-3367-4ccc-b447-6616d150bb70 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:36.340531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:36.341384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:36.341891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:36.342411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:36.347636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:36.490620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:36.492903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:36.528869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1471/2922] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:00:43.894394 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=14 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:46.505586 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=72 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:00:51.819964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38800bfe-01c2-43c5-8d11-5133dac83dde service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:51.833089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38800bfe-01c2-43c5-8d11-5133dac83dde service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:51.839724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98efc2-7abe-454b-ab44-3ce347b4f7b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:51.842311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98efc2-7abe-454b-ab44-3ce347b4f7b3 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:51.842792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98efc2-7abe-454b-ab44-3ce347b4f7b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:51.843755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98efc2-7abe-454b-ab44-3ce347b4f7b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:51.849222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb98efc2-7abe-454b-ab44-3ce347b4f7b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:51.893573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98efc2-7abe-454b-ab44-3ce347b4f7b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:51.897004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98efc2-7abe-454b-ab44-3ce347b4f7b3 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:51.919594 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1452/2923] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:00:54.261668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:54.264295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:54.285101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ddddf6-332e-40fe-a838-ed2b290436ae service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:54.296077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05524590-f7f8-453a-b687-c745c7fda7c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:54.297124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05524590-f7f8-453a-b687-c745c7fda7c8 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:54.297685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05524590-f7f8-453a-b687-c745c7fda7c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:54.298108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05524590-f7f8-453a-b687-c745c7fda7c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:54.311112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-05524590-f7f8-453a-b687-c745c7fda7c8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:54.354293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05524590-f7f8-453a-b687-c745c7fda7c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:54.359789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05524590-f7f8-453a-b687-c745c7fda7c8 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:54.392539 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1472/2924] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:00:57.355356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ec2d-58d9-4127-923c-7ac73fa85679 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:57.355902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ec2d-58d9-4127-923c-7ac73fa85679 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:57.355997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e4ec2d-58d9-4127-923c-7ac73fa85679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:57.418422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-61e4ec2d-58d9-4127-923c-7ac73fa85679 None None] MFA Rules not processed for user `7e709503bbff4c239491b0f109673264`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:57.427251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-61e4ec2d-58d9-4127-923c-7ac73fa85679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:57.665942 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1453/2925] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:57 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:58.247489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821ae7-0a85-4537-ba35-ab5e95cd267f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:58.247930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821ae7-0a85-4537-ba35-ab5e95cd267f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:58.248019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13821ae7-0a85-4537-ba35-ab5e95cd267f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:58.285623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-13821ae7-0a85-4537-ba35-ab5e95cd267f None None] MFA Rules not processed for user `0a5f0704d95640a99457ddd8652f83ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:00:58.287092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-13821ae7-0a85-4537-ba35-ab5e95cd267f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:58.308413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1473/2926] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:00:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:00:59.323002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ec2d-58d9-4127-923c-7ac73fa85679 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:00:59.362121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e4ec2d-58d9-4127-923c-7ac73fa85679 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:00:59.377919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:00:59.378798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:00:59.379257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:00:59.379691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:00:59.381714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:00:59.411455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:00:59.413147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:00:59.434411 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1454/2927] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:00:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:00.670104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c116a-b1a8-42b3-ba00-e83db1a04381 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:00.670639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c116a-b1a8-42b3-ba00-e83db1a04381 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:00.670715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c116a-b1a8-42b3-ba00-e83db1a04381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:00.848499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:00.851836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:00.858321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4e9c116a-b1a8-42b3-ba00-e83db1a04381 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:00.859561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e9c116a-b1a8-42b3-ba00-e83db1a04381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:01.005648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0b5bc-1116-4234-bfb5-55e7ee44f5d5 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:01.024319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a8fc4-6943-4bb0-bc5d-cf0f08da3b3f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:01.027860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a8fc4-6943-4bb0-bc5d-cf0f08da3b3f service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:01.028549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a8fc4-6943-4bb0-bc5d-cf0f08da3b3f service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:01.029515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5a8fc4-6943-4bb0-bc5d-cf0f08da3b3f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:01.037331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ec5a8fc4-6943-4bb0-bc5d-cf0f08da3b3f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:01.045459 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1474/2928] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:01:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 376 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:01.082322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c116a-b1a8-42b3-ba00-e83db1a04381 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:01.084292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e9c116a-b1a8-42b3-ba00-e83db1a04381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:01.096463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a8fc4-6943-4bb0-bc5d-cf0f08da3b3f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:01.099623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5a8fc4-6943-4bb0-bc5d-cf0f08da3b3f service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:01.149463 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1455/2929] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:01.239590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c116a-b1a8-42b3-ba00-e83db1a04381 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:01.247939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d0089-414a-417a-bcaa-0b329eba9bd7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:01.248802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0089-414a-417a-bcaa-0b329eba9bd7 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:01.249625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0089-414a-417a-bcaa-0b329eba9bd7 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:01.250159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5d0089-414a-417a-bcaa-0b329eba9bd7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:01.261188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d0089-414a-417a-bcaa-0b329eba9bd7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:01.263014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5d0089-414a-417a-bcaa-0b329eba9bd7 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:01.284762 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1475/2930] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:01:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:01.574392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a8fc4-6943-4bb0-bc5d-cf0f08da3b3f service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:01.588143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5a8fc4-6943-4bb0-bc5d-cf0f08da3b3f service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:01.603558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80f2a3-3f00-47db-93d4-b0165ce8ecfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:01.604819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80f2a3-3f00-47db-93d4-b0165ce8ecfc service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:01.605272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80f2a3-3f00-47db-93d4-b0165ce8ecfc service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:01.606002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80f2a3-3f00-47db-93d4-b0165ce8ecfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:01.608662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-db80f2a3-3f00-47db-93d4-b0165ce8ecfc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:01.827813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80f2a3-3f00-47db-93d4-b0165ce8ecfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:01.832992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80f2a3-3f00-47db-93d4-b0165ce8ecfc service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:01.869356 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1456/2931] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:01.990952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d0089-414a-417a-bcaa-0b329eba9bd7 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:01.993680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc5d0089-414a-417a-bcaa-0b329eba9bd7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:02.024892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5d0089-414a-417a-bcaa-0b329eba9bd7 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:02.040053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:02.041073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:02.041630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:02.042145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] PATH_INFO: `/v3/users/9f3fa66a009149e8b5cec58e4b24a788` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:02.044102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f3fa66a009149e8b5cec58e4b24a788)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:02.046372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:02.085613 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:02.161864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f3fa66a009149e8b5cec58e4b24a788'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:02.204851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f3fa66a009149e8b5cec58e4b24a788'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:02.205945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f3fa66a009149e8b5cec58e4b24a788'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:02.218840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80f2a3-3f00-47db-93d4-b0165ce8ecfc service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:02.222466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f3fa66a009149e8b5cec58e4b24a788'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:02.224023 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:02.232819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80f2a3-3f00-47db-93d4-b0165ce8ecfc service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:02.241965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7ab1234d-8bfc-45ed-8047-85c6de1d8e98 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f3fa66a009149e8b5cec58e4b24a788'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:02.243757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:02.244616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:02.245100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:02.245631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:02.248930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:02.289338 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1476/2932] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:01:01 2022] DELETE /identity/v3/users/9f3fa66a009149e8b5cec58e4b24a788 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:02.291336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:02.296819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:02.321725 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1457/2933] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:02.443550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185a5a-9679-4bcf-ab55-a0e896034fe4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:02.443859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185a5a-9679-4bcf-ab55-a0e896034fe4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:02.444248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3185a5a-9679-4bcf-ab55-a0e896034fe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:02.547989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d3185a5a-9679-4bcf-ab55-a0e896034fe4 None None] MFA Rules not processed for user `0fd6766aed02437eb254480dba23f9db`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:02.563170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d3185a5a-9679-4bcf-ab55-a0e896034fe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:02.702368 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1477/2934] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:03.207830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:03.212494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:03.273605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f729f8-da40-4e33-a734-d5deabfbf0f2 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:03.429234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:03.429913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:03.431809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:03.432101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] PATH_INFO: `/v3/projects/c229d0d4780449dd9b751ffb8b1b734d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:03.434783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c229d0d4780449dd9b751ffb8b1b734d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:03.442498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:03.525670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c229d0d4780449dd9b751ffb8b1b734d', 'request_id': 'req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.535937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c229d0d4780449dd9b751ffb8b1b734d', 'request_id': 'req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.554382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c229d0d4780449dd9b751ffb8b1b734d', 'request_id': 'req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.571992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] The token cache is being invalidate because project c229d0d4780449dd9b751ffb8b1b734d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:01:03.572300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.572998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.578644 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1458/2935] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:03 2022] DELETE /identity/v3/projects/c229d0d4780449dd9b751ffb8b1b734d => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:03.579874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185a5a-9679-4bcf-ab55-a0e896034fe4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:03.605860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3185a5a-9679-4bcf-ab55-a0e896034fe4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:03.757877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:03.758558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:03.758835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:03.759106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] PATH_INFO: `/v3/users/d0ac6c6a70544337a25ab96d25156a07` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:03.760375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0ac6c6a70544337a25ab96d25156a07)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:03.762594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:03.875341 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:03.890650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0ac6c6a70544337a25ab96d25156a07'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.923574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0ac6c6a70544337a25ab96d25156a07'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.924451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0ac6c6a70544337a25ab96d25156a07'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.941961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0ac6c6a70544337a25ab96d25156a07'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.960949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9ed929-8011-4535-86e0-727f7a24c8f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0ac6c6a70544337a25ab96d25156a07'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:03.979448 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1478/2936] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:01:03 2022] DELETE /identity/v3/users/d0ac6c6a70544337a25ab96d25156a07 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:01:04.924968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:04.927124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:04.945164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1a189d-cc04-4ecb-968e-747a44d0ecc3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:05.130768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:05.131580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:05.131978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:05.132340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] PATH_INFO: `/v3/projects/50d8e630279847609d36865cdfb1bf96` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:05.134281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=50d8e630279847609d36865cdfb1bf96)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:05.137163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:05.203183 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:05.265947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50d8e630279847609d36865cdfb1bf96', 'request_id': 'req-43bbd615-eed2-46c9-b747-50aff0b6d8ee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:05.287625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50d8e630279847609d36865cdfb1bf96', 'request_id': 'req-43bbd615-eed2-46c9-b747-50aff0b6d8ee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:05.297451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50d8e630279847609d36865cdfb1bf96', 'request_id': 'req-43bbd615-eed2-46c9-b747-50aff0b6d8ee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:05.320635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] The token cache is being invalidate because project 50d8e630279847609d36865cdfb1bf96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:01:05.321330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:05.323997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43bbd615-eed2-46c9-b747-50aff0b6d8ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:05.327310 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1459/2937] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:04 2022] DELETE /identity/v3/projects/50d8e630279847609d36865cdfb1bf96 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:05.332599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a19c0-b1e3-4a53-8661-e4497ec81177 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:05.333945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a19c0-b1e3-4a53-8661-e4497ec81177 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:05.334479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3a19c0-b1e3-4a53-8661-e4497ec81177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:05.371657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2d3a19c0-b1e3-4a53-8661-e4497ec81177 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:05.375497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2d3a19c0-b1e3-4a53-8661-e4497ec81177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:05.480150 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1479/2938] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:05.489342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3732-9c77-4a74-805c-fa9489755ea3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:05.490464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3732-9c77-4a74-805c-fa9489755ea3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:05.490988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e3732-9c77-4a74-805c-fa9489755ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:05.539783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-274e3732-9c77-4a74-805c-fa9489755ea3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:05.542980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-274e3732-9c77-4a74-805c-fa9489755ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:05.580266 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1460/2939] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:05.585010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a19c0-b1e3-4a53-8661-e4497ec81177 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:05.598709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3a19c0-b1e3-4a53-8661-e4497ec81177 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:05.610841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723043b-22b3-4abe-832b-1b91337ed8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:05.612554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723043b-22b3-4abe-832b-1b91337ed8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:05.612973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723043b-22b3-4abe-832b-1b91337ed8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:05.613390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e723043b-22b3-4abe-832b-1b91337ed8a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:05.614078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723043b-22b3-4abe-832b-1b91337ed8a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:01:05.616204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723043b-22b3-4abe-832b-1b91337ed8a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:05.620629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e723043b-22b3-4abe-832b-1b91337ed8a7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:05.655802 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1480/2940] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:01:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:01:05.659165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e3732-9c77-4a74-805c-fa9489755ea3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:05.672678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e3732-9c77-4a74-805c-fa9489755ea3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:05.697816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc84d-5506-4a05-860d-ea0da06ec01a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:05.698448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc84d-5506-4a05-860d-ea0da06ec01a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:05.698738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc84d-5506-4a05-860d-ea0da06ec01a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:05.699014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52fc84d-5506-4a05-860d-ea0da06ec01a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:05.699676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fc84d-5506-4a05-860d-ea0da06ec01a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:05.705368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52fc84d-5506-4a05-860d-ea0da06ec01a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:05.824149 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1461/2941] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:01:05 2022] POST /identity/v3/projects => generated 385 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:01:05.832465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723043b-22b3-4abe-832b-1b91337ed8a7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:05.873794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e723043b-22b3-4abe-832b-1b91337ed8a7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:06.000659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffcd68-d6ab-4dc8-bde5-8f5fab755356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:06.001476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffcd68-d6ab-4dc8-bde5-8f5fab755356 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:06.001810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffcd68-d6ab-4dc8-bde5-8f5fab755356 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:06.002139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebffcd68-d6ab-4dc8-bde5-8f5fab755356 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:06.002847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffcd68-d6ab-4dc8-bde5-8f5fab755356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:06.005658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebffcd68-d6ab-4dc8-bde5-8f5fab755356 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:06.035867 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1481/2942] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:01:05 2022] POST /identity/v3/users => generated 293 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:01:06.041209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc84d-5506-4a05-860d-ea0da06ec01a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:06.053378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52fc84d-5506-4a05-860d-ea0da06ec01a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:06.072882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f2ff-58ed-4f7f-977b-3446ebdfbe91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:06.073806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f2ff-58ed-4f7f-977b-3446ebdfbe91 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:06.074262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f2ff-58ed-4f7f-977b-3446ebdfbe91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:06.074550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81f2ff-58ed-4f7f-977b-3446ebdfbe91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:06.075336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81f2ff-58ed-4f7f-977b-3446ebdfbe91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:06.077785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81f2ff-58ed-4f7f-977b-3446ebdfbe91 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:06.111817 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1462/2943] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:01:06.113778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffcd68-d6ab-4dc8-bde5-8f5fab755356 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:06.130970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebffcd68-d6ab-4dc8-bde5-8f5fab755356 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:06.153209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483bbe73-fd30-498c-b8f8-f51abfd9a155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:06.153887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bbe73-fd30-498c-b8f8-f51abfd9a155 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:06.154219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bbe73-fd30-498c-b8f8-f51abfd9a155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:06.154495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483bbe73-fd30-498c-b8f8-f51abfd9a155 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:06.155186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bbe73-fd30-498c-b8f8-f51abfd9a155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:06.156965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483bbe73-fd30-498c-b8f8-f51abfd9a155 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:06.187184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f2ff-58ed-4f7f-977b-3446ebdfbe91 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:06.192778 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1482/2944] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:01:06 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:01:06.203014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81f2ff-58ed-4f7f-977b-3446ebdfbe91 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:06.212238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc659a3f-bea9-45dc-a7b3-ab62d9d7caf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:06.212927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc659a3f-bea9-45dc-a7b3-ab62d9d7caf8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:06.213209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc659a3f-bea9-45dc-a7b3-ab62d9d7caf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:06.213532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc659a3f-bea9-45dc-a7b3-ab62d9d7caf8 admin admin] PATH_INFO: `/v3/projects/3d8386ac6bcc427eac985785c55c05f7/users/63d465e19fe64e54b54e3e09338a2822/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:06.260156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc659a3f-bea9-45dc-a7b3-ab62d9d7caf8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d8386ac6bcc427eac985785c55c05f7, user_id=63d465e19fe64e54b54e3e09338a2822, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:06.267139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc659a3f-bea9-45dc-a7b3-ab62d9d7caf8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:06.320285 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1463/2945] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:01:06 2022] PUT /identity/v3/projects/3d8386ac6bcc427eac985785c55c05f7/users/63d465e19fe64e54b54e3e09338a2822/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:06.325688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93860e72-168e-4d2b-8710-6f2f3bedd609 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:06.326015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93860e72-168e-4d2b-8710-6f2f3bedd609 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:06.326252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93860e72-168e-4d2b-8710-6f2f3bedd609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:06.383877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-93860e72-168e-4d2b-8710-6f2f3bedd609 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:06.385843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93860e72-168e-4d2b-8710-6f2f3bedd609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:06.413178 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:06.444634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc659a3f-bea9-45dc-a7b3-ab62d9d7caf8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:06.446606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cc659a3f-bea9-45dc-a7b3-ab62d9d7caf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:06.538151 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1483/2946] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:06.585918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93860e72-168e-4d2b-8710-6f2f3bedd609 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:06.587903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93860e72-168e-4d2b-8710-6f2f3bedd609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:06.666016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc659a3f-bea9-45dc-a7b3-ab62d9d7caf8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:06.674140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b4814-2625-48d6-950a-4169ad32ad86 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:06.674971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b4814-2625-48d6-950a-4169ad32ad86 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:06.675323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b4814-2625-48d6-950a-4169ad32ad86 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:06.675715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808b4814-2625-48d6-950a-4169ad32ad86 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:06.678040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-808b4814-2625-48d6-950a-4169ad32ad86 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:06.701246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b4814-2625-48d6-950a-4169ad32ad86 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:06.704466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808b4814-2625-48d6-950a-4169ad32ad86 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:06.726263 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1464/2947] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:01:06.757901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93860e72-168e-4d2b-8710-6f2f3bedd609 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:06.770668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bd82-15f1-44c8-9e1c-c22696a77dec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:06.771390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bd82-15f1-44c8-9e1c-c22696a77dec service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:06.776758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bd82-15f1-44c8-9e1c-c22696a77dec service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:06.777127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e946bd82-15f1-44c8-9e1c-c22696a77dec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:06.804150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946bd82-15f1-44c8-9e1c-c22696a77dec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:06.805661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e946bd82-15f1-44c8-9e1c-c22696a77dec service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:06.827418 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1484/2948] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:01:15.218477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b4814-2625-48d6-950a-4169ad32ad86 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:15.251424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808b4814-2625-48d6-950a-4169ad32ad86 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:15.271290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8915-19cd-460b-976f-1347bfddb42a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:15.271941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8915-19cd-460b-976f-1347bfddb42a service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:15.272226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8915-19cd-460b-976f-1347bfddb42a service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:15.272514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379b8915-19cd-460b-976f-1347bfddb42a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:15.275117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-379b8915-19cd-460b-976f-1347bfddb42a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:15.297088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b8915-19cd-460b-976f-1347bfddb42a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:15.297088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379b8915-19cd-460b-976f-1347bfddb42a service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:15.308142 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1465/2949] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:16.822580 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=42 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:23.615572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bd82-15f1-44c8-9e1c-c22696a77dec service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:23.617022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e946bd82-15f1-44c8-9e1c-c22696a77dec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:23.636706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e946bd82-15f1-44c8-9e1c-c22696a77dec service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:23.662778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:23.663350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:23.663630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:23.663916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] PATH_INFO: `/v3/users/f381609a3c0d4583804a70c89d288881` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:23.665538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=f381609a3c0d4583804a70c89d288881)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:23.673043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:23.788693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f381609a3c0d4583804a70c89d288881'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:23.821190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f381609a3c0d4583804a70c89d288881'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:23.821943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f381609a3c0d4583804a70c89d288881'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:23.849833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f381609a3c0d4583804a70c89d288881'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:23.864405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee82ac7b-4fa9-4ce4-a2d6-dc8af9b2b0ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f381609a3c0d4583804a70c89d288881'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:23.886704 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1485/2950] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:01:23 2022] DELETE /identity/v3/users/f381609a3c0d4583804a70c89d288881 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:24.468385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8915-19cd-460b-976f-1347bfddb42a service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:24.487497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379b8915-19cd-460b-976f-1347bfddb42a service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:24.498949 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:24.691931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:24.693097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:24.693579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:24.694644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] PATH_INFO: `/v3/projects/92fabbee6f184b9b8ebff84ca55c3c67` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:24.696782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92fabbee6f184b9b8ebff84ca55c3c67)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:24.699100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:24.796209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92fabbee6f184b9b8ebff84ca55c3c67', 'request_id': 'req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:24.836349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92fabbee6f184b9b8ebff84ca55c3c67', 'request_id': 'req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:24.858820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92fabbee6f184b9b8ebff84ca55c3c67', 'request_id': 'req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:24.893228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] The token cache is being invalidate because project 92fabbee6f184b9b8ebff84ca55c3c67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:01:24.893553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:24.895504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-599ac06f-57fb-45ae-b6c1-20cc7a5d11d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:24.901287 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1466/2951] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:24 2022] DELETE /identity/v3/projects/92fabbee6f184b9b8ebff84ca55c3c67 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:24.902890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2137a-a2e4-4c15-9f1c-5036eb0d8828 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:24.904344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2137a-a2e4-4c15-9f1c-5036eb0d8828 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:24.904996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2137a-a2e4-4c15-9f1c-5036eb0d8828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:24.987138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-42b2137a-a2e4-4c15-9f1c-5036eb0d8828 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:24.989284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42b2137a-a2e4-4c15-9f1c-5036eb0d8828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:25.069483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2d54-0496-4493-9054-183425655b31 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.069891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2d54-0496-4493-9054-183425655b31 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.070268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb2d54-0496-4493-9054-183425655b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.126856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-81eb2d54-0496-4493-9054-183425655b31 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:25.129723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81eb2d54-0496-4493-9054-183425655b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:25.177337 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1486/2952] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:01:25.185512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132fbea-150b-4783-95dc-de0519ab728d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.185802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132fbea-150b-4783-95dc-de0519ab728d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.186087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132fbea-150b-4783-95dc-de0519ab728d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.224337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5132fbea-150b-4783-95dc-de0519ab728d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:25.225759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5132fbea-150b-4783-95dc-de0519ab728d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:25.260732 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1487/2953] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:25.261836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132fbea-150b-4783-95dc-de0519ab728d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:25.286940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132fbea-150b-4783-95dc-de0519ab728d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:25.306909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe4ccb-eb42-4837-9f7c-3204277c171e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:25.312386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4ccb-eb42-4837-9f7c-3204277c171e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.313110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4ccb-eb42-4837-9f7c-3204277c171e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.313574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01fe4ccb-eb42-4837-9f7c-3204277c171e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.318396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe4ccb-eb42-4837-9f7c-3204277c171e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:01:25.318761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe4ccb-eb42-4837-9f7c-3204277c171e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:25.320603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01fe4ccb-eb42-4837-9f7c-3204277c171e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:25.329400 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1467/2954] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:01:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:01:25.349836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2d54-0496-4493-9054-183425655b31 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:25.351298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81eb2d54-0496-4493-9054-183425655b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:25.370335 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1488/2955] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:01:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:01:25.381537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe4ccb-eb42-4837-9f7c-3204277c171e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:25.397157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01fe4ccb-eb42-4837-9f7c-3204277c171e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:25.403297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a8c6-c3b6-4984-b411-2a895e25fc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:25.403964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a8c6-c3b6-4984-b411-2a895e25fc50 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.404297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a8c6-c3b6-4984-b411-2a895e25fc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.405175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf7a8c6-c3b6-4984-b411-2a895e25fc50 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.405390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a8c6-c3b6-4984-b411-2a895e25fc50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:25.407399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf7a8c6-c3b6-4984-b411-2a895e25fc50 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:25.444459 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:25.461542 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1489/2956] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:01:25 2022] POST /identity/v3/projects => generated 371 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:01:25.465463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a8c6-c3b6-4984-b411-2a895e25fc50 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:25.511428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb2d54-0496-4493-9054-183425655b31 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:25.526057 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:25.590222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf7a8c6-c3b6-4984-b411-2a895e25fc50 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:25.606097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8094-96fe-4fd9-8597-f99795b410c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:25.606923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8094-96fe-4fd9-8597-f99795b410c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.607672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8094-96fe-4fd9-8597-f99795b410c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.608087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039d8094-96fe-4fd9-8597-f99795b410c6 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.608870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d8094-96fe-4fd9-8597-f99795b410c6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:25.611589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039d8094-96fe-4fd9-8597-f99795b410c6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:25.652835 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1490/2957] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:01:25 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:01:25.656637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8094-96fe-4fd9-8597-f99795b410c6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:25.656765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab48fb65-739b-4075-8e37-380ebe94f3c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:25.657321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48fb65-739b-4075-8e37-380ebe94f3c6 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.657700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48fb65-739b-4075-8e37-380ebe94f3c6 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.657981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab48fb65-739b-4075-8e37-380ebe94f3c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.667974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039d8094-96fe-4fd9-8597-f99795b410c6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:25.673788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cdc0b-c347-4444-910d-8b5ea83736d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:25.674469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cdc0b-c347-4444-910d-8b5ea83736d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.674757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cdc0b-c347-4444-910d-8b5ea83736d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.675033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8cdc0b-c347-4444-910d-8b5ea83736d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.675769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cdc0b-c347-4444-910d-8b5ea83736d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:25.677418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8cdc0b-c347-4444-910d-8b5ea83736d8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:25.692093 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1491/2958] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:01:25.706233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cdc0b-c347-4444-910d-8b5ea83736d8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:25.732067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8cdc0b-c347-4444-910d-8b5ea83736d8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:25.748170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4953f-4a3a-41b5-95c7-f8ab2deb073c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:25.749219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4953f-4a3a-41b5-95c7-f8ab2deb073c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.754587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4953f-4a3a-41b5-95c7-f8ab2deb073c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.755927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb4953f-4a3a-41b5-95c7-f8ab2deb073c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.756783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4953f-4a3a-41b5-95c7-f8ab2deb073c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:25.758679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb4953f-4a3a-41b5-95c7-f8ab2deb073c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:25.775650 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1492/2959] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:01:25 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:01:25.782088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4953f-4a3a-41b5-95c7-f8ab2deb073c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:25.801200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48fb65-739b-4075-8e37-380ebe94f3c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:25.806670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab48fb65-739b-4075-8e37-380ebe94f3c6 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:25.807297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb4953f-4a3a-41b5-95c7-f8ab2deb073c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:25.818568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449e2cd-6598-4332-ac0f-deda89db83b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:25.820263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449e2cd-6598-4332-ac0f-deda89db83b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.822676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449e2cd-6598-4332-ac0f-deda89db83b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.823155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7449e2cd-6598-4332-ac0f-deda89db83b3 admin admin] PATH_INFO: `/v3/projects/e39ab7b5b92a41668acea520536e4537/users/8941a72c029246b99e52925781a4d1e6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.827249 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1468/2960] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:01:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:25.848889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449e2cd-6598-4332-ac0f-deda89db83b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e39ab7b5b92a41668acea520536e4537, user_id=8941a72c029246b99e52925781a4d1e6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:25.851923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7449e2cd-6598-4332-ac0f-deda89db83b3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:25.881691 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1493/2961] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:01:25 2022] PUT /identity/v3/projects/e39ab7b5b92a41668acea520536e4537/users/8941a72c029246b99e52925781a4d1e6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:25.889435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf833c-5910-4449-9492-d97b747c4b76 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:25.889950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf833c-5910-4449-9492-d97b747c4b76 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:25.890518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcf833c-5910-4449-9492-d97b747c4b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:25.932216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4fcf833c-5910-4449-9492-d97b747c4b76 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:25.933959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4fcf833c-5910-4449-9492-d97b747c4b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:26.093785 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1469/2962] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:26.110937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449e2cd-6598-4332-ac0f-deda89db83b3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:26.114244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7449e2cd-6598-4332-ac0f-deda89db83b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:26.275358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7449e2cd-6598-4332-ac0f-deda89db83b3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:26.282923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed83728b-6d16-431f-8b7b-56c97e226909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:26.284014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83728b-6d16-431f-8b7b-56c97e226909 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:26.284399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83728b-6d16-431f-8b7b-56c97e226909 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:26.285457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed83728b-6d16-431f-8b7b-56c97e226909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:26.298190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83728b-6d16-431f-8b7b-56c97e226909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:26.301663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed83728b-6d16-431f-8b7b-56c97e226909 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:26.315833 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1494/2963] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:26.546660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af24e9-ec18-400c-8749-5ee808224e67 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:26.547211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af24e9-ec18-400c-8749-5ee808224e67 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:26.547211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af24e9-ec18-400c-8749-5ee808224e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:26.577010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-95af24e9-ec18-400c-8749-5ee808224e67 None None] MFA Rules not processed for user `ca932e5866274fc78b04689811e72746`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:26.578608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-95af24e9-ec18-400c-8749-5ee808224e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:26.613524 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:26.665214 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1470/2964] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:26 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:01:27.762858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5a4b1-a09b-4f25-8c07-d4f6100ba8c0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:27.763798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5a4b1-a09b-4f25-8c07-d4f6100ba8c0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:27.764301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d5a4b1-a09b-4f25-8c07-d4f6100ba8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:27.849983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-26d5a4b1-a09b-4f25-8c07-d4f6100ba8c0 None None] MFA Rules not processed for user `63d465e19fe64e54b54e3e09338a2822`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:27.851745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-26d5a4b1-a09b-4f25-8c07-d4f6100ba8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:28.003036 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1495/2965] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:28.075498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af24e9-ec18-400c-8749-5ee808224e67 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:28.077053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-95af24e9-ec18-400c-8749-5ee808224e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:28.203072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af24e9-ec18-400c-8749-5ee808224e67 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:28.212250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2937464-34c2-4af0-b032-518ab193b9d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:28.212933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2937464-34c2-4af0-b032-518ab193b9d8 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:28.213346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2937464-34c2-4af0-b032-518ab193b9d8 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:28.213792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2937464-34c2-4af0-b032-518ab193b9d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:28.224066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2937464-34c2-4af0-b032-518ab193b9d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:28.226121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2937464-34c2-4af0-b032-518ab193b9d8 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:28.241467 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1471/2966] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:28 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:30.681414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5a4b1-a09b-4f25-8c07-d4f6100ba8c0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:30.709556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d5a4b1-a09b-4f25-8c07-d4f6100ba8c0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:30.724472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba023d-8454-45a1-9365-b581678b4e9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:30.725600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba023d-8454-45a1-9365-b581678b4e9d service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:30.726054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba023d-8454-45a1-9365-b581678b4e9d service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:30.762583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba023d-8454-45a1-9365-b581678b4e9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:30.768319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-31ba023d-8454-45a1-9365-b581678b4e9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:30.804927 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:30.988717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba023d-8454-45a1-9365-b581678b4e9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:30.991670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ba023d-8454-45a1-9365-b581678b4e9d service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:31.029895 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1496/2967] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:32.843251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2937464-34c2-4af0-b032-518ab193b9d8 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:32.849344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2937464-34c2-4af0-b032-518ab193b9d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:32.882291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2937464-34c2-4af0-b032-518ab193b9d8 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:32.887929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:32.889081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:32.889555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:32.890045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] PATH_INFO: `/v3/users/cc0be0ed857d4c96b26724144e20d766` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:32.892083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc0be0ed857d4c96b26724144e20d766)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:32.894575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:32.995006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc0be0ed857d4c96b26724144e20d766'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:33.050448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc0be0ed857d4c96b26724144e20d766'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:33.051635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc0be0ed857d4c96b26724144e20d766'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:33.064361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc0be0ed857d4c96b26724144e20d766'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:33.080316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc0be0ed857d4c96b26724144e20d766'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:33.091241 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1472/2968] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:01:32 2022] DELETE /identity/v3/users/cc0be0ed857d4c96b26724144e20d766 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:34.190675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba023d-8454-45a1-9365-b581678b4e9d service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:34.229440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba023d-8454-45a1-9365-b581678b4e9d service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:34.387624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:34.388614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:34.389017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:34.390334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] PATH_INFO: `/v3/projects/ad4d1fc14f404932ab515a6a4c5a3048` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:34.393333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad4d1fc14f404932ab515a6a4c5a3048)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:34.399148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:34.512748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad4d1fc14f404932ab515a6a4c5a3048', 'request_id': 'req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.525438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad4d1fc14f404932ab515a6a4c5a3048', 'request_id': 'req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.537283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad4d1fc14f404932ab515a6a4c5a3048', 'request_id': 'req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.559860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] The token cache is being invalidate because project ad4d1fc14f404932ab515a6a4c5a3048 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:01:34.560258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.566832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.569588 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1497/2969] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:34 2022] DELETE /identity/v3/projects/ad4d1fc14f404932ab515a6a4c5a3048 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:34.575077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:34.583360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:34.609512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab45d3-d7ce-48dd-acfe-1ef43bea72b5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:34.685519 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:34.759544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:34.760765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:34.761213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:34.761684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] PATH_INFO: `/v3/users/2b8194e0c6d34a9eb2d70595e8c80569` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:34.763251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b8194e0c6d34a9eb2d70595e8c80569)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:34.767700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:34.853815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b8194e0c6d34a9eb2d70595e8c80569'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.876012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b8194e0c6d34a9eb2d70595e8c80569'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.898103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b8194e0c6d34a9eb2d70595e8c80569'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.914216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b8194e0c6d34a9eb2d70595e8c80569'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.937534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b9a90df-266c-44be-b2c0-44e87e2f553d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b8194e0c6d34a9eb2d70595e8c80569'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:34.953021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1473/2970] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:01:34 2022] DELETE /identity/v3/users/2b8194e0c6d34a9eb2d70595e8c80569 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:01:35.709498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:35.713516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:35.732386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3ff9ae-5684-4363-b0aa-7d717c8e5dac admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:35.771004 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:35.823165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:35.824467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:35.824984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:35.826146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] PATH_INFO: `/v3/projects/62672bde0bd84f6892e27ee13fe282f6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:35.827906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62672bde0bd84f6892e27ee13fe282f6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:35.830387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:35.967484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62672bde0bd84f6892e27ee13fe282f6', 'request_id': 'req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:35.986699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62672bde0bd84f6892e27ee13fe282f6', 'request_id': 'req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:35.995104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62672bde0bd84f6892e27ee13fe282f6', 'request_id': 'req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:36.012275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] The token cache is being invalidate because project 62672bde0bd84f6892e27ee13fe282f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:01:36.012894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:36.013956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9eef6d09-6156-4cfc-90bc-a22f07f4b8d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:36.016120 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1498/2971] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:01:35 2022] DELETE /identity/v3/projects/62672bde0bd84f6892e27ee13fe282f6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:01:36.021464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a1ad-2b2a-4b3c-a2e7-6c631d9c740a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:36.022006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a1ad-2b2a-4b3c-a2e7-6c631d9c740a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:36.022006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a925a1ad-2b2a-4b3c-a2e7-6c631d9c740a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:36.050868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a925a1ad-2b2a-4b3c-a2e7-6c631d9c740a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:36.052483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a925a1ad-2b2a-4b3c-a2e7-6c631d9c740a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:36.177762 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1474/2972] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:36.183285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82935d-8afe-4a04-882b-6a716f295bab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:36.183597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82935d-8afe-4a04-882b-6a716f295bab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:36.183874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82935d-8afe-4a04-882b-6a716f295bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:36.212061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5d82935d-8afe-4a04-882b-6a716f295bab None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:36.213329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5d82935d-8afe-4a04-882b-6a716f295bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:36.236110 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1499/2973] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:36.240782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925a1ad-2b2a-4b3c-a2e7-6c631d9c740a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:36.251163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a925a1ad-2b2a-4b3c-a2e7-6c631d9c740a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:36.258969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12e897-9104-41a1-9aad-322a02f0c85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:36.259763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12e897-9104-41a1-9aad-322a02f0c85a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:36.260159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12e897-9104-41a1-9aad-322a02f0c85a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:36.260540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f12e897-9104-41a1-9aad-322a02f0c85a admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:36.261635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12e897-9104-41a1-9aad-322a02f0c85a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:01:36.262165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12e897-9104-41a1-9aad-322a02f0c85a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:36.263996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f12e897-9104-41a1-9aad-322a02f0c85a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:36.281920 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1475/2974] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:01:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:01:36.286104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82935d-8afe-4a04-882b-6a716f295bab None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:36.299315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82935d-8afe-4a04-882b-6a716f295bab None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:36.319367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fa0e4-103f-4074-b2fa-4b303f1ac85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:36.320684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fa0e4-103f-4074-b2fa-4b303f1ac85e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:36.321675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fa0e4-103f-4074-b2fa-4b303f1ac85e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:36.322147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4fa0e4-103f-4074-b2fa-4b303f1ac85e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:36.322849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fa0e4-103f-4074-b2fa-4b303f1ac85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:36.325248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4fa0e4-103f-4074-b2fa-4b303f1ac85e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:36.368680 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1500/2975] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:01:36 2022] POST /identity/v3/projects => generated 387 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:01:36.389593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12e897-9104-41a1-9aad-322a02f0c85a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:36.402820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f12e897-9104-41a1-9aad-322a02f0c85a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:36.452419 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:36.493998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3513-604a-431f-bb41-5931ce4e927b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:36.495921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3513-604a-431f-bb41-5931ce4e927b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:36.496773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3513-604a-431f-bb41-5931ce4e927b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:36.497380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056b3513-604a-431f-bb41-5931ce4e927b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:36.499521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b3513-604a-431f-bb41-5931ce4e927b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:36.501898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056b3513-604a-431f-bb41-5931ce4e927b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:36.533503 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1476/2976] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:01:36 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:01:36.537919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fa0e4-103f-4074-b2fa-4b303f1ac85e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:36.554260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4fa0e4-103f-4074-b2fa-4b303f1ac85e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:36.560634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede73d-72f4-42a0-8553-b207ad6d7980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:36.561947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede73d-72f4-42a0-8553-b207ad6d7980 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:36.562388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede73d-72f4-42a0-8553-b207ad6d7980 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:36.562835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caede73d-72f4-42a0-8553-b207ad6d7980 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:36.563734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caede73d-72f4-42a0-8553-b207ad6d7980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:36.565779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caede73d-72f4-42a0-8553-b207ad6d7980 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:36.586677 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1501/2977] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:01:36.591116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3513-604a-431f-bb41-5931ce4e927b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:36.604668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056b3513-604a-431f-bb41-5931ce4e927b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:36.626367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9af128-e95b-42ba-99c4-c99ee0b0b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:36.627206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9af128-e95b-42ba-99c4-c99ee0b0b9ea admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:36.627493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9af128-e95b-42ba-99c4-c99ee0b0b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:36.630265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9af128-e95b-42ba-99c4-c99ee0b0b9ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:36.631434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9af128-e95b-42ba-99c4-c99ee0b0b9ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:36.633270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9af128-e95b-42ba-99c4-c99ee0b0b9ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:36.649770 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1477/2978] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:01:36 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:01:36.651206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede73d-72f4-42a0-8553-b207ad6d7980 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:36.665265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caede73d-72f4-42a0-8553-b207ad6d7980 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:36.676323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bfa2e-c149-4919-893e-54a0a1949882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:36.677157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bfa2e-c149-4919-893e-54a0a1949882 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:36.677717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bfa2e-c149-4919-893e-54a0a1949882 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:36.678117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bfa2e-c149-4919-893e-54a0a1949882 admin admin] PATH_INFO: `/v3/projects/33ae68ba2a584665992f3856fab416a5/users/0ba0cbf327634abdb5a1be7d2ee31e30/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:36.704147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bfa2e-c149-4919-893e-54a0a1949882 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33ae68ba2a584665992f3856fab416a5, user_id=0ba0cbf327634abdb5a1be7d2ee31e30, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:36.724561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bfa2e-c149-4919-893e-54a0a1949882 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:36.769333 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1502/2979] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:01:36 2022] PUT /identity/v3/projects/33ae68ba2a584665992f3856fab416a5/users/0ba0cbf327634abdb5a1be7d2ee31e30/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:01:36.774358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67fcd-754d-4463-b7da-b998a9e8e646 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:36.774866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67fcd-754d-4463-b7da-b998a9e8e646 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:36.775279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be67fcd-754d-4463-b7da-b998a9e8e646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:36.819258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4be67fcd-754d-4463-b7da-b998a9e8e646 None None] MFA Rules not processed for user `0ba0cbf327634abdb5a1be7d2ee31e30`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:36.820784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4be67fcd-754d-4463-b7da-b998a9e8e646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:36.945003 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1478/2980] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:01:36.950190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bfa2e-c149-4919-893e-54a0a1949882 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:37.060214 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:37.073055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bfa2e-c149-4919-893e-54a0a1949882 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:37.090927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513831a-a78b-41ac-b9b1-a6a0a2d38d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:37.091857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513831a-a78b-41ac-b9b1-a6a0a2d38d5f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.092208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513831a-a78b-41ac-b9b1-a6a0a2d38d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.092667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513831a-a78b-41ac-b9b1-a6a0a2d38d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.093623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513831a-a78b-41ac-b9b1-a6a0a2d38d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:37.095841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513831a-a78b-41ac-b9b1-a6a0a2d38d5f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:37.145960 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1503/2981] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:01:36 2022] POST /identity/v3/projects => generated 385 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:01:37.150388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be67fcd-754d-4463-b7da-b998a9e8e646 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:37.165882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be67fcd-754d-4463-b7da-b998a9e8e646 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:37.268241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d457-0834-4b95-b5e9-d75091903c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:37.268973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d457-0834-4b95-b5e9-d75091903c80 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.269989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d457-0834-4b95-b5e9-d75091903c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.270146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d457-0834-4b95-b5e9-d75091903c80 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.270878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66d457-0834-4b95-b5e9-d75091903c80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:37.273028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66d457-0834-4b95-b5e9-d75091903c80 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:37.302013 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1479/2982] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:01:37 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:01:37.306784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513831a-a78b-41ac-b9b1-a6a0a2d38d5f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:37.328244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513831a-a78b-41ac-b9b1-a6a0a2d38d5f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:37.336364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b8336-4be7-4818-835a-c1060e99a790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:37.337594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b8336-4be7-4818-835a-c1060e99a790 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.338168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b8336-4be7-4818-835a-c1060e99a790 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.338595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b8336-4be7-4818-835a-c1060e99a790 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.339588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b8336-4be7-4818-835a-c1060e99a790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:37.341202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b8336-4be7-4818-835a-c1060e99a790 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:37.366077 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1504/2983] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:01:37.370284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d457-0834-4b95-b5e9-d75091903c80 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:37.385879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d457-0834-4b95-b5e9-d75091903c80 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:37.393187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230db54-7bc5-4b3a-829e-965fc5028c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:37.393966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230db54-7bc5-4b3a-829e-965fc5028c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.394858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230db54-7bc5-4b3a-829e-965fc5028c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.395366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230db54-7bc5-4b3a-829e-965fc5028c25 admin admin] PATH_INFO: `/v3/projects/b34da25e70e54621b0409ec47faf2b0b/users/dbad87a7ad024511aa5e6668fda00328/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.418672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230db54-7bc5-4b3a-829e-965fc5028c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34da25e70e54621b0409ec47faf2b0b, user_id=dbad87a7ad024511aa5e6668fda00328, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:37.421530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c230db54-7bc5-4b3a-829e-965fc5028c25 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:37.438876 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1480/2984] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:01:37 2022] PUT /identity/v3/projects/b34da25e70e54621b0409ec47faf2b0b/users/dbad87a7ad024511aa5e6668fda00328/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:01:37.443701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b8336-4be7-4818-835a-c1060e99a790 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:37.455542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b8336-4be7-4818-835a-c1060e99a790 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:37.526045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adfb04-67ec-462e-8861-28d41725df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:37.526766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adfb04-67ec-462e-8861-28d41725df55 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.527139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adfb04-67ec-462e-8861-28d41725df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.527634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adfb04-67ec-462e-8861-28d41725df55 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.528358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adfb04-67ec-462e-8861-28d41725df55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:37.530163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adfb04-67ec-462e-8861-28d41725df55 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:37.542413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1505/2985] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:01:37 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:01:37.546428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230db54-7bc5-4b3a-829e-965fc5028c25 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:37.556097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03127a-101f-4475-bcec-c172fb403f4f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.556387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03127a-101f-4475-bcec-c172fb403f4f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.556678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03127a-101f-4475-bcec-c172fb403f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.560665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230db54-7bc5-4b3a-829e-965fc5028c25 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:37.565953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86eeade4-07a8-4c7e-a7cc-e4a0aca1e632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:37.566916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeade4-07a8-4c7e-a7cc-e4a0aca1e632 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.567409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeade4-07a8-4c7e-a7cc-e4a0aca1e632 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.567751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86eeade4-07a8-4c7e-a7cc-e4a0aca1e632 admin admin] PATH_INFO: `/v3/projects/b34da25e70e54621b0409ec47faf2b0b/users/dbad87a7ad024511aa5e6668fda00328/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.570706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eeade4-07a8-4c7e-a7cc-e4a0aca1e632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b34da25e70e54621b0409ec47faf2b0b, user_id=dbad87a7ad024511aa5e6668fda00328, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:37.573503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86eeade4-07a8-4c7e-a7cc-e4a0aca1e632 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:37.582294 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:37.601973 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1481/2986] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:01:37 2022] PUT /identity/v3/projects/b34da25e70e54621b0409ec47faf2b0b/users/dbad87a7ad024511aa5e6668fda00328/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:01:37.604245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dc03127a-101f-4475-bcec-c172fb403f4f None None] MFA Rules not processed for user `8941a72c029246b99e52925781a4d1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:37.604604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abe7e-2368-4f43-b4bb-e6a794a32b4e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.605041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abe7e-2368-4f43-b4bb-e6a794a32b4e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.605488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83abe7e-2368-4f43-b4bb-e6a794a32b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.606100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc03127a-101f-4475-bcec-c172fb403f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:37.645311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f83abe7e-2368-4f43-b4bb-e6a794a32b4e None None] MFA Rules not processed for user `dbad87a7ad024511aa5e6668fda00328`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:37.646562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f83abe7e-2368-4f43-b4bb-e6a794a32b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:37.705913 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1506/2987] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:37.717159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5606a-5a65-4d39-aa5f-f2ca942e38a8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.717482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5606a-5a65-4d39-aa5f-f2ca942e38a8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.717764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5606a-5a65-4d39-aa5f-f2ca942e38a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.753989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-53e5606a-5a65-4d39-aa5f-f2ca942e38a8 None None] MFA Rules not processed for user `8941a72c029246b99e52925781a4d1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:37.756525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-53e5606a-5a65-4d39-aa5f-f2ca942e38a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:37.759232 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1482/2988] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:37.777150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29757a3-b6c8-4ecb-90ac-a1dd9ef6fbc7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:37.778763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29757a3-b6c8-4ecb-90ac-a1dd9ef6fbc7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:37.779549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29757a3-b6c8-4ecb-90ac-a1dd9ef6fbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:37.781386 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1507/2989] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:37.823078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c29757a3-b6c8-4ecb-90ac-a1dd9ef6fbc7 None None] MFA Rules not processed for user `0ba0cbf327634abdb5a1be7d2ee31e30`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:37.824578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c29757a3-b6c8-4ecb-90ac-a1dd9ef6fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:37.901705 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1483/2990] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:01:37 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:37.969920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5606a-5a65-4d39-aa5f-f2ca942e38a8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:37.977269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-53e5606a-5a65-4d39-aa5f-f2ca942e38a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:38.032598 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:38.071697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5606a-5a65-4d39-aa5f-f2ca942e38a8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:38.077285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c289-82ac-47aa-9a4c-7b2c9aca8fae service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:38.077917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c289-82ac-47aa-9a4c-7b2c9aca8fae service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:38.078195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c289-82ac-47aa-9a4c-7b2c9aca8fae service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:38.078468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9c289-82ac-47aa-9a4c-7b2c9aca8fae service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:38.087247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9c289-82ac-47aa-9a4c-7b2c9aca8fae service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:38.088765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9c289-82ac-47aa-9a4c-7b2c9aca8fae service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:38.098335 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1508/2991] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:37 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:38.228853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29757a3-b6c8-4ecb-90ac-a1dd9ef6fbc7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:38.230398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c29757a3-b6c8-4ecb-90ac-a1dd9ef6fbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:38.247948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29757a3-b6c8-4ecb-90ac-a1dd9ef6fbc7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:38.253609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a08bc2-b6f7-4eb3-9869-d70c406da55f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:38.254218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a08bc2-b6f7-4eb3-9869-d70c406da55f service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:38.254498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a08bc2-b6f7-4eb3-9869-d70c406da55f service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:38.254772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a08bc2-b6f7-4eb3-9869-d70c406da55f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:38.263069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a08bc2-b6f7-4eb3-9869-d70c406da55f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:38.264661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a08bc2-b6f7-4eb3-9869-d70c406da55f service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:38.274421 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1484/2992] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:38 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:38.384116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c289-82ac-47aa-9a4c-7b2c9aca8fae service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:38.385769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f8c9c289-82ac-47aa-9a4c-7b2c9aca8fae service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:38.477888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9c289-82ac-47aa-9a4c-7b2c9aca8fae service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:38.482673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc78dbf-6b71-4942-8fe9-2e5075c73f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:38.483305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc78dbf-6b71-4942-8fe9-2e5075c73f28 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:38.483593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc78dbf-6b71-4942-8fe9-2e5075c73f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:38.483863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc78dbf-6b71-4942-8fe9-2e5075c73f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:38.485989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7fc78dbf-6b71-4942-8fe9-2e5075c73f28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:38.499938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc78dbf-6b71-4942-8fe9-2e5075c73f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:38.501458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc78dbf-6b71-4942-8fe9-2e5075c73f28 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:38.511397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1509/2993] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:48.269945 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=66 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:48.507474 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=37 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:52.063177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a08bc2-b6f7-4eb3-9869-d70c406da55f service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:52.081197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a08bc2-b6f7-4eb3-9869-d70c406da55f service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:52.087858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1d200f-3537-4cf3-975e-1fc2693b5b8f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:52.088625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d200f-3537-4cf3-975e-1fc2693b5b8f service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:52.089223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d200f-3537-4cf3-975e-1fc2693b5b8f service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:52.089663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1d200f-3537-4cf3-975e-1fc2693b5b8f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:52.091758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7c1d200f-3537-4cf3-975e-1fc2693b5b8f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:52.211762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d200f-3537-4cf3-975e-1fc2693b5b8f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:52.214399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1d200f-3537-4cf3-975e-1fc2693b5b8f service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:52.251432 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1485/2994] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:52 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:01:53.785781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc78dbf-6b71-4942-8fe9-2e5075c73f28 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:53.798780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc78dbf-6b71-4942-8fe9-2e5075c73f28 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:53.808635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:53.809656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:53.811188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:53.811701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:53.817962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:54.005676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:54.007431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:54.021906 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1510/2995] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:54.884781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19207993-7de8-4101-ae31-7a12abcb8f91 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:54.885236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19207993-7de8-4101-ae31-7a12abcb8f91 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:54.885346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19207993-7de8-4101-ae31-7a12abcb8f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:54.907972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-19207993-7de8-4101-ae31-7a12abcb8f91 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:01:54.909805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-19207993-7de8-4101-ae31-7a12abcb8f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:55.032330 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1486/2996] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:01:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:01:55.040049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:55.043693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:55.168396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba168-a8a2-43f2-a26a-7ac7f196c00e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:55.183885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d7642-fb53-4705-a43a-52d1c26e5219 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:55.186175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d7642-fb53-4705-a43a-52d1c26e5219 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:55.186175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d7642-fb53-4705-a43a-52d1c26e5219 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:55.186175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d7642-fb53-4705-a43a-52d1c26e5219 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:55.201395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d7642-fb53-4705-a43a-52d1c26e5219 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:55.204193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4d7642-fb53-4705-a43a-52d1c26e5219 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:55.217191 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1511/2997] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:01:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:01:57.729806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19207993-7de8-4101-ae31-7a12abcb8f91 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:57.758187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19207993-7de8-4101-ae31-7a12abcb8f91 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:57.772719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d91d0b-8817-41ed-8137-231bbddde111 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:57.774173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d91d0b-8817-41ed-8137-231bbddde111 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:57.774874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d91d0b-8817-41ed-8137-231bbddde111 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:57.775623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d91d0b-8817-41ed-8137-231bbddde111 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:57.782120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-97d91d0b-8817-41ed-8137-231bbddde111 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:57.819194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d91d0b-8817-41ed-8137-231bbddde111 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:57.824914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d91d0b-8817-41ed-8137-231bbddde111 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:57.868778 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1487/2998] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:01:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:01:59.483798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d7642-fb53-4705-a43a-52d1c26e5219 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:01:59.485948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6a4d7642-fb53-4705-a43a-52d1c26e5219 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:01:59.514425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d7642-fb53-4705-a43a-52d1c26e5219 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:01:59.531187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:01:59.532039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:01:59.532363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:01:59.532763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] PATH_INFO: `/v3/users/63d465e19fe64e54b54e3e09338a2822` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:01:59.534307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] RBAC: Authorizing `identity:delete_user(user_id=63d465e19fe64e54b54e3e09338a2822)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:01:59.537971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:01:59.655365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63d465e19fe64e54b54e3e09338a2822'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:59.683089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63d465e19fe64e54b54e3e09338a2822'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:59.683900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63d465e19fe64e54b54e3e09338a2822'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:59.698993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63d465e19fe64e54b54e3e09338a2822'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:59.708495 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:01:59.715241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63d465e19fe64e54b54e3e09338a2822'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:01:59.732261 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1512/2999] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:01:59 2022] DELETE /identity/v3/users/63d465e19fe64e54b54e3e09338a2822 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:00.294761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d91d0b-8817-41ed-8137-231bbddde111 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:00.311870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d91d0b-8817-41ed-8137-231bbddde111 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:00.494624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:00.499095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:00.499539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:00.499832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] PATH_INFO: `/v3/projects/3d8386ac6bcc427eac985785c55c05f7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:00.501508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d8386ac6bcc427eac985785c55c05f7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:00.506533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:00.623689 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:00.677228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d8386ac6bcc427eac985785c55c05f7', 'request_id': 'req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:00.691322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d8386ac6bcc427eac985785c55c05f7', 'request_id': 'req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:00.721653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d8386ac6bcc427eac985785c55c05f7', 'request_id': 'req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:00.737435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:00.739108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:00.767686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] The token cache is being invalidate because project 3d8386ac6bcc427eac985785c55c05f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:00.785742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:00.787768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-09b82bb8-c52c-49e6-a8b2-2c74a0ac27f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:00.793406 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1488/3000] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:00 2022] DELETE /identity/v3/projects/3d8386ac6bcc427eac985785c55c05f7 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:00.802442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed5342-a30f-49d1-ab30-dc4841ca8aff None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:00.802860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed5342-a30f-49d1-ab30-dc4841ca8aff None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:00.803632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ed5342-a30f-49d1-ab30-dc4841ca8aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:00.898968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c2ed5342-a30f-49d1-ab30-dc4841ca8aff None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:00.906100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c2ed5342-a30f-49d1-ab30-dc4841ca8aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:01.094565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11621159-87f1-41b5-91ce-7e7d1765385c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:01.205532 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1489/3001] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:01.209685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d374d-ebcd-43fb-8dbc-fc7cd7b1f853 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:01.210078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d374d-ebcd-43fb-8dbc-fc7cd7b1f853 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:01.210491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d374d-ebcd-43fb-8dbc-fc7cd7b1f853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:01.257709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9a2d374d-ebcd-43fb-8dbc-fc7cd7b1f853 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:01.258983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a2d374d-ebcd-43fb-8dbc-fc7cd7b1f853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:01.287419 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1490/3002] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:01.288531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d374d-ebcd-43fb-8dbc-fc7cd7b1f853 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:01.322443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d374d-ebcd-43fb-8dbc-fc7cd7b1f853 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:01.345229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939290f-2ce4-491d-ad56-f33f35c80301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:01.348126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939290f-2ce4-491d-ad56-f33f35c80301 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:01.348126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939290f-2ce4-491d-ad56-f33f35c80301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:01.348126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6939290f-2ce4-491d-ad56-f33f35c80301 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:01.349085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939290f-2ce4-491d-ad56-f33f35c80301 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:02:01.351130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939290f-2ce4-491d-ad56-f33f35c80301 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:01.355299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6939290f-2ce4-491d-ad56-f33f35c80301 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:01.355459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bccf13-7f13-4156-8a75-c69034dafbac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:01.356379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bccf13-7f13-4156-8a75-c69034dafbac service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:01.356379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bccf13-7f13-4156-8a75-c69034dafbac service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:01.356539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bccf13-7f13-4156-8a75-c69034dafbac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:01.367943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8bccf13-7f13-4156-8a75-c69034dafbac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:01.386616 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1491/3003] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:02:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:01.392964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939290f-2ce4-491d-ad56-f33f35c80301 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:01.452425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6939290f-2ce4-491d-ad56-f33f35c80301 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:01.474489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06034f-b66c-4950-96aa-65f31377e6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:01.475210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06034f-b66c-4950-96aa-65f31377e6e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:01.475440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06034f-b66c-4950-96aa-65f31377e6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:01.475714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d06034f-b66c-4950-96aa-65f31377e6e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:01.477069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06034f-b66c-4950-96aa-65f31377e6e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:01.496024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d06034f-b66c-4950-96aa-65f31377e6e4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:01.580686 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1492/3004] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:01 2022] POST /identity/v3/projects => generated 401 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:01.582011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bccf13-7f13-4156-8a75-c69034dafbac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:01.583608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06034f-b66c-4950-96aa-65f31377e6e4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:01.588491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bccf13-7f13-4156-8a75-c69034dafbac service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:01.610412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1513/3005] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 874 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:01.772667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d06034f-b66c-4950-96aa-65f31377e6e4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:01.783879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf3b6-227b-46bc-9ab0-c6d75f96a4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:01.785441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf3b6-227b-46bc-9ab0-c6d75f96a4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:01.785882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf3b6-227b-46bc-9ab0-c6d75f96a4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:01.786378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dbf3b6-227b-46bc-9ab0-c6d75f96a4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:01.787183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbf3b6-227b-46bc-9ab0-c6d75f96a4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:01.789347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dbf3b6-227b-46bc-9ab0-c6d75f96a4b0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:01.864213 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1493/3006] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:01 2022] POST /identity/v3/users => generated 301 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:01.870813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bccf13-7f13-4156-8a75-c69034dafbac service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:01.900797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bccf13-7f13-4156-8a75-c69034dafbac service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:01.916929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9d22-e0a0-4886-bf96-ee72a69c2855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:01.919207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9d22-e0a0-4886-bf96-ee72a69c2855 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:01.919961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9d22-e0a0-4886-bf96-ee72a69c2855 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:01.921041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8b9d22-e0a0-4886-bf96-ee72a69c2855 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:01.923092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b9d22-e0a0-4886-bf96-ee72a69c2855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:01.926594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb8b9d22-e0a0-4886-bf96-ee72a69c2855 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:01.947521 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1514/3007] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:01.953484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf3b6-227b-46bc-9ab0-c6d75f96a4b0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:01.988523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dbf3b6-227b-46bc-9ab0-c6d75f96a4b0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:02.007830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8614fa62-a6d1-4aa3-92f9-e7e4cbbed11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:02.009042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614fa62-a6d1-4aa3-92f9-e7e4cbbed11d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:02.009851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614fa62-a6d1-4aa3-92f9-e7e4cbbed11d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:02.010504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8614fa62-a6d1-4aa3-92f9-e7e4cbbed11d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:02.016452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614fa62-a6d1-4aa3-92f9-e7e4cbbed11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:02.023708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8614fa62-a6d1-4aa3-92f9-e7e4cbbed11d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:02.027477 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:02.057726 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1494/3008] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:02.063774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9d22-e0a0-4886-bf96-ee72a69c2855 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:02.087356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb8b9d22-e0a0-4886-bf96-ee72a69c2855 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:02.105572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76100524-7b3a-4fcc-867b-2593150eb898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:02.107358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76100524-7b3a-4fcc-867b-2593150eb898 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:02.107875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76100524-7b3a-4fcc-867b-2593150eb898 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:02.110039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76100524-7b3a-4fcc-867b-2593150eb898 admin admin] PATH_INFO: `/v3/projects/3d86f261dab443f285d12a39b85da0ce/users/e5418897ffec4982917708414f3279a0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:02.172416 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:02.178379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76100524-7b3a-4fcc-867b-2593150eb898 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d86f261dab443f285d12a39b85da0ce, user_id=e5418897ffec4982917708414f3279a0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:02.193828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76100524-7b3a-4fcc-867b-2593150eb898 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:02.233551 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1515/3009] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:02 2022] PUT /identity/v3/projects/3d86f261dab443f285d12a39b85da0ce/users/e5418897ffec4982917708414f3279a0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:02.257527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800a9bf-d8d8-4148-b8a9-195dd8410e52 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:02.258317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800a9bf-d8d8-4148-b8a9-195dd8410e52 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:02.258970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c800a9bf-d8d8-4148-b8a9-195dd8410e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:02.436603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c800a9bf-d8d8-4148-b8a9-195dd8410e52 None None] MFA Rules not processed for user `e5418897ffec4982917708414f3279a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:02.438358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c800a9bf-d8d8-4148-b8a9-195dd8410e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:02.463761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185c128-4cca-4497-b59c-65e6caf30a84 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:02.464235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185c128-4cca-4497-b59c-65e6caf30a84 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:02.464711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4185c128-4cca-4497-b59c-65e6caf30a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:02.507517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4185c128-4cca-4497-b59c-65e6caf30a84 None None] MFA Rules not processed for user `0ba0cbf327634abdb5a1be7d2ee31e30`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:02.509951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4185c128-4cca-4497-b59c-65e6caf30a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:02.723933 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1516/3010] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:02 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:02:02.932050 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1495/3011] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 676 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:03.094046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185c128-4cca-4497-b59c-65e6caf30a84 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:03.096419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4185c128-4cca-4497-b59c-65e6caf30a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:03.210237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4185c128-4cca-4497-b59c-65e6caf30a84 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:03.216132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2d57c0-36d7-4ddf-8894-2891797b8800 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:03.217086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d57c0-36d7-4ddf-8894-2891797b8800 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:03.217258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d57c0-36d7-4ddf-8894-2891797b8800 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:03.217569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2d57c0-36d7-4ddf-8894-2891797b8800 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:03.227287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d57c0-36d7-4ddf-8894-2891797b8800 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:03.229086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2d57c0-36d7-4ddf-8894-2891797b8800 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:03.251793 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1517/3012] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:03 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:03.328141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800a9bf-d8d8-4148-b8a9-195dd8410e52 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:03.523441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c800a9bf-d8d8-4148-b8a9-195dd8410e52 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:03.537109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:03.538020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:03.538630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:03.539037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] PATH_INFO: `/v3/users/e5418897ffec4982917708414f3279a0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:03.553157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5418897ffec4982917708414f3279a0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:03.561436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:03.727954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5418897ffec4982917708414f3279a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:03.764796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5418897ffec4982917708414f3279a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:03.765754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5418897ffec4982917708414f3279a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:03.782231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5418897ffec4982917708414f3279a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:03.793494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5418897ffec4982917708414f3279a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:03.808227 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1496/3013] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:03 2022] DELETE /identity/v3/users/e5418897ffec4982917708414f3279a0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:03.812501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa90a3b-13b1-40a5-a3de-aca0fae12b0e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:03.813359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa90a3b-13b1-40a5-a3de-aca0fae12b0e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:03.813800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa90a3b-13b1-40a5-a3de-aca0fae12b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:03.866225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0aa90a3b-13b1-40a5-a3de-aca0fae12b0e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:03.867490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0aa90a3b-13b1-40a5-a3de-aca0fae12b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:04.113432 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1518/3014] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:04.123504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:04.125269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:04.167127 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:04.307869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3666846d-438d-401e-b206-cbb051c03a91 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:04.307869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d9f0b5-3b83-4978-8250-7cbef8fa2972 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:04.308777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9f0b5-3b83-4978-8250-7cbef8fa2972 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:04.309188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9f0b5-3b83-4978-8250-7cbef8fa2972 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:04.309689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d9f0b5-3b83-4978-8250-7cbef8fa2972 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:04.321652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9f0b5-3b83-4978-8250-7cbef8fa2972 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:04.323392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d9f0b5-3b83-4978-8250-7cbef8fa2972 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:04.371757 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1497/3015] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:05.161236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa90a3b-13b1-40a5-a3de-aca0fae12b0e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:05.162864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0aa90a3b-13b1-40a5-a3de-aca0fae12b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:05.183423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa90a3b-13b1-40a5-a3de-aca0fae12b0e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:05.197445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:05.198386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:05.200416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:05.200870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] PATH_INFO: `/v3/projects/3d86f261dab443f285d12a39b85da0ce` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:05.202307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d86f261dab443f285d12a39b85da0ce)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:05.206869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:05.289047 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:05.391956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d86f261dab443f285d12a39b85da0ce', 'request_id': 'req-e517023b-663a-4dfa-8df7-65e32fc4a246'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:05.417439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d86f261dab443f285d12a39b85da0ce', 'request_id': 'req-e517023b-663a-4dfa-8df7-65e32fc4a246'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:05.430166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d86f261dab443f285d12a39b85da0ce', 'request_id': 'req-e517023b-663a-4dfa-8df7-65e32fc4a246'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:05.462072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] The token cache is being invalidate because project 3d86f261dab443f285d12a39b85da0ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:05.466251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:05.471644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e517023b-663a-4dfa-8df7-65e32fc4a246 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:05.477350 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1519/3016] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:05 2022] DELETE /identity/v3/projects/3d86f261dab443f285d12a39b85da0ce => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:05.483599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5985b7a-1252-44e8-82c2-508df6d392e0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:05.484104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5985b7a-1252-44e8-82c2-508df6d392e0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:05.484699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5985b7a-1252-44e8-82c2-508df6d392e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:05.650212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f5985b7a-1252-44e8-82c2-508df6d392e0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:05.654190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f5985b7a-1252-44e8-82c2-508df6d392e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:05.857616 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1498/3017] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:05.865811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f6b82-207f-469e-ad1d-e5d21719507c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:05.866242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f6b82-207f-469e-ad1d-e5d21719507c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:05.866636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f6b82-207f-469e-ad1d-e5d21719507c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:05.926884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aa5f6b82-207f-469e-ad1d-e5d21719507c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:05.928561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa5f6b82-207f-469e-ad1d-e5d21719507c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:05.950063 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1520/3018] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:05.953989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5985b7a-1252-44e8-82c2-508df6d392e0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:05.977591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5985b7a-1252-44e8-82c2-508df6d392e0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:05.993016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076410-4717-4457-a647-8a68cafecfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:05.993936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076410-4717-4457-a647-8a68cafecfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:05.994394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076410-4717-4457-a647-8a68cafecfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:05.995008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae076410-4717-4457-a647-8a68cafecfa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:05.995828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae076410-4717-4457-a647-8a68cafecfa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:02:05.996300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae076410-4717-4457-a647-8a68cafecfa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:05.998386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae076410-4717-4457-a647-8a68cafecfa4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:06.038665 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1499/3019] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:06.043134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f6b82-207f-469e-ad1d-e5d21719507c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:06.066211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f6b82-207f-469e-ad1d-e5d21719507c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:06.078837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3639d-74dd-4f67-9e69-75c7159ff191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:06.086083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3639d-74dd-4f67-9e69-75c7159ff191 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:06.087765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3639d-74dd-4f67-9e69-75c7159ff191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:06.088272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e3639d-74dd-4f67-9e69-75c7159ff191 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:06.089176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3639d-74dd-4f67-9e69-75c7159ff191 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:06.098800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e3639d-74dd-4f67-9e69-75c7159ff191 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:06.205340 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1521/3020] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:06 2022] POST /identity/v3/projects => generated 403 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:02:06.209248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076410-4717-4457-a647-8a68cafecfa4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:06.223902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae076410-4717-4457-a647-8a68cafecfa4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:06.411509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2927d5-3692-4924-896a-821ac16087ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:06.411967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2927d5-3692-4924-896a-821ac16087ff admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:06.412941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2927d5-3692-4924-896a-821ac16087ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:06.413230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2927d5-3692-4924-896a-821ac16087ff admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:06.413904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2927d5-3692-4924-896a-821ac16087ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:06.419640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2927d5-3692-4924-896a-821ac16087ff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:06.516492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3639d-74dd-4f67-9e69-75c7159ff191 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:06.519110 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1500/3021] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:06 2022] POST /identity/v3/users => generated 302 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:06.532014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e3639d-74dd-4f67-9e69-75c7159ff191 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:06.556911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaf3c2-6df8-4c9c-9b29-0907616e7c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:06.557506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaf3c2-6df8-4c9c-9b29-0907616e7c8c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:06.557795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaf3c2-6df8-4c9c-9b29-0907616e7c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:06.558072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeaf3c2-6df8-4c9c-9b29-0907616e7c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:06.558725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaf3c2-6df8-4c9c-9b29-0907616e7c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:06.560351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeaf3c2-6df8-4c9c-9b29-0907616e7c8c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:06.583463 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1522/3022] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:02:06.588826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2927d5-3692-4924-896a-821ac16087ff admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:06.618452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2927d5-3692-4924-896a-821ac16087ff admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:06.625426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6007a6b6-de1d-4eee-9afb-73640e8b0711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:06.626099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007a6b6-de1d-4eee-9afb-73640e8b0711 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:06.626382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007a6b6-de1d-4eee-9afb-73640e8b0711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:06.626657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6007a6b6-de1d-4eee-9afb-73640e8b0711 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:06.627303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007a6b6-de1d-4eee-9afb-73640e8b0711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:06.629332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6007a6b6-de1d-4eee-9afb-73640e8b0711 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:06.650985 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1501/3023] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:06.652359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaf3c2-6df8-4c9c-9b29-0907616e7c8c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:06.691630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeaf3c2-6df8-4c9c-9b29-0907616e7c8c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:06.697358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3213b-08e3-4169-9071-dbcb263fd4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:06.698047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3213b-08e3-4169-9071-dbcb263fd4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:06.698654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3213b-08e3-4169-9071-dbcb263fd4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:06.698941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d3213b-08e3-4169-9071-dbcb263fd4d5 admin admin] PATH_INFO: `/v3/projects/d8b23bc011414545b6ee64c17d866805/users/28d6776b4c53419ea6a3a4260adc0d45/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:06.744372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3213b-08e3-4169-9071-dbcb263fd4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8b23bc011414545b6ee64c17d866805, user_id=28d6776b4c53419ea6a3a4260adc0d45, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:06.753248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d3213b-08e3-4169-9071-dbcb263fd4d5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:06.818316 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1523/3024] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:06 2022] PUT /identity/v3/projects/d8b23bc011414545b6ee64c17d866805/users/28d6776b4c53419ea6a3a4260adc0d45/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:06.819259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01840b21-c52b-427c-b0e3-fbec34146b1b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:06.821902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01840b21-c52b-427c-b0e3-fbec34146b1b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:06.821902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01840b21-c52b-427c-b0e3-fbec34146b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:06.892239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3213b-08e3-4169-9071-dbcb263fd4d5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:06.894802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-01840b21-c52b-427c-b0e3-fbec34146b1b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:06.895255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b5d3213b-08e3-4169-9071-dbcb263fd4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:06.902789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01840b21-c52b-427c-b0e3-fbec34146b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:06.946807 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:07.086994 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1502/3025] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:02:07.093749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d3213b-08e3-4169-9071-dbcb263fd4d5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:07.094307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01840b21-c52b-427c-b0e3-fbec34146b1b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:07.100557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01840b21-c52b-427c-b0e3-fbec34146b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:07.113702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:07.114356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:07.117165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:07.118485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] PATH_INFO: `/v3/users/0a5f0704d95640a99457ddd8652f83ca` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:07.121891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a5f0704d95640a99457ddd8652f83ca)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:07.129510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:07.232353 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:07.238040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a5f0704d95640a99457ddd8652f83ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:07.261792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01840b21-c52b-427c-b0e3-fbec34146b1b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:07.264583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a5f0704d95640a99457ddd8652f83ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:07.271930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a5f0704d95640a99457ddd8652f83ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:07.272109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:07.272790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:07.273072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:07.273368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:07.275260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:07.291088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a5f0704d95640a99457ddd8652f83ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:07.301525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:07.305053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:07.312862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-051c431c-daad-4655-9356-b01528c625ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a5f0704d95640a99457ddd8652f83ca'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:07.318724 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1503/3026] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:02:07.337346 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1524/3027] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:06 2022] DELETE /identity/v3/users/0a5f0704d95640a99457ddd8652f83ca => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:07.907860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:07.911753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:07.959185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9ac6c-a867-4eba-a807-e6e0509d5615 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:08.132512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:08.133606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:08.136212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:08.136805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] PATH_INFO: `/v3/projects/8296bcb4ff034194b66485ce116bb18a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:08.138953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8296bcb4ff034194b66485ce116bb18a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:08.146503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:08.281910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8296bcb4ff034194b66485ce116bb18a', 'request_id': 'req-0188d541-1f63-4579-a1ae-0a635e9b035a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:08.321195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8296bcb4ff034194b66485ce116bb18a', 'request_id': 'req-0188d541-1f63-4579-a1ae-0a635e9b035a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:08.348673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8296bcb4ff034194b66485ce116bb18a', 'request_id': 'req-0188d541-1f63-4579-a1ae-0a635e9b035a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:08.355289 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:08.407984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] The token cache is being invalidate because project 8296bcb4ff034194b66485ce116bb18a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:08.408303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:08.409254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0188d541-1f63-4579-a1ae-0a635e9b035a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:08.413367 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1504/3028] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:07 2022] DELETE /identity/v3/projects/8296bcb4ff034194b66485ce116bb18a => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:08.417871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d241a-c2c9-459f-8ef1-4198af718b16 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:08.418374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d241a-c2c9-459f-8ef1-4198af718b16 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:08.418601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d241a-c2c9-459f-8ef1-4198af718b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:08.477716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7e3d241a-c2c9-459f-8ef1-4198af718b16 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:08.478980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7e3d241a-c2c9-459f-8ef1-4198af718b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:08.728276 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1525/3029] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:08.730579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b02fd-a64d-4672-972d-e0dca3e60430 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:08.730873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b02fd-a64d-4672-972d-e0dca3e60430 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:08.731162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36b02fd-a64d-4672-972d-e0dca3e60430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:08.786803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a36b02fd-a64d-4672-972d-e0dca3e60430 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:08.790565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a36b02fd-a64d-4672-972d-e0dca3e60430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:08.818429 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1505/3030] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:08.822665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d241a-c2c9-459f-8ef1-4198af718b16 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:08.839034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d241a-c2c9-459f-8ef1-4198af718b16 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:08.867968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f1b21-7763-4e56-8d52-58213cd56881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:08.868603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f1b21-7763-4e56-8d52-58213cd56881 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:08.868886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f1b21-7763-4e56-8d52-58213cd56881 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:08.869336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f1b21-7763-4e56-8d52-58213cd56881 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:08.870020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f1b21-7763-4e56-8d52-58213cd56881 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:02:08.870314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f1b21-7763-4e56-8d52-58213cd56881 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:08.871954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f1b21-7763-4e56-8d52-58213cd56881 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:08.929137 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1526/3031] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:02:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:08.930157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b02fd-a64d-4672-972d-e0dca3e60430 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:08.947652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36b02fd-a64d-4672-972d-e0dca3e60430 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:08.963026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9282ac6-4d05-4e73-b706-b65b574eed5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:08.963899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9282ac6-4d05-4e73-b706-b65b574eed5f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:08.964320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9282ac6-4d05-4e73-b706-b65b574eed5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:08.964769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9282ac6-4d05-4e73-b706-b65b574eed5f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:08.965641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9282ac6-4d05-4e73-b706-b65b574eed5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:08.967707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9282ac6-4d05-4e73-b706-b65b574eed5f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:09.114389 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1506/3032] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:08 2022] POST /identity/v3/projects => generated 389 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:02:09.117780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f1b21-7763-4e56-8d52-58213cd56881 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:09.172164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f1b21-7763-4e56-8d52-58213cd56881 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:09.409907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805eb63-d60f-4751-8f65-29723578d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:09.410759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805eb63-d60f-4751-8f65-29723578d8e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:09.411157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805eb63-d60f-4751-8f65-29723578d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:09.411474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805eb63-d60f-4751-8f65-29723578d8e7 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:09.412283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805eb63-d60f-4751-8f65-29723578d8e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:09.415195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805eb63-d60f-4751-8f65-29723578d8e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:09.512001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1527/3033] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:09 2022] POST /identity/v3/users => generated 295 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:09.516533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9282ac6-4d05-4e73-b706-b65b574eed5f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:09.534093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9282ac6-4d05-4e73-b706-b65b574eed5f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:09.560961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd9b1-6ea8-423a-960d-4ee0fa27767f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:09.563620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd9b1-6ea8-423a-960d-4ee0fa27767f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:09.564086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd9b1-6ea8-423a-960d-4ee0fa27767f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:09.566334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78cd9b1-6ea8-423a-960d-4ee0fa27767f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:09.568296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cd9b1-6ea8-423a-960d-4ee0fa27767f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:09.573755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78cd9b1-6ea8-423a-960d-4ee0fa27767f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:09.604931 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1507/3034] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:09.608887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805eb63-d60f-4751-8f65-29723578d8e7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:09.626731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805eb63-d60f-4751-8f65-29723578d8e7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:09.639917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59652a8-23df-4be1-8b8c-e0f93a47b835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:09.640816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59652a8-23df-4be1-8b8c-e0f93a47b835 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:09.641103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59652a8-23df-4be1-8b8c-e0f93a47b835 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:09.642103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59652a8-23df-4be1-8b8c-e0f93a47b835 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:09.644134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59652a8-23df-4be1-8b8c-e0f93a47b835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:09.647762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59652a8-23df-4be1-8b8c-e0f93a47b835 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:09.697480 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1528/3035] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:09 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:09.701593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd9b1-6ea8-423a-960d-4ee0fa27767f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:09.716936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78cd9b1-6ea8-423a-960d-4ee0fa27767f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:09.728220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a054a99-6698-4f31-86fc-492ee88df847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:09.728963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a054a99-6698-4f31-86fc-492ee88df847 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:09.729247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a054a99-6698-4f31-86fc-492ee88df847 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:09.729551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a054a99-6698-4f31-86fc-492ee88df847 admin admin] PATH_INFO: `/v3/projects/30dbbc2d63444107b5518dbabd023d2f/users/ba45d4c2ea4c46aabee199ebc7e9d6f2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:09.769967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a054a99-6698-4f31-86fc-492ee88df847 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30dbbc2d63444107b5518dbabd023d2f, user_id=ba45d4c2ea4c46aabee199ebc7e9d6f2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:09.772640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a054a99-6698-4f31-86fc-492ee88df847 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:09.803622 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1508/3036] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:09 2022] PUT /identity/v3/projects/30dbbc2d63444107b5518dbabd023d2f/users/ba45d4c2ea4c46aabee199ebc7e9d6f2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:09.809122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf31eb2-ae1e-40f8-b86c-fb09e60b7fa6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:09.809429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf31eb2-ae1e-40f8-b86c-fb09e60b7fa6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:09.809703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf31eb2-ae1e-40f8-b86c-fb09e60b7fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:09.843740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ccf31eb2-ae1e-40f8-b86c-fb09e60b7fa6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:09.848299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ccf31eb2-ae1e-40f8-b86c-fb09e60b7fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:09.898200 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:10.006035 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1529/3037] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:10.066269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a054a99-6698-4f31-86fc-492ee88df847 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:10.068207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2a054a99-6698-4f31-86fc-492ee88df847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:10.173509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a054a99-6698-4f31-86fc-492ee88df847 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:10.177381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74995d6-42c1-4035-ae4b-608dae879f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:10.178005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74995d6-42c1-4035-ae4b-608dae879f42 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:10.178287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74995d6-42c1-4035-ae4b-608dae879f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:10.178561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74995d6-42c1-4035-ae4b-608dae879f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:10.192908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74995d6-42c1-4035-ae4b-608dae879f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:10.200842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74995d6-42c1-4035-ae4b-608dae879f42 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:10.233310 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1509/3038] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:19.981687 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=15 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:20.214188 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=2,keystone:SELECT=56,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:25.242027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df533-1812-4f47-b5ec-4e74b351cca9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:25.242566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df533-1812-4f47-b5ec-4e74b351cca9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:25.242647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36df533-1812-4f47-b5ec-4e74b351cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:25.264161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a36df533-1812-4f47-b5ec-4e74b351cca9 None None] MFA Rules not processed for user `ca932e5866274fc78b04689811e72746`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:25.265429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a36df533-1812-4f47-b5ec-4e74b351cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:25.428697 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1530/3039] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:25.868792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f7a10-ca11-4e2a-8e65-8d06fc7829a8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:25.871040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f7a10-ca11-4e2a-8e65-8d06fc7829a8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:25.872043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f7a10-ca11-4e2a-8e65-8d06fc7829a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:25.978756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c86f7a10-ca11-4e2a-8e65-8d06fc7829a8 None None] MFA Rules not processed for user `28d6776b4c53419ea6a3a4260adc0d45`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:25.980960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c86f7a10-ca11-4e2a-8e65-8d06fc7829a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:26.476177 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1510/3040] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:25 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 610 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:26.492770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36df533-1812-4f47-b5ec-4e74b351cca9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:26.495366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a36df533-1812-4f47-b5ec-4e74b351cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:26.691960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36df533-1812-4f47-b5ec-4e74b351cca9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:26.698972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd7de2-2fd5-4893-a7cf-a2c80164f3bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:26.700234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd7de2-2fd5-4893-a7cf-a2c80164f3bd service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:26.702718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd7de2-2fd5-4893-a7cf-a2c80164f3bd service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:26.703014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fd7de2-2fd5-4893-a7cf-a2c80164f3bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:26.725680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd7de2-2fd5-4893-a7cf-a2c80164f3bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:26.727906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fd7de2-2fd5-4893-a7cf-a2c80164f3bd service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:26.763144 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1531/3041] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:26 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:27.957552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f7a10-ca11-4e2a-8e65-8d06fc7829a8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:27.960850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c86f7a10-ca11-4e2a-8e65-8d06fc7829a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:27.992564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f7a10-ca11-4e2a-8e65-8d06fc7829a8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:27.997959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4ab5f-34e6-4a5b-b47a-31924b358863 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:27.999412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ab5f-34e6-4a5b-b47a-31924b358863 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:28.000717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ab5f-34e6-4a5b-b47a-31924b358863 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:28.001600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b4ab5f-34e6-4a5b-b47a-31924b358863 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:28.004932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e2b4ab5f-34e6-4a5b-b47a-31924b358863 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:28.028351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4ab5f-34e6-4a5b-b47a-31924b358863 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:28.031244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b4ab5f-34e6-4a5b-b47a-31924b358863 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:28.059638 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1511/3042] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:28.135028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd7de2-2fd5-4893-a7cf-a2c80164f3bd service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:28.136464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93fd7de2-2fd5-4893-a7cf-a2c80164f3bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:28.164523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fd7de2-2fd5-4893-a7cf-a2c80164f3bd service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:28.188811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:28.191291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:28.191291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:28.191583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] PATH_INFO: `/v3/users/8941a72c029246b99e52925781a4d1e6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:28.195126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8941a72c029246b99e52925781a4d1e6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:28.197218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:28.341635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8941a72c029246b99e52925781a4d1e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:28.371657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8941a72c029246b99e52925781a4d1e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:28.374800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8941a72c029246b99e52925781a4d1e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:28.397973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8941a72c029246b99e52925781a4d1e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:28.424907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7dae9bb5-2170-4430-9917-e21537cfc5d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8941a72c029246b99e52925781a4d1e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:28.457374 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1532/3043] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:28 2022] DELETE /identity/v3/users/8941a72c029246b99e52925781a4d1e6 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:29.245007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4ab5f-34e6-4a5b-b47a-31924b358863 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:29.266797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b4ab5f-34e6-4a5b-b47a-31924b358863 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:29.445416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:29.446574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:29.446856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:29.447122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] PATH_INFO: `/v3/projects/e39ab7b5b92a41668acea520536e4537` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:29.449780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e39ab7b5b92a41668acea520536e4537)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:29.457609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:29.561729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e39ab7b5b92a41668acea520536e4537', 'request_id': 'req-bcff59d4-b18d-40b5-9948-f33973334dc9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:29.571833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e39ab7b5b92a41668acea520536e4537', 'request_id': 'req-bcff59d4-b18d-40b5-9948-f33973334dc9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:29.587254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e39ab7b5b92a41668acea520536e4537', 'request_id': 'req-bcff59d4-b18d-40b5-9948-f33973334dc9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:29.605804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] The token cache is being invalidate because project e39ab7b5b92a41668acea520536e4537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:29.606806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:29.608319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcff59d4-b18d-40b5-9948-f33973334dc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:29.610719 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1512/3044] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:29 2022] DELETE /identity/v3/projects/e39ab7b5b92a41668acea520536e4537 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:29.619349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dc2e8-16cc-4c57-b04e-7f040ca17de9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:29.620136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dc2e8-16cc-4c57-b04e-7f040ca17de9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:29.620428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dc2e8-16cc-4c57-b04e-7f040ca17de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:29.640928 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:29.677532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0d6dc2e8-16cc-4c57-b04e-7f040ca17de9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:29.679252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f114f-c952-4d2d-a411-9f19c53d20c5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:29.679763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f114f-c952-4d2d-a411-9f19c53d20c5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:29.679900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d6dc2e8-16cc-4c57-b04e-7f040ca17de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:29.680454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f114f-c952-4d2d-a411-9f19c53d20c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:29.696573 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:29.707541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0d4f114f-c952-4d2d-a411-9f19c53d20c5 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:29.709397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0d4f114f-c952-4d2d-a411-9f19c53d20c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:29.773958 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1533/3045] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:29.781474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60fed6-d637-4706-9f3b-dc6cf266e8fe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:29.781770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60fed6-d637-4706-9f3b-dc6cf266e8fe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:29.782987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f60fed6-d637-4706-9f3b-dc6cf266e8fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:29.810463 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1513/3046] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:02:29.811720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f114f-c952-4d2d-a411-9f19c53d20c5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:29.814074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0d4f114f-c952-4d2d-a411-9f19c53d20c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:29.834416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9f60fed6-d637-4706-9f3b-dc6cf266e8fe None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:29.839615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9f60fed6-d637-4706-9f3b-dc6cf266e8fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:29.870549 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1534/3047] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:29.875058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60fed6-d637-4706-9f3b-dc6cf266e8fe None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:29.901501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f60fed6-d637-4706-9f3b-dc6cf266e8fe None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:29.919266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bc82f-b96b-47f3-8d75-f21ba21c2614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:29.919918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bc82f-b96b-47f3-8d75-f21ba21c2614 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:29.920202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bc82f-b96b-47f3-8d75-f21ba21c2614 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:29.920615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bc82f-b96b-47f3-8d75-f21ba21c2614 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:29.921125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bc82f-b96b-47f3-8d75-f21ba21c2614 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:02:29.923163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bc82f-b96b-47f3-8d75-f21ba21c2614 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:29.926404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1bc82f-b96b-47f3-8d75-f21ba21c2614 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:29.955698 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1535/3048] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:29.960241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bc82f-b96b-47f3-8d75-f21ba21c2614 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:29.985928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bc82f-b96b-47f3-8d75-f21ba21c2614 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:29.997806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7ff9-066d-4e02-8a88-005284277469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:30.000329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7ff9-066d-4e02-8a88-005284277469 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:30.001797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7ff9-066d-4e02-8a88-005284277469 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:30.003778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b7ff9-066d-4e02-8a88-005284277469 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:30.008626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b7ff9-066d-4e02-8a88-005284277469 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:30.010615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f114f-c952-4d2d-a411-9f19c53d20c5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:30.016109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd1f1d-ffd1-4dd3-ac91-7f2c63c62a25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:30.027423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213b7ff9-066d-4e02-8a88-005284277469 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:30.027943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd1f1d-ffd1-4dd3-ac91-7f2c63c62a25 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:30.028247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd1f1d-ffd1-4dd3-ac91-7f2c63c62a25 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:30.028543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd1f1d-ffd1-4dd3-ac91-7f2c63c62a25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:30.051481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd1f1d-ffd1-4dd3-ac91-7f2c63c62a25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:30.053134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfd1f1d-ffd1-4dd3-ac91-7f2c63c62a25 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:30.076865 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1514/3049] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:02:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:02:30.158291 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1536/3050] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:29 2022] POST /identity/v3/projects => generated 367 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:30.162965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd1f1d-ffd1-4dd3-ac91-7f2c63c62a25 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:30.182845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd1f1d-ffd1-4dd3-ac91-7f2c63c62a25 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:30.357411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827b51c-6ffc-462f-8584-2ae9255e46e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:30.360758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827b51c-6ffc-462f-8584-2ae9255e46e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:30.361283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827b51c-6ffc-462f-8584-2ae9255e46e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:30.362205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9827b51c-6ffc-462f-8584-2ae9255e46e4 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:30.363175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827b51c-6ffc-462f-8584-2ae9255e46e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:30.370060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9827b51c-6ffc-462f-8584-2ae9255e46e4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:30.454415 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1515/3051] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:30 2022] POST /identity/v3/users => generated 284 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:30.457197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7ff9-066d-4e02-8a88-005284277469 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:30.473615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b7ff9-066d-4e02-8a88-005284277469 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:30.510707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e347e-642d-4816-ae69-851be88870aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:30.513884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e347e-642d-4816-ae69-851be88870aa admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:30.515195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e347e-642d-4816-ae69-851be88870aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:30.515500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e347e-642d-4816-ae69-851be88870aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:30.516191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e347e-642d-4816-ae69-851be88870aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:30.525355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e347e-642d-4816-ae69-851be88870aa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:30.567204 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1537/3052] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:30.582974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827b51c-6ffc-462f-8584-2ae9255e46e4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:30.610400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9827b51c-6ffc-462f-8584-2ae9255e46e4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:30.645232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328e0be-5e68-48a3-9eb4-b076f02725cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:30.648295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e0be-5e68-48a3-9eb4-b076f02725cb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:30.649770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e0be-5e68-48a3-9eb4-b076f02725cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:30.650837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328e0be-5e68-48a3-9eb4-b076f02725cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:30.654004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328e0be-5e68-48a3-9eb4-b076f02725cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:30.659985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328e0be-5e68-48a3-9eb4-b076f02725cb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:30.689422 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1516/3053] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:30.693364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e347e-642d-4816-ae69-851be88870aa admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:30.721674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e347e-642d-4816-ae69-851be88870aa admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:30.746862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06ac29-ebf1-4c4b-8573-2b980a76ebd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:30.749860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06ac29-ebf1-4c4b-8573-2b980a76ebd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:30.750554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06ac29-ebf1-4c4b-8573-2b980a76ebd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:30.751845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f06ac29-ebf1-4c4b-8573-2b980a76ebd9 admin admin] PATH_INFO: `/v3/projects/cc1867b129e246c9a3e286ce41339392/users/e23b731167094c99bba210dc92e50a7c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:30.817199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06ac29-ebf1-4c4b-8573-2b980a76ebd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc1867b129e246c9a3e286ce41339392, user_id=e23b731167094c99bba210dc92e50a7c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:30.824133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f06ac29-ebf1-4c4b-8573-2b980a76ebd9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:30.870401 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1538/3054] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:30 2022] PUT /identity/v3/projects/cc1867b129e246c9a3e286ce41339392/users/e23b731167094c99bba210dc92e50a7c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:30.888285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b844f2c-3eb4-419b-9d2e-b5e27747d674 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:30.888696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b844f2c-3eb4-419b-9d2e-b5e27747d674 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:30.889352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b844f2c-3eb4-419b-9d2e-b5e27747d674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:31.003916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6b844f2c-3eb4-419b-9d2e-b5e27747d674 None None] MFA Rules not processed for user `e23b731167094c99bba210dc92e50a7c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:31.010347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6b844f2c-3eb4-419b-9d2e-b5e27747d674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:31.036590 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:31.249514 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1517/3055] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:31.255441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06ac29-ebf1-4c4b-8573-2b980a76ebd9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:31.461076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f06ac29-ebf1-4c4b-8573-2b980a76ebd9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:31.467750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaff8f-4a14-4eb2-8706-e734fbabc0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:31.468879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaff8f-4a14-4eb2-8706-e734fbabc0c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:31.469458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaff8f-4a14-4eb2-8706-e734fbabc0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:31.469975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaff8f-4a14-4eb2-8706-e734fbabc0c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:31.470914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaff8f-4a14-4eb2-8706-e734fbabc0c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:31.473586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaff8f-4a14-4eb2-8706-e734fbabc0c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:31.559951 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1539/3056] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:31 2022] POST /identity/v3/projects => generated 367 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:02:31.564182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b844f2c-3eb4-419b-9d2e-b5e27747d674 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:31.584455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b844f2c-3eb4-419b-9d2e-b5e27747d674 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:31.795656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973f503-9756-4787-911e-64ebb1dd6cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:31.796451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f503-9756-4787-911e-64ebb1dd6cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:31.796763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f503-9756-4787-911e-64ebb1dd6cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:31.797045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0973f503-9756-4787-911e-64ebb1dd6cf9 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:31.797729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973f503-9756-4787-911e-64ebb1dd6cf9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:31.799759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0973f503-9756-4787-911e-64ebb1dd6cf9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:31.851703 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1518/3057] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:31 2022] POST /identity/v3/users => generated 290 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:31.852438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaff8f-4a14-4eb2-8706-e734fbabc0c2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:31.867550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaff8f-4a14-4eb2-8706-e734fbabc0c2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:31.878225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c32ec-aa71-45ba-adf1-fce4703587f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:31.879104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c32ec-aa71-45ba-adf1-fce4703587f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:31.879576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c32ec-aa71-45ba-adf1-fce4703587f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:31.879992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5c32ec-aa71-45ba-adf1-fce4703587f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:31.880989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c32ec-aa71-45ba-adf1-fce4703587f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:31.884239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5c32ec-aa71-45ba-adf1-fce4703587f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:31.892966 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:31.907030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973f503-9756-4787-911e-64ebb1dd6cf9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:31.915658 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1540/3058] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:31.922599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0973f503-9756-4787-911e-64ebb1dd6cf9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:31.929972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b03a-94ba-4f8e-be66-e8c3235703ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:31.931302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b03a-94ba-4f8e-be66-e8c3235703ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:31.931814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b03a-94ba-4f8e-be66-e8c3235703ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:31.932341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44b03a-94ba-4f8e-be66-e8c3235703ea admin admin] PATH_INFO: `/v3/projects/5985737ea12441feb4f2c976a512be29/users/a82b51d2e5034dea9b43c9ebebf0471e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:31.966082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44b03a-94ba-4f8e-be66-e8c3235703ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5985737ea12441feb4f2c976a512be29, user_id=a82b51d2e5034dea9b43c9ebebf0471e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:31.970901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44b03a-94ba-4f8e-be66-e8c3235703ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:32.000047 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1519/3059] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:31 2022] PUT /identity/v3/projects/5985737ea12441feb4f2c976a512be29/users/a82b51d2e5034dea9b43c9ebebf0471e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:32.004743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c32ec-aa71-45ba-adf1-fce4703587f4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:32.021131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5c32ec-aa71-45ba-adf1-fce4703587f4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:32.192291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd1114-9d9b-49b6-b193-0efa0b596329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:32.192928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd1114-9d9b-49b6-b193-0efa0b596329 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:32.195955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd1114-9d9b-49b6-b193-0efa0b596329 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:32.196386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd1114-9d9b-49b6-b193-0efa0b596329 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:32.198408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd1114-9d9b-49b6-b193-0efa0b596329 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:32.206669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd1114-9d9b-49b6-b193-0efa0b596329 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:32.242469 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1541/3060] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:32 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:32.245887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b03a-94ba-4f8e-be66-e8c3235703ea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:32.270534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44b03a-94ba-4f8e-be66-e8c3235703ea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:32.281420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32d358-90d9-40ad-8409-c111bd3470ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:32.282538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32d358-90d9-40ad-8409-c111bd3470ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:32.283023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32d358-90d9-40ad-8409-c111bd3470ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:32.283319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32d358-90d9-40ad-8409-c111bd3470ab admin admin] PATH_INFO: `/v3/projects/5985737ea12441feb4f2c976a512be29/users/a82b51d2e5034dea9b43c9ebebf0471e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:32.286430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32d358-90d9-40ad-8409-c111bd3470ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=5985737ea12441feb4f2c976a512be29, user_id=a82b51d2e5034dea9b43c9ebebf0471e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:32.293592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b32d358-90d9-40ad-8409-c111bd3470ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:32.331988 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1520/3061] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:32 2022] PUT /identity/v3/projects/5985737ea12441feb4f2c976a512be29/users/a82b51d2e5034dea9b43c9ebebf0471e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:32.344614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7aa41-a94a-4878-8f01-ac5fe504de39 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:32.345290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7aa41-a94a-4878-8f01-ac5fe504de39 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:32.345843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc7aa41-a94a-4878-8f01-ac5fe504de39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:32.452594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8dc7aa41-a94a-4878-8f01-ac5fe504de39 None None] MFA Rules not processed for user `a82b51d2e5034dea9b43c9ebebf0471e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:32.461220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8dc7aa41-a94a-4878-8f01-ac5fe504de39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:32.521431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e788b3-7b58-4637-81ab-7c2e88de7e8c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:32.521736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e788b3-7b58-4637-81ab-7c2e88de7e8c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:32.522054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e788b3-7b58-4637-81ab-7c2e88de7e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:32.637761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-82e788b3-7b58-4637-81ab-7c2e88de7e8c None None] MFA Rules not processed for user `ba45d4c2ea4c46aabee199ebc7e9d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:32.642729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82e788b3-7b58-4637-81ab-7c2e88de7e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:32.768228 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1542/3062] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 426 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:32.770153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7aa41-a94a-4878-8f01-ac5fe504de39 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:32.791611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc7aa41-a94a-4878-8f01-ac5fe504de39 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:32.798355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136c920-a4a6-45a1-a2d2-332badbab00a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:32.799391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c920-a4a6-45a1-a2d2-332badbab00a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:32.799803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c920-a4a6-45a1-a2d2-332badbab00a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:32.800911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136c920-a4a6-45a1-a2d2-332badbab00a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:32.801949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136c920-a4a6-45a1-a2d2-332badbab00a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:32.814848 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:32.817141 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-e136c920-a4a6-45a1-a2d2-332badbab00a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:32.817141 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:02:32.817141 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:02:32.818730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136c920-a4a6-45a1-a2d2-332badbab00a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:32.854860 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1543/3063] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:02:32 2022] POST /identity/v3/domains => generated 276 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:32.858435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136c920-a4a6-45a1-a2d2-332badbab00a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:32.866091 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1521/3064] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:02:32.876045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52917588-287c-4d5c-bbdd-f5aa804b2583 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:32.876638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52917588-287c-4d5c-bbdd-f5aa804b2583 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:32.877018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52917588-287c-4d5c-bbdd-f5aa804b2583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:32.915311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-52917588-287c-4d5c-bbdd-f5aa804b2583 None None] MFA Rules not processed for user `ba45d4c2ea4c46aabee199ebc7e9d6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:32.917446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52917588-287c-4d5c-bbdd-f5aa804b2583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:33.060704 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1522/3065] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:33.135145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136c920-a4a6-45a1-a2d2-332badbab00a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:33.157141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:33.158037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:33.159656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:33.160232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:33.164143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:33.168444 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:33.168444 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:02:33.168444 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:02:33.174451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:33.209573 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:33.242437 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1544/3066] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:32 2022] POST /identity/v3/groups => generated 278 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:33.248945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52917588-287c-4d5c-bbdd-f5aa804b2583 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:33.292832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52917588-287c-4d5c-bbdd-f5aa804b2583 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:33.310388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:33.312486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:33.318942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfc4bc-1a79-4d39-82b2-ad464500d1d5 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:33.320199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfc4bc-1a79-4d39-82b2-ad464500d1d5 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:33.325745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfc4bc-1a79-4d39-82b2-ad464500d1d5 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:33.326176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cfc4bc-1a79-4d39-82b2-ad464500d1d5 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/3768cb96d8954be58c01ac6471848503` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:33.341407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfc4bc-1a79-4d39-82b2-ad464500d1d5 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:update_group(group_id=3768cb96d8954be58c01ac6471848503)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:33.342766 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-53cfc4bc-1a79-4d39-82b2-ad464500d1d5 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:33.342766 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:02:33.342766 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:02:33.343988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cfc4bc-1a79-4d39-82b2-ad464500d1d5 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:33.385941 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1523/3067] 10.222.0.25 () {60 vars in 1247 bytes} [Mon Oct 24 09:02:33 2022] PATCH /identity/v3/groups/3768cb96d8954be58c01ac6471848503 => generated 292 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:33.390573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfc4bc-1a79-4d39-82b2-ad464500d1d5 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:33.411805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cfc4bc-1a79-4d39-82b2-ad464500d1d5 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:33.419044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9a5cd-3900-4a13-a728-1b5bce5b21f1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:33.420195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9a5cd-3900-4a13-a728-1b5bce5b21f1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:33.420729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9a5cd-3900-4a13-a728-1b5bce5b21f1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:33.421233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d9a5cd-3900-4a13-a728-1b5bce5b21f1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/3768cb96d8954be58c01ac6471848503` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:33.433972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9a5cd-3900-4a13-a728-1b5bce5b21f1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:get_group(group_id=3768cb96d8954be58c01ac6471848503)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:33.435549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d9a5cd-3900-4a13-a728-1b5bce5b21f1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:33.446597 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1524/3068] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:33 2022] GET /identity/v3/groups/3768cb96d8954be58c01ac6471848503 => generated 292 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:02:33.446597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9a5cd-3900-4a13-a728-1b5bce5b21f1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:33.467174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d9a5cd-3900-4a13-a728-1b5bce5b21f1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:33.479460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c1c49-c6aa-4909-91de-9d0b35bc2bdb tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:33.480175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c1c49-c6aa-4909-91de-9d0b35bc2bdb tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:33.480380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c1c49-c6aa-4909-91de-9d0b35bc2bdb tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:33.480663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4c1c49-c6aa-4909-91de-9d0b35bc2bdb tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/3768cb96d8954be58c01ac6471848503` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:33.482186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c1c49-c6aa-4909-91de-9d0b35bc2bdb tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:update_group(group_id=3768cb96d8954be58c01ac6471848503)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:33.483851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4c1c49-c6aa-4909-91de-9d0b35bc2bdb tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:33.519432 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1525/3069] 10.222.0.25 () {60 vars in 1246 bytes} [Mon Oct 24 09:02:33 2022] PATCH /identity/v3/groups/3768cb96d8954be58c01ac6471848503 => generated 307 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:33.523164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c1c49-c6aa-4909-91de-9d0b35bc2bdb tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:33.558065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb64646-a9e3-4e12-8eb4-6586da73cd63 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:33.561401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4c1c49-c6aa-4909-91de-9d0b35bc2bdb tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:33.567438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bced6-9438-46e0-ae0d-e3bfbe7393fd tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:33.568237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bced6-9438-46e0-ae0d-e3bfbe7393fd tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:33.568586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bced6-9438-46e0-ae0d-e3bfbe7393fd tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:33.569086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5bced6-9438-46e0-ae0d-e3bfbe7393fd tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/3768cb96d8954be58c01ac6471848503` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:33.575647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bced6-9438-46e0-ae0d-e3bfbe7393fd tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3768cb96d8954be58c01ac6471848503)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:33.576966 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-ca5bced6-9438-46e0-ae0d-e3bfbe7393fd tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:33.576966 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:02:33.576966 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:02:33.578810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5bced6-9438-46e0-ae0d-e3bfbe7393fd tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:33.598087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d35e-eb36-4be6-8171-6235d7d89bc9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:33.598734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d35e-eb36-4be6-8171-6235d7d89bc9 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:33.599024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d35e-eb36-4be6-8171-6235d7d89bc9 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:33.599307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293d35e-eb36-4be6-8171-6235d7d89bc9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:33.614659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293d35e-eb36-4be6-8171-6235d7d89bc9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:33.619439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293d35e-eb36-4be6-8171-6235d7d89bc9 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:33.643506 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1545/3070] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:02:33.669947 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1526/3071] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:02:33 2022] DELETE /identity/v3/groups/3768cb96d8954be58c01ac6471848503 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:33.676369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d35e-eb36-4be6-8171-6235d7d89bc9 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:33.693165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293d35e-eb36-4be6-8171-6235d7d89bc9 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:33.795414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9384e5-0685-48ed-a7b3-9851f5a0fe2e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:33.796243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9384e5-0685-48ed-a7b3-9851f5a0fe2e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:33.796536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9384e5-0685-48ed-a7b3-9851f5a0fe2e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:33.797473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9384e5-0685-48ed-a7b3-9851f5a0fe2e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:33.798819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9384e5-0685-48ed-a7b3-9851f5a0fe2e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:33.802220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9384e5-0685-48ed-a7b3-9851f5a0fe2e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:33.840387 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1546/3072] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:33 2022] POST /identity/v3/groups => generated 325 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:33.847118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bced6-9438-46e0-ae0d-e3bfbe7393fd tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:33.864970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5bced6-9438-46e0-ae0d-e3bfbe7393fd tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:33.874501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0acc4c-dc72-45c8-afd0-1670e1cb2cf2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:33.875843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0acc4c-dc72-45c8-afd0-1670e1cb2cf2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:33.876450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0acc4c-dc72-45c8-afd0-1670e1cb2cf2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:33.877010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0acc4c-dc72-45c8-afd0-1670e1cb2cf2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:33.882516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0acc4c-dc72-45c8-afd0-1670e1cb2cf2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:33.885879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0acc4c-dc72-45c8-afd0-1670e1cb2cf2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:33.929345 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1527/3073] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:33 2022] POST /identity/v3/users => generated 323 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:33.931975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9384e5-0685-48ed-a7b3-9851f5a0fe2e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:33.945971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9384e5-0685-48ed-a7b3-9851f5a0fe2e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:33.964041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a1072-203d-4442-a010-560a543ba861 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:33.966615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a1072-203d-4442-a010-560a543ba861 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:33.967007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a1072-203d-4442-a010-560a543ba861 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:33.967301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a1072-203d-4442-a010-560a543ba861 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users/6cee6a4cb0ac4f9f9ade9361a7353884` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:34.029383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a1072-203d-4442-a010-560a543ba861 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=987554945969429ca41735f143e65af1, user_id=6cee6a4cb0ac4f9f9ade9361a7353884)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:34.037697 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-225a1072-203d-4442-a010-560a543ba861 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:34.037697 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:02:34.037697 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:02:34.039540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a1072-203d-4442-a010-560a543ba861 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:34.142500 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1547/3074] 10.222.0.25 () {60 vars in 1360 bytes} [Mon Oct 24 09:02:33 2022] PUT /identity/v3/groups/987554945969429ca41735f143e65af1/users/6cee6a4cb0ac4f9f9ade9361a7353884 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:34.144410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0acc4c-dc72-45c8-afd0-1670e1cb2cf2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:34.164625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0acc4c-dc72-45c8-afd0-1670e1cb2cf2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:34.282978 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:UPDATE=2,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:34.345442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eef61-0e15-4355-81a6-55a0a93bcd50 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:34.346077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eef61-0e15-4355-81a6-55a0a93bcd50 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:34.346365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eef61-0e15-4355-81a6-55a0a93bcd50 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:34.346687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77eef61-0e15-4355-81a6-55a0a93bcd50 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:34.347341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eef61-0e15-4355-81a6-55a0a93bcd50 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:34.349432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77eef61-0e15-4355-81a6-55a0a93bcd50 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:34.471024 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1528/3075] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:34 2022] POST /identity/v3/users => generated 323 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:34.471739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a1072-203d-4442-a010-560a543ba861 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:34.486593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a1072-203d-4442-a010-560a543ba861 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:34.506862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81453496-3c0d-4768-8b91-8653512e552b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:34.507573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453496-3c0d-4768-8b91-8653512e552b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:34.507936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453496-3c0d-4768-8b91-8653512e552b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:34.508170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81453496-3c0d-4768-8b91-8653512e552b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users/e797b3f904ce474785647eab05df83cf` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:34.575190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81453496-3c0d-4768-8b91-8653512e552b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=987554945969429ca41735f143e65af1, user_id=e797b3f904ce474785647eab05df83cf)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:34.577353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81453496-3c0d-4768-8b91-8653512e552b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:34.674562 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1548/3076] 10.222.0.25 () {60 vars in 1360 bytes} [Mon Oct 24 09:02:34 2022] PUT /identity/v3/groups/987554945969429ca41735f143e65af1/users/e797b3f904ce474785647eab05df83cf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:34.680054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eef61-0e15-4355-81a6-55a0a93bcd50 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:34.696043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77eef61-0e15-4355-81a6-55a0a93bcd50 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:34.928067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e7a06-bb94-4201-ba58-f3f5e75bc5e1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:34.931973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e7a06-bb94-4201-ba58-f3f5e75bc5e1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:34.932397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e7a06-bb94-4201-ba58-f3f5e75bc5e1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:34.932790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896e7a06-bb94-4201-ba58-f3f5e75bc5e1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:34.933683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e7a06-bb94-4201-ba58-f3f5e75bc5e1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:34.941776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896e7a06-bb94-4201-ba58-f3f5e75bc5e1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:35.038883 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1529/3077] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:34 2022] POST /identity/v3/users => generated 321 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:35.042567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81453496-3c0d-4768-8b91-8653512e552b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:35.049177 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:35.064905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81453496-3c0d-4768-8b91-8653512e552b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:35.082860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6915573-5d2f-4250-8a27-79c1e55b57c3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:35.084371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6915573-5d2f-4250-8a27-79c1e55b57c3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:35.085175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6915573-5d2f-4250-8a27-79c1e55b57c3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:35.087021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6915573-5d2f-4250-8a27-79c1e55b57c3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users/a6c6ee8ca68e4fac93fe7195e049b78e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:35.135276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6915573-5d2f-4250-8a27-79c1e55b57c3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=987554945969429ca41735f143e65af1, user_id=a6c6ee8ca68e4fac93fe7195e049b78e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:35.137839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6915573-5d2f-4250-8a27-79c1e55b57c3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:35.185534 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1549/3078] 10.222.0.25 () {60 vars in 1360 bytes} [Mon Oct 24 09:02:35 2022] PUT /identity/v3/groups/987554945969429ca41735f143e65af1/users/a6c6ee8ca68e4fac93fe7195e049b78e => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:35.188147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e7a06-bb94-4201-ba58-f3f5e75bc5e1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:35.200239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896e7a06-bb94-4201-ba58-f3f5e75bc5e1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:35.358032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13eee3-a744-4a65-aeb6-54a22a44a26c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:35.359908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13eee3-a744-4a65-aeb6-54a22a44a26c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:35.365272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13eee3-a744-4a65-aeb6-54a22a44a26c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:35.365769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c13eee3-a744-4a65-aeb6-54a22a44a26c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:35.370175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13eee3-a744-4a65-aeb6-54a22a44a26c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=987554945969429ca41735f143e65af1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:35.376585 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-6c13eee3-a744-4a65-aeb6-54a22a44a26c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:35.376585 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:02:35.376585 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:02:35.383082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c13eee3-a744-4a65-aeb6-54a22a44a26c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:35.436052 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1530/3079] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:02:35 2022] GET /identity/v3/groups/987554945969429ca41735f143e65af1/users => generated 1083 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:35.440263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6915573-5d2f-4250-8a27-79c1e55b57c3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:35.457190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6915573-5d2f-4250-8a27-79c1e55b57c3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:35.469705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54511c-40b0-4cdd-ba73-16213954ecc7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:35.472237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54511c-40b0-4cdd-ba73-16213954ecc7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:35.474273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54511c-40b0-4cdd-ba73-16213954ecc7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:35.474947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c54511c-40b0-4cdd-ba73-16213954ecc7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users/6cee6a4cb0ac4f9f9ade9361a7353884` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:35.479978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54511c-40b0-4cdd-ba73-16213954ecc7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=987554945969429ca41735f143e65af1, user_id=6cee6a4cb0ac4f9f9ade9361a7353884)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:35.483060 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-4c54511c-40b0-4cdd-ba73-16213954ecc7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_user_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:35.483060 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:02:35.483060 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:02:35.488872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c54511c-40b0-4cdd-ba73-16213954ecc7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:35.540459 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1550/3080] 10.222.0.25 () {58 vars in 1342 bytes} [Mon Oct 24 09:02:35 2022] HEAD /identity/v3/groups/987554945969429ca41735f143e65af1/users/6cee6a4cb0ac4f9f9ade9361a7353884 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:35.543896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13eee3-a744-4a65-aeb6-54a22a44a26c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:35.570567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c13eee3-a744-4a65-aeb6-54a22a44a26c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:35.591349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:35.592015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:35.592354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:35.592633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users/6cee6a4cb0ac4f9f9ade9361a7353884` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:35.602072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=987554945969429ca41735f143e65af1, user_id=6cee6a4cb0ac4f9f9ade9361a7353884)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:35.603134 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:35.603134 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:02:35.603134 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:02:35.604534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:35.631591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '6cee6a4cb0ac4f9f9ade9361a7353884'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:35.656998 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1531/3081] 10.222.0.25 () {58 vars in 1344 bytes} [Mon Oct 24 09:02:35 2022] DELETE /identity/v3/groups/987554945969429ca41735f143e65af1/users/6cee6a4cb0ac4f9f9ade9361a7353884 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:35.663675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54511c-40b0-4cdd-ba73-16213954ecc7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:35.698811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c54511c-40b0-4cdd-ba73-16213954ecc7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:35.841449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481e746-4dd5-48cc-bf62-354463cfb67e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:35.842126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481e746-4dd5-48cc-bf62-354463cfb67e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:35.845490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481e746-4dd5-48cc-bf62-354463cfb67e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:35.845813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5481e746-4dd5-48cc-bf62-354463cfb67e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users/e797b3f904ce474785647eab05df83cf` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:35.851843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481e746-4dd5-48cc-bf62-354463cfb67e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=987554945969429ca41735f143e65af1, user_id=e797b3f904ce474785647eab05df83cf)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:35.854352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5481e746-4dd5-48cc-bf62-354463cfb67e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:35.885346 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1551/3082] 10.222.0.25 () {58 vars in 1342 bytes} [Mon Oct 24 09:02:35 2022] HEAD /identity/v3/groups/987554945969429ca41735f143e65af1/users/e797b3f904ce474785647eab05df83cf => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:35.886209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:35.897640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d8276-3bfd-4874-9aa4-b49d3c190179 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:35.911971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d909b-d43c-447b-9a47-5698e889b7bc tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:35.912689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d909b-d43c-447b-9a47-5698e889b7bc tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:35.912982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d909b-d43c-447b-9a47-5698e889b7bc tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:35.913260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147d909b-d43c-447b-9a47-5698e889b7bc tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users/e797b3f904ce474785647eab05df83cf` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:35.917285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d909b-d43c-447b-9a47-5698e889b7bc tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=987554945969429ca41735f143e65af1, user_id=e797b3f904ce474785647eab05df83cf)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:35.919123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147d909b-d43c-447b-9a47-5698e889b7bc tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:35.936312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-147d909b-d43c-447b-9a47-5698e889b7bc tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'e797b3f904ce474785647eab05df83cf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:35.960066 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1532/3083] 10.222.0.25 () {58 vars in 1344 bytes} [Mon Oct 24 09:02:35 2022] DELETE /identity/v3/groups/987554945969429ca41735f143e65af1/users/e797b3f904ce474785647eab05df83cf => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:35.964223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481e746-4dd5-48cc-bf62-354463cfb67e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:35.976141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5481e746-4dd5-48cc-bf62-354463cfb67e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:36.141711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107c39-526d-499b-8af1-6b23ee1deec8 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:36.142489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107c39-526d-499b-8af1-6b23ee1deec8 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:36.142867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107c39-526d-499b-8af1-6b23ee1deec8 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:36.143221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a107c39-526d-499b-8af1-6b23ee1deec8 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users/a6c6ee8ca68e4fac93fe7195e049b78e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:36.153721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a107c39-526d-499b-8af1-6b23ee1deec8 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:check_user_in_group(group_id=987554945969429ca41735f143e65af1, user_id=a6c6ee8ca68e4fac93fe7195e049b78e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:36.158708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a107c39-526d-499b-8af1-6b23ee1deec8 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:36.211711 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1552/3084] 10.222.0.25 () {58 vars in 1342 bytes} [Mon Oct 24 09:02:35 2022] HEAD /identity/v3/groups/987554945969429ca41735f143e65af1/users/a6c6ee8ca68e4fac93fe7195e049b78e => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:36.219357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d909b-d43c-447b-9a47-5698e889b7bc tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:36.236020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147d909b-d43c-447b-9a47-5698e889b7bc tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:36.244028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273d45-7e8e-4f48-a09f-ec5532feb6b3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:36.245172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273d45-7e8e-4f48-a09f-ec5532feb6b3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:36.245876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273d45-7e8e-4f48-a09f-ec5532feb6b3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:36.246657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19273d45-7e8e-4f48-a09f-ec5532feb6b3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users/a6c6ee8ca68e4fac93fe7195e049b78e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:36.249169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19273d45-7e8e-4f48-a09f-ec5532feb6b3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=987554945969429ca41735f143e65af1, user_id=a6c6ee8ca68e4fac93fe7195e049b78e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:36.252585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19273d45-7e8e-4f48-a09f-ec5532feb6b3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:36.259446 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:INSERT=8,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:36.266931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-19273d45-7e8e-4f48-a09f-ec5532feb6b3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'a6c6ee8ca68e4fac93fe7195e049b78e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:36.304883 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1533/3085] 10.222.0.25 () {58 vars in 1344 bytes} [Mon Oct 24 09:02:36 2022] DELETE /identity/v3/groups/987554945969429ca41735f143e65af1/users/a6c6ee8ca68e4fac93fe7195e049b78e => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:36.306811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107c39-526d-499b-8af1-6b23ee1deec8 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:36.327357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a107c39-526d-499b-8af1-6b23ee1deec8 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:36.538803 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:36.649394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:36.650394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:36.652237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:36.652751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:36.656253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:list_users_in_group(group_id=987554945969429ca41735f143e65af1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:36.660304 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users_in_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:36.660304 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:02:36.660304 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:02:36.662843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:36.716297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273d45-7e8e-4f48-a09f-ec5532feb6b3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:36.719800 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1553/3086] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:02:36 2022] GET /identity/v3/groups/987554945969429ca41735f143e65af1/users => generated 145 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:36.747250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19273d45-7e8e-4f48-a09f-ec5532feb6b3 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:36.763818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:36.764465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:36.764743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:36.765017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/users/a6c6ee8ca68e4fac93fe7195e049b78e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:36.779055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a6c6ee8ca68e4fac93fe7195e049b78e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:36.787040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:36.966620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c6ee8ca68e4fac93fe7195e049b78e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.033672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c6ee8ca68e4fac93fe7195e049b78e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.036329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c6ee8ca68e4fac93fe7195e049b78e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.051198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c6ee8ca68e4fac93fe7195e049b78e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.094061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c6ee8ca68e4fac93fe7195e049b78e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.133374 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1534/3087] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:36 2022] DELETE /identity/v3/users/a6c6ee8ca68e4fac93fe7195e049b78e => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:37.134325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:37.137119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:37.177508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e32739-7248-43bf-b976-d86439131b5a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:37.464411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:37.465280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:37.465674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:37.467230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/users/e797b3f904ce474785647eab05df83cf` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:37.469665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e797b3f904ce474785647eab05df83cf)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:37.474853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:37.659792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e797b3f904ce474785647eab05df83cf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.711669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e797b3f904ce474785647eab05df83cf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.733963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e797b3f904ce474785647eab05df83cf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.785882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e797b3f904ce474785647eab05df83cf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.816488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e797b3f904ce474785647eab05df83cf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:37.849983 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1554/3088] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:37 2022] DELETE /identity/v3/users/e797b3f904ce474785647eab05df83cf => generated 0 bytes in 713 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:37.851221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:37.869594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b6a9a1-f284-4cc2-a53a-08211368d46b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:38.205438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:38.208871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:38.208871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:38.217477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/users/6cee6a4cb0ac4f9f9ade9361a7353884` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:38.217477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_user(user_id=6cee6a4cb0ac4f9f9ade9361a7353884)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:38.224957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:38.341151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cee6a4cb0ac4f9f9ade9361a7353884'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:38.367316 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=78,keystone:INSERT=2,keystone:DELETE=20 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:38.369486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cee6a4cb0ac4f9f9ade9361a7353884'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:38.370727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cee6a4cb0ac4f9f9ade9361a7353884'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:38.383462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cee6a4cb0ac4f9f9ade9361a7353884'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:38.397943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cee6a4cb0ac4f9f9ade9361a7353884'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:38.411807 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1535/3089] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:37 2022] DELETE /identity/v3/users/6cee6a4cb0ac4f9f9ade9361a7353884 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:38.413058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:38.414996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:38.446886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ead3e16-c6c6-4042-9624-32c41efd94a7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:38.634029 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:38.661633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afacdaf-a2f4-4a46-b9ae-ff5626c374ae tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:38.665331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afacdaf-a2f4-4a46-b9ae-ff5626c374ae tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:38.667721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afacdaf-a2f4-4a46-b9ae-ff5626c374ae tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:38.668195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afacdaf-a2f4-4a46-b9ae-ff5626c374ae tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/987554945969429ca41735f143e65af1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:38.671217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afacdaf-a2f4-4a46-b9ae-ff5626c374ae tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_group(group_id=987554945969429ca41735f143e65af1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:38.675060 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-8afacdaf-a2f4-4a46-b9ae-ff5626c374ae tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:38.675060 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:02:38.675060 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:02:38.678364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afacdaf-a2f4-4a46-b9ae-ff5626c374ae tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:38.796241 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1555/3090] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:02:38 2022] DELETE /identity/v3/groups/987554945969429ca41735f143e65af1 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:38.804373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:38.806935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:38.824434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e3cd6-ba37-45f6-8825-2c00da6b0456 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:38.959733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642535ad-98e8-4b50-a28e-07efc28c26b9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:38.960754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642535ad-98e8-4b50-a28e-07efc28c26b9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:38.961840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642535ad-98e8-4b50-a28e-07efc28c26b9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:38.962488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642535ad-98e8-4b50-a28e-07efc28c26b9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:38.963736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642535ad-98e8-4b50-a28e-07efc28c26b9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:38.964989 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-642535ad-98e8-4b50-a28e-07efc28c26b9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:38.964989 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:02:38.964989 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:02:38.966654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642535ad-98e8-4b50-a28e-07efc28c26b9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:38.988376 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1536/3091] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:38 2022] POST /identity/v3/groups => generated 326 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:02:38.992591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afacdaf-a2f4-4a46-b9ae-ff5626c374ae tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:39.008563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afacdaf-a2f4-4a46-b9ae-ff5626c374ae tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:39.019047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637609b7-c0fb-4f5b-8a79-d307e204db6c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:39.021853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637609b7-c0fb-4f5b-8a79-d307e204db6c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:39.022654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637609b7-c0fb-4f5b-8a79-d307e204db6c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:39.023029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637609b7-c0fb-4f5b-8a79-d307e204db6c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:39.025688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637609b7-c0fb-4f5b-8a79-d307e204db6c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:39.031221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637609b7-c0fb-4f5b-8a79-d307e204db6c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:39.070220 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1556/3092] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:38 2022] POST /identity/v3/groups => generated 325 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:39.074317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642535ad-98e8-4b50-a28e-07efc28c26b9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:39.089025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642535ad-98e8-4b50-a28e-07efc28c26b9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:39.101477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b911c8-539c-4902-811f-3cd4365f0025 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:39.102366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b911c8-539c-4902-811f-3cd4365f0025 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:39.107697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b911c8-539c-4902-811f-3cd4365f0025 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:39.108465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b911c8-539c-4902-811f-3cd4365f0025 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:39.109426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b911c8-539c-4902-811f-3cd4365f0025 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:39.111609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b911c8-539c-4902-811f-3cd4365f0025 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:39.166012 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1537/3093] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:39 2022] POST /identity/v3/groups => generated 327 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:39.169357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637609b7-c0fb-4f5b-8a79-d307e204db6c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:39.209890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637609b7-c0fb-4f5b-8a79-d307e204db6c tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:39.239538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830b212-52d1-456e-a2b1-7dfe8a74932b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:39.240232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830b212-52d1-456e-a2b1-7dfe8a74932b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:39.240585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830b212-52d1-456e-a2b1-7dfe8a74932b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:39.241771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0830b212-52d1-456e-a2b1-7dfe8a74932b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:39.245373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830b212-52d1-456e-a2b1-7dfe8a74932b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:list_groups()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:39.249915 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-0830b212-52d1-456e-a2b1-7dfe8a74932b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_groups": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:39.249915 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:02:39.249915 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:02:39.254955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0830b212-52d1-456e-a2b1-7dfe8a74932b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:39.293311 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1557/3094] 10.222.0.25 () {58 vars in 1125 bytes} [Mon Oct 24 09:02:39 2022] GET /identity/v3/groups => generated 1488 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:39.294196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b911c8-539c-4902-811f-3cd4365f0025 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:39.313909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b911c8-539c-4902-811f-3cd4365f0025 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:39.324707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a0a45-314b-467a-95f2-3524f84b7691 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:39.325388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a0a45-314b-467a-95f2-3524f84b7691 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:39.325669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a0a45-314b-467a-95f2-3524f84b7691 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:39.326332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491a0a45-314b-467a-95f2-3524f84b7691 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/e3fe722d6af343e0a67cf3a3a37ab521` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:39.341326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a0a45-314b-467a-95f2-3524f84b7691 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e3fe722d6af343e0a67cf3a3a37ab521)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:39.343807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491a0a45-314b-467a-95f2-3524f84b7691 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:39.487774 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1538/3095] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:02:39 2022] DELETE /identity/v3/groups/e3fe722d6af343e0a67cf3a3a37ab521 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:39.492074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830b212-52d1-456e-a2b1-7dfe8a74932b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:39.504676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0830b212-52d1-456e-a2b1-7dfe8a74932b tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:39.642889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b18ee4-c815-47a4-b6fc-b67e31219789 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:39.646246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b18ee4-c815-47a4-b6fc-b67e31219789 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:39.646591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b18ee4-c815-47a4-b6fc-b67e31219789 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:39.646872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b18ee4-c815-47a4-b6fc-b67e31219789 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/62cf85265f1d45fe90465a6e37d0a0e4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:39.661360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b18ee4-c815-47a4-b6fc-b67e31219789 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_group(group_id=62cf85265f1d45fe90465a6e37d0a0e4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:39.671540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b18ee4-c815-47a4-b6fc-b67e31219789 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:39.783907 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1558/3096] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:02:39 2022] DELETE /identity/v3/groups/62cf85265f1d45fe90465a6e37d0a0e4 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:39.789937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a0a45-314b-467a-95f2-3524f84b7691 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:39.805479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491a0a45-314b-467a-95f2-3524f84b7691 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:40.006411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9906e8-84ee-43b0-a4c2-fff00489b573 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:40.008900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9906e8-84ee-43b0-a4c2-fff00489b573 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:40.008900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9906e8-84ee-43b0-a4c2-fff00489b573 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:40.009601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9906e8-84ee-43b0-a4c2-fff00489b573 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/413710a8bbcc4b54bd4f224e33c2fc11` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:40.033208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9906e8-84ee-43b0-a4c2-fff00489b573 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_group(group_id=413710a8bbcc4b54bd4f224e33c2fc11)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:40.040404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9906e8-84ee-43b0-a4c2-fff00489b573 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:40.072926 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:40.216618 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1539/3097] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:02:39 2022] DELETE /identity/v3/groups/413710a8bbcc4b54bd4f224e33c2fc11 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:40.222075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b18ee4-c815-47a4-b6fc-b67e31219789 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:40.242925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b18ee4-c815-47a4-b6fc-b67e31219789 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:40.367191 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:40.407259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870d55a-2191-4239-9886-8b0a87665da7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:40.409308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870d55a-2191-4239-9886-8b0a87665da7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:40.410597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870d55a-2191-4239-9886-8b0a87665da7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:40.412355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2870d55a-2191-4239-9886-8b0a87665da7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:40.413122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870d55a-2191-4239-9886-8b0a87665da7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:40.418729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2870d55a-2191-4239-9886-8b0a87665da7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:40.498097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9906e8-84ee-43b0-a4c2-fff00489b573 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:40.503965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ca9906e8-84ee-43b0-a4c2-fff00489b573 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:40.521700 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1559/3098] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:40 2022] POST /identity/v3/users => generated 321 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:40.523948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870d55a-2191-4239-9886-8b0a87665da7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:40.568993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2870d55a-2191-4239-9886-8b0a87665da7 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:40.592720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726036d-bf4c-4496-8126-602ecd5c0e9e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:40.596307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726036d-bf4c-4496-8126-602ecd5c0e9e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:40.597209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726036d-bf4c-4496-8126-602ecd5c0e9e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:40.623175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726036d-bf4c-4496-8126-602ecd5c0e9e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:40.627613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726036d-bf4c-4496-8126-602ecd5c0e9e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:40.640840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726036d-bf4c-4496-8126-602ecd5c0e9e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:40.662468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9906e8-84ee-43b0-a4c2-fff00489b573 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:40.682581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:40.685442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:40.685758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:40.688792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] PATH_INFO: `/v3/users/7e709503bbff4c239491b0f109673264` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:40.688792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e709503bbff4c239491b0f109673264)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:40.690059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:40.703410 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1560/3099] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:40 2022] POST /identity/v3/groups => generated 326 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:40.708242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726036d-bf4c-4496-8126-602ecd5c0e9e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:40.722424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726036d-bf4c-4496-8126-602ecd5c0e9e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:40.747860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0039ac6-4670-42a1-b0ab-402953517451 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:40.748691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0039ac6-4670-42a1-b0ab-402953517451 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:40.749419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0039ac6-4670-42a1-b0ab-402953517451 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:40.749814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0039ac6-4670-42a1-b0ab-402953517451 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/2d36cab07eaa469b94f126323636ea2a/users/9592424131814e86ab367a4d3c65ffd8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:40.818818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e709503bbff4c239491b0f109673264'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:40.829171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0039ac6-4670-42a1-b0ab-402953517451 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=2d36cab07eaa469b94f126323636ea2a, user_id=9592424131814e86ab367a4d3c65ffd8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:40.835586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0039ac6-4670-42a1-b0ab-402953517451 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:40.852148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e709503bbff4c239491b0f109673264'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:40.853340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e709503bbff4c239491b0f109673264'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:40.870473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e709503bbff4c239491b0f109673264'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:40.883227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e709503bbff4c239491b0f109673264'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:40.899576 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1561/3100] 10.222.0.25 () {60 vars in 1360 bytes} [Mon Oct 24 09:02:40 2022] PUT /identity/v3/groups/2d36cab07eaa469b94f126323636ea2a/users/9592424131814e86ab367a4d3c65ffd8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:40.902665 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1540/3101] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:40 2022] DELETE /identity/v3/users/7e709503bbff4c239491b0f109673264 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:40.907106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0039ac6-4670-42a1-b0ab-402953517451 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:40.909225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0039ac6-4670-42a1-b0ab-402953517451 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:41.106275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0039ac6-4670-42a1-b0ab-402953517451 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:41.247968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0db3-18d3-4193-b742-01fe36c313c1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:41.248726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0db3-18d3-4193-b742-01fe36c313c1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:41.249563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0db3-18d3-4193-b742-01fe36c313c1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:41.250448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493d0db3-18d3-4193-b742-01fe36c313c1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:41.251245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d0db3-18d3-4193-b742-01fe36c313c1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:41.254357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493d0db3-18d3-4193-b742-01fe36c313c1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:41.277435 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1562/3102] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:02:40 2022] POST /identity/v3/groups => generated 327 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:41.281822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:41.294816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f1879f-0c52-431c-9ba1-05b5f2529396 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:41.318645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253481f-35d9-4d9c-938e-4624fdfe8f48 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:41.320206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253481f-35d9-4d9c-938e-4624fdfe8f48 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:41.321199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253481f-35d9-4d9c-938e-4624fdfe8f48 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:41.322121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e253481f-35d9-4d9c-938e-4624fdfe8f48 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/e2f4655aca2644b69ff96664e8eea7d0/users/9592424131814e86ab367a4d3c65ffd8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:41.340752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0db3-18d3-4193-b742-01fe36c313c1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:41.342840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-493d0db3-18d3-4193-b742-01fe36c313c1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:41.350273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253481f-35d9-4d9c-938e-4624fdfe8f48 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=e2f4655aca2644b69ff96664e8eea7d0, user_id=9592424131814e86ab367a4d3c65ffd8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:41.357649 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-e253481f-35d9-4d9c-938e-4624fdfe8f48 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:add_user_to_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:41.357649 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:02:41.357649 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:02:41.364767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e253481f-35d9-4d9c-938e-4624fdfe8f48 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:41.415138 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:41.490133 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1541/3103] 10.222.0.25 () {60 vars in 1360 bytes} [Mon Oct 24 09:02:41 2022] PUT /identity/v3/groups/e2f4655aca2644b69ff96664e8eea7d0/users/9592424131814e86ab367a4d3c65ffd8 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:41.494832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253481f-35d9-4d9c-938e-4624fdfe8f48 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:41.554184 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:41.582206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493d0db3-18d3-4193-b742-01fe36c313c1 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:41.702998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e253481f-35d9-4d9c-938e-4624fdfe8f48 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:41.715211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4222ff-dcdc-429f-b3e9-39d5be769d1a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:41.715868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4222ff-dcdc-429f-b3e9-39d5be769d1a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:41.716230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4222ff-dcdc-429f-b3e9-39d5be769d1a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:41.716510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4222ff-dcdc-429f-b3e9-39d5be769d1a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/users/9592424131814e86ab367a4d3c65ffd8/groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:41.717907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4222ff-dcdc-429f-b3e9-39d5be769d1a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:list_groups_for_user(user_id=9592424131814e86ab367a4d3c65ffd8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:41.720200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4222ff-dcdc-429f-b3e9-39d5be769d1a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:41.750540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:41.751734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:41.752320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:41.752912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] PATH_INFO: `/v3/projects/b90fabc24c5d4f509e45e0eec0b323a7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:41.754872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b90fabc24c5d4f509e45e0eec0b323a7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:41.757780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:41.765248 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1542/3104] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:02:41 2022] GET /identity/v3/users/9592424131814e86ab367a4d3c65ffd8/groups => generated 839 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:41.766964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4222ff-dcdc-429f-b3e9-39d5be769d1a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:41.790031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4222ff-dcdc-429f-b3e9-39d5be769d1a tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:41.797109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0a99f-1489-4cea-ae70-50cd5b29666e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:41.797821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a99f-1489-4cea-ae70-50cd5b29666e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:41.798058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a99f-1489-4cea-ae70-50cd5b29666e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:41.798336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e0a99f-1489-4cea-ae70-50cd5b29666e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/e2f4655aca2644b69ff96664e8eea7d0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:41.799668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0a99f-1489-4cea-ae70-50cd5b29666e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_group(group_id=e2f4655aca2644b69ff96664e8eea7d0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:41.802258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e0a99f-1489-4cea-ae70-50cd5b29666e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:41.942848 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1543/3105] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:02:41 2022] DELETE /identity/v3/groups/e2f4655aca2644b69ff96664e8eea7d0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:41.944372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0a99f-1489-4cea-ae70-50cd5b29666e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:41.945116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b90fabc24c5d4f509e45e0eec0b323a7', 'request_id': 'req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:41.972043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b90fabc24c5d4f509e45e0eec0b323a7', 'request_id': 'req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:41.982352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b90fabc24c5d4f509e45e0eec0b323a7', 'request_id': 'req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:42.012149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] The token cache is being invalidate because project b90fabc24c5d4f509e45e0eec0b323a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:42.014511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:42.015332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59f4dffc-2e30-4ca2-b74b-0f11d1815a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:42.023231 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1563/3106] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:41 2022] DELETE /identity/v3/projects/b90fabc24c5d4f509e45e0eec0b323a7 => generated 0 bytes in 679 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:42.024903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbeb53-c745-4ba8-872f-92b24d12e357 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:42.025187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbeb53-c745-4ba8-872f-92b24d12e357 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:42.026070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbeb53-c745-4ba8-872f-92b24d12e357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:42.101651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-42cbeb53-c745-4ba8-872f-92b24d12e357 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:42.106757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42cbeb53-c745-4ba8-872f-92b24d12e357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:42.108037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e0a99f-1489-4cea-ae70-50cd5b29666e tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:42.127481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6b783-41e2-4550-a34c-da33438e7302 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:42.130075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6b783-41e2-4550-a34c-da33438e7302 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:42.130382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6b783-41e2-4550-a34c-da33438e7302 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:42.131799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be6b783-41e2-4550-a34c-da33438e7302 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/groups/2d36cab07eaa469b94f126323636ea2a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:42.135324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6b783-41e2-4550-a34c-da33438e7302 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_group(group_id=2d36cab07eaa469b94f126323636ea2a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:42.147000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be6b783-41e2-4550-a34c-da33438e7302 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:42.280044 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1544/3107] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:02:41 2022] DELETE /identity/v3/groups/2d36cab07eaa469b94f126323636ea2a => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:42.281603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6b783-41e2-4550-a34c-da33438e7302 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:42.286574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2be6b783-41e2-4550-a34c-da33438e7302 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:42.317390 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1564/3108] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:42.340117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64e7f7-8695-478c-b9c4-cf076dbe5f39 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:42.341917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64e7f7-8695-478c-b9c4-cf076dbe5f39 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:42.342107 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:42.342539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf64e7f7-8695-478c-b9c4-cf076dbe5f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:42.356546 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:42.380067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bf64e7f7-8695-478c-b9c4-cf076dbe5f39 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:42.381884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bf64e7f7-8695-478c-b9c4-cf076dbe5f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:42.508342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be6b783-41e2-4550-a34c-da33438e7302 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:42.536241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:42.538570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:42.538570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:42.538570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/users/9592424131814e86ab367a4d3c65ffd8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:42.539528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_user(user_id=9592424131814e86ab367a4d3c65ffd8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:42.543060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:42.705606 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1565/3109] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:42.710893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64e7f7-8695-478c-b9c4-cf076dbe5f39 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:42.728764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9592424131814e86ab367a4d3c65ffd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:42.752043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf64e7f7-8695-478c-b9c4-cf076dbe5f39 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:42.768333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:42.770554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:42.770853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:42.771138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:42.773955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:02:42.776172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:42.782445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:42.785723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9592424131814e86ab367a4d3c65ffd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:42.786557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9592424131814e86ab367a4d3c65ffd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:42.803695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9592424131814e86ab367a4d3c65ffd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:42.810184 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1566/3110] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:02:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:42.814488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:42.819835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:42.858094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9592424131814e86ab367a4d3c65ffd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:42.888133 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1545/3111] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:42 2022] DELETE /identity/v3/users/9592424131814e86ab367a4d3c65ffd8 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:42.897927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:42.912175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:42.915445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0447721c-99d5-49e7-9c72-877f1afede86 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:43.132335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fde0a-51e9-40b6-bb4f-1b615b54c06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:43.132935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fde0a-51e9-40b6-bb4f-1b615b54c06a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:43.133241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fde0a-51e9-40b6-bb4f-1b615b54c06a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:43.137703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7fde0a-51e9-40b6-bb4f-1b615b54c06a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:43.138413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fde0a-51e9-40b6-bb4f-1b615b54c06a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:43.150416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7fde0a-51e9-40b6-bb4f-1b615b54c06a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:43.161979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c199a0-3e91-45af-b7e5-c194ed9078fe tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:43.180504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:43.181166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:43.181572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:43.181809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/domains/ce2bb705db8b4723a0605d6cda6d1ebd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:43.184876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=ce2bb705db8b4723a0605d6cda6d1ebd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:43.186045 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:43.186045 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:02:43.186045 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:02:43.187011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:43.248423 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1567/3112] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:42 2022] POST /identity/v3/projects => generated 383 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:43.249799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fde0a-51e9-40b6-bb4f-1b615b54c06a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:43.297978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.302737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.359618 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:43.367156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.368137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.373840 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1546/3113] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:02:42 2022] PATCH /identity/v3/domains/ce2bb705db8b4723a0605d6cda6d1ebd => generated 277 bytes in 476 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:43.379590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:43.381072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:43.492807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7fde0a-51e9-40b6-bb4f-1b615b54c06a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:43.534456 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:43.589105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41283e68-e297-41ce-a738-53f8ce9b4aa9 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:43.622782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3770fcc-fd38-4158-826c-4ea9f45b978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:43.624117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3770fcc-fd38-4158-826c-4ea9f45b978a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:43.624612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3770fcc-fd38-4158-826c-4ea9f45b978a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:43.625154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3770fcc-fd38-4158-826c-4ea9f45b978a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:43.627058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3770fcc-fd38-4158-826c-4ea9f45b978a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:43.632683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a82b51d2e5034dea9b43c9ebebf0471e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5985737ea12441feb4f2c976a512be29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:43.634992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:43.635344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3770fcc-fd38-4158-826c-4ea9f45b978a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:43.637947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:43.638355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] PATH_INFO: `/v3/domains/ce2bb705db8b4723a0605d6cda6d1ebd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:43.660975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=ce2bb705db8b4723a0605d6cda6d1ebd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:43.663565 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:02:43.663565 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:02:43.663565 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:02:43.664795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:43.679958 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1568/3114] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:43 2022] POST /identity/v3/users => generated 292 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:43.683425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3770fcc-fd38-4158-826c-4ea9f45b978a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:43.687115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d3770fcc-fd38-4158-826c-4ea9f45b978a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:43.715370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3770fcc-fd38-4158-826c-4ea9f45b978a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:43.725875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.726746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71de49d-b4fc-4f14-84ff-83c1f2fb5f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:43.728751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71de49d-b4fc-4f14-84ff-83c1f2fb5f8e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:43.729137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71de49d-b4fc-4f14-84ff-83c1f2fb5f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:43.729535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71de49d-b4fc-4f14-84ff-83c1f2fb5f8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:43.731388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71de49d-b4fc-4f14-84ff-83c1f2fb5f8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:43.736781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71de49d-b4fc-4f14-84ff-83c1f2fb5f8e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:43.744292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.755485 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1569/3115] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:43.769371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71de49d-b4fc-4f14-84ff-83c1f2fb5f8e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:43.792405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71de49d-b4fc-4f14-84ff-83c1f2fb5f8e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:43.805901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549f32-d6fe-4b57-85d6-a1c7cdfa5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:43.806668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549f32-d6fe-4b57-85d6-a1c7cdfa5dfd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:43.807058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549f32-d6fe-4b57-85d6-a1c7cdfa5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:43.807430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5549f32-d6fe-4b57-85d6-a1c7cdfa5dfd admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:43.808267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5549f32-d6fe-4b57-85d6-a1c7cdfa5dfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:43.810010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5549f32-d6fe-4b57-85d6-a1c7cdfa5dfd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:43.859056 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1570/3116] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:43.864299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd', 'request_id': 'req-2f26ccc5-6f9b-41bc-901d-28056bca83d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.866351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549f32-d6fe-4b57-85d6-a1c7cdfa5dfd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:43.875510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd', 'request_id': 'req-2f26ccc5-6f9b-41bc-901d-28056bca83d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.891425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd', 'request_id': 'req-2f26ccc5-6f9b-41bc-901d-28056bca83d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.896836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5549f32-d6fe-4b57-85d6-a1c7cdfa5dfd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:43.921626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] The token cache is being invalidate because project ce2bb705db8b4723a0605d6cda6d1ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:43.922212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.923296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.954195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd', 'request_id': 'req-2f26ccc5-6f9b-41bc-901d-28056bca83d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.955065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd', 'request_id': 'req-2f26ccc5-6f9b-41bc-901d-28056bca83d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.955782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'ce2bb705db8b4723a0605d6cda6d1ebd', 'request_id': 'req-2f26ccc5-6f9b-41bc-901d-28056bca83d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:43.981821 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1547/3117] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:02:43 2022] DELETE /identity/v3/domains/ce2bb705db8b4723a0605d6cda6d1ebd => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:43.985963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:43.988407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:44.066302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7bc452-2768-4d58-8e23-a0edfaf43076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:44.068225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bc452-2768-4d58-8e23-a0edfaf43076 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:44.070019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bc452-2768-4d58-8e23-a0edfaf43076 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:44.072242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7bc452-2768-4d58-8e23-a0edfaf43076 admin admin] PATH_INFO: `/v3/projects/18d52fd8cbf748b881b4cd6f065381dc/users/136253a1592742219ad302722be1d5f2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:44.073553 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:44.104882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bc452-2768-4d58-8e23-a0edfaf43076 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18d52fd8cbf748b881b4cd6f065381dc, user_id=136253a1592742219ad302722be1d5f2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:44.109897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7bc452-2768-4d58-8e23-a0edfaf43076 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:44.130023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f26ccc5-6f9b-41bc-901d-28056bca83d2 tempest-GroupsV3TestJSON-421752137 tempest-GroupsV3TestJSON-421752137-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:44.176265 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1571/3118] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:43 2022] PUT /identity/v3/projects/18d52fd8cbf748b881b4cd6f065381dc/users/136253a1592742219ad302722be1d5f2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:44.184571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c64d-4d4a-47ec-946e-f55754d5767d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:44.186169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c64d-4d4a-47ec-946e-f55754d5767d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:44.187587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c62c64d-4d4a-47ec-946e-f55754d5767d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:44.248501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:44.249596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:44.249871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:44.250144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] PATH_INFO: `/v3/users/e23b731167094c99bba210dc92e50a7c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:44.250814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3c62c64d-4d4a-47ec-946e-f55754d5767d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:44.251985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e23b731167094c99bba210dc92e50a7c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:44.255772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3c62c64d-4d4a-47ec-946e-f55754d5767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:44.256624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:44.283309 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1572/3119] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:44.291137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62c64d-4d4a-47ec-946e-f55754d5767d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:44.292641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3c62c64d-4d4a-47ec-946e-f55754d5767d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:44.387825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e23b731167094c99bba210dc92e50a7c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:44.435186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e23b731167094c99bba210dc92e50a7c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:44.443226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e23b731167094c99bba210dc92e50a7c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:44.445755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c62c64d-4d4a-47ec-946e-f55754d5767d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:44.459052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:44.459688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:44.461152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:44.461992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:44.467544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:44.468788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e23b731167094c99bba210dc92e50a7c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:44.487898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aac081d-c5d2-40b3-804f-c9192f39082a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e23b731167094c99bba210dc92e50a7c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:44.501263 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1548/3120] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:43 2022] DELETE /identity/v3/users/e23b731167094c99bba210dc92e50a7c => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:44.509681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001e6e4-a284-40ec-9dd6-d644801eb04f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:44.510358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001e6e4-a284-40ec-9dd6-d644801eb04f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:44.510949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f001e6e4-a284-40ec-9dd6-d644801eb04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:44.538497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:44.539972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:44.551642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f001e6e4-a284-40ec-9dd6-d644801eb04f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:44.553358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f001e6e4-a284-40ec-9dd6-d644801eb04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:44.585998 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1573/3121] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:02:44.707295 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1549/3122] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:44.748013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:44.751195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:44.786598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c840b3-0e53-43bd-9cde-b18c15a4ceca service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:44.806576 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:44.956910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dc1dc-47bf-4aaa-a683-c5c5c01be790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:44.957841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dc1dc-47bf-4aaa-a683-c5c5c01be790 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:44.958182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dc1dc-47bf-4aaa-a683-c5c5c01be790 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:44.958501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342dc1dc-47bf-4aaa-a683-c5c5c01be790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:44.984851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dc1dc-47bf-4aaa-a683-c5c5c01be790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:44.986720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342dc1dc-47bf-4aaa-a683-c5c5c01be790 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:44.999814 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1574/3123] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:46.932707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001e6e4-a284-40ec-9dd6-d644801eb04f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:46.935589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f001e6e4-a284-40ec-9dd6-d644801eb04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:46.948973 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:46.958548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f001e6e4-a284-40ec-9dd6-d644801eb04f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:46.966613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:46.967511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:46.967954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:46.968643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] PATH_INFO: `/v3/projects/cc1867b129e246c9a3e286ce41339392` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:46.970206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc1867b129e246c9a3e286ce41339392)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:47.004447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:47.089456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc1867b129e246c9a3e286ce41339392', 'request_id': 'req-2373f57d-cdb8-44f7-9030-293f1b48752e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.097073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc1867b129e246c9a3e286ce41339392', 'request_id': 'req-2373f57d-cdb8-44f7-9030-293f1b48752e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.109696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc1867b129e246c9a3e286ce41339392', 'request_id': 'req-2373f57d-cdb8-44f7-9030-293f1b48752e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.124207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] The token cache is being invalidate because project cc1867b129e246c9a3e286ce41339392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:47.124801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.126040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.128195 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1550/3124] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:46 2022] DELETE /identity/v3/projects/cc1867b129e246c9a3e286ce41339392 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:47.132032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dc1dc-47bf-4aaa-a683-c5c5c01be790 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:47.148800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342dc1dc-47bf-4aaa-a683-c5c5c01be790 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:47.226174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:47.227132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:47.227711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:47.228192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] PATH_INFO: `/v3/users/a82b51d2e5034dea9b43c9ebebf0471e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:47.230027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a82b51d2e5034dea9b43c9ebebf0471e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:47.234217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:47.313465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a82b51d2e5034dea9b43c9ebebf0471e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.339493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a82b51d2e5034dea9b43c9ebebf0471e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.340496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a82b51d2e5034dea9b43c9ebebf0471e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.354033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a82b51d2e5034dea9b43c9ebebf0471e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.369457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e176c4c5-9bd8-484c-84d2-b3d15c8b4660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a82b51d2e5034dea9b43c9ebebf0471e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:47.385800 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1575/3125] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:47 2022] DELETE /identity/v3/users/a82b51d2e5034dea9b43c9ebebf0471e => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:48.174332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:48.178548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:48.203493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373f57d-cdb8-44f7-9030-293f1b48752e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:48.289017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:48.290632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:48.290769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:48.291294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] PATH_INFO: `/v3/projects/5985737ea12441feb4f2c976a512be29` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:48.293871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5985737ea12441feb4f2c976a512be29)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:48.296479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:48.375978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5985737ea12441feb4f2c976a512be29', 'request_id': 'req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:48.387975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5985737ea12441feb4f2c976a512be29', 'request_id': 'req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:48.405852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5985737ea12441feb4f2c976a512be29', 'request_id': 'req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:48.425921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] The token cache is being invalidate because project 5985737ea12441feb4f2c976a512be29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:48.426218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:48.431494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d52bfcf5-efeb-4e61-8563-f2586e9e3a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:48.437229 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1551/3126] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:48 2022] DELETE /identity/v3/projects/5985737ea12441feb4f2c976a512be29 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:48.439183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c249c46-5a52-4891-8588-6c95940935da None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:48.441128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c249c46-5a52-4891-8588-6c95940935da None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:48.441128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c249c46-5a52-4891-8588-6c95940935da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:48.475825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6c249c46-5a52-4891-8588-6c95940935da None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:48.477516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6c249c46-5a52-4891-8588-6c95940935da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:48.520421 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:48.571695 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1576/3127] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:48.579769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de54c5-f413-4b87-959c-d62b68d85ac2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:48.580102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de54c5-f413-4b87-959c-d62b68d85ac2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:48.580381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de54c5-f413-4b87-959c-d62b68d85ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:48.609838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f4de54c5-f413-4b87-959c-d62b68d85ac2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:48.611067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f4de54c5-f413-4b87-959c-d62b68d85ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:48.620710 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1552/3128] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:48.625354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c249c46-5a52-4891-8588-6c95940935da None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:48.638085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c249c46-5a52-4891-8588-6c95940935da None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:48.643063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cc970-9e6a-43c4-99ad-d9f0283cf420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:48.643889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cc970-9e6a-43c4-99ad-d9f0283cf420 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:48.644279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cc970-9e6a-43c4-99ad-d9f0283cf420 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:48.644669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749cc970-9e6a-43c4-99ad-d9f0283cf420 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:48.645476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cc970-9e6a-43c4-99ad-d9f0283cf420 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:02:48.645881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cc970-9e6a-43c4-99ad-d9f0283cf420 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:48.647592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749cc970-9e6a-43c4-99ad-d9f0283cf420 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:48.660737 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1577/3129] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:02:48.665506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de54c5-f413-4b87-959c-d62b68d85ac2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:48.679768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de54c5-f413-4b87-959c-d62b68d85ac2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:48.693741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dba9b0-c7e3-495c-aefe-f91fb637b6f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:48.694360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba9b0-c7e3-495c-aefe-f91fb637b6f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:48.694637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba9b0-c7e3-495c-aefe-f91fb637b6f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:48.694909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dba9b0-c7e3-495c-aefe-f91fb637b6f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:48.695556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dba9b0-c7e3-495c-aefe-f91fb637b6f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:48.697505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dba9b0-c7e3-495c-aefe-f91fb637b6f4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:48.711670 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:48.761182 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1553/3130] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:48 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:02:48.765720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cc970-9e6a-43c4-99ad-d9f0283cf420 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:48.777628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749cc970-9e6a-43c4-99ad-d9f0283cf420 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:48.857413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd6e19-aa09-4d33-8f92-57a0b93c373e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:48.858250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd6e19-aa09-4d33-8f92-57a0b93c373e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:48.858595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd6e19-aa09-4d33-8f92-57a0b93c373e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:48.859866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd6e19-aa09-4d33-8f92-57a0b93c373e admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:48.860630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd6e19-aa09-4d33-8f92-57a0b93c373e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:48.863483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd6e19-aa09-4d33-8f92-57a0b93c373e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:48.898945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1578/3131] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:48 2022] POST /identity/v3/users => generated 285 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:48.900188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dba9b0-c7e3-495c-aefe-f91fb637b6f4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:48.922208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dba9b0-c7e3-495c-aefe-f91fb637b6f4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:48.944597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f37e9-9825-45e7-b2ee-1235cb8482dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:48.945372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f37e9-9825-45e7-b2ee-1235cb8482dd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:48.945755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f37e9-9825-45e7-b2ee-1235cb8482dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:48.946208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92f37e9-9825-45e7-b2ee-1235cb8482dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:48.946937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f37e9-9825-45e7-b2ee-1235cb8482dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:48.949687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92f37e9-9825-45e7-b2ee-1235cb8482dd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:48.969336 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1554/3132] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:48.973573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd6e19-aa09-4d33-8f92-57a0b93c373e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:48.989051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd6e19-aa09-4d33-8f92-57a0b93c373e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:49.002530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f73973e-35de-49f1-ae82-a5d10e479ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:49.003695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73973e-35de-49f1-ae82-a5d10e479ecd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:49.003970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73973e-35de-49f1-ae82-a5d10e479ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:49.004242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f73973e-35de-49f1-ae82-a5d10e479ecd admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:49.004940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73973e-35de-49f1-ae82-a5d10e479ecd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:49.006492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f73973e-35de-49f1-ae82-a5d10e479ecd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:49.031103 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1579/3133] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:49.033408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f37e9-9825-45e7-b2ee-1235cb8482dd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:49.045916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92f37e9-9825-45e7-b2ee-1235cb8482dd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:49.076541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634dc2-ed54-417f-8021-5d0ab1773bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:49.077247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634dc2-ed54-417f-8021-5d0ab1773bbc admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:49.077625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634dc2-ed54-417f-8021-5d0ab1773bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:49.077976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d634dc2-ed54-417f-8021-5d0ab1773bbc admin admin] PATH_INFO: `/v3/projects/195a17b43d7c473e9ac07aede5d99817/users/bba8cfbcba274aa2a3de9280c9374a46/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:49.110742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d634dc2-ed54-417f-8021-5d0ab1773bbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=195a17b43d7c473e9ac07aede5d99817, user_id=bba8cfbcba274aa2a3de9280c9374a46, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:49.116359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d634dc2-ed54-417f-8021-5d0ab1773bbc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:49.135550 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1555/3134] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:49 2022] PUT /identity/v3/projects/195a17b43d7c473e9ac07aede5d99817/users/bba8cfbcba274aa2a3de9280c9374a46/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:49.150390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12e7f-bb35-4c8f-aa39-cf26d559bc2b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:49.150494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12e7f-bb35-4c8f-aa39-cf26d559bc2b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:49.150764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac12e7f-bb35-4c8f-aa39-cf26d559bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:49.186889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aac12e7f-bb35-4c8f-aa39-cf26d559bc2b None None] MFA Rules not processed for user `bba8cfbcba274aa2a3de9280c9374a46`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:49.188622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aac12e7f-bb35-4c8f-aa39-cf26d559bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:49.322044 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1580/3135] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:49.327766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634dc2-ed54-417f-8021-5d0ab1773bbc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:49.352805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d634dc2-ed54-417f-8021-5d0ab1773bbc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:49.357780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60447424-3d28-49a2-8c86-26c4a4f03f8e tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:49.358648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60447424-3d28-49a2-8c86-26c4a4f03f8e tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:49.359289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60447424-3d28-49a2-8c86-26c4a4f03f8e tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:49.359758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60447424-3d28-49a2-8c86-26c4a4f03f8e tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/application_credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:49.360613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60447424-3d28-49a2-8c86-26c4a4f03f8e tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:create_application_credential(user_id=bba8cfbcba274aa2a3de9280c9374a46)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:49.363001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60447424-3d28-49a2-8c86-26c4a4f03f8e tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:49.567686 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1556/3136] 10.222.0.25 () {60 vars in 1315 bytes} [Mon Oct 24 09:02:49 2022] POST /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/application_credentials => generated 920 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:49.571990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12e7f-bb35-4c8f-aa39-cf26d559bc2b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:49.586026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac12e7f-bb35-4c8f-aa39-cf26d559bc2b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:49.604087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ddb3-a55b-4942-9429-c2fceafa8399 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:49.605070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ddb3-a55b-4942-9429-c2fceafa8399 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:49.605437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ddb3-a55b-4942-9429-c2fceafa8399 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:49.605962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199ddb3-a55b-4942-9429-c2fceafa8399 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules/52147fd1d2444f1084d92ccace970b89` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:49.608594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ddb3-a55b-4942-9429-c2fceafa8399 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:delete_access_rule(user_id=bba8cfbcba274aa2a3de9280c9374a46, access_rule_id=52147fd1d2444f1084d92ccace970b89)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:49.611306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199ddb3-a55b-4942-9429-c2fceafa8399 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6199ddb3-a55b-4942-9429-c2fceafa8399 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] May not delete access rule in use: keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 256, in delete_access_rule Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.delete(ref) Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 09:02:49.660948 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 09:02:49.662203 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 577, in execute Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dependency_processor.process_deletes(uow, states) Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 552, in process_deletes Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._synchronize( Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/dependency.py", line 610, in _synchronize Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application sync.clear(dest, self.mapper, self.prop.synchronize_pairs) Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/sync.py", line 86, in clear Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise AssertionError( Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application AssertionError: Dependency rule tried to blank-out primary key column 'application_credential_access_rule.access_rule_id' on instance '' Oct 24 09:02:49.663191 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 763, in delete Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application PROVIDERS.application_credential_api.delete_access_rule( Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:02:49.664163 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:02:49.665234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/core.py", line 252, in delete_access_rule Oct 24 09:02:49.665234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.driver.delete_access_rule(access_rule_id) Oct 24 09:02:49.665234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/application_credential/backends/sql.py", line 258, in delete_access_rule Oct 24 09:02:49.665234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 24 09:02:49.665234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: May not delete access rule in use Oct 24 09:02:49.665234 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:02:49.669822 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1581/3137] 10.222.0.25 () {58 vars in 1362 bytes} [Mon Oct 24 09:02:49 2022] DELETE /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules/52147fd1d2444f1084d92ccace970b89 => generated 89 bytes in 98 msecs (HTTP/1.1 403) 5 headers in 183 bytes (1 switches on core 0) Oct 24 09:02:49.674963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60447424-3d28-49a2-8c86-26c4a4f03f8e tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:49.703880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60447424-3d28-49a2-8c86-26c4a4f03f8e tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:49.710440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a4f40-e7d5-492c-8764-19d190de8d2f tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:49.711357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a4f40-e7d5-492c-8764-19d190de8d2f tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:49.711835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a4f40-e7d5-492c-8764-19d190de8d2f tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:49.712292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61a4f40-e7d5-492c-8764-19d190de8d2f tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/application_credentials/96b759d907b649408f90b76249e45cba` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:49.742284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a4f40-e7d5-492c-8764-19d190de8d2f tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:delete_application_credential(user_id=bba8cfbcba274aa2a3de9280c9374a46, application_credential_id=96b759d907b649408f90b76249e45cba)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:49.743974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61a4f40-e7d5-492c-8764-19d190de8d2f tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:49.791580 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1557/3138] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:02:49 2022] DELETE /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/application_credentials/96b759d907b649408f90b76249e45cba => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:49.796036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ddb3-a55b-4942-9429-c2fceafa8399 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:49.809805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199ddb3-a55b-4942-9429-c2fceafa8399 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:49.816398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae87e7-c80e-42b9-b27a-96ec2471eb91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:49.816708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae87e7-c80e-42b9-b27a-96ec2471eb91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:49.816991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae87e7-c80e-42b9-b27a-96ec2471eb91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:49.817265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cae87e7-c80e-42b9-b27a-96ec2471eb91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:49.819066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae87e7-c80e-42b9-b27a-96ec2471eb91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:list_access_rules(user_id=bba8cfbcba274aa2a3de9280c9374a46)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:49.821586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cae87e7-c80e-42b9-b27a-96ec2471eb91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:49.834704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a4f40-e7d5-492c-8764-19d190de8d2f tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:49.841609 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1582/3139] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 09:02:49 2022] GET /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules => generated 369 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:49.847834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61a4f40-e7d5-492c-8764-19d190de8d2f tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:49.858827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b96284-8112-414e-a6b4-ee78e9de7f33 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:49.859500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b96284-8112-414e-a6b4-ee78e9de7f33 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:49.859889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b96284-8112-414e-a6b4-ee78e9de7f33 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:49.860171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b96284-8112-414e-a6b4-ee78e9de7f33 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules/52147fd1d2444f1084d92ccace970b89` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:49.865876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b96284-8112-414e-a6b4-ee78e9de7f33 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:delete_access_rule(user_id=bba8cfbcba274aa2a3de9280c9374a46, access_rule_id=52147fd1d2444f1084d92ccace970b89)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:49.867382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b96284-8112-414e-a6b4-ee78e9de7f33 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:49.914660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae87e7-c80e-42b9-b27a-96ec2471eb91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:49.915179 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1558/3140] 10.222.0.25 () {58 vars in 1362 bytes} [Mon Oct 24 09:02:49 2022] DELETE /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules/52147fd1d2444f1084d92ccace970b89 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:49.941456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cae87e7-c80e-42b9-b27a-96ec2471eb91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:49.953381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de662a0-4f42-46fc-a7d0-9e11d770816a tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:49.953873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de662a0-4f42-46fc-a7d0-9e11d770816a tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:49.954159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de662a0-4f42-46fc-a7d0-9e11d770816a tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:49.954433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de662a0-4f42-46fc-a7d0-9e11d770816a tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:49.956322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de662a0-4f42-46fc-a7d0-9e11d770816a tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:list_access_rules(user_id=bba8cfbcba274aa2a3de9280c9374a46)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:49.957643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de662a0-4f42-46fc-a7d0-9e11d770816a tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:49.962478 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:49.968308 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1583/3141] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 09:02:49 2022] GET /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules => generated 158 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:49.981027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b96284-8112-414e-a6b4-ee78e9de7f33 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:49.992640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b96284-8112-414e-a6b4-ee78e9de7f33 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:50.010321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da65b67-4a31-4c9d-aeb0-9bf9019e38dd tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:50.013329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da65b67-4a31-4c9d-aeb0-9bf9019e38dd tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:50.014484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da65b67-4a31-4c9d-aeb0-9bf9019e38dd tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:50.015038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da65b67-4a31-4c9d-aeb0-9bf9019e38dd tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/application_credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:50.018091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da65b67-4a31-4c9d-aeb0-9bf9019e38dd tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:create_application_credential(user_id=bba8cfbcba274aa2a3de9280c9374a46)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:50.022993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da65b67-4a31-4c9d-aeb0-9bf9019e38dd tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:50.135515 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:50.204592 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1559/3142] 10.222.0.25 () {60 vars in 1315 bytes} [Mon Oct 24 09:02:49 2022] POST /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/application_credentials => generated 921 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:50.209190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de662a0-4f42-46fc-a7d0-9e11d770816a tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:50.226184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de662a0-4f42-46fc-a7d0-9e11d770816a tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:50.231072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc0afb-7952-47ce-85f8-df4f518517c6 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:50.231981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc0afb-7952-47ce-85f8-df4f518517c6 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:50.232432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc0afb-7952-47ce-85f8-df4f518517c6 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:50.232952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98bc0afb-7952-47ce-85f8-df4f518517c6 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:50.235274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc0afb-7952-47ce-85f8-df4f518517c6 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:list_access_rules(user_id=bba8cfbcba274aa2a3de9280c9374a46)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:50.239533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98bc0afb-7952-47ce-85f8-df4f518517c6 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:50.252310 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1584/3143] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 09:02:50 2022] GET /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules => generated 369 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:50.259926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da65b67-4a31-4c9d-aeb0-9bf9019e38dd tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:50.274628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da65b67-4a31-4c9d-aeb0-9bf9019e38dd tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:50.298114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ebfd3-272f-4969-8c2a-e5ed0f2425fe tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:50.298782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ebfd3-272f-4969-8c2a-e5ed0f2425fe tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:50.299065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ebfd3-272f-4969-8c2a-e5ed0f2425fe tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:50.300527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ebfd3-272f-4969-8c2a-e5ed0f2425fe tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/application_credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:50.301234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ebfd3-272f-4969-8c2a-e5ed0f2425fe tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:create_application_credential(user_id=bba8cfbcba274aa2a3de9280c9374a46)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:50.302721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6ebfd3-272f-4969-8c2a-e5ed0f2425fe tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:50.464911 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1560/3144] 10.222.0.25 () {60 vars in 1315 bytes} [Mon Oct 24 09:02:50 2022] POST /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/application_credentials => generated 920 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:50.465639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc0afb-7952-47ce-85f8-df4f518517c6 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:50.485523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98bc0afb-7952-47ce-85f8-df4f518517c6 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:50.496362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5576c-3610-42eb-94e3-0424c7553d91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bba8cfbcba274aa2a3de9280c9374a46', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '195a17b43d7c473e9ac07aede5d99817', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:50.497232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5576c-3610-42eb-94e3-0424c7553d91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:50.497954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5576c-3610-42eb-94e3-0424c7553d91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:50.498519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5576c-3610-42eb-94e3-0424c7553d91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules/e59494594c3b4211843916e767d17b84` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:50.502007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5576c-3610-42eb-94e3-0424c7553d91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorizing `identity:get_access_rule(user_id=bba8cfbcba274aa2a3de9280c9374a46, access_rule_id=e59494594c3b4211843916e767d17b84)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:50.506936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5576c-3610-42eb-94e3-0424c7553d91 tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:50.529031 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1585/3145] 10.222.0.25 () {58 vars in 1359 bytes} [Mon Oct 24 09:02:50 2022] GET /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46/access_rules/e59494594c3b4211843916e767d17b84 => generated 229 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:50.530438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ebfd3-272f-4969-8c2a-e5ed0f2425fe tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:50.679732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ebfd3-272f-4969-8c2a-e5ed0f2425fe tempest-AccessRulesV3Test-936832184 tempest-AccessRulesV3Test-936832184-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:50.687327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:50.688418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:50.688697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:50.689055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] PATH_INFO: `/v3/users/bba8cfbcba274aa2a3de9280c9374a46` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:50.690848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba8cfbcba274aa2a3de9280c9374a46)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:50.693852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:50.776598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba8cfbcba274aa2a3de9280c9374a46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:50.786158 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:50.839485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba8cfbcba274aa2a3de9280c9374a46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:50.841009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba8cfbcba274aa2a3de9280c9374a46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:50.857573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba8cfbcba274aa2a3de9280c9374a46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:50.873579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba8cfbcba274aa2a3de9280c9374a46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:50.887322 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1561/3146] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:50 2022] DELETE /identity/v3/users/bba8cfbcba274aa2a3de9280c9374a46 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:50.891684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b0df4-42d7-470a-b5c9-04ec7a8d06bd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:50.892208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b0df4-42d7-470a-b5c9-04ec7a8d06bd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:50.892208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361b0df4-42d7-470a-b5c9-04ec7a8d06bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:50.928113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-361b0df4-42d7-470a-b5c9-04ec7a8d06bd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:50.929463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-361b0df4-42d7-470a-b5c9-04ec7a8d06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:51.211337 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1586/3147] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:51.239850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:51.241844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:51.343252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c5bee-a43d-4103-81bb-47256d1bf9ee admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:51.347982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842cda2b-8fa0-4374-9f9b-51bedafc2ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:51.348942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cda2b-8fa0-4374-9f9b-51bedafc2ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:51.349425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cda2b-8fa0-4374-9f9b-51bedafc2ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:51.349852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842cda2b-8fa0-4374-9f9b-51bedafc2ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:51.363050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cda2b-8fa0-4374-9f9b-51bedafc2ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:51.364899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842cda2b-8fa0-4374-9f9b-51bedafc2ba8 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:51.378451 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1562/3148] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:53.713546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b0df4-42d7-470a-b5c9-04ec7a8d06bd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:53.714997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-361b0df4-42d7-470a-b5c9-04ec7a8d06bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:53.734552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361b0df4-42d7-470a-b5c9-04ec7a8d06bd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:53.747634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:53.748287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:53.748569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:53.748845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] PATH_INFO: `/v3/users/0ba0cbf327634abdb5a1be7d2ee31e30` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:53.754116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ba0cbf327634abdb5a1be7d2ee31e30)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:53.756135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:53.855562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ba0cbf327634abdb5a1be7d2ee31e30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:53.887750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ba0cbf327634abdb5a1be7d2ee31e30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:53.889528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ba0cbf327634abdb5a1be7d2ee31e30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:53.906053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ba0cbf327634abdb5a1be7d2ee31e30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:53.923927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ba0cbf327634abdb5a1be7d2ee31e30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:53.938364 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1587/3149] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:53 2022] DELETE /identity/v3/users/0ba0cbf327634abdb5a1be7d2ee31e30 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:53.943525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbaa65-489a-4d01-86d3-d6a873a7307a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:53.944042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbaa65-489a-4d01-86d3-d6a873a7307a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:53.944371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbaa65-489a-4d01-86d3-d6a873a7307a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:54.011944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-92fbaa65-489a-4d01-86d3-d6a873a7307a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:54.016358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-92fbaa65-489a-4d01-86d3-d6a873a7307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:54.156965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:54.159861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:54.236150 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1563/3150] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:54.269672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbaa65-489a-4d01-86d3-d6a873a7307a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:54.271539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-92fbaa65-489a-4d01-86d3-d6a873a7307a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:54.381119 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:54.413065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d781e-8d92-4175-932c-a272d7c0476a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:54.425549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:54.426211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:54.426488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:54.426760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] PATH_INFO: `/v3/projects/195a17b43d7c473e9ac07aede5d99817` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:54.430977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=195a17b43d7c473e9ac07aede5d99817)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:54.434587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:54.467780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbaa65-489a-4d01-86d3-d6a873a7307a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:54.475420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff329c8-7095-49d6-a45e-e4ddf8ec1b70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:54.476050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff329c8-7095-49d6-a45e-e4ddf8ec1b70 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:54.476334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff329c8-7095-49d6-a45e-e4ddf8ec1b70 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:54.476612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff329c8-7095-49d6-a45e-e4ddf8ec1b70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:54.508172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff329c8-7095-49d6-a45e-e4ddf8ec1b70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:54.512848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff329c8-7095-49d6-a45e-e4ddf8ec1b70 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:54.525205 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:54.541451 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1564/3151] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:02:54.559603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195a17b43d7c473e9ac07aede5d99817', 'request_id': 'req-a77719c0-12ac-4136-90dd-1905701bbb29'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:54.573919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195a17b43d7c473e9ac07aede5d99817', 'request_id': 'req-a77719c0-12ac-4136-90dd-1905701bbb29'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:54.584921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195a17b43d7c473e9ac07aede5d99817', 'request_id': 'req-a77719c0-12ac-4136-90dd-1905701bbb29'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:54.613554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] The token cache is being invalidate because project 195a17b43d7c473e9ac07aede5d99817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:54.614269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:54.616017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a77719c0-12ac-4136-90dd-1905701bbb29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:54.620544 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1588/3152] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:54 2022] DELETE /identity/v3/projects/195a17b43d7c473e9ac07aede5d99817 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:54.625758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc4f2-ace5-412d-8688-55f9c2e44428 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:54.626000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc4f2-ace5-412d-8688-55f9c2e44428 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:54.626474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ccc4f2-ace5-412d-8688-55f9c2e44428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:54.660108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e2ccc4f2-ace5-412d-8688-55f9c2e44428 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:54.662859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e2ccc4f2-ace5-412d-8688-55f9c2e44428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:54.785949 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1565/3153] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:54.793863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc86e42-83f7-406c-8ec0-0ebed3be4ccc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:54.794402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc86e42-83f7-406c-8ec0-0ebed3be4ccc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:54.794528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc86e42-83f7-406c-8ec0-0ebed3be4ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:54.857211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0cc86e42-83f7-406c-8ec0-0ebed3be4ccc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:54.862823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0cc86e42-83f7-406c-8ec0-0ebed3be4ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:54.885031 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1589/3154] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:54.889745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccc4f2-ace5-412d-8688-55f9c2e44428 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:54.926490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ccc4f2-ace5-412d-8688-55f9c2e44428 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:54.934343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:54.935716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:54.936172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:54.936790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:54.937847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:02:54.938561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:54.942150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:54.979764 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1566/3155] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:02:54.984581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc86e42-83f7-406c-8ec0-0ebed3be4ccc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:55.013918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc86e42-83f7-406c-8ec0-0ebed3be4ccc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:55.026305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126d250-593e-4223-8de5-39fe2f044180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:55.028064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126d250-593e-4223-8de5-39fe2f044180 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:55.029434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126d250-593e-4223-8de5-39fe2f044180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:55.029890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6126d250-593e-4223-8de5-39fe2f044180 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:55.036399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126d250-593e-4223-8de5-39fe2f044180 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:55.042596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6126d250-593e-4223-8de5-39fe2f044180 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:55.154454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:55.157248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:55.179020 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1590/3156] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:54 2022] POST /identity/v3/projects => generated 371 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:55.182942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126d250-593e-4223-8de5-39fe2f044180 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:55.199332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c16229-d53d-41c4-b37c-cad4efe5e021 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:55.291444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6126d250-593e-4223-8de5-39fe2f044180 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:55.298744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa679-0966-475e-9038-9c206e5f67e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:55.299820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa679-0966-475e-9038-9c206e5f67e3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:55.300201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa679-0966-475e-9038-9c206e5f67e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:55.300931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39aa679-0966-475e-9038-9c206e5f67e3 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:55.302075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39aa679-0966-475e-9038-9c206e5f67e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:55.309151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39aa679-0966-475e-9038-9c206e5f67e3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:55.327598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:55.328335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:55.329115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:55.329115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] PATH_INFO: `/v3/projects/33ae68ba2a584665992f3856fab416a5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:55.331975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=33ae68ba2a584665992f3856fab416a5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:55.333929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:55.359836 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1591/3157] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:55 2022] POST /identity/v3/users => generated 286 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:02:55.365387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa679-0966-475e-9038-9c206e5f67e3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:55.397398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39aa679-0966-475e-9038-9c206e5f67e3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:55.417738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14055e2-3ea6-40c0-991b-9231385fad0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:55.419405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14055e2-3ea6-40c0-991b-9231385fad0a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:55.422174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14055e2-3ea6-40c0-991b-9231385fad0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:55.422627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14055e2-3ea6-40c0-991b-9231385fad0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:55.425550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14055e2-3ea6-40c0-991b-9231385fad0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:55.442404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14055e2-3ea6-40c0-991b-9231385fad0a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:55.448403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33ae68ba2a584665992f3856fab416a5', 'request_id': 'req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.464898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33ae68ba2a584665992f3856fab416a5', 'request_id': 'req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.480288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33ae68ba2a584665992f3856fab416a5', 'request_id': 'req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.485789 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1592/3158] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:55.491479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14055e2-3ea6-40c0-991b-9231385fad0a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:55.504279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] The token cache is being invalidate because project 33ae68ba2a584665992f3856fab416a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:55.504497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.505335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.509216 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1567/3159] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:55 2022] DELETE /identity/v3/projects/33ae68ba2a584665992f3856fab416a5 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:55.513421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:55.514891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:55.520642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14055e2-3ea6-40c0-991b-9231385fad0a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:55.553561 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:55.638669 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:55.653428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c461f-e8bc-4ec7-b921-192d36ce01c3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:55.661718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:55.662868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:55.663464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:55.663965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] PATH_INFO: `/v3/users/dbad87a7ad024511aa5e6668fda00328` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:55.666481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbad87a7ad024511aa5e6668fda00328)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:55.670417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:55.708207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11231f76-0c7e-4aaa-bfdd-fef3d6d72f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:55.709028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11231f76-0c7e-4aaa-bfdd-fef3d6d72f59 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:55.709448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11231f76-0c7e-4aaa-bfdd-fef3d6d72f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:55.710412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11231f76-0c7e-4aaa-bfdd-fef3d6d72f59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:55.711226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11231f76-0c7e-4aaa-bfdd-fef3d6d72f59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:55.713176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11231f76-0c7e-4aaa-bfdd-fef3d6d72f59 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:55.728903 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1593/3160] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:55 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:55.734374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11231f76-0c7e-4aaa-bfdd-fef3d6d72f59 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:55.738110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-11231f76-0c7e-4aaa-bfdd-fef3d6d72f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:55.767711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11231f76-0c7e-4aaa-bfdd-fef3d6d72f59 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:55.771952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbad87a7ad024511aa5e6668fda00328'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.781474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c514-eb02-475f-bfba-8872c35f3580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:55.782315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c514-eb02-475f-bfba-8872c35f3580 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:55.782932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c514-eb02-475f-bfba-8872c35f3580 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:55.783221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a53c514-eb02-475f-bfba-8872c35f3580 admin admin] PATH_INFO: `/v3/projects/2fa35beb56134e30aa94f0a671fd6818/users/f09b2a880caa4c7a9ebe4a22dbc64be9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:55.802122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbad87a7ad024511aa5e6668fda00328'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.803130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbad87a7ad024511aa5e6668fda00328'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.826302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbad87a7ad024511aa5e6668fda00328'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.835795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c514-eb02-475f-bfba-8872c35f3580 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fa35beb56134e30aa94f0a671fd6818, user_id=f09b2a880caa4c7a9ebe4a22dbc64be9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:55.839714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a53c514-eb02-475f-bfba-8872c35f3580 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:55.848830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48bdfcec-9382-4f83-ae8d-747095a95fc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbad87a7ad024511aa5e6668fda00328'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:55.861079 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1568/3161] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:55 2022] DELETE /identity/v3/users/dbad87a7ad024511aa5e6668fda00328 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:55.881024 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1594/3162] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:55 2022] PUT /identity/v3/projects/2fa35beb56134e30aa94f0a671fd6818/users/f09b2a880caa4c7a9ebe4a22dbc64be9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:55.884670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1c164-bbe8-4494-8755-0a4708619f6f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:55.885189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1c164-bbe8-4494-8755-0a4708619f6f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:55.885703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a1c164-bbe8-4494-8755-0a4708619f6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:55.926943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c6a1c164-bbe8-4494-8755-0a4708619f6f None None] MFA Rules not processed for user `f09b2a880caa4c7a9ebe4a22dbc64be9`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:55.928799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c6a1c164-bbe8-4494-8755-0a4708619f6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:56.070410 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1569/3163] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:56.071009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c514-eb02-475f-bfba-8872c35f3580 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.085212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a53c514-eb02-475f-bfba-8872c35f3580 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.100263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fbe3b-67ba-48e1-8a26-c3e9d8b9d189 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.101580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fbe3b-67ba-48e1-8a26-c3e9d8b9d189 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.101984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fbe3b-67ba-48e1-8a26-c3e9d8b9d189 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.102330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fbe3b-67ba-48e1-8a26-c3e9d8b9d189 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.103781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fbe3b-67ba-48e1-8a26-c3e9d8b9d189 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.106168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fbe3b-67ba-48e1-8a26-c3e9d8b9d189 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.144167 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1595/3164] 10.222.0.25 () {60 vars in 1299 bytes} [Mon Oct 24 09:02:56 2022] POST /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2 => generated 367 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:56.147112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1c164-bbe8-4494-8755-0a4708619f6f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.160351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a1c164-bbe8-4494-8755-0a4708619f6f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.167184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edb057-a1a1-45a0-bd1f-8b2c3311791e tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.168255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edb057-a1a1-45a0-bd1f-8b2c3311791e tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.168715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edb057-a1a1-45a0-bd1f-8b2c3311791e tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.169201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0edb057-a1a1-45a0-bd1f-8b2c3311791e tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/9d879466b63e40b6865953e2cae66e5a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.172372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edb057-a1a1-45a0-bd1f-8b2c3311791e tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9, credential_id=9d879466b63e40b6865953e2cae66e5a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.174229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0edb057-a1a1-45a0-bd1f-8b2c3311791e tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.206795 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1570/3165] 10.222.0.25 () {58 vars in 1380 bytes} [Mon Oct 24 09:02:56 2022] DELETE /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/9d879466b63e40b6865953e2cae66e5a => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:56.213311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fbe3b-67ba-48e1-8a26-c3e9d8b9d189 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.230681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fbe3b-67ba-48e1-8a26-c3e9d8b9d189 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.236776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4524-425a-4521-bb11-9503190c1215 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.238819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4524-425a-4521-bb11-9503190c1215 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.239212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4524-425a-4521-bb11-9503190c1215 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.239608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8c4524-425a-4521-bb11-9503190c1215 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.240513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c4524-425a-4521-bb11-9503190c1215 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.242159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8c4524-425a-4521-bb11-9503190c1215 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.264961 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1596/3166] 10.222.0.25 () {60 vars in 1299 bytes} [Mon Oct 24 09:02:56 2022] POST /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2 => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:56.269859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edb057-a1a1-45a0-bd1f-8b2c3311791e tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.285763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0edb057-a1a1-45a0-bd1f-8b2c3311791e tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.297498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c8c3f-2a7e-4d9c-8fa8-cf328427ea09 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.298657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c8c3f-2a7e-4d9c-8fa8-cf328427ea09 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.298788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c8c3f-2a7e-4d9c-8fa8-cf328427ea09 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.299179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c8c3f-2a7e-4d9c-8fa8-cf328427ea09 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/c4e909c63bd44e14bc4a2e3ca9212bf8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.303919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c8c3f-2a7e-4d9c-8fa8-cf328427ea09 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9, credential_id=c4e909c63bd44e14bc4a2e3ca9212bf8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.305782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c8c3f-2a7e-4d9c-8fa8-cf328427ea09 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.312252 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:56.332692 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1571/3167] 10.222.0.25 () {58 vars in 1380 bytes} [Mon Oct 24 09:02:56 2022] DELETE /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/c4e909c63bd44e14bc4a2e3ca9212bf8 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:56.337159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4524-425a-4521-bb11-9503190c1215 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.349440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8c4524-425a-4521-bb11-9503190c1215 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.355494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a152b5-ce75-4217-a501-545b20b3c962 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.356216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a152b5-ce75-4217-a501-545b20b3c962 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.356517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a152b5-ce75-4217-a501-545b20b3c962 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.356843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a152b5-ce75-4217-a501-545b20b3c962 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/c4e909c63bd44e14bc4a2e3ca9212bf8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e8a152b5-ce75-4217-a501-545b20b3c962 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Could not find credential: ced48ada7293631663ab86f1e2dcf9d5073a73d4368c1e47fbd6131f454b48b0.: keystone.exception.CredentialNotFound: Could not find credential: ced48ada7293631663ab86f1e2dcf9d5073a73d4368c1e47fbd6131f454b48b0. Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 426, in get Oct 24 09:02:56.404358 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 119, in _build_enforcer_target_data_owner_and_user_id_match Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref['credential'] = PROVIDERS.credential_api.get_credential( Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 119, in get_credential Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application credential = self._get_credential(credential_id) Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:02:56.405410 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/core.py", line 124, in _get_credential Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_credential(credential_id) Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 88, in get_credential Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_credential(session, credential_id).to_dict() Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/credential/backends/sql.py", line 83, in _get_credential Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.CredentialNotFound(credential_id=credential_id) Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.CredentialNotFound: Could not find credential: ced48ada7293631663ab86f1e2dcf9d5073a73d4368c1e47fbd6131f454b48b0. Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:02:56.406352 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1597/3168] 10.222.0.25 () {58 vars in 1377 bytes} [Mon Oct 24 09:02:56 2022] GET /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/c4e909c63bd44e14bc4a2e3ca9212bf8 => generated 148 bytes in 70 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:02:56.412264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c8c3f-2a7e-4d9c-8fa8-cf328427ea09 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.427451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c8c3f-2a7e-4d9c-8fa8-cf328427ea09 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.433465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebe595-0c64-4baa-be84-c504d7ec7624 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.435907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebe595-0c64-4baa-be84-c504d7ec7624 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.436432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebe595-0c64-4baa-be84-c504d7ec7624 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.436811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ebe595-0c64-4baa-be84-c504d7ec7624 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.437643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebe595-0c64-4baa-be84-c504d7ec7624 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.440567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ebe595-0c64-4baa-be84-c504d7ec7624 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.500456 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1572/3169] 10.222.0.25 () {60 vars in 1299 bytes} [Mon Oct 24 09:02:56 2022] POST /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2 => generated 367 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:02:56.503516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a152b5-ce75-4217-a501-545b20b3c962 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.519248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a152b5-ce75-4217-a501-545b20b3c962 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.537005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2af34e-efce-4d49-8c77-071616611803 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.537891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2af34e-efce-4d49-8c77-071616611803 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.538329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2af34e-efce-4d49-8c77-071616611803 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.541777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2af34e-efce-4d49-8c77-071616611803 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.542946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2af34e-efce-4d49-8c77-071616611803 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.547790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2af34e-efce-4d49-8c77-071616611803 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.584476 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1598/3170] 10.222.0.25 () {60 vars in 1299 bytes} [Mon Oct 24 09:02:56 2022] POST /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2 => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:56.588329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebe595-0c64-4baa-be84-c504d7ec7624 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.603493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ebe595-0c64-4baa-be84-c504d7ec7624 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.608863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d60d2-b0e4-47b3-8b1c-72e66bbf2bf2 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.609725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d60d2-b0e4-47b3-8b1c-72e66bbf2bf2 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.610211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d60d2-b0e4-47b3-8b1c-72e66bbf2bf2 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.610498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08d60d2-b0e4-47b3-8b1c-72e66bbf2bf2 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.611099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d60d2-b0e4-47b3-8b1c-72e66bbf2bf2 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_list_credentials(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.614178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08d60d2-b0e4-47b3-8b1c-72e66bbf2bf2 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.633882 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1573/3171] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 09:02:56 2022] GET /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2 => generated 865 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:56.638463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2af34e-efce-4d49-8c77-071616611803 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.653923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2af34e-efce-4d49-8c77-071616611803 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.664988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fcff4-1d20-41d7-a9c7-df038a384f4c tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.665695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fcff4-1d20-41d7-a9c7-df038a384f4c tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.665984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fcff4-1d20-41d7-a9c7-df038a384f4c tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.666266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560fcff4-1d20-41d7-a9c7-df038a384f4c tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/d7506b66286e4a30ab7b46fd18233dcc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.671700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fcff4-1d20-41d7-a9c7-df038a384f4c tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9, credential_id=d7506b66286e4a30ab7b46fd18233dcc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.673658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560fcff4-1d20-41d7-a9c7-df038a384f4c tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.706724 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1599/3172] 10.222.0.25 () {58 vars in 1380 bytes} [Mon Oct 24 09:02:56 2022] DELETE /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/d7506b66286e4a30ab7b46fd18233dcc => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:56.711159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d60d2-b0e4-47b3-8b1c-72e66bbf2bf2 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.726076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08d60d2-b0e4-47b3-8b1c-72e66bbf2bf2 tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.737646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09092b99-277c-413d-816d-4912681ca1cf tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.738314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092b99-277c-413d-816d-4912681ca1cf tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.738615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092b99-277c-413d-816d-4912681ca1cf tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.738896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09092b99-277c-413d-816d-4912681ca1cf tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/d23cb3728240403394de08f332b0563b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.743423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09092b99-277c-413d-816d-4912681ca1cf tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9, credential_id=d23cb3728240403394de08f332b0563b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.748337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09092b99-277c-413d-816d-4912681ca1cf tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.787697 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1574/3173] 10.222.0.25 () {58 vars in 1380 bytes} [Mon Oct 24 09:02:56 2022] DELETE /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/d23cb3728240403394de08f332b0563b => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:56.790266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fcff4-1d20-41d7-a9c7-df038a384f4c tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.804129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560fcff4-1d20-41d7-a9c7-df038a384f4c tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.815536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953899b9-3d14-4bcc-aa54-971c518430bd tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.816583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953899b9-3d14-4bcc-aa54-971c518430bd tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.817051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953899b9-3d14-4bcc-aa54-971c518430bd tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.817551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953899b9-3d14-4bcc-aa54-971c518430bd tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.818593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953899b9-3d14-4bcc-aa54-971c518430bd tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_create_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.820941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953899b9-3d14-4bcc-aa54-971c518430bd tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.872022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09092b99-277c-413d-816d-4912681ca1cf tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.883701 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1600/3174] 10.222.0.25 () {60 vars in 1299 bytes} [Mon Oct 24 09:02:56 2022] POST /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2 => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:56.884777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09092b99-277c-413d-816d-4912681ca1cf tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.889892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ce170-ba4b-4baa-aacc-8d015519897f tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.890633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ce170-ba4b-4baa-aacc-8d015519897f tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.890993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ce170-ba4b-4baa-aacc-8d015519897f tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.891343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607ce170-ba4b-4baa-aacc-8d015519897f tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/db367293c094466884425586bbd233c4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.894258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ce170-ba4b-4baa-aacc-8d015519897f tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_get_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9, credential_id=db367293c094466884425586bbd233c4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.895921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607ce170-ba4b-4baa-aacc-8d015519897f tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:56.903061 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1575/3175] 10.222.0.25 () {58 vars in 1377 bytes} [Mon Oct 24 09:02:56 2022] GET /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/db367293c094466884425586bbd233c4 => generated 367 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:56.904716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953899b9-3d14-4bcc-aa54-971c518430bd tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.927555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953899b9-3d14-4bcc-aa54-971c518430bd tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:56.943541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ce170-ba4b-4baa-aacc-8d015519897f tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:56.949223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-607ce170-ba4b-4baa-aacc-8d015519897f tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:56.960854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24de706-5153-4011-b07d-5fe687d9991d tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f09b2a880caa4c7a9ebe4a22dbc64be9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2fa35beb56134e30aa94f0a671fd6818', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:56.964567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24de706-5153-4011-b07d-5fe687d9991d tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:56.965093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24de706-5153-4011-b07d-5fe687d9991d tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:56.965988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24de706-5153-4011-b07d-5fe687d9991d tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/db367293c094466884425586bbd233c4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:56.986388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24de706-5153-4011-b07d-5fe687d9991d tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorizing `identity:ec2_delete_credential(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9, credential_id=db367293c094466884425586bbd233c4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:56.993355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24de706-5153-4011-b07d-5fe687d9991d tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:57.053200 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1601/3176] 10.222.0.25 () {58 vars in 1380 bytes} [Mon Oct 24 09:02:56 2022] DELETE /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9/credentials/OS-EC2/db367293c094466884425586bbd233c4 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:57.059450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24de706-5153-4011-b07d-5fe687d9991d tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:57.065147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d24de706-5153-4011-b07d-5fe687d9991d tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:57.220590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607ce170-ba4b-4baa-aacc-8d015519897f tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:57.247382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:57.248945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:57.250127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:57.250969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] PATH_INFO: `/v3/projects/b34da25e70e54621b0409ec47faf2b0b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:57.252397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b34da25e70e54621b0409ec47faf2b0b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:57.255094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:57.292612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24de706-5153-4011-b07d-5fe687d9991d tempest-EC2CredentialsTest-235649376 tempest-EC2CredentialsTest-235649376-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:57.304434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:57.310414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:57.310923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:57.311380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] PATH_INFO: `/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:57.313031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f09b2a880caa4c7a9ebe4a22dbc64be9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:57.316531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:57.349519 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:57.368398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b34da25e70e54621b0409ec47faf2b0b', 'request_id': 'req-58679af0-e00b-497e-a297-fd3299f80f1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.383309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b34da25e70e54621b0409ec47faf2b0b', 'request_id': 'req-58679af0-e00b-497e-a297-fd3299f80f1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.401953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b34da25e70e54621b0409ec47faf2b0b', 'request_id': 'req-58679af0-e00b-497e-a297-fd3299f80f1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.418834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] The token cache is being invalidate because project b34da25e70e54621b0409ec47faf2b0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:57.419412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.424500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f09b2a880caa4c7a9ebe4a22dbc64be9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.425657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58679af0-e00b-497e-a297-fd3299f80f1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.428860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1576/3177] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:56 2022] DELETE /identity/v3/projects/b34da25e70e54621b0409ec47faf2b0b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:57.434768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291ddd-ecfa-4c20-b4d4-57155af80315 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:57.435627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291ddd-ecfa-4c20-b4d4-57155af80315 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:57.436202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2291ddd-ecfa-4c20-b4d4-57155af80315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:57.482142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e2291ddd-ecfa-4c20-b4d4-57155af80315 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:57.483995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e2291ddd-ecfa-4c20-b4d4-57155af80315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:57.485639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f09b2a880caa4c7a9ebe4a22dbc64be9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.486451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f09b2a880caa4c7a9ebe4a22dbc64be9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.500853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f09b2a880caa4c7a9ebe4a22dbc64be9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.511260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce4c8d18-556a-4310-9294-65f99ab68839 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f09b2a880caa4c7a9ebe4a22dbc64be9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:57.534183 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1602/3178] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:57 2022] DELETE /identity/v3/users/f09b2a880caa4c7a9ebe4a22dbc64be9 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:57.541479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b58bca-550a-43bb-a6ef-890289e5eee5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:57.541888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b58bca-550a-43bb-a6ef-890289e5eee5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:57.542321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b58bca-550a-43bb-a6ef-890289e5eee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:57.562367 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:57.591359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-24b58bca-550a-43bb-a6ef-890289e5eee5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:57.595819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-24b58bca-550a-43bb-a6ef-890289e5eee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:57.617370 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1577/3179] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:02:57.626046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5deb31-d153-4a9b-bf42-fa9bbf510311 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:57.626382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5deb31-d153-4a9b-bf42-fa9bbf510311 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:57.627242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5deb31-d153-4a9b-bf42-fa9bbf510311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:57.660622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ba5deb31-d153-4a9b-bf42-fa9bbf510311 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:57.663246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ba5deb31-d153-4a9b-bf42-fa9bbf510311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:57.723813 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1603/3180] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:57.755135 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1578/3181] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:02:57.759454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b58bca-550a-43bb-a6ef-890289e5eee5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:57.788451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b58bca-550a-43bb-a6ef-890289e5eee5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:57.796346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e6b31-4c89-40db-b14f-1b2bbda4aad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:57.796837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e6b31-4c89-40db-b14f-1b2bbda4aad8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:57.797538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e6b31-4c89-40db-b14f-1b2bbda4aad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:57.797538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e6b31-4c89-40db-b14f-1b2bbda4aad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:57.800209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e6b31-4c89-40db-b14f-1b2bbda4aad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:02:57.800209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e6b31-4c89-40db-b14f-1b2bbda4aad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:57.802034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4e6b31-4c89-40db-b14f-1b2bbda4aad8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:57.810769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5deb31-d153-4a9b-bf42-fa9bbf510311 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:57.813470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ba5deb31-d153-4a9b-bf42-fa9bbf510311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:57.826883 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1604/3182] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:02:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:02:57.827930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e6b31-4c89-40db-b14f-1b2bbda4aad8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:57.876639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e6b31-4c89-40db-b14f-1b2bbda4aad8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:57.908353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22f263-7c3c-46e9-8b81-738fc86aa4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:57.909924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22f263-7c3c-46e9-8b81-738fc86aa4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:57.910600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22f263-7c3c-46e9-8b81-738fc86aa4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:57.911856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d22f263-7c3c-46e9-8b81-738fc86aa4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:57.912653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22f263-7c3c-46e9-8b81-738fc86aa4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:57.917547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d22f263-7c3c-46e9-8b81-738fc86aa4c8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:57.985642 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1605/3183] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:57 2022] POST /identity/v3/projects => generated 373 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:57.990318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22f263-7c3c-46e9-8b81-738fc86aa4c8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:57.991281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5deb31-d153-4a9b-bf42-fa9bbf510311 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:58.144130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513f1b9-7ac3-498e-aaea-f5fdabe8aaad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:58.144130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513f1b9-7ac3-498e-aaea-f5fdabe8aaad service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:58.144130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513f1b9-7ac3-498e-aaea-f5fdabe8aaad service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:58.144130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4513f1b9-7ac3-498e-aaea-f5fdabe8aaad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:58.154587 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:58.167402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d22f263-7c3c-46e9-8b81-738fc86aa4c8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:58.171267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513f1b9-7ac3-498e-aaea-f5fdabe8aaad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:58.175169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4513f1b9-7ac3-498e-aaea-f5fdabe8aaad service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:58.181485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53ddd2-08f3-4c96-b8f0-9625355495af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:58.182228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ddd2-08f3-4c96-b8f0-9625355495af admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:58.182590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ddd2-08f3-4c96-b8f0-9625355495af admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:58.183115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d53ddd2-08f3-4c96-b8f0-9625355495af admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:58.183876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53ddd2-08f3-4c96-b8f0-9625355495af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:58.187399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d53ddd2-08f3-4c96-b8f0-9625355495af admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:58.201836 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1579/3184] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:02:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:02:58.226216 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1606/3185] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:57 2022] POST /identity/v3/users => generated 287 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:02:58.227926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513f1b9-7ac3-498e-aaea-f5fdabe8aaad service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:58.244841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4513f1b9-7ac3-498e-aaea-f5fdabe8aaad service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:58.252062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d01f4-27eb-4f43-b644-725de5e4e93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:58.252928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d01f4-27eb-4f43-b644-725de5e4e93b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:58.253385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d01f4-27eb-4f43-b644-725de5e4e93b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:58.253926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4d01f4-27eb-4f43-b644-725de5e4e93b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:58.254688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d01f4-27eb-4f43-b644-725de5e4e93b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:58.256745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4d01f4-27eb-4f43-b644-725de5e4e93b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:58.278672 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1580/3186] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:58.280236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53ddd2-08f3-4c96-b8f0-9625355495af admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:58.295611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d53ddd2-08f3-4c96-b8f0-9625355495af admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:58.303736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d943e0-cb5a-4582-b11c-1b16c196a310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:58.305254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d943e0-cb5a-4582-b11c-1b16c196a310 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:58.306502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d943e0-cb5a-4582-b11c-1b16c196a310 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:58.306502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d943e0-cb5a-4582-b11c-1b16c196a310 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:58.307259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d943e0-cb5a-4582-b11c-1b16c196a310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:58.309335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d943e0-cb5a-4582-b11c-1b16c196a310 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:58.330904 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1607/3187] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:58.332421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d01f4-27eb-4f43-b644-725de5e4e93b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:58.344192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4d01f4-27eb-4f43-b644-725de5e4e93b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:58.354079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d1bea-7e9f-4a6c-b0f7-69afb5fe369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:58.354899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d1bea-7e9f-4a6c-b0f7-69afb5fe369f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:58.355569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d1bea-7e9f-4a6c-b0f7-69afb5fe369f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:58.356027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2d1bea-7e9f-4a6c-b0f7-69afb5fe369f admin admin] PATH_INFO: `/v3/projects/72b5d3aef4214073b745477d3d48442b/users/4dde4bb72f914457a633358837d178de/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:58.389530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d1bea-7e9f-4a6c-b0f7-69afb5fe369f admin admin] RBAC: Authorizing `identity:create_grant(project_id=72b5d3aef4214073b745477d3d48442b, user_id=4dde4bb72f914457a633358837d178de, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:58.399599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2d1bea-7e9f-4a6c-b0f7-69afb5fe369f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:58.422301 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1581/3188] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:58 2022] PUT /identity/v3/projects/72b5d3aef4214073b745477d3d48442b/users/4dde4bb72f914457a633358837d178de/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:58.435189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91329237-1c62-4de5-a052-a42b709e5816 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:58.435478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91329237-1c62-4de5-a052-a42b709e5816 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:58.435755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91329237-1c62-4de5-a052-a42b709e5816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:58.527281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-91329237-1c62-4de5-a052-a42b709e5816 None None] MFA Rules not processed for user `4dde4bb72f914457a633358837d178de`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:58.530323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-91329237-1c62-4de5-a052-a42b709e5816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:58.711458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1608/3189] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:02:58.717733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d1bea-7e9f-4a6c-b0f7-69afb5fe369f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:58.739961 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:58.826258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2d1bea-7e9f-4a6c-b0f7-69afb5fe369f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:58.832265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549d5dc-83c9-4a52-826f-9633a2b35d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:58.833204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549d5dc-83c9-4a52-826f-9633a2b35d0b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:58.833667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549d5dc-83c9-4a52-826f-9633a2b35d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:58.834122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7549d5dc-83c9-4a52-826f-9633a2b35d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:58.834912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549d5dc-83c9-4a52-826f-9633a2b35d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:58.837137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7549d5dc-83c9-4a52-826f-9633a2b35d0b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:58.932357 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1582/3190] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:02:58 2022] POST /identity/v3/projects => generated 373 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:58.935968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91329237-1c62-4de5-a052-a42b709e5816 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:58.950599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549d5dc-83c9-4a52-826f-9633a2b35d0b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:58.953005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7549d5dc-83c9-4a52-826f-9633a2b35d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:58.959695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91329237-1c62-4de5-a052-a42b709e5816 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:59.091943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97ac6-dcc3-4e83-a732-93e2bb496294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:59.092699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97ac6-dcc3-4e83-a732-93e2bb496294 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:59.092922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97ac6-dcc3-4e83-a732-93e2bb496294 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:59.093206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb97ac6-dcc3-4e83-a732-93e2bb496294 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:59.093933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb97ac6-dcc3-4e83-a732-93e2bb496294 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:59.095942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb97ac6-dcc3-4e83-a732-93e2bb496294 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:59.120035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7549d5dc-83c9-4a52-826f-9633a2b35d0b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:59.126025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:59.126302 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1609/3191] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:02:58 2022] POST /identity/v3/users => generated 293 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:02:59.130760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:59.131089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97ac6-dcc3-4e83-a732-93e2bb496294 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:59.131267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:59.131656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] PATH_INFO: `/v3/users/28d6776b4c53419ea6a3a4260adc0d45` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:59.133172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=28d6776b4c53419ea6a3a4260adc0d45)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:59.136402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:59.150644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb97ac6-dcc3-4e83-a732-93e2bb496294 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:59.156669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d055e-df3b-4cf1-836d-ea95eac02184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:59.157368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d055e-df3b-4cf1-836d-ea95eac02184 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:59.157707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d055e-df3b-4cf1-836d-ea95eac02184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:59.157989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734d055e-df3b-4cf1-836d-ea95eac02184 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:59.158634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d055e-df3b-4cf1-836d-ea95eac02184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:59.161686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734d055e-df3b-4cf1-836d-ea95eac02184 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:59.179677 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1610/3192] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:59.195454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d055e-df3b-4cf1-836d-ea95eac02184 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:59.212976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734d055e-df3b-4cf1-836d-ea95eac02184 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:59.215698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28d6776b4c53419ea6a3a4260adc0d45'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.222596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84518b86-185e-4c24-96ee-d010e59197ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:59.223586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84518b86-185e-4c24-96ee-d010e59197ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:59.223904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84518b86-185e-4c24-96ee-d010e59197ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:59.224223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84518b86-185e-4c24-96ee-d010e59197ae admin admin] PATH_INFO: `/v3/projects/a2f1f02e88af4e77b8cc8c09da030d0d/users/6a527b0a494f4fe59ebe528dad993e1b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:59.253225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28d6776b4c53419ea6a3a4260adc0d45'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.256540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28d6776b4c53419ea6a3a4260adc0d45'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.266424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84518b86-185e-4c24-96ee-d010e59197ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f1f02e88af4e77b8cc8c09da030d0d, user_id=6a527b0a494f4fe59ebe528dad993e1b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:59.269874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84518b86-185e-4c24-96ee-d010e59197ae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:59.284434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28d6776b4c53419ea6a3a4260adc0d45'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.325827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28d6776b4c53419ea6a3a4260adc0d45'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.333437 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1611/3193] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:59 2022] PUT /identity/v3/projects/a2f1f02e88af4e77b8cc8c09da030d0d/users/6a527b0a494f4fe59ebe528dad993e1b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:59.334607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84518b86-185e-4c24-96ee-d010e59197ae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:59.339773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-84518b86-185e-4c24-96ee-d010e59197ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:59.346033 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1583/3194] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:02:58 2022] DELETE /identity/v3/users/28d6776b4c53419ea6a3a4260adc0d45 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:59.390580 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:59.464522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84518b86-185e-4c24-96ee-d010e59197ae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:59.547423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eda9a7-42b7-4ceb-97de-603004d865c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:59.548242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eda9a7-42b7-4ceb-97de-603004d865c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:59.548529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eda9a7-42b7-4ceb-97de-603004d865c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:59.548801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eda9a7-42b7-4ceb-97de-603004d865c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:59.550217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eda9a7-42b7-4ceb-97de-603004d865c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:59.551908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eda9a7-42b7-4ceb-97de-603004d865c4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:59.571472 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1612/3195] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:02:59.572326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:59.588396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3cf4b8-7549-4f4d-89a8-d4944978fb5f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:59.605494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2975c6c-0108-44f3-9f54-cb81e161442c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:59.606179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2975c6c-0108-44f3-9f54-cb81e161442c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:59.606457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2975c6c-0108-44f3-9f54-cb81e161442c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:59.606746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2975c6c-0108-44f3-9f54-cb81e161442c admin admin] PATH_INFO: `/v3/projects/a2f1f02e88af4e77b8cc8c09da030d0d/users/6a527b0a494f4fe59ebe528dad993e1b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:59.608810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2975c6c-0108-44f3-9f54-cb81e161442c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f1f02e88af4e77b8cc8c09da030d0d, user_id=6a527b0a494f4fe59ebe528dad993e1b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:59.614675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0116-027e-49a8-abe7-5914a748e681 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:59.614675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0116-027e-49a8-abe7-5914a748e681 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:59.614675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5c0116-027e-49a8-abe7-5914a748e681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:59.617988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2975c6c-0108-44f3-9f54-cb81e161442c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:59.625916 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:02:59.634429 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1584/3196] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:02:59 2022] PUT /identity/v3/projects/a2f1f02e88af4e77b8cc8c09da030d0d/users/6a527b0a494f4fe59ebe528dad993e1b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:02:59.651217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2975c6c-0108-44f3-9f54-cb81e161442c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:59.654563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f2975c6c-0108-44f3-9f54-cb81e161442c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:59.696147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-eb5c0116-027e-49a8-abe7-5914a748e681 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:59.697562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eb5c0116-027e-49a8-abe7-5914a748e681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:59.773185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2975c6c-0108-44f3-9f54-cb81e161442c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:02:59.780214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:02:59.780858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:59.781137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:59.781448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] PATH_INFO: `/v3/projects/2fa35beb56134e30aa94f0a671fd6818` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:59.782610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fa35beb56134e30aa94f0a671fd6818)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:02:59.785856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:02:59.790873 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1613/3197] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:59 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:02:59.820120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc122532-54c1-436b-abf2-ee5074decfab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:02:59.820461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc122532-54c1-436b-abf2-ee5074decfab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:02:59.820762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc122532-54c1-436b-abf2-ee5074decfab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:02:59.870582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fa35beb56134e30aa94f0a671fd6818', 'request_id': 'req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.880742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fa35beb56134e30aa94f0a671fd6818', 'request_id': 'req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.881585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bc122532-54c1-436b-abf2-ee5074decfab None None] MFA Rules not processed for user `6a527b0a494f4fe59ebe528dad993e1b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:02:59.884579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc122532-54c1-436b-abf2-ee5074decfab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:59.897568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fa35beb56134e30aa94f0a671fd6818', 'request_id': 'req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.923767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] The token cache is being invalidate because project 2fa35beb56134e30aa94f0a671fd6818 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:02:59.924317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.925238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:02:59.927300 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1585/3198] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:59 2022] DELETE /identity/v3/projects/2fa35beb56134e30aa94f0a671fd6818 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:02:59.928447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:02:59.934062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:02:59.960346 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:00.024817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a6f2a1-0e04-473f-9595-5eaa8cabcb69 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:00.041501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:00.042047 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1614/3199] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:02:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:00.042193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.042427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.042708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] PATH_INFO: `/v3/projects/d8b23bc011414545b6ee64c17d866805` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.043997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be27b6-4025-4923-990b-895aa5ca0ad4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.044127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8b23bc011414545b6ee64c17d866805)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:00.044315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be27b6-4025-4923-990b-895aa5ca0ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.044530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be27b6-4025-4923-990b-895aa5ca0ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.046325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:00.086981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b2be27b6-4025-4923-990b-895aa5ca0ad4 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:00.088720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2be27b6-4025-4923-990b-895aa5ca0ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:00.132689 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:00.162422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8b23bc011414545b6ee64c17d866805', 'request_id': 'req-5a19df3b-7690-45c8-961b-7ae3bc49ad58'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:00.178315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8b23bc011414545b6ee64c17d866805', 'request_id': 'req-5a19df3b-7690-45c8-961b-7ae3bc49ad58'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:00.187820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8b23bc011414545b6ee64c17d866805', 'request_id': 'req-5a19df3b-7690-45c8-961b-7ae3bc49ad58'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:00.213584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] The token cache is being invalidate because project d8b23bc011414545b6ee64c17d866805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:00.213872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:00.214743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a19df3b-7690-45c8-961b-7ae3bc49ad58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:00.229281 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1586/3200] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:02:59 2022] DELETE /identity/v3/projects/d8b23bc011414545b6ee64c17d866805 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:00.230735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189de358-fd0b-4856-91f0-df12640cdf60 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.231019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189de358-fd0b-4856-91f0-df12640cdf60 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.231294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189de358-fd0b-4856-91f0-df12640cdf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.262499 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1615/3201] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:00.262970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b598-b5cb-47dc-ae83-c7b185cab7b1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.263492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b598-b5cb-47dc-ae83-c7b185cab7b1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.264205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa50b598-b5cb-47dc-ae83-c7b185cab7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.274903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-189de358-fd0b-4856-91f0-df12640cdf60 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:00.276133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-189de358-fd0b-4856-91f0-df12640cdf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:00.313276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aa50b598-b5cb-47dc-ae83-c7b185cab7b1 None None] MFA Rules not processed for user `4dde4bb72f914457a633358837d178de`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:00.316620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa50b598-b5cb-47dc-ae83-c7b185cab7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:00.438318 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1587/3202] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:00.440108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb411-4c0c-4f86-a6b1-efdbd1a5fce2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.440542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb411-4c0c-4f86-a6b1-efdbd1a5fce2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.441033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8cb411-4c0c-4f86-a6b1-efdbd1a5fce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.476555 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1616/3203] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:00.476555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b598-b5cb-47dc-ae83-c7b185cab7b1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:00.476555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa50b598-b5cb-47dc-ae83-c7b185cab7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:00.488767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ca8cb411-4c0c-4f86-a6b1-efdbd1a5fce2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:00.490430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ca8cb411-4c0c-4f86-a6b1-efdbd1a5fce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:00.523410 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1588/3204] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:00.526303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14327512-cadb-4438-aee1-35c79f8509a2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.529116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14327512-cadb-4438-aee1-35c79f8509a2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.531156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14327512-cadb-4438-aee1-35c79f8509a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.593508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-14327512-cadb-4438-aee1-35c79f8509a2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:00.595033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-14327512-cadb-4438-aee1-35c79f8509a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:00.614217 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1589/3205] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:00.615427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaa3a7-d40f-4d12-8ed2-c6ba606174df None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.615710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaa3a7-d40f-4d12-8ed2-c6ba606174df None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.615983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbaa3a7-d40f-4d12-8ed2-c6ba606174df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.664417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-afbaa3a7-d40f-4d12-8ed2-c6ba606174df None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:00.665876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-afbaa3a7-d40f-4d12-8ed2-c6ba606174df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:00.684103 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1590/3206] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:00.684577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa50b598-b5cb-47dc-ae83-c7b185cab7b1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:00.688661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaa3a7-d40f-4d12-8ed2-c6ba606174df None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:00.695176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebda5e-ceac-4fa1-9b1e-719177430d03 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:00.696080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebda5e-ceac-4fa1-9b1e-719177430d03 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.696531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebda5e-ceac-4fa1-9b1e-719177430d03 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.696960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebda5e-ceac-4fa1-9b1e-719177430d03 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.698973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e1ebda5e-ceac-4fa1-9b1e-719177430d03 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:00.708566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbaa3a7-d40f-4d12-8ed2-c6ba606174df None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:00.726892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e83447-25ea-4b8a-bfd9-0ec35f3ca8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:00.727513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e83447-25ea-4b8a-bfd9-0ec35f3ca8b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.727789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e83447-25ea-4b8a-bfd9-0ec35f3ca8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.728057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e83447-25ea-4b8a-bfd9-0ec35f3ca8b0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.728706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e83447-25ea-4b8a-bfd9-0ec35f3ca8b0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:03:00.729006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e83447-25ea-4b8a-bfd9-0ec35f3ca8b0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:00.730846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e83447-25ea-4b8a-bfd9-0ec35f3ca8b0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:00.753472 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1591/3207] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:03:00.755067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e83447-25ea-4b8a-bfd9-0ec35f3ca8b0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:00.769160 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:00.780988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e83447-25ea-4b8a-bfd9-0ec35f3ca8b0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:00.792119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9c377-64b7-455d-83bd-ac172a24f918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:00.793412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c377-64b7-455d-83bd-ac172a24f918 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.793888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c377-64b7-455d-83bd-ac172a24f918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.794318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9c377-64b7-455d-83bd-ac172a24f918 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.795525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9c377-64b7-455d-83bd-ac172a24f918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:03:00.796010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9c377-64b7-455d-83bd-ac172a24f918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:00.798271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e9c377-64b7-455d-83bd-ac172a24f918 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:00.827999 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1592/3208] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:03:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:03:00.837383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebda5e-ceac-4fa1-9b1e-719177430d03 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:00.842399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9c377-64b7-455d-83bd-ac172a24f918 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:00.842601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebda5e-ceac-4fa1-9b1e-719177430d03 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:00.854226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9c377-64b7-455d-83bd-ac172a24f918 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:00.867980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57963b2-032a-43b7-807e-43eb2ee7ef5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:00.868794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57963b2-032a-43b7-807e-43eb2ee7ef5d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.869143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57963b2-032a-43b7-807e-43eb2ee7ef5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.869444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57963b2-032a-43b7-807e-43eb2ee7ef5d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.870085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57963b2-032a-43b7-807e-43eb2ee7ef5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:00.871992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57963b2-032a-43b7-807e-43eb2ee7ef5d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:00.880402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1617/3209] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:00.881277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebda5e-ceac-4fa1-9b1e-719177430d03 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:00.909602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebda5e-ceac-4fa1-9b1e-719177430d03 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:00.921544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af604362-850a-462f-9e05-b733310533a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:00.922101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604362-850a-462f-9e05-b733310533a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.922383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604362-850a-462f-9e05-b733310533a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.922680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af604362-850a-462f-9e05-b733310533a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.923610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af604362-850a-462f-9e05-b733310533a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:00.925582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af604362-850a-462f-9e05-b733310533a2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:00.955113 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1593/3210] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:00 2022] POST /identity/v3/projects => generated 397 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:00.956152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd26d2a-ca0c-49a8-8f6f-e360941c8a83 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:00.958143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd26d2a-ca0c-49a8-8f6f-e360941c8a83 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:00.959548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd26d2a-ca0c-49a8-8f6f-e360941c8a83 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:00.963860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1594/3211] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:03:00 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:03:00.965020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd26d2a-ca0c-49a8-8f6f-e360941c8a83 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.010238 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1618/3212] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:00 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:01.014387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458119-52eb-4bd9-a3af-fc1d5ee6579b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.014811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458119-52eb-4bd9-a3af-fc1d5ee6579b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.015216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a458119-52eb-4bd9-a3af-fc1d5ee6579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.130818 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:01.156587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0a458119-52eb-4bd9-a3af-fc1d5ee6579b None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:01.158505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0a458119-52eb-4bd9-a3af-fc1d5ee6579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:01.164696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd26d2a-ca0c-49a8-8f6f-e360941c8a83 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.249038 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1619/3213] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:03:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:01.250137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458119-52eb-4bd9-a3af-fc1d5ee6579b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.280920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2582-7573-4535-b44d-4f5dadc55e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.281597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2582-7573-4535-b44d-4f5dadc55e11 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.281868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2582-7573-4535-b44d-4f5dadc55e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.282149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e2582-7573-4535-b44d-4f5dadc55e11 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.282793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e2582-7573-4535-b44d-4f5dadc55e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:01.289904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e2582-7573-4535-b44d-4f5dadc55e11 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:01.336380 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1595/3214] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:00 2022] POST /identity/v3/users => generated 305 bytes in 372 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:01.337341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2582-7573-4535-b44d-4f5dadc55e11 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.342865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-445e2582-7573-4535-b44d-4f5dadc55e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:01.382687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e2582-7573-4535-b44d-4f5dadc55e11 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.392326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c3d82-9d4e-4a74-9276-a2802277e7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.392913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3d82-9d4e-4a74-9276-a2802277e7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.393322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3d82-9d4e-4a74-9276-a2802277e7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.393618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5c3d82-9d4e-4a74-9276-a2802277e7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.410516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a458119-52eb-4bd9-a3af-fc1d5ee6579b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.413675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c3d82-9d4e-4a74-9276-a2802277e7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:01.419109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5c3d82-9d4e-4a74-9276-a2802277e7a6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:01.427921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e9606-c6e8-4f73-9f68-452c8fa9ecb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.430240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e9606-c6e8-4f73-9f68-452c8fa9ecb4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.430537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e9606-c6e8-4f73-9f68-452c8fa9ecb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.432857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c94e9606-c6e8-4f73-9f68-452c8fa9ecb4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.434200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e9606-c6e8-4f73-9f68-452c8fa9ecb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:01.440098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c94e9606-c6e8-4f73-9f68-452c8fa9ecb4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:01.446466 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1596/3215] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:01.446466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c3d82-9d4e-4a74-9276-a2802277e7a6 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.474885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5c3d82-9d4e-4a74-9276-a2802277e7a6 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.481784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e01cb9-6df8-4cf0-82af-0b0624eb4a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.484957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e01cb9-6df8-4cf0-82af-0b0624eb4a8a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.485233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e01cb9-6df8-4cf0-82af-0b0624eb4a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.489751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e01cb9-6df8-4cf0-82af-0b0624eb4a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.490478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e01cb9-6df8-4cf0-82af-0b0624eb4a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:01.492646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1620/3216] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:01 2022] POST /identity/v3/users => generated 291 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:01.494411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e01cb9-6df8-4cf0-82af-0b0624eb4a8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:01.497629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e9606-c6e8-4f73-9f68-452c8fa9ecb4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.524092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c94e9606-c6e8-4f73-9f68-452c8fa9ecb4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.526647 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1597/3217] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:01.529799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e01cb9-6df8-4cf0-82af-0b0624eb4a8a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.535737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604b71-9ab6-4aca-8076-ad1230ebbf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.537545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604b71-9ab6-4aca-8076-ad1230ebbf1b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.537833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604b71-9ab6-4aca-8076-ad1230ebbf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.538115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f604b71-9ab6-4aca-8076-ad1230ebbf1b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.541486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f604b71-9ab6-4aca-8076-ad1230ebbf1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:01.550839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f604b71-9ab6-4aca-8076-ad1230ebbf1b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:01.557086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e01cb9-6df8-4cf0-82af-0b0624eb4a8a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.573728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379107-533d-4291-9193-d2d7aa9c602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.574406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379107-533d-4291-9193-d2d7aa9c602d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.575481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379107-533d-4291-9193-d2d7aa9c602d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.575603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83379107-533d-4291-9193-d2d7aa9c602d admin admin] PATH_INFO: `/v3/projects/7e667fdf6fa04b1289af0be64d7f60bb/users/c2d2c4e9fcd245538a601367d70b09a1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.576766 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1621/3218] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:01.579121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604b71-9ab6-4aca-8076-ad1230ebbf1b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.605662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f604b71-9ab6-4aca-8076-ad1230ebbf1b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.614755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83379107-533d-4291-9193-d2d7aa9c602d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e667fdf6fa04b1289af0be64d7f60bb, user_id=c2d2c4e9fcd245538a601367d70b09a1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:01.617705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83379107-533d-4291-9193-d2d7aa9c602d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:01.618589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2af20-5d6d-4e1a-b0ea-4c632a59bcfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.621242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2af20-5d6d-4e1a-b0ea-4c632a59bcfc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.621875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2af20-5d6d-4e1a-b0ea-4c632a59bcfc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.622500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2af20-5d6d-4e1a-b0ea-4c632a59bcfc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.625923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2af20-5d6d-4e1a-b0ea-4c632a59bcfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:01.634238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2af20-5d6d-4e1a-b0ea-4c632a59bcfc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:01.638546 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1598/3219] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:01 2022] PUT /identity/v3/projects/7e667fdf6fa04b1289af0be64d7f60bb/users/c2d2c4e9fcd245538a601367d70b09a1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:01.642475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379107-533d-4291-9193-d2d7aa9c602d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.673325 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1622/3220] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:01.677821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2af20-5d6d-4e1a-b0ea-4c632a59bcfc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.710747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2af20-5d6d-4e1a-b0ea-4c632a59bcfc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.726092 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:01.749790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83379107-533d-4291-9193-d2d7aa9c602d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.766673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcd47a-7ee5-41f1-a8cc-e285b7f42f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.767596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcd47a-7ee5-41f1-a8cc-e285b7f42f6f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.768034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcd47a-7ee5-41f1-a8cc-e285b7f42f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.769027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdcd47a-7ee5-41f1-a8cc-e285b7f42f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.770284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcd47a-7ee5-41f1-a8cc-e285b7f42f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:01.772191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdcd47a-7ee5-41f1-a8cc-e285b7f42f6f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:01.786927 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1599/3221] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:01.788311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcd47a-7ee5-41f1-a8cc-e285b7f42f6f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:01.791487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7cdcd47a-7ee5-41f1-a8cc-e285b7f42f6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:01.863761 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:01.923347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbd1e2-0f2f-47bf-8ec8-0f9abf19017e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.924561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd1e2-0f2f-47bf-8ec8-0f9abf19017e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.924964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd1e2-0f2f-47bf-8ec8-0f9abf19017e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.925371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fbd1e2-0f2f-47bf-8ec8-0f9abf19017e admin admin] PATH_INFO: `/v3/projects/5297380773734f4ab82dbb83f1c855e0/users/0faa202378cf499581a14f05c7cfa9c8/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.935614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdcd47a-7ee5-41f1-a8cc-e285b7f42f6f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:01.943778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abe7d7-c318-401a-b4d6-ea107cfd0d42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:01.944234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abe7d7-c318-401a-b4d6-ea107cfd0d42 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:01.944522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abe7d7-c318-401a-b4d6-ea107cfd0d42 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:01.944801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abe7d7-c318-401a-b4d6-ea107cfd0d42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:01.948051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7abe7d7-c318-401a-b4d6-ea107cfd0d42 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:01.966844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbd1e2-0f2f-47bf-8ec8-0f9abf19017e admin admin] RBAC: Authorizing `identity:create_grant(project_id=5297380773734f4ab82dbb83f1c855e0, user_id=0faa202378cf499581a14f05c7cfa9c8, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:01.971038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fbd1e2-0f2f-47bf-8ec8-0f9abf19017e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:02.033451 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1623/3222] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:01 2022] PUT /identity/v3/projects/5297380773734f4ab82dbb83f1c855e0/users/0faa202378cf499581a14f05c7cfa9c8/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:02.033451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbd1e2-0f2f-47bf-8ec8-0f9abf19017e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:02.134260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abe7d7-c318-401a-b4d6-ea107cfd0d42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:02.135887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abe7d7-c318-401a-b4d6-ea107cfd0d42 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:02.151327 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1600/3223] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:02.152590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39c5c-5de5-4ee2-bdae-8f0dd59b4fd1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:02.153002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39c5c-5de5-4ee2-bdae-8f0dd59b4fd1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:02.153276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac39c5c-5de5-4ee2-bdae-8f0dd59b4fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:02.217835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fbd1e2-0f2f-47bf-8ec8-0f9abf19017e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:02.225846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4ac39c5c-5de5-4ee2-bdae-8f0dd59b4fd1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:02.230157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4ac39c5c-5de5-4ee2-bdae-8f0dd59b4fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:02.233962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecdf753-6d19-42ba-ac00-fb70ecd43fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:02.234814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf753-6d19-42ba-ac00-fb70ecd43fe5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:02.235768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf753-6d19-42ba-ac00-fb70ecd43fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:02.236496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecdf753-6d19-42ba-ac00-fb70ecd43fe5 admin admin] PATH_INFO: `/v3/projects/7e667fdf6fa04b1289af0be64d7f60bb/users/c2d2c4e9fcd245538a601367d70b09a1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:02.243175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdf753-6d19-42ba-ac00-fb70ecd43fe5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e667fdf6fa04b1289af0be64d7f60bb, user_id=c2d2c4e9fcd245538a601367d70b09a1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:02.250683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecdf753-6d19-42ba-ac00-fb70ecd43fe5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:02.255083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1601/3224] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:02.255083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80e90-3dfa-4848-a55c-4412f0747acf None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:02.255083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80e90-3dfa-4848-a55c-4412f0747acf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:02.255083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac80e90-3dfa-4848-a55c-4412f0747acf None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:02.256439 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1602/3225] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:03:02.262292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac80e90-3dfa-4848-a55c-4412f0747acf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:02.298010 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1624/3226] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:02 2022] PUT /identity/v3/projects/7e667fdf6fa04b1289af0be64d7f60bb/users/c2d2c4e9fcd245538a601367d70b09a1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:02.300081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211cde5-f5f1-4ec5-b6a3-99686711b37a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:02.300375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211cde5-f5f1-4ec5-b6a3-99686711b37a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:02.300652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211cde5-f5f1-4ec5-b6a3-99686711b37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:02.356849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1211cde5-f5f1-4ec5-b6a3-99686711b37a None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:02.360414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1211cde5-f5f1-4ec5-b6a3-99686711b37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:02.427794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac80e90-3dfa-4848-a55c-4412f0747acf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:02.503514 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1625/3227] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:03:02 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:02.505713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b132e4-f332-4b0d-8c09-2ccc51c5274d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:02.506011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b132e4-f332-4b0d-8c09-2ccc51c5274d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:02.506292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b132e4-f332-4b0d-8c09-2ccc51c5274d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:02.577254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-26b132e4-f332-4b0d-8c09-2ccc51c5274d None None] MFA Rules not processed for user `c2d2c4e9fcd245538a601367d70b09a1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:02.579140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-26b132e4-f332-4b0d-8c09-2ccc51c5274d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:02.607009 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:02.652138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4104e-127c-4628-a794-d960d1c2a0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:02.653429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4104e-127c-4628-a794-d960d1c2a0be service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:02.653429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4104e-127c-4628-a794-d960d1c2a0be service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:02.653429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb4104e-127c-4628-a794-d960d1c2a0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:02.726448 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1626/3228] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:02 2022] POST /identity/v3/auth/tokens => generated 3341 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:02.728014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b132e4-f332-4b0d-8c09-2ccc51c5274d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:02.728996 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:02.749926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b132e4-f332-4b0d-8c09-2ccc51c5274d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:02.761411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ef4fc-fc20-43dd-ab59-6f6420b27b0f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:02.762043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ef4fc-fc20-43dd-ab59-6f6420b27b0f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:02.762327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ef4fc-fc20-43dd-ab59-6f6420b27b0f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:02.762605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ef4fc-fc20-43dd-ab59-6f6420b27b0f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:02.779082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ef4fc-fc20-43dd-ab59-6f6420b27b0f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:02.780711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ef4fc-fc20-43dd-ab59-6f6420b27b0f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:02.794155 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1627/3229] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:02.795108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ef4fc-fc20-43dd-ab59-6f6420b27b0f service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:02.813439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4104e-127c-4628-a794-d960d1c2a0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:02.815122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb4104e-127c-4628-a794-d960d1c2a0be service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:02.830779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ef4fc-fc20-43dd-ab59-6f6420b27b0f service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:02.840394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a53d06-1205-463b-9c9b-37517b07ff51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:02.841160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53d06-1205-463b-9c9b-37517b07ff51 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:02.841568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53d06-1205-463b-9c9b-37517b07ff51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:02.842391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a53d06-1205-463b-9c9b-37517b07ff51 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:02.843168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a53d06-1205-463b-9c9b-37517b07ff51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:02.845362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a53d06-1205-463b-9c9b-37517b07ff51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:02.850402 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1603/3230] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:02.949055 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1628/3231] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:02 2022] POST /identity/v3/projects => generated 395 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:02.955494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4104e-127c-4628-a794-d960d1c2a0be service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:02.973270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb4104e-127c-4628-a794-d960d1c2a0be service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:03.123028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de6d05-5506-46f7-aa47-0d042f7f2748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:03.123028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de6d05-5506-46f7-aa47-0d042f7f2748 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:03.123028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de6d05-5506-46f7-aa47-0d042f7f2748 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:03.123028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6de6d05-5506-46f7-aa47-0d042f7f2748 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:03.123513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de6d05-5506-46f7-aa47-0d042f7f2748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:03.181474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6de6d05-5506-46f7-aa47-0d042f7f2748 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:03.266287 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1604/3232] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:02 2022] POST /identity/v3/users => generated 298 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:03.271158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a53d06-1205-463b-9c9b-37517b07ff51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:03.294557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a53d06-1205-463b-9c9b-37517b07ff51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:03.326663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fce87d-8122-44e7-a6ce-5caf9baa2073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:03.327302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fce87d-8122-44e7-a6ce-5caf9baa2073 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:03.327585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fce87d-8122-44e7-a6ce-5caf9baa2073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:03.327858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fce87d-8122-44e7-a6ce-5caf9baa2073 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:03.339188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fce87d-8122-44e7-a6ce-5caf9baa2073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:03.345320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fce87d-8122-44e7-a6ce-5caf9baa2073 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:03.348666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de6d05-5506-46f7-aa47-0d042f7f2748 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:03.401649 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1629/3233] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:03.402606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fce87d-8122-44e7-a6ce-5caf9baa2073 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:03.441742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fce87d-8122-44e7-a6ce-5caf9baa2073 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:03.473938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d791736-f6a0-4bf5-97dc-ca1d39c75d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:03.474469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d791736-f6a0-4bf5-97dc-ca1d39c75d90 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:03.474754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d791736-f6a0-4bf5-97dc-ca1d39c75d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:03.475030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d791736-f6a0-4bf5-97dc-ca1d39c75d90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:03.475681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d791736-f6a0-4bf5-97dc-ca1d39c75d90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:03.477333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d791736-f6a0-4bf5-97dc-ca1d39c75d90 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:03.513003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6de6d05-5506-46f7-aa47-0d042f7f2748 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:03.518832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:03.519767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:03.520199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:03.520966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:03.524216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:03.547238 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1630/3234] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:03 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:03.552782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d791736-f6a0-4bf5-97dc-ca1d39c75d90 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:03.599849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d791736-f6a0-4bf5-97dc-ca1d39c75d90 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:03.619389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e32a97-0b80-42bf-aa17-11d59a2c105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:03.625616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e32a97-0b80-42bf-aa17-11d59a2c105c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:03.626989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e32a97-0b80-42bf-aa17-11d59a2c105c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:03.627955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e32a97-0b80-42bf-aa17-11d59a2c105c admin admin] PATH_INFO: `/v3/projects/8eb9678f8c2d42029a5dfe0f1bcae242/users/1d69d2b346e845fda1e27611ffa2f7a3/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:03.657272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e32a97-0b80-42bf-aa17-11d59a2c105c admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eb9678f8c2d42029a5dfe0f1bcae242, user_id=1d69d2b346e845fda1e27611ffa2f7a3, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:03.662704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e32a97-0b80-42bf-aa17-11d59a2c105c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:03.689534 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1631/3235] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:03 2022] PUT /identity/v3/projects/8eb9678f8c2d42029a5dfe0f1bcae242/users/1d69d2b346e845fda1e27611ffa2f7a3/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:03.706334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b563921-d898-4373-8f2a-ebb090db4388 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:03.706737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b563921-d898-4373-8f2a-ebb090db4388 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:03.707126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b563921-d898-4373-8f2a-ebb090db4388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:03.760870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:03.762387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:03.776480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6b563921-d898-4373-8f2a-ebb090db4388 None None] MFA Rules not processed for user `1d69d2b346e845fda1e27611ffa2f7a3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:03.778071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6b563921-d898-4373-8f2a-ebb090db4388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:03.801578 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1605/3236] 10.222.0.25 () {60 vars in 1396 bytes} [Mon Oct 24 09:03:03 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3242 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:04.050624 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1632/3237] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:03 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:04.052801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:04.076802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:04.161861 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:04.428886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c89e14e-475a-41a1-b7d0-e632014e0948 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:04.606636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d6f898-920b-4bc6-8a96-69a85be3b74c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:04.607597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6f898-920b-4bc6-8a96-69a85be3b74c service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:04.608030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6f898-920b-4bc6-8a96-69a85be3b74c service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:04.608503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d6f898-920b-4bc6-8a96-69a85be3b74c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:04.756721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6f898-920b-4bc6-8a96-69a85be3b74c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:04.760862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d6f898-920b-4bc6-8a96-69a85be3b74c service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:04.789071 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1606/3238] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:04 2022] GET /identity/v3/auth/tokens => generated 3341 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:05.790245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b563921-d898-4373-8f2a-ebb090db4388 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:05.864370 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:05.982122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b563921-d898-4373-8f2a-ebb090db4388 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:05.989748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:05.990667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:05.991108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:05.991799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] PATH_INFO: `/v3/users/c2d2c4e9fcd245538a601367d70b09a1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:05.993152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2d2c4e9fcd245538a601367d70b09a1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:05.995339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:06.125991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2d2c4e9fcd245538a601367d70b09a1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:06.152753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2d2c4e9fcd245538a601367d70b09a1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:06.153846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2d2c4e9fcd245538a601367d70b09a1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:06.165162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2d2c4e9fcd245538a601367d70b09a1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:06.225905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8fd9adba-d59b-4f20-abc6-59156eab8f68 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2d2c4e9fcd245538a601367d70b09a1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:06.256106 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1633/3239] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:05 2022] DELETE /identity/v3/users/c2d2c4e9fcd245538a601367d70b09a1 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:06.260931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3196ae-1e02-40cf-be69-e5120be51d0f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:06.261559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3196ae-1e02-40cf-be69-e5120be51d0f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:06.261559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3196ae-1e02-40cf-be69-e5120be51d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:06.306532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0c3196ae-1e02-40cf-be69-e5120be51d0f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:06.307798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0c3196ae-1e02-40cf-be69-e5120be51d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:06.452694 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1607/3240] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:06.499634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6d7ae-24c2-44e8-80b8-5b59c41ac158 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:06.499996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6d7ae-24c2-44e8-80b8-5b59c41ac158 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:06.500260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a6d7ae-24c2-44e8-80b8-5b59c41ac158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:06.534774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a1a6d7ae-24c2-44e8-80b8-5b59c41ac158 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:06.538463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a1a6d7ae-24c2-44e8-80b8-5b59c41ac158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:06.550925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3196ae-1e02-40cf-be69-e5120be51d0f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:06.552437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0c3196ae-1e02-40cf-be69-e5120be51d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:06.558473 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:06.689997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3196ae-1e02-40cf-be69-e5120be51d0f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:06.697942 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1634/3241] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:03:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:06.712659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bea271-5d8a-4771-9f95-2d29c23dfa29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:06.715485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bea271-5d8a-4771-9f95-2d29c23dfa29 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:06.715932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bea271-5d8a-4771-9f95-2d29c23dfa29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:06.729545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bea271-5d8a-4771-9f95-2d29c23dfa29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:06.737770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6d7ae-24c2-44e8-80b8-5b59c41ac158 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:06.740507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a1a6d7ae-24c2-44e8-80b8-5b59c41ac158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:06.764936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bea271-5d8a-4771-9f95-2d29c23dfa29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:06.767684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bea271-5d8a-4771-9f95-2d29c23dfa29 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:06.807475 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1608/3242] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:06.861438 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:06.903132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a6d7ae-24c2-44e8-80b8-5b59c41ac158 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:06.913647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7146a4-adf8-4001-8fcb-cd16a9960252 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:06.914766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7146a4-adf8-4001-8fcb-cd16a9960252 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:06.915401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7146a4-adf8-4001-8fcb-cd16a9960252 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:06.915987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7146a4-adf8-4001-8fcb-cd16a9960252 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:06.933973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7146a4-adf8-4001-8fcb-cd16a9960252 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:06.938358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7146a4-adf8-4001-8fcb-cd16a9960252 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:06.957934 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1635/3243] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:03:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:03:08.061197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c100f9-17a6-43ab-bb3d-e28c9637b074 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:08.062487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c100f9-17a6-43ab-bb3d-e28c9637b074 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:08.063158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c100f9-17a6-43ab-bb3d-e28c9637b074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:08.093178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-60c100f9-17a6-43ab-bb3d-e28c9637b074 None None] MFA Rules not processed for user `ca932e5866274fc78b04689811e72746`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:08.096923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-60c100f9-17a6-43ab-bb3d-e28c9637b074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:08.168654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1609/3244] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:08 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:08.430725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7146a4-adf8-4001-8fcb-cd16a9960252 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:08.432275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8f7146a4-adf8-4001-8fcb-cd16a9960252 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:08.464580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7146a4-adf8-4001-8fcb-cd16a9960252 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:08.476807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:08.479854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:08.480264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:08.480644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] PATH_INFO: `/v3/projects/7e667fdf6fa04b1289af0be64d7f60bb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:08.495395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e667fdf6fa04b1289af0be64d7f60bb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:08.498248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:08.653951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e667fdf6fa04b1289af0be64d7f60bb', 'request_id': 'req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:08.668149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e667fdf6fa04b1289af0be64d7f60bb', 'request_id': 'req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:08.685048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e667fdf6fa04b1289af0be64d7f60bb', 'request_id': 'req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:08.708003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] The token cache is being invalidate because project 7e667fdf6fa04b1289af0be64d7f60bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:08.709692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:08.715465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:08.719166 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1636/3245] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:08 2022] DELETE /identity/v3/projects/7e667fdf6fa04b1289af0be64d7f60bb => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:08.723429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c100f9-17a6-43ab-bb3d-e28c9637b074 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:08.747601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c100f9-17a6-43ab-bb3d-e28c9637b074 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:08.871263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:08.872875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:08.873231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:08.873909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] PATH_INFO: `/v3/users/1d69d2b346e845fda1e27611ffa2f7a3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:08.876899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d69d2b346e845fda1e27611ffa2f7a3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:08.882971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:08.980273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d69d2b346e845fda1e27611ffa2f7a3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:08.986127 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:08.998726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d69d2b346e845fda1e27611ffa2f7a3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:08.999957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d69d2b346e845fda1e27611ffa2f7a3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:09.013334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d69d2b346e845fda1e27611ffa2f7a3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:09.030527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d69d2b346e845fda1e27611ffa2f7a3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:09.042012 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1610/3246] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:08 2022] DELETE /identity/v3/users/1d69d2b346e845fda1e27611ffa2f7a3 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:09.097215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:09.099272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:09.353140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c62d960-5cd9-4aa6-b870-fac2bb22f7b6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:09.482429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4643e6-4b2f-464c-9be4-65cc9e7c804e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:09.484398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4643e6-4b2f-464c-9be4-65cc9e7c804e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:09.484959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4643e6-4b2f-464c-9be4-65cc9e7c804e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:09.485710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4643e6-4b2f-464c-9be4-65cc9e7c804e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:09.487903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bd4643e6-4b2f-464c-9be4-65cc9e7c804e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:09.510065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4643e6-4b2f-464c-9be4-65cc9e7c804e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:09.512129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4643e6-4b2f-464c-9be4-65cc9e7c804e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:09.526399 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1637/3247] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:10.504101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:10.506177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:10.704173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e5b63-7a6e-4b82-b551-9cd7ccc0345d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:10.721767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:10.722411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:10.722963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:10.723234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] PATH_INFO: `/v3/projects/8eb9678f8c2d42029a5dfe0f1bcae242` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:10.724277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eb9678f8c2d42029a5dfe0f1bcae242)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:10.726216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:10.839351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eb9678f8c2d42029a5dfe0f1bcae242', 'request_id': 'req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:10.867988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eb9678f8c2d42029a5dfe0f1bcae242', 'request_id': 'req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:10.887406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eb9678f8c2d42029a5dfe0f1bcae242', 'request_id': 'req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:10.916150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] The token cache is being invalidate because project 8eb9678f8c2d42029a5dfe0f1bcae242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:10.934508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:10.938637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1273f4-e1de-4892-a3c5-e2d14a08a9c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:10.943773 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1611/3248] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:10 2022] DELETE /identity/v3/projects/8eb9678f8c2d42029a5dfe0f1bcae242 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:10.945787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fcc49-6131-4392-8e56-721708147b97 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:10.946762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fcc49-6131-4392-8e56-721708147b97 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:10.948406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6fcc49-6131-4392-8e56-721708147b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:10.998553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2a6fcc49-6131-4392-8e56-721708147b97 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:11.003500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a6fcc49-6131-4392-8e56-721708147b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:11.060855 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:11.143836 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1638/3249] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:11.152080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab5672-59e2-4216-a9ca-1757c66c63ad None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:11.152600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab5672-59e2-4216-a9ca-1757c66c63ad None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:11.152980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab5672-59e2-4216-a9ca-1757c66c63ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:11.206805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7bab5672-59e2-4216-a9ca-1757c66c63ad None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:11.209376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7bab5672-59e2-4216-a9ca-1757c66c63ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:11.223179 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1612/3250] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:11.228803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fcc49-6131-4392-8e56-721708147b97 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:11.266449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6fcc49-6131-4392-8e56-721708147b97 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:11.291794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9844d7-317a-4454-b2fa-577e2682b470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:11.293385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9844d7-317a-4454-b2fa-577e2682b470 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:11.294058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9844d7-317a-4454-b2fa-577e2682b470 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:11.294949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9844d7-317a-4454-b2fa-577e2682b470 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:11.295903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9844d7-317a-4454-b2fa-577e2682b470 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:03:11.296594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9844d7-317a-4454-b2fa-577e2682b470 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:11.298793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9844d7-317a-4454-b2fa-577e2682b470 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:11.323611 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1639/3251] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:03:11.327431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab5672-59e2-4216-a9ca-1757c66c63ad None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:11.339895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab5672-59e2-4216-a9ca-1757c66c63ad None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:11.349771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862bf72-13b1-4440-b6c6-c5711744aed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:11.350726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862bf72-13b1-4440-b6c6-c5711744aed3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:11.351244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862bf72-13b1-4440-b6c6-c5711744aed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:11.351633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7862bf72-13b1-4440-b6c6-c5711744aed3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:11.353602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862bf72-13b1-4440-b6c6-c5711744aed3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:11.356747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7862bf72-13b1-4440-b6c6-c5711744aed3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:11.421258 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1613/3252] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:11 2022] POST /identity/v3/projects => generated 399 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:11.423434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9844d7-317a-4454-b2fa-577e2682b470 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:11.448064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9844d7-317a-4454-b2fa-577e2682b470 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:11.675596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979784f-869f-415a-8bcb-25f72bb9d5de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:11.682961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979784f-869f-415a-8bcb-25f72bb9d5de admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:11.686498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979784f-869f-415a-8bcb-25f72bb9d5de admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:11.686813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979784f-869f-415a-8bcb-25f72bb9d5de admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:11.689839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979784f-869f-415a-8bcb-25f72bb9d5de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:11.692177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979784f-869f-415a-8bcb-25f72bb9d5de admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:11.755871 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1640/3253] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:11 2022] POST /identity/v3/users => generated 306 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:11.760195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862bf72-13b1-4440-b6c6-c5711744aed3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:11.775136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7862bf72-13b1-4440-b6c6-c5711744aed3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:11.790272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c900c-e38c-4775-b39a-e9f1cdfddc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:11.790898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c900c-e38c-4775-b39a-e9f1cdfddc0e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:11.791181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c900c-e38c-4775-b39a-e9f1cdfddc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:11.791454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c900c-e38c-4775-b39a-e9f1cdfddc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:11.792110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c900c-e38c-4775-b39a-e9f1cdfddc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:11.793777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c900c-e38c-4775-b39a-e9f1cdfddc0e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:11.811389 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1614/3254] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:11.816157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979784f-869f-415a-8bcb-25f72bb9d5de admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:11.827996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979784f-869f-415a-8bcb-25f72bb9d5de admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:11.833509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f7d9-8a5d-4711-8a9b-38f9cb65d325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:11.834507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f7d9-8a5d-4711-8a9b-38f9cb65d325 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:11.834859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f7d9-8a5d-4711-8a9b-38f9cb65d325 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:11.835205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a5f7d9-8a5d-4711-8a9b-38f9cb65d325 admin admin] PATH_INFO: `/v3/projects/4530afd94f844fabaac535729e718a14/users/7f165e03eb0b4c4b9c4497d012fada29/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:11.856087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5f7d9-8a5d-4711-8a9b-38f9cb65d325 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4530afd94f844fabaac535729e718a14, user_id=7f165e03eb0b4c4b9c4497d012fada29, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:11.858978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a5f7d9-8a5d-4711-8a9b-38f9cb65d325 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:11.886281 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1641/3255] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:11 2022] PUT /identity/v3/projects/4530afd94f844fabaac535729e718a14/users/7f165e03eb0b4c4b9c4497d012fada29/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:03:11.887225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c900c-e38c-4775-b39a-e9f1cdfddc0e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:11.900319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c900c-e38c-4775-b39a-e9f1cdfddc0e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:11.926924 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:11.985610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d4241-2e16-4e73-9b9e-2cb83f32a52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:11.986257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4241-2e16-4e73-9b9e-2cb83f32a52c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:11.986716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4241-2e16-4e73-9b9e-2cb83f32a52c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:11.987961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4241-2e16-4e73-9b9e-2cb83f32a52c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:11.988731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d4241-2e16-4e73-9b9e-2cb83f32a52c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:11.990973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d4241-2e16-4e73-9b9e-2cb83f32a52c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:12.011920 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1615/3256] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:12.016654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f7d9-8a5d-4711-8a9b-38f9cb65d325 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:12.029606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a5f7d9-8a5d-4711-8a9b-38f9cb65d325 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:12.036613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c2553-882e-4f26-b244-b6e71a87f27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:12.037707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c2553-882e-4f26-b244-b6e71a87f27b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:12.038053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c2553-882e-4f26-b244-b6e71a87f27b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:12.038543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c2553-882e-4f26-b244-b6e71a87f27b admin admin] PATH_INFO: `/v3/projects/4530afd94f844fabaac535729e718a14/users/7f165e03eb0b4c4b9c4497d012fada29/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:12.041144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c2553-882e-4f26-b244-b6e71a87f27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4530afd94f844fabaac535729e718a14, user_id=7f165e03eb0b4c4b9c4497d012fada29, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:12.044440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5c2553-882e-4f26-b244-b6e71a87f27b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:12.063880 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1642/3257] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:12 2022] PUT /identity/v3/projects/4530afd94f844fabaac535729e718a14/users/7f165e03eb0b4c4b9c4497d012fada29/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:12.075404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24afab3-f93d-45a6-b265-ba50aee26e25 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:12.075698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24afab3-f93d-45a6-b265-ba50aee26e25 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:12.075979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24afab3-f93d-45a6-b265-ba50aee26e25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:12.157964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d24afab3-f93d-45a6-b265-ba50aee26e25 None None] MFA Rules not processed for user `7f165e03eb0b4c4b9c4497d012fada29`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:12.160206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d24afab3-f93d-45a6-b265-ba50aee26e25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:12.335626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1616/3258] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:12 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:12.360266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c2553-882e-4f26-b244-b6e71a87f27b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:12.495946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5c2553-882e-4f26-b244-b6e71a87f27b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:12.512303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f222-1175-4fed-a9a0-463d108473b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:12.513554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f222-1175-4fed-a9a0-463d108473b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:12.514012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f222-1175-4fed-a9a0-463d108473b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:12.514342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3413f222-1175-4fed-a9a0-463d108473b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:12.514997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f222-1175-4fed-a9a0-463d108473b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:12.517426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3413f222-1175-4fed-a9a0-463d108473b4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:12.531070 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:12.582701 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1643/3259] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:12 2022] POST /identity/v3/projects => generated 397 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:12.584260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24afab3-f93d-45a6-b265-ba50aee26e25 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:12.598719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24afab3-f93d-45a6-b265-ba50aee26e25 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:12.764377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52414140-d44b-430d-95e3-12834daf26e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:12.765055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52414140-d44b-430d-95e3-12834daf26e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:12.765529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52414140-d44b-430d-95e3-12834daf26e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:12.765813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52414140-d44b-430d-95e3-12834daf26e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:12.766460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52414140-d44b-430d-95e3-12834daf26e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:12.769031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52414140-d44b-430d-95e3-12834daf26e8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:12.854717 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1617/3260] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:12 2022] POST /identity/v3/users => generated 299 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:12.859105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f222-1175-4fed-a9a0-463d108473b4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:12.882442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3413f222-1175-4fed-a9a0-463d108473b4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:12.910383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cf431-d360-4862-9b83-e70e73a8e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:12.911844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cf431-d360-4862-9b83-e70e73a8e852 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:12.912849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cf431-d360-4862-9b83-e70e73a8e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:12.913155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24cf431-d360-4862-9b83-e70e73a8e852 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:12.915647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cf431-d360-4862-9b83-e70e73a8e852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:12.921781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24cf431-d360-4862-9b83-e70e73a8e852 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:12.966597 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1644/3261] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:03:12.967992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52414140-d44b-430d-95e3-12834daf26e8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:12.987432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52414140-d44b-430d-95e3-12834daf26e8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:13.020906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4a07bb-7519-470c-aaa1-68772fff4d27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:13.022444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a07bb-7519-470c-aaa1-68772fff4d27 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:13.024293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a07bb-7519-470c-aaa1-68772fff4d27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:13.024681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4a07bb-7519-470c-aaa1-68772fff4d27 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:13.026232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a07bb-7519-470c-aaa1-68772fff4d27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:13.028288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd4a07bb-7519-470c-aaa1-68772fff4d27 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:13.062117 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1618/3262] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:12 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:13.062965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cf431-d360-4862-9b83-e70e73a8e852 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:13.077203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24cf431-d360-4862-9b83-e70e73a8e852 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:13.102089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345ea19-8137-46c6-ac6e-43de8a631dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:13.102827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ea19-8137-46c6-ac6e-43de8a631dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:13.103637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ea19-8137-46c6-ac6e-43de8a631dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:13.104178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0345ea19-8137-46c6-ac6e-43de8a631dd0 admin admin] PATH_INFO: `/v3/projects/be6d726c0c324baf9c9c4850c793d82d/users/8c7f15c8248048358e77074d68e4fe6b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:13.178425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345ea19-8137-46c6-ac6e-43de8a631dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be6d726c0c324baf9c9c4850c793d82d, user_id=8c7f15c8248048358e77074d68e4fe6b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:13.183497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0345ea19-8137-46c6-ac6e-43de8a631dd0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:13.223970 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1645/3263] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:13 2022] PUT /identity/v3/projects/be6d726c0c324baf9c9c4850c793d82d/users/8c7f15c8248048358e77074d68e4fe6b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:13.235219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88e029-6fd8-4069-a36d-55d7131f7472 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:13.235543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88e029-6fd8-4069-a36d-55d7131f7472 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:13.235788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88e029-6fd8-4069-a36d-55d7131f7472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:13.281335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4f88e029-6fd8-4069-a36d-55d7131f7472 None None] MFA Rules not processed for user `8c7f15c8248048358e77074d68e4fe6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:13.283639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4f88e029-6fd8-4069-a36d-55d7131f7472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:13.297981 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:13.437191 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1619/3264] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:13 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:13.449167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345ea19-8137-46c6-ac6e-43de8a631dd0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:13.451206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0345ea19-8137-46c6-ac6e-43de8a631dd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:13.566309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0345ea19-8137-46c6-ac6e-43de8a631dd0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:13.577326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06035c-e2a2-4260-9e7e-f401ac514612 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:13.579896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06035c-e2a2-4260-9e7e-f401ac514612 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:13.580190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06035c-e2a2-4260-9e7e-f401ac514612 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:13.580470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06035c-e2a2-4260-9e7e-f401ac514612 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:13.761075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06035c-e2a2-4260-9e7e-f401ac514612 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:13.763444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06035c-e2a2-4260-9e7e-f401ac514612 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:13.836312 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1646/3265] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:13 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:14.116006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88e029-6fd8-4069-a36d-55d7131f7472 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:14.118156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4f88e029-6fd8-4069-a36d-55d7131f7472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:14.285429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88e029-6fd8-4069-a36d-55d7131f7472 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:14.306879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:14.307733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:14.308022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:14.308315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] PATH_INFO: `/v3/users/0fd6766aed02437eb254480dba23f9db` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:14.318068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0fd6766aed02437eb254480dba23f9db)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:14.323331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:14.436585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0fd6766aed02437eb254480dba23f9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.456467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0fd6766aed02437eb254480dba23f9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.457331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0fd6766aed02437eb254480dba23f9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.468553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0fd6766aed02437eb254480dba23f9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.481645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0fd6766aed02437eb254480dba23f9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.495529 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1620/3266] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:14 2022] DELETE /identity/v3/users/0fd6766aed02437eb254480dba23f9db => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:14.500050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880d3c-480e-4efd-bf98-c8ddfff7ce52 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:14.500546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880d3c-480e-4efd-bf98-c8ddfff7ce52 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:14.500666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15880d3c-480e-4efd-bf98-c8ddfff7ce52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:14.540864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-15880d3c-480e-4efd-bf98-c8ddfff7ce52 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:14.542106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-15880d3c-480e-4efd-bf98-c8ddfff7ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:14.666133 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1647/3267] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:14.709453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:14.711004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:14.726949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2250d14-b64e-443a-85b2-1b54a1c02df7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:14.728738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880d3c-480e-4efd-bf98-c8ddfff7ce52 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:14.731312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-15880d3c-480e-4efd-bf98-c8ddfff7ce52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:14.732756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:14.733693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:14.733869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:14.734271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] PATH_INFO: `/v3/users/7f165e03eb0b4c4b9c4497d012fada29` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:14.735628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f165e03eb0b4c4b9c4497d012fada29)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:14.737713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:14.742086 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:14.778844 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:14.826906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f165e03eb0b4c4b9c4497d012fada29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.848858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f165e03eb0b4c4b9c4497d012fada29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.849999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f165e03eb0b4c4b9c4497d012fada29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.864061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f165e03eb0b4c4b9c4497d012fada29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.871731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15880d3c-480e-4efd-bf98-c8ddfff7ce52 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:14.878299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8d04edf5-46db-4827-8146-1abaaf578d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f165e03eb0b4c4b9c4497d012fada29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:14.880583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:14.882363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:14.883771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:14.884126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:14.888850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:14.894641 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1621/3268] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:14 2022] DELETE /identity/v3/users/7f165e03eb0b4c4b9c4497d012fada29 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:14.897039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef629586-0d63-41f1-b585-1d20412534a6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:14.897039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef629586-0d63-41f1-b585-1d20412534a6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:14.897449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef629586-0d63-41f1-b585-1d20412534a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:14.907899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:14.910859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:14.927079 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1648/3269] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:14.935595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ef629586-0d63-41f1-b585-1d20412534a6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:14.937055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ef629586-0d63-41f1-b585-1d20412534a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:15.029585 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1622/3270] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:15.079750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:15.082037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:15.100621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1cce2a-3ebb-4d0d-b5ec-d87c1166de74 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:15.244457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311d5516-2a1a-4f14-934d-972afabf5fe2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:15.245094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5516-2a1a-4f14-934d-972afabf5fe2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:15.245528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5516-2a1a-4f14-934d-972afabf5fe2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:15.245805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311d5516-2a1a-4f14-934d-972afabf5fe2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:15.262360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d5516-2a1a-4f14-934d-972afabf5fe2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:15.264432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311d5516-2a1a-4f14-934d-972afabf5fe2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:15.281663 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1649/3271] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:15.401631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef629586-0d63-41f1-b585-1d20412534a6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:15.403725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ef629586-0d63-41f1-b585-1d20412534a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:15.421077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef629586-0d63-41f1-b585-1d20412534a6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:15.429947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:15.430204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:15.430717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:15.430932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] PATH_INFO: `/v3/projects/72bbfc5e1e574b689ef044341663b776` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:15.432788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=72bbfc5e1e574b689ef044341663b776)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:15.439562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:15.549973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72bbfc5e1e574b689ef044341663b776', 'request_id': 'req-42566e6f-046c-421b-a0b0-eed9528b00ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:15.559674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72bbfc5e1e574b689ef044341663b776', 'request_id': 'req-42566e6f-046c-421b-a0b0-eed9528b00ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:15.586817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72bbfc5e1e574b689ef044341663b776', 'request_id': 'req-42566e6f-046c-421b-a0b0-eed9528b00ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:15.599113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9fe0a-6be7-437c-9389-e1a1f8d68b08 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:15.599570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9fe0a-6be7-437c-9389-e1a1f8d68b08 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:15.599757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a9fe0a-6be7-437c-9389-e1a1f8d68b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:15.616699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] The token cache is being invalidate because project 72bbfc5e1e574b689ef044341663b776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:15.617102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:15.617764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:15.625557 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1623/3272] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:15 2022] DELETE /identity/v3/projects/72bbfc5e1e574b689ef044341663b776 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:15.626969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:15.629282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:15.683926 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:15.711783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c0a9fe0a-6be7-437c-9389-e1a1f8d68b08 None None] MFA Rules not processed for user `0faa202378cf499581a14f05c7cfa9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:15.717026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c0a9fe0a-6be7-437c-9389-e1a1f8d68b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:15.781844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42566e6f-046c-421b-a0b0-eed9528b00ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:15.823436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:15.826475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:15.826774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:15.827896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] PATH_INFO: `/v3/users/5bf6db6e2b53482cb4a38b1319ba971f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:15.835958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf6db6e2b53482cb4a38b1319ba971f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:15.841517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:15.983413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1650/3273] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:15.984435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf6db6e2b53482cb4a38b1319ba971f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.007011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf6db6e2b53482cb4a38b1319ba971f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.008012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf6db6e2b53482cb4a38b1319ba971f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.018797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf6db6e2b53482cb4a38b1319ba971f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.029278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf6db6e2b53482cb4a38b1319ba971f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.038043 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1624/3274] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:15 2022] DELETE /identity/v3/users/5bf6db6e2b53482cb4a38b1319ba971f => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:16.334287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9fe0a-6be7-437c-9389-e1a1f8d68b08 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:16.338315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c0a9fe0a-6be7-437c-9389-e1a1f8d68b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:16.415196 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:16.545703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:16.546210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a9fe0a-6be7-437c-9389-e1a1f8d68b08 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:16.547147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:16.698441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c3c999-8acc-4994-bed7-a53cb021dedd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:16.703494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:16.704530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:16.705026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:16.705755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] PATH_INFO: `/v3/projects/4530afd94f844fabaac535729e718a14` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:16.708008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=4530afd94f844fabaac535729e718a14)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:16.709892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:16.710523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:16.710806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:16.711082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:16.711501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:16.712912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:16.787726 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:16.794083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4530afd94f844fabaac535729e718a14', 'request_id': 'req-49e5a36a-8b4f-4931-a6f1-3114121898ee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.828854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4530afd94f844fabaac535729e718a14', 'request_id': 'req-49e5a36a-8b4f-4931-a6f1-3114121898ee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.833487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:16.836708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:16.854123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4530afd94f844fabaac535729e718a14', 'request_id': 'req-49e5a36a-8b4f-4931-a6f1-3114121898ee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.866885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1651/3275] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:16.867812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:16.871090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:16.873125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] The token cache is being invalidate because project 4530afd94f844fabaac535729e718a14 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:16.874026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.876026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:16.877364 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1625/3276] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:16 2022] DELETE /identity/v3/projects/4530afd94f844fabaac535729e718a14 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:16.881091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:16.887366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:16.911433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893e3baa-5fa7-4863-8583-65081e67b808 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:17.034926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e5a36a-8b4f-4931-a6f1-3114121898ee admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:17.048896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:17.052079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:17.052079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:17.053376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] PATH_INFO: `/v3/projects/3044fc3726124c13980277eda94bbd3e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:17.055934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:17.056478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:17.057485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3044fc3726124c13980277eda94bbd3e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:17.057914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:17.059886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] PATH_INFO: `/v3/users/8c7f15c8248048358e77074d68e4fe6b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:17.060586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:17.062541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8c7f15c8248048358e77074d68e4fe6b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:17.067166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:17.119157 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:17.193840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3044fc3726124c13980277eda94bbd3e', 'request_id': 'req-558dafca-5196-4454-9b42-76dac85124d0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.201434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8c7f15c8248048358e77074d68e4fe6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.208994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3044fc3726124c13980277eda94bbd3e', 'request_id': 'req-558dafca-5196-4454-9b42-76dac85124d0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.226739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3044fc3726124c13980277eda94bbd3e', 'request_id': 'req-558dafca-5196-4454-9b42-76dac85124d0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.237507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8c7f15c8248048358e77074d68e4fe6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.240132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8c7f15c8248048358e77074d68e4fe6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.254954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] The token cache is being invalidate because project 3044fc3726124c13980277eda94bbd3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:17.255203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.255892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-558dafca-5196-4454-9b42-76dac85124d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.261571 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1652/3277] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:16 2022] DELETE /identity/v3/projects/3044fc3726124c13980277eda94bbd3e => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:17.269424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5757-5e5d-4532-a1ae-15651d4eac9d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:17.269874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8c7f15c8248048358e77074d68e4fe6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.270544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5757-5e5d-4532-a1ae-15651d4eac9d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:17.272055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f5757-5e5d-4532-a1ae-15651d4eac9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:17.285008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e1e8b5e-5583-42c6-9f03-fc287bd1a2e6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8c7f15c8248048358e77074d68e4fe6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:17.297176 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1626/3278] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:16 2022] DELETE /identity/v3/users/8c7f15c8248048358e77074d68e4fe6b => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:17.314241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e52f5757-5e5d-4532-a1ae-15651d4eac9d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:17.315543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e52f5757-5e5d-4532-a1ae-15651d4eac9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:17.408227 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1653/3279] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:17.418476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609a11-d7af-4b76-938e-39478f561007 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:17.419069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609a11-d7af-4b76-938e-39478f561007 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:17.419521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa609a11-d7af-4b76-938e-39478f561007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:17.466942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-aa609a11-d7af-4b76-938e-39478f561007 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:17.468197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aa609a11-d7af-4b76-938e-39478f561007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:17.490627 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1627/3280] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:17.492432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f5757-5e5d-4532-a1ae-15651d4eac9d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:17.513046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f5757-5e5d-4532-a1ae-15651d4eac9d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:17.527904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acd2c9-2e79-4e38-a9f6-fb66341d7d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:17.530051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acd2c9-2e79-4e38-a9f6-fb66341d7d5b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:17.530412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acd2c9-2e79-4e38-a9f6-fb66341d7d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:17.531701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acd2c9-2e79-4e38-a9f6-fb66341d7d5b admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:17.533032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acd2c9-2e79-4e38-a9f6-fb66341d7d5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:03:17.535200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acd2c9-2e79-4e38-a9f6-fb66341d7d5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:17.539932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acd2c9-2e79-4e38-a9f6-fb66341d7d5b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:17.586474 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1654/3281] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:03:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:03:17.587890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609a11-d7af-4b76-938e-39478f561007 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:17.609979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa609a11-d7af-4b76-938e-39478f561007 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:17.615654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93252e8-f71c-4f86-a5ef-a4d25bda90aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:17.616273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93252e8-f71c-4f86-a5ef-a4d25bda90aa admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:17.616555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93252e8-f71c-4f86-a5ef-a4d25bda90aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:17.616833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93252e8-f71c-4f86-a5ef-a4d25bda90aa admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:17.617503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93252e8-f71c-4f86-a5ef-a4d25bda90aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:17.619430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93252e8-f71c-4f86-a5ef-a4d25bda90aa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:17.684902 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1628/3282] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:17 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:17.689028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acd2c9-2e79-4e38-a9f6-fb66341d7d5b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:17.708439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acd2c9-2e79-4e38-a9f6-fb66341d7d5b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:17.873263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdc0ae-5b6d-4179-a512-01c017ef21ea None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:17.873581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdc0ae-5b6d-4179-a512-01c017ef21ea None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:17.873857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2bdc0ae-5b6d-4179-a512-01c017ef21ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:17.914418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a2bdc0ae-5b6d-4179-a512-01c017ef21ea None None] MFA Rules not processed for user `0faa202378cf499581a14f05c7cfa9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:17.915653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a2bdc0ae-5b6d-4179-a512-01c017ef21ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:17.928592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2563c22-f975-44fb-ae90-f201e36fed3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:17.929151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563c22-f975-44fb-ae90-f201e36fed3f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:17.929830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563c22-f975-44fb-ae90-f201e36fed3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:17.929830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2563c22-f975-44fb-ae90-f201e36fed3f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:17.931563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2563c22-f975-44fb-ae90-f201e36fed3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:17.938644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2563c22-f975-44fb-ae90-f201e36fed3f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:17.964399 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:17.989173 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1655/3283] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:17 2022] POST /identity/v3/users => generated 292 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:03:17.993037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2563c22-f975-44fb-ae90-f201e36fed3f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:18.012995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2563c22-f975-44fb-ae90-f201e36fed3f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:18.031421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f72e6-90b9-4c9e-b789-b089a0baebea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:18.032138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f72e6-90b9-4c9e-b789-b089a0baebea admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:18.032494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f72e6-90b9-4c9e-b789-b089a0baebea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:18.033006 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1629/3284] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:17 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:18.037408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249f72e6-90b9-4c9e-b789-b089a0baebea admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:18.038477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f72e6-90b9-4c9e-b789-b089a0baebea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:18.040198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249f72e6-90b9-4c9e-b789-b089a0baebea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:18.065795 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1656/3285] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:17 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:18.069778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdc0ae-5b6d-4179-a512-01c017ef21ea None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:18.091790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2bdc0ae-5b6d-4179-a512-01c017ef21ea None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:18.107031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d77fff-9716-4368-89c0-ec9d9580efd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:18.107944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77fff-9716-4368-89c0-ec9d9580efd7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:18.108453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77fff-9716-4368-89c0-ec9d9580efd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:18.108956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d77fff-9716-4368-89c0-ec9d9580efd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:18.109899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d77fff-9716-4368-89c0-ec9d9580efd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:18.112483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d77fff-9716-4368-89c0-ec9d9580efd7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:18.125204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1630/3286] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:18.129740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f72e6-90b9-4c9e-b789-b089a0baebea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:18.151292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249f72e6-90b9-4c9e-b789-b089a0baebea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:18.163894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa775be-364a-49f4-93d0-fe8aa0ecff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:18.165617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa775be-364a-49f4-93d0-fe8aa0ecff69 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:18.166236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa775be-364a-49f4-93d0-fe8aa0ecff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:18.166757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa775be-364a-49f4-93d0-fe8aa0ecff69 admin admin] PATH_INFO: `/v3/projects/8469ec38031e46da9bfde167e0b6da15/users/e20476ff91b34c24b84e67e4416b13b0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:18.173578 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:18.213346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa775be-364a-49f4-93d0-fe8aa0ecff69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8469ec38031e46da9bfde167e0b6da15, user_id=e20476ff91b34c24b84e67e4416b13b0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:18.217013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa775be-364a-49f4-93d0-fe8aa0ecff69 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:18.250124 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1657/3287] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:18 2022] PUT /identity/v3/projects/8469ec38031e46da9bfde167e0b6da15/users/e20476ff91b34c24b84e67e4416b13b0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:03:18.269018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f2772-8670-4af9-ae4f-60a21ae8ad0b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:18.269733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f2772-8670-4af9-ae4f-60a21ae8ad0b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:18.270047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266f2772-8670-4af9-ae4f-60a21ae8ad0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:18.316329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-266f2772-8670-4af9-ae4f-60a21ae8ad0b None None] MFA Rules not processed for user `e20476ff91b34c24b84e67e4416b13b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:18.317666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-266f2772-8670-4af9-ae4f-60a21ae8ad0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:18.444693 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1631/3288] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:18.449146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa775be-364a-49f4-93d0-fe8aa0ecff69 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:18.548957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa775be-364a-49f4-93d0-fe8aa0ecff69 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:18.556143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b57bbf-25ef-45a9-8727-e876ae1f4472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:18.578721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b57bbf-25ef-45a9-8727-e876ae1f4472 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:18.579125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b57bbf-25ef-45a9-8727-e876ae1f4472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:18.579407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b57bbf-25ef-45a9-8727-e876ae1f4472 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:18.580110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b57bbf-25ef-45a9-8727-e876ae1f4472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:18.605877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b57bbf-25ef-45a9-8727-e876ae1f4472 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:18.656166 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1658/3289] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:18 2022] POST /identity/v3/projects => generated 381 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:18.659933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f2772-8670-4af9-ae4f-60a21ae8ad0b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:18.694803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266f2772-8670-4af9-ae4f-60a21ae8ad0b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:18.711692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b57bbf-25ef-45a9-8727-e876ae1f4472 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:18.713847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-59b57bbf-25ef-45a9-8727-e876ae1f4472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:18.793154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19193dd2-3ef5-4615-b283-112ff305b198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:18.794438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19193dd2-3ef5-4615-b283-112ff305b198 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:18.794734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19193dd2-3ef5-4615-b283-112ff305b198 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:18.795198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19193dd2-3ef5-4615-b283-112ff305b198 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:18.795985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19193dd2-3ef5-4615-b283-112ff305b198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:18.797984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19193dd2-3ef5-4615-b283-112ff305b198 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:18.849077 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1632/3290] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:18 2022] POST /identity/v3/users => generated 297 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:18.854469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b57bbf-25ef-45a9-8727-e876ae1f4472 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:18.866221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19193dd2-3ef5-4615-b283-112ff305b198 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:18.874346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:18.875322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:18.875601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:18.875875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] PATH_INFO: `/v3/projects/be6d726c0c324baf9c9c4850c793d82d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:18.879734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be6d726c0c324baf9c9c4850c793d82d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:18.886064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:18.899732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19193dd2-3ef5-4615-b283-112ff305b198 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:18.911602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0afa-e5f2-4f70-8712-f130cc8b1b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:18.915176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0afa-e5f2-4f70-8712-f130cc8b1b23 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:18.915469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0afa-e5f2-4f70-8712-f130cc8b1b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:18.916183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599c0afa-e5f2-4f70-8712-f130cc8b1b23 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:18.917719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0afa-e5f2-4f70-8712-f130cc8b1b23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:18.923207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599c0afa-e5f2-4f70-8712-f130cc8b1b23 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:18.954865 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1633/3291] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:18 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:18.958656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0afa-e5f2-4f70-8712-f130cc8b1b23 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:18.983856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599c0afa-e5f2-4f70-8712-f130cc8b1b23 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:19.020699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be6d726c0c324baf9c9c4850c793d82d', 'request_id': 'req-025fc576-46f0-4e20-afc3-b76f7b762f91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:19.038437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be6d726c0c324baf9c9c4850c793d82d', 'request_id': 'req-025fc576-46f0-4e20-afc3-b76f7b762f91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:19.045974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be6d726c0c324baf9c9c4850c793d82d', 'request_id': 'req-025fc576-46f0-4e20-afc3-b76f7b762f91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:19.048222 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:19.077798 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:19.088731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] The token cache is being invalidate because project be6d726c0c324baf9c9c4850c793d82d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:19.089141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:19.090545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-025fc576-46f0-4e20-afc3-b76f7b762f91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:19.099160 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1659/3292] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:18 2022] DELETE /identity/v3/projects/be6d726c0c324baf9c9c4850c793d82d => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:03:19.105440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcbf03-935d-4638-97bf-842df9d80b13 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.105985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcbf03-935d-4638-97bf-842df9d80b13 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.106600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcbf03-935d-4638-97bf-842df9d80b13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.134232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-88bcbf03-935d-4638-97bf-842df9d80b13 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:19.136411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-88bcbf03-935d-4638-97bf-842df9d80b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:19.160782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99f99-696a-49c5-886b-09444dd27b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:19.161918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99f99-696a-49c5-886b-09444dd27b95 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.162375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99f99-696a-49c5-886b-09444dd27b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.162806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb99f99-696a-49c5-886b-09444dd27b95 admin admin] PATH_INFO: `/v3/projects/ad9fe920d6ea4a66aed938397bb4a4f3/users/aafa32b8c12044e496f673e68dbff91e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.186551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb99f99-696a-49c5-886b-09444dd27b95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9fe920d6ea4a66aed938397bb4a4f3, user_id=aafa32b8c12044e496f673e68dbff91e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:19.191129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb99f99-696a-49c5-886b-09444dd27b95 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:19.219387 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1634/3293] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:18 2022] PUT /identity/v3/projects/ad9fe920d6ea4a66aed938397bb4a4f3/users/aafa32b8c12044e496f673e68dbff91e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:19.220391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99f99-696a-49c5-886b-09444dd27b95 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:19.235745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8eb99f99-696a-49c5-886b-09444dd27b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:19.300664 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1660/3294] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:19.312719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe0c2e-7a4d-4253-b4a3-f60a54955a79 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.313643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe0c2e-7a4d-4253-b4a3-f60a54955a79 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.313928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe0c2e-7a4d-4253-b4a3-f60a54955a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.336883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb99f99-696a-49c5-886b-09444dd27b95 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:19.344559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d870c-b950-47ce-9f51-7ce763366308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:19.345521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d870c-b950-47ce-9f51-7ce763366308 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.345952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d870c-b950-47ce-9f51-7ce763366308 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.346917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828d870c-b950-47ce-9f51-7ce763366308 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.347586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d870c-b950-47ce-9f51-7ce763366308 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:19.349714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828d870c-b950-47ce-9f51-7ce763366308 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:19.370058 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1635/3295] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:19.371147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d870c-b950-47ce-9f51-7ce763366308 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:19.378859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8bfe0c2e-7a4d-4253-b4a3-f60a54955a79 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:19.380733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8bfe0c2e-7a4d-4253-b4a3-f60a54955a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:19.385010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828d870c-b950-47ce-9f51-7ce763366308 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:19.390484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c3d073-09c5-4acd-84e8-9903e1b94031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:19.391258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d073-09c5-4acd-84e8-9903e1b94031 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.391554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d073-09c5-4acd-84e8-9903e1b94031 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.391832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c3d073-09c5-4acd-84e8-9903e1b94031 admin admin] PATH_INFO: `/v3/projects/ad9fe920d6ea4a66aed938397bb4a4f3/users/aafa32b8c12044e496f673e68dbff91e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.395340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d073-09c5-4acd-84e8-9903e1b94031 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9fe920d6ea4a66aed938397bb4a4f3, user_id=aafa32b8c12044e496f673e68dbff91e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:19.396655 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1661/3296] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:19.399776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c3d073-09c5-4acd-84e8-9903e1b94031 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:19.412062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe0c2e-7a4d-4253-b4a3-f60a54955a79 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:19.415033 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1636/3297] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:19 2022] PUT /identity/v3/projects/ad9fe920d6ea4a66aed938397bb4a4f3/users/aafa32b8c12044e496f673e68dbff91e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:19.427679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ddbeb-a6a9-473c-8ecf-1c95da49c97e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.428080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ddbeb-a6a9-473c-8ecf-1c95da49c97e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.428463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5ddbeb-a6a9-473c-8ecf-1c95da49c97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.443309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe0c2e-7a4d-4253-b4a3-f60a54955a79 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:19.475366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2d5ddbeb-a6a9-473c-8ecf-1c95da49c97e None None] MFA Rules not processed for user `aafa32b8c12044e496f673e68dbff91e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:19.479532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2d5ddbeb-a6a9-473c-8ecf-1c95da49c97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:19.564828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd74092-46c3-4979-a128-f0545afb3758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:19.565743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd74092-46c3-4979-a128-f0545afb3758 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.566254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd74092-46c3-4979-a128-f0545afb3758 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.567793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd74092-46c3-4979-a128-f0545afb3758 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.568606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd74092-46c3-4979-a128-f0545afb3758 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:03:19.569010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd74092-46c3-4979-a128-f0545afb3758 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:19.570961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd74092-46c3-4979-a128-f0545afb3758 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:19.616354 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1662/3298] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:03:19.618677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd74092-46c3-4979-a128-f0545afb3758 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:19.649074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd74092-46c3-4979-a128-f0545afb3758 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:19.668304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa07f6-e927-432d-8d16-4be23183a2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:19.668304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa07f6-e927-432d-8d16-4be23183a2a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.668304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa07f6-e927-432d-8d16-4be23183a2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.672648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fa07f6-e927-432d-8d16-4be23183a2a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.673517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa07f6-e927-432d-8d16-4be23183a2a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:19.679549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fa07f6-e927-432d-8d16-4be23183a2a9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:19.682882 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1637/3299] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:19.694092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f6be-54ee-4f04-ad9d-97da3d6abf64 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.694525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f6be-54ee-4f04-ad9d-97da3d6abf64 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.694816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2f6be-54ee-4f04-ad9d-97da3d6abf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.744975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6be2f6be-54ee-4f04-ad9d-97da3d6abf64 None None] MFA Rules not processed for user `e20476ff91b34c24b84e67e4416b13b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:19.750252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6be2f6be-54ee-4f04-ad9d-97da3d6abf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:19.768214 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1663/3300] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:19 2022] POST /identity/v3/projects => generated 369 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:19.770196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa07f6-e927-432d-8d16-4be23183a2a9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:19.789164 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:19.880056 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1638/3301] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:19.940135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fa07f6-e927-432d-8d16-4be23183a2a9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:19.947245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b172-4c82-4418-adec-7df40f479dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:19.947963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b172-4c82-4418-adec-7df40f479dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:19.948315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b172-4c82-4418-adec-7df40f479dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:19.948664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d9b172-4c82-4418-adec-7df40f479dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:19.949506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b172-4c82-4418-adec-7df40f479dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:19.951798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d9b172-4c82-4418-adec-7df40f479dc0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:19.965668 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:19.988360 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1664/3302] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:19 2022] POST /identity/v3/users => generated 285 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:03:19.989453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2f6be-54ee-4f04-ad9d-97da3d6abf64 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:20.015554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2f6be-54ee-4f04-ad9d-97da3d6abf64 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:20.027884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ced73-7471-4bc8-b244-d401dd5afbc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:20.028543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ced73-7471-4bc8-b244-d401dd5afbc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:20.028823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ced73-7471-4bc8-b244-d401dd5afbc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:20.029098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4ced73-7471-4bc8-b244-d401dd5afbc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:20.032535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ced73-7471-4bc8-b244-d401dd5afbc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:20.036767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4ced73-7471-4bc8-b244-d401dd5afbc9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:20.081370 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1639/3303] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:19 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:20.085623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b172-4c82-4418-adec-7df40f479dc0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:20.111752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d9b172-4c82-4418-adec-7df40f479dc0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:20.119017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9265d744-9302-473e-819a-9b5ca6c51d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:20.120005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265d744-9302-473e-819a-9b5ca6c51d57 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:20.120535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265d744-9302-473e-819a-9b5ca6c51d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:20.120925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9265d744-9302-473e-819a-9b5ca6c51d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:20.121923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265d744-9302-473e-819a-9b5ca6c51d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:20.123694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9265d744-9302-473e-819a-9b5ca6c51d57 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:20.154734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ced73-7471-4bc8-b244-d401dd5afbc9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:20.155015 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1665/3304] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:20.169538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4ced73-7471-4bc8-b244-d401dd5afbc9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:20.185197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a314-e0e0-458f-b133-a6167c353646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:20.189454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a314-e0e0-458f-b133-a6167c353646 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:20.189621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a314-e0e0-458f-b133-a6167c353646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:20.191299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447a314-e0e0-458f-b133-a6167c353646 admin admin] PATH_INFO: `/v3/projects/fbddac8b537e49db84cbee3197ce5aae/users/4ac9d881ea62484fa4e65b676b5c1760/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:20.227451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447a314-e0e0-458f-b133-a6167c353646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbddac8b537e49db84cbee3197ce5aae, user_id=4ac9d881ea62484fa4e65b676b5c1760, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:20.232217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447a314-e0e0-458f-b133-a6167c353646 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:20.293322 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1640/3305] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:20 2022] PUT /identity/v3/projects/fbddac8b537e49db84cbee3197ce5aae/users/4ac9d881ea62484fa4e65b676b5c1760/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:03:20.314460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372f4a3-7277-460a-a9ce-e0035610f62e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:20.314755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372f4a3-7277-460a-a9ce-e0035610f62e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:20.315165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5372f4a3-7277-460a-a9ce-e0035610f62e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:20.376286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5372f4a3-7277-460a-a9ce-e0035610f62e None None] MFA Rules not processed for user `4ac9d881ea62484fa4e65b676b5c1760`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:20.378049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5372f4a3-7277-460a-a9ce-e0035610f62e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:20.544890 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1666/3306] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:20 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:20.550044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a314-e0e0-458f-b133-a6167c353646 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:20.662385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447a314-e0e0-458f-b133-a6167c353646 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:20.667260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69ce0c-69dd-4218-a58a-19e19f53e08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:20.667883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69ce0c-69dd-4218-a58a-19e19f53e08d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:20.668164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69ce0c-69dd-4218-a58a-19e19f53e08d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:20.668439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d69ce0c-69dd-4218-a58a-19e19f53e08d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:20.669121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69ce0c-69dd-4218-a58a-19e19f53e08d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:20.671047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d69ce0c-69dd-4218-a58a-19e19f53e08d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:20.720236 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1641/3307] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:20 2022] POST /identity/v3/projects => generated 367 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:03:20.724593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372f4a3-7277-460a-a9ce-e0035610f62e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:20.742317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5372f4a3-7277-460a-a9ce-e0035610f62e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:20.765081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69ce0c-69dd-4218-a58a-19e19f53e08d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:20.767728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7d69ce0c-69dd-4218-a58a-19e19f53e08d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:20.913809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6b03a-a8bb-42d0-ac10-febe9af42bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:20.915341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6b03a-a8bb-42d0-ac10-febe9af42bda admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:20.915644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6b03a-a8bb-42d0-ac10-febe9af42bda admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:20.917243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e6b03a-a8bb-42d0-ac10-febe9af42bda admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:20.921721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6b03a-a8bb-42d0-ac10-febe9af42bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:20.926505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e6b03a-a8bb-42d0-ac10-febe9af42bda admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:20.974596 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1667/3308] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:20 2022] POST /identity/v3/users => generated 284 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:20.978693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6b03a-a8bb-42d0-ac10-febe9af42bda admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:20.979362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d69ce0c-69dd-4218-a58a-19e19f53e08d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:20.998093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e6b03a-a8bb-42d0-ac10-febe9af42bda admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:21.004883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45cff1-5616-4c8a-b4f4-087c0705beca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:21.005680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45cff1-5616-4c8a-b4f4-087c0705beca admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:21.005969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45cff1-5616-4c8a-b4f4-087c0705beca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:21.006243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45cff1-5616-4c8a-b4f4-087c0705beca admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:21.006892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45cff1-5616-4c8a-b4f4-087c0705beca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:21.008513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a45cff1-5616-4c8a-b4f4-087c0705beca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:21.016286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920e2bf-829a-41c2-a79a-98e968436612 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:21.016843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920e2bf-829a-41c2-a79a-98e968436612 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:21.020319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920e2bf-829a-41c2-a79a-98e968436612 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:21.020647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920e2bf-829a-41c2-a79a-98e968436612 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:21.020766 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1668/3309] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:21.025391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1920e2bf-829a-41c2-a79a-98e968436612 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:21.026388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45cff1-5616-4c8a-b4f4-087c0705beca admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:21.039519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45cff1-5616-4c8a-b4f4-087c0705beca admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:21.045139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9d52c-a354-45c2-a265-2122b405b8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:21.045962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9d52c-a354-45c2-a265-2122b405b8a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:21.046251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9d52c-a354-45c2-a265-2122b405b8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:21.046530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9d52c-a354-45c2-a265-2122b405b8a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:21.047177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9d52c-a354-45c2-a265-2122b405b8a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:21.048927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9d52c-a354-45c2-a265-2122b405b8a7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:21.052838 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:21.070397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1669/3310] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:21.072895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9d52c-a354-45c2-a265-2122b405b8a7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:21.114036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9d52c-a354-45c2-a265-2122b405b8a7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:21.131315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f7249-c56f-4aa7-a81d-a0a23ce77a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:21.134117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f7249-c56f-4aa7-a81d-a0a23ce77a7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:21.135559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f7249-c56f-4aa7-a81d-a0a23ce77a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:21.137447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04f7249-c56f-4aa7-a81d-a0a23ce77a7b admin admin] PATH_INFO: `/v3/projects/8a92e23d05634434b828e3129cf81aa8/users/b792c96dfab742a9bd2234ce15528729/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:21.182635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920e2bf-829a-41c2-a79a-98e968436612 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:21.184249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920e2bf-829a-41c2-a79a-98e968436612 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:21.191534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f7249-c56f-4aa7-a81d-a0a23ce77a7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a92e23d05634434b828e3129cf81aa8, user_id=b792c96dfab742a9bd2234ce15528729, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:21.194833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04f7249-c56f-4aa7-a81d-a0a23ce77a7b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:21.198127 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1642/3311] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:21.216500 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1670/3312] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:21 2022] PUT /identity/v3/projects/8a92e23d05634434b828e3129cf81aa8/users/b792c96dfab742a9bd2234ce15528729/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:21.311053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48891160-b973-4082-8c9b-ef0f64d90fd8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:21.311202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48891160-b973-4082-8c9b-ef0f64d90fd8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:21.311736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48891160-b973-4082-8c9b-ef0f64d90fd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:21.349974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-48891160-b973-4082-8c9b-ef0f64d90fd8 None None] MFA Rules not processed for user `b792c96dfab742a9bd2234ce15528729`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:21.351287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-48891160-b973-4082-8c9b-ef0f64d90fd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:21.465022 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1643/3313] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:21.481754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f7249-c56f-4aa7-a81d-a0a23ce77a7b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:21.484896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e04f7249-c56f-4aa7-a81d-a0a23ce77a7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:21.534092 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:21.599784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04f7249-c56f-4aa7-a81d-a0a23ce77a7b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:21.604764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2518b-d2a7-4bb2-8211-46acad02ee06 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:21.605476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2518b-d2a7-4bb2-8211-46acad02ee06 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:21.605761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2518b-d2a7-4bb2-8211-46acad02ee06 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:21.606036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d2518b-d2a7-4bb2-8211-46acad02ee06 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:21.729481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2518b-d2a7-4bb2-8211-46acad02ee06 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:21.731645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d2518b-d2a7-4bb2-8211-46acad02ee06 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:21.749567 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1671/3314] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:21 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:21.977099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48891160-b973-4082-8c9b-ef0f64d90fd8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:21.989574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48891160-b973-4082-8c9b-ef0f64d90fd8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:21.994018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c089a-1351-440c-855c-12719a9a54b5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:21.994747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c089a-1351-440c-855c-12719a9a54b5 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:21.995133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c089a-1351-440c-855c-12719a9a54b5 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:21.995557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90c089a-1351-440c-855c-12719a9a54b5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:22.007318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c089a-1351-440c-855c-12719a9a54b5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:22.008760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90c089a-1351-440c-855c-12719a9a54b5 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:22.023933 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1644/3315] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:21 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:23.864753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2518b-d2a7-4bb2-8211-46acad02ee06 service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:23.866437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37d2518b-d2a7-4bb2-8211-46acad02ee06 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:23.956203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d2518b-d2a7-4bb2-8211-46acad02ee06 service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:23.964075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca94f43-c89d-4d47-8ece-11d5a114d5f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:23.965489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94f43-c89d-4d47-8ece-11d5a114d5f5 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:23.965929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94f43-c89d-4d47-8ece-11d5a114d5f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:23.966414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca94f43-c89d-4d47-8ece-11d5a114d5f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:23.968603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6ca94f43-c89d-4d47-8ece-11d5a114d5f5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:24.009233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c089a-1351-440c-855c-12719a9a54b5 service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:24.052471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca94f43-c89d-4d47-8ece-11d5a114d5f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:24.054138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca94f43-c89d-4d47-8ece-11d5a114d5f5 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:24.065997 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1672/3316] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:24.136687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90c089a-1351-440c-855c-12719a9a54b5 service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:24.151844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:24.152710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:24.153161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:24.153617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] PATH_INFO: `/v3/users/4ac9d881ea62484fa4e65b676b5c1760` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:24.156664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ac9d881ea62484fa4e65b676b5c1760)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:24.158943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:24.206292 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:24.241346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ac9d881ea62484fa4e65b676b5c1760'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:24.271100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ac9d881ea62484fa4e65b676b5c1760'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:24.272243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ac9d881ea62484fa4e65b676b5c1760'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:24.284980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ac9d881ea62484fa4e65b676b5c1760'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:24.295869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ac9d881ea62484fa4e65b676b5c1760'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:24.313699 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1645/3317] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:24 2022] DELETE /identity/v3/users/4ac9d881ea62484fa4e65b676b5c1760 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:24.315430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09024-72e9-4479-a48d-0b7a1dae3a96 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:24.316534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09024-72e9-4479-a48d-0b7a1dae3a96 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:24.317007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade09024-72e9-4479-a48d-0b7a1dae3a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:24.327577 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:24.342832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ade09024-72e9-4479-a48d-0b7a1dae3a96 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:24.344344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ade09024-72e9-4479-a48d-0b7a1dae3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:24.431129 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1673/3318] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:24.440785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:24.442532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:24.523216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7701152f-467c-422d-b2cc-35063430c193 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:24.527218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f7d6c-f485-4ebf-8919-e99faaeec2b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:24.528408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f7d6c-f485-4ebf-8919-e99faaeec2b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:24.528687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f7d6c-f485-4ebf-8919-e99faaeec2b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:24.528958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f7d6c-f485-4ebf-8919-e99faaeec2b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:24.558912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f7d6c-f485-4ebf-8919-e99faaeec2b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:24.558912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f7d6c-f485-4ebf-8919-e99faaeec2b9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:24.572526 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1646/3319] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:24.757639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade09024-72e9-4479-a48d-0b7a1dae3a96 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:24.759089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ade09024-72e9-4479-a48d-0b7a1dae3a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:24.845024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade09024-72e9-4479-a48d-0b7a1dae3a96 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:24.857044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:24.857624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:24.857916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:24.858189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:24.870985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:24.890612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:24.894220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:24.918244 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1674/3320] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:25.224805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f7d6c-f485-4ebf-8919-e99faaeec2b9 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:25.226828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a74f7d6c-f485-4ebf-8919-e99faaeec2b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:25.254660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f7d6c-f485-4ebf-8919-e99faaeec2b9 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:25.265827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:25.266480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:25.269522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:25.270109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] PATH_INFO: `/v3/projects/fbddac8b537e49db84cbee3197ce5aae` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:25.273433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbddac8b537e49db84cbee3197ce5aae)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:25.276398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:25.296728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:25.298243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:25.336035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2606d-d552-4ae0-b2be-521d6458ee53 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:25.342478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:25.343830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:25.344194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:25.344570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:25.356072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:25.360072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbddac8b537e49db84cbee3197ce5aae', 'request_id': 'req-04fec777-6b89-4fdd-9177-8ef1295ed6c4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.371362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:25.372136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbddac8b537e49db84cbee3197ce5aae', 'request_id': 'req-04fec777-6b89-4fdd-9177-8ef1295ed6c4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.372986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:25.382788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbddac8b537e49db84cbee3197ce5aae', 'request_id': 'req-04fec777-6b89-4fdd-9177-8ef1295ed6c4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.398903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] The token cache is being invalidate because project fbddac8b537e49db84cbee3197ce5aae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:25.399454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.400513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.403026 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1647/3321] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:25 2022] DELETE /identity/v3/projects/fbddac8b537e49db84cbee3197ce5aae => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:25.407355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:25.409373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:25.438914 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1675/3322] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:03:25.452225 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:25.521004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fec777-6b89-4fdd-9177-8ef1295ed6c4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:25.530516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:25.531551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:25.532018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:25.532781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] PATH_INFO: `/v3/users/b792c96dfab742a9bd2234ce15528729` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:25.534233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b792c96dfab742a9bd2234ce15528729)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:25.537023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:25.632333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b792c96dfab742a9bd2234ce15528729'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.665087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b792c96dfab742a9bd2234ce15528729'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.666931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b792c96dfab742a9bd2234ce15528729'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.687797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b792c96dfab742a9bd2234ce15528729'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.699515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a4c00952-cebd-4c7d-bffc-26079ac50dc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b792c96dfab742a9bd2234ce15528729'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:25.710538 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1648/3323] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:25 2022] DELETE /identity/v3/users/b792c96dfab742a9bd2234ce15528729 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:25.777960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:25.780257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:25.809792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b05cf40-bf7f-477a-b1c3-8deaa798e111 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:25.912418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:25.913054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:25.913497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:25.913851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:25.915962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:25.929709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:25.931729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:25.947655 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1676/3324] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:03:27.120620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a6e8b-dca4-43c7-aff3-c1e3050245e9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:27.121146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a6e8b-dca4-43c7-aff3-c1e3050245e9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:27.121271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914a6e8b-dca4-43c7-aff3-c1e3050245e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:27.175001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-914a6e8b-dca4-43c7-aff3-c1e3050245e9 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:27.178331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-914a6e8b-dca4-43c7-aff3-c1e3050245e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:27.259780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:27.262386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:27.295242 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:27.400286 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1649/3325] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:27.498920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cb7fc1-30d1-47f3-862e-131a760cc7ba service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:27.510005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:27.510855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:27.511294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:27.511754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] PATH_INFO: `/v3/projects/8a92e23d05634434b828e3129cf81aa8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:27.514290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a92e23d05634434b828e3129cf81aa8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:27.529377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:27.631468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a92e23d05634434b828e3129cf81aa8', 'request_id': 'req-89a3fef3-8915-4d8d-91c1-9a681e3ada50'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:27.643543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a92e23d05634434b828e3129cf81aa8', 'request_id': 'req-89a3fef3-8915-4d8d-91c1-9a681e3ada50'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:27.652587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a92e23d05634434b828e3129cf81aa8', 'request_id': 'req-89a3fef3-8915-4d8d-91c1-9a681e3ada50'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:27.665585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] The token cache is being invalidate because project 8a92e23d05634434b828e3129cf81aa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:27.666139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:27.666957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-89a3fef3-8915-4d8d-91c1-9a681e3ada50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:27.668861 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1677/3326] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:27 2022] DELETE /identity/v3/projects/8a92e23d05634434b828e3129cf81aa8 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:03:27.676074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386571fb-d310-4a86-9503-b8c2de366e55 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:27.676368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386571fb-d310-4a86-9503-b8c2de366e55 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:27.676651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386571fb-d310-4a86-9503-b8c2de366e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:27.697051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-386571fb-d310-4a86-9503-b8c2de366e55 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:27.698234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-386571fb-d310-4a86-9503-b8c2de366e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:27.755474 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:27.769995 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1650/3327] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:27.777987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310c9ad-50a4-453e-9a09-d3d054910449 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:27.778457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310c9ad-50a4-453e-9a09-d3d054910449 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:27.778873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a310c9ad-50a4-453e-9a09-d3d054910449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:27.823241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a310c9ad-50a4-453e-9a09-d3d054910449 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:27.825333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a310c9ad-50a4-453e-9a09-d3d054910449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:27.863153 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1678/3328] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:27.863501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386571fb-d310-4a86-9503-b8c2de366e55 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:27.877614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386571fb-d310-4a86-9503-b8c2de366e55 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:27.886962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd9a5f-7cca-4f75-8c9d-aeef0a47fd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:27.887589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd9a5f-7cca-4f75-8c9d-aeef0a47fd97 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:27.887900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd9a5f-7cca-4f75-8c9d-aeef0a47fd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:27.888178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd9a5f-7cca-4f75-8c9d-aeef0a47fd97 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:27.888843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd9a5f-7cca-4f75-8c9d-aeef0a47fd97 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:03:27.889149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd9a5f-7cca-4f75-8c9d-aeef0a47fd97 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:27.895473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cd9a5f-7cca-4f75-8c9d-aeef0a47fd97 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:27.918974 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1651/3329] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:03:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:03:27.923401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310c9ad-50a4-453e-9a09-d3d054910449 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:27.934838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a310c9ad-50a4-453e-9a09-d3d054910449 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:27.946349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cdf9e-5b43-4ade-897a-026e2e437569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:27.946662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cdf9e-5b43-4ade-897a-026e2e437569 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:27.947210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cdf9e-5b43-4ade-897a-026e2e437569 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:27.947357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540cdf9e-5b43-4ade-897a-026e2e437569 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:27.948203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cdf9e-5b43-4ade-897a-026e2e437569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:27.950307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540cdf9e-5b43-4ade-897a-026e2e437569 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:27.994911 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1679/3330] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:27 2022] POST /identity/v3/projects => generated 391 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:27.999074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd9a5f-7cca-4f75-8c9d-aeef0a47fd97 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:28.017285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cd9a5f-7cca-4f75-8c9d-aeef0a47fd97 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:28.135122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd2f82-53c9-4caf-aeac-b1d5b0590b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:28.135892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2f82-53c9-4caf-aeac-b1d5b0590b3b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:28.138683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2f82-53c9-4caf-aeac-b1d5b0590b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:28.141135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddd2f82-53c9-4caf-aeac-b1d5b0590b3b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:28.143055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd2f82-53c9-4caf-aeac-b1d5b0590b3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:28.148532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddd2f82-53c9-4caf-aeac-b1d5b0590b3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:28.191417 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1652/3331] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:27 2022] POST /identity/v3/users => generated 296 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:28.198892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cdf9e-5b43-4ade-897a-026e2e437569 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:28.212157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540cdf9e-5b43-4ade-897a-026e2e437569 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:28.220005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ea71-08b5-49b5-ab1f-3f15a452c3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:28.220688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ea71-08b5-49b5-ab1f-3f15a452c3d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:28.222285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ea71-08b5-49b5-ab1f-3f15a452c3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:28.222732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d250ea71-08b5-49b5-ab1f-3f15a452c3d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:28.223457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250ea71-08b5-49b5-ab1f-3f15a452c3d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:28.225329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d250ea71-08b5-49b5-ab1f-3f15a452c3d5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:28.247688 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1680/3332] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:28.251570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd2f82-53c9-4caf-aeac-b1d5b0590b3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:28.268200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddd2f82-53c9-4caf-aeac-b1d5b0590b3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:28.278010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83ccc26-880e-44cc-810e-2877f7fcd220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:28.279122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ccc26-880e-44cc-810e-2877f7fcd220 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:28.279122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ccc26-880e-44cc-810e-2877f7fcd220 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:28.279393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83ccc26-880e-44cc-810e-2877f7fcd220 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:28.280484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ccc26-880e-44cc-810e-2877f7fcd220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:28.285091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83ccc26-880e-44cc-810e-2877f7fcd220 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:28.302405 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1653/3333] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:28.304062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ea71-08b5-49b5-ab1f-3f15a452c3d5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:28.316151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d250ea71-08b5-49b5-ab1f-3f15a452c3d5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:28.320744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb49f-ba17-42f2-a45b-8992236f94a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:28.322269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb49f-ba17-42f2-a45b-8992236f94a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:28.322991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb49f-ba17-42f2-a45b-8992236f94a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:28.322991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bb49f-ba17-42f2-a45b-8992236f94a1 admin admin] PATH_INFO: `/v3/projects/46319904b15945fe869108bce8b3aca9/users/e102736446234c96a8c45bd67e2a0d7b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:28.344032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bb49f-ba17-42f2-a45b-8992236f94a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46319904b15945fe869108bce8b3aca9, user_id=e102736446234c96a8c45bd67e2a0d7b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:28.353117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845bb49f-ba17-42f2-a45b-8992236f94a1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:28.395144 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1681/3334] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:28 2022] PUT /identity/v3/projects/46319904b15945fe869108bce8b3aca9/users/e102736446234c96a8c45bd67e2a0d7b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:28.396870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187e586-8574-4ef4-84ca-736435130b19 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:28.397321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187e586-8574-4ef4-84ca-736435130b19 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:28.397857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2187e586-8574-4ef4-84ca-736435130b19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:28.466427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2187e586-8574-4ef4-84ca-736435130b19 None None] MFA Rules not processed for user `e102736446234c96a8c45bd67e2a0d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:28.467714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2187e586-8574-4ef4-84ca-736435130b19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:28.702776 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1654/3335] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:28 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:28.707591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb49f-ba17-42f2-a45b-8992236f94a1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:28.805634 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:28.869398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bb49f-ba17-42f2-a45b-8992236f94a1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:28.901903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c9912-1087-4364-879b-6174a99431b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:28.902829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c9912-1087-4364-879b-6174a99431b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:28.903024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c9912-1087-4364-879b-6174a99431b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:28.903444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1c9912-1087-4364-879b-6174a99431b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:28.904211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c9912-1087-4364-879b-6174a99431b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:28.907491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1c9912-1087-4364-879b-6174a99431b8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:28.986406 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1682/3336] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:28 2022] POST /identity/v3/projects => generated 391 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:28.990579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187e586-8574-4ef4-84ca-736435130b19 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:29.012024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2187e586-8574-4ef4-84ca-736435130b19 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:29.097253 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:29.115197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5caf9-62f2-4a44-b824-7072401f3c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:29.115822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5caf9-62f2-4a44-b824-7072401f3c0d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:29.116188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5caf9-62f2-4a44-b824-7072401f3c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:29.116468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5caf9-62f2-4a44-b824-7072401f3c0d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:29.117195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5caf9-62f2-4a44-b824-7072401f3c0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:29.119312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c5caf9-62f2-4a44-b824-7072401f3c0d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:29.155760 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1655/3337] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:28 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:29.160753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c9912-1087-4364-879b-6174a99431b8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:29.173554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1c9912-1087-4364-879b-6174a99431b8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:29.187812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3facf5c-1b2e-4cec-a484-3f11931698c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:29.189206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3facf5c-1b2e-4cec-a484-3f11931698c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:29.189757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3facf5c-1b2e-4cec-a484-3f11931698c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:29.190195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3facf5c-1b2e-4cec-a484-3f11931698c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:29.191017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3facf5c-1b2e-4cec-a484-3f11931698c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:29.192811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3facf5c-1b2e-4cec-a484-3f11931698c5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:29.244178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5caf9-62f2-4a44-b824-7072401f3c0d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:29.244825 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1683/3338] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:29.258958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5caf9-62f2-4a44-b824-7072401f3c0d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:29.275606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01f628-c33a-4858-8b94-028a4b49391e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:29.279639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01f628-c33a-4858-8b94-028a4b49391e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:29.279932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01f628-c33a-4858-8b94-028a4b49391e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:29.280210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb01f628-c33a-4858-8b94-028a4b49391e admin admin] PATH_INFO: `/v3/projects/944cb22e19b444dc91082a7e4d015dc9/users/19cbd2e661c84ce0a1e7d631d7009f40/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:29.327012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01f628-c33a-4858-8b94-028a4b49391e admin admin] RBAC: Authorizing `identity:create_grant(project_id=944cb22e19b444dc91082a7e4d015dc9, user_id=19cbd2e661c84ce0a1e7d631d7009f40, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:29.331262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb01f628-c33a-4858-8b94-028a4b49391e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:29.369398 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1656/3339] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:29 2022] PUT /identity/v3/projects/944cb22e19b444dc91082a7e4d015dc9/users/19cbd2e661c84ce0a1e7d631d7009f40/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:03:29.373935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3facf5c-1b2e-4cec-a484-3f11931698c5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:29.399571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3facf5c-1b2e-4cec-a484-3f11931698c5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:29.562163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d3a1d8-c64c-4245-a537-fddc2d65f413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:29.563097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a1d8-c64c-4245-a537-fddc2d65f413 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:29.563944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a1d8-c64c-4245-a537-fddc2d65f413 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:29.564356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d3a1d8-c64c-4245-a537-fddc2d65f413 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:29.566417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3a1d8-c64c-4245-a537-fddc2d65f413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:29.573424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d3a1d8-c64c-4245-a537-fddc2d65f413 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:29.599177 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1684/3340] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:29 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:29.603835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01f628-c33a-4858-8b94-028a4b49391e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:29.621056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb01f628-c33a-4858-8b94-028a4b49391e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:29.634690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a95603-bbbe-400b-907d-243b0ccae4f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:29.635787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95603-bbbe-400b-907d-243b0ccae4f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:29.636226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95603-bbbe-400b-907d-243b0ccae4f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:29.636720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a95603-bbbe-400b-907d-243b0ccae4f7 admin admin] PATH_INFO: `/v3/projects/944cb22e19b444dc91082a7e4d015dc9/users/19cbd2e661c84ce0a1e7d631d7009f40/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:29.639214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a95603-bbbe-400b-907d-243b0ccae4f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=944cb22e19b444dc91082a7e4d015dc9, user_id=19cbd2e661c84ce0a1e7d631d7009f40, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:29.642293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a95603-bbbe-400b-907d-243b0ccae4f7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:29.658124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1657/3341] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:29 2022] PUT /identity/v3/projects/944cb22e19b444dc91082a7e4d015dc9/users/19cbd2e661c84ce0a1e7d631d7009f40/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:03:29.672992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071ed7-23c5-440a-9381-99c1b8251280 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:29.673447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071ed7-23c5-440a-9381-99c1b8251280 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:29.673832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73071ed7-23c5-440a-9381-99c1b8251280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:29.731656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-73071ed7-23c5-440a-9381-99c1b8251280 None None] MFA Rules not processed for user `19cbd2e661c84ce0a1e7d631d7009f40`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:29.734921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-73071ed7-23c5-440a-9381-99c1b8251280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:29.836947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1685/3342] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:29.848559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a95603-bbbe-400b-907d-243b0ccae4f7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:29.850773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20a95603-bbbe-400b-907d-243b0ccae4f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:30.035831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a95603-bbbe-400b-907d-243b0ccae4f7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:30.041701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d890c4-cc56-4e1e-a566-a10ba8f2abe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:30.043065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d890c4-cc56-4e1e-a566-a10ba8f2abe6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:30.043346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d890c4-cc56-4e1e-a566-a10ba8f2abe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:30.043619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d890c4-cc56-4e1e-a566-a10ba8f2abe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:30.186586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d890c4-cc56-4e1e-a566-a10ba8f2abe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:30.188961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d890c4-cc56-4e1e-a566-a10ba8f2abe6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:30.213281 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1658/3343] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:29 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:35.414771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73071ed7-23c5-440a-9381-99c1b8251280 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:35.429550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73071ed7-23c5-440a-9381-99c1b8251280 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:35.441340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75421d21-3922-4f2d-a6b8-9faac2dd3946 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:35.442115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75421d21-3922-4f2d-a6b8-9faac2dd3946 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:35.442250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75421d21-3922-4f2d-a6b8-9faac2dd3946 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:35.442587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75421d21-3922-4f2d-a6b8-9faac2dd3946 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:35.462938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75421d21-3922-4f2d-a6b8-9faac2dd3946 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:35.464453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75421d21-3922-4f2d-a6b8-9faac2dd3946 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:35.502725 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1686/3344] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:35 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:38.509854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d890c4-cc56-4e1e-a566-a10ba8f2abe6 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:38.511471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82d890c4-cc56-4e1e-a566-a10ba8f2abe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:38.651836 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:38.660522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d890c4-cc56-4e1e-a566-a10ba8f2abe6 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:38.673050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:38.676008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:38.676464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:38.677040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] PATH_INFO: `/v3/users/ba45d4c2ea4c46aabee199ebc7e9d6f2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:38.679657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba45d4c2ea4c46aabee199ebc7e9d6f2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:38.685566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:38.824713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba45d4c2ea4c46aabee199ebc7e9d6f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:38.839865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba45d4c2ea4c46aabee199ebc7e9d6f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:38.841078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba45d4c2ea4c46aabee199ebc7e9d6f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:38.865755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba45d4c2ea4c46aabee199ebc7e9d6f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:38.888737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba45d4c2ea4c46aabee199ebc7e9d6f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:38.909779 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1659/3345] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:38 2022] DELETE /identity/v3/users/ba45d4c2ea4c46aabee199ebc7e9d6f2 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:38.922013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75421d21-3922-4f2d-a6b8-9faac2dd3946 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:38.924835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75421d21-3922-4f2d-a6b8-9faac2dd3946 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:38.983982 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:39.105637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75421d21-3922-4f2d-a6b8-9faac2dd3946 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:39.214965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e7b03-8dfc-4654-a448-bfbc107c9c8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:39.218187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7b03-8dfc-4654-a448-bfbc107c9c8c service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:39.220480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7b03-8dfc-4654-a448-bfbc107c9c8c service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:39.220879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e7b03-8dfc-4654-a448-bfbc107c9c8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:39.229331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fd1e7b03-8dfc-4654-a448-bfbc107c9c8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:39.257644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e7b03-8dfc-4654-a448-bfbc107c9c8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:39.261279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e7b03-8dfc-4654-a448-bfbc107c9c8c service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:39.287594 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1687/3346] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:39.632591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:39.634426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:39.765846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b555ac-4fe1-4371-af17-38d49eb98624 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:39.773926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:39.775133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:39.776082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:39.776707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] PATH_INFO: `/v3/projects/30dbbc2d63444107b5518dbabd023d2f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:39.778784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] RBAC: Authorizing `identity:delete_project(project_id=30dbbc2d63444107b5518dbabd023d2f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:39.781571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:39.894892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30dbbc2d63444107b5518dbabd023d2f', 'request_id': 'req-78372b00-c420-48b3-9ea7-836129aff33e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:39.911489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30dbbc2d63444107b5518dbabd023d2f', 'request_id': 'req-78372b00-c420-48b3-9ea7-836129aff33e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:39.926334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30dbbc2d63444107b5518dbabd023d2f', 'request_id': 'req-78372b00-c420-48b3-9ea7-836129aff33e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:39.944528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] The token cache is being invalidate because project 30dbbc2d63444107b5518dbabd023d2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:39.945986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:39.946883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78372b00-c420-48b3-9ea7-836129aff33e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:39.949076 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1660/3347] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:39 2022] DELETE /identity/v3/projects/30dbbc2d63444107b5518dbabd023d2f => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:39.954243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c80fa-d74b-42d2-b457-136962ac182b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:39.955686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c80fa-d74b-42d2-b457-136962ac182b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:39.956205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c80fa-d74b-42d2-b457-136962ac182b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:40.004661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-268c80fa-d74b-42d2-b457-136962ac182b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:40.007860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-268c80fa-d74b-42d2-b457-136962ac182b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:40.112586 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1688/3348] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:40.124504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88855ff5-c518-4157-8b0a-185b743f5566 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:40.125338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88855ff5-c518-4157-8b0a-185b743f5566 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:40.125609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88855ff5-c518-4157-8b0a-185b743f5566 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:40.143969 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:40.159653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-88855ff5-c518-4157-8b0a-185b743f5566 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:40.161578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-88855ff5-c518-4157-8b0a-185b743f5566 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:40.202511 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1661/3349] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:40.203945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c80fa-d74b-42d2-b457-136962ac182b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:40.238826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c80fa-d74b-42d2-b457-136962ac182b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:40.258143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bcc52-0ba7-49b9-9cbd-b01f3a57ed38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:40.259247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bcc52-0ba7-49b9-9cbd-b01f3a57ed38 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:40.260063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bcc52-0ba7-49b9-9cbd-b01f3a57ed38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:40.260593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09bcc52-0ba7-49b9-9cbd-b01f3a57ed38 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:40.261495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bcc52-0ba7-49b9-9cbd-b01f3a57ed38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:03:40.262086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bcc52-0ba7-49b9-9cbd-b01f3a57ed38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:40.264739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09bcc52-0ba7-49b9-9cbd-b01f3a57ed38 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:40.296981 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1689/3350] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:03:40.302934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88855ff5-c518-4157-8b0a-185b743f5566 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:40.318203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88855ff5-c518-4157-8b0a-185b743f5566 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:40.334563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e1c62-c43e-44af-b84c-a3b5d21a2f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:40.335193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e1c62-c43e-44af-b84c-a3b5d21a2f6b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:40.336221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e1c62-c43e-44af-b84c-a3b5d21a2f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:40.336648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e1c62-c43e-44af-b84c-a3b5d21a2f6b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:40.338093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e1c62-c43e-44af-b84c-a3b5d21a2f6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:40.341324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e1c62-c43e-44af-b84c-a3b5d21a2f6b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:40.411847 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1662/3351] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:40 2022] POST /identity/v3/projects => generated 379 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:40.412382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bcc52-0ba7-49b9-9cbd-b01f3a57ed38 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:40.427555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09bcc52-0ba7-49b9-9cbd-b01f3a57ed38 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:40.528235 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:40.572774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad27e3-97b6-4d37-8a07-f3a440b8ccbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:40.572774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad27e3-97b6-4d37-8a07-f3a440b8ccbd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:40.572774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad27e3-97b6-4d37-8a07-f3a440b8ccbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:40.572774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ad27e3-97b6-4d37-8a07-f3a440b8ccbd admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:40.573413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad27e3-97b6-4d37-8a07-f3a440b8ccbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:40.578620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ad27e3-97b6-4d37-8a07-f3a440b8ccbd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:40.622576 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1690/3352] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:40 2022] POST /identity/v3/users => generated 290 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:03:40.627760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e1c62-c43e-44af-b84c-a3b5d21a2f6b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:40.641943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e1c62-c43e-44af-b84c-a3b5d21a2f6b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:40.650088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a28c-5ee4-40e1-b2fa-36d891920d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:40.651060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a28c-5ee4-40e1-b2fa-36d891920d79 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:40.651558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a28c-5ee4-40e1-b2fa-36d891920d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:40.652034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4679a28c-5ee4-40e1-b2fa-36d891920d79 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:40.653075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a28c-5ee4-40e1-b2fa-36d891920d79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:40.654939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4679a28c-5ee4-40e1-b2fa-36d891920d79 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:40.668071 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1663/3353] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:40.671928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad27e3-97b6-4d37-8a07-f3a440b8ccbd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:40.684559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ad27e3-97b6-4d37-8a07-f3a440b8ccbd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:40.690629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc469fee-86de-4a3d-a58d-ee4445dc8d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:40.691646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc469fee-86de-4a3d-a58d-ee4445dc8d5c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:40.692149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc469fee-86de-4a3d-a58d-ee4445dc8d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:40.692607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc469fee-86de-4a3d-a58d-ee4445dc8d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:40.693620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc469fee-86de-4a3d-a58d-ee4445dc8d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:40.695478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc469fee-86de-4a3d-a58d-ee4445dc8d5c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:40.711372 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1691/3354] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:03:40.715369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a28c-5ee4-40e1-b2fa-36d891920d79 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:40.735008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4679a28c-5ee4-40e1-b2fa-36d891920d79 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:40.743378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6371385-3317-4d2e-a942-505438ac0f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:40.744175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6371385-3317-4d2e-a942-505438ac0f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:40.745330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6371385-3317-4d2e-a942-505438ac0f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:40.745622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6371385-3317-4d2e-a942-505438ac0f43 admin admin] PATH_INFO: `/v3/projects/be8fffe9b0994ded9f07301735105917/users/c703cc73a22749858ffe05500e52aa03/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:40.766027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6371385-3317-4d2e-a942-505438ac0f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be8fffe9b0994ded9f07301735105917, user_id=c703cc73a22749858ffe05500e52aa03, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:40.769768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6371385-3317-4d2e-a942-505438ac0f43 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:40.794229 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1664/3355] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:40 2022] PUT /identity/v3/projects/be8fffe9b0994ded9f07301735105917/users/c703cc73a22749858ffe05500e52aa03/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:40.795993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab495-8925-4135-ab73-757f30e7b33b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:40.796311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab495-8925-4135-ab73-757f30e7b33b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:40.796586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ab495-8925-4135-ab73-757f30e7b33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:40.824384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7b5ab495-8925-4135-ab73-757f30e7b33b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:40.825922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b5ab495-8925-4135-ab73-757f30e7b33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:40.993574 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1692/3356] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:41.009716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6371385-3317-4d2e-a942-505438ac0f43 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:41.011791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e6371385-3317-4d2e-a942-505438ac0f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:41.201489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6371385-3317-4d2e-a942-505438ac0f43 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:41.209622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a970db9-3c13-46ca-9736-366f8d82cf9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:41.210676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a970db9-3c13-46ca-9736-366f8d82cf9b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:41.210994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a970db9-3c13-46ca-9736-366f8d82cf9b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:41.212026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a970db9-3c13-46ca-9736-366f8d82cf9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:41.231489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a970db9-3c13-46ca-9736-366f8d82cf9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:41.234284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a970db9-3c13-46ca-9736-366f8d82cf9b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:41.250592 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1665/3357] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:41.263139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ab495-8925-4135-ab73-757f30e7b33b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:41.266379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b5ab495-8925-4135-ab73-757f30e7b33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:41.305018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5ab495-8925-4135-ab73-757f30e7b33b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:41.313651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:41.314957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:41.316160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:41.316688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] PATH_INFO: `/v3/users/e102736446234c96a8c45bd67e2a0d7b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:41.321667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e102736446234c96a8c45bd67e2a0d7b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:41.326630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:41.426804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e102736446234c96a8c45bd67e2a0d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:41.446978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e102736446234c96a8c45bd67e2a0d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:41.448347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e102736446234c96a8c45bd67e2a0d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:41.463760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e102736446234c96a8c45bd67e2a0d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:41.476160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e102736446234c96a8c45bd67e2a0d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:41.486201 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1693/3358] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:41 2022] DELETE /identity/v3/users/e102736446234c96a8c45bd67e2a0d7b => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:41.488222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4c5dd-573f-49d0-a325-975a7ed8dcac None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:41.488512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4c5dd-573f-49d0-a325-975a7ed8dcac None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:41.488789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4c5dd-573f-49d0-a325-975a7ed8dcac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:41.532422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-59d4c5dd-573f-49d0-a325-975a7ed8dcac None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:41.534406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-59d4c5dd-573f-49d0-a325-975a7ed8dcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:41.654810 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1666/3359] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:41.662029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:41.663615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:41.706316 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:41.736893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0fac4c-8c8b-4605-b74b-87acf44ecc87 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:41.740681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f25b7-8019-49f6-adb6-f25333169805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:41.741553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f25b7-8019-49f6-adb6-f25333169805 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:41.741938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f25b7-8019-49f6-adb6-f25333169805 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:41.742711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177f25b7-8019-49f6-adb6-f25333169805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:41.755915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f25b7-8019-49f6-adb6-f25333169805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:41.757411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177f25b7-8019-49f6-adb6-f25333169805 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:41.770276 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1694/3360] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:42.000837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4c5dd-573f-49d0-a325-975a7ed8dcac None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:42.002522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-59d4c5dd-573f-49d0-a325-975a7ed8dcac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:42.031979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4c5dd-573f-49d0-a325-975a7ed8dcac None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:42.039790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:42.040900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:42.041527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:42.041966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] PATH_INFO: `/v3/projects/46319904b15945fe869108bce8b3aca9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:42.043451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46319904b15945fe869108bce8b3aca9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:42.055993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:42.123543 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:42.142286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46319904b15945fe869108bce8b3aca9', 'request_id': 'req-8512ddfe-69f0-40c2-97a7-841f9cbf9604'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.151470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46319904b15945fe869108bce8b3aca9', 'request_id': 'req-8512ddfe-69f0-40c2-97a7-841f9cbf9604'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.161198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46319904b15945fe869108bce8b3aca9', 'request_id': 'req-8512ddfe-69f0-40c2-97a7-841f9cbf9604'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.176880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] The token cache is being invalidate because project 46319904b15945fe869108bce8b3aca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:42.177171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.178038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.179979 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1667/3361] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:41 2022] DELETE /identity/v3/projects/46319904b15945fe869108bce8b3aca9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:42.183880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f25b7-8019-49f6-adb6-f25333169805 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:42.196998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177f25b7-8019-49f6-adb6-f25333169805 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:42.273499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:42.274163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:42.274450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:42.274859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] PATH_INFO: `/v3/users/19cbd2e661c84ce0a1e7d631d7009f40` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:42.276123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] RBAC: Authorizing `identity:delete_user(user_id=19cbd2e661c84ce0a1e7d631d7009f40)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:42.278765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:42.350782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19cbd2e661c84ce0a1e7d631d7009f40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.372090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:42.374668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19cbd2e661c84ce0a1e7d631d7009f40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.374803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:42.376664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19cbd2e661c84ce0a1e7d631d7009f40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.391287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19cbd2e661c84ce0a1e7d631d7009f40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.403730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19cbd2e661c84ce0a1e7d631d7009f40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:42.415584 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1695/3362] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:42 2022] DELETE /identity/v3/users/19cbd2e661c84ce0a1e7d631d7009f40 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:42.542467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8512ddfe-69f0-40c2-97a7-841f9cbf9604 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:42.658951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8440dc4-1038-40e4-8940-2f67beadd185 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:42.659665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8440dc4-1038-40e4-8940-2f67beadd185 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:42.659888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8440dc4-1038-40e4-8940-2f67beadd185 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:42.660875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8440dc4-1038-40e4-8940-2f67beadd185 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:42.663883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d8440dc4-1038-40e4-8940-2f67beadd185 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:42.784590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8440dc4-1038-40e4-8940-2f67beadd185 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:42.788182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8440dc4-1038-40e4-8940-2f67beadd185 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:42.798751 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:42.822263 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1668/3363] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:43.238582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:43.242390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:43.447539 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:43.482412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b914c9db-7f0f-4177-87e2-258f6b3a978a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:43.496066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:43.497720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:43.498010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:43.498711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] PATH_INFO: `/v3/projects/944cb22e19b444dc91082a7e4d015dc9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:43.500820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=944cb22e19b444dc91082a7e4d015dc9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:43.503381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:43.592310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '944cb22e19b444dc91082a7e4d015dc9', 'request_id': 'req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:43.603257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '944cb22e19b444dc91082a7e4d015dc9', 'request_id': 'req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:43.614884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '944cb22e19b444dc91082a7e4d015dc9', 'request_id': 'req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:43.630860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] The token cache is being invalidate because project 944cb22e19b444dc91082a7e4d015dc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:43.631386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:43.632171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4db41c5-d1b4-4b31-a655-7c2235a6b3b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:43.639702 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1696/3364] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:43 2022] DELETE /identity/v3/projects/944cb22e19b444dc91082a7e4d015dc9 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:43.645607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404e35-0f7b-4bd0-b97d-6a1947562498 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:43.646911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404e35-0f7b-4bd0-b97d-6a1947562498 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:43.647351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3404e35-0f7b-4bd0-b97d-6a1947562498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:43.671687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c3404e35-0f7b-4bd0-b97d-6a1947562498 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:43.673977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c3404e35-0f7b-4bd0-b97d-6a1947562498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:43.754017 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1669/3365] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:43.762191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bb229-94a0-4b61-a52e-16b59773be23 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:43.762540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bb229-94a0-4b61-a52e-16b59773be23 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:43.762886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06bb229-94a0-4b61-a52e-16b59773be23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:43.795153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c06bb229-94a0-4b61-a52e-16b59773be23 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:43.796775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c06bb229-94a0-4b61-a52e-16b59773be23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:43.823271 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1697/3366] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:43.834307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404e35-0f7b-4bd0-b97d-6a1947562498 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:43.846421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3404e35-0f7b-4bd0-b97d-6a1947562498 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:43.852234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b207db-ee5e-49a8-884d-1e43d78d7906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:43.854282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b207db-ee5e-49a8-884d-1e43d78d7906 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:43.854853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b207db-ee5e-49a8-884d-1e43d78d7906 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:43.855313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b207db-ee5e-49a8-884d-1e43d78d7906 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:43.856175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b207db-ee5e-49a8-884d-1e43d78d7906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:03:43.856637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b207db-ee5e-49a8-884d-1e43d78d7906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:43.858661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b207db-ee5e-49a8-884d-1e43d78d7906 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:43.882568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bb229-94a0-4b61-a52e-16b59773be23 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:43.890075 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1670/3367] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:03:43.896307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06bb229-94a0-4b61-a52e-16b59773be23 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:43.902080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85f8195-115f-456e-a97b-cbcfa17500ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:43.902850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f8195-115f-456e-a97b-cbcfa17500ab admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:43.903141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f8195-115f-456e-a97b-cbcfa17500ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:43.903419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85f8195-115f-456e-a97b-cbcfa17500ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:43.904468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f8195-115f-456e-a97b-cbcfa17500ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:43.907681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85f8195-115f-456e-a97b-cbcfa17500ab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:43.982728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b207db-ee5e-49a8-884d-1e43d78d7906 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:43.996498 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1698/3368] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:43 2022] POST /identity/v3/projects => generated 383 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:44.000915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b207db-ee5e-49a8-884d-1e43d78d7906 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:44.063429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5937b-fcac-483c-ab89-e34e083b6d4d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:44.063728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5937b-fcac-483c-ab89-e34e083b6d4d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:44.064010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d5937b-fcac-483c-ab89-e34e083b6d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:44.109216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-93d5937b-fcac-483c-ab89-e34e083b6d4d None None] MFA Rules not processed for user `e20476ff91b34c24b84e67e4416b13b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:44.114779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93d5937b-fcac-483c-ab89-e34e083b6d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:44.174357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6977c0b-9d79-41af-9bd5-96f941441bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:44.175128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6977c0b-9d79-41af-9bd5-96f941441bcf admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:44.175418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6977c0b-9d79-41af-9bd5-96f941441bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:44.175696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6977c0b-9d79-41af-9bd5-96f941441bcf admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:44.176339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6977c0b-9d79-41af-9bd5-96f941441bcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:44.178345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6977c0b-9d79-41af-9bd5-96f941441bcf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:44.238074 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1671/3369] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:43 2022] POST /identity/v3/users => generated 292 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:44.240676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6977c0b-9d79-41af-9bd5-96f941441bcf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:44.270675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6977c0b-9d79-41af-9bd5-96f941441bcf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:44.273238 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1699/3370] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:44.281155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299510-8238-4525-a44c-0f146b89fc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:44.281855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299510-8238-4525-a44c-0f146b89fc83 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:44.291951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299510-8238-4525-a44c-0f146b89fc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:44.295597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f299510-8238-4525-a44c-0f146b89fc83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:44.295597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f299510-8238-4525-a44c-0f146b89fc83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:44.295597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f299510-8238-4525-a44c-0f146b89fc83 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:44.310865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5937b-fcac-483c-ab89-e34e083b6d4d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:44.315409 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1672/3371] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:44.323003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d5937b-fcac-483c-ab89-e34e083b6d4d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:44.328342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1749e4a3-7c05-40e5-8894-b7ebd928190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:44.329000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749e4a3-7c05-40e5-8894-b7ebd928190d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:44.329285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749e4a3-7c05-40e5-8894-b7ebd928190d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:44.329604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1749e4a3-7c05-40e5-8894-b7ebd928190d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:44.330828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749e4a3-7c05-40e5-8894-b7ebd928190d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:44.333383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1749e4a3-7c05-40e5-8894-b7ebd928190d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:44.355878 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1700/3372] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:44.356985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299510-8238-4525-a44c-0f146b89fc83 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:44.369930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f299510-8238-4525-a44c-0f146b89fc83 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:44.376521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878cded-f6d2-4714-904b-f584e030ea3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:44.377123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878cded-f6d2-4714-904b-f584e030ea3e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:44.377427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878cded-f6d2-4714-904b-f584e030ea3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:44.377705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878cded-f6d2-4714-904b-f584e030ea3e admin admin] PATH_INFO: `/v3/projects/880b935740fe48f194c37e40e31b8258/users/f7c3220f3e7f4fdfbb8e02a583783b37/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:44.397776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878cded-f6d2-4714-904b-f584e030ea3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=880b935740fe48f194c37e40e31b8258, user_id=f7c3220f3e7f4fdfbb8e02a583783b37, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:44.400433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878cded-f6d2-4714-904b-f584e030ea3e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:44.430704 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1673/3373] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:44 2022] PUT /identity/v3/projects/880b935740fe48f194c37e40e31b8258/users/f7c3220f3e7f4fdfbb8e02a583783b37/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:03:44.441608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38eed-3c8e-474d-8186-57a0ed848d06 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:44.441945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38eed-3c8e-474d-8186-57a0ed848d06 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:44.442378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc38eed-3c8e-474d-8186-57a0ed848d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:44.503793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5cc38eed-3c8e-474d-8186-57a0ed848d06 None None] MFA Rules not processed for user `f7c3220f3e7f4fdfbb8e02a583783b37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:44.505486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5cc38eed-3c8e-474d-8186-57a0ed848d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:44.554064 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:44.603257 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1701/3374] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:44.603689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878cded-f6d2-4714-904b-f584e030ea3e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:44.716077 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:44.735722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38eed-3c8e-474d-8186-57a0ed848d06 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:44.737386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5cc38eed-3c8e-474d-8186-57a0ed848d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:44.741933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878cded-f6d2-4714-904b-f584e030ea3e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:44.749783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d8a8d-c9bc-429f-bfa4-b94d9bf49b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:44.752461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d8a8d-c9bc-429f-bfa4-b94d9bf49b38 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:44.752912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d8a8d-c9bc-429f-bfa4-b94d9bf49b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:44.753390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d8a8d-c9bc-429f-bfa4-b94d9bf49b38 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:44.754454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d8a8d-c9bc-429f-bfa4-b94d9bf49b38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:44.757094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d8a8d-c9bc-429f-bfa4-b94d9bf49b38 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:44.793135 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1674/3375] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:44 2022] POST /identity/v3/projects => generated 381 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:03:44.797013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d8a8d-c9bc-429f-bfa4-b94d9bf49b38 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:44.853781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc38eed-3c8e-474d-8186-57a0ed848d06 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:44.932369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d8a8d-c9bc-429f-bfa4-b94d9bf49b38 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:44.943166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbde74-c96a-4cff-89a7-c20127628a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:44.944186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbde74-c96a-4cff-89a7-c20127628a18 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:44.944687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbde74-c96a-4cff-89a7-c20127628a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:44.945177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bbde74-c96a-4cff-89a7-c20127628a18 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:44.946175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbde74-c96a-4cff-89a7-c20127628a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:44.950342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bbde74-c96a-4cff-89a7-c20127628a18 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:44.959385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39659b1b-3892-4729-9657-aa3834458560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:44.960031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39659b1b-3892-4729-9657-aa3834458560 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:44.960310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39659b1b-3892-4729-9657-aa3834458560 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:44.960585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39659b1b-3892-4729-9657-aa3834458560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:44.963150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39659b1b-3892-4729-9657-aa3834458560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:44.978383 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1675/3376] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:44 2022] POST /identity/v3/users => generated 291 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:03:44.980755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39659b1b-3892-4729-9657-aa3834458560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:44.981931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbde74-c96a-4cff-89a7-c20127628a18 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:44.982331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39659b1b-3892-4729-9657-aa3834458560 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:44.997799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bbde74-c96a-4cff-89a7-c20127628a18 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:45.001964 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1702/3377] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:45.004593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a393-ca2b-4b0d-8ee2-27f08edcff12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:45.005336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a393-ca2b-4b0d-8ee2-27f08edcff12 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:45.006320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a393-ca2b-4b0d-8ee2-27f08edcff12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:45.006320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde4a393-ca2b-4b0d-8ee2-27f08edcff12 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:45.006625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4a393-ca2b-4b0d-8ee2-27f08edcff12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:45.009388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde4a393-ca2b-4b0d-8ee2-27f08edcff12 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:45.022147 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1676/3378] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:45.025995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39659b1b-3892-4729-9657-aa3834458560 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:45.041587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39659b1b-3892-4729-9657-aa3834458560 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:45.049762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2167720-e25f-493a-9e9f-d519c58fd0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:45.050614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167720-e25f-493a-9e9f-d519c58fd0fe admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:45.050899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167720-e25f-493a-9e9f-d519c58fd0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:45.051567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2167720-e25f-493a-9e9f-d519c58fd0fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:45.052284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2167720-e25f-493a-9e9f-d519c58fd0fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:45.054029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2167720-e25f-493a-9e9f-d519c58fd0fe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:45.070351 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1703/3379] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:45.074279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a393-ca2b-4b0d-8ee2-27f08edcff12 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:45.093627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde4a393-ca2b-4b0d-8ee2-27f08edcff12 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:45.099939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c3762-b0ba-4032-8b03-18285248d1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:45.100616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c3762-b0ba-4032-8b03-18285248d1bc admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:45.107092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c3762-b0ba-4032-8b03-18285248d1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:45.107470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c3762-b0ba-4032-8b03-18285248d1bc admin admin] PATH_INFO: `/v3/projects/e45e214cc08f49bcbbb4d26e44c5e754/users/3a093ee171f74edca21701eca7971e87/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:45.140859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c3762-b0ba-4032-8b03-18285248d1bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=e45e214cc08f49bcbbb4d26e44c5e754, user_id=3a093ee171f74edca21701eca7971e87, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:45.144495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453c3762-b0ba-4032-8b03-18285248d1bc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:45.172065 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1677/3380] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:45 2022] PUT /identity/v3/projects/e45e214cc08f49bcbbb4d26e44c5e754/users/3a093ee171f74edca21701eca7971e87/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:45.183892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d9b18-3600-4252-be66-301c4f66962c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:45.184081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d9b18-3600-4252-be66-301c4f66962c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:45.184332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d9b18-3600-4252-be66-301c4f66962c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:45.222740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d13d9b18-3600-4252-be66-301c4f66962c None None] MFA Rules not processed for user `3a093ee171f74edca21701eca7971e87`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:45.223988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d13d9b18-3600-4252-be66-301c4f66962c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:45.331958 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1704/3381] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:45.333344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c3762-b0ba-4032-8b03-18285248d1bc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:45.422914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c3762-b0ba-4032-8b03-18285248d1bc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:45.428123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358ed9f-4d77-450b-997f-565e10ded3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:45.428902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358ed9f-4d77-450b-997f-565e10ded3fa admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:45.429250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358ed9f-4d77-450b-997f-565e10ded3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:45.429836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7358ed9f-4d77-450b-997f-565e10ded3fa admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:45.430617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358ed9f-4d77-450b-997f-565e10ded3fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:45.434983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7358ed9f-4d77-450b-997f-565e10ded3fa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:45.498612 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1678/3382] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:45 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:45.503462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d9b18-3600-4252-be66-301c4f66962c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:45.550988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d9b18-3600-4252-be66-301c4f66962c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:45.581541 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:45.721640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa556ee-bc7e-4a7f-bb16-11d5af9a3d6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:45.722503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa556ee-bc7e-4a7f-bb16-11d5af9a3d6f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:45.722879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa556ee-bc7e-4a7f-bb16-11d5af9a3d6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:45.724055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa556ee-bc7e-4a7f-bb16-11d5af9a3d6f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:45.724811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa556ee-bc7e-4a7f-bb16-11d5af9a3d6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:45.746457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa556ee-bc7e-4a7f-bb16-11d5af9a3d6f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:45.824855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358ed9f-4d77-450b-997f-565e10ded3fa admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:45.828189 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1705/3383] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:45 2022] POST /identity/v3/users => generated 298 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:45.840373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7358ed9f-4d77-450b-997f-565e10ded3fa admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:45.853589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b3bf2-3f7c-4f81-a81b-76fd9ffd676a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:45.854331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b3bf2-3f7c-4f81-a81b-76fd9ffd676a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:45.855457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b3bf2-3f7c-4f81-a81b-76fd9ffd676a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:45.855748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b3bf2-3f7c-4f81-a81b-76fd9ffd676a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:45.856539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b3bf2-3f7c-4f81-a81b-76fd9ffd676a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:45.864572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b3bf2-3f7c-4f81-a81b-76fd9ffd676a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:45.868729 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:45.896173 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1679/3384] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:45 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:45.897330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa556ee-bc7e-4a7f-bb16-11d5af9a3d6f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:45.910819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa556ee-bc7e-4a7f-bb16-11d5af9a3d6f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:45.928141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36462843-77fe-452c-81c8-1cec782be342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:45.933251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36462843-77fe-452c-81c8-1cec782be342 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:45.933675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36462843-77fe-452c-81c8-1cec782be342 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:45.934058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36462843-77fe-452c-81c8-1cec782be342 admin admin] PATH_INFO: `/v3/projects/4be25d8e96f7498980f0ccbdcf685357/users/c8cb2b8bb3c7421787a12ab2860f9446/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:46.000636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36462843-77fe-452c-81c8-1cec782be342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be25d8e96f7498980f0ccbdcf685357, user_id=c8cb2b8bb3c7421787a12ab2860f9446, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:46.008808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36462843-77fe-452c-81c8-1cec782be342 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:46.036799 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1706/3385] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:45 2022] PUT /identity/v3/projects/4be25d8e96f7498980f0ccbdcf685357/users/c8cb2b8bb3c7421787a12ab2860f9446/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:46.040494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b3bf2-3f7c-4f81-a81b-76fd9ffd676a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:46.058661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b3bf2-3f7c-4f81-a81b-76fd9ffd676a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:46.204881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605d660b-ba54-4b9d-ab7d-724fb6bd42a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:46.205586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d660b-ba54-4b9d-ab7d-724fb6bd42a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:46.205868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d660b-ba54-4b9d-ab7d-724fb6bd42a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:46.206144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605d660b-ba54-4b9d-ab7d-724fb6bd42a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:46.206844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d660b-ba54-4b9d-ab7d-724fb6bd42a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:46.208410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605d660b-ba54-4b9d-ab7d-724fb6bd42a5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:46.242720 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1680/3386] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:46 2022] GET /identity/v3/roles => generated 1420 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:46.243045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36462843-77fe-452c-81c8-1cec782be342 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:46.256409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36462843-77fe-452c-81c8-1cec782be342 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:46.270965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e32e74-fdd5-4b7b-a44a-d70679e33e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:46.272198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e32e74-fdd5-4b7b-a44a-d70679e33e0e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:46.272350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e32e74-fdd5-4b7b-a44a-d70679e33e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:46.272796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e32e74-fdd5-4b7b-a44a-d70679e33e0e admin admin] PATH_INFO: `/v3/projects/4be25d8e96f7498980f0ccbdcf685357/users/c8cb2b8bb3c7421787a12ab2860f9446/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:46.278932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e32e74-fdd5-4b7b-a44a-d70679e33e0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4be25d8e96f7498980f0ccbdcf685357, user_id=c8cb2b8bb3c7421787a12ab2860f9446, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:46.294831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e32e74-fdd5-4b7b-a44a-d70679e33e0e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:46.344191 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1707/3387] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:46 2022] PUT /identity/v3/projects/4be25d8e96f7498980f0ccbdcf685357/users/c8cb2b8bb3c7421787a12ab2860f9446/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:46.345260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97881c1-ecb3-4f6b-9633-bfd5d58f2ca8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:46.345580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97881c1-ecb3-4f6b-9633-bfd5d58f2ca8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:46.346506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97881c1-ecb3-4f6b-9633-bfd5d58f2ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:46.421328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f97881c1-ecb3-4f6b-9633-bfd5d58f2ca8 None None] MFA Rules not processed for user `c8cb2b8bb3c7421787a12ab2860f9446`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:46.422596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f97881c1-ecb3-4f6b-9633-bfd5d58f2ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:46.592232 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1681/3388] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:46.758485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e32e74-fdd5-4b7b-a44a-d70679e33e0e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:46.760335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-45e32e74-fdd5-4b7b-a44a-d70679e33e0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:47.016940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e32e74-fdd5-4b7b-a44a-d70679e33e0e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:47.034490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb6cc64-9519-453b-84ec-871f9ac6d5f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:47.035463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6cc64-9519-453b-84ec-871f9ac6d5f5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:47.035650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6cc64-9519-453b-84ec-871f9ac6d5f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:47.036690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb6cc64-9519-453b-84ec-871f9ac6d5f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:47.252747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6cc64-9519-453b-84ec-871f9ac6d5f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:47.261047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb6cc64-9519-453b-84ec-871f9ac6d5f5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:47.299307 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1708/3389] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:54.110944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97881c1-ecb3-4f6b-9633-bfd5d58f2ca8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:54.112520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f97881c1-ecb3-4f6b-9633-bfd5d58f2ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:54.253112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97881c1-ecb3-4f6b-9633-bfd5d58f2ca8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:54.259430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:54.260125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:54.260475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:54.260979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:54.263361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:54.287744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:54.289424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:54.317017 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1682/3390] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:03:57.287508 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:57.295286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854ea2e-838f-4940-9ff0-a782419c76cf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:57.295873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854ea2e-838f-4940-9ff0-a782419c76cf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:57.296221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854ea2e-838f-4940-9ff0-a782419c76cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:57.337440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6854ea2e-838f-4940-9ff0-a782419c76cf None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:57.341963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6854ea2e-838f-4940-9ff0-a782419c76cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:57.468885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1709/3391] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:57.476057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:57.477750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:57.496895 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:57.645460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820b42c1-ccc0-4d29-9573-2b37ea0721e4 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:57.679808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:57.680571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:57.680881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:57.681158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] PATH_INFO: `/v3/users/ca932e5866274fc78b04689811e72746` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:57.682464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca932e5866274fc78b04689811e72746)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:57.689068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:57.794761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca932e5866274fc78b04689811e72746'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:57.818949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca932e5866274fc78b04689811e72746'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:57.819731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca932e5866274fc78b04689811e72746'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:57.839153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca932e5866274fc78b04689811e72746'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:57.881035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca932e5866274fc78b04689811e72746'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:57.897964 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1683/3392] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:03:57 2022] DELETE /identity/v3/users/ca932e5866274fc78b04689811e72746 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:57.962858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ee589-08a9-4644-9e8f-a827879d5e16 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:57.964708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ee589-08a9-4644-9e8f-a827879d5e16 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:57.965228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ee589-08a9-4644-9e8f-a827879d5e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:58.089930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a63ee589-08a9-4644-9e8f-a827879d5e16 None None] MFA Rules not processed for user `c703cc73a22749858ffe05500e52aa03`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:58.091251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a63ee589-08a9-4644-9e8f-a827879d5e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:58.262352 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1710/3393] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:58.413322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:58.413322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:58.428636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ee589-08a9-4644-9e8f-a827879d5e16 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:58.430292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a63ee589-08a9-4644-9e8f-a827879d5e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:58.509176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7a4ee-60a9-430e-9867-3c83d853fb86 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:58.516627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:58.517732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:58.518253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:58.518894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] PATH_INFO: `/v3/projects/af6b3d4f42c447a083ecf6d7b6618b92` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:58.521124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6b3d4f42c447a083ecf6d7b6618b92)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:58.524191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:58.570946 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:58.600923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6b3d4f42c447a083ecf6d7b6618b92', 'request_id': 'req-ac38a459-89fe-42fb-9437-9368b8243e6f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:58.608436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6b3d4f42c447a083ecf6d7b6618b92', 'request_id': 'req-ac38a459-89fe-42fb-9437-9368b8243e6f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:58.609066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ee589-08a9-4644-9e8f-a827879d5e16 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:58.618424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6b3d4f42c447a083ecf6d7b6618b92', 'request_id': 'req-ac38a459-89fe-42fb-9437-9368b8243e6f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:58.635669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] The token cache is being invalidate because project af6b3d4f42c447a083ecf6d7b6618b92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:03:58.636019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:58.637853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ac38a459-89fe-42fb-9437-9368b8243e6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:03:58.654452 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:58.660037 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1684/3394] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:03:58 2022] DELETE /identity/v3/projects/af6b3d4f42c447a083ecf6d7b6618b92 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:58.666277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac1e3-7344-4195-ba64-7e31abc778e6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:58.666542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac1e3-7344-4195-ba64-7e31abc778e6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:58.674875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac1e3-7344-4195-ba64-7e31abc778e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:58.713128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-daeac1e3-7344-4195-ba64-7e31abc778e6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:58.714654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-daeac1e3-7344-4195-ba64-7e31abc778e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:58.747383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e7218-c6eb-47a8-acc4-bdf1f837ab0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:58.747598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e7218-c6eb-47a8-acc4-bdf1f837ab0b service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:58.748709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e7218-c6eb-47a8-acc4-bdf1f837ab0b service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:58.748709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653e7218-c6eb-47a8-acc4-bdf1f837ab0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:58.753423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-653e7218-c6eb-47a8-acc4-bdf1f837ab0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:58.836543 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1685/3395] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:03:58.843564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d758093-2231-479a-9321-553f5efbb92a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:58.844770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d758093-2231-479a-9321-553f5efbb92a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:58.845058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d758093-2231-479a-9321-553f5efbb92a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:58.911929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2d758093-2231-479a-9321-553f5efbb92a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:58.913271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2d758093-2231-479a-9321-553f5efbb92a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:58.922241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e7218-c6eb-47a8-acc4-bdf1f837ab0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:58.924429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653e7218-c6eb-47a8-acc4-bdf1f837ab0b service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:58.930125 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1686/3396] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:03:58.934038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d758093-2231-479a-9321-553f5efbb92a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:58.947233 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1711/3397] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:03:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:03:58.955101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d758093-2231-479a-9321-553f5efbb92a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:58.961594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796196-a77c-4b52-9797-1c1ec87fb30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:58.962464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796196-a77c-4b52-9797-1c1ec87fb30c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:58.963193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796196-a77c-4b52-9797-1c1ec87fb30c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:58.963722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82796196-a77c-4b52-9797-1c1ec87fb30c admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:58.965079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796196-a77c-4b52-9797-1c1ec87fb30c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:03:58.965674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796196-a77c-4b52-9797-1c1ec87fb30c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:58.968751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82796196-a77c-4b52-9797-1c1ec87fb30c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:58.985185 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1687/3398] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:03:58.989904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e7218-c6eb-47a8-acc4-bdf1f837ab0b service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:59.006837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653e7218-c6eb-47a8-acc4-bdf1f837ab0b service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:59.017892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fa79c-b43c-4a61-b8cc-b2acef12b139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:59.018470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fa79c-b43c-4a61-b8cc-b2acef12b139 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:59.018748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fa79c-b43c-4a61-b8cc-b2acef12b139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:59.019021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1fa79c-b43c-4a61-b8cc-b2acef12b139 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:59.019651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fa79c-b43c-4a61-b8cc-b2acef12b139 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:59.021852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1fa79c-b43c-4a61-b8cc-b2acef12b139 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:59.098616 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1712/3399] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:03:58 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:59.115136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796196-a77c-4b52-9797-1c1ec87fb30c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:59.128846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82796196-a77c-4b52-9797-1c1ec87fb30c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:59.290374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fc787-b6d6-4196-a682-1e01eb510662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:59.292033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc787-b6d6-4196-a682-1e01eb510662 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:59.292321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc787-b6d6-4196-a682-1e01eb510662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:59.293961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1fc787-b6d6-4196-a682-1e01eb510662 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:59.294725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fc787-b6d6-4196-a682-1e01eb510662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:59.299909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1fc787-b6d6-4196-a682-1e01eb510662 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:59.374272 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1688/3400] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:03:59 2022] POST /identity/v3/users => generated 296 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:03:59.379344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fa79c-b43c-4a61-b8cc-b2acef12b139 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:59.399084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1fa79c-b43c-4a61-b8cc-b2acef12b139 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:59.407556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72145b-5d9e-4cac-a70b-2801541046e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:59.408242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72145b-5d9e-4cac-a70b-2801541046e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:59.409034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72145b-5d9e-4cac-a70b-2801541046e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:59.409311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea72145b-5d9e-4cac-a70b-2801541046e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:59.409981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72145b-5d9e-4cac-a70b-2801541046e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:59.411658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea72145b-5d9e-4cac-a70b-2801541046e1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:59.423743 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1713/3401] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:59.427587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fc787-b6d6-4196-a682-1e01eb510662 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:59.443371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1fc787-b6d6-4196-a682-1e01eb510662 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:59.449687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48788bf8-c221-44ed-b8f8-1b1f854bff57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:59.450736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48788bf8-c221-44ed-b8f8-1b1f854bff57 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:59.451167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48788bf8-c221-44ed-b8f8-1b1f854bff57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:59.463778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48788bf8-c221-44ed-b8f8-1b1f854bff57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:59.466321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48788bf8-c221-44ed-b8f8-1b1f854bff57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:59.479327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48788bf8-c221-44ed-b8f8-1b1f854bff57 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:59.512170 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1689/3402] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:03:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:03:59.513811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72145b-5d9e-4cac-a70b-2801541046e1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:03:59.540317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea72145b-5d9e-4cac-a70b-2801541046e1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:03:59.549964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938d7f1-e50c-4ffa-86cc-6427e4572899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:03:59.551021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938d7f1-e50c-4ffa-86cc-6427e4572899 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:59.551522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938d7f1-e50c-4ffa-86cc-6427e4572899 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:59.552104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938d7f1-e50c-4ffa-86cc-6427e4572899 admin admin] PATH_INFO: `/v3/projects/03c18ddbdf0c4e269192dffd770d144c/users/9807fb29a299419ba0f1331ce251edd4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:59.574192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938d7f1-e50c-4ffa-86cc-6427e4572899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03c18ddbdf0c4e269192dffd770d144c, user_id=9807fb29a299419ba0f1331ce251edd4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:03:59.584197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938d7f1-e50c-4ffa-86cc-6427e4572899 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:03:59.604097 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1714/3403] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:03:59 2022] PUT /identity/v3/projects/03c18ddbdf0c4e269192dffd770d144c/users/9807fb29a299419ba0f1331ce251edd4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:03:59.616820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c3a0c-9e18-4297-990a-01b2bbc7b324 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:03:59.617156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c3a0c-9e18-4297-990a-01b2bbc7b324 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:03:59.617396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2c3a0c-9e18-4297-990a-01b2bbc7b324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:03:59.656434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5c2c3a0c-9e18-4297-990a-01b2bbc7b324 None None] MFA Rules not processed for user `9807fb29a299419ba0f1331ce251edd4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:03:59.657780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5c2c3a0c-9e18-4297-990a-01b2bbc7b324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:03:59.664265 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:03:59.828930 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1690/3404] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:03:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:00.557091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938d7f1-e50c-4ffa-86cc-6427e4572899 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:00.559904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e938d7f1-e50c-4ffa-86cc-6427e4572899 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:00.717684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938d7f1-e50c-4ffa-86cc-6427e4572899 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:00.733383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c8519-e702-4bcf-a81b-8677515f8474 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:00.734384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c8519-e702-4bcf-a81b-8677515f8474 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:00.734891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2c8519-e702-4bcf-a81b-8677515f8474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:00.741759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed52f0-9fcf-497e-bb6a-538504b49411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:00.742758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed52f0-9fcf-497e-bb6a-538504b49411 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:00.742849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed52f0-9fcf-497e-bb6a-538504b49411 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:00.743128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed52f0-9fcf-497e-bb6a-538504b49411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:00.770049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed52f0-9fcf-497e-bb6a-538504b49411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:00.771715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed52f0-9fcf-497e-bb6a-538504b49411 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:00.784118 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:00.784867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8d2c8519-e702-4bcf-a81b-8677515f8474 None None] MFA Rules not processed for user `0faa202378cf499581a14f05c7cfa9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:00.786205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8d2c8519-e702-4bcf-a81b-8677515f8474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:00.816479 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1715/3405] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:00.936506 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1691/3406] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:04:02.507927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed52f0-9fcf-497e-bb6a-538504b49411 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:02.635351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed52f0-9fcf-497e-bb6a-538504b49411 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:02.645152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:02.647834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:02.648359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:02.650149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] PATH_INFO: `/v3/users/9807fb29a299419ba0f1331ce251edd4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:02.652855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9807fb29a299419ba0f1331ce251edd4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:02.663868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:02.729345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aefb44-cda5-4325-af8d-8fb1eea88748 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:02.729345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aefb44-cda5-4325-af8d-8fb1eea88748 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:02.730415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aefb44-cda5-4325-af8d-8fb1eea88748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:02.776387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9807fb29a299419ba0f1331ce251edd4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:02.780076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c2aefb44-cda5-4325-af8d-8fb1eea88748 None None] MFA Rules not processed for user `c703cc73a22749858ffe05500e52aa03`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:02.784010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c2aefb44-cda5-4325-af8d-8fb1eea88748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:02.796531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9807fb29a299419ba0f1331ce251edd4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:02.797571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9807fb29a299419ba0f1331ce251edd4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:02.810218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9807fb29a299419ba0f1331ce251edd4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:02.822531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-11567b1b-f9c6-4758-b1cd-6fd2674eeac2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9807fb29a299419ba0f1331ce251edd4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:02.834409 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1716/3407] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:02 2022] DELETE /identity/v3/users/9807fb29a299419ba0f1331ce251edd4 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:02.836121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea175c-5b79-49f3-86e0-8f782fdaa2e0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:02.836519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea175c-5b79-49f3-86e0-8f782fdaa2e0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:02.836901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbea175c-5b79-49f3-86e0-8f782fdaa2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:02.861637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bbea175c-5b79-49f3-86e0-8f782fdaa2e0 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:02.863250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bbea175c-5b79-49f3-86e0-8f782fdaa2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:02.904970 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1692/3408] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:02.909693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19122-7e23-4932-a417-f5be8fc3ac09 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:02.910000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19122-7e23-4932-a417-f5be8fc3ac09 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:02.910289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e19122-7e23-4932-a417-f5be8fc3ac09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:02.949127 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1717/3409] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:02.956664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c1e19122-7e23-4932-a417-f5be8fc3ac09 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:02.962283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1e19122-7e23-4932-a417-f5be8fc3ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:03.051076 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:03.073643 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1693/3410] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:03.084691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea175c-5b79-49f3-86e0-8f782fdaa2e0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:03.086178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bbea175c-5b79-49f3-86e0-8f782fdaa2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:03.123286 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:03.176959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbea175c-5b79-49f3-86e0-8f782fdaa2e0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:03.182374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62ad68a-fcd9-4ea8-be4c-27935dfb77fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:03.183366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ad68a-fcd9-4ea8-be4c-27935dfb77fd service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:03.183904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ad68a-fcd9-4ea8-be4c-27935dfb77fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:03.184189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62ad68a-fcd9-4ea8-be4c-27935dfb77fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:03.195149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ad68a-fcd9-4ea8-be4c-27935dfb77fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:03.196669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62ad68a-fcd9-4ea8-be4c-27935dfb77fd service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:03.207865 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1718/3411] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:04:04.547132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19122-7e23-4932-a417-f5be8fc3ac09 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:04.550801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1e19122-7e23-4932-a417-f5be8fc3ac09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:04.614954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e19122-7e23-4932-a417-f5be8fc3ac09 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:04.630687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:04.632890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:04.636515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:04.636989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] PATH_INFO: `/v3/projects/03c18ddbdf0c4e269192dffd770d144c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:04.640178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] RBAC: Authorizing `identity:delete_project(project_id=03c18ddbdf0c4e269192dffd770d144c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:04.649667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:04.792094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03c18ddbdf0c4e269192dffd770d144c', 'request_id': 'req-256e100d-8ed3-4def-9d84-17e954f7071e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:04.806172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03c18ddbdf0c4e269192dffd770d144c', 'request_id': 'req-256e100d-8ed3-4def-9d84-17e954f7071e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:04.825855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03c18ddbdf0c4e269192dffd770d144c', 'request_id': 'req-256e100d-8ed3-4def-9d84-17e954f7071e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:04.846088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] The token cache is being invalidate because project 03c18ddbdf0c4e269192dffd770d144c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:04.846244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:04.847114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e100d-8ed3-4def-9d84-17e954f7071e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:04.849796 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1694/3412] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:04 2022] DELETE /identity/v3/projects/03c18ddbdf0c4e269192dffd770d144c => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:04.856200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffafe43-84a8-4e55-ab59-a1b6f346ab98 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:04.856804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffafe43-84a8-4e55-ab59-a1b6f346ab98 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:04.857069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffafe43-84a8-4e55-ab59-a1b6f346ab98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:04.951774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9ffafe43-84a8-4e55-ab59-a1b6f346ab98 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:04.957036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9ffafe43-84a8-4e55-ab59-a1b6f346ab98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:05.181861 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1719/3413] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:05.190187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9542d-4c78-4caf-85ff-9e9e4b4d937c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:05.190590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9542d-4c78-4caf-85ff-9e9e4b4d937c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:05.190875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b9542d-4c78-4caf-85ff-9e9e4b4d937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:05.235889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-86b9542d-4c78-4caf-85ff-9e9e4b4d937c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:05.237956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-86b9542d-4c78-4caf-85ff-9e9e4b4d937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:05.253152 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1695/3414] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:05.257221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffafe43-84a8-4e55-ab59-a1b6f346ab98 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:05.275658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffafe43-84a8-4e55-ab59-a1b6f346ab98 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:05.283510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1981db-d2b0-4adc-9fb3-3ba6379c05b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:05.284350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1981db-d2b0-4adc-9fb3-3ba6379c05b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:05.284737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1981db-d2b0-4adc-9fb3-3ba6379c05b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:05.285430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1981db-d2b0-4adc-9fb3-3ba6379c05b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:05.286213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1981db-d2b0-4adc-9fb3-3ba6379c05b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:04:05.286620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1981db-d2b0-4adc-9fb3-3ba6379c05b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:05.289115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1981db-d2b0-4adc-9fb3-3ba6379c05b1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:05.318835 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1720/3415] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:04:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:04:05.322873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9542d-4c78-4caf-85ff-9e9e4b4d937c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:05.338762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b9542d-4c78-4caf-85ff-9e9e4b4d937c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:05.348952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c209f-ca55-4188-99b0-4e89dc77cccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:05.349792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c209f-ca55-4188-99b0-4e89dc77cccf admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:05.350179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c209f-ca55-4188-99b0-4e89dc77cccf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:05.350554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c209f-ca55-4188-99b0-4e89dc77cccf admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:05.351308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c209f-ca55-4188-99b0-4e89dc77cccf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:05.355698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c209f-ca55-4188-99b0-4e89dc77cccf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:05.418564 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1696/3416] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:04:05 2022] POST /identity/v3/projects => generated 397 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:04:05.424087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1981db-d2b0-4adc-9fb3-3ba6379c05b1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:05.440104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1981db-d2b0-4adc-9fb3-3ba6379c05b1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:05.590525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386dd9-69fa-4259-bcb0-26d8b6cd8811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:05.591243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386dd9-69fa-4259-bcb0-26d8b6cd8811 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:05.591553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386dd9-69fa-4259-bcb0-26d8b6cd8811 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:05.591838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20386dd9-69fa-4259-bcb0-26d8b6cd8811 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:05.592497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20386dd9-69fa-4259-bcb0-26d8b6cd8811 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:05.594869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20386dd9-69fa-4259-bcb0-26d8b6cd8811 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:05.636237 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1721/3417] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:04:05 2022] POST /identity/v3/users => generated 299 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:05.640851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c209f-ca55-4188-99b0-4e89dc77cccf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:05.662740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c209f-ca55-4188-99b0-4e89dc77cccf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:05.675420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc835b-a538-4dab-89d7-7e53b7061d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:05.677999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc835b-a538-4dab-89d7-7e53b7061d99 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:05.678452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc835b-a538-4dab-89d7-7e53b7061d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:05.679859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbc835b-a538-4dab-89d7-7e53b7061d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:05.681044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc835b-a538-4dab-89d7-7e53b7061d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:05.688222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbc835b-a538-4dab-89d7-7e53b7061d99 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:05.718291 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1697/3418] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:05.722836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386dd9-69fa-4259-bcb0-26d8b6cd8811 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:05.737866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20386dd9-69fa-4259-bcb0-26d8b6cd8811 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:05.747562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62a114-50aa-492e-8f70-aed50260367e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:05.748591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62a114-50aa-492e-8f70-aed50260367e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:05.748736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62a114-50aa-492e-8f70-aed50260367e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:05.748912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62a114-50aa-492e-8f70-aed50260367e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:05.749601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62a114-50aa-492e-8f70-aed50260367e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:05.751505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62a114-50aa-492e-8f70-aed50260367e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:05.768124 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1722/3419] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:05.769029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc835b-a538-4dab-89d7-7e53b7061d99 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:05.782743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbc835b-a538-4dab-89d7-7e53b7061d99 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:05.791146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80578c-d348-42cf-89e4-d963aeb15320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:05.791816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80578c-d348-42cf-89e4-d963aeb15320 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:05.792100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80578c-d348-42cf-89e4-d963aeb15320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:05.793030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80578c-d348-42cf-89e4-d963aeb15320 admin admin] PATH_INFO: `/v3/projects/175a13a281b24a6289e68a76402eb470/users/09b32a47b2874040a560e3f3776fdff9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:05.812434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80578c-d348-42cf-89e4-d963aeb15320 admin admin] RBAC: Authorizing `identity:create_grant(project_id=175a13a281b24a6289e68a76402eb470, user_id=09b32a47b2874040a560e3f3776fdff9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:05.815305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80578c-d348-42cf-89e4-d963aeb15320 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:05.848490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea4200-bf30-4daf-b832-a8cafa2fad8b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:05.848929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea4200-bf30-4daf-b832-a8cafa2fad8b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:05.850054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceea4200-bf30-4daf-b832-a8cafa2fad8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:05.857018 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1698/3420] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:05 2022] PUT /identity/v3/projects/175a13a281b24a6289e68a76402eb470/users/09b32a47b2874040a560e3f3776fdff9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:05.888030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ceea4200-bf30-4daf-b832-a8cafa2fad8b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:05.889510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ceea4200-bf30-4daf-b832-a8cafa2fad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:05.951060 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:06.068317 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1723/3421] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:06.175968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80578c-d348-42cf-89e4-d963aeb15320 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:06.178502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bc80578c-d348-42cf-89e4-d963aeb15320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:06.339379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80578c-d348-42cf-89e4-d963aeb15320 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:06.351488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46387dae-67c7-45c2-9c53-197d2d877549 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:06.352562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46387dae-67c7-45c2-9c53-197d2d877549 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:06.353135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46387dae-67c7-45c2-9c53-197d2d877549 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:06.353938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46387dae-67c7-45c2-9c53-197d2d877549 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:06.382116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46387dae-67c7-45c2-9c53-197d2d877549 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:06.382116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46387dae-67c7-45c2-9c53-197d2d877549 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:06.402375 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1699/3422] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:08.352069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da01dc6-4212-4e73-b610-64ba9eb506b8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:08.352612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da01dc6-4212-4e73-b610-64ba9eb506b8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:08.352839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da01dc6-4212-4e73-b610-64ba9eb506b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:08.372981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1da01dc6-4212-4e73-b610-64ba9eb506b8 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:08.374572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1da01dc6-4212-4e73-b610-64ba9eb506b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:08.483763 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1724/3423] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:09.632697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faae1b-79ef-49de-89d6-64c8fecf1db8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:09.633284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faae1b-79ef-49de-89d6-64c8fecf1db8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:09.633284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71faae1b-79ef-49de-89d6-64c8fecf1db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:09.675452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-71faae1b-79ef-49de-89d6-64c8fecf1db8 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:09.676841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-71faae1b-79ef-49de-89d6-64c8fecf1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:09.695290 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1700/3424] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:10.135231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13b6ab-13ea-478a-8365-9ad79129ffa7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:10.135733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13b6ab-13ea-478a-8365-9ad79129ffa7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:10.135820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc13b6ab-13ea-478a-8365-9ad79129ffa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:10.169660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fc13b6ab-13ea-478a-8365-9ad79129ffa7 None None] MFA Rules not processed for user `4dde4bb72f914457a633358837d178de`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:10.171190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fc13b6ab-13ea-478a-8365-9ad79129ffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:10.249463 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1725/3425] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:11.390657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a3ea-6fd2-401f-a1e0-af84afce690d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:11.393510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a3ea-6fd2-401f-a1e0-af84afce690d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:11.395535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab90a3ea-6fd2-401f-a1e0-af84afce690d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:11.458498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ab90a3ea-6fd2-401f-a1e0-af84afce690d None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:11.459891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab90a3ea-6fd2-401f-a1e0-af84afce690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:11.485609 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1701/3426] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:11 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:11.914982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13b6ab-13ea-478a-8365-9ad79129ffa7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:11.917079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fc13b6ab-13ea-478a-8365-9ad79129ffa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:11.964396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc13b6ab-13ea-478a-8365-9ad79129ffa7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:11.974913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f602c242-e532-4325-a340-734a3091904a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:11.975782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602c242-e532-4325-a340-734a3091904a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:11.976254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602c242-e532-4325-a340-734a3091904a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:11.976696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f602c242-e532-4325-a340-734a3091904a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:11.996124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f602c242-e532-4325-a340-734a3091904a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:12.088105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602c242-e532-4325-a340-734a3091904a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:12.089971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f602c242-e532-4325-a340-734a3091904a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:12.102474 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1726/3427] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:11 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:12.504448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a3ea-6fd2-401f-a1e0-af84afce690d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:12.506263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab90a3ea-6fd2-401f-a1e0-af84afce690d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:12.513639 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:12.655133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab90a3ea-6fd2-401f-a1e0-af84afce690d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:12.661607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15701f-726d-4224-bd74-e892768a4fb8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:12.662170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15701f-726d-4224-bd74-e892768a4fb8 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:12.662488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15701f-726d-4224-bd74-e892768a4fb8 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:12.662720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15701f-726d-4224-bd74-e892768a4fb8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:12.671726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6f15701f-726d-4224-bd74-e892768a4fb8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:12.699674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15701f-726d-4224-bd74-e892768a4fb8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:12.701327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15701f-726d-4224-bd74-e892768a4fb8 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:12.728777 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1702/3428] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:13.571592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65dc3d-7131-4372-ae61-e64eaf900785 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:13.572979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65dc3d-7131-4372-ae61-e64eaf900785 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:13.573503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a65dc3d-7131-4372-ae61-e64eaf900785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:13.624083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2a65dc3d-7131-4372-ae61-e64eaf900785 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:13.627614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a65dc3d-7131-4372-ae61-e64eaf900785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:13.651829 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1727/3429] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:14.969648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e8be-045c-4d53-b8b1-d9b9fd4f3b23 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:14.970537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e8be-045c-4d53-b8b1-d9b9fd4f3b23 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:14.970819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf8e8be-045c-4d53-b8b1-d9b9fd4f3b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:15.015591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0bf8e8be-045c-4d53-b8b1-d9b9fd4f3b23 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:15.016815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0bf8e8be-045c-4d53-b8b1-d9b9fd4f3b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:15.025757 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1703/3430] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:16.459657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9c81b-c74e-481b-a94b-21c81f4922e0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:16.460246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9c81b-c74e-481b-a94b-21c81f4922e0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:16.460246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea9c81b-c74e-481b-a94b-21c81f4922e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:16.510317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1ea9c81b-c74e-481b-a94b-21c81f4922e0 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:16.511715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1ea9c81b-c74e-481b-a94b-21c81f4922e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:16.535479 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1728/3431] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:18.320811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c5899-f65d-4dff-ac8d-8113a7e5e8a8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:18.321275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c5899-f65d-4dff-ac8d-8113a7e5e8a8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:18.321404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c5899-f65d-4dff-ac8d-8113a7e5e8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:18.366389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-270c5899-f65d-4dff-ac8d-8113a7e5e8a8 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:18.367632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-270c5899-f65d-4dff-ac8d-8113a7e5e8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:18.385491 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1704/3432] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:19.393526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d415e-fce8-4302-be38-eda1a15f2e11 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:19.396200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d415e-fce8-4302-be38-eda1a15f2e11 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:19.397406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d415e-fce8-4302-be38-eda1a15f2e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:19.426255 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:19.460283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6c7d415e-fce8-4302-be38-eda1a15f2e11 None None] MFA Rules not processed for user `e20476ff91b34c24b84e67e4416b13b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:19.461555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6c7d415e-fce8-4302-be38-eda1a15f2e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:19.571005 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1729/3433] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:19.834698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fb5bb-f4ff-4c93-8433-80055370334e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:19.835172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fb5bb-f4ff-4c93-8433-80055370334e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:19.835511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7fb5bb-f4ff-4c93-8433-80055370334e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:19.866986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3e7fb5bb-f4ff-4c93-8433-80055370334e None None] MFA Rules not processed for user `09b32a47b2874040a560e3f3776fdff9`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:19.868384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3e7fb5bb-f4ff-4c93-8433-80055370334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:19.985078 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1705/3434] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:19.997845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4a64c-d698-4f4b-b0f1-38c1c877a7c2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:19.998203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4a64c-d698-4f4b-b0f1-38c1c877a7c2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:19.998558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae4a64c-d698-4f4b-b0f1-38c1c877a7c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:20.034609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8ae4a64c-d698-4f4b-b0f1-38c1c877a7c2 None None] MFA Rules not processed for user `09b32a47b2874040a560e3f3776fdff9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:20.036514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8ae4a64c-d698-4f4b-b0f1-38c1c877a7c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:20.051369 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1730/3435] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:19 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:20.232230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fb5bb-f4ff-4c93-8433-80055370334e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:20.233763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3e7fb5bb-f4ff-4c93-8433-80055370334e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:20.374307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7fb5bb-f4ff-4c93-8433-80055370334e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:20.383840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1d0c5-8b08-42af-ba30-958b1243bb20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:20.384741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1d0c5-8b08-42af-ba30-958b1243bb20 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:20.385233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1d0c5-8b08-42af-ba30-958b1243bb20 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:20.385647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa1d0c5-8b08-42af-ba30-958b1243bb20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:20.397329 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:20.400674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1d0c5-8b08-42af-ba30-958b1243bb20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:20.402569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa1d0c5-8b08-42af-ba30-958b1243bb20 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:20.415011 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1706/3436] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:20 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:22.477695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9643d5-05f0-4be1-94fd-b306d8d32447 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:22.478545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9643d5-05f0-4be1-94fd-b306d8d32447 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:22.479038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9643d5-05f0-4be1-94fd-b306d8d32447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:22.519714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cb9643d5-05f0-4be1-94fd-b306d8d32447 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:22.522532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cb9643d5-05f0-4be1-94fd-b306d8d32447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:22.541371 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1731/3437] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:22 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:23.691135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1d0c5-8b08-42af-ba30-958b1243bb20 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:23.707701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa1d0c5-8b08-42af-ba30-958b1243bb20 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:23.731037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e727b28-849f-47d0-88a1-b599797e755d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:23.731668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727b28-849f-47d0-88a1-b599797e755d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:23.731948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727b28-849f-47d0-88a1-b599797e755d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:23.732218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e727b28-849f-47d0-88a1-b599797e755d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:23.742576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5e727b28-849f-47d0-88a1-b599797e755d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:23.910571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727b28-849f-47d0-88a1-b599797e755d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:23.912223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e727b28-849f-47d0-88a1-b599797e755d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:23.924839 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1707/3438] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:23 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:32.506301 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=30 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:33.276805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af169f-196c-49e3-8033-f194a93f7a54 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:33.277370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af169f-196c-49e3-8033-f194a93f7a54 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:33.278324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21af169f-196c-49e3-8033-f194a93f7a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:33.301770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-21af169f-196c-49e3-8033-f194a93f7a54 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:33.303299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-21af169f-196c-49e3-8033-f194a93f7a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:33.311455 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1732/3439] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:33.919532 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=30 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:34.315586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f266971-021f-494f-9033-5749c35b5440 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:34.315953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f266971-021f-494f-9033-5749c35b5440 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:34.316145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f266971-021f-494f-9033-5749c35b5440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:34.339830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2f266971-021f-494f-9033-5749c35b5440 None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:34.341992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f266971-021f-494f-9033-5749c35b5440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:34.354129 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1708/3440] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:39.578688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af169f-196c-49e3-8033-f194a93f7a54 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:39.580768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-21af169f-196c-49e3-8033-f194a93f7a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:39.599137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21af169f-196c-49e3-8033-f194a93f7a54 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:39.604858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c4db0f-3407-4bbe-b324-15bfd83cb6b3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:39.606227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4db0f-3407-4bbe-b324-15bfd83cb6b3 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:39.606799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4db0f-3407-4bbe-b324-15bfd83cb6b3 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:39.607228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c4db0f-3407-4bbe-b324-15bfd83cb6b3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:39.609272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-45c4db0f-3407-4bbe-b324-15bfd83cb6b3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:39.622746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4db0f-3407-4bbe-b324-15bfd83cb6b3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:39.624741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c4db0f-3407-4bbe-b324-15bfd83cb6b3 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:39.636811 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1733/3441] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:04:40.238790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f266971-021f-494f-9033-5749c35b5440 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:40.240195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f266971-021f-494f-9033-5749c35b5440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:40.253900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f266971-021f-494f-9033-5749c35b5440 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:40.258573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:40.259196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:40.259478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:40.259756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] PATH_INFO: `/v3/users/f7c3220f3e7f4fdfbb8e02a583783b37` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:40.260898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7c3220f3e7f4fdfbb8e02a583783b37)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:40.262843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:40.311202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7c3220f3e7f4fdfbb8e02a583783b37'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:40.323549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7c3220f3e7f4fdfbb8e02a583783b37'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:40.324286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7c3220f3e7f4fdfbb8e02a583783b37'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:40.336680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7c3220f3e7f4fdfbb8e02a583783b37'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:40.343889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7c3220f3e7f4fdfbb8e02a583783b37'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:40.350925 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1709/3442] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:40 2022] DELETE /identity/v3/users/f7c3220f3e7f4fdfbb8e02a583783b37 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:40.355304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb603338-57bb-4222-b01b-17aa7a145508 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:40.355586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb603338-57bb-4222-b01b-17aa7a145508 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:40.355893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb603338-57bb-4222-b01b-17aa7a145508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:40.375219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fb603338-57bb-4222-b01b-17aa7a145508 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:40.376661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb603338-57bb-4222-b01b-17aa7a145508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:40.437743 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1734/3443] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:04:40.447913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:40.449417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:40.531301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e18046-b045-499f-ba20-fdc39389edca admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:40.537260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac76a8d-bfc6-45fd-81da-fceda3f9a5b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:40.538024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac76a8d-bfc6-45fd-81da-fceda3f9a5b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:40.538374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac76a8d-bfc6-45fd-81da-fceda3f9a5b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:40.538717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac76a8d-bfc6-45fd-81da-fceda3f9a5b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:40.549170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac76a8d-bfc6-45fd-81da-fceda3f9a5b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:40.550796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac76a8d-bfc6-45fd-81da-fceda3f9a5b4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:40.567100 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1710/3444] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:40.878976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb603338-57bb-4222-b01b-17aa7a145508 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:40.880450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb603338-57bb-4222-b01b-17aa7a145508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:40.893880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb603338-57bb-4222-b01b-17aa7a145508 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:40.899838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:40.900685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:40.901119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:40.901420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] PATH_INFO: `/v3/projects/880b935740fe48f194c37e40e31b8258` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:40.903514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=880b935740fe48f194c37e40e31b8258)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:40.906513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:40.983081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '880b935740fe48f194c37e40e31b8258', 'request_id': 'req-67cb50bc-f061-4683-bf6d-6cb8805794f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:40.992819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '880b935740fe48f194c37e40e31b8258', 'request_id': 'req-67cb50bc-f061-4683-bf6d-6cb8805794f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:41.000327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '880b935740fe48f194c37e40e31b8258', 'request_id': 'req-67cb50bc-f061-4683-bf6d-6cb8805794f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:41.012237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] The token cache is being invalidate because project 880b935740fe48f194c37e40e31b8258 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:41.012532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:41.013389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:41.015243 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1735/3445] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:40 2022] DELETE /identity/v3/projects/880b935740fe48f194c37e40e31b8258 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:41.019481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac76a8d-bfc6-45fd-81da-fceda3f9a5b4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:41.030185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac76a8d-bfc6-45fd-81da-fceda3f9a5b4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:41.156876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:41.158505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:41.158794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:41.159066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] PATH_INFO: `/v3/users/3a093ee171f74edca21701eca7971e87` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:41.160305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a093ee171f74edca21701eca7971e87)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:41.162450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:41.177932 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:41.226989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a093ee171f74edca21701eca7971e87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:41.246796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a093ee171f74edca21701eca7971e87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:41.249221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a093ee171f74edca21701eca7971e87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:41.262909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a093ee171f74edca21701eca7971e87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:41.275422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a093ee171f74edca21701eca7971e87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:41.283949 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1711/3446] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:41 2022] DELETE /identity/v3/users/3a093ee171f74edca21701eca7971e87 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:41.835133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:41.836561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:41.851008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cb50bc-f061-4683-bf6d-6cb8805794f2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:41.937708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:41.940655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:41.941193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:41.942919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] PATH_INFO: `/v3/projects/e45e214cc08f49bcbbb4d26e44c5e754` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:41.944471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e45e214cc08f49bcbbb4d26e44c5e754)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:41.947009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:41.954118 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:42.007621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e45e214cc08f49bcbbb4d26e44c5e754', 'request_id': 'req-38e58fe7-ca2b-4527-aef6-3366479c857e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.016850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e45e214cc08f49bcbbb4d26e44c5e754', 'request_id': 'req-38e58fe7-ca2b-4527-aef6-3366479c857e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.028181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e45e214cc08f49bcbbb4d26e44c5e754', 'request_id': 'req-38e58fe7-ca2b-4527-aef6-3366479c857e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.043377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] The token cache is being invalidate because project e45e214cc08f49bcbbb4d26e44c5e754 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:42.043377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.044034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.045831 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1736/3447] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:41 2022] DELETE /identity/v3/projects/e45e214cc08f49bcbbb4d26e44c5e754 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:42.050121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:42.051714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:42.065771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc6d817-047b-4636-8091-eb39a1622966 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:42.165470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:42.166258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:42.166611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:42.167058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] PATH_INFO: `/v3/users/c8cb2b8bb3c7421787a12ab2860f9446` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:42.168431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cb2b8bb3c7421787a12ab2860f9446)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:42.170917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:42.242845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cb2b8bb3c7421787a12ab2860f9446'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.256454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cb2b8bb3c7421787a12ab2860f9446'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.257192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cb2b8bb3c7421787a12ab2860f9446'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.267915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cb2b8bb3c7421787a12ab2860f9446'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.276053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6368a448-fa48-46d6-b75a-0e613522aa42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cb2b8bb3c7421787a12ab2860f9446'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.285460 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1712/3448] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:42 2022] DELETE /identity/v3/users/c8cb2b8bb3c7421787a12ab2860f9446 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:42.781399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:42.783128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:42.798460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e58fe7-ca2b-4527-aef6-3366479c857e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:42.880835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:42.881521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:42.881794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:42.882286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] PATH_INFO: `/v3/projects/4be25d8e96f7498980f0ccbdcf685357` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:42.883872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4be25d8e96f7498980f0ccbdcf685357)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:42.885804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:42.955868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4be25d8e96f7498980f0ccbdcf685357', 'request_id': 'req-535aba83-baee-4161-81d6-240ef1e28bf3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.968417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4be25d8e96f7498980f0ccbdcf685357', 'request_id': 'req-535aba83-baee-4161-81d6-240ef1e28bf3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.977770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4be25d8e96f7498980f0ccbdcf685357', 'request_id': 'req-535aba83-baee-4161-81d6-240ef1e28bf3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.989540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] The token cache is being invalidate because project 4be25d8e96f7498980f0ccbdcf685357 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:42.990157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.991042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-535aba83-baee-4161-81d6-240ef1e28bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:42.993095 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1737/3449] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:42 2022] DELETE /identity/v3/projects/4be25d8e96f7498980f0ccbdcf685357 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:42.998447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a688-1fea-4e0d-9392-035360ea319b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:42.998447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a688-1fea-4e0d-9392-035360ea319b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:42.998447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a688-1fea-4e0d-9392-035360ea319b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.014621 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=20,keystone:SELECT=78,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:43.022328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8b93a688-1fea-4e0d-9392-035360ea319b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:43.024113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b93a688-1fea-4e0d-9392-035360ea319b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:43.097961 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1713/3450] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:43.107250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a69da-0ed8-4af7-ac81-e00588ccbf30 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:43.107250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a69da-0ed8-4af7-ac81-e00588ccbf30 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:43.107250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a69da-0ed8-4af7-ac81-e00588ccbf30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.159456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-583a69da-0ed8-4af7-ac81-e00588ccbf30 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:43.160694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-583a69da-0ed8-4af7-ac81-e00588ccbf30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:43.178475 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1738/3451] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:43.182379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a688-1fea-4e0d-9392-035360ea319b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:43.194560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a688-1fea-4e0d-9392-035360ea319b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:43.200890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6470-112c-4b93-9795-0577b69b2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:43.201838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6470-112c-4b93-9795-0577b69b2a0a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:43.202742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6470-112c-4b93-9795-0577b69b2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:43.209693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ba6470-112c-4b93-9795-0577b69b2a0a admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.209999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6470-112c-4b93-9795-0577b69b2a0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:04:43.211210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6470-112c-4b93-9795-0577b69b2a0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:43.213844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ba6470-112c-4b93-9795-0577b69b2a0a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:43.233921 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1714/3452] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:04:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:04:43.239501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a69da-0ed8-4af7-ac81-e00588ccbf30 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:43.249696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a69da-0ed8-4af7-ac81-e00588ccbf30 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:43.258300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb81b4-693e-4a1d-adf5-47744943c0fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:43.259422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb81b4-693e-4a1d-adf5-47744943c0fb admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:43.259917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb81b4-693e-4a1d-adf5-47744943c0fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:43.260346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eb81b4-693e-4a1d-adf5-47744943c0fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.262168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb81b4-693e-4a1d-adf5-47744943c0fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:43.264493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eb81b4-693e-4a1d-adf5-47744943c0fb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:43.281036 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:43.301745 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1739/3453] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:04:43 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:43.305928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6470-112c-4b93-9795-0577b69b2a0a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:43.321708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ba6470-112c-4b93-9795-0577b69b2a0a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:43.410517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2af98-acb5-4f1d-8c23-4a663cbf40ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:43.411186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2af98-acb5-4f1d-8c23-4a663cbf40ae admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:43.411468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2af98-acb5-4f1d-8c23-4a663cbf40ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:43.411744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac2af98-acb5-4f1d-8c23-4a663cbf40ae admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.412521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2af98-acb5-4f1d-8c23-4a663cbf40ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:43.414525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac2af98-acb5-4f1d-8c23-4a663cbf40ae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:43.443491 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1715/3454] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:04:43 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:43.447149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb81b4-693e-4a1d-adf5-47744943c0fb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:43.458563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eb81b4-693e-4a1d-adf5-47744943c0fb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:43.464208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04bcb1-10ec-464b-ad14-058810266842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:43.464842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04bcb1-10ec-464b-ad14-058810266842 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:43.465119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04bcb1-10ec-464b-ad14-058810266842 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:43.465443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04bcb1-10ec-464b-ad14-058810266842 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.466161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04bcb1-10ec-464b-ad14-058810266842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:43.468003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04bcb1-10ec-464b-ad14-058810266842 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:43.482123 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1740/3455] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:43.487281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2af98-acb5-4f1d-8c23-4a663cbf40ae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:43.499439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac2af98-acb5-4f1d-8c23-4a663cbf40ae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:43.505641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc28b2cc-23ba-4aea-a5c4-3130d7243692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:43.506661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28b2cc-23ba-4aea-a5c4-3130d7243692 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:43.506790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28b2cc-23ba-4aea-a5c4-3130d7243692 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:43.507112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc28b2cc-23ba-4aea-a5c4-3130d7243692 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.507837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28b2cc-23ba-4aea-a5c4-3130d7243692 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:43.509527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc28b2cc-23ba-4aea-a5c4-3130d7243692 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:43.523702 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1716/3456] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:43 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:04:43.527729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04bcb1-10ec-464b-ad14-058810266842 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:43.543863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04bcb1-10ec-464b-ad14-058810266842 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:43.549956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb738da0-3f14-4906-aadc-6571b9cdecc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:43.550626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb738da0-3f14-4906-aadc-6571b9cdecc6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:43.550910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb738da0-3f14-4906-aadc-6571b9cdecc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:43.551185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb738da0-3f14-4906-aadc-6571b9cdecc6 admin admin] PATH_INFO: `/v3/projects/b9b11125928d4520b5d6eb3e6551d440/users/c216225debff4961bd4bcdee9205f397/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.568404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb738da0-3f14-4906-aadc-6571b9cdecc6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b11125928d4520b5d6eb3e6551d440, user_id=c216225debff4961bd4bcdee9205f397, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:43.571151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb738da0-3f14-4906-aadc-6571b9cdecc6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:43.589491 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1741/3457] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:43 2022] PUT /identity/v3/projects/b9b11125928d4520b5d6eb3e6551d440/users/c216225debff4961bd4bcdee9205f397/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:43.600237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b496538-9119-4535-a797-1c4017f65a43 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:43.600538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b496538-9119-4535-a797-1c4017f65a43 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:43.600802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b496538-9119-4535-a797-1c4017f65a43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.634209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7b496538-9119-4535-a797-1c4017f65a43 None None] MFA Rules not processed for user `c216225debff4961bd4bcdee9205f397`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:43.635569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7b496538-9119-4535-a797-1c4017f65a43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:43.734770 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1717/3458] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:43.739657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb738da0-3f14-4906-aadc-6571b9cdecc6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:43.844895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb738da0-3f14-4906-aadc-6571b9cdecc6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:43.851713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415cdbd-6223-4569-9728-ab0c2cbd99ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:43.853070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415cdbd-6223-4569-9728-ab0c2cbd99ba admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:43.853488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415cdbd-6223-4569-9728-ab0c2cbd99ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:43.853860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8415cdbd-6223-4569-9728-ab0c2cbd99ba admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:43.855218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415cdbd-6223-4569-9728-ab0c2cbd99ba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:43.857970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8415cdbd-6223-4569-9728-ab0c2cbd99ba admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:43.898040 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1742/3459] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:04:43 2022] POST /identity/v3/projects => generated 375 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:43.901223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b496538-9119-4535-a797-1c4017f65a43 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:43.915792 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:43.922677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b496538-9119-4535-a797-1c4017f65a43 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:43.999234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f389-c105-40a6-8165-47eb607d039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:44.000275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f389-c105-40a6-8165-47eb607d039d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:44.000552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f389-c105-40a6-8165-47eb607d039d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:44.000825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab06f389-c105-40a6-8165-47eb607d039d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:44.001903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f389-c105-40a6-8165-47eb607d039d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:44.004007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab06f389-c105-40a6-8165-47eb607d039d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:44.036139 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1718/3460] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:04:43 2022] POST /identity/v3/users => generated 294 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:04:44.037463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415cdbd-6223-4569-9728-ab0c2cbd99ba admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:44.055616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8415cdbd-6223-4569-9728-ab0c2cbd99ba admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:44.068860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60c8a8-a799-4abb-a7b8-d013c1a61a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:44.069749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60c8a8-a799-4abb-a7b8-d013c1a61a3f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:44.070043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60c8a8-a799-4abb-a7b8-d013c1a61a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:44.070288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd60c8a8-a799-4abb-a7b8-d013c1a61a3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:44.070928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60c8a8-a799-4abb-a7b8-d013c1a61a3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:44.072805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd60c8a8-a799-4abb-a7b8-d013c1a61a3f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:44.084433 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1743/3461] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:44.088708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f389-c105-40a6-8165-47eb607d039d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:44.099514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab06f389-c105-40a6-8165-47eb607d039d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:44.104245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60511456-9f51-4da9-87c7-6b0e18aac507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:44.104932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60511456-9f51-4da9-87c7-6b0e18aac507 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:44.105211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60511456-9f51-4da9-87c7-6b0e18aac507 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:44.105515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60511456-9f51-4da9-87c7-6b0e18aac507 admin admin] PATH_INFO: `/v3/projects/44e1beb751094e5da560247d0265d518/users/71518a94b51b4dc692e3f02e5bfe9ea5/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:44.122116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60511456-9f51-4da9-87c7-6b0e18aac507 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e1beb751094e5da560247d0265d518, user_id=71518a94b51b4dc692e3f02e5bfe9ea5, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:44.124781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60511456-9f51-4da9-87c7-6b0e18aac507 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:44.140046 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1719/3462] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:44 2022] PUT /identity/v3/projects/44e1beb751094e5da560247d0265d518/users/71518a94b51b4dc692e3f02e5bfe9ea5/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:44.145474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60c8a8-a799-4abb-a7b8-d013c1a61a3f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:44.158938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd60c8a8-a799-4abb-a7b8-d013c1a61a3f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:44.230269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd8c49-4a04-425b-bbcc-ff6b7144b6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:44.231538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8c49-4a04-425b-bbcc-ff6b7144b6d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:44.232084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8c49-4a04-425b-bbcc-ff6b7144b6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:44.232429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd8c49-4a04-425b-bbcc-ff6b7144b6d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:44.233189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8c49-4a04-425b-bbcc-ff6b7144b6d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:44.234958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd8c49-4a04-425b-bbcc-ff6b7144b6d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:44.251859 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1744/3463] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:44 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:44.252829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60511456-9f51-4da9-87c7-6b0e18aac507 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:44.264647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60511456-9f51-4da9-87c7-6b0e18aac507 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:44.269813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6896aec-9b1f-4b63-b8e7-cf7d42179c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:44.270463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896aec-9b1f-4b63-b8e7-cf7d42179c2e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:44.270889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896aec-9b1f-4b63-b8e7-cf7d42179c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:44.271167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6896aec-9b1f-4b63-b8e7-cf7d42179c2e admin admin] PATH_INFO: `/v3/projects/44e1beb751094e5da560247d0265d518/users/71518a94b51b4dc692e3f02e5bfe9ea5/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:44.273108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6896aec-9b1f-4b63-b8e7-cf7d42179c2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=44e1beb751094e5da560247d0265d518, user_id=71518a94b51b4dc692e3f02e5bfe9ea5, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:44.275761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6896aec-9b1f-4b63-b8e7-cf7d42179c2e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:44.289415 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1720/3464] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:44 2022] PUT /identity/v3/projects/44e1beb751094e5da560247d0265d518/users/71518a94b51b4dc692e3f02e5bfe9ea5/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:44.297627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40a5bd-ca9d-4939-a5a7-66b908adb2a8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:44.297941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40a5bd-ca9d-4939-a5a7-66b908adb2a8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:44.298226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb40a5bd-ca9d-4939-a5a7-66b908adb2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:44.332645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bb40a5bd-ca9d-4939-a5a7-66b908adb2a8 None None] MFA Rules not processed for user `71518a94b51b4dc692e3f02e5bfe9ea5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:44.334040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb40a5bd-ca9d-4939-a5a7-66b908adb2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:44.355260 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:44.429218 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1745/3465] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:04:44.444851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6896aec-9b1f-4b63-b8e7-cf7d42179c2e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:44.446643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a6896aec-9b1f-4b63-b8e7-cf7d42179c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:44.519770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6896aec-9b1f-4b63-b8e7-cf7d42179c2e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:44.523704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4e0a4-7ed4-438d-aa0d-87ff974fd1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:44.524442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4e0a4-7ed4-438d-aa0d-87ff974fd1ab service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:44.524724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4e0a4-7ed4-438d-aa0d-87ff974fd1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:44.524997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4e0a4-7ed4-438d-aa0d-87ff974fd1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:44.536569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4e0a4-7ed4-438d-aa0d-87ff974fd1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:44.538452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4e0a4-7ed4-438d-aa0d-87ff974fd1ab service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:44.552175 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1721/3466] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:04:46.377906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1004e-588e-40cb-b7b5-37b505e1a96b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:46.378440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1004e-588e-40cb-b7b5-37b505e1a96b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:46.380076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1004e-588e-40cb-b7b5-37b505e1a96b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:46.417157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4df1004e-588e-40cb-b7b5-37b505e1a96b None None] MFA Rules not processed for user `e20476ff91b34c24b84e67e4416b13b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:46.421637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4df1004e-588e-40cb-b7b5-37b505e1a96b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:46.540668 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1746/3467] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:47.034813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4e0a4-7ed4-438d-aa0d-87ff974fd1ab service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:47.104729 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:47.109908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4e0a4-7ed4-438d-aa0d-87ff974fd1ab service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:47.116697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:47.117487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:47.117831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:47.118307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] PATH_INFO: `/v3/users/c216225debff4961bd4bcdee9205f397` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:47.119783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c216225debff4961bd4bcdee9205f397)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:47.121974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:47.180186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c216225debff4961bd4bcdee9205f397'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:47.192979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c216225debff4961bd4bcdee9205f397'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:47.193725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c216225debff4961bd4bcdee9205f397'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:47.207009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c216225debff4961bd4bcdee9205f397'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:47.226770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c216225debff4961bd4bcdee9205f397'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:47.239330 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1722/3468] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:47 2022] DELETE /identity/v3/users/c216225debff4961bd4bcdee9205f397 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:47.241193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77143341-cac7-4b08-be31-5e1e0d14c3d4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:47.241514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77143341-cac7-4b08-be31-5e1e0d14c3d4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:47.241861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77143341-cac7-4b08-be31-5e1e0d14c3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:47.267407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-77143341-cac7-4b08-be31-5e1e0d14c3d4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:47.269528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-77143341-cac7-4b08-be31-5e1e0d14c3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:47.391396 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1747/3469] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:47.428400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:47.430233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:47.561833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9fbc6-ef25-47b4-a09b-cd88852dbed3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:47.569602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a52d-5ea1-4126-b23b-b0eb1079c2f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:47.570542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a52d-5ea1-4126-b23b-b0eb1079c2f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:47.571153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a52d-5ea1-4126-b23b-b0eb1079c2f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:47.571434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e57a52d-5ea1-4126-b23b-b0eb1079c2f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:47.584091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a52d-5ea1-4126-b23b-b0eb1079c2f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:47.586418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e57a52d-5ea1-4126-b23b-b0eb1079c2f2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:47.599857 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1723/3470] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:48.097637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aeb89-8b82-4ae8-92a3-79901bbdfc7e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:48.097923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aeb89-8b82-4ae8-92a3-79901bbdfc7e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:48.098470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537aeb89-8b82-4ae8-92a3-79901bbdfc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:48.141170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-537aeb89-8b82-4ae8-92a3-79901bbdfc7e None None] MFA Rules not processed for user `136253a1592742219ad302722be1d5f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:48.150013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-537aeb89-8b82-4ae8-92a3-79901bbdfc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:48.235152 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1748/3471] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:48.311064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a52d-5ea1-4126-b23b-b0eb1079c2f2 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:48.312640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6e57a52d-5ea1-4126-b23b-b0eb1079c2f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:48.334757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e57a52d-5ea1-4126-b23b-b0eb1079c2f2 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:48.346577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:48.347490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:48.348555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:48.348913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] PATH_INFO: `/v3/projects/b9b11125928d4520b5d6eb3e6551d440` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:48.350645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b11125928d4520b5d6eb3e6551d440)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:48.352836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:48.421224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b11125928d4520b5d6eb3e6551d440', 'request_id': 'req-7c99e159-852d-481c-b259-7efd112fcaca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.436821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b11125928d4520b5d6eb3e6551d440', 'request_id': 'req-7c99e159-852d-481c-b259-7efd112fcaca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.455670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b11125928d4520b5d6eb3e6551d440', 'request_id': 'req-7c99e159-852d-481c-b259-7efd112fcaca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.468801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] The token cache is being invalidate because project b9b11125928d4520b5d6eb3e6551d440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:48.469397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.470396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.477378 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1724/3472] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:48 2022] DELETE /identity/v3/projects/b9b11125928d4520b5d6eb3e6551d440 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:48.479755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aeb89-8b82-4ae8-92a3-79901bbdfc7e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:48.492142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537aeb89-8b82-4ae8-92a3-79901bbdfc7e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:48.496703 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:48.594362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:48.595350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:48.595789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:48.596223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] PATH_INFO: `/v3/users/71518a94b51b4dc692e3f02e5bfe9ea5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:48.598077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=71518a94b51b4dc692e3f02e5bfe9ea5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:48.601135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:48.693098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71518a94b51b4dc692e3f02e5bfe9ea5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.708109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71518a94b51b4dc692e3f02e5bfe9ea5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.709594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71518a94b51b4dc692e3f02e5bfe9ea5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.722540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71518a94b51b4dc692e3f02e5bfe9ea5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.736558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9059dbae-09bc-4971-acf5-bd2222faddaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71518a94b51b4dc692e3f02e5bfe9ea5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:48.743713 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1749/3473] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:48 2022] DELETE /identity/v3/users/71518a94b51b4dc692e3f02e5bfe9ea5 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:49.619771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:49.621324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:49.631543 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:49.635818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c99e159-852d-481c-b259-7efd112fcaca admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:49.806615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:49.807464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:49.809000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:49.809527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] PATH_INFO: `/v3/projects/44e1beb751094e5da560247d0265d518` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:49.812831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=44e1beb751094e5da560247d0265d518)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:49.815913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:49.923462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44e1beb751094e5da560247d0265d518', 'request_id': 'req-f032fed2-2b36-4b44-817f-b158fb0f5d85'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:49.934096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44e1beb751094e5da560247d0265d518', 'request_id': 'req-f032fed2-2b36-4b44-817f-b158fb0f5d85'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:49.955755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44e1beb751094e5da560247d0265d518', 'request_id': 'req-f032fed2-2b36-4b44-817f-b158fb0f5d85'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:49.980642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] The token cache is being invalidate because project 44e1beb751094e5da560247d0265d518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:49.981272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:49.988996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f032fed2-2b36-4b44-817f-b158fb0f5d85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:49.996224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b0f1f-317d-40d8-b7f4-15f282b0f992 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:49.997013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b0f1f-317d-40d8-b7f4-15f282b0f992 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:49.997013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b0f1f-317d-40d8-b7f4-15f282b0f992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:49.997778 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1725/3474] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:49 2022] DELETE /identity/v3/projects/44e1beb751094e5da560247d0265d518 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:50.034499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a80b0f1f-317d-40d8-b7f4-15f282b0f992 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:50.036973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a80b0f1f-317d-40d8-b7f4-15f282b0f992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:50.177797 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1750/3475] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:50.179552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b69748-3db7-4e84-8315-2b1ee039b9d6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:50.179713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b69748-3db7-4e84-8315-2b1ee039b9d6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:50.179991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b69748-3db7-4e84-8315-2b1ee039b9d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:50.215563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-52b69748-3db7-4e84-8315-2b1ee039b9d6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:50.218599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52b69748-3db7-4e84-8315-2b1ee039b9d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:50.246842 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1726/3476] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:50.253161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b0f1f-317d-40d8-b7f4-15f282b0f992 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:50.272236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b0f1f-317d-40d8-b7f4-15f282b0f992 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:50.279679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fca330-a9e6-4076-800c-8ae144600405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:50.280321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fca330-a9e6-4076-800c-8ae144600405 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:50.280603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fca330-a9e6-4076-800c-8ae144600405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:50.280876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36fca330-a9e6-4076-800c-8ae144600405 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:50.281566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fca330-a9e6-4076-800c-8ae144600405 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:04:50.281866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fca330-a9e6-4076-800c-8ae144600405 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:50.283547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36fca330-a9e6-4076-800c-8ae144600405 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:50.301135 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1751/3477] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:04:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:04:50.301976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b69748-3db7-4e84-8315-2b1ee039b9d6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:50.312123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b69748-3db7-4e84-8315-2b1ee039b9d6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:50.317741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca002c22-288e-4967-8865-f51acba56c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:50.318625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca002c22-288e-4967-8865-f51acba56c63 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:50.318625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca002c22-288e-4967-8865-f51acba56c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:50.318964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca002c22-288e-4967-8865-f51acba56c63 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:50.319517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca002c22-288e-4967-8865-f51acba56c63 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:50.321599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca002c22-288e-4967-8865-f51acba56c63 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:50.357803 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1727/3478] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:04:50 2022] POST /identity/v3/projects => generated 367 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:04:50.358756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fca330-a9e6-4076-800c-8ae144600405 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:50.374668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36fca330-a9e6-4076-800c-8ae144600405 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:50.387792 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:50.498250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa4e8-fc33-4b96-b4e4-f34e669d03a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:50.498898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa4e8-fc33-4b96-b4e4-f34e669d03a2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:50.499174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa4e8-fc33-4b96-b4e4-f34e669d03a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:50.499444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605fa4e8-fc33-4b96-b4e4-f34e669d03a2 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:50.500081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fa4e8-fc33-4b96-b4e4-f34e669d03a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:50.502688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605fa4e8-fc33-4b96-b4e4-f34e669d03a2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:50.575790 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1752/3479] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:04:50 2022] POST /identity/v3/users => generated 284 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:50.581244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca002c22-288e-4967-8865-f51acba56c63 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:50.602458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca002c22-288e-4967-8865-f51acba56c63 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:50.614569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f81d7d-fab1-47c0-ab99-1f8a73f57139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:50.615245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f81d7d-fab1-47c0-ab99-1f8a73f57139 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:50.615529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f81d7d-fab1-47c0-ab99-1f8a73f57139 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:50.615798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f81d7d-fab1-47c0-ab99-1f8a73f57139 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:50.616464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f81d7d-fab1-47c0-ab99-1f8a73f57139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:50.620373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f81d7d-fab1-47c0-ab99-1f8a73f57139 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:50.644541 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1728/3480] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:50.645254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa4e8-fc33-4b96-b4e4-f34e669d03a2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:50.660133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605fa4e8-fc33-4b96-b4e4-f34e669d03a2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:50.678119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f446ae8d-cf12-44e4-a7fa-03f43dbab4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:50.678805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ae8d-cf12-44e4-a7fa-03f43dbab4bc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:50.679159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ae8d-cf12-44e4-a7fa-03f43dbab4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:50.679505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f446ae8d-cf12-44e4-a7fa-03f43dbab4bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:50.685725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446ae8d-cf12-44e4-a7fa-03f43dbab4bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:50.706030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f446ae8d-cf12-44e4-a7fa-03f43dbab4bc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:50.728871 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1753/3481] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:04:50.733838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f81d7d-fab1-47c0-ab99-1f8a73f57139 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:50.751019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f81d7d-fab1-47c0-ab99-1f8a73f57139 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:50.764762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbccadd-dafc-4c0d-a998-4123c8075643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:50.765478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbccadd-dafc-4c0d-a998-4123c8075643 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:50.765757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbccadd-dafc-4c0d-a998-4123c8075643 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:50.766029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbccadd-dafc-4c0d-a998-4123c8075643 admin admin] PATH_INFO: `/v3/projects/3f66c56bc12b44e691cd7bdced027ff0/users/a4ad2c21ddee44ff9add7032545a1333/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:50.804106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbccadd-dafc-4c0d-a998-4123c8075643 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f66c56bc12b44e691cd7bdced027ff0, user_id=a4ad2c21ddee44ff9add7032545a1333, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:50.811294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbccadd-dafc-4c0d-a998-4123c8075643 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:50.844187 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1729/3482] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:50 2022] PUT /identity/v3/projects/3f66c56bc12b44e691cd7bdced027ff0/users/a4ad2c21ddee44ff9add7032545a1333/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:50.850114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86acc9-58b1-4902-81b3-cad0192a1020 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:50.851634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86acc9-58b1-4902-81b3-cad0192a1020 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:50.852306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86acc9-58b1-4902-81b3-cad0192a1020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:50.984094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-df86acc9-58b1-4902-81b3-cad0192a1020 None None] MFA Rules not processed for user `a4ad2c21ddee44ff9add7032545a1333`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:50.985949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-df86acc9-58b1-4902-81b3-cad0192a1020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:51.155992 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1754/3483] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:51.161131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbccadd-dafc-4c0d-a998-4123c8075643 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:51.252739 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:51.332792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbccadd-dafc-4c0d-a998-4123c8075643 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:51.345128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b974d4-e09c-425c-b188-7da35a7eec46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:51.346572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b974d4-e09c-425c-b188-7da35a7eec46 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:51.347157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b974d4-e09c-425c-b188-7da35a7eec46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:51.347476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b974d4-e09c-425c-b188-7da35a7eec46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:51.349117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b974d4-e09c-425c-b188-7da35a7eec46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:51.352880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b974d4-e09c-425c-b188-7da35a7eec46 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:51.410383 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1730/3484] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:04:51 2022] POST /identity/v3/projects => generated 369 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:51.412096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86acc9-58b1-4902-81b3-cad0192a1020 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:51.433117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86acc9-58b1-4902-81b3-cad0192a1020 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:51.556081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7225de1-d87e-4ffe-b434-2142a6adbc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:51.558004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7225de1-d87e-4ffe-b434-2142a6adbc07 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:51.558401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7225de1-d87e-4ffe-b434-2142a6adbc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:51.558794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7225de1-d87e-4ffe-b434-2142a6adbc07 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:51.559696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7225de1-d87e-4ffe-b434-2142a6adbc07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:51.563228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7225de1-d87e-4ffe-b434-2142a6adbc07 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:51.605083 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1755/3485] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:04:51 2022] POST /identity/v3/users => generated 291 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:51.606169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b974d4-e09c-425c-b188-7da35a7eec46 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:51.618915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b974d4-e09c-425c-b188-7da35a7eec46 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:51.627434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96a918-563f-4dd6-bded-ff59cadd06fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:51.628678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96a918-563f-4dd6-bded-ff59cadd06fd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:51.629112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96a918-563f-4dd6-bded-ff59cadd06fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:51.629579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96a918-563f-4dd6-bded-ff59cadd06fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:51.630459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96a918-563f-4dd6-bded-ff59cadd06fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:51.633108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96a918-563f-4dd6-bded-ff59cadd06fd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:51.649644 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1731/3486] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:04:51.650394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7225de1-d87e-4ffe-b434-2142a6adbc07 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:51.667286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7225de1-d87e-4ffe-b434-2142a6adbc07 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:51.677869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30556a9a-66d5-47ed-8b74-89358ff7d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:51.678709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30556a9a-66d5-47ed-8b74-89358ff7d7b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:51.680503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30556a9a-66d5-47ed-8b74-89358ff7d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:51.680898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30556a9a-66d5-47ed-8b74-89358ff7d7b4 admin admin] PATH_INFO: `/v3/projects/8a5108c4e882481fa62767503ea0c1fa/users/832255d168ac40f7bf53d0a4694746f8/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:51.699835 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:51.714502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30556a9a-66d5-47ed-8b74-89358ff7d7b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5108c4e882481fa62767503ea0c1fa, user_id=832255d168ac40f7bf53d0a4694746f8, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:51.719269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30556a9a-66d5-47ed-8b74-89358ff7d7b4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:51.760133 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1756/3487] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:51 2022] PUT /identity/v3/projects/8a5108c4e882481fa62767503ea0c1fa/users/832255d168ac40f7bf53d0a4694746f8/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:51.766484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96a918-563f-4dd6-bded-ff59cadd06fd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:51.788313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96a918-563f-4dd6-bded-ff59cadd06fd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:51.897938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb30418b-7561-44e0-afc9-08df113c3834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:51.898864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30418b-7561-44e0-afc9-08df113c3834 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:51.899456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30418b-7561-44e0-afc9-08df113c3834 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:51.899960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb30418b-7561-44e0-afc9-08df113c3834 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:51.901716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30418b-7561-44e0-afc9-08df113c3834 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:51.903982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb30418b-7561-44e0-afc9-08df113c3834 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:51.919458 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1732/3488] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:51 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:51.924710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30556a9a-66d5-47ed-8b74-89358ff7d7b4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:51.945181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30556a9a-66d5-47ed-8b74-89358ff7d7b4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:51.958204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c8c6-1d05-4cde-91ba-586c6c988819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:51.960284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c8c6-1d05-4cde-91ba-586c6c988819 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:51.961711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c8c6-1d05-4cde-91ba-586c6c988819 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:51.962574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b36c8c6-1d05-4cde-91ba-586c6c988819 admin admin] PATH_INFO: `/v3/projects/8a5108c4e882481fa62767503ea0c1fa/users/832255d168ac40f7bf53d0a4694746f8/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:51.968159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36c8c6-1d05-4cde-91ba-586c6c988819 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a5108c4e882481fa62767503ea0c1fa, user_id=832255d168ac40f7bf53d0a4694746f8, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:51.974688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b36c8c6-1d05-4cde-91ba-586c6c988819 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:52.019505 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1757/3489] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:51 2022] PUT /identity/v3/projects/8a5108c4e882481fa62767503ea0c1fa/users/832255d168ac40f7bf53d0a4694746f8/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:52.035481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633fa57-45b1-42b5-9e42-c11bf101ef3c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:52.036042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633fa57-45b1-42b5-9e42-c11bf101ef3c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:52.036417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d633fa57-45b1-42b5-9e42-c11bf101ef3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:52.108037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d633fa57-45b1-42b5-9e42-c11bf101ef3c None None] MFA Rules not processed for user `832255d168ac40f7bf53d0a4694746f8`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:52.110939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d633fa57-45b1-42b5-9e42-c11bf101ef3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:52.255993 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1733/3490] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:52 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:52.273038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c8c6-1d05-4cde-91ba-586c6c988819 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:52.276982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8b36c8c6-1d05-4cde-91ba-586c6c988819 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:52.388295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b36c8c6-1d05-4cde-91ba-586c6c988819 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:52.393791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d45a3b-4743-4463-ba12-59d037ad278a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:52.394535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45a3b-4743-4463-ba12-59d037ad278a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:52.394815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45a3b-4743-4463-ba12-59d037ad278a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:52.395087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d45a3b-4743-4463-ba12-59d037ad278a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:52.418333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d45a3b-4743-4463-ba12-59d037ad278a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:52.419808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d45a3b-4743-4463-ba12-59d037ad278a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:52.443859 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1758/3491] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:52 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:55.493551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633fa57-45b1-42b5-9e42-c11bf101ef3c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:55.537227 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:55.616795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d633fa57-45b1-42b5-9e42-c11bf101ef3c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:55.624075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:55.624965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:55.625463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:55.625815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] PATH_INFO: `/v3/users/a4ad2c21ddee44ff9add7032545a1333` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:55.628594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4ad2c21ddee44ff9add7032545a1333)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:55.632606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:55.741560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4ad2c21ddee44ff9add7032545a1333'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:55.772553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4ad2c21ddee44ff9add7032545a1333'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:55.774174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4ad2c21ddee44ff9add7032545a1333'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:55.794537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4ad2c21ddee44ff9add7032545a1333'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:55.810373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4ad2c21ddee44ff9add7032545a1333'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:55.819988 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1734/3492] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:55 2022] DELETE /identity/v3/users/a4ad2c21ddee44ff9add7032545a1333 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:55.824719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df440ef2-0293-46df-b251-c34af5b517e4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:55.825243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df440ef2-0293-46df-b251-c34af5b517e4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:55.825401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df440ef2-0293-46df-b251-c34af5b517e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:55.856370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-df440ef2-0293-46df-b251-c34af5b517e4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:55.858639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-df440ef2-0293-46df-b251-c34af5b517e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:55.946231 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1759/3493] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:55.964500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:55.966339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:56.040279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d47d432-22eb-4b23-8c64-e95223607a82 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:56.054849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc34f87-7817-4c06-80c7-8641ca604c58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:56.055896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34f87-7817-4c06-80c7-8641ca604c58 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:56.056437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34f87-7817-4c06-80c7-8641ca604c58 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:56.057561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc34f87-7817-4c06-80c7-8641ca604c58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:56.070228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc34f87-7817-4c06-80c7-8641ca604c58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:56.071809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc34f87-7817-4c06-80c7-8641ca604c58 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:56.085042 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1735/3494] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:56.273606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df440ef2-0293-46df-b251-c34af5b517e4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:56.276693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-df440ef2-0293-46df-b251-c34af5b517e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:56.296207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df440ef2-0293-46df-b251-c34af5b517e4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:56.311421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:56.312322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:56.312791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:56.313220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] PATH_INFO: `/v3/users/0faa202378cf499581a14f05c7cfa9c8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:56.316157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0faa202378cf499581a14f05c7cfa9c8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:56.318536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:56.382080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0faa202378cf499581a14f05c7cfa9c8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.398272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0faa202378cf499581a14f05c7cfa9c8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.399154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0faa202378cf499581a14f05c7cfa9c8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.417128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0faa202378cf499581a14f05c7cfa9c8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.419150 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:56.429697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0faa202378cf499581a14f05c7cfa9c8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.440740 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1760/3495] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:56 2022] DELETE /identity/v3/users/0faa202378cf499581a14f05c7cfa9c8 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:56.604350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc34f87-7817-4c06-80c7-8641ca604c58 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:56.607342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0fc34f87-7817-4c06-80c7-8641ca604c58 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:56.648030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc34f87-7817-4c06-80c7-8641ca604c58 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:56.692729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:56.694277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:56.713788 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:56.762353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:56.763405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:56.764051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:56.764435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] PATH_INFO: `/v3/projects/3f66c56bc12b44e691cd7bdced027ff0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:56.765867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f66c56bc12b44e691cd7bdced027ff0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:56.768637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:56.816954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17678ff2-ec3b-45dd-b753-188b02e82f73 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:56.823103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:56.824013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:56.824013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:56.824282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] PATH_INFO: `/v3/projects/5297380773734f4ab82dbb83f1c855e0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:56.825516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5297380773734f4ab82dbb83f1c855e0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:56.827418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:56.841765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f66c56bc12b44e691cd7bdced027ff0', 'request_id': 'req-8b172b1f-1999-4225-8920-c0cac1fba9eb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.849475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f66c56bc12b44e691cd7bdced027ff0', 'request_id': 'req-8b172b1f-1999-4225-8920-c0cac1fba9eb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.872944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f66c56bc12b44e691cd7bdced027ff0', 'request_id': 'req-8b172b1f-1999-4225-8920-c0cac1fba9eb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.887007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] The token cache is being invalidate because project 3f66c56bc12b44e691cd7bdced027ff0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:56.887330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.888621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.894199 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1736/3496] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:56 2022] DELETE /identity/v3/projects/3f66c56bc12b44e691cd7bdced027ff0 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:56.895095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:56.896841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:56.911707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5297380773734f4ab82dbb83f1c855e0', 'request_id': 'req-a025f8f2-71f9-4845-8578-86affd9bca71'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.941046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5297380773734f4ab82dbb83f1c855e0', 'request_id': 'req-a025f8f2-71f9-4845-8578-86affd9bca71'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:56.955127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5297380773734f4ab82dbb83f1c855e0', 'request_id': 'req-a025f8f2-71f9-4845-8578-86affd9bca71'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.011337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] The token cache is being invalidate because project 5297380773734f4ab82dbb83f1c855e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:57.011727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.013331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b172b1f-1999-4225-8920-c0cac1fba9eb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.013575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a025f8f2-71f9-4845-8578-86affd9bca71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.023017 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1761/3497] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:56 2022] DELETE /identity/v3/projects/5297380773734f4ab82dbb83f1c855e0 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:57.027704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05800e-4e97-4df2-b238-946f1bf0f67b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.027995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05800e-4e97-4df2-b238-946f1bf0f67b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.028272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05800e-4e97-4df2-b238-946f1bf0f67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.063703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dc05800e-4e97-4df2-b238-946f1bf0f67b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:57.065111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc05800e-4e97-4df2-b238-946f1bf0f67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:57.102150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.102914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.103264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.103613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] PATH_INFO: `/v3/users/832255d168ac40f7bf53d0a4694746f8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.104836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=832255d168ac40f7bf53d0a4694746f8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.106969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.149150 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:57.174740 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1762/3498] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:57.175034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '832255d168ac40f7bf53d0a4694746f8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.182787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e93ec-348f-4a22-9f16-9c61b9869ae8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.183072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e93ec-348f-4a22-9f16-9c61b9869ae8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.183347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e93ec-348f-4a22-9f16-9c61b9869ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.188160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '832255d168ac40f7bf53d0a4694746f8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.188998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '832255d168ac40f7bf53d0a4694746f8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.197804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '832255d168ac40f7bf53d0a4694746f8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.207809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ff4e93ec-348f-4a22-9f16-9c61b9869ae8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:57.208008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '832255d168ac40f7bf53d0a4694746f8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.210429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff4e93ec-348f-4a22-9f16-9c61b9869ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:57.214729 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1737/3499] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:56 2022] DELETE /identity/v3/users/832255d168ac40f7bf53d0a4694746f8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:57.223056 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1763/3500] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:57.226520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.308646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81709611-0951-446c-9e9f-653c0ff9d466 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.317724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd9649-6ffd-488b-b991-6fae35146365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.318608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9649-6ffd-488b-b991-6fae35146365 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.318916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9649-6ffd-488b-b991-6fae35146365 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.319318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cd9649-6ffd-488b-b991-6fae35146365 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.320063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd9649-6ffd-488b-b991-6fae35146365 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:04:57.320459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd9649-6ffd-488b-b991-6fae35146365 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.322329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cd9649-6ffd-488b-b991-6fae35146365 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.342211 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1738/3501] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:04:57.345865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e93ec-348f-4a22-9f16-9c61b9869ae8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.356482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e93ec-348f-4a22-9f16-9c61b9869ae8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.362579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12485e76-6766-464c-b636-fc1da82030b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.363189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12485e76-6766-464c-b636-fc1da82030b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.363468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12485e76-6766-464c-b636-fc1da82030b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.363761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12485e76-6766-464c-b636-fc1da82030b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.364402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12485e76-6766-464c-b636-fc1da82030b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.366510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12485e76-6766-464c-b636-fc1da82030b8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.379700 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:57.408707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd9649-6ffd-488b-b991-6fae35146365 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.410054 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1764/3502] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:04:57 2022] POST /identity/v3/projects => generated 361 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:04:57.423602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cd9649-6ffd-488b-b991-6fae35146365 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.492076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791622a-7af1-4a43-bbd1-66d13f02d189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.492968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791622a-7af1-4a43-bbd1-66d13f02d189 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.493363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791622a-7af1-4a43-bbd1-66d13f02d189 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.493644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2791622a-7af1-4a43-bbd1-66d13f02d189 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.494460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791622a-7af1-4a43-bbd1-66d13f02d189 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.497258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2791622a-7af1-4a43-bbd1-66d13f02d189 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.524438 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1739/3503] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:04:57 2022] POST /identity/v3/users => generated 281 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:57.529056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12485e76-6766-464c-b636-fc1da82030b8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.544055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12485e76-6766-464c-b636-fc1da82030b8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.545606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791622a-7af1-4a43-bbd1-66d13f02d189 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.547275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2791622a-7af1-4a43-bbd1-66d13f02d189 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:57.558069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce7be0-d405-4fdf-99f4-228397f16993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.558711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce7be0-d405-4fdf-99f4-228397f16993 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.559040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce7be0-d405-4fdf-99f4-228397f16993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.559483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ce7be0-d405-4fdf-99f4-228397f16993 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.560147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce7be0-d405-4fdf-99f4-228397f16993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.564169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ce7be0-d405-4fdf-99f4-228397f16993 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.567485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2791622a-7af1-4a43-bbd1-66d13f02d189 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.575775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.576305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.576595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.576859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] PATH_INFO: `/v3/projects/8a5108c4e882481fa62767503ea0c1fa` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.578617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a5108c4e882481fa62767503ea0c1fa)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.582203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.585615 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1765/3504] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:57.589715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce7be0-d405-4fdf-99f4-228397f16993 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.602205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ce7be0-d405-4fdf-99f4-228397f16993 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.607446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e1126-f651-47db-ac2d-21f0a5957e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.608400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e1126-f651-47db-ac2d-21f0a5957e8b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.608682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e1126-f651-47db-ac2d-21f0a5957e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.608956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e1126-f651-47db-ac2d-21f0a5957e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.609904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e1126-f651-47db-ac2d-21f0a5957e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.611660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e1126-f651-47db-ac2d-21f0a5957e8b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.622452 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:57.624346 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1766/3505] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:57.629963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e1126-f651-47db-ac2d-21f0a5957e8b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.642729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e1126-f651-47db-ac2d-21f0a5957e8b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.647542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c6502-299f-48f0-8a94-4364d3d83db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.648168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6502-299f-48f0-8a94-4364d3d83db8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.648418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6502-299f-48f0-8a94-4364d3d83db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.648692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6502-299f-48f0-8a94-4364d3d83db8 admin admin] PATH_INFO: `/v3/projects/f064dddc22864e70acf391a98d697022/users/cd7b21f395df4520b96c5f5559af11ba/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.665523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a5108c4e882481fa62767503ea0c1fa', 'request_id': 'req-de6ff6da-14f0-46ee-88f2-f2d21998bce6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.666236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c6502-299f-48f0-8a94-4364d3d83db8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f064dddc22864e70acf391a98d697022, user_id=cd7b21f395df4520b96c5f5559af11ba, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.669201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c6502-299f-48f0-8a94-4364d3d83db8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.673741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a5108c4e882481fa62767503ea0c1fa', 'request_id': 'req-de6ff6da-14f0-46ee-88f2-f2d21998bce6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.684746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a5108c4e882481fa62767503ea0c1fa', 'request_id': 'req-de6ff6da-14f0-46ee-88f2-f2d21998bce6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.693115 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1767/3506] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:57 2022] PUT /identity/v3/projects/f064dddc22864e70acf391a98d697022/users/cd7b21f395df4520b96c5f5559af11ba/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:57.707278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] The token cache is being invalidate because project 8a5108c4e882481fa62767503ea0c1fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:57.708541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc663d88-86fe-4b7b-9fb3-be0646ebd6d4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.709372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc663d88-86fe-4b7b-9fb3-be0646ebd6d4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.709863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc663d88-86fe-4b7b-9fb3-be0646ebd6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.711939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.713107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-de6ff6da-14f0-46ee-88f2-f2d21998bce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:57.715014 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1740/3507] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:57 2022] DELETE /identity/v3/projects/8a5108c4e882481fa62767503ea0c1fa => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:04:57.721163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1f441-c888-4276-8f7b-471c4847368c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.721494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1f441-c888-4276-8f7b-471c4847368c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.722576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1f441-c888-4276-8f7b-471c4847368c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.748576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dc663d88-86fe-4b7b-9fb3-be0646ebd6d4 None None] MFA Rules not processed for user `cd7b21f395df4520b96c5f5559af11ba`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:57.750033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc663d88-86fe-4b7b-9fb3-be0646ebd6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:57.750308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1ca1f441-c888-4276-8f7b-471c4847368c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:57.751939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1ca1f441-c888-4276-8f7b-471c4847368c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:57.828733 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1741/3508] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:57.837062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eb5e5-f869-4f70-bcb0-a4cb51f1cee3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.837377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eb5e5-f869-4f70-bcb0-a4cb51f1cee3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.837659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515eb5e5-f869-4f70-bcb0-a4cb51f1cee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.847204 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1768/3509] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:04:57.858220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-515eb5e5-f869-4f70-bcb0-a4cb51f1cee3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:57.858400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc663d88-86fe-4b7b-9fb3-be0646ebd6d4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.859437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-515eb5e5-f869-4f70-bcb0-a4cb51f1cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:57.859590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc663d88-86fe-4b7b-9fb3-be0646ebd6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:57.867659 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1742/3510] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:04:57.871869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515eb5e5-f869-4f70-bcb0-a4cb51f1cee3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.881971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515eb5e5-f869-4f70-bcb0-a4cb51f1cee3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.887104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be20fde-cc67-42a7-a8b1-6a39831fc422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.887788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be20fde-cc67-42a7-a8b1-6a39831fc422 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.888066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be20fde-cc67-42a7-a8b1-6a39831fc422 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.888349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be20fde-cc67-42a7-a8b1-6a39831fc422 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.888995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be20fde-cc67-42a7-a8b1-6a39831fc422 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:04:57.889530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be20fde-cc67-42a7-a8b1-6a39831fc422 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.890916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be20fde-cc67-42a7-a8b1-6a39831fc422 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.906096 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1743/3511] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:04:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:04:57.912145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be20fde-cc67-42a7-a8b1-6a39831fc422 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.925083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be20fde-cc67-42a7-a8b1-6a39831fc422 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.930219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b313a-0d55-4d52-9f85-4cfee0e938bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.930896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b313a-0d55-4d52-9f85-4cfee0e938bd admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.931182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b313a-0d55-4d52-9f85-4cfee0e938bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.931454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605b313a-0d55-4d52-9f85-4cfee0e938bd admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.932087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b313a-0d55-4d52-9f85-4cfee0e938bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.934246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605b313a-0d55-4d52-9f85-4cfee0e938bd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.940669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc663d88-86fe-4b7b-9fb3-be0646ebd6d4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:57.946517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe88f-9851-4ec9-974a-fc3fac021248 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:57.947127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe88f-9851-4ec9-974a-fc3fac021248 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:57.947405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe88f-9851-4ec9-974a-fc3fac021248 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:57.947677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcbe88f-9851-4ec9-974a-fc3fac021248 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:57.956885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe88f-9851-4ec9-974a-fc3fac021248 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:57.958552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcbe88f-9851-4ec9-974a-fc3fac021248 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:57.968446 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1769/3512] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:57.976976 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1744/3513] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:04:57 2022] POST /identity/v3/projects => generated 371 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:04:57.978164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe88f-9851-4ec9-974a-fc3fac021248 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:57.991944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcbe88f-9851-4ec9-974a-fc3fac021248 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:58.015184 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:58.019190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b313a-0d55-4d52-9f85-4cfee0e938bd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:58.021647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-605b313a-0d55-4d52-9f85-4cfee0e938bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:58.083041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0fd61-d658-40bf-8dde-bb6a7d5e3d15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:58.083988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0fd61-d658-40bf-8dde-bb6a7d5e3d15 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:58.086558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0fd61-d658-40bf-8dde-bb6a7d5e3d15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:58.086714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d0fd61-d658-40bf-8dde-bb6a7d5e3d15 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:58.087464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0fd61-d658-40bf-8dde-bb6a7d5e3d15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:58.089905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d0fd61-d658-40bf-8dde-bb6a7d5e3d15 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:58.121114 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1770/3514] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:04:57 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:04:58.121340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605b313a-0d55-4d52-9f85-4cfee0e938bd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:58.123706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0fd61-d658-40bf-8dde-bb6a7d5e3d15 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:58.124768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:58.125430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:58.125710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:58.126758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] PATH_INFO: `/v3/users/cd7b21f395df4520b96c5f5559af11ba` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:58.127970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd7b21f395df4520b96c5f5559af11ba)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:58.129925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:58.137101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d0fd61-d658-40bf-8dde-bb6a7d5e3d15 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:58.142233 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:58.144067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e6619-55eb-4205-8e5e-4108b6120737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:58.145004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6619-55eb-4205-8e5e-4108b6120737 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:58.145449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6619-55eb-4205-8e5e-4108b6120737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:58.145997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e6619-55eb-4205-8e5e-4108b6120737 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:58.146720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e6619-55eb-4205-8e5e-4108b6120737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:58.148420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e6619-55eb-4205-8e5e-4108b6120737 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:58.164554 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1771/3515] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:58.168261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e6619-55eb-4205-8e5e-4108b6120737 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:58.182480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e6619-55eb-4205-8e5e-4108b6120737 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:58.192133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0f6a3-1b99-4e1c-935f-2721c62d34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:58.192631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0f6a3-1b99-4e1c-935f-2721c62d34ad admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:58.192867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0f6a3-1b99-4e1c-935f-2721c62d34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:58.193159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf0f6a3-1b99-4e1c-935f-2721c62d34ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:58.194390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0f6a3-1b99-4e1c-935f-2721c62d34ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:58.195453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf0f6a3-1b99-4e1c-935f-2721c62d34ad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:58.209007 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1772/3516] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:58 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:04:58.212981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd7b21f395df4520b96c5f5559af11ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:58.213650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0f6a3-1b99-4e1c-935f-2721c62d34ad admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:58.225388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf0f6a3-1b99-4e1c-935f-2721c62d34ad admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:58.229337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd7b21f395df4520b96c5f5559af11ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:58.230427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd7b21f395df4520b96c5f5559af11ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:58.231574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b31af4-6aa9-4a88-837d-7315db56ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:58.232233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31af4-6aa9-4a88-837d-7315db56ffc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:58.232511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31af4-6aa9-4a88-837d-7315db56ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:58.232790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b31af4-6aa9-4a88-837d-7315db56ffc0 admin admin] PATH_INFO: `/v3/projects/c0bd5630deeb45d6941c4f9c3e71e145/users/b2da2f47ad97447da5f4384f1e443dba/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:58.241633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd7b21f395df4520b96c5f5559af11ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:58.249232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b31af4-6aa9-4a88-837d-7315db56ffc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0bd5630deeb45d6941c4f9c3e71e145, user_id=b2da2f47ad97447da5f4384f1e443dba, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:58.252238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5d73e6eb-6af8-459c-b550-6ec0dbeef823 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd7b21f395df4520b96c5f5559af11ba'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:58.253784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b31af4-6aa9-4a88-837d-7315db56ffc0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:58.264317 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1745/3517] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:04:58 2022] DELETE /identity/v3/users/cd7b21f395df4520b96c5f5559af11ba => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:04:58.269606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6834a-679a-44cd-98ad-a5a6b0be94c6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:58.269938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6834a-679a-44cd-98ad-a5a6b0be94c6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:58.270226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6834a-679a-44cd-98ad-a5a6b0be94c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:58.280610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1773/3518] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:58 2022] PUT /identity/v3/projects/c0bd5630deeb45d6941c4f9c3e71e145/users/b2da2f47ad97447da5f4384f1e443dba/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:04:58.292935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8745-798d-472f-bb58-460511da606a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:58.293199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8745-798d-472f-bb58-460511da606a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:58.293515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a8745-798d-472f-bb58-460511da606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:58.306062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f1b6834a-679a-44cd-98ad-a5a6b0be94c6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:58.307454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f1b6834a-679a-44cd-98ad-a5a6b0be94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:58.328547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e26a8745-798d-472f-bb58-460511da606a None None] MFA Rules not processed for user `b2da2f47ad97447da5f4384f1e443dba`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:58.330481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e26a8745-798d-472f-bb58-460511da606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:58.416415 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1746/3519] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:58.427710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6834a-679a-44cd-98ad-a5a6b0be94c6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:58.428888 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1774/3520] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:04:58.429633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f1b6834a-679a-44cd-98ad-a5a6b0be94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:58.441521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a8745-798d-472f-bb58-460511da606a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:58.443617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e26a8745-798d-472f-bb58-460511da606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:58.524313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6834a-679a-44cd-98ad-a5a6b0be94c6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:58.537049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867583fe-03fd-4685-b73a-02d21e589661 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:58.537049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867583fe-03fd-4685-b73a-02d21e589661 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:58.537925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867583fe-03fd-4685-b73a-02d21e589661 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:58.537925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867583fe-03fd-4685-b73a-02d21e589661 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:58.543837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a8745-798d-472f-bb58-460511da606a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:58.548758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ac93c8-7027-4d73-ab41-8b7fd4d43c4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:58.549414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac93c8-7027-4d73-ab41-8b7fd4d43c4b service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:58.549698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac93c8-7027-4d73-ab41-8b7fd4d43c4b service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:58.549972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ac93c8-7027-4d73-ab41-8b7fd4d43c4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:58.558144 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:58.560336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867583fe-03fd-4685-b73a-02d21e589661 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:58.561962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867583fe-03fd-4685-b73a-02d21e589661 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:58.564837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac93c8-7027-4d73-ab41-8b7fd4d43c4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:58.569500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ac93c8-7027-4d73-ab41-8b7fd4d43c4b service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:58.603181 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1775/3521] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:58 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:04:58.605511 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1747/3522] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:04:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:04:59.056546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa7c1-adfe-4afe-b6ef-67adbbafad3d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.057475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa7c1-adfe-4afe-b6ef-67adbbafad3d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.057979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa7c1-adfe-4afe-b6ef-67adbbafad3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:59.081255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-60efa7c1-adfe-4afe-b6ef-67adbbafad3d None None] MFA Rules not processed for user `09b32a47b2874040a560e3f3776fdff9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:59.082756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60efa7c1-adfe-4afe-b6ef-67adbbafad3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:59.140436 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1776/3523] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:59.354027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867583fe-03fd-4685-b73a-02d21e589661 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:59.355703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-867583fe-03fd-4685-b73a-02d21e589661 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:59.380137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867583fe-03fd-4685-b73a-02d21e589661 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:59.390392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:59.391050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.391327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.392154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] PATH_INFO: `/v3/projects/f064dddc22864e70acf391a98d697022` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:59.393378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f064dddc22864e70acf391a98d697022)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:59.395427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:59.451261 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:04:59.489196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f064dddc22864e70acf391a98d697022', 'request_id': 'req-58e10261-9f9b-4eff-9c42-186456f29b9f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:59.497482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f064dddc22864e70acf391a98d697022', 'request_id': 'req-58e10261-9f9b-4eff-9c42-186456f29b9f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:59.506658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f064dddc22864e70acf391a98d697022', 'request_id': 'req-58e10261-9f9b-4eff-9c42-186456f29b9f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:59.518208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] The token cache is being invalidate because project f064dddc22864e70acf391a98d697022 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:04:59.518562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:59.519616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58e10261-9f9b-4eff-9c42-186456f29b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:04:59.521105 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1748/3524] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:04:59 2022] DELETE /identity/v3/projects/f064dddc22864e70acf391a98d697022 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:04:59.526190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045f297-ba13-4d52-a8a0-91770de8ff15 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.526527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045f297-ba13-4d52-a8a0-91770de8ff15 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.526754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2045f297-ba13-4d52-a8a0-91770de8ff15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:59.545953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2045f297-ba13-4d52-a8a0-91770de8ff15 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:59.547141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2045f297-ba13-4d52-a8a0-91770de8ff15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:59.616094 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1777/3525] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:04:59.623736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f6cf7-d552-4dac-833f-e1d918b8ba4e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.624099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f6cf7-d552-4dac-833f-e1d918b8ba4e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.624469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01f6cf7-d552-4dac-833f-e1d918b8ba4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:59.645558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e01f6cf7-d552-4dac-833f-e1d918b8ba4e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:04:59.646880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e01f6cf7-d552-4dac-833f-e1d918b8ba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:04:59.656528 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1749/3526] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:04:59.660912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045f297-ba13-4d52-a8a0-91770de8ff15 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:59.671246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2045f297-ba13-4d52-a8a0-91770de8ff15 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:59.676288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36575e6c-a650-4a8a-8c47-403faa997e74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:59.677001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36575e6c-a650-4a8a-8c47-403faa997e74 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.677330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36575e6c-a650-4a8a-8c47-403faa997e74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.677614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36575e6c-a650-4a8a-8c47-403faa997e74 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:59.678262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36575e6c-a650-4a8a-8c47-403faa997e74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:04:59.678571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36575e6c-a650-4a8a-8c47-403faa997e74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:59.680181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36575e6c-a650-4a8a-8c47-403faa997e74 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:59.696255 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1778/3527] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:04:59.697416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f6cf7-d552-4dac-833f-e1d918b8ba4e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:59.708475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01f6cf7-d552-4dac-833f-e1d918b8ba4e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:59.713189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738168ff-5c30-4220-8c97-d6a8fc8d9284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:59.713975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738168ff-5c30-4220-8c97-d6a8fc8d9284 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.714385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738168ff-5c30-4220-8c97-d6a8fc8d9284 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.714589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738168ff-5c30-4220-8c97-d6a8fc8d9284 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:59.715155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738168ff-5c30-4220-8c97-d6a8fc8d9284 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:59.717063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738168ff-5c30-4220-8c97-d6a8fc8d9284 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:59.751760 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1750/3528] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:04:59 2022] POST /identity/v3/projects => generated 385 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:59.756176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36575e6c-a650-4a8a-8c47-403faa997e74 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:59.771055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36575e6c-a650-4a8a-8c47-403faa997e74 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:59.838310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e937-61d2-4634-9a2e-48d557c78f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:59.839019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e937-61d2-4634-9a2e-48d557c78f5b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.839364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e937-61d2-4634-9a2e-48d557c78f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.839705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb4e937-61d2-4634-9a2e-48d557c78f5b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:59.840416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4e937-61d2-4634-9a2e-48d557c78f5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:59.842693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fb4e937-61d2-4634-9a2e-48d557c78f5b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:59.872576 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1779/3529] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:04:59 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:04:59.873767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738168ff-5c30-4220-8c97-d6a8fc8d9284 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:59.889341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738168ff-5c30-4220-8c97-d6a8fc8d9284 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:59.895590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358bfda-4bd9-4818-ab23-8cdd021a02b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:59.896607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358bfda-4bd9-4818-ab23-8cdd021a02b3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.896607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358bfda-4bd9-4818-ab23-8cdd021a02b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.896946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e358bfda-4bd9-4818-ab23-8cdd021a02b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:59.898481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358bfda-4bd9-4818-ab23-8cdd021a02b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:59.899722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e358bfda-4bd9-4818-ab23-8cdd021a02b3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:59.915381 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1751/3530] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:59.919965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e937-61d2-4634-9a2e-48d557c78f5b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:59.931729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb4e937-61d2-4634-9a2e-48d557c78f5b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:59.939551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e754eb-7f99-4116-88e7-0c3677e40ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:59.940315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e754eb-7f99-4116-88e7-0c3677e40ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.940644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e754eb-7f99-4116-88e7-0c3677e40ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.941024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e754eb-7f99-4116-88e7-0c3677e40ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:04:59.941897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e754eb-7f99-4116-88e7-0c3677e40ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:04:59.943978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e754eb-7f99-4116-88e7-0c3677e40ba0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:04:59.957344 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1780/3531] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:04:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:04:59.960706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358bfda-4bd9-4818-ab23-8cdd021a02b3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:04:59.971675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e358bfda-4bd9-4818-ab23-8cdd021a02b3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:04:59.977056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f11248-444f-4cdf-9e55-f6dc40d2e5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:04:59.977763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f11248-444f-4cdf-9e55-f6dc40d2e5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:04:59.982440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f11248-444f-4cdf-9e55-f6dc40d2e5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:04:59.982812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f11248-444f-4cdf-9e55-f6dc40d2e5f3 admin admin] PATH_INFO: `/v3/projects/62a15639dcb743da88acbde43c90e3a9/users/1e38267e38654eadbefc711d55365c91/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:00.005961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f11248-444f-4cdf-9e55-f6dc40d2e5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a15639dcb743da88acbde43c90e3a9, user_id=1e38267e38654eadbefc711d55365c91, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:00.009404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f11248-444f-4cdf-9e55-f6dc40d2e5f3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:00.038535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1752/3532] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:04:59 2022] PUT /identity/v3/projects/62a15639dcb743da88acbde43c90e3a9/users/1e38267e38654eadbefc711d55365c91/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:05:00.040137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eac44-5d05-4aa5-8c48-abcaee21a5eb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:00.040426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eac44-5d05-4aa5-8c48-abcaee21a5eb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:00.040702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991eac44-5d05-4aa5-8c48-abcaee21a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:00.057086 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:00.067179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-991eac44-5d05-4aa5-8c48-abcaee21a5eb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:00.068633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-991eac44-5d05-4aa5-8c48-abcaee21a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:00.221523 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1781/3533] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:05:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:05:00.235677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f11248-444f-4cdf-9e55-f6dc40d2e5f3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:00.237989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-62f11248-444f-4cdf-9e55-f6dc40d2e5f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:00.359120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f11248-444f-4cdf-9e55-f6dc40d2e5f3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:00.369123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3053b981-95c9-4225-8c5d-b1635b01fb79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:00.369868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b981-95c9-4225-8c5d-b1635b01fb79 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:00.370407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b981-95c9-4225-8c5d-b1635b01fb79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:00.370697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3053b981-95c9-4225-8c5d-b1635b01fb79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:00.386726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053b981-95c9-4225-8c5d-b1635b01fb79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:00.388443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3053b981-95c9-4225-8c5d-b1635b01fb79 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:00.418585 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1753/3534] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:05:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:05:01.287556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9421d-8ccd-4c7c-ad3c-3c392ffc4a90 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:01.287987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9421d-8ccd-4c7c-ad3c-3c392ffc4a90 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:01.288090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a9421d-8ccd-4c7c-ad3c-3c392ffc4a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:01.325589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f6a9421d-8ccd-4c7c-ad3c-3c392ffc4a90 None None] MFA Rules not processed for user `e20476ff91b34c24b84e67e4416b13b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:01.326797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6a9421d-8ccd-4c7c-ad3c-3c392ffc4a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:01.412804 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1782/3535] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:05:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:05:10.260461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1af56-9de5-4084-8223-11432e34703f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:10.260985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1af56-9de5-4084-8223-11432e34703f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:10.260985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc1af56-9de5-4084-8223-11432e34703f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:10.325017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-afc1af56-9de5-4084-8223-11432e34703f None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:10.327880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-afc1af56-9de5-4084-8223-11432e34703f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:10.476362 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:10.489847 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1754/3536] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:05:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:05:10.574007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9421d-8ccd-4c7c-ad3c-3c392ffc4a90 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:10.575440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6a9421d-8ccd-4c7c-ad3c-3c392ffc4a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:10.683013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a9421d-8ccd-4c7c-ad3c-3c392ffc4a90 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:10.702106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a59861-7d2e-488a-907a-1950ca9af9fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:10.702761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a59861-7d2e-488a-907a-1950ca9af9fa service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:10.703058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a59861-7d2e-488a-907a-1950ca9af9fa service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:10.703341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a59861-7d2e-488a-907a-1950ca9af9fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:10.721099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a59861-7d2e-488a-907a-1950ca9af9fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:10.723287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a59861-7d2e-488a-907a-1950ca9af9fa service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:10.737043 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1783/3537] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:05:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:05:13.258813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd590e8-dade-4a9f-ab87-0dbd259ce691 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:13.259287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd590e8-dade-4a9f-ab87-0dbd259ce691 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:13.259373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd590e8-dade-4a9f-ab87-0dbd259ce691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:13.356450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1fd590e8-dade-4a9f-ab87-0dbd259ce691 None None] MFA Rules not processed for user `1e38267e38654eadbefc711d55365c91`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:13.358369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1fd590e8-dade-4a9f-ab87-0dbd259ce691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:13.505338 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1755/3538] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:05:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:05:13.519568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a59861-7d2e-488a-907a-1950ca9af9fa service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:13.521826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-36a59861-7d2e-488a-907a-1950ca9af9fa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:13.621746 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:13.723054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a59861-7d2e-488a-907a-1950ca9af9fa service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:13.732160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a130a-0bdd-4bd7-823a-d8f4cc94c519 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:13.732713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a130a-0bdd-4bd7-823a-d8f4cc94c519 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:13.733202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a130a-0bdd-4bd7-823a-d8f4cc94c519 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:13.733629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a130a-0bdd-4bd7-823a-d8f4cc94c519 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:13.745084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a130a-0bdd-4bd7-823a-d8f4cc94c519 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:13.747734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a130a-0bdd-4bd7-823a-d8f4cc94c519 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:13.786736 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1784/3539] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:05:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:05:18.399325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e953936-d792-44cf-b6c8-98d3bdde7a60 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:18.400292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e953936-d792-44cf-b6c8-98d3bdde7a60 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:18.400786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e953936-d792-44cf-b6c8-98d3bdde7a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:18.436583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6e953936-d792-44cf-b6c8-98d3bdde7a60 None None] MFA Rules not processed for user `1e38267e38654eadbefc711d55365c91`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:18.438734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6e953936-d792-44cf-b6c8-98d3bdde7a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:18.466866 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1756/3540] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:05:18 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:05:20.366343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a6945-9c7f-4ad3-8d62-1d5959e70a51 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:20.366948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a6945-9c7f-4ad3-8d62-1d5959e70a51 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:20.366948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1a6945-9c7f-4ad3-8d62-1d5959e70a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:20.409763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4b1a6945-9c7f-4ad3-8d62-1d5959e70a51 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:20.413479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4b1a6945-9c7f-4ad3-8d62-1d5959e70a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:20.441138 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1785/3541] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:05:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:05:20.466660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e953936-d792-44cf-b6c8-98d3bdde7a60 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:20.492770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e953936-d792-44cf-b6c8-98d3bdde7a60 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:20.507420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca888f24-ca57-47aa-8c17-8b20b445bae1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:20.508457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca888f24-ca57-47aa-8c17-8b20b445bae1 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:20.508985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca888f24-ca57-47aa-8c17-8b20b445bae1 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:20.509533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca888f24-ca57-47aa-8c17-8b20b445bae1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:20.545568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca888f24-ca57-47aa-8c17-8b20b445bae1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:20.547347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca888f24-ca57-47aa-8c17-8b20b445bae1 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:20.584355 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1757/3542] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:05:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:05:27.753082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072b1c2-d8ff-40dc-82e6-cb84584f2e55 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:27.753583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072b1c2-d8ff-40dc-82e6-cb84584f2e55 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:27.758052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c072b1c2-d8ff-40dc-82e6-cb84584f2e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:27.873799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c072b1c2-d8ff-40dc-82e6-cb84584f2e55 None None] MFA Rules not processed for user `4dde4bb72f914457a633358837d178de`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:27.880089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c072b1c2-d8ff-40dc-82e6-cb84584f2e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:28.091037 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1786/3543] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:05:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:05:30.567067 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=42 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:38.078383 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=43 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:05:40.267226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4c817-5cf9-40e2-a452-1a8f77e778c7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:40.267705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4c817-5cf9-40e2-a452-1a8f77e778c7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:40.268400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce4c817-5cf9-40e2-a452-1a8f77e778c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:40.290563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cce4c817-5cf9-40e2-a452-1a8f77e778c7 None None] MFA Rules not processed for user `e20476ff91b34c24b84e67e4416b13b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:40.292419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cce4c817-5cf9-40e2-a452-1a8f77e778c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:40.308165 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1758/3544] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:05:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:05:48.719208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813127-f28d-40af-b1e7-51f7c31d312b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:48.720200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813127-f28d-40af-b1e7-51f7c31d312b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:48.720483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63813127-f28d-40af-b1e7-51f7c31d312b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:48.743778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-63813127-f28d-40af-b1e7-51f7c31d312b None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:48.745282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-63813127-f28d-40af-b1e7-51f7c31d312b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:48.756660 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1787/3545] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:05:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:05:48.771266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4c817-5cf9-40e2-a452-1a8f77e778c7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:48.788862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce4c817-5cf9-40e2-a452-1a8f77e778c7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:48.798587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57696-fd1f-4f8f-80a5-3a457ccca413 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:48.801456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57696-fd1f-4f8f-80a5-3a457ccca413 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:48.802001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57696-fd1f-4f8f-80a5-3a457ccca413 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:48.802450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b57696-fd1f-4f8f-80a5-3a457ccca413 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:48.813421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b57696-fd1f-4f8f-80a5-3a457ccca413 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:48.815425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b57696-fd1f-4f8f-80a5-3a457ccca413 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:48.829288 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1759/3546] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:05:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:05:50.010164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa9a85-9ac1-44aa-b362-855ce44ebb44 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:50.010777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa9a85-9ac1-44aa-b362-855ce44ebb44 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:50.010777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aa9a85-9ac1-44aa-b362-855ce44ebb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:50.129413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e6aa9a85-9ac1-44aa-b362-855ce44ebb44 None None] MFA Rules not processed for user `09b32a47b2874040a560e3f3776fdff9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:05:50.135377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e6aa9a85-9ac1-44aa-b362-855ce44ebb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:50.227004 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1788/3547] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:05:50 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:05:52.020770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57696-fd1f-4f8f-80a5-3a457ccca413 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:52.022524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-00b57696-fd1f-4f8f-80a5-3a457ccca413 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:52.205734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b57696-fd1f-4f8f-80a5-3a457ccca413 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:52.211980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9a6c-0e66-4d44-a231-2debfd5d1e54 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:52.212963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9a6c-0e66-4d44-a231-2debfd5d1e54 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:52.217388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9a6c-0e66-4d44-a231-2debfd5d1e54 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:52.218026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fd9a6c-0e66-4d44-a231-2debfd5d1e54 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:52.223947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e4fd9a6c-0e66-4d44-a231-2debfd5d1e54 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:52.248710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd9a6c-0e66-4d44-a231-2debfd5d1e54 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:52.251271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fd9a6c-0e66-4d44-a231-2debfd5d1e54 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:52.280612 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1760/3548] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:05:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:05:52.335646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa9a85-9ac1-44aa-b362-855ce44ebb44 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:52.349954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aa9a85-9ac1-44aa-b362-855ce44ebb44 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:52.360142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:52.360789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:52.361048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:52.369484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:52.390995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:52.458726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:52.462822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:52.523014 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1789/3549] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:05:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:05:53.137201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9a6c-0e66-4d44-a231-2debfd5d1e54 service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:53.151352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fd9a6c-0e66-4d44-a231-2debfd5d1e54 service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:53.164491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fb995-d995-4846-b05b-a98c80ff2058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:53.165585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fb995-d995-4846-b05b-a98c80ff2058 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:53.166140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fb995-d995-4846-b05b-a98c80ff2058 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:53.166685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00fb995-d995-4846-b05b-a98c80ff2058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:53.178933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b00fb995-d995-4846-b05b-a98c80ff2058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:53.202465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fb995-d995-4846-b05b-a98c80ff2058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:53.204774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00fb995-d995-4846-b05b-a98c80ff2058 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:53.246368 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1761/3550] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:05:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:05:54.140064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:54.142545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:54.173213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff675d3d-a40b-4917-91a8-1ac7c6e0ed64 service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:54.185976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b04dc3-f3d1-418e-b559-bdbe073c6ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:54.188141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b04dc3-f3d1-418e-b559-bdbe073c6ecf service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:54.188755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b04dc3-f3d1-418e-b559-bdbe073c6ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:54.189282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b04dc3-f3d1-418e-b559-bdbe073c6ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:54.196305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c2b04dc3-f3d1-418e-b559-bdbe073c6ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:54.247518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b04dc3-f3d1-418e-b559-bdbe073c6ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:54.249007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b04dc3-f3d1-418e-b559-bdbe073c6ecf service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:54.272832 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1790/3551] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:05:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:05:59.421365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fb995-d995-4846-b05b-a98c80ff2058 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:05:59.433572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00fb995-d995-4846-b05b-a98c80ff2058 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:05:59.462066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03583be9-9ca6-48b1-a233-173db3e036aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:05:59.462690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583be9-9ca6-48b1-a233-173db3e036aa service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:05:59.465138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583be9-9ca6-48b1-a233-173db3e036aa service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:05:59.465614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03583be9-9ca6-48b1-a233-173db3e036aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:05:59.470834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-03583be9-9ca6-48b1-a233-173db3e036aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:05:59.494902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03583be9-9ca6-48b1-a233-173db3e036aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:05:59.497132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03583be9-9ca6-48b1-a233-173db3e036aa service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:05:59.524046 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1762/3552] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:05:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:06:00.273398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70908d44-0da3-4d0f-8eb4-b33a8d59cfe3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:00.274251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70908d44-0da3-4d0f-8eb4-b33a8d59cfe3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:00.274732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70908d44-0da3-4d0f-8eb4-b33a8d59cfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:00.307744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-70908d44-0da3-4d0f-8eb4-b33a8d59cfe3 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:00.308987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-70908d44-0da3-4d0f-8eb4-b33a8d59cfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:00.347147 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1791/3553] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:06:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:00.353183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03583be9-9ca6-48b1-a233-173db3e036aa service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:00.372914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03583be9-9ca6-48b1-a233-173db3e036aa service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:00.387608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a6ec-7132-4d27-ad54-461d50f3c788 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:00.388380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a6ec-7132-4d27-ad54-461d50f3c788 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:00.388782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a6ec-7132-4d27-ad54-461d50f3c788 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:00.389156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3a6ec-7132-4d27-ad54-461d50f3c788 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:00.403726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3a6ec-7132-4d27-ad54-461d50f3c788 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:00.406832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3a6ec-7132-4d27-ad54-461d50f3c788 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:00.421254 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1763/3554] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:02.072728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70908d44-0da3-4d0f-8eb4-b33a8d59cfe3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:02.090680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70908d44-0da3-4d0f-8eb4-b33a8d59cfe3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:02.105821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393080-0a93-48b3-ad86-4f6467d50278 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:02.106786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393080-0a93-48b3-ad86-4f6467d50278 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:02.107252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393080-0a93-48b3-ad86-4f6467d50278 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:02.107693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba393080-0a93-48b3-ad86-4f6467d50278 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:02.110745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ba393080-0a93-48b3-ad86-4f6467d50278 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:02.139441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba393080-0a93-48b3-ad86-4f6467d50278 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:02.141506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba393080-0a93-48b3-ad86-4f6467d50278 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:02.176225 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1792/3555] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:06:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:06:10.413485 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=53 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:11.316988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a6ec-7132-4d27-ad54-461d50f3c788 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:11.319473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bce3a6ec-7132-4d27-ad54-461d50f3c788 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:11.539550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3a6ec-7132-4d27-ad54-461d50f3c788 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:11.549835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da65f9c-6c7d-4fa1-a1ea-414d96c39627 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:11.550614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65f9c-6c7d-4fa1-a1ea-414d96c39627 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:11.550902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65f9c-6c7d-4fa1-a1ea-414d96c39627 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:11.551993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da65f9c-6c7d-4fa1-a1ea-414d96c39627 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:11.554191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0da65f9c-6c7d-4fa1-a1ea-414d96c39627 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:11.598509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da65f9c-6c7d-4fa1-a1ea-414d96c39627 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:11.600971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da65f9c-6c7d-4fa1-a1ea-414d96c39627 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:11.636858 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1764/3556] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:06:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:06:12.163266 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=49 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:19.367347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393080-0a93-48b3-ad86-4f6467d50278 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:19.392286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba393080-0a93-48b3-ad86-4f6467d50278 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:19.413887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80358699-afa3-44d0-844a-fb4c90385551 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:19.414522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80358699-afa3-44d0-844a-fb4c90385551 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:19.414805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80358699-afa3-44d0-844a-fb4c90385551 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:19.415207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80358699-afa3-44d0-844a-fb4c90385551 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:19.418162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-80358699-afa3-44d0-844a-fb4c90385551 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:19.450654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80358699-afa3-44d0-844a-fb4c90385551 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:19.453941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80358699-afa3-44d0-844a-fb4c90385551 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:19.469375 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1793/3557] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:06:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:06:21.625824 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=32 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:26.455809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f62c0e-6bf9-4972-b178-a359c9cb080d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:26.456380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f62c0e-6bf9-4972-b178-a359c9cb080d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:26.457391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f62c0e-6bf9-4972-b178-a359c9cb080d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:26.504431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d5f62c0e-6bf9-4972-b178-a359c9cb080d None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:26.514192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d5f62c0e-6bf9-4972-b178-a359c9cb080d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:26.523328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1765/3558] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:06:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:26.542486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80358699-afa3-44d0-844a-fb4c90385551 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:26.558460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80358699-afa3-44d0-844a-fb4c90385551 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:26.565749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c6a569-c787-4f1c-b139-d7dd1fa93f1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:26.566599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6a569-c787-4f1c-b139-d7dd1fa93f1b service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:26.567201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6a569-c787-4f1c-b139-d7dd1fa93f1b service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:26.567782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c6a569-c787-4f1c-b139-d7dd1fa93f1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:26.580730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6a569-c787-4f1c-b139-d7dd1fa93f1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:26.582836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c6a569-c787-4f1c-b139-d7dd1fa93f1b service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:26.605381 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1794/3559] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:06:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:27.728530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f62c0e-6bf9-4972-b178-a359c9cb080d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:27.730717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d5f62c0e-6bf9-4972-b178-a359c9cb080d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:27.764171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f62c0e-6bf9-4972-b178-a359c9cb080d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:27.792283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac6abe-4e3c-4e90-9508-5bf2b8abe2a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:27.793181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac6abe-4e3c-4e90-9508-5bf2b8abe2a2 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:27.795544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac6abe-4e3c-4e90-9508-5bf2b8abe2a2 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:27.796590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ac6abe-4e3c-4e90-9508-5bf2b8abe2a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:27.800345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42ac6abe-4e3c-4e90-9508-5bf2b8abe2a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:27.817505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac6abe-4e3c-4e90-9508-5bf2b8abe2a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:27.822090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ac6abe-4e3c-4e90-9508-5bf2b8abe2a2 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:27.851559 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1766/3560] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:06:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:06:31.908540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7e862-c59f-44b7-a176-46f5d6682614 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:31.909123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7e862-c59f-44b7-a176-46f5d6682614 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:31.909968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7e862-c59f-44b7-a176-46f5d6682614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:31.967279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-99f7e862-c59f-44b7-a176-46f5d6682614 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:31.972680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-99f7e862-c59f-44b7-a176-46f5d6682614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:32.027486 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1795/3561] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:06:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:06:32.028735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac6abe-4e3c-4e90-9508-5bf2b8abe2a2 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:32.042756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ac6abe-4e3c-4e90-9508-5bf2b8abe2a2 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:32.052529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19608e5-0394-418d-8c26-c34d680f988f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:32.053468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19608e5-0394-418d-8c26-c34d680f988f service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:32.066441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19608e5-0394-418d-8c26-c34d680f988f service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:32.067010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19608e5-0394-418d-8c26-c34d680f988f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:32.080579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19608e5-0394-418d-8c26-c34d680f988f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:32.083511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19608e5-0394-418d-8c26-c34d680f988f service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:32.095785 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1767/3562] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:06:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:06:41.950831 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=15 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:42.090583 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=15 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:47.117601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53431c6-2e2a-44c3-a859-cb0975abf7e8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:47.118163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53431c6-2e2a-44c3-a859-cb0975abf7e8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:47.118163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53431c6-2e2a-44c3-a859-cb0975abf7e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:47.165946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e53431c6-2e2a-44c3-a859-cb0975abf7e8 None None] MFA Rules not processed for user `4dde4bb72f914457a633358837d178de`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:47.167483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e53431c6-2e2a-44c3-a859-cb0975abf7e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:47.208251 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1796/3563] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:06:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:54.664170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19608e5-0394-418d-8c26-c34d680f988f service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:54.674062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e19608e5-0394-418d-8c26-c34d680f988f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:54.699487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19608e5-0394-418d-8c26-c34d680f988f service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:54.707887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:54.708772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:54.709251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:54.710357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] PATH_INFO: `/v3/users/09b32a47b2874040a560e3f3776fdff9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:54.711909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09b32a47b2874040a560e3f3776fdff9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:54.719967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:54.800997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09b32a47b2874040a560e3f3776fdff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:54.815217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09b32a47b2874040a560e3f3776fdff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:54.816261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09b32a47b2874040a560e3f3776fdff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:54.828314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09b32a47b2874040a560e3f3776fdff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:54.855388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09b32a47b2874040a560e3f3776fdff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:54.864173 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1768/3564] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:06:54 2022] DELETE /identity/v3/users/09b32a47b2874040a560e3f3776fdff9 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:06:55.262081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06104296-8472-428c-b9d9-ca8745b17245 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:55.263479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06104296-8472-428c-b9d9-ca8745b17245 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:55.264143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06104296-8472-428c-b9d9-ca8745b17245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:55.294430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-06104296-8472-428c-b9d9-ca8745b17245 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:55.296200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-06104296-8472-428c-b9d9-ca8745b17245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:55.400769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:55.402490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:55.413723 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1797/3565] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:06:55 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:06:55.430911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06104296-8472-428c-b9d9-ca8745b17245 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:55.434440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-06104296-8472-428c-b9d9-ca8745b17245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:55.537204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af9903-44d9-4b0c-9310-a04bfa5a8713 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:55.543166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:55.544139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:55.544668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:55.545159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] PATH_INFO: `/v3/users/e20476ff91b34c24b84e67e4416b13b0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:55.546969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e20476ff91b34c24b84e67e4416b13b0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:55.549138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:55.596536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06104296-8472-428c-b9d9-ca8745b17245 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:55.613708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad80b4b-f7e9-4df6-8f28-40caf7d9348c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:55.614583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad80b4b-f7e9-4df6-8f28-40caf7d9348c service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:55.615063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad80b4b-f7e9-4df6-8f28-40caf7d9348c service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:55.615969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad80b4b-f7e9-4df6-8f28-40caf7d9348c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:55.627893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad80b4b-f7e9-4df6-8f28-40caf7d9348c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:55.629538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad80b4b-f7e9-4df6-8f28-40caf7d9348c service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:55.633326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e20476ff91b34c24b84e67e4416b13b0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:55.654271 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1798/3566] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:06:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:55.681986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e20476ff91b34c24b84e67e4416b13b0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:55.685651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e20476ff91b34c24b84e67e4416b13b0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:55.709893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e20476ff91b34c24b84e67e4416b13b0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:55.721635 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:55.734404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e20476ff91b34c24b84e67e4416b13b0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:55.748532 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1769/3567] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:06:55 2022] DELETE /identity/v3/users/e20476ff91b34c24b84e67e4416b13b0 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:06:55.754123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b757b2-fcf7-44c1-9505-70bbddc5ba4c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:55.754415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b757b2-fcf7-44c1-9505-70bbddc5ba4c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:55.754696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b757b2-fcf7-44c1-9505-70bbddc5ba4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:55.791716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-64b757b2-fcf7-44c1-9505-70bbddc5ba4c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:55.792982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-64b757b2-fcf7-44c1-9505-70bbddc5ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:55.914209 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1799/3568] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:06:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:55.959795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:55.961942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:56.044928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b757b2-fcf7-44c1-9505-70bbddc5ba4c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:56.047180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-64b757b2-fcf7-44c1-9505-70bbddc5ba4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:56.068651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b757b2-fcf7-44c1-9505-70bbddc5ba4c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:56.082368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:56.083435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:56.085993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:56.086583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] PATH_INFO: `/v3/projects/175a13a281b24a6289e68a76402eb470` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:56.090601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=175a13a281b24a6289e68a76402eb470)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:56.093868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:56.180232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36ab0fb-4681-4497-8c41-c21fb132b51f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:56.181794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6fec8a-8fee-48d9-9203-128580f4cf50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:56.182009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fec8a-8fee-48d9-9203-128580f4cf50 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:56.182291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fec8a-8fee-48d9-9203-128580f4cf50 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:56.182563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6fec8a-8fee-48d9-9203-128580f4cf50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:56.201289 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:56.207813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fec8a-8fee-48d9-9203-128580f4cf50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:56.211716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6fec8a-8fee-48d9-9203-128580f4cf50 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:56.235575 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1770/3569] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:06:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:06:56.306216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '175a13a281b24a6289e68a76402eb470', 'request_id': 'req-88e59819-cea3-4092-a6a7-73ff7c774f5b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:56.317840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '175a13a281b24a6289e68a76402eb470', 'request_id': 'req-88e59819-cea3-4092-a6a7-73ff7c774f5b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:56.347856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '175a13a281b24a6289e68a76402eb470', 'request_id': 'req-88e59819-cea3-4092-a6a7-73ff7c774f5b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:56.380681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] The token cache is being invalidate because project 175a13a281b24a6289e68a76402eb470 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:06:56.381023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:56.382550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-88e59819-cea3-4092-a6a7-73ff7c774f5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:56.385529 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1800/3570] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:06:56 2022] DELETE /identity/v3/projects/175a13a281b24a6289e68a76402eb470 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:06:56.394117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884f6fa-6684-445b-b00f-84a9d1115ce1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:56.395690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884f6fa-6684-445b-b00f-84a9d1115ce1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:56.396277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884f6fa-6684-445b-b00f-84a9d1115ce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:56.432079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8884f6fa-6684-445b-b00f-84a9d1115ce1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:56.433313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8884f6fa-6684-445b-b00f-84a9d1115ce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:56.637868 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1771/3571] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:56.640874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec06c-85b4-400d-903d-7b7e0c7dd92f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:56.641904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec06c-85b4-400d-903d-7b7e0c7dd92f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:56.642494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ec06c-85b4-400d-903d-7b7e0c7dd92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:56.755881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ac3ec06c-85b4-400d-903d-7b7e0c7dd92f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:56.765007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ac3ec06c-85b4-400d-903d-7b7e0c7dd92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:56.787896 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1801/3572] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:56.792938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884f6fa-6684-445b-b00f-84a9d1115ce1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:56.808227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884f6fa-6684-445b-b00f-84a9d1115ce1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:56.819372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53b372-de7d-4121-8791-8e7820b1d1c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:56.820646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53b372-de7d-4121-8791-8e7820b1d1c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:56.821155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53b372-de7d-4121-8791-8e7820b1d1c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:56.821661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc53b372-de7d-4121-8791-8e7820b1d1c2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:56.822673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53b372-de7d-4121-8791-8e7820b1d1c2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:06:56.823644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53b372-de7d-4121-8791-8e7820b1d1c2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:56.828662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc53b372-de7d-4121-8791-8e7820b1d1c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:56.854679 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1772/3573] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:06:56.860976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec06c-85b4-400d-903d-7b7e0c7dd92f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:56.879464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ec06c-85b4-400d-903d-7b7e0c7dd92f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:56.891899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56109fad-e68e-4043-b5d3-c26fc7480a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:56.892720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56109fad-e68e-4043-b5d3-c26fc7480a2a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:56.892844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56109fad-e68e-4043-b5d3-c26fc7480a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:56.893081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56109fad-e68e-4043-b5d3-c26fc7480a2a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:56.894023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56109fad-e68e-4043-b5d3-c26fc7480a2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:56.895702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56109fad-e68e-4043-b5d3-c26fc7480a2a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:56.935957 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1802/3574] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:06:56 2022] POST /identity/v3/projects => generated 385 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:06:56.940019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53b372-de7d-4121-8791-8e7820b1d1c2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:56.951367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56109fad-e68e-4043-b5d3-c26fc7480a2a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:56.959822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56109fad-e68e-4043-b5d3-c26fc7480a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:56.962165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc53b372-de7d-4121-8791-8e7820b1d1c2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:57.187438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58949489-25ab-4958-a267-78faf1efe3e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:57.188151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58949489-25ab-4958-a267-78faf1efe3e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:57.188496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58949489-25ab-4958-a267-78faf1efe3e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:57.189021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58949489-25ab-4958-a267-78faf1efe3e2 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:57.189940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58949489-25ab-4958-a267-78faf1efe3e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:57.192122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58949489-25ab-4958-a267-78faf1efe3e2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:57.192711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56109fad-e68e-4043-b5d3-c26fc7480a2a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:57.206701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:57.207359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:57.207639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:57.207912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] PATH_INFO: `/v3/projects/8469ec38031e46da9bfde167e0b6da15` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:57.213870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8469ec38031e46da9bfde167e0b6da15)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:57.215816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:57.259333 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1773/3575] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:06:56 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:06:57.266387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58949489-25ab-4958-a267-78faf1efe3e2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:57.300633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58949489-25ab-4958-a267-78faf1efe3e2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:57.314751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5b2ad-9e25-4fe0-87e8-0f27bddb4195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:57.317571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5b2ad-9e25-4fe0-87e8-0f27bddb4195 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:57.317875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5b2ad-9e25-4fe0-87e8-0f27bddb4195 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:57.318153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5b2ad-9e25-4fe0-87e8-0f27bddb4195 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:57.321670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5b2ad-9e25-4fe0-87e8-0f27bddb4195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:57.329240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5b2ad-9e25-4fe0-87e8-0f27bddb4195 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:57.343135 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:57.351944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8469ec38031e46da9bfde167e0b6da15', 'request_id': 'req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.353711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1774/3576] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:06:57.357500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5b2ad-9e25-4fe0-87e8-0f27bddb4195 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:57.377431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8469ec38031e46da9bfde167e0b6da15', 'request_id': 'req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.378402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5b2ad-9e25-4fe0-87e8-0f27bddb4195 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:57.390911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8469ec38031e46da9bfde167e0b6da15', 'request_id': 'req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.418307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] The token cache is being invalidate because project 8469ec38031e46da9bfde167e0b6da15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:06:57.418603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.421493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.423996 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1803/3577] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:06:56 2022] DELETE /identity/v3/projects/8469ec38031e46da9bfde167e0b6da15 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:06:57.428108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:57.432155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:57.467779 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:57.480308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf43954-3310-461a-bcdd-8c62b8a602b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:57.481099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf43954-3310-461a-bcdd-8c62b8a602b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:57.481445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf43954-3310-461a-bcdd-8c62b8a602b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:57.481734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf43954-3310-461a-bcdd-8c62b8a602b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:57.482555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf43954-3310-461a-bcdd-8c62b8a602b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:57.485834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf43954-3310-461a-bcdd-8c62b8a602b7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:57.501124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1775/3578] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:06:57.505319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf43954-3310-461a-bcdd-8c62b8a602b7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:57.507486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-edf43954-3310-461a-bcdd-8c62b8a602b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:57.536959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf43954-3310-461a-bcdd-8c62b8a602b7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:57.551431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1efd0-a1f5-4911-b658-035820891e97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:57.554046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1efd0-a1f5-4911-b658-035820891e97 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:57.555904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1efd0-a1f5-4911-b658-035820891e97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:57.556311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1efd0-a1f5-4911-b658-035820891e97 admin admin] PATH_INFO: `/v3/projects/7efcd6b20b7945549462ff819faa6cd8/users/c92b6e38d9c442b596b113895c61d7c6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:57.590801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1efd0-a1f5-4911-b658-035820891e97 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7efcd6b20b7945549462ff819faa6cd8, user_id=c92b6e38d9c442b596b113895c61d7c6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:57.598193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba1efd0-a1f5-4911-b658-035820891e97 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:57.602467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5952d167-f6b2-4d3e-8ab3-5e1ff5adb1f5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:57.641497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:57.641497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:57.641497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:57.641497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] PATH_INFO: `/v3/users/aafa32b8c12044e496f673e68dbff91e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:57.642299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aafa32b8c12044e496f673e68dbff91e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:57.657330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:57.661591 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1776/3579] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:06:57 2022] PUT /identity/v3/projects/7efcd6b20b7945549462ff819faa6cd8/users/c92b6e38d9c442b596b113895c61d7c6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:06:57.668741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377df5f-fe2f-4ca0-955c-c662d7956b64 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:57.669142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377df5f-fe2f-4ca0-955c-c662d7956b64 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:57.669554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6377df5f-fe2f-4ca0-955c-c662d7956b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:57.731415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6377df5f-fe2f-4ca0-955c-c662d7956b64 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:57.734878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6377df5f-fe2f-4ca0-955c-c662d7956b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:57.819025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aafa32b8c12044e496f673e68dbff91e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.855658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aafa32b8c12044e496f673e68dbff91e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.856439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aafa32b8c12044e496f673e68dbff91e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.871428 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1777/3580] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:06:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:06:57.872022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aafa32b8c12044e496f673e68dbff91e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.872817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9cecb-da36-4f6f-b69d-46a52d8aaac2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:57.873266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9cecb-da36-4f6f-b69d-46a52d8aaac2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:57.876180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa9cecb-da36-4f6f-b69d-46a52d8aaac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:57.891222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aafa32b8c12044e496f673e68dbff91e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:57.906668 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1804/3581] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:06:57 2022] DELETE /identity/v3/users/aafa32b8c12044e496f673e68dbff91e => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:06:57.907345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4fa9cecb-da36-4f6f-b69d-46a52d8aaac2 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:57.908751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4fa9cecb-da36-4f6f-b69d-46a52d8aaac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:57.926620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:57.928157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:58.025832 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1778/3582] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:06:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:58.041204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9cecb-da36-4f6f-b69d-46a52d8aaac2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:58.050935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4fa9cecb-da36-4f6f-b69d-46a52d8aaac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:58.066581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f249356-4841-4a0c-a18e-20b550af4e3a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:58.077987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07753632-c2aa-4a6c-8fa5-cc7030233583 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:58.078744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07753632-c2aa-4a6c-8fa5-cc7030233583 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:58.079147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07753632-c2aa-4a6c-8fa5-cc7030233583 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:58.079551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07753632-c2aa-4a6c-8fa5-cc7030233583 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:58.102821 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:58.156824 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:58.176931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07753632-c2aa-4a6c-8fa5-cc7030233583 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:58.178834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07753632-c2aa-4a6c-8fa5-cc7030233583 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:58.191113 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1805/3583] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:06:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:06:58.204918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa9cecb-da36-4f6f-b69d-46a52d8aaac2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:58.212111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd1886d-2c36-435d-ae2a-834836baed1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:58.212847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1886d-2c36-435d-ae2a-834836baed1b service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:58.213201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1886d-2c36-435d-ae2a-834836baed1b service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:58.213583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd1886d-2c36-435d-ae2a-834836baed1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:58.225131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1886d-2c36-435d-ae2a-834836baed1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:58.227090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd1886d-2c36-435d-ae2a-834836baed1b service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:58.239347 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1779/3584] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:06:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:06:58.588364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07753632-c2aa-4a6c-8fa5-cc7030233583 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:58.590629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-07753632-c2aa-4a6c-8fa5-cc7030233583 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:58.613006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07753632-c2aa-4a6c-8fa5-cc7030233583 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:58.630399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:58.631205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:58.631590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:58.631968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] PATH_INFO: `/v3/projects/ad9fe920d6ea4a66aed938397bb4a4f3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:58.634310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9fe920d6ea4a66aed938397bb4a4f3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:58.636476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:58.771270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9fe920d6ea4a66aed938397bb4a4f3', 'request_id': 'req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:58.787724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70d94-48d5-4764-933d-c6a66065bc62 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:58.788444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70d94-48d5-4764-933d-c6a66065bc62 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:58.789057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9fe920d6ea4a66aed938397bb4a4f3', 'request_id': 'req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:58.789406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d70d94-48d5-4764-933d-c6a66065bc62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:58.799266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9fe920d6ea4a66aed938397bb4a4f3', 'request_id': 'req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:58.820018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f0d70d94-48d5-4764-933d-c6a66065bc62 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:58.821590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f0d70d94-48d5-4764-933d-c6a66065bc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:58.825947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] The token cache is being invalidate because project ad9fe920d6ea4a66aed938397bb4a4f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:06:58.826282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:58.828893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2989cb74-86a4-4baa-82ef-8ba88bbc0e18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:06:58.831481 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1806/3585] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:06:58 2022] DELETE /identity/v3/projects/ad9fe920d6ea4a66aed938397bb4a4f3 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:06:58.837710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7e126-dbaf-42ff-b942-f12b88b0ed16 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:58.838866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7e126-dbaf-42ff-b942-f12b88b0ed16 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:58.839995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b7e126-dbaf-42ff-b942-f12b88b0ed16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:58.898651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b2b7e126-dbaf-42ff-b942-f12b88b0ed16 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:58.901411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2b7e126-dbaf-42ff-b942-f12b88b0ed16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:58.966702 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1780/3586] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:06:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:58.991138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d70d94-48d5-4764-933d-c6a66065bc62 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:59.001824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f0d70d94-48d5-4764-933d-c6a66065bc62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:59.153308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d70d94-48d5-4764-933d-c6a66065bc62 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:59.155653 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1807/3587] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:06:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:59.163798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c580874-5fd9-45c5-b166-0a8666390233 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:59.164185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c580874-5fd9-45c5-b166-0a8666390233 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:59.164472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c580874-5fd9-45c5-b166-0a8666390233 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:59.166996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ee417-8dc2-458e-b19c-f1d191619d1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:59.167200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ee417-8dc2-458e-b19c-f1d191619d1a service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:59.167552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ee417-8dc2-458e-b19c-f1d191619d1a service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:59.167891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ee417-8dc2-458e-b19c-f1d191619d1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:59.178297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ee417-8dc2-458e-b19c-f1d191619d1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:59.179406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ee417-8dc2-458e-b19c-f1d191619d1a service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:59.191618 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1781/3588] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:06:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:06:59.199438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1c580874-5fd9-45c5-b166-0a8666390233 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:06:59.200789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c580874-5fd9-45c5-b166-0a8666390233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:06:59.226589 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1808/3589] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:06:59.230945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ee417-8dc2-458e-b19c-f1d191619d1a service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:59.243393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ee417-8dc2-458e-b19c-f1d191619d1a service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:59.260426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849665b7-361f-44ad-9e36-e9acf96a4e2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:59.262420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849665b7-361f-44ad-9e36-e9acf96a4e2e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:59.262420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849665b7-361f-44ad-9e36-e9acf96a4e2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:59.263303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849665b7-361f-44ad-9e36-e9acf96a4e2e admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:59.266939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849665b7-361f-44ad-9e36-e9acf96a4e2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:06:59.268469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849665b7-361f-44ad-9e36-e9acf96a4e2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:59.270217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849665b7-361f-44ad-9e36-e9acf96a4e2e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:59.322140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c580874-5fd9-45c5-b166-0a8666390233 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:59.335580 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1782/3590] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:06:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:06:59.340899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c580874-5fd9-45c5-b166-0a8666390233 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:59.355606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c16a64-c19c-4615-9005-53532ec5b4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:59.356624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c16a64-c19c-4615-9005-53532ec5b4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:59.359922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c16a64-c19c-4615-9005-53532ec5b4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:59.360209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c16a64-c19c-4615-9005-53532ec5b4f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:59.361598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c16a64-c19c-4615-9005-53532ec5b4f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:59.363760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c16a64-c19c-4615-9005-53532ec5b4f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:59.437325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849665b7-361f-44ad-9e36-e9acf96a4e2e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:59.446985 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1809/3591] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:06:59 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:06:59.451595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849665b7-361f-44ad-9e36-e9acf96a4e2e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:59.495181 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:06:59.541715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370036a0-1391-46cd-bbf2-6fafe2a1315f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:59.542759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370036a0-1391-46cd-bbf2-6fafe2a1315f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:59.543101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370036a0-1391-46cd-bbf2-6fafe2a1315f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:59.543458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370036a0-1391-46cd-bbf2-6fafe2a1315f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:59.544220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370036a0-1391-46cd-bbf2-6fafe2a1315f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:59.547607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370036a0-1391-46cd-bbf2-6fafe2a1315f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:59.601811 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1783/3592] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:06:59 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:06:59.606620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c16a64-c19c-4615-9005-53532ec5b4f4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:59.627293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c16a64-c19c-4615-9005-53532ec5b4f4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:59.647070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2372f-4515-4517-8972-3589fb890e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:59.653328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2372f-4515-4517-8972-3589fb890e4f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:59.654694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2372f-4515-4517-8972-3589fb890e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:59.658200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe2372f-4515-4517-8972-3589fb890e4f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:59.659996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2372f-4515-4517-8972-3589fb890e4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:59.663631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe2372f-4515-4517-8972-3589fb890e4f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:59.699451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370036a0-1391-46cd-bbf2-6fafe2a1315f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:59.712222 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1810/3593] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:06:59.717206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370036a0-1391-46cd-bbf2-6fafe2a1315f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:59.731061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8b1d18-e2b4-48e1-a25b-38a511f6fb77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:59.732218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b1d18-e2b4-48e1-a25b-38a511f6fb77 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:59.732881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b1d18-e2b4-48e1-a25b-38a511f6fb77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:59.734410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8b1d18-e2b4-48e1-a25b-38a511f6fb77 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:59.735339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b1d18-e2b4-48e1-a25b-38a511f6fb77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:59.738098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8b1d18-e2b4-48e1-a25b-38a511f6fb77 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:59.788330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2372f-4515-4517-8972-3589fb890e4f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:06:59.803336 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1784/3594] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:06:59 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:06:59.806085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe2372f-4515-4517-8972-3589fb890e4f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:06:59.828392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d2058-72af-4c69-84c3-cfc76784745e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:06:59.829934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2058-72af-4c69-84c3-cfc76784745e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:59.830681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2058-72af-4c69-84c3-cfc76784745e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:59.832523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3d2058-72af-4c69-84c3-cfc76784745e admin admin] PATH_INFO: `/v3/projects/fbba515dcd32461e967014ee826d82ba/users/e6c579036b0846ffbce85349fb5f6333/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:06:59.884608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d2058-72af-4c69-84c3-cfc76784745e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbba515dcd32461e967014ee826d82ba, user_id=e6c579036b0846ffbce85349fb5f6333, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:06:59.893907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3d2058-72af-4c69-84c3-cfc76784745e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:06:59.939654 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1811/3595] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:06:59 2022] PUT /identity/v3/projects/fbba515dcd32461e967014ee826d82ba/users/e6c579036b0846ffbce85349fb5f6333/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:06:59.950732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb627c-a494-4c79-b1d4-3b8acf774647 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:06:59.951017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb627c-a494-4c79-b1d4-3b8acf774647 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:06:59.951292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb627c-a494-4c79-b1d4-3b8acf774647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:00.032752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6dcb627c-a494-4c79-b1d4-3b8acf774647 None None] MFA Rules not processed for user `e6c579036b0846ffbce85349fb5f6333`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:00.035617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6dcb627c-a494-4c79-b1d4-3b8acf774647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:00.151806 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1785/3596] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:06:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:00.157249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d2058-72af-4c69-84c3-cfc76784745e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:00.163957 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:00.250439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb627c-a494-4c79-b1d4-3b8acf774647 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:00.252165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6dcb627c-a494-4c79-b1d4-3b8acf774647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:00.297552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3d2058-72af-4c69-84c3-cfc76784745e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:00.311705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5870f-2232-42c2-8413-9cc4a00f23f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:00.312461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5870f-2232-42c2-8413-9cc4a00f23f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:00.312814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5870f-2232-42c2-8413-9cc4a00f23f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:00.313174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5870f-2232-42c2-8413-9cc4a00f23f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:00.313929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5870f-2232-42c2-8413-9cc4a00f23f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:00.315948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5870f-2232-42c2-8413-9cc4a00f23f6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:00.380618 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1812/3597] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:07:00 2022] POST /identity/v3/projects => generated 377 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:07:00.385122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5870f-2232-42c2-8413-9cc4a00f23f6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:00.401975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb627c-a494-4c79-b1d4-3b8acf774647 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:00.475946 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:00.514463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5870f-2232-42c2-8413-9cc4a00f23f6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:00.526093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4dda-6e71-4f27-8881-01aab098e3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:00.526843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4dda-6e71-4f27-8881-01aab098e3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:00.527240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4dda-6e71-4f27-8881-01aab098e3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:00.528460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ea4dda-6e71-4f27-8881-01aab098e3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:00.530899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea4dda-6e71-4f27-8881-01aab098e3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:00.536022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ea4dda-6e71-4f27-8881-01aab098e3b0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:00.561850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33bdee-ea61-4834-9cec-95fb02d2a067 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:00.562631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33bdee-ea61-4834-9cec-95fb02d2a067 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:00.562965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33bdee-ea61-4834-9cec-95fb02d2a067 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:00.563248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab33bdee-ea61-4834-9cec-95fb02d2a067 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:00.565604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab33bdee-ea61-4834-9cec-95fb02d2a067 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:00.572684 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1813/3598] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:07:00 2022] POST /identity/v3/users => generated 295 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:07:00.577529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4dda-6e71-4f27-8881-01aab098e3b0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:00.581722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33bdee-ea61-4834-9cec-95fb02d2a067 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:00.583552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab33bdee-ea61-4834-9cec-95fb02d2a067 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:00.598987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ea4dda-6e71-4f27-8881-01aab098e3b0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:00.603726 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1786/3599] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:00.612297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5450cc2-04d9-4ff5-8b1a-16c4d66c817e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:00.613563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5450cc2-04d9-4ff5-8b1a-16c4d66c817e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:00.613563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5450cc2-04d9-4ff5-8b1a-16c4d66c817e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:00.613766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5450cc2-04d9-4ff5-8b1a-16c4d66c817e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:00.614456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5450cc2-04d9-4ff5-8b1a-16c4d66c817e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:00.618377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5450cc2-04d9-4ff5-8b1a-16c4d66c817e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:00.650086 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1814/3600] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:00.654527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33bdee-ea61-4834-9cec-95fb02d2a067 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:00.671478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab33bdee-ea61-4834-9cec-95fb02d2a067 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:00.686104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80f0b-f4fa-4a0c-a2b8-42290bf805b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:00.686974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80f0b-f4fa-4a0c-a2b8-42290bf805b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:00.687435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80f0b-f4fa-4a0c-a2b8-42290bf805b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:00.691186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d80f0b-f4fa-4a0c-a2b8-42290bf805b5 admin admin] PATH_INFO: `/v3/projects/5f09adede3624bfc85a8eb48e7d120f8/users/3e4e1acd2ea9425ea5c37d36ff225ab5/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:00.734084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d80f0b-f4fa-4a0c-a2b8-42290bf805b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f09adede3624bfc85a8eb48e7d120f8, user_id=3e4e1acd2ea9425ea5c37d36ff225ab5, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:00.742965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d80f0b-f4fa-4a0c-a2b8-42290bf805b5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:00.768380 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1787/3601] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:00 2022] PUT /identity/v3/projects/5f09adede3624bfc85a8eb48e7d120f8/users/3e4e1acd2ea9425ea5c37d36ff225ab5/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:00.769957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5450cc2-04d9-4ff5-8b1a-16c4d66c817e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:00.790136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5450cc2-04d9-4ff5-8b1a-16c4d66c817e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:00.943002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34616f76-72b3-4ef5-9fce-8ab4d3deaa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:00.943630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616f76-72b3-4ef5-9fce-8ab4d3deaa1e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:00.943915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616f76-72b3-4ef5-9fce-8ab4d3deaa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:00.944194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34616f76-72b3-4ef5-9fce-8ab4d3deaa1e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:00.944842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616f76-72b3-4ef5-9fce-8ab4d3deaa1e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:00.946491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34616f76-72b3-4ef5-9fce-8ab4d3deaa1e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:00.974703 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1815/3602] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:00.978909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80f0b-f4fa-4a0c-a2b8-42290bf805b5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:00.992228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d80f0b-f4fa-4a0c-a2b8-42290bf805b5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:01.005562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3766-1b7f-4f9d-87df-9d4d397c31e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:01.006300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3766-1b7f-4f9d-87df-9d4d397c31e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:01.006583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3766-1b7f-4f9d-87df-9d4d397c31e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:01.006918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fff3766-1b7f-4f9d-87df-9d4d397c31e5 admin admin] PATH_INFO: `/v3/projects/5f09adede3624bfc85a8eb48e7d120f8/users/3e4e1acd2ea9425ea5c37d36ff225ab5/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:01.013507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3766-1b7f-4f9d-87df-9d4d397c31e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f09adede3624bfc85a8eb48e7d120f8, user_id=3e4e1acd2ea9425ea5c37d36ff225ab5, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:01.015979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fff3766-1b7f-4f9d-87df-9d4d397c31e5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:01.035740 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1788/3603] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:00 2022] PUT /identity/v3/projects/5f09adede3624bfc85a8eb48e7d120f8/users/3e4e1acd2ea9425ea5c37d36ff225ab5/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:01.047726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cdbab-be30-4697-8321-d05b3bb0806e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:01.048024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cdbab-be30-4697-8321-d05b3bb0806e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:01.050371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4cdbab-be30-4697-8321-d05b3bb0806e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:01.074707 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:01.127655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1d4cdbab-be30-4697-8321-d05b3bb0806e None None] MFA Rules not processed for user `3e4e1acd2ea9425ea5c37d36ff225ab5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:01.131145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d4cdbab-be30-4697-8321-d05b3bb0806e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:01.302018 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1816/3604] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:07:01.312761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3766-1b7f-4f9d-87df-9d4d397c31e5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:01.448630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fff3766-1b7f-4f9d-87df-9d4d397c31e5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:01.455603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a48691-0e1e-48b6-99c1-4a8ad511ec7b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:01.456452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a48691-0e1e-48b6-99c1-4a8ad511ec7b service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:01.456734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a48691-0e1e-48b6-99c1-4a8ad511ec7b service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:01.457067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a48691-0e1e-48b6-99c1-4a8ad511ec7b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:01.468086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a48691-0e1e-48b6-99c1-4a8ad511ec7b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:01.469591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a48691-0e1e-48b6-99c1-4a8ad511ec7b service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:01.481448 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1789/3605] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:01 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:07:01.880663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cdbab-be30-4697-8321-d05b3bb0806e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:02.018104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4cdbab-be30-4697-8321-d05b3bb0806e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:02.027677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:02.029048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:02.029506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:02.029931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] PATH_INFO: `/v3/users/e6c579036b0846ffbce85349fb5f6333` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:02.031647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6c579036b0846ffbce85349fb5f6333)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:02.034510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:02.172812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6c579036b0846ffbce85349fb5f6333'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:02.197555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6c579036b0846ffbce85349fb5f6333'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:02.198415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6c579036b0846ffbce85349fb5f6333'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:02.216436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6c579036b0846ffbce85349fb5f6333'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:02.229881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6c579036b0846ffbce85349fb5f6333'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:02.249333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84824c74-01ca-4697-a4d8-377dae596957 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:02.249874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84824c74-01ca-4697-a4d8-377dae596957 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:02.249874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84824c74-01ca-4697-a4d8-377dae596957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:02.250461 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1817/3606] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:07:01 2022] DELETE /identity/v3/users/e6c579036b0846ffbce85349fb5f6333 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:02.296304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-84824c74-01ca-4697-a4d8-377dae596957 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:02.300564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-84824c74-01ca-4697-a4d8-377dae596957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:02.491584 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1790/3607] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:02.519261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:02.522902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:02.551331 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:02.729763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea75b8-1e9f-47d1-8d14-85f477a84a2f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:02.736210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6b9a-abaf-404c-8214-5e5516f258bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:02.737000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6b9a-abaf-404c-8214-5e5516f258bf service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:02.737408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6b9a-abaf-404c-8214-5e5516f258bf service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:02.737685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd6b9a-abaf-404c-8214-5e5516f258bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:02.756399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6b9a-abaf-404c-8214-5e5516f258bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:02.759313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd6b9a-abaf-404c-8214-5e5516f258bf service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:02.779051 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1818/3608] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:03.818721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84824c74-01ca-4697-a4d8-377dae596957 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:03.820110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-84824c74-01ca-4697-a4d8-377dae596957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:03.837327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84824c74-01ca-4697-a4d8-377dae596957 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:03.850008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:03.850714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:03.851200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:03.851478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] PATH_INFO: `/v3/projects/fbba515dcd32461e967014ee826d82ba` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:03.853353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbba515dcd32461e967014ee826d82ba)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:03.855429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:03.859673 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:04.035122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbba515dcd32461e967014ee826d82ba', 'request_id': 'req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.049241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbba515dcd32461e967014ee826d82ba', 'request_id': 'req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.064920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbba515dcd32461e967014ee826d82ba', 'request_id': 'req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.088582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] The token cache is being invalidate because project fbba515dcd32461e967014ee826d82ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:07:04.089321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.090484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.096446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6b9a-abaf-404c-8214-5e5516f258bf service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:04.097179 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1791/3609] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:07:03 2022] DELETE /identity/v3/projects/fbba515dcd32461e967014ee826d82ba => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:04.111646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd6b9a-abaf-404c-8214-5e5516f258bf service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:04.214069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:04.214896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:04.215879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:04.215879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] PATH_INFO: `/v3/users/3e4e1acd2ea9425ea5c37d36ff225ab5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:04.216915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e4e1acd2ea9425ea5c37d36ff225ab5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:04.219060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:04.314868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e4e1acd2ea9425ea5c37d36ff225ab5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.331186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e4e1acd2ea9425ea5c37d36ff225ab5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.332328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e4e1acd2ea9425ea5c37d36ff225ab5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.347569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e4e1acd2ea9425ea5c37d36ff225ab5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.367318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bc05be-c18a-4995-81c4-78073379604d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e4e1acd2ea9425ea5c37d36ff225ab5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:04.377261 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1819/3610] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:07:04 2022] DELETE /identity/v3/users/3e4e1acd2ea9425ea5c37d36ff225ab5 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:04.969570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:04.971726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:05.019833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03d8ee5-392f-4072-bbd6-1b3c7f52369f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:05.153284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:05.154197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:05.154590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:05.155148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] PATH_INFO: `/v3/projects/5f09adede3624bfc85a8eb48e7d120f8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:05.156422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f09adede3624bfc85a8eb48e7d120f8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:05.158613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:05.219770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f09adede3624bfc85a8eb48e7d120f8', 'request_id': 'req-f07e187d-69f2-4a0a-84a6-389750225217'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:05.227269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f09adede3624bfc85a8eb48e7d120f8', 'request_id': 'req-f07e187d-69f2-4a0a-84a6-389750225217'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:05.238295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f09adede3624bfc85a8eb48e7d120f8', 'request_id': 'req-f07e187d-69f2-4a0a-84a6-389750225217'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:05.254644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] The token cache is being invalidate because project 5f09adede3624bfc85a8eb48e7d120f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:07:05.255188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:05.257029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07e187d-69f2-4a0a-84a6-389750225217 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:05.259658 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1792/3611] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:07:04 2022] DELETE /identity/v3/projects/5f09adede3624bfc85a8eb48e7d120f8 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:05.267684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe840-98b4-4ea6-8604-62eaf890fefa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:05.268256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe840-98b4-4ea6-8604-62eaf890fefa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:05.268724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fe840-98b4-4ea6-8604-62eaf890fefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:05.305535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-840fe840-98b4-4ea6-8604-62eaf890fefa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:05.306909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-840fe840-98b4-4ea6-8604-62eaf890fefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:05.344249 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:05.411655 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1820/3612] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:05.419566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36926e-4d08-4059-bed0-e400ccc49be0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:05.420215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36926e-4d08-4059-bed0-e400ccc49be0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:05.421653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa36926e-4d08-4059-bed0-e400ccc49be0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:05.466616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-aa36926e-4d08-4059-bed0-e400ccc49be0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:05.472952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aa36926e-4d08-4059-bed0-e400ccc49be0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:05.508223 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1793/3613] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:05.509552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe840-98b4-4ea6-8604-62eaf890fefa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:05.523846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fe840-98b4-4ea6-8604-62eaf890fefa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:05.539463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195899d5-47d5-4cf0-9317-ada35167bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:05.540460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195899d5-47d5-4cf0-9317-ada35167bb6c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:05.541047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195899d5-47d5-4cf0-9317-ada35167bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:05.542233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195899d5-47d5-4cf0-9317-ada35167bb6c admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:05.543168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195899d5-47d5-4cf0-9317-ada35167bb6c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:07:05.544322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195899d5-47d5-4cf0-9317-ada35167bb6c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:05.560315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195899d5-47d5-4cf0-9317-ada35167bb6c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:05.580482 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1821/3614] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:07:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:07:05.585797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36926e-4d08-4059-bed0-e400ccc49be0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:05.599594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa36926e-4d08-4059-bed0-e400ccc49be0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:05.606334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5eac5-8d77-465f-805b-5edfe08d8474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:05.608639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5eac5-8d77-465f-805b-5edfe08d8474 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:05.610387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5eac5-8d77-465f-805b-5edfe08d8474 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:05.610859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde5eac5-8d77-465f-805b-5edfe08d8474 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:05.612079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5eac5-8d77-465f-805b-5edfe08d8474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:05.614883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde5eac5-8d77-465f-805b-5edfe08d8474 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:05.654589 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:05.678838 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1794/3615] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:07:05 2022] POST /identity/v3/projects => generated 391 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:07:05.684315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195899d5-47d5-4cf0-9317-ada35167bb6c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:05.698367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195899d5-47d5-4cf0-9317-ada35167bb6c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:05.824838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c727c-4878-48d1-bc3e-dde071c00f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:05.825546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c727c-4878-48d1-bc3e-dde071c00f0c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:05.826314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c727c-4878-48d1-bc3e-dde071c00f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:05.826475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c727c-4878-48d1-bc3e-dde071c00f0c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:05.827952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c727c-4878-48d1-bc3e-dde071c00f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:05.830465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11c727c-4878-48d1-bc3e-dde071c00f0c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:05.890924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5eac5-8d77-465f-805b-5edfe08d8474 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:05.891602 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1822/3616] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:07:05 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:07:05.907613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde5eac5-8d77-465f-805b-5edfe08d8474 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:05.921934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1a57e-7812-4acb-b72e-086c42800372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:05.922872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1a57e-7812-4acb-b72e-086c42800372 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:05.933517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1a57e-7812-4acb-b72e-086c42800372 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:05.933890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d1a57e-7812-4acb-b72e-086c42800372 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:05.934611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1a57e-7812-4acb-b72e-086c42800372 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:05.946699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d1a57e-7812-4acb-b72e-086c42800372 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:05.961707 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1795/3617] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:05.965783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c727c-4878-48d1-bc3e-dde071c00f0c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:05.981355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c727c-4878-48d1-bc3e-dde071c00f0c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:05.996009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c752fe1d-eefc-473a-8906-cd40dd66ee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:05.997071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752fe1d-eefc-473a-8906-cd40dd66ee60 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:05.997799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752fe1d-eefc-473a-8906-cd40dd66ee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:05.998243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c752fe1d-eefc-473a-8906-cd40dd66ee60 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:05.999109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752fe1d-eefc-473a-8906-cd40dd66ee60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:06.001333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c752fe1d-eefc-473a-8906-cd40dd66ee60 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:06.024567 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1823/3618] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:05 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:06.028733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1a57e-7812-4acb-b72e-086c42800372 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:06.044462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d1a57e-7812-4acb-b72e-086c42800372 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:06.087067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d2bd7-bb54-43a8-ad15-3593ae21a651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:06.088148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d2bd7-bb54-43a8-ad15-3593ae21a651 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:06.088554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d2bd7-bb54-43a8-ad15-3593ae21a651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:06.089479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d2bd7-bb54-43a8-ad15-3593ae21a651 admin admin] PATH_INFO: `/v3/projects/28e678ec94294cdd8a0d0c9decedb25a/users/7f5e5507c064421b8e6c7a2a6e4997b8/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:06.120970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d2bd7-bb54-43a8-ad15-3593ae21a651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28e678ec94294cdd8a0d0c9decedb25a, user_id=7f5e5507c064421b8e6c7a2a6e4997b8, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:06.125230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d2bd7-bb54-43a8-ad15-3593ae21a651 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:06.163974 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1796/3619] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:06 2022] PUT /identity/v3/projects/28e678ec94294cdd8a0d0c9decedb25a/users/7f5e5507c064421b8e6c7a2a6e4997b8/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:06.174957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dc3a4-7400-4f8b-ba25-07bbd7f03ad0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:06.175274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dc3a4-7400-4f8b-ba25-07bbd7f03ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:06.175521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5dc3a4-7400-4f8b-ba25-07bbd7f03ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:06.229444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2a5dc3a4-7400-4f8b-ba25-07bbd7f03ad0 None None] MFA Rules not processed for user `7f5e5507c064421b8e6c7a2a6e4997b8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:06.230984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a5dc3a4-7400-4f8b-ba25-07bbd7f03ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:06.355863 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1824/3620] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:06 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:06.360812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d2bd7-bb54-43a8-ad15-3593ae21a651 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:06.491074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d2bd7-bb54-43a8-ad15-3593ae21a651 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:06.497125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf313819-9c79-4c24-826e-f9f4c6ca5e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:06.497926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf313819-9c79-4c24-826e-f9f4c6ca5e9b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:06.500049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf313819-9c79-4c24-826e-f9f4c6ca5e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:06.502559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf313819-9c79-4c24-826e-f9f4c6ca5e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:06.504341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf313819-9c79-4c24-826e-f9f4c6ca5e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:06.508828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf313819-9c79-4c24-826e-f9f4c6ca5e9b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:06.547208 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1797/3621] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:07:06 2022] POST /identity/v3/projects => generated 393 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:07:06.551417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dc3a4-7400-4f8b-ba25-07bbd7f03ad0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:06.571477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5dc3a4-7400-4f8b-ba25-07bbd7f03ad0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:06.671768 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:06.787385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbaa52-38a5-472a-a4b9-00b493edacbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:06.788023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbaa52-38a5-472a-a4b9-00b493edacbd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:06.788301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbaa52-38a5-472a-a4b9-00b493edacbd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:06.788865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbaa52-38a5-472a-a4b9-00b493edacbd admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:06.789648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbaa52-38a5-472a-a4b9-00b493edacbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:06.792404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cbaa52-38a5-472a-a4b9-00b493edacbd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:06.827513 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1825/3622] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:07:06 2022] POST /identity/v3/users => generated 303 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:07:06.831269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf313819-9c79-4c24-826e-f9f4c6ca5e9b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:06.851755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf313819-9c79-4c24-826e-f9f4c6ca5e9b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:06.876526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da3b04-c816-4a20-9896-9017706d3481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:06.877600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da3b04-c816-4a20-9896-9017706d3481 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:06.878361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da3b04-c816-4a20-9896-9017706d3481 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:06.878844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76da3b04-c816-4a20-9896-9017706d3481 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:06.880444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da3b04-c816-4a20-9896-9017706d3481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:06.883224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76da3b04-c816-4a20-9896-9017706d3481 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:06.925935 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1798/3623] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:06 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:06.930610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbaa52-38a5-472a-a4b9-00b493edacbd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:06.957761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbaa52-38a5-472a-a4b9-00b493edacbd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:06.968525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6d378-efec-4f34-baf0-7fc166d009e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:06.969197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6d378-efec-4f34-baf0-7fc166d009e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:06.969499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6d378-efec-4f34-baf0-7fc166d009e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:06.969769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae6d378-efec-4f34-baf0-7fc166d009e7 admin admin] PATH_INFO: `/v3/projects/9535f147098642a4a50adbe73e0afc7f/users/c6894bd442c7465796694374c07ae771/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:07.008143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6d378-efec-4f34-baf0-7fc166d009e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9535f147098642a4a50adbe73e0afc7f, user_id=c6894bd442c7465796694374c07ae771, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:07.016325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae6d378-efec-4f34-baf0-7fc166d009e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:07.045594 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1826/3624] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:06 2022] PUT /identity/v3/projects/9535f147098642a4a50adbe73e0afc7f/users/c6894bd442c7465796694374c07ae771/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:07.050479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da3b04-c816-4a20-9896-9017706d3481 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:07.068751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76da3b04-c816-4a20-9896-9017706d3481 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:07.223922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a721483-8b30-4521-922b-820791e5b127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:07.226031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a721483-8b30-4521-922b-820791e5b127 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:07.226602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a721483-8b30-4521-922b-820791e5b127 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:07.227301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a721483-8b30-4521-922b-820791e5b127 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:07.228189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a721483-8b30-4521-922b-820791e5b127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:07.236605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a721483-8b30-4521-922b-820791e5b127 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:07.264882 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1799/3625] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:07 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:07.268948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6d378-efec-4f34-baf0-7fc166d009e7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:07.283464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae6d378-efec-4f34-baf0-7fc166d009e7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:07.290258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35f8ed-030c-470b-ab66-10b9ad2395b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:07.291215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35f8ed-030c-470b-ab66-10b9ad2395b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:07.291592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35f8ed-030c-470b-ab66-10b9ad2395b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:07.292099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e35f8ed-030c-470b-ab66-10b9ad2395b0 admin admin] PATH_INFO: `/v3/projects/9535f147098642a4a50adbe73e0afc7f/users/c6894bd442c7465796694374c07ae771/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:07.294864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35f8ed-030c-470b-ab66-10b9ad2395b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9535f147098642a4a50adbe73e0afc7f, user_id=c6894bd442c7465796694374c07ae771, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:07.300814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e35f8ed-030c-470b-ab66-10b9ad2395b0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:07.315128 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1827/3626] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:07 2022] PUT /identity/v3/projects/9535f147098642a4a50adbe73e0afc7f/users/c6894bd442c7465796694374c07ae771/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:07.327779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7fbb-5fff-457f-9b7c-27c099818752 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:07.328212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7fbb-5fff-457f-9b7c-27c099818752 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:07.328590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f7fbb-5fff-457f-9b7c-27c099818752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:07.381235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-169f7fbb-5fff-457f-9b7c-27c099818752 None None] MFA Rules not processed for user `c6894bd442c7465796694374c07ae771`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:07.382719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-169f7fbb-5fff-457f-9b7c-27c099818752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:07.407425 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:07.502491 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1800/3627] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:07 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:07.516973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35f8ed-030c-470b-ab66-10b9ad2395b0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:07.518960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7e35f8ed-030c-470b-ab66-10b9ad2395b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:07.738389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e35f8ed-030c-470b-ab66-10b9ad2395b0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:07.753795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354937c-25a8-48ba-912e-797f3fcfd4d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:07.754524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354937c-25a8-48ba-912e-797f3fcfd4d1 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:07.754876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354937c-25a8-48ba-912e-797f3fcfd4d1 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:07.755220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7354937c-25a8-48ba-912e-797f3fcfd4d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:07.777040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354937c-25a8-48ba-912e-797f3fcfd4d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:07.781726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7354937c-25a8-48ba-912e-797f3fcfd4d1 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:07.818520 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1828/3628] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:07 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:08.228904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958aefe-6dd0-4385-a0b1-ef3b80e5e642 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:08.229861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958aefe-6dd0-4385-a0b1-ef3b80e5e642 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:08.230717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4958aefe-6dd0-4385-a0b1-ef3b80e5e642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:08.277932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354937c-25a8-48ba-912e-797f3fcfd4d1 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:08.301174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7354937c-25a8-48ba-912e-797f3fcfd4d1 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:08.308355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4958aefe-6dd0-4385-a0b1-ef3b80e5e642 None None] MFA Rules not processed for user `c703cc73a22749858ffe05500e52aa03`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:08.309945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4958aefe-6dd0-4385-a0b1-ef3b80e5e642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:08.326144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f06eba-c8ed-48e1-8b88-2e9dff2f549c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:08.327503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06eba-c8ed-48e1-8b88-2e9dff2f549c service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:08.327888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06eba-c8ed-48e1-8b88-2e9dff2f549c service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:08.328265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f06eba-c8ed-48e1-8b88-2e9dff2f549c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:08.454571 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1801/3629] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:08.486637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06eba-c8ed-48e1-8b88-2e9dff2f549c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:08.488340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f06eba-c8ed-48e1-8b88-2e9dff2f549c service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:08.516577 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:08.534201 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1829/3630] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:08 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:07:08.569692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958aefe-6dd0-4385-a0b1-ef3b80e5e642 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:08.784186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4958aefe-6dd0-4385-a0b1-ef3b80e5e642 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:08.796871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:08.797571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:08.797850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:08.798128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] PATH_INFO: `/v3/users/7f5e5507c064421b8e6c7a2a6e4997b8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:08.801543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f5e5507c064421b8e6c7a2a6e4997b8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:08.804725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:08.912841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f5e5507c064421b8e6c7a2a6e4997b8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:08.935333 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:08.943991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f5e5507c064421b8e6c7a2a6e4997b8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:08.945743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f5e5507c064421b8e6c7a2a6e4997b8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:08.957956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f5e5507c064421b8e6c7a2a6e4997b8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:08.970200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f5e5507c064421b8e6c7a2a6e4997b8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:08.991658 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1802/3631] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:07:08 2022] DELETE /identity/v3/users/7f5e5507c064421b8e6c7a2a6e4997b8 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:08.993946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9b19f-0c01-4a39-912a-581425d731c0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:08.994235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9b19f-0c01-4a39-912a-581425d731c0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:08.994540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da9b19f-0c01-4a39-912a-581425d731c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:09.047376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0da9b19f-0c01-4a39-912a-581425d731c0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:09.048774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0da9b19f-0c01-4a39-912a-581425d731c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:09.309259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1830/3632] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:09.354370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:09.356119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:09.513287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d595729-ac38-4a51-9839-d51ee99b2f4c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:09.525022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440d2b-8adf-40b3-8545-8e713327966a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:09.525651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440d2b-8adf-40b3-8545-8e713327966a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:09.525936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440d2b-8adf-40b3-8545-8e713327966a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:09.526262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54440d2b-8adf-40b3-8545-8e713327966a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:09.548275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54440d2b-8adf-40b3-8545-8e713327966a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:09.549786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54440d2b-8adf-40b3-8545-8e713327966a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:09.573416 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1803/3633] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:11.484241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9b19f-0c01-4a39-912a-581425d731c0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:11.486998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0da9b19f-0c01-4a39-912a-581425d731c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:11.508742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da9b19f-0c01-4a39-912a-581425d731c0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:11.541416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:11.543688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:11.545593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:11.546111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] PATH_INFO: `/v3/projects/28e678ec94294cdd8a0d0c9decedb25a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:11.548220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28e678ec94294cdd8a0d0c9decedb25a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:11.555760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:11.654449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28e678ec94294cdd8a0d0c9decedb25a', 'request_id': 'req-a5ebe18e-9ef4-4817-95bc-703698b46e17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:11.665682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28e678ec94294cdd8a0d0c9decedb25a', 'request_id': 'req-a5ebe18e-9ef4-4817-95bc-703698b46e17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:11.690963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28e678ec94294cdd8a0d0c9decedb25a', 'request_id': 'req-a5ebe18e-9ef4-4817-95bc-703698b46e17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:11.706275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] The token cache is being invalidate because project 28e678ec94294cdd8a0d0c9decedb25a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:07:11.706766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:11.707871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a5ebe18e-9ef4-4817-95bc-703698b46e17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:11.710251 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1831/3634] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:07:11 2022] DELETE /identity/v3/projects/28e678ec94294cdd8a0d0c9decedb25a => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:11.714038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440d2b-8adf-40b3-8545-8e713327966a service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:11.726680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54440d2b-8adf-40b3-8545-8e713327966a service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:11.887888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:11.888540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:11.888826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:11.889137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] PATH_INFO: `/v3/users/c6894bd442c7465796694374c07ae771` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:11.906226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6894bd442c7465796694374c07ae771)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:11.908317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:11.992617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6894bd442c7465796694374c07ae771'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:12.024692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6894bd442c7465796694374c07ae771'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:12.025881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6894bd442c7465796694374c07ae771'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:12.045115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6894bd442c7465796694374c07ae771'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:12.057975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6894bd442c7465796694374c07ae771'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:12.063737 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:12.081850 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1804/3635] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:07:11 2022] DELETE /identity/v3/users/c6894bd442c7465796694374c07ae771 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:13.780491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9052942-192d-4008-92cb-27b5f98e18ae None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:13.781928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9052942-192d-4008-92cb-27b5f98e18ae None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:13.782516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9052942-192d-4008-92cb-27b5f98e18ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:13.844010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f9052942-192d-4008-92cb-27b5f98e18ae None None] MFA Rules not processed for user `c92b6e38d9c442b596b113895c61d7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:13.845656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f9052942-192d-4008-92cb-27b5f98e18ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:14.015261 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1832/3636] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:14.378976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:14.386684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:14.454881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9052942-192d-4008-92cb-27b5f98e18ae None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:14.459316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f9052942-192d-4008-92cb-27b5f98e18ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:14.494861 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:14.498015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbfeb82-aa1a-4624-8068-de4f38824351 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:14.516593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b8be39-a61b-4176-9e13-90fba54bcdab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:14.517562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8be39-a61b-4176-9e13-90fba54bcdab service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:14.529474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8be39-a61b-4176-9e13-90fba54bcdab service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:14.530186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b8be39-a61b-4176-9e13-90fba54bcdab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:14.556053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8be39-a61b-4176-9e13-90fba54bcdab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:14.558927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b8be39-a61b-4176-9e13-90fba54bcdab service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:14.577808 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1805/3637] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:14.650082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9052942-192d-4008-92cb-27b5f98e18ae None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:14.665882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:14.668583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:14.669723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:14.670012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] PATH_INFO: `/v3/projects/9535f147098642a4a50adbe73e0afc7f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:14.673401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9535f147098642a4a50adbe73e0afc7f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:14.679651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:14.807854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9535f147098642a4a50adbe73e0afc7f', 'request_id': 'req-3641cc99-321c-4abc-b113-12fbb7d2ff6f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:14.823576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9535f147098642a4a50adbe73e0afc7f', 'request_id': 'req-3641cc99-321c-4abc-b113-12fbb7d2ff6f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:14.835920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9535f147098642a4a50adbe73e0afc7f', 'request_id': 'req-3641cc99-321c-4abc-b113-12fbb7d2ff6f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:14.851719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] The token cache is being invalidate because project 9535f147098642a4a50adbe73e0afc7f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:07:14.852149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:14.853731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3641cc99-321c-4abc-b113-12fbb7d2ff6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:14.857049 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1833/3638] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:07:14 2022] DELETE /identity/v3/projects/9535f147098642a4a50adbe73e0afc7f => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:14.866687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675e34d-5aea-4d25-9d5c-38c2b43d94e6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:14.868139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675e34d-5aea-4d25-9d5c-38c2b43d94e6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:14.868774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b675e34d-5aea-4d25-9d5c-38c2b43d94e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:14.916428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b675e34d-5aea-4d25-9d5c-38c2b43d94e6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:14.917921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b675e34d-5aea-4d25-9d5c-38c2b43d94e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:15.104452 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1806/3639] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:15.111727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4f13-725f-41e9-82f0-3d2d9afdafa9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:15.112238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4f13-725f-41e9-82f0-3d2d9afdafa9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:15.112627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4f13-725f-41e9-82f0-3d2d9afdafa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:15.224342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-946c4f13-725f-41e9-82f0-3d2d9afdafa9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:15.226433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-946c4f13-725f-41e9-82f0-3d2d9afdafa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:15.267075 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1834/3640] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:07:15.272402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675e34d-5aea-4d25-9d5c-38c2b43d94e6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:15.285398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b675e34d-5aea-4d25-9d5c-38c2b43d94e6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:15.319495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e972-9274-47f7-9f4d-761ecca254f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:15.320835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e972-9274-47f7-9f4d-761ecca254f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:15.321267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e972-9274-47f7-9f4d-761ecca254f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:15.321828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f1e972-9274-47f7-9f4d-761ecca254f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:15.323236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e972-9274-47f7-9f4d-761ecca254f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:07:15.328504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e972-9274-47f7-9f4d-761ecca254f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:15.332976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f1e972-9274-47f7-9f4d-761ecca254f2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:15.356317 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1807/3641] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:07:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:07:15.361522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4f13-725f-41e9-82f0-3d2d9afdafa9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:15.383797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4f13-725f-41e9-82f0-3d2d9afdafa9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:15.413667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15752b55-d9d9-4cbd-9799-ad7c412008e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:15.415510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15752b55-d9d9-4cbd-9799-ad7c412008e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:15.415822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15752b55-d9d9-4cbd-9799-ad7c412008e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:15.416077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15752b55-d9d9-4cbd-9799-ad7c412008e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:15.416753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15752b55-d9d9-4cbd-9799-ad7c412008e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:15.418748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15752b55-d9d9-4cbd-9799-ad7c412008e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:15.489757 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1835/3642] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:07:15 2022] POST /identity/v3/projects => generated 371 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:07:15.494238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e972-9274-47f7-9f4d-761ecca254f2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:15.510597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f1e972-9274-47f7-9f4d-761ecca254f2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:15.614012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800cbcc-d787-421c-8317-1cfc67df79e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:15.614660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800cbcc-d787-421c-8317-1cfc67df79e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:15.614997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800cbcc-d787-421c-8317-1cfc67df79e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:15.615301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a800cbcc-d787-421c-8317-1cfc67df79e4 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:15.615997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800cbcc-d787-421c-8317-1cfc67df79e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:15.629940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a800cbcc-d787-421c-8317-1cfc67df79e4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:15.665020 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1808/3643] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:07:15 2022] POST /identity/v3/users => generated 286 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:07:15.670711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15752b55-d9d9-4cbd-9799-ad7c412008e8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:15.690529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15752b55-d9d9-4cbd-9799-ad7c412008e8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:15.702371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f2e62-1d50-494b-b06c-65a876c6b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:15.703929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f2e62-1d50-494b-b06c-65a876c6b5ab admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:15.704240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f2e62-1d50-494b-b06c-65a876c6b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:15.704479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f2e62-1d50-494b-b06c-65a876c6b5ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:15.705379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f2e62-1d50-494b-b06c-65a876c6b5ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:15.707319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f2e62-1d50-494b-b06c-65a876c6b5ab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:15.720720 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1836/3644] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:07:15.725262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800cbcc-d787-421c-8317-1cfc67df79e4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:15.733363 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:15.739262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a800cbcc-d787-421c-8317-1cfc67df79e4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:15.747424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf7aa65-1a66-41f0-8456-fd59aeb5977b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:15.748199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7aa65-1a66-41f0-8456-fd59aeb5977b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:15.748855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7aa65-1a66-41f0-8456-fd59aeb5977b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:15.749462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf7aa65-1a66-41f0-8456-fd59aeb5977b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:15.750722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7aa65-1a66-41f0-8456-fd59aeb5977b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:15.753543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf7aa65-1a66-41f0-8456-fd59aeb5977b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:15.774727 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1809/3645] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:15 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:15.778703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f2e62-1d50-494b-b06c-65a876c6b5ab admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:15.806323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f2e62-1d50-494b-b06c-65a876c6b5ab admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:15.823071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7db3f1-6e56-45b8-843d-a719e77a7bc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:15.825645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7db3f1-6e56-45b8-843d-a719e77a7bc8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:15.827644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7db3f1-6e56-45b8-843d-a719e77a7bc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:15.828308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7db3f1-6e56-45b8-843d-a719e77a7bc8 admin admin] PATH_INFO: `/v3/projects/8c9d3ba6d3c44a0fb855f6dbe9eac22e/users/0c54b473269a4657806f6c753230d962/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:15.859253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7db3f1-6e56-45b8-843d-a719e77a7bc8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9d3ba6d3c44a0fb855f6dbe9eac22e, user_id=0c54b473269a4657806f6c753230d962, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:15.863658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7db3f1-6e56-45b8-843d-a719e77a7bc8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:15.891011 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1837/3646] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:15 2022] PUT /identity/v3/projects/8c9d3ba6d3c44a0fb855f6dbe9eac22e/users/0c54b473269a4657806f6c753230d962/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:07:15.903979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0056-4fbf-4bf8-983d-890db5ac624b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:15.904589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0056-4fbf-4bf8-983d-890db5ac624b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:15.905055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed0056-4fbf-4bf8-983d-890db5ac624b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:15.977876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-95ed0056-4fbf-4bf8-983d-890db5ac624b None None] MFA Rules not processed for user `0c54b473269a4657806f6c753230d962`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:15.983398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-95ed0056-4fbf-4bf8-983d-890db5ac624b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:16.148067 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1810/3647] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:07:16.150542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7db3f1-6e56-45b8-843d-a719e77a7bc8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:16.152966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4a7db3f1-6e56-45b8-843d-a719e77a7bc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:16.217694 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:16.270740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7db3f1-6e56-45b8-843d-a719e77a7bc8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:16.280064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37173ea-ef3b-4b23-b615-7fd6b03e75f5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:16.281138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37173ea-ef3b-4b23-b615-7fd6b03e75f5 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:16.281617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37173ea-ef3b-4b23-b615-7fd6b03e75f5 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:16.282091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37173ea-ef3b-4b23-b615-7fd6b03e75f5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:16.294963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37173ea-ef3b-4b23-b615-7fd6b03e75f5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:16.297566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37173ea-ef3b-4b23-b615-7fd6b03e75f5 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:16.308742 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1838/3648] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:17.854897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0056-4fbf-4bf8-983d-890db5ac624b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:17.935979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed0056-4fbf-4bf8-983d-890db5ac624b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:17.942651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:17.944127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:17.944471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:17.944920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] PATH_INFO: `/v3/users/0c54b473269a4657806f6c753230d962` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:17.947631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c54b473269a4657806f6c753230d962)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:17.950179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:18.017637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c54b473269a4657806f6c753230d962'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:18.033538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c54b473269a4657806f6c753230d962'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:18.034782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c54b473269a4657806f6c753230d962'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:18.045062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c54b473269a4657806f6c753230d962'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:18.065475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c54b473269a4657806f6c753230d962'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:18.067398 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:18.075488 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1811/3649] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:07:17 2022] DELETE /identity/v3/users/0c54b473269a4657806f6c753230d962 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:18.080625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b795e-550d-4e3e-be2d-bae3ff982e07 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:18.082197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b795e-550d-4e3e-be2d-bae3ff982e07 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:18.082887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7b795e-550d-4e3e-be2d-bae3ff982e07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:18.116341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ce7b795e-550d-4e3e-be2d-bae3ff982e07 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:18.117645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ce7b795e-550d-4e3e-be2d-bae3ff982e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:18.250406 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1839/3650] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:18.275209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:18.279989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:18.382608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0f98e8-5cbd-413f-8555-04b3a0e314ff admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:18.386954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b135922b-bd7a-4cee-8de3-2f764c15468a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:18.387686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135922b-bd7a-4cee-8de3-2f764c15468a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:18.387985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135922b-bd7a-4cee-8de3-2f764c15468a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:18.388256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135922b-bd7a-4cee-8de3-2f764c15468a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:18.421986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135922b-bd7a-4cee-8de3-2f764c15468a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:18.423457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b135922b-bd7a-4cee-8de3-2f764c15468a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:18.447763 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1812/3651] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:19.711281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b795e-550d-4e3e-be2d-bae3ff982e07 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:19.712775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ce7b795e-550d-4e3e-be2d-bae3ff982e07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:19.728679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7b795e-550d-4e3e-be2d-bae3ff982e07 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:19.740520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:19.743002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:19.744209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:19.744729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] PATH_INFO: `/v3/projects/8c9d3ba6d3c44a0fb855f6dbe9eac22e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:19.750542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9d3ba6d3c44a0fb855f6dbe9eac22e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:19.753138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:19.870475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9d3ba6d3c44a0fb855f6dbe9eac22e', 'request_id': 'req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:19.884545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9d3ba6d3c44a0fb855f6dbe9eac22e', 'request_id': 'req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:19.900189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9d3ba6d3c44a0fb855f6dbe9eac22e', 'request_id': 'req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:19.968705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] The token cache is being invalidate because project 8c9d3ba6d3c44a0fb855f6dbe9eac22e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:07:19.969318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:19.971073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1feef2e7-b6ac-4186-83c2-b1f74c29dd90 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:19.978527 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1840/3652] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:07:19 2022] DELETE /identity/v3/projects/8c9d3ba6d3c44a0fb855f6dbe9eac22e => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:07:19.983855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d771d-b83b-4658-98fe-9e6997c837d5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:19.984394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d771d-b83b-4658-98fe-9e6997c837d5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:19.984394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d771d-b83b-4658-98fe-9e6997c837d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:20.030942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9b1d771d-b83b-4658-98fe-9e6997c837d5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:20.032168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9b1d771d-b83b-4658-98fe-9e6997c837d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:20.131909 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1813/3653] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:20.140443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda5cfa-ce49-42ca-92dc-ac21324ebfb6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:20.141431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda5cfa-ce49-42ca-92dc-ac21324ebfb6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:20.141784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda5cfa-ce49-42ca-92dc-ac21324ebfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:20.203755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aeda5cfa-ce49-42ca-92dc-ac21324ebfb6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:20.205017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aeda5cfa-ce49-42ca-92dc-ac21324ebfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:20.234643 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1841/3654] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:20.235541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d771d-b83b-4658-98fe-9e6997c837d5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:20.250161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d771d-b83b-4658-98fe-9e6997c837d5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:20.264458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71be2d-4000-42c5-aefe-171de6aeedbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:20.265237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71be2d-4000-42c5-aefe-171de6aeedbc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:20.265548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71be2d-4000-42c5-aefe-171de6aeedbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:20.265812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c71be2d-4000-42c5-aefe-171de6aeedbc admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:20.266471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71be2d-4000-42c5-aefe-171de6aeedbc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:07:20.266768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71be2d-4000-42c5-aefe-171de6aeedbc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:20.268399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c71be2d-4000-42c5-aefe-171de6aeedbc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:20.301045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda5cfa-ce49-42ca-92dc-ac21324ebfb6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:20.307472 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1814/3655] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:07:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:07:20.313629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda5cfa-ce49-42ca-92dc-ac21324ebfb6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:20.324122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2d24f-77c1-4acc-ab57-a7685c5e350a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:20.324877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2d24f-77c1-4acc-ab57-a7685c5e350a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:20.325136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2d24f-77c1-4acc-ab57-a7685c5e350a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:20.325441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe2d24f-77c1-4acc-ab57-a7685c5e350a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:20.326789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2d24f-77c1-4acc-ab57-a7685c5e350a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:20.336269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe2d24f-77c1-4acc-ab57-a7685c5e350a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:20.396123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71be2d-4000-42c5-aefe-171de6aeedbc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:20.408098 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1842/3656] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:07:20 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:07:20.418494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c71be2d-4000-42c5-aefe-171de6aeedbc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:20.552296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88410982-d764-4670-9bc2-fa0593a09c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:20.553222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88410982-d764-4670-9bc2-fa0593a09c88 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:20.553728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88410982-d764-4670-9bc2-fa0593a09c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:20.554174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88410982-d764-4670-9bc2-fa0593a09c88 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:20.554975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88410982-d764-4670-9bc2-fa0593a09c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:20.559917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88410982-d764-4670-9bc2-fa0593a09c88 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:20.615071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2d24f-77c1-4acc-ab57-a7685c5e350a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:20.615987 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1815/3657] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:07:20 2022] POST /identity/v3/users => generated 291 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:07:20.631399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe2d24f-77c1-4acc-ab57-a7685c5e350a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:20.644614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ad68-7c52-4a92-aecb-2ad19282f973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:20.645665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ad68-7c52-4a92-aecb-2ad19282f973 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:20.646167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ad68-7c52-4a92-aecb-2ad19282f973 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:20.646759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56ad68-7c52-4a92-aecb-2ad19282f973 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:20.647635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56ad68-7c52-4a92-aecb-2ad19282f973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:20.649871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56ad68-7c52-4a92-aecb-2ad19282f973 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:20.666313 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1843/3658] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:20.667993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88410982-d764-4670-9bc2-fa0593a09c88 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:20.680768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88410982-d764-4670-9bc2-fa0593a09c88 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:20.688696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07560f53-4b8c-4bdc-a896-c4284d1b9deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:20.689771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07560f53-4b8c-4bdc-a896-c4284d1b9deb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:20.690261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07560f53-4b8c-4bdc-a896-c4284d1b9deb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:20.690764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07560f53-4b8c-4bdc-a896-c4284d1b9deb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:20.691658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07560f53-4b8c-4bdc-a896-c4284d1b9deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:20.697933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07560f53-4b8c-4bdc-a896-c4284d1b9deb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:20.713124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1816/3659] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:20.718707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ad68-7c52-4a92-aecb-2ad19282f973 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:20.731008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56ad68-7c52-4a92-aecb-2ad19282f973 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:20.749153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ccfe9-7552-457b-a8e2-4b2d5ddd094b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:20.750212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ccfe9-7552-457b-a8e2-4b2d5ddd094b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:20.759800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ccfe9-7552-457b-a8e2-4b2d5ddd094b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:20.760325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752ccfe9-7552-457b-a8e2-4b2d5ddd094b admin admin] PATH_INFO: `/v3/projects/36d08afe0cae4a30b7893af60cb43176/users/91889207aa8c42ae96929f703c4d17db/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:20.767322 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:20.786150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ccfe9-7552-457b-a8e2-4b2d5ddd094b admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d08afe0cae4a30b7893af60cb43176, user_id=91889207aa8c42ae96929f703c4d17db, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:20.789750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752ccfe9-7552-457b-a8e2-4b2d5ddd094b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:20.829375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16919d4a-33ac-432d-a736-0eaba9d85440 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:20.833112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16919d4a-33ac-432d-a736-0eaba9d85440 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:20.833558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16919d4a-33ac-432d-a736-0eaba9d85440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:20.837670 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1844/3660] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:20 2022] PUT /identity/v3/projects/36d08afe0cae4a30b7893af60cb43176/users/91889207aa8c42ae96929f703c4d17db/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:20.871422 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:20.888433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-16919d4a-33ac-432d-a736-0eaba9d85440 None None] MFA Rules not processed for user `91889207aa8c42ae96929f703c4d17db`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:20.890969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16919d4a-33ac-432d-a736-0eaba9d85440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:21.024121 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1817/3661] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:20 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:21.038726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ccfe9-7552-457b-a8e2-4b2d5ddd094b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:21.041005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-752ccfe9-7552-457b-a8e2-4b2d5ddd094b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:21.205843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752ccfe9-7552-457b-a8e2-4b2d5ddd094b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:21.218566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced98327-92ff-43fe-b75e-15c0aaf6e83b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:21.219796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced98327-92ff-43fe-b75e-15c0aaf6e83b service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:21.220376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced98327-92ff-43fe-b75e-15c0aaf6e83b service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:21.221369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced98327-92ff-43fe-b75e-15c0aaf6e83b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:21.234845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced98327-92ff-43fe-b75e-15c0aaf6e83b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:21.239217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced98327-92ff-43fe-b75e-15c0aaf6e83b service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:21.262511 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1845/3662] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:21 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:21.355909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16919d4a-33ac-432d-a736-0eaba9d85440 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:21.467443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16919d4a-33ac-432d-a736-0eaba9d85440 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:21.473982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:21.475300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:21.475797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:21.488633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] PATH_INFO: `/v3/users/91889207aa8c42ae96929f703c4d17db` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:21.490781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91889207aa8c42ae96929f703c4d17db)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:21.492743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:21.581335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91889207aa8c42ae96929f703c4d17db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:21.598081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91889207aa8c42ae96929f703c4d17db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:21.598978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91889207aa8c42ae96929f703c4d17db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:21.618749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0a0fe-8c8e-4f7c-bdc7-8e52e3f37416 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:21.619099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0a0fe-8c8e-4f7c-bdc7-8e52e3f37416 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:21.619832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0a0fe-8c8e-4f7c-bdc7-8e52e3f37416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:21.621890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91889207aa8c42ae96929f703c4d17db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:21.637186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c1f2709e-cb75-406a-8b90-d96661f5a2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91889207aa8c42ae96929f703c4d17db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:21.658297 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1818/3663] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:07:21 2022] DELETE /identity/v3/users/91889207aa8c42ae96929f703c4d17db => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:21.668882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0bd0a0fe-8c8e-4f7c-bdc7-8e52e3f37416 None None] MFA Rules not processed for user `c92b6e38d9c442b596b113895c61d7c6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:21.671126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0bd0a0fe-8c8e-4f7c-bdc7-8e52e3f37416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:21.685406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecce0a-b259-41d6-8ef7-71f8fa77c687 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:21.685921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecce0a-b259-41d6-8ef7-71f8fa77c687 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:21.686960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ecce0a-b259-41d6-8ef7-71f8fa77c687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:21.750779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f3ecce0a-b259-41d6-8ef7-71f8fa77c687 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:21.753387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f3ecce0a-b259-41d6-8ef7-71f8fa77c687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:21.774086 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:21.797394 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1846/3664] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:21.850314 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1819/3665] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:21.870607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0a0fe-8c8e-4f7c-bdc7-8e52e3f37416 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:21.873530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0bd0a0fe-8c8e-4f7c-bdc7-8e52e3f37416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:21.973925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0a0fe-8c8e-4f7c-bdc7-8e52e3f37416 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:21.977173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf6e70-4d72-4e08-b6b7-46209d7eb1a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:21.977910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf6e70-4d72-4e08-b6b7-46209d7eb1a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:21.978312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf6e70-4d72-4e08-b6b7-46209d7eb1a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:21.978907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf6e70-4d72-4e08-b6b7-46209d7eb1a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:21.989847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf6e70-4d72-4e08-b6b7-46209d7eb1a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:21.991329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaf6e70-4d72-4e08-b6b7-46209d7eb1a0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:22.002357 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1847/3666] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:22.819961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecce0a-b259-41d6-8ef7-71f8fa77c687 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:22.822499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f3ecce0a-b259-41d6-8ef7-71f8fa77c687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:22.877505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ecce0a-b259-41d6-8ef7-71f8fa77c687 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:22.895179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:22.898123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:22.900873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:22.905617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] PATH_INFO: `/v3/projects/36d08afe0cae4a30b7893af60cb43176` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:22.909263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d08afe0cae4a30b7893af60cb43176)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:22.911746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:23.039628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d08afe0cae4a30b7893af60cb43176', 'request_id': 'req-e2a8a2e7-31e2-416f-8749-8750c83a3571'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:23.047522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d08afe0cae4a30b7893af60cb43176', 'request_id': 'req-e2a8a2e7-31e2-416f-8749-8750c83a3571'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:23.065219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d08afe0cae4a30b7893af60cb43176', 'request_id': 'req-e2a8a2e7-31e2-416f-8749-8750c83a3571'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:23.081408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] The token cache is being invalidate because project 36d08afe0cae4a30b7893af60cb43176 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:07:23.081889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:23.082713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e2a8a2e7-31e2-416f-8749-8750c83a3571 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:23.086060 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1820/3667] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:07:22 2022] DELETE /identity/v3/projects/36d08afe0cae4a30b7893af60cb43176 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:23.092569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab86c1-57a5-4ea2-bcbd-42f097bb0edc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:23.093568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab86c1-57a5-4ea2-bcbd-42f097bb0edc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:23.093848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab86c1-57a5-4ea2-bcbd-42f097bb0edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:23.122690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e9ab86c1-57a5-4ea2-bcbd-42f097bb0edc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:23.124216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e9ab86c1-57a5-4ea2-bcbd-42f097bb0edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:23.164835 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:23.231363 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1848/3668] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:23.241375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba52af-da8e-446f-ab66-7b4f1aad0458 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:23.241854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba52af-da8e-446f-ab66-7b4f1aad0458 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:23.242313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba52af-da8e-446f-ab66-7b4f1aad0458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:23.274359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-82ba52af-da8e-446f-ab66-7b4f1aad0458 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:23.275868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82ba52af-da8e-446f-ab66-7b4f1aad0458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:23.319606 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1821/3669] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:23.325595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab86c1-57a5-4ea2-bcbd-42f097bb0edc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:23.339327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab86c1-57a5-4ea2-bcbd-42f097bb0edc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:23.359323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5a851-14bf-4cde-9233-37b9d2e2a2f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:23.359957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5a851-14bf-4cde-9233-37b9d2e2a2f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:23.360238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5a851-14bf-4cde-9233-37b9d2e2a2f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:23.365384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd5a851-14bf-4cde-9233-37b9d2e2a2f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:23.365384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5a851-14bf-4cde-9233-37b9d2e2a2f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:07:23.365384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5a851-14bf-4cde-9233-37b9d2e2a2f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:23.365384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd5a851-14bf-4cde-9233-37b9d2e2a2f0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:23.392780 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1849/3670] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:07:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:07:23.397600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba52af-da8e-446f-ab66-7b4f1aad0458 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:23.413479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba52af-da8e-446f-ab66-7b4f1aad0458 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:23.427198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9abbd9-9c00-4333-9914-c5ae5ed6ca46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:23.428563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9abbd9-9c00-4333-9914-c5ae5ed6ca46 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:23.429117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9abbd9-9c00-4333-9914-c5ae5ed6ca46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:23.429654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9abbd9-9c00-4333-9914-c5ae5ed6ca46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:23.430554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9abbd9-9c00-4333-9914-c5ae5ed6ca46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:23.432725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9abbd9-9c00-4333-9914-c5ae5ed6ca46 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:23.494370 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1822/3671] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:07:23 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:07:23.499092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5a851-14bf-4cde-9233-37b9d2e2a2f0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:23.520188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd5a851-14bf-4cde-9233-37b9d2e2a2f0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:23.617533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2f7b-3757-4748-bdeb-7048f7e672d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:23.618759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2f7b-3757-4748-bdeb-7048f7e672d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:23.620604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2f7b-3757-4748-bdeb-7048f7e672d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:23.621101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a2f7b-3757-4748-bdeb-7048f7e672d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:23.622892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2f7b-3757-4748-bdeb-7048f7e672d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:23.629172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a2f7b-3757-4748-bdeb-7048f7e672d5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:23.683637 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1850/3672] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:07:23 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:07:23.687438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9abbd9-9c00-4333-9914-c5ae5ed6ca46 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:23.713681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9abbd9-9c00-4333-9914-c5ae5ed6ca46 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:23.725940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd967ee-36ae-4aa3-b01a-ccccb3603539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:23.727781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd967ee-36ae-4aa3-b01a-ccccb3603539 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:23.728823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd967ee-36ae-4aa3-b01a-ccccb3603539 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:23.729188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd967ee-36ae-4aa3-b01a-ccccb3603539 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:23.729933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd967ee-36ae-4aa3-b01a-ccccb3603539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:23.731613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd967ee-36ae-4aa3-b01a-ccccb3603539 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:23.779060 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1823/3673] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:23.783569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2f7b-3757-4748-bdeb-7048f7e672d5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:23.820080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a2f7b-3757-4748-bdeb-7048f7e672d5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:23.837720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6863b-2dc7-4461-aeff-63ce93b4bc68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:23.839633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6863b-2dc7-4461-aeff-63ce93b4bc68 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:23.839888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6863b-2dc7-4461-aeff-63ce93b4bc68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:23.840177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6863b-2dc7-4461-aeff-63ce93b4bc68 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:23.842676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6863b-2dc7-4461-aeff-63ce93b4bc68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:23.849876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6863b-2dc7-4461-aeff-63ce93b4bc68 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:23.889253 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1851/3674] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:23 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:23.892948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd967ee-36ae-4aa3-b01a-ccccb3603539 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:23.909732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd967ee-36ae-4aa3-b01a-ccccb3603539 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:23.923420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66412e06-27c1-46d8-874b-b8bff370ab6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:23.924367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66412e06-27c1-46d8-874b-b8bff370ab6e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:23.924649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66412e06-27c1-46d8-874b-b8bff370ab6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:23.924921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66412e06-27c1-46d8-874b-b8bff370ab6e admin admin] PATH_INFO: `/v3/projects/82888bc2bd7c40dcbae68a5e4fa6c4f2/users/5ae455a2351c4cf9a32ca68e686d27d0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:23.958399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66412e06-27c1-46d8-874b-b8bff370ab6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=82888bc2bd7c40dcbae68a5e4fa6c4f2, user_id=5ae455a2351c4cf9a32ca68e686d27d0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:23.961821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66412e06-27c1-46d8-874b-b8bff370ab6e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:23.988265 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1824/3675] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:23 2022] PUT /identity/v3/projects/82888bc2bd7c40dcbae68a5e4fa6c4f2/users/5ae455a2351c4cf9a32ca68e686d27d0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:23.994549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74053618-7b52-40e6-9563-8fff13c629bf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:23.994977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74053618-7b52-40e6-9563-8fff13c629bf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:23.996339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74053618-7b52-40e6-9563-8fff13c629bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:24.042544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-74053618-7b52-40e6-9563-8fff13c629bf None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:24.048952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-74053618-7b52-40e6-9563-8fff13c629bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:24.197721 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1852/3676] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:24.256335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66412e06-27c1-46d8-874b-b8bff370ab6e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:24.258551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-66412e06-27c1-46d8-874b-b8bff370ab6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:24.361507 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:24.404530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66412e06-27c1-46d8-874b-b8bff370ab6e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:24.412794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eab5e-61d2-404d-b38d-7b08a46a9834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:24.413600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eab5e-61d2-404d-b38d-7b08a46a9834 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:24.414028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eab5e-61d2-404d-b38d-7b08a46a9834 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:24.414405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5eab5e-61d2-404d-b38d-7b08a46a9834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:24.430042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eab5e-61d2-404d-b38d-7b08a46a9834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:24.432568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5eab5e-61d2-404d-b38d-7b08a46a9834 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:24.457728 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1825/3677] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:25.378478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74053618-7b52-40e6-9563-8fff13c629bf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:25.382644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-74053618-7b52-40e6-9563-8fff13c629bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:25.411253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74053618-7b52-40e6-9563-8fff13c629bf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:25.424494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:25.425854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:25.426469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:25.426900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] PATH_INFO: `/v3/users/136253a1592742219ad302722be1d5f2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:25.428324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=136253a1592742219ad302722be1d5f2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:25.433371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:25.462881 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:25.526780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '136253a1592742219ad302722be1d5f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:25.549683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '136253a1592742219ad302722be1d5f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:25.550840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '136253a1592742219ad302722be1d5f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:25.566254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '136253a1592742219ad302722be1d5f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:25.579907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8f8f9da-d176-451a-a0f6-4e398b7dd210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '136253a1592742219ad302722be1d5f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:25.612179 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1853/3678] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:07:25 2022] DELETE /identity/v3/users/136253a1592742219ad302722be1d5f2 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:25.946132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eab5e-61d2-404d-b38d-7b08a46a9834 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:25.962689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5eab5e-61d2-404d-b38d-7b08a46a9834 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:26.120029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:26.120545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:26.121012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:26.121316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] PATH_INFO: `/v3/projects/18d52fd8cbf748b881b4cd6f065381dc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:26.124057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] RBAC: Authorizing `identity:delete_project(project_id=18d52fd8cbf748b881b4cd6f065381dc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:26.126779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:26.214975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18d52fd8cbf748b881b4cd6f065381dc', 'request_id': 'req-f41a8446-d94e-4290-b730-27419f64297e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:26.223700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18d52fd8cbf748b881b4cd6f065381dc', 'request_id': 'req-f41a8446-d94e-4290-b730-27419f64297e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:26.235539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18d52fd8cbf748b881b4cd6f065381dc', 'request_id': 'req-f41a8446-d94e-4290-b730-27419f64297e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:26.249442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] The token cache is being invalidate because project 18d52fd8cbf748b881b4cd6f065381dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:07:26.250055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:26.250991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f41a8446-d94e-4290-b730-27419f64297e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:26.258871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480096b-bfff-491b-ad47-d135cb95abb5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:26.259556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480096b-bfff-491b-ad47-d135cb95abb5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:26.260032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480096b-bfff-491b-ad47-d135cb95abb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:26.264323 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1826/3679] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:07:25 2022] DELETE /identity/v3/projects/18d52fd8cbf748b881b4cd6f065381dc => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:26.286874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5480096b-bfff-491b-ad47-d135cb95abb5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:26.288861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5480096b-bfff-491b-ad47-d135cb95abb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:26.366965 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1854/3680] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:26.375652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c658b-cac2-4415-9046-e4530aadb49a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:26.375966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c658b-cac2-4415-9046-e4530aadb49a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:26.376179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7c658b-cac2-4415-9046-e4530aadb49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:26.405503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ce7c658b-cac2-4415-9046-e4530aadb49a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:26.406705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ce7c658b-cac2-4415-9046-e4530aadb49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:26.420654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1827/3681] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:26.425935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480096b-bfff-491b-ad47-d135cb95abb5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:26.451810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480096b-bfff-491b-ad47-d135cb95abb5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:26.471765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3c130-ca33-434c-847f-8b53906c6ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:26.472819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3c130-ca33-434c-847f-8b53906c6ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:26.474050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3c130-ca33-434c-847f-8b53906c6ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:26.475406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d3c130-ca33-434c-847f-8b53906c6ce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:26.476448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3c130-ca33-434c-847f-8b53906c6ce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:07:26.476955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3c130-ca33-434c-847f-8b53906c6ce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:26.479861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d3c130-ca33-434c-847f-8b53906c6ce3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:26.507321 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1855/3682] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:07:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:07:26.515232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c658b-cac2-4415-9046-e4530aadb49a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:26.548608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7c658b-cac2-4415-9046-e4530aadb49a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:26.563127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce37a9-c3c9-42d0-8d5a-4a05283414ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:26.563812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce37a9-c3c9-42d0-8d5a-4a05283414ea admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:26.564096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce37a9-c3c9-42d0-8d5a-4a05283414ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:26.564376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ce37a9-c3c9-42d0-8d5a-4a05283414ea admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:26.565070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce37a9-c3c9-42d0-8d5a-4a05283414ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:26.568278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ce37a9-c3c9-42d0-8d5a-4a05283414ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:26.627041 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1828/3683] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:07:26 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:07:26.632483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3c130-ca33-434c-847f-8b53906c6ce3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:26.647252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d3c130-ca33-434c-847f-8b53906c6ce3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:26.768066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56947461-09ef-4606-9e87-2c91d891502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:26.769162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56947461-09ef-4606-9e87-2c91d891502d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:26.770313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56947461-09ef-4606-9e87-2c91d891502d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:26.770757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56947461-09ef-4606-9e87-2c91d891502d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:26.772374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56947461-09ef-4606-9e87-2c91d891502d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:26.777935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56947461-09ef-4606-9e87-2c91d891502d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:26.816448 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1856/3684] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:07:26 2022] POST /identity/v3/users => generated 294 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:07:26.820460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce37a9-c3c9-42d0-8d5a-4a05283414ea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:26.832285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ce37a9-c3c9-42d0-8d5a-4a05283414ea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:26.840945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ceab9d-8979-4c71-9b73-b5c410efc3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:26.841627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceab9d-8979-4c71-9b73-b5c410efc3cb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:26.842921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceab9d-8979-4c71-9b73-b5c410efc3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:26.842921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ceab9d-8979-4c71-9b73-b5c410efc3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:26.843872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ceab9d-8979-4c71-9b73-b5c410efc3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:26.847291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ceab9d-8979-4c71-9b73-b5c410efc3cb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:26.879763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56947461-09ef-4606-9e87-2c91d891502d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:26.898797 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1829/3685] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:26.902940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56947461-09ef-4606-9e87-2c91d891502d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:26.922430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a60e5-0e10-4b74-9a22-ac6cb72eb91b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:26.923202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a60e5-0e10-4b74-9a22-ac6cb72eb91b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:26.924783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a60e5-0e10-4b74-9a22-ac6cb72eb91b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:26.925246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a60e5-0e10-4b74-9a22-ac6cb72eb91b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:26.928453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a60e5-0e10-4b74-9a22-ac6cb72eb91b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:26.932407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a60e5-0e10-4b74-9a22-ac6cb72eb91b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:26.984901 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1857/3686] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:26 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:26.989289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ceab9d-8979-4c71-9b73-b5c410efc3cb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:27.008314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ceab9d-8979-4c71-9b73-b5c410efc3cb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:27.022776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a72f4-5e8f-4d70-8686-85330cb0e003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:27.024012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a72f4-5e8f-4d70-8686-85330cb0e003 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:27.024591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a72f4-5e8f-4d70-8686-85330cb0e003 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:27.025855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452a72f4-5e8f-4d70-8686-85330cb0e003 admin admin] PATH_INFO: `/v3/projects/088a5c29652d43ba950e02d8f211c591/users/febaff91ac1b4977848d8a67517a70fd/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:27.076312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a72f4-5e8f-4d70-8686-85330cb0e003 admin admin] RBAC: Authorizing `identity:create_grant(project_id=088a5c29652d43ba950e02d8f211c591, user_id=febaff91ac1b4977848d8a67517a70fd, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:27.080213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452a72f4-5e8f-4d70-8686-85330cb0e003 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:27.101969 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1830/3687] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:26 2022] PUT /identity/v3/projects/088a5c29652d43ba950e02d8f211c591/users/febaff91ac1b4977848d8a67517a70fd/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:27.108494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790f4d6-460f-44d3-966e-4f66f8c6085e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:27.109059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790f4d6-460f-44d3-966e-4f66f8c6085e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:27.109378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790f4d6-460f-44d3-966e-4f66f8c6085e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:27.118563 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:27.179551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2790f4d6-460f-44d3-966e-4f66f8c6085e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:27.182124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2790f4d6-460f-44d3-966e-4f66f8c6085e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:27.327447 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1858/3688] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:27.388253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a72f4-5e8f-4d70-8686-85330cb0e003 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:27.391369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-452a72f4-5e8f-4d70-8686-85330cb0e003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:27.408798 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:27.562462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452a72f4-5e8f-4d70-8686-85330cb0e003 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:27.585328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262a3c20-c36d-43f9-ba44-4dc56dd063b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:27.586551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3c20-c36d-43f9-ba44-4dc56dd063b6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:27.587367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3c20-c36d-43f9-ba44-4dc56dd063b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:27.587846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262a3c20-c36d-43f9-ba44-4dc56dd063b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:27.619118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a3c20-c36d-43f9-ba44-4dc56dd063b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:27.620992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262a3c20-c36d-43f9-ba44-4dc56dd063b6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:27.646978 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1831/3689] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:37.312541 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=26 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:37.499404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e351df4-0654-472a-9813-153a1bd23d59 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:37.499827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e351df4-0654-472a-9813-153a1bd23d59 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:37.500183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e351df4-0654-472a-9813-153a1bd23d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:37.539586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8e351df4-0654-472a-9813-153a1bd23d59 None None] MFA Rules not processed for user `5ae455a2351c4cf9a32ca68e686d27d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:37.541061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8e351df4-0654-472a-9813-153a1bd23d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:37.632083 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=23 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:37.719156 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1859/3690] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:37.719417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106faf96-90ac-4d50-b96f-b8ea5ce006c0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:37.719596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106faf96-90ac-4d50-b96f-b8ea5ce006c0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:37.719856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106faf96-90ac-4d50-b96f-b8ea5ce006c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:37.790565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-106faf96-90ac-4d50-b96f-b8ea5ce006c0 None None] MFA Rules not processed for user `5ae455a2351c4cf9a32ca68e686d27d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:37.792040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-106faf96-90ac-4d50-b96f-b8ea5ce006c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:37.809444 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1832/3691] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:37 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:07:37.821217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e351df4-0654-472a-9813-153a1bd23d59 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:37.822634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8e351df4-0654-472a-9813-153a1bd23d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:38.021417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e351df4-0654-472a-9813-153a1bd23d59 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:38.027315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e417415c-b2fe-43d5-ba3d-cef055ccb769 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:38.027946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417415c-b2fe-43d5-ba3d-cef055ccb769 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:38.028226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417415c-b2fe-43d5-ba3d-cef055ccb769 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:38.028499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e417415c-b2fe-43d5-ba3d-cef055ccb769 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:38.046606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417415c-b2fe-43d5-ba3d-cef055ccb769 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:38.048643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e417415c-b2fe-43d5-ba3d-cef055ccb769 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:38.087099 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1860/3692] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:37 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:39.091244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106faf96-90ac-4d50-b96f-b8ea5ce006c0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:39.108999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106faf96-90ac-4d50-b96f-b8ea5ce006c0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:39.136802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928719ad-bd3e-4580-bc81-c4a72b2177c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:39.137481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928719ad-bd3e-4580-bc81-c4a72b2177c3 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:39.137763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928719ad-bd3e-4580-bc81-c4a72b2177c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:39.138039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928719ad-bd3e-4580-bc81-c4a72b2177c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:39.149014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-928719ad-bd3e-4580-bc81-c4a72b2177c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:39.206654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928719ad-bd3e-4580-bc81-c4a72b2177c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:39.208547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928719ad-bd3e-4580-bc81-c4a72b2177c3 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:39.241649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1833/3693] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:40.834896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73342570-24ff-4c86-82a1-f99b7bc6e0b8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:40.836521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73342570-24ff-4c86-82a1-f99b7bc6e0b8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:40.836811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73342570-24ff-4c86-82a1-f99b7bc6e0b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:40.937352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-73342570-24ff-4c86-82a1-f99b7bc6e0b8 None None] MFA Rules not processed for user `febaff91ac1b4977848d8a67517a70fd`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:40.940299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-73342570-24ff-4c86-82a1-f99b7bc6e0b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:41.153456 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1861/3694] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:49.223749 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=9 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:51.143483 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:54.605992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928719ad-bd3e-4580-bc81-c4a72b2177c3 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:54.620628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928719ad-bd3e-4580-bc81-c4a72b2177c3 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:54.629475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:54.630683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:54.634961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:54.635285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] PATH_INFO: `/v3/users/febaff91ac1b4977848d8a67517a70fd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:54.637447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] RBAC: Authorizing `identity:delete_user(user_id=febaff91ac1b4977848d8a67517a70fd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:54.639580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:54.706355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'febaff91ac1b4977848d8a67517a70fd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:54.724542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'febaff91ac1b4977848d8a67517a70fd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:54.726096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'febaff91ac1b4977848d8a67517a70fd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:54.738139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'febaff91ac1b4977848d8a67517a70fd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:54.749483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90a44cf3-03bf-40ad-a3ad-d4c719e4978e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'febaff91ac1b4977848d8a67517a70fd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:54.761364 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1834/3695] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:07:54 2022] DELETE /identity/v3/users/febaff91ac1b4977848d8a67517a70fd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:55.391016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73342570-24ff-4c86-82a1-f99b7bc6e0b8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:55.407109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73342570-24ff-4c86-82a1-f99b7bc6e0b8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:55.538084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:55.538877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:55.539015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:55.539272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] PATH_INFO: `/v3/projects/088a5c29652d43ba950e02d8f211c591` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:55.540463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=088a5c29652d43ba950e02d8f211c591)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:55.542440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:55.653909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '088a5c29652d43ba950e02d8f211c591', 'request_id': 'req-5f194c67-c429-4b0d-a2c0-bd98dce04a81'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:55.666056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '088a5c29652d43ba950e02d8f211c591', 'request_id': 'req-5f194c67-c429-4b0d-a2c0-bd98dce04a81'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:55.675321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '088a5c29652d43ba950e02d8f211c591', 'request_id': 'req-5f194c67-c429-4b0d-a2c0-bd98dce04a81'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:55.692831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] The token cache is being invalidate because project 088a5c29652d43ba950e02d8f211c591 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:07:55.693280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:55.694178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5f194c67-c429-4b0d-a2c0-bd98dce04a81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:07:55.705059 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1862/3696] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:07:55 2022] DELETE /identity/v3/projects/088a5c29652d43ba950e02d8f211c591 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:55.705576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040cc9-cb05-47b1-b2c1-83647e8caf5e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:55.706368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040cc9-cb05-47b1-b2c1-83647e8caf5e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:55.706530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b040cc9-cb05-47b1-b2c1-83647e8caf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:55.732653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8b040cc9-cb05-47b1-b2c1-83647e8caf5e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:55.735685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b040cc9-cb05-47b1-b2c1-83647e8caf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:55.857495 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1835/3697] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:07:55.857717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f9bf9-303f-49d6-bfce-df4809e0e69e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:55.857839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f9bf9-303f-49d6-bfce-df4809e0e69e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:55.858095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f9bf9-303f-49d6-bfce-df4809e0e69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:55.889503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2f8f9bf9-303f-49d6-bfce-df4809e0e69e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:55.892170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2f8f9bf9-303f-49d6-bfce-df4809e0e69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:55.925975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040cc9-cb05-47b1-b2c1-83647e8caf5e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:55.938130 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1863/3698] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:07:55.940034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b040cc9-cb05-47b1-b2c1-83647e8caf5e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:55.946994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a8ffb-9b2b-47bb-bfa4-147794724249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:55.948756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8ffb-9b2b-47bb-bfa4-147794724249 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:55.949238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8ffb-9b2b-47bb-bfa4-147794724249 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:55.949564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a8ffb-9b2b-47bb-bfa4-147794724249 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:55.951561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a8ffb-9b2b-47bb-bfa4-147794724249 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:07:55.952562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a8ffb-9b2b-47bb-bfa4-147794724249 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:55.954668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a8ffb-9b2b-47bb-bfa4-147794724249 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:55.981183 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1836/3699] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:07:55.987658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f9bf9-303f-49d6-bfce-df4809e0e69e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:56.003769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f9bf9-303f-49d6-bfce-df4809e0e69e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:56.009153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fefc56-a777-4d5c-8553-16d795c8bb54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:56.010413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fefc56-a777-4d5c-8553-16d795c8bb54 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:56.010413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fefc56-a777-4d5c-8553-16d795c8bb54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:56.011087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fefc56-a777-4d5c-8553-16d795c8bb54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:56.014144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fefc56-a777-4d5c-8553-16d795c8bb54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:56.016555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fefc56-a777-4d5c-8553-16d795c8bb54 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:56.087489 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1864/3700] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:07:55 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:07:56.092555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a8ffb-9b2b-47bb-bfa4-147794724249 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:56.103594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a8ffb-9b2b-47bb-bfa4-147794724249 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:56.204771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b842e6e-9a63-442f-b6a4-c84faa9b614e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:56.205875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b842e6e-9a63-442f-b6a4-c84faa9b614e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:56.205875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b842e6e-9a63-442f-b6a4-c84faa9b614e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:56.206105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b842e6e-9a63-442f-b6a4-c84faa9b614e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:56.206795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b842e6e-9a63-442f-b6a4-c84faa9b614e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:56.208832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b842e6e-9a63-442f-b6a4-c84faa9b614e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:56.225160 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:56.253731 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1837/3701] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:07:56 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:07:56.257867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fefc56-a777-4d5c-8553-16d795c8bb54 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:56.271845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fefc56-a777-4d5c-8553-16d795c8bb54 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:56.288358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae559f4-0d46-405d-b8ad-9f978c9f6fda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:56.289191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae559f4-0d46-405d-b8ad-9f978c9f6fda admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:56.289611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae559f4-0d46-405d-b8ad-9f978c9f6fda admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:56.289984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae559f4-0d46-405d-b8ad-9f978c9f6fda admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:56.290783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae559f4-0d46-405d-b8ad-9f978c9f6fda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:56.292539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae559f4-0d46-405d-b8ad-9f978c9f6fda admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:56.333687 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1865/3702] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:56.337455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b842e6e-9a63-442f-b6a4-c84faa9b614e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:56.364306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b842e6e-9a63-442f-b6a4-c84faa9b614e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:56.369833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d5fdca-f831-4908-b92c-d8bd792e292d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:56.370449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5fdca-f831-4908-b92c-d8bd792e292d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:56.370732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5fdca-f831-4908-b92c-d8bd792e292d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:56.371009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d5fdca-f831-4908-b92c-d8bd792e292d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:56.371802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5fdca-f831-4908-b92c-d8bd792e292d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:56.373520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d5fdca-f831-4908-b92c-d8bd792e292d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:56.407022 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1838/3703] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:07:56 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:07:56.411639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae559f4-0d46-405d-b8ad-9f978c9f6fda admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:56.431942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae559f4-0d46-405d-b8ad-9f978c9f6fda admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:56.448224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a047-92cd-4420-a093-6ad37140c4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:56.449034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a047-92cd-4420-a093-6ad37140c4c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:56.452006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a047-92cd-4420-a093-6ad37140c4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:56.452318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b3a047-92cd-4420-a093-6ad37140c4c7 admin admin] PATH_INFO: `/v3/projects/fd9d1609606e41d99bf83f1e1b2ec3d6/users/217fef5b8a2e4ac78e54337318f043fa/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:56.507226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a047-92cd-4420-a093-6ad37140c4c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd9d1609606e41d99bf83f1e1b2ec3d6, user_id=217fef5b8a2e4ac78e54337318f043fa, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:56.518247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b3a047-92cd-4420-a093-6ad37140c4c7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:56.545693 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1866/3704] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:07:56 2022] PUT /identity/v3/projects/fd9d1609606e41d99bf83f1e1b2ec3d6/users/217fef5b8a2e4ac78e54337318f043fa/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:07:56.550605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e158f9-b657-4929-b49a-030e5a0d1a64 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:56.551093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e158f9-b657-4929-b49a-030e5a0d1a64 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:56.551393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e158f9-b657-4929-b49a-030e5a0d1a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:56.593031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e7e158f9-b657-4929-b49a-030e5a0d1a64 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:56.594851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e7e158f9-b657-4929-b49a-030e5a0d1a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:56.698311 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1839/3705] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:07:56.747181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a047-92cd-4420-a093-6ad37140c4c7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:56.750162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-86b3a047-92cd-4420-a093-6ad37140c4c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:56.845110 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:56.886638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b3a047-92cd-4420-a093-6ad37140c4c7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:56.891172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0802097c-9233-433e-a993-5623c83fddd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:56.891793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802097c-9233-433e-a993-5623c83fddd0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:56.892071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802097c-9233-433e-a993-5623c83fddd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:56.892439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0802097c-9233-433e-a993-5623c83fddd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:56.904306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802097c-9233-433e-a993-5623c83fddd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:56.906120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0802097c-9233-433e-a993-5623c83fddd0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:56.918276 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1867/3706] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:07:57.964647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac371-64d2-48a5-9e38-f2cdd8a39fb7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:57.965146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac371-64d2-48a5-9e38-f2cdd8a39fb7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:57.965251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9ac371-64d2-48a5-9e38-f2cdd8a39fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:58.031418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2c9ac371-64d2-48a5-9e38-f2cdd8a39fb7 None None] MFA Rules not processed for user `217fef5b8a2e4ac78e54337318f043fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:58.033043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2c9ac371-64d2-48a5-9e38-f2cdd8a39fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:58.258077 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1840/3707] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:58.258294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87635a-4ed6-4571-bd8f-d0b467b2db7a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:58.258294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87635a-4ed6-4571-bd8f-d0b467b2db7a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:58.258845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec87635a-4ed6-4571-bd8f-d0b467b2db7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:58.286846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ec87635a-4ed6-4571-bd8f-d0b467b2db7a None None] MFA Rules not processed for user `217fef5b8a2e4ac78e54337318f043fa`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:07:58.288085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ec87635a-4ed6-4571-bd8f-d0b467b2db7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:58.306881 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1868/3708] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:07:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:07:58.583020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ac371-64d2-48a5-9e38-f2cdd8a39fb7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:07:58.584675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2c9ac371-64d2-48a5-9e38-f2cdd8a39fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:07:58.759216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9ac371-64d2-48a5-9e38-f2cdd8a39fb7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:07:58.774107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f02e5-eec6-4b7c-b718-ac9a77f49677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:07:58.776887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f02e5-eec6-4b7c-b718-ac9a77f49677 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:07:58.777190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f02e5-eec6-4b7c-b718-ac9a77f49677 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:07:58.777575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91f02e5-eec6-4b7c-b718-ac9a77f49677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:07:58.808685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f02e5-eec6-4b7c-b718-ac9a77f49677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:07:58.808685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91f02e5-eec6-4b7c-b718-ac9a77f49677 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:07:58.816146 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:07:58.836323 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1841/3709] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:07:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:00.474914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51637609-ba7c-49f6-a506-3ea1e6910c6e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:00.475779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51637609-ba7c-49f6-a506-3ea1e6910c6e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:00.476249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51637609-ba7c-49f6-a506-3ea1e6910c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:00.511683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-51637609-ba7c-49f6-a506-3ea1e6910c6e None None] MFA Rules not processed for user `c703cc73a22749858ffe05500e52aa03`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:00.514758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-51637609-ba7c-49f6-a506-3ea1e6910c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:00.691224 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1869/3710] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:00.813413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f02e5-eec6-4b7c-b718-ac9a77f49677 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:00.815214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e91f02e5-eec6-4b7c-b718-ac9a77f49677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:00.832499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91f02e5-eec6-4b7c-b718-ac9a77f49677 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:00.839071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:00.840349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:00.840349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:00.840349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] PATH_INFO: `/v3/users/1e38267e38654eadbefc711d55365c91` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:00.842617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e38267e38654eadbefc711d55365c91)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:00.844652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:00.911245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e38267e38654eadbefc711d55365c91'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:00.932001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e38267e38654eadbefc711d55365c91'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:00.933052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e38267e38654eadbefc711d55365c91'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:00.944313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e38267e38654eadbefc711d55365c91'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:00.957601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e38267e38654eadbefc711d55365c91'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:00.966542 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1842/3711] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:00 2022] DELETE /identity/v3/users/1e38267e38654eadbefc711d55365c91 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:01.284674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51637609-ba7c-49f6-a506-3ea1e6910c6e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:01.304071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51637609-ba7c-49f6-a506-3ea1e6910c6e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:01.383504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:01.385150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:01.418694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:01.421284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:01.421833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:01.423314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] PATH_INFO: `/v3/users/217fef5b8a2e4ac78e54337318f043fa` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:01.424831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=217fef5b8a2e4ac78e54337318f043fa)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:01.432924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:01.533162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '217fef5b8a2e4ac78e54337318f043fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.539340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c62a6a0-c7de-4193-abe9-34fffcdc2a9d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:01.552784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:01.555438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:01.555729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:01.556009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] PATH_INFO: `/v3/projects/62a15639dcb743da88acbde43c90e3a9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:01.561052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a15639dcb743da88acbde43c90e3a9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:01.563076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:01.573618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '217fef5b8a2e4ac78e54337318f043fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.574691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '217fef5b8a2e4ac78e54337318f043fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.583798 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:01.589999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '217fef5b8a2e4ac78e54337318f043fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.630602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-24e27235-dd0a-46ee-abcb-656ae9dc79f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '217fef5b8a2e4ac78e54337318f043fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.642134 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1870/3712] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:01 2022] DELETE /identity/v3/users/217fef5b8a2e4ac78e54337318f043fa => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:01.713847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a15639dcb743da88acbde43c90e3a9', 'request_id': 'req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.723570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a15639dcb743da88acbde43c90e3a9', 'request_id': 'req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.735127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a15639dcb743da88acbde43c90e3a9', 'request_id': 'req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.745975 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:01.787144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] The token cache is being invalidate because project 62a15639dcb743da88acbde43c90e3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:01.788460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.791590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:01.802070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d3be2-548f-4791-969e-461a9c119a9b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:01.802384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d3be2-548f-4791-969e-461a9c119a9b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:01.802711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d3be2-548f-4791-969e-461a9c119a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:01.806688 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1843/3713] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:01 2022] DELETE /identity/v3/projects/62a15639dcb743da88acbde43c90e3a9 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:01.816422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:01.825522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:01.867414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-623d3be2-548f-4791-969e-461a9c119a9b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:01.869107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-623d3be2-548f-4791-969e-461a9c119a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:01.956908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce9b0a-5c5a-41bc-961c-5b9c3552ce3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:01.966953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5408d-b731-4784-ba5e-58bf136f107b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:01.967574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5408d-b731-4784-ba5e-58bf136f107b service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:01.967855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5408d-b731-4784-ba5e-58bf136f107b service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:01.968128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5408d-b731-4784-ba5e-58bf136f107b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:01.970324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2bf5408d-b731-4784-ba5e-58bf136f107b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:02.015989 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1871/3714] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:02.017122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d3be2-548f-4791-969e-461a9c119a9b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.019980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-623d3be2-548f-4791-969e-461a9c119a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:02.125210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d3be2-548f-4791-969e-461a9c119a9b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.129997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5820b5-461a-4207-846f-ea31a876c122 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:02.130894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5820b5-461a-4207-846f-ea31a876c122 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.131394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5820b5-461a-4207-846f-ea31a876c122 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.131810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5820b5-461a-4207-846f-ea31a876c122 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.134034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9a5820b5-461a-4207-846f-ea31a876c122 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:02.135081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5408d-b731-4784-ba5e-58bf136f107b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.137894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5408d-b731-4784-ba5e-58bf136f107b service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.154708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5820b5-461a-4207-846f-ea31a876c122 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.158962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5820b5-461a-4207-846f-ea31a876c122 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.163388 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1844/3715] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:02.165922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aeba2-7586-4d87-9d78-02d317491d8a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.166609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aeba2-7586-4d87-9d78-02d317491d8a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.167335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86aeba2-7586-4d87-9d78-02d317491d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.173388 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1872/3716] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:02.212020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f86aeba2-7586-4d87-9d78-02d317491d8a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:02.215572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f86aeba2-7586-4d87-9d78-02d317491d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:02.238449 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1845/3717] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:02.242795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5820b5-461a-4207-846f-ea31a876c122 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.259310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aeba2-7586-4d87-9d78-02d317491d8a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.261049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f86aeba2-7586-4d87-9d78-02d317491d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:02.268116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5820b5-461a-4207-846f-ea31a876c122 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.280028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd69023-17e1-43aa-ac0c-13643b249c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:02.281169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd69023-17e1-43aa-ac0c-13643b249c7f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.281768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd69023-17e1-43aa-ac0c-13643b249c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.283995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd69023-17e1-43aa-ac0c-13643b249c7f admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.288341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd69023-17e1-43aa-ac0c-13643b249c7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:02.289545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd69023-17e1-43aa-ac0c-13643b249c7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.293212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86aeba2-7586-4d87-9d78-02d317491d8a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.296459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd69023-17e1-43aa-ac0c-13643b249c7f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.307722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:02.310871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.311198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.311475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] PATH_INFO: `/v3/projects/fd9d1609606e41d99bf83f1e1b2ec3d6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.314074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd9d1609606e41d99bf83f1e1b2ec3d6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.320206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.332214 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1873/3718] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:02.337691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd69023-17e1-43aa-ac0c-13643b249c7f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.361744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd69023-17e1-43aa-ac0c-13643b249c7f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.370013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7a62f-0ecb-4629-aca6-dd9022c4594e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:02.370804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7a62f-0ecb-4629-aca6-dd9022c4594e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.371281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7a62f-0ecb-4629-aca6-dd9022c4594e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.371563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b7a62f-0ecb-4629-aca6-dd9022c4594e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.372535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7a62f-0ecb-4629-aca6-dd9022c4594e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.374495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b7a62f-0ecb-4629-aca6-dd9022c4594e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.444325 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1874/3719] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:02 2022] POST /identity/v3/projects => generated 397 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:02.446359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7a62f-0ecb-4629-aca6-dd9022c4594e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.462499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd9d1609606e41d99bf83f1e1b2ec3d6', 'request_id': 'req-465e7a45-03a9-43da-bf82-a6edaa6f1000'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:02.472383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd9d1609606e41d99bf83f1e1b2ec3d6', 'request_id': 'req-465e7a45-03a9-43da-bf82-a6edaa6f1000'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:02.481526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd9d1609606e41d99bf83f1e1b2ec3d6', 'request_id': 'req-465e7a45-03a9-43da-bf82-a6edaa6f1000'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:02.496380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] The token cache is being invalidate because project fd9d1609606e41d99bf83f1e1b2ec3d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:02.496725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:02.498155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:02.500430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1846/3720] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:02 2022] DELETE /identity/v3/projects/fd9d1609606e41d99bf83f1e1b2ec3d6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:02.501864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.504964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:02.523077 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:02.538757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b7a62f-0ecb-4629-aca6-dd9022c4594e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.543327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8829d-d48d-4b7e-b22c-effe2b666b3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:02.544047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8829d-d48d-4b7e-b22c-effe2b666b3c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.544512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8829d-d48d-4b7e-b22c-effe2b666b3c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.545115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8829d-d48d-4b7e-b22c-effe2b666b3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.547316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-36e8829d-d48d-4b7e-b22c-effe2b666b3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:02.562202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8829d-d48d-4b7e-b22c-effe2b666b3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.563885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e8829d-d48d-4b7e-b22c-effe2b666b3c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.567781 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:02.586298 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1875/3721] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:02.588583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1078-410e-4685-a648-e83d462d17f3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.589040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1078-410e-4685-a648-e83d462d17f3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.589548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517a1078-410e-4685-a648-e83d462d17f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.628797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-517a1078-410e-4685-a648-e83d462d17f3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:02.631861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-517a1078-410e-4685-a648-e83d462d17f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:02.645940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465e7a45-03a9-43da-bf82-a6edaa6f1000 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.757936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124f961-cfc7-4d06-a4c6-498ffff16a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:02.758558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124f961-cfc7-4d06-a4c6-498ffff16a4d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.758891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124f961-cfc7-4d06-a4c6-498ffff16a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.759169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f124f961-cfc7-4d06-a4c6-498ffff16a4d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.759949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124f961-cfc7-4d06-a4c6-498ffff16a4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.762165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f124f961-cfc7-4d06-a4c6-498ffff16a4d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.791985 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1847/3722] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:02 2022] POST /identity/v3/users => generated 299 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:02.794402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124f961-cfc7-4d06-a4c6-498ffff16a4d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.804724 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1876/3723] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:02.809259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce4c9c-5d77-449c-9fcc-52c91042ea42 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.810260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce4c9c-5d77-449c-9fcc-52c91042ea42 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.810416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce4c9c-5d77-449c-9fcc-52c91042ea42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.834302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f124f961-cfc7-4d06-a4c6-498ffff16a4d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.844079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-60ce4c9c-5d77-449c-9fcc-52c91042ea42 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:02.845205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60ce4c9c-5d77-449c-9fcc-52c91042ea42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:02.853017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df480fa-06a8-4f50-a6be-8dfcac336e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:02.853825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df480fa-06a8-4f50-a6be-8dfcac336e86 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.855795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df480fa-06a8-4f50-a6be-8dfcac336e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.856180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df480fa-06a8-4f50-a6be-8dfcac336e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.866109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df480fa-06a8-4f50-a6be-8dfcac336e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.866474 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1877/3724] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:08:02.867038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df480fa-06a8-4f50-a6be-8dfcac336e86 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.870093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce4c9c-5d77-449c-9fcc-52c91042ea42 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.896428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce4c9c-5d77-449c-9fcc-52c91042ea42 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.906836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6097830-8738-41f2-bca4-4fb13fa86361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:02.907456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6097830-8738-41f2-bca4-4fb13fa86361 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.907882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6097830-8738-41f2-bca4-4fb13fa86361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.908270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6097830-8738-41f2-bca4-4fb13fa86361 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.908812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6097830-8738-41f2-bca4-4fb13fa86361 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:02.909146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6097830-8738-41f2-bca4-4fb13fa86361 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.911639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6097830-8738-41f2-bca4-4fb13fa86361 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.915519 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1848/3725] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:02.917239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df480fa-06a8-4f50-a6be-8dfcac336e86 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.940194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df480fa-06a8-4f50-a6be-8dfcac336e86 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.949327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8427221-4a91-4abc-b0cd-3fb24a203528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:02.950069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8427221-4a91-4abc-b0cd-3fb24a203528 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:02.951338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8427221-4a91-4abc-b0cd-3fb24a203528 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:02.951338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8427221-4a91-4abc-b0cd-3fb24a203528 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:02.952023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8427221-4a91-4abc-b0cd-3fb24a203528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:02.955609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8427221-4a91-4abc-b0cd-3fb24a203528 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:02.963857 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1878/3726] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:02.964297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6097830-8738-41f2-bca4-4fb13fa86361 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.983623 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1849/3727] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:02.984662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8427221-4a91-4abc-b0cd-3fb24a203528 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:02.988504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6097830-8738-41f2-bca4-4fb13fa86361 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:02.996080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8427221-4a91-4abc-b0cd-3fb24a203528 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:03.002890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453e9829-425b-45d4-9250-1dc8df82cf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:03.004729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9829-425b-45d4-9250-1dc8df82cf78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:03.007013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9829-425b-45d4-9250-1dc8df82cf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:03.018134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbbc06-1934-47dd-9d13-5f6069571b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:03.018737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453e9829-425b-45d4-9250-1dc8df82cf78 admin admin] PATH_INFO: `/v3/projects/567f2f97a829442d95c67be784f82734/users/1f771366ecb64bc38869072b6d3cc06e/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:03.018914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbbc06-1934-47dd-9d13-5f6069571b7a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:03.019059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbbc06-1934-47dd-9d13-5f6069571b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:03.019342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcbbc06-1934-47dd-9d13-5f6069571b7a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:03.019977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbbc06-1934-47dd-9d13-5f6069571b7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:03.029579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcbbc06-1934-47dd-9d13-5f6069571b7a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:03.061389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9829-425b-45d4-9250-1dc8df82cf78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=567f2f97a829442d95c67be784f82734, user_id=1f771366ecb64bc38869072b6d3cc06e, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:03.067166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453e9829-425b-45d4-9250-1dc8df82cf78 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:03.091003 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1850/3728] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:02 2022] PUT /identity/v3/projects/567f2f97a829442d95c67be784f82734/users/1f771366ecb64bc38869072b6d3cc06e/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:03.096095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1fbd3-d894-4d1c-a547-f4b39660c229 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:03.096601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1fbd3-d894-4d1c-a547-f4b39660c229 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:03.097098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d1fbd3-d894-4d1c-a547-f4b39660c229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:03.117280 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1879/3729] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:02 2022] POST /identity/v3/projects => generated 361 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:03.118423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbbc06-1934-47dd-9d13-5f6069571b7a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:03.126962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-62d1fbd3-d894-4d1c-a547-f4b39660c229 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:03.128614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-62d1fbd3-d894-4d1c-a547-f4b39660c229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:03.224472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcbbc06-1934-47dd-9d13-5f6069571b7a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:03.226992 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:03.236132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a137-4cbd-48a6-9098-3df61a73c84c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:03.237064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a137-4cbd-48a6-9098-3df61a73c84c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:03.237381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a137-4cbd-48a6-9098-3df61a73c84c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:03.237660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500a137-4cbd-48a6-9098-3df61a73c84c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:03.238351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500a137-4cbd-48a6-9098-3df61a73c84c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:03.240599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500a137-4cbd-48a6-9098-3df61a73c84c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:03.272430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1851/3730] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:08:03.299731 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1880/3731] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:03 2022] POST /identity/v3/users => generated 281 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:03.303887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1fbd3-d894-4d1c-a547-f4b39660c229 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:03.317471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a137-4cbd-48a6-9098-3df61a73c84c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:03.319855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1500a137-4cbd-48a6-9098-3df61a73c84c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:03.321421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d1fbd3-d894-4d1c-a547-f4b39660c229 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:03.328353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d9760-5143-4c7d-9392-a43198d3a9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:03.329282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d9760-5143-4c7d-9392-a43198d3a9e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:03.329762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d9760-5143-4c7d-9392-a43198d3a9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:03.330205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d9760-5143-4c7d-9392-a43198d3a9e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:03.331023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d9760-5143-4c7d-9392-a43198d3a9e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:03.334016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d9760-5143-4c7d-9392-a43198d3a9e0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:03.357708 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1852/3732] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:03.363994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d9760-5143-4c7d-9392-a43198d3a9e0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:03.384806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d9760-5143-4c7d-9392-a43198d3a9e0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:03.398562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc4e61-43ce-4e44-8a9e-55305903043b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:03.399179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc4e61-43ce-4e44-8a9e-55305903043b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:03.399454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc4e61-43ce-4e44-8a9e-55305903043b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:03.399721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bc4e61-43ce-4e44-8a9e-55305903043b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:03.400354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc4e61-43ce-4e44-8a9e-55305903043b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:03.402126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bc4e61-43ce-4e44-8a9e-55305903043b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:03.421803 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:03.425620 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1853/3733] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:03 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:03.430215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc4e61-43ce-4e44-8a9e-55305903043b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:03.437542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500a137-4cbd-48a6-9098-3df61a73c84c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:03.444620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f16755-a11d-4421-95b4-dbd590754931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:03.445439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16755-a11d-4421-95b4-dbd590754931 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:03.445960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16755-a11d-4421-95b4-dbd590754931 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:03.446349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f16755-a11d-4421-95b4-dbd590754931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:03.453096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bc4e61-43ce-4e44-8a9e-55305903043b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:03.462876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f16755-a11d-4421-95b4-dbd590754931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:03.465960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f16755-a11d-4421-95b4-dbd590754931 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:03.468631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32d99a-836b-4867-9652-8c4b54b2ad61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:03.469397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32d99a-836b-4867-9652-8c4b54b2ad61 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:03.469683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32d99a-836b-4867-9652-8c4b54b2ad61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:03.469956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd32d99a-836b-4867-9652-8c4b54b2ad61 admin admin] PATH_INFO: `/v3/projects/db5ae71809c14e8b88af19c759ee25fc/users/6b27e8d5114f4b8eb3b43e862b2a09dc/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:03.486721 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1881/3734] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:08:03.501144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32d99a-836b-4867-9652-8c4b54b2ad61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db5ae71809c14e8b88af19c759ee25fc, user_id=6b27e8d5114f4b8eb3b43e862b2a09dc, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:03.503767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd32d99a-836b-4867-9652-8c4b54b2ad61 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:03.541000 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1854/3735] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:03 2022] PUT /identity/v3/projects/db5ae71809c14e8b88af19c759ee25fc/users/6b27e8d5114f4b8eb3b43e862b2a09dc/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:03.543549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226656e-b717-4e77-861e-f5877a29a7dc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:03.544668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226656e-b717-4e77-861e-f5877a29a7dc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:03.545882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226656e-b717-4e77-861e-f5877a29a7dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:03.626089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0226656e-b717-4e77-861e-f5877a29a7dc None None] MFA Rules not processed for user `6b27e8d5114f4b8eb3b43e862b2a09dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:03.627771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0226656e-b717-4e77-861e-f5877a29a7dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:03.762185 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1882/3736] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:03 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:04.942309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32d99a-836b-4867-9652-8c4b54b2ad61 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:05.052604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd32d99a-836b-4867-9652-8c4b54b2ad61 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:05.068361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:05.070454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:05.071816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:05.072099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] PATH_INFO: `/v3/users/6b27e8d5114f4b8eb3b43e862b2a09dc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:05.073751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b27e8d5114f4b8eb3b43e862b2a09dc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:05.076325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:05.147090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b27e8d5114f4b8eb3b43e862b2a09dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:05.163612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b27e8d5114f4b8eb3b43e862b2a09dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:05.164370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b27e8d5114f4b8eb3b43e862b2a09dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:05.175173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b27e8d5114f4b8eb3b43e862b2a09dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:05.184631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b27e8d5114f4b8eb3b43e862b2a09dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:05.196672 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1855/3737] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:04 2022] DELETE /identity/v3/users/6b27e8d5114f4b8eb3b43e862b2a09dc => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:05.198372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102462e-32cc-4fa8-9cdf-ba80a5c9fda4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:05.198851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102462e-32cc-4fa8-9cdf-ba80a5c9fda4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:05.199110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102462e-32cc-4fa8-9cdf-ba80a5c9fda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:05.221184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6102462e-32cc-4fa8-9cdf-ba80a5c9fda4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:05.222620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6102462e-32cc-4fa8-9cdf-ba80a5c9fda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:05.298813 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1883/3738] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:05.316813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:05.318372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:05.357346 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:05.399161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438159-4021-4520-be2f-a085a59fe502 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:05.407312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e85066e-492e-434e-81ff-89065cd19f82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:05.409434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85066e-492e-434e-81ff-89065cd19f82 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:05.409790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85066e-492e-434e-81ff-89065cd19f82 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:05.410287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e85066e-492e-434e-81ff-89065cd19f82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:05.422320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85066e-492e-434e-81ff-89065cd19f82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:05.423940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e85066e-492e-434e-81ff-89065cd19f82 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:05.438882 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1856/3739] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:06.372582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102462e-32cc-4fa8-9cdf-ba80a5c9fda4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:06.373507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6102462e-32cc-4fa8-9cdf-ba80a5c9fda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:06.443878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102462e-32cc-4fa8-9cdf-ba80a5c9fda4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:06.455140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:06.456067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:06.456551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:06.457245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] PATH_INFO: `/v3/projects/db5ae71809c14e8b88af19c759ee25fc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:06.459043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db5ae71809c14e8b88af19c759ee25fc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:06.462224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:06.535145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db5ae71809c14e8b88af19c759ee25fc', 'request_id': 'req-d4e244fd-f048-4c32-a598-13b4bd00de02'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:06.559331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db5ae71809c14e8b88af19c759ee25fc', 'request_id': 'req-d4e244fd-f048-4c32-a598-13b4bd00de02'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:06.583263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db5ae71809c14e8b88af19c759ee25fc', 'request_id': 'req-d4e244fd-f048-4c32-a598-13b4bd00de02'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:06.617836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] The token cache is being invalidate because project db5ae71809c14e8b88af19c759ee25fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:06.618199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:06.618932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4e244fd-f048-4c32-a598-13b4bd00de02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:06.621008 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1884/3740] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:06 2022] DELETE /identity/v3/projects/db5ae71809c14e8b88af19c759ee25fc => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:06.625994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b82d1-4ae5-4d78-9439-7605602804cb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:06.626866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b82d1-4ae5-4d78-9439-7605602804cb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:06.627351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531b82d1-4ae5-4d78-9439-7605602804cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:06.677483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-531b82d1-4ae5-4d78-9439-7605602804cb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:06.678953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-531b82d1-4ae5-4d78-9439-7605602804cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:06.825096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728d69d-e761-408d-8455-fdceed222068 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:06.825965 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1857/3741] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:06.828487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728d69d-e761-408d-8455-fdceed222068 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:06.828887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d728d69d-e761-408d-8455-fdceed222068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:06.840715 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:06.876932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d728d69d-e761-408d-8455-fdceed222068 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:06.879183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d728d69d-e761-408d-8455-fdceed222068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:06.893803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b82d1-4ae5-4d78-9439-7605602804cb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:06.901610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1885/3742] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:06.922588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531b82d1-4ae5-4d78-9439-7605602804cb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:06.935964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345366a-88d5-4cab-9acf-e78f11fa7a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:06.938415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345366a-88d5-4cab-9acf-e78f11fa7a11 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:06.941878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345366a-88d5-4cab-9acf-e78f11fa7a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:06.942410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345366a-88d5-4cab-9acf-e78f11fa7a11 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:06.943818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345366a-88d5-4cab-9acf-e78f11fa7a11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:06.944327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345366a-88d5-4cab-9acf-e78f11fa7a11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:06.950055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5345366a-88d5-4cab-9acf-e78f11fa7a11 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:06.991825 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1858/3743] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:06.993128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728d69d-e761-408d-8455-fdceed222068 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:07.008181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d728d69d-e761-408d-8455-fdceed222068 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:07.020108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4bbe1-3f27-4bff-a084-ad9b1e9ac4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:07.020807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4bbe1-3f27-4bff-a084-ad9b1e9ac4d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:07.021122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4bbe1-3f27-4bff-a084-ad9b1e9ac4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:07.021465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4bbe1-3f27-4bff-a084-ad9b1e9ac4d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:07.022136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4bbe1-3f27-4bff-a084-ad9b1e9ac4d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:07.024577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4bbe1-3f27-4bff-a084-ad9b1e9ac4d1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:07.072248 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1886/3744] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:06 2022] POST /identity/v3/projects => generated 367 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:07.073444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345366a-88d5-4cab-9acf-e78f11fa7a11 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:07.088640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345366a-88d5-4cab-9acf-e78f11fa7a11 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:07.171164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf015c1-d05b-4dc5-996d-9c62f743e8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:07.171780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf015c1-d05b-4dc5-996d-9c62f743e8ab admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:07.172060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf015c1-d05b-4dc5-996d-9c62f743e8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:07.172336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf015c1-d05b-4dc5-996d-9c62f743e8ab admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:07.173369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf015c1-d05b-4dc5-996d-9c62f743e8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:07.175553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf015c1-d05b-4dc5-996d-9c62f743e8ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:07.206064 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1859/3745] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:07 2022] POST /identity/v3/users => generated 284 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:08:07.209952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4bbe1-3f27-4bff-a084-ad9b1e9ac4d1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:07.224914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4bbe1-3f27-4bff-a084-ad9b1e9ac4d1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:07.231195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1781b2-f1b2-4f16-a68f-20a13328997a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:07.232676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1781b2-f1b2-4f16-a68f-20a13328997a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:07.233031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1781b2-f1b2-4f16-a68f-20a13328997a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:07.233475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1781b2-f1b2-4f16-a68f-20a13328997a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:07.234230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1781b2-f1b2-4f16-a68f-20a13328997a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:07.236652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1781b2-f1b2-4f16-a68f-20a13328997a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:07.252314 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1887/3746] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:07.257090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf015c1-d05b-4dc5-996d-9c62f743e8ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:07.305323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf015c1-d05b-4dc5-996d-9c62f743e8ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:07.322683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e4ff1e-35ef-4eea-be78-5b0c1b4c88c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:07.323313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ff1e-35ef-4eea-be78-5b0c1b4c88c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:07.323597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ff1e-35ef-4eea-be78-5b0c1b4c88c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:07.324030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e4ff1e-35ef-4eea-be78-5b0c1b4c88c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:07.324954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ff1e-35ef-4eea-be78-5b0c1b4c88c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:07.326383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e4ff1e-35ef-4eea-be78-5b0c1b4c88c8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:07.342142 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1860/3747] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:07 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:07.343223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1781b2-f1b2-4f16-a68f-20a13328997a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:07.354113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1781b2-f1b2-4f16-a68f-20a13328997a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:07.361282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcf8e8-86de-4209-ba53-a54a877a7471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:07.362110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcf8e8-86de-4209-ba53-a54a877a7471 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:07.362486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcf8e8-86de-4209-ba53-a54a877a7471 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:07.362783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcf8e8-86de-4209-ba53-a54a877a7471 admin admin] PATH_INFO: `/v3/projects/481af50acfb045a1bea3cc2b671f4720/users/0244080d8323459e9d89bef12b74873d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:07.381546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcf8e8-86de-4209-ba53-a54a877a7471 admin admin] RBAC: Authorizing `identity:create_grant(project_id=481af50acfb045a1bea3cc2b671f4720, user_id=0244080d8323459e9d89bef12b74873d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:07.385062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adcf8e8-86de-4209-ba53-a54a877a7471 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:07.412061 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1888/3748] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:07 2022] PUT /identity/v3/projects/481af50acfb045a1bea3cc2b671f4720/users/0244080d8323459e9d89bef12b74873d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:07.413931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f4f6-d801-4a64-a6c1-2a57a8c26611 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:07.414221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f4f6-d801-4a64-a6c1-2a57a8c26611 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:07.414499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe9f4f6-d801-4a64-a6c1-2a57a8c26611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:07.450884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bbe9f4f6-d801-4a64-a6c1-2a57a8c26611 None None] MFA Rules not processed for user `0244080d8323459e9d89bef12b74873d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:07.452342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bbe9f4f6-d801-4a64-a6c1-2a57a8c26611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:07.491699 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:07.544882 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1861/3749] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:07.554135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcf8e8-86de-4209-ba53-a54a877a7471 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:07.556038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0adcf8e8-86de-4209-ba53-a54a877a7471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:07.657776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcf8e8-86de-4209-ba53-a54a877a7471 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:07.663009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf334be-0391-4631-8f36-f9a55669660d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:07.663864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf334be-0391-4631-8f36-f9a55669660d service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:07.664455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf334be-0391-4631-8f36-f9a55669660d service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:07.665109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf334be-0391-4631-8f36-f9a55669660d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:07.677005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf334be-0391-4631-8f36-f9a55669660d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:07.679599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf334be-0391-4631-8f36-f9a55669660d service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:07.702476 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1889/3750] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:07 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:15.827294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2e13b-b188-45b8-88a4-ae8023319edd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:15.827780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2e13b-b188-45b8-88a4-ae8023319edd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:15.827872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2e13b-b188-45b8-88a4-ae8023319edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:15.868396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-51f2e13b-b188-45b8-88a4-ae8023319edd None None] MFA Rules not processed for user `1f771366ecb64bc38869072b6d3cc06e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:15.870018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-51f2e13b-b188-45b8-88a4-ae8023319edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:15.993362 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1862/3751] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:16.078286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0cc29-a6d7-4bea-891e-90d04cf706ed None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:16.078864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0cc29-a6d7-4bea-891e-90d04cf706ed None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:16.078864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0cc29-a6d7-4bea-891e-90d04cf706ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:16.105136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cad0cc29-a6d7-4bea-891e-90d04cf706ed None None] MFA Rules not processed for user `1f771366ecb64bc38869072b6d3cc06e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:16.107280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cad0cc29-a6d7-4bea-891e-90d04cf706ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:16.115685 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1890/3752] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:16.127566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2e13b-b188-45b8-88a4-ae8023319edd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:16.129267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-51f2e13b-b188-45b8-88a4-ae8023319edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:16.225043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f2e13b-b188-45b8-88a4-ae8023319edd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:16.233987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23176f4e-b729-4d67-a587-85c9ac541b0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:16.234604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176f4e-b729-4d67-a587-85c9ac541b0a service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:16.234882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176f4e-b729-4d67-a587-85c9ac541b0a service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:16.235149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23176f4e-b729-4d67-a587-85c9ac541b0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:16.245890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23176f4e-b729-4d67-a587-85c9ac541b0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:16.248437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23176f4e-b729-4d67-a587-85c9ac541b0a service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:16.260465 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1863/3753] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:16 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:26.101120 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=64,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:26.256231 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=79 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:31.230257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0cc29-a6d7-4bea-891e-90d04cf706ed None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:31.324716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0cc29-a6d7-4bea-891e-90d04cf706ed None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:31.330144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:31.331026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:31.331490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:31.331936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] PATH_INFO: `/v3/users/0244080d8323459e9d89bef12b74873d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:31.333930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0244080d8323459e9d89bef12b74873d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:31.336058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:31.396564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0244080d8323459e9d89bef12b74873d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:31.413576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0244080d8323459e9d89bef12b74873d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:31.414475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0244080d8323459e9d89bef12b74873d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:31.424091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0244080d8323459e9d89bef12b74873d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:31.443267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0244080d8323459e9d89bef12b74873d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:31.456286 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1891/3754] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:31 2022] DELETE /identity/v3/users/0244080d8323459e9d89bef12b74873d => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:31.460616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f709f-9013-4936-8f13-46aecc7896ba None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:31.462115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f709f-9013-4936-8f13-46aecc7896ba None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:31.462590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f709f-9013-4936-8f13-46aecc7896ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:31.494387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7e9f709f-9013-4936-8f13-46aecc7896ba None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:31.495859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e9f709f-9013-4936-8f13-46aecc7896ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:31.609587 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1864/3755] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:08:31.623521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:31.625241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:31.775447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f7fa39-a80f-471c-a34f-846d3443de14 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:31.783397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d7812-618a-4b33-a1e8-5d4b2701d1f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:31.784468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d7812-618a-4b33-a1e8-5d4b2701d1f9 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:31.785641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d7812-618a-4b33-a1e8-5d4b2701d1f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:31.786164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d7812-618a-4b33-a1e8-5d4b2701d1f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:31.811930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d7812-618a-4b33-a1e8-5d4b2701d1f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:31.816627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d7812-618a-4b33-a1e8-5d4b2701d1f9 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:31.836460 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1892/3756] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:32.647057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f709f-9013-4936-8f13-46aecc7896ba None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:32.649139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e9f709f-9013-4936-8f13-46aecc7896ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:32.678999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f709f-9013-4936-8f13-46aecc7896ba None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:32.685421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:32.686970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:32.687566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:32.688003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] PATH_INFO: `/v3/projects/481af50acfb045a1bea3cc2b671f4720` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:32.689618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] RBAC: Authorizing `identity:delete_project(project_id=481af50acfb045a1bea3cc2b671f4720)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:32.698306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:32.807647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '481af50acfb045a1bea3cc2b671f4720', 'request_id': 'req-8c9e8db6-a69f-439c-bd51-283f9ed3b680'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:32.818238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '481af50acfb045a1bea3cc2b671f4720', 'request_id': 'req-8c9e8db6-a69f-439c-bd51-283f9ed3b680'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:32.834175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '481af50acfb045a1bea3cc2b671f4720', 'request_id': 'req-8c9e8db6-a69f-439c-bd51-283f9ed3b680'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:32.866464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] The token cache is being invalidate because project 481af50acfb045a1bea3cc2b671f4720 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:32.866876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:32.869548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c9e8db6-a69f-439c-bd51-283f9ed3b680 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:32.871248 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1865/3757] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:32 2022] DELETE /identity/v3/projects/481af50acfb045a1bea3cc2b671f4720 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:32.880328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de39fd-3f71-4dbd-8ca6-f4a9a2acdaae None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:32.881158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de39fd-3f71-4dbd-8ca6-f4a9a2acdaae None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:32.882284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de39fd-3f71-4dbd-8ca6-f4a9a2acdaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:32.912647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-46de39fd-3f71-4dbd-8ca6-f4a9a2acdaae None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:32.914301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-46de39fd-3f71-4dbd-8ca6-f4a9a2acdaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:32.955290 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:33.083223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1893/3758] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:33.207926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b78e4f-a67e-44a5-835d-7a577d4e8545 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:33.208615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b78e4f-a67e-44a5-835d-7a577d4e8545 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:33.209010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b78e4f-a67e-44a5-835d-7a577d4e8545 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:33.247604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-56b78e4f-a67e-44a5-835d-7a577d4e8545 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:33.249491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-56b78e4f-a67e-44a5-835d-7a577d4e8545 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:33.265108 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1866/3759] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:33.269331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de39fd-3f71-4dbd-8ca6-f4a9a2acdaae None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:33.285743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de39fd-3f71-4dbd-8ca6-f4a9a2acdaae None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:33.307941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a59dc-1615-4fbe-a736-0283e68d62d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:33.308697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a59dc-1615-4fbe-a736-0283e68d62d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:33.309388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a59dc-1615-4fbe-a736-0283e68d62d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:33.314283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a59dc-1615-4fbe-a736-0283e68d62d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:33.315615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a59dc-1615-4fbe-a736-0283e68d62d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:33.316046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a59dc-1615-4fbe-a736-0283e68d62d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:33.317876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18a59dc-1615-4fbe-a736-0283e68d62d3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:33.353363 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1894/3760] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:33.358230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b78e4f-a67e-44a5-835d-7a577d4e8545 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:33.368363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b78e4f-a67e-44a5-835d-7a577d4e8545 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:33.373676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014167-aa47-4df3-94de-09da111da5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:33.374425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014167-aa47-4df3-94de-09da111da5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:33.375053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014167-aa47-4df3-94de-09da111da5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:33.375445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1014167-aa47-4df3-94de-09da111da5c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:33.376232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014167-aa47-4df3-94de-09da111da5c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:33.378456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1014167-aa47-4df3-94de-09da111da5c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:33.437205 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1867/3761] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:33 2022] POST /identity/v3/projects => generated 377 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:08:33.441409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a59dc-1615-4fbe-a736-0283e68d62d3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:33.455543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a59dc-1615-4fbe-a736-0283e68d62d3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:33.548925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365eaa6-bcda-4f09-9bd5-d89dacbee023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:33.549582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365eaa6-bcda-4f09-9bd5-d89dacbee023 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:33.549860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365eaa6-bcda-4f09-9bd5-d89dacbee023 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:33.550134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6365eaa6-bcda-4f09-9bd5-d89dacbee023 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:33.550801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365eaa6-bcda-4f09-9bd5-d89dacbee023 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:33.552775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6365eaa6-bcda-4f09-9bd5-d89dacbee023 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:33.588116 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1895/3762] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:33 2022] POST /identity/v3/users => generated 289 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:33.588471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014167-aa47-4df3-94de-09da111da5c2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:33.604705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1014167-aa47-4df3-94de-09da111da5c2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:33.611254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fc599-b66e-4676-8969-97436cf4fed3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:33.611961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fc599-b66e-4676-8969-97436cf4fed3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:33.612432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fc599-b66e-4676-8969-97436cf4fed3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:33.612768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fc599-b66e-4676-8969-97436cf4fed3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:33.613515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fc599-b66e-4676-8969-97436cf4fed3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:33.615263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fc599-b66e-4676-8969-97436cf4fed3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:33.633270 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1868/3763] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:08:33.638267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365eaa6-bcda-4f09-9bd5-d89dacbee023 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:33.651951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6365eaa6-bcda-4f09-9bd5-d89dacbee023 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:33.672677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd494d9c-1ab6-43d1-a61c-76bb431b855e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:33.673311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd494d9c-1ab6-43d1-a61c-76bb431b855e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:33.673614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd494d9c-1ab6-43d1-a61c-76bb431b855e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:33.673892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd494d9c-1ab6-43d1-a61c-76bb431b855e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:33.674651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd494d9c-1ab6-43d1-a61c-76bb431b855e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:33.676324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd494d9c-1ab6-43d1-a61c-76bb431b855e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:33.703763 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1896/3764] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:33 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:33.704440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fc599-b66e-4676-8969-97436cf4fed3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:33.717023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fc599-b66e-4676-8969-97436cf4fed3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:33.734099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820747a9-1418-43ba-8f60-d00fcea2cb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:33.734881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820747a9-1418-43ba-8f60-d00fcea2cb58 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:33.735273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820747a9-1418-43ba-8f60-d00fcea2cb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:33.735680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820747a9-1418-43ba-8f60-d00fcea2cb58 admin admin] PATH_INFO: `/v3/projects/012fc23e6846415b891d2dfe91c29d23/users/6de7f2242baf4fad842da47d0a8127a9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:33.763903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820747a9-1418-43ba-8f60-d00fcea2cb58 admin admin] RBAC: Authorizing `identity:create_grant(project_id=012fc23e6846415b891d2dfe91c29d23, user_id=6de7f2242baf4fad842da47d0a8127a9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:33.767608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820747a9-1418-43ba-8f60-d00fcea2cb58 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:33.788476 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1869/3765] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:33 2022] PUT /identity/v3/projects/012fc23e6846415b891d2dfe91c29d23/users/6de7f2242baf4fad842da47d0a8127a9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:33.799231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc0cb-5a8b-4b59-98c6-bea38130a34d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:33.799989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc0cb-5a8b-4b59-98c6-bea38130a34d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:33.799989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219cc0cb-5a8b-4b59-98c6-bea38130a34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:33.868817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-219cc0cb-5a8b-4b59-98c6-bea38130a34d None None] MFA Rules not processed for user `6de7f2242baf4fad842da47d0a8127a9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:33.873067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-219cc0cb-5a8b-4b59-98c6-bea38130a34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:34.049397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1897/3766] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:34.053430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820747a9-1418-43ba-8f60-d00fcea2cb58 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:34.103215 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:34.220220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820747a9-1418-43ba-8f60-d00fcea2cb58 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:34.227381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82f572-add2-4039-b573-9cec0e55b081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:34.228222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82f572-add2-4039-b573-9cec0e55b081 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:34.228524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82f572-add2-4039-b573-9cec0e55b081 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:34.228944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82f572-add2-4039-b573-9cec0e55b081 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:34.230176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82f572-add2-4039-b573-9cec0e55b081 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:34.232911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82f572-add2-4039-b573-9cec0e55b081 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:34.289906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1870/3767] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:34 2022] POST /identity/v3/projects => generated 375 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:08:34.293938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc0cb-5a8b-4b59-98c6-bea38130a34d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:34.310066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219cc0cb-5a8b-4b59-98c6-bea38130a34d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:34.331172 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:34.424930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a30643-b7ba-40c6-b3ae-1b2954bda2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:34.426439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a30643-b7ba-40c6-b3ae-1b2954bda2c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:34.426994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a30643-b7ba-40c6-b3ae-1b2954bda2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:34.427552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a30643-b7ba-40c6-b3ae-1b2954bda2c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:34.428502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a30643-b7ba-40c6-b3ae-1b2954bda2c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:34.432545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a30643-b7ba-40c6-b3ae-1b2954bda2c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:34.514247 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1898/3768] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:34 2022] POST /identity/v3/users => generated 294 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:34.517728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82f572-add2-4039-b573-9cec0e55b081 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:34.531157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82f572-add2-4039-b573-9cec0e55b081 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:34.547464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0898c8-f390-4e23-9130-0b9d5c5dc54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:34.548036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0898c8-f390-4e23-9130-0b9d5c5dc54b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:34.548310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0898c8-f390-4e23-9130-0b9d5c5dc54b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:34.548587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0898c8-f390-4e23-9130-0b9d5c5dc54b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:34.549237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0898c8-f390-4e23-9130-0b9d5c5dc54b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:34.551540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0898c8-f390-4e23-9130-0b9d5c5dc54b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:34.580967 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1871/3769] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:34.585194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a30643-b7ba-40c6-b3ae-1b2954bda2c2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:34.600625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a30643-b7ba-40c6-b3ae-1b2954bda2c2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:34.607963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9100429-2f9d-4c18-a200-705f93eaf58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:34.608758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9100429-2f9d-4c18-a200-705f93eaf58c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:34.609148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9100429-2f9d-4c18-a200-705f93eaf58c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:34.619131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9100429-2f9d-4c18-a200-705f93eaf58c admin admin] PATH_INFO: `/v3/projects/1dc40a86798e497384f0195e9660ca34/users/d8443bf33bba4b2db81c37c918c7299c/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:34.660916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9100429-2f9d-4c18-a200-705f93eaf58c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc40a86798e497384f0195e9660ca34, user_id=d8443bf33bba4b2db81c37c918c7299c, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:34.663620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9100429-2f9d-4c18-a200-705f93eaf58c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:34.693081 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1899/3770] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:34 2022] PUT /identity/v3/projects/1dc40a86798e497384f0195e9660ca34/users/d8443bf33bba4b2db81c37c918c7299c/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:34.697221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0898c8-f390-4e23-9130-0b9d5c5dc54b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:34.708529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0898c8-f390-4e23-9130-0b9d5c5dc54b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:34.846816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca100f-7911-44ca-9375-f13ee0c08b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:34.850618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca100f-7911-44ca-9375-f13ee0c08b88 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:34.850869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca100f-7911-44ca-9375-f13ee0c08b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:34.851123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca100f-7911-44ca-9375-f13ee0c08b88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:34.905465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca100f-7911-44ca-9375-f13ee0c08b88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:34.905465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca100f-7911-44ca-9375-f13ee0c08b88 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:34.905899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9100429-2f9d-4c18-a200-705f93eaf58c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:34.906787 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1872/3771] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:34 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:34.917800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9100429-2f9d-4c18-a200-705f93eaf58c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:34.925008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3621166-12bb-4819-8c48-3d2ffa06f7ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:34.925921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3621166-12bb-4819-8c48-3d2ffa06f7ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:34.926338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3621166-12bb-4819-8c48-3d2ffa06f7ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:34.926751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3621166-12bb-4819-8c48-3d2ffa06f7ea admin admin] PATH_INFO: `/v3/projects/1dc40a86798e497384f0195e9660ca34/users/d8443bf33bba4b2db81c37c918c7299c/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:34.929198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3621166-12bb-4819-8c48-3d2ffa06f7ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc40a86798e497384f0195e9660ca34, user_id=d8443bf33bba4b2db81c37c918c7299c, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:34.932881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3621166-12bb-4819-8c48-3d2ffa06f7ea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:34.963756 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1900/3772] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:34 2022] PUT /identity/v3/projects/1dc40a86798e497384f0195e9660ca34/users/d8443bf33bba4b2db81c37c918c7299c/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:34.975564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96524ec-1983-472b-a16c-556483a6b209 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:34.975849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96524ec-1983-472b-a16c-556483a6b209 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:34.976114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96524ec-1983-472b-a16c-556483a6b209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.038978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c96524ec-1983-472b-a16c-556483a6b209 None None] MFA Rules not processed for user `d8443bf33bba4b2db81c37c918c7299c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:35.041223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c96524ec-1983-472b-a16c-556483a6b209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:35.170825 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1873/3773] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:35.175557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3621166-12bb-4819-8c48-3d2ffa06f7ea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.193887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3621166-12bb-4819-8c48-3d2ffa06f7ea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.203078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09ffee-e565-4b36-b3e8-02432ee4daaf tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.203733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09ffee-e565-4b36-b3e8-02432ee4daaf tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.204012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09ffee-e565-4b36-b3e8-02432ee4daaf tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.204307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09ffee-e565-4b36-b3e8-02432ee4daaf tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.204974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09ffee-e565-4b36-b3e8-02432ee4daaf tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.206031 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-3a09ffee-e565-4b36-b3e8-02432ee4daaf tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:08:35.206031 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:08:35.206031 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:08:35.207173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a09ffee-e565-4b36-b3e8-02432ee4daaf tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:35.254140 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1901/3774] 10.222.0.25 () {60 vars in 1185 bytes} [Mon Oct 24 09:08:35 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:35.258408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96524ec-1983-472b-a16c-556483a6b209 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.268846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96524ec-1983-472b-a16c-556483a6b209 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.274252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.274999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.275405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.275755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/774eb2aa5f724580a9b3a1bc74fa117b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.276471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=774eb2aa5f724580a9b3a1bc74fa117b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.277783 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:08:35.277783 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:08:35.277783 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:08:35.278953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:35.287843 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1874/3775] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:08:35 2022] GET /identity/v3/OS-OAUTH1/consumers/774eb2aa5f724580a9b3a1bc74fa117b => generated 220 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:35.292608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09ffee-e565-4b36-b3e8-02432ee4daaf tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.313441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09ffee-e565-4b36-b3e8-02432ee4daaf tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.329338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.331177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.331704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.332248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/774eb2aa5f724580a9b3a1bc74fa117b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.333808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=774eb2aa5f724580a9b3a1bc74fa117b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.335573 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:08:35.335573 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:08:35.335573 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:08:35.337107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:35.337567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invalidating token cache because consumer 774eb2aa5f724580a9b3a1bc74fa117b has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:35.337989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:35.339205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:35.373947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '774eb2aa5f724580a9b3a1bc74fa117b', 'request_id': 'req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:35.409717 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1902/3776] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:08:35 2022] DELETE /identity/v3/OS-OAUTH1/consumers/774eb2aa5f724580a9b3a1bc74fa117b => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:35.414633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.418945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:35.439787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5f95ca-33c5-4797-bd63-598161080d78 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.445697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c916b2c-7b19-4ec2-84e9-b6384f5f825f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.446597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c916b2c-7b19-4ec2-84e9-b6384f5f825f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.447009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c916b2c-7b19-4ec2-84e9-b6384f5f825f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.447384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c916b2c-7b19-4ec2-84e9-b6384f5f825f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.448159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c916b2c-7b19-4ec2-84e9-b6384f5f825f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.449798 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-0c916b2c-7b19-4ec2-84e9-b6384f5f825f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:08:35.449798 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:08:35.449798 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:08:35.450906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c916b2c-7b19-4ec2-84e9-b6384f5f825f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:35.455930 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:35.475879 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1875/3777] 10.222.0.25 () {60 vars in 1185 bytes} [Mon Oct 24 09:08:35 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:35.480371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.493572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf930d0a-88e7-4ed3-8483-336c6ba4e04c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.501552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.502682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.502960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.503214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3e0e1ebad9014017861d716ba19a9f34` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.504370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=3e0e1ebad9014017861d716ba19a9f34)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.505630 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_consumer": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:08:35.505630 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:08:35.505630 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:08:35.506818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:35.537312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c916b2c-7b19-4ec2-84e9-b6384f5f825f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.545621 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1903/3778] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:08:35 2022] GET /identity/v3/OS-OAUTH1/consumers/3e0e1ebad9014017861d716ba19a9f34 => generated 221 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:08:35.556423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c916b2c-7b19-4ec2-84e9-b6384f5f825f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.572212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.572921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.573272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.573639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3e0e1ebad9014017861d716ba19a9f34` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.574298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=3e0e1ebad9014017861d716ba19a9f34)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.575958 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:08:35.575958 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:08:35.575958 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:08:35.579366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:35.579994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invalidating token cache because consumer 3e0e1ebad9014017861d716ba19a9f34 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:35.581382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:35.584476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:35.605390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '3e0e1ebad9014017861d716ba19a9f34', 'request_id': 'req-7c66b37d-b73b-4088-ae20-9103471821d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:35.630320 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1876/3779] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:08:35 2022] DELETE /identity/v3/OS-OAUTH1/consumers/3e0e1ebad9014017861d716ba19a9f34 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:35.634815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.640049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:35.681838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab2e6a-fa73-4f8c-a58f-9716e6981f6f tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.694536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.695324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.695739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.696201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3e0e1ebad9014017861d716ba19a9f34` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.697595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=3e0e1ebad9014017861d716ba19a9f34)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.716630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 100, in get Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_consumer(consumer_id) Oct 24 09:08:35.748347 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 95, in _get_consumer Oct 24 09:08:35.749288 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.oauth_api.get_consumer(consumer_id)) Oct 24 09:08:35.749288 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 101, in get_consumer Oct 24 09:08:35.749288 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.get_consumer_with_secret(consumer_id)) Oct 24 09:08:35.749288 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 96, in get_consumer_with_secret Oct 24 09:08:35.749288 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 24 09:08:35.749288 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 24 09:08:35.749288 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 24 09:08:35.749288 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 24 09:08:35.749288 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:08:35.758398 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1904/3780] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:08:35 2022] GET /identity/v3/OS-OAUTH1/consumers/3e0e1ebad9014017861d716ba19a9f34 => generated 74 bytes in 124 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 09:08:35.759643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.796135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c66b37d-b73b-4088-ae20-9103471821d2 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.803796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.804711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.805339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.806768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/3e0e1ebad9014017861d716ba19a9f34` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.808031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=3e0e1ebad9014017861d716ba19a9f34)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.810736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:35.811738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invalidating token cache because consumer 3e0e1ebad9014017861d716ba19a9f34 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:35.812261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:35.813275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Consumer not found: keystone.exception.NotFound: Consumer not found Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_oauth1.py", line 123, in delete Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.oauth_api.delete_consumer( Oct 24 09:08:35.835767 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/core.py", line 139, in delete_consumer Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ret = self.driver.delete_consumer(consumer_id) Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 133, in delete_consumer Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._delete_consumer(session, consumer_id) Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 110, in _delete_consumer Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application consumer_ref = self._get_consumer(session, consumer_id) Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/oauth1/backends/sql.py", line 91, in _get_consumer Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.NotFound(_('Consumer not found')) Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.NotFound: Consumer not found Oct 24 09:08:35.836613 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:08:35.839250 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1877/3781] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:08:35 2022] DELETE /identity/v3/OS-OAUTH1/consumers/3e0e1ebad9014017861d716ba19a9f34 => generated 74 bytes in 80 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 09:08:35.843940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.847975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:35.881330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e388c19-09b3-4db7-a7c8-3a84ef88c1a8 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.895886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa2f5-ccb1-458d-89d2-6f935d81b50d tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.896525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa2f5-ccb1-458d-89d2-6f935d81b50d tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.896808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa2f5-ccb1-458d-89d2-6f935d81b50d tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.900735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15baa2f5-ccb1-458d-89d2-6f935d81b50d tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.904291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baa2f5-ccb1-458d-89d2-6f935d81b50d tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.909895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15baa2f5-ccb1-458d-89d2-6f935d81b50d tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:35.942693 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1905/3782] 10.222.0.25 () {60 vars in 1185 bytes} [Mon Oct 24 09:08:35 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:35.945918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:35.964408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0f66c-d480-4312-81a5-a25fd1d5acc1 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:35.972575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b3e44-d6dc-4517-9777-8a9b3a8179fa tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:35.973628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b3e44-d6dc-4517-9777-8a9b3a8179fa tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:35.974212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b3e44-d6dc-4517-9777-8a9b3a8179fa tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:35.974661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794b3e44-d6dc-4517-9777-8a9b3a8179fa tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:35.975773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b3e44-d6dc-4517-9777-8a9b3a8179fa tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:35.978052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794b3e44-d6dc-4517-9777-8a9b3a8179fa tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:36.011913 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1878/3783] 10.222.0.25 () {60 vars in 1185 bytes} [Mon Oct 24 09:08:35 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 267 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:36.016861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa2f5-ccb1-458d-89d2-6f935d81b50d tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:36.034412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15baa2f5-ccb1-458d-89d2-6f935d81b50d tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:36.041761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:36.044312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:36.044312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:36.044507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:36.044917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:list_consumers()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:36.045953 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_consumers": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:08:36.045953 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:08:36.045953 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:08:36.046902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:36.054943 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1906/3784] 10.222.0.25 () {58 vars in 1164 bytes} [Mon Oct 24 09:08:36 2022] GET /identity/v3/OS-OAUTH1/consumers => generated 536 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:36.058722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b3e44-d6dc-4517-9777-8a9b3a8179fa tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:36.073422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794b3e44-d6dc-4517-9777-8a9b3a8179fa tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:36.079187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:36.079976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:36.080331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:36.080709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/1dfc922a7bf14583a4d7608ebc4324f2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:36.081453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=1dfc922a7bf14583a4d7608ebc4324f2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:36.083168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:36.083545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invalidating token cache because consumer 1dfc922a7bf14583a4d7608ebc4324f2 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:36.083950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.084946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.101530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '1dfc922a7bf14583a4d7608ebc4324f2', 'request_id': 'req-9c61c684-3032-4b92-b09e-4b82b6e4b44c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.123432 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1879/3785] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:08:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/1dfc922a7bf14583a4d7608ebc4324f2 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:36.127876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:36.130171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:36.152570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ccbe-7627-4aec-b7ae-54fdaeaefdd9 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:36.158739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:36.159550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:36.159935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:36.160306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/b33ab82d3c894c8587f63fa7b4ad03bf` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:36.161607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=b33ab82d3c894c8587f63fa7b4ad03bf)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:36.163332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:36.163704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invalidating token cache because consumer b33ab82d3c894c8587f63fa7b4ad03bf has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:36.164112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.165510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.180215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': 'b33ab82d3c894c8587f63fa7b4ad03bf', 'request_id': 'req-00471da0-6958-4509-87f5-dad85a4e8486'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.200316 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1907/3786] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:08:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/b33ab82d3c894c8587f63fa7b4ad03bf => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:36.205222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:36.222964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c61c684-3032-4b92-b09e-4b82b6e4b44c tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:36.237784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b0f2-33ba-4e98-8c86-bf0841074f22 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:36.238197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b0f2-33ba-4e98-8c86-bf0841074f22 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:36.238546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b0f2-33ba-4e98-8c86-bf0841074f22 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:36.239029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5504b0f2-33ba-4e98-8c86-bf0841074f22 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:36.239760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b0f2-33ba-4e98-8c86-bf0841074f22 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:create_consumer()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:36.242317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5504b0f2-33ba-4e98-8c86-bf0841074f22 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:36.264484 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1880/3787] 10.222.0.25 () {60 vars in 1185 bytes} [Mon Oct 24 09:08:36 2022] POST /identity/v3/OS-OAUTH1/consumers => generated 266 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:08:36.268427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:36.270130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:36.286742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00471da0-6958-4509-87f5-dad85a4e8486 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:36.294428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48385825-493f-4368-9b0f-11ad77ae00d4 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:36.295243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48385825-493f-4368-9b0f-11ad77ae00d4 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:36.295554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48385825-493f-4368-9b0f-11ad77ae00d4 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:36.295834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48385825-493f-4368-9b0f-11ad77ae00d4 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8182492ec71c463b9ca93bf2309e9a49` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:36.296715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48385825-493f-4368-9b0f-11ad77ae00d4 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:update_consumer(consumer_id=8182492ec71c463b9ca93bf2309e9a49)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:36.297967 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-48385825-493f-4368-9b0f-11ad77ae00d4 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_consumer": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:08:36.297967 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:08:36.297967 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:08:36.299658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48385825-493f-4368-9b0f-11ad77ae00d4 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:36.330436 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1908/3788] 10.222.0.25 () {60 vars in 1285 bytes} [Mon Oct 24 09:08:36 2022] PATCH /identity/v3/OS-OAUTH1/consumers/8182492ec71c463b9ca93bf2309e9a49 => generated 221 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:36.331487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b0f2-33ba-4e98-8c86-bf0841074f22 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:36.347854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5504b0f2-33ba-4e98-8c86-bf0841074f22 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:36.365751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbbaa4-bcc4-488b-b104-712e68c74392 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:36.366426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbbaa4-bcc4-488b-b104-712e68c74392 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:36.366713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbbaa4-bcc4-488b-b104-712e68c74392 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:36.366993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bbbaa4-bcc4-488b-b104-712e68c74392 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8182492ec71c463b9ca93bf2309e9a49` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:36.367600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbbaa4-bcc4-488b-b104-712e68c74392 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:get_consumer(consumer_id=8182492ec71c463b9ca93bf2309e9a49)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:36.369486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bbbaa4-bcc4-488b-b104-712e68c74392 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:36.381820 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1881/3789] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:08:36 2022] GET /identity/v3/OS-OAUTH1/consumers/8182492ec71c463b9ca93bf2309e9a49 => generated 221 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:36.387056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48385825-493f-4368-9b0f-11ad77ae00d4 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:36.412696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48385825-493f-4368-9b0f-11ad77ae00d4 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:36.419195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd8443bf33bba4b2db81c37c918c7299c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1dc40a86798e497384f0195e9660ca34', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:36.420059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:36.420353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:36.420932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] PATH_INFO: `/v3/OS-OAUTH1/consumers/8182492ec71c463b9ca93bf2309e9a49` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:36.421696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorizing `identity:delete_consumer(consumer_id=8182492ec71c463b9ca93bf2309e9a49)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:36.424207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:36.424489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invalidating token cache because consumer 8182492ec71c463b9ca93bf2309e9a49 has been deleted. Authorization for users with OAuth tokens will be recalculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:36.425123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.425742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.430438 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:INSERT=9,keystone:DELETE=4,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:36.456581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a7d33125-2360-4f9e-b58a-c3037400cc08 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Invoking callback _consumer_callback for event identity OS-OAUTH1:consumer deleted for {'resource_info': '8182492ec71c463b9ca93bf2309e9a49', 'request_id': 'req-a7d33125-2360-4f9e-b58a-c3037400cc08'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.493409 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1909/3790] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:08:36 2022] DELETE /identity/v3/OS-OAUTH1/consumers/8182492ec71c463b9ca93bf2309e9a49 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:36.498964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbbaa4-bcc4-488b-b104-712e68c74392 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:36.500985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20bbbaa4-bcc4-488b-b104-712e68c74392 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:36.604851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bbbaa4-bcc4-488b-b104-712e68c74392 tempest-OAUTHConsumersV3Test-730470396 tempest-OAUTHConsumersV3Test-730470396-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:36.611827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:36.612491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:36.612826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:36.613119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] PATH_INFO: `/v3/users/6de7f2242baf4fad842da47d0a8127a9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:36.617283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6de7f2242baf4fad842da47d0a8127a9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:36.619909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:36.691939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6de7f2242baf4fad842da47d0a8127a9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.698004 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=5,keystone:SELECT=83,keystone:DELETE=12 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:36.732009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6de7f2242baf4fad842da47d0a8127a9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.733002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6de7f2242baf4fad842da47d0a8127a9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.742807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6de7f2242baf4fad842da47d0a8127a9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.753063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6de7f2242baf4fad842da47d0a8127a9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:36.760955 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1882/3791] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:36 2022] DELETE /identity/v3/users/6de7f2242baf4fad842da47d0a8127a9 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:36.767286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30daff2-6b4d-4f2d-aac4-75ad4ec06d02 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:36.767573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30daff2-6b4d-4f2d-aac4-75ad4ec06d02 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:36.767968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30daff2-6b4d-4f2d-aac4-75ad4ec06d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:36.793125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a30daff2-6b4d-4f2d-aac4-75ad4ec06d02 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:36.795091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a30daff2-6b4d-4f2d-aac4-75ad4ec06d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:36.880896 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1910/3792] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:36.900966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:36.904600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:37.010106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30daff2-6b4d-4f2d-aac4-75ad4ec06d02 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:37.011711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a30daff2-6b4d-4f2d-aac4-75ad4ec06d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:37.056889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30daff2-6b4d-4f2d-aac4-75ad4ec06d02 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:37.073835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:37.074537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:37.075415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:37.075697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] PATH_INFO: `/v3/users/4dde4bb72f914457a633358837d178de` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:37.076905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dde4bb72f914457a633358837d178de)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:37.079535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:37.131472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787ee521-305c-4d00-9f83-1f97b16c7763 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:37.138269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d620db-3efd-43a0-96a6-efbcb98763e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:37.138895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d620db-3efd-43a0-96a6-efbcb98763e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:37.139184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d620db-3efd-43a0-96a6-efbcb98763e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:37.139463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d620db-3efd-43a0-96a6-efbcb98763e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:37.182090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d620db-3efd-43a0-96a6-efbcb98763e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:37.185124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d620db-3efd-43a0-96a6-efbcb98763e1 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:37.200703 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1883/3793] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:08:37.202121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d620db-3efd-43a0-96a6-efbcb98763e1 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:37.204315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f3d620db-3efd-43a0-96a6-efbcb98763e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:37.213132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dde4bb72f914457a633358837d178de'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.231567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d620db-3efd-43a0-96a6-efbcb98763e1 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:37.247301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:37.249136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:37.250196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:37.251147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] PATH_INFO: `/v3/users/c92b6e38d9c442b596b113895c61d7c6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:37.253486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dde4bb72f914457a633358837d178de'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.254661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c92b6e38d9c442b596b113895c61d7c6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:37.255520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dde4bb72f914457a633358837d178de'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.259514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:37.274668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dde4bb72f914457a633358837d178de'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.296298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-06cbb320-f070-458b-8aed-d1082baa684f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dde4bb72f914457a633358837d178de'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.310374 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1911/3794] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:37 2022] DELETE /identity/v3/users/4dde4bb72f914457a633358837d178de => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:37.318083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d41e93-2290-468c-b175-b5f9abb8ead1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:37.318439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d41e93-2290-468c-b175-b5f9abb8ead1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:37.318789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d41e93-2290-468c-b175-b5f9abb8ead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:37.368274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d8d41e93-2290-468c-b175-b5f9abb8ead1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:37.370405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d8d41e93-2290-468c-b175-b5f9abb8ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:37.375588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c92b6e38d9c442b596b113895c61d7c6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.405992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c92b6e38d9c442b596b113895c61d7c6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.407867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c92b6e38d9c442b596b113895c61d7c6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.425234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c92b6e38d9c442b596b113895c61d7c6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.439423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c92b6e38d9c442b596b113895c61d7c6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:37.456190 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1884/3795] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:37 2022] DELETE /identity/v3/users/c92b6e38d9c442b596b113895c61d7c6 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:37.483677 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:37.508755 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1912/3796] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:37.568367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:37.569866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:37.658736 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:37.660579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c388c81-1417-43db-84f7-07bd445e7e92 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:37.666869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47685755-f077-44eb-bc2a-70ebc53a76d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:37.668347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47685755-f077-44eb-bc2a-70ebc53a76d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:37.668347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47685755-f077-44eb-bc2a-70ebc53a76d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:37.668746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47685755-f077-44eb-bc2a-70ebc53a76d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:37.741042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47685755-f077-44eb-bc2a-70ebc53a76d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:37.742631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47685755-f077-44eb-bc2a-70ebc53a76d1 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:37.754821 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1885/3797] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:38.329137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d41e93-2290-468c-b175-b5f9abb8ead1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:38.330630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d8d41e93-2290-468c-b175-b5f9abb8ead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:38.356697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d41e93-2290-468c-b175-b5f9abb8ead1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:38.362552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:38.363649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:38.364140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:38.364617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] PATH_INFO: `/v3/projects/7efcd6b20b7945549462ff819faa6cd8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:38.366023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=7efcd6b20b7945549462ff819faa6cd8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:38.380092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:38.431801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47685755-f077-44eb-bc2a-70ebc53a76d1 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:38.433514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-47685755-f077-44eb-bc2a-70ebc53a76d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:38.448507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7efcd6b20b7945549462ff819faa6cd8', 'request_id': 'req-8d792c86-cb7e-427f-8c65-06ea05c415ee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.456644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47685755-f077-44eb-bc2a-70ebc53a76d1 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:38.465128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7efcd6b20b7945549462ff819faa6cd8', 'request_id': 'req-8d792c86-cb7e-427f-8c65-06ea05c415ee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.476356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7efcd6b20b7945549462ff819faa6cd8', 'request_id': 'req-8d792c86-cb7e-427f-8c65-06ea05c415ee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.500141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] The token cache is being invalidate because project 7efcd6b20b7945549462ff819faa6cd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:38.501280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.502767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d792c86-cb7e-427f-8c65-06ea05c415ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.511192 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1913/3798] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:38 2022] DELETE /identity/v3/projects/7efcd6b20b7945549462ff819faa6cd8 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:38.511536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a28a0-f775-4ad5-9f78-cbf7f6c8a132 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:38.512953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a28a0-f775-4ad5-9f78-cbf7f6c8a132 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:38.513534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197a28a0-f775-4ad5-9f78-cbf7f6c8a132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:38.563118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:38.564016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:38.564970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:38.564970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] PATH_INFO: `/v3/projects/012fc23e6846415b891d2dfe91c29d23` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:38.566414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=012fc23e6846415b891d2dfe91c29d23)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:38.569589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:38.584723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-197a28a0-f775-4ad5-9f78-cbf7f6c8a132 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:38.589262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-197a28a0-f775-4ad5-9f78-cbf7f6c8a132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:38.622068 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1914/3799] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:38.623639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38215c-69f1-4fd5-a382-93f09ecb9fb3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:38.624043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38215c-69f1-4fd5-a382-93f09ecb9fb3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:38.624424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c38215c-69f1-4fd5-a382-93f09ecb9fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:38.667771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3c38215c-69f1-4fd5-a382-93f09ecb9fb3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:38.669769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3c38215c-69f1-4fd5-a382-93f09ecb9fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:38.683796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '012fc23e6846415b891d2dfe91c29d23', 'request_id': 'req-8fcb2c99-5844-44e9-bb84-1324f203ad1b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.694409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '012fc23e6846415b891d2dfe91c29d23', 'request_id': 'req-8fcb2c99-5844-44e9-bb84-1324f203ad1b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.704368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '012fc23e6846415b891d2dfe91c29d23', 'request_id': 'req-8fcb2c99-5844-44e9-bb84-1324f203ad1b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.766593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] The token cache is being invalidate because project 012fc23e6846415b891d2dfe91c29d23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:38.766956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.769501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.775392 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1886/3800] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:38 2022] DELETE /identity/v3/projects/012fc23e6846415b891d2dfe91c29d23 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:38.778245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:38.782465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:38.817951 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1915/3801] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:38.818938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38215c-69f1-4fd5-a382-93f09ecb9fb3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:38.822222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3c38215c-69f1-4fd5-a382-93f09ecb9fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:38.835592 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:38.844226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c38215c-69f1-4fd5-a382-93f09ecb9fb3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:38.860891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:38.861912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:38.862201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:38.862477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] PATH_INFO: `/v3/users/b2da2f47ad97447da5f4384f1e443dba` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:38.867454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2da2f47ad97447da5f4384f1e443dba)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:38.871043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:38.903481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcb2c99-5844-44e9-bb84-1324f203ad1b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:38.910004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:38.910956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:38.911391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:38.911669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] PATH_INFO: `/v3/projects/72b5d3aef4214073b745477d3d48442b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:38.913062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=72b5d3aef4214073b745477d3d48442b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:38.915396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:38.941757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2da2f47ad97447da5f4384f1e443dba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.961527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2da2f47ad97447da5f4384f1e443dba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.962478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2da2f47ad97447da5f4384f1e443dba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.966463 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:38.973223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2da2f47ad97447da5f4384f1e443dba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.980075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72b5d3aef4214073b745477d3d48442b', 'request_id': 'req-d00890da-ae72-4b1c-89b9-34b539db27c7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.987070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2da2f47ad97447da5f4384f1e443dba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.990700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72b5d3aef4214073b745477d3d48442b', 'request_id': 'req-d00890da-ae72-4b1c-89b9-34b539db27c7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:38.994573 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1916/3802] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:38 2022] DELETE /identity/v3/users/b2da2f47ad97447da5f4384f1e443dba => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:38.995309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:38.997013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.003461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72b5d3aef4214073b745477d3d48442b', 'request_id': 'req-d00890da-ae72-4b1c-89b9-34b539db27c7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.021804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] The token cache is being invalidate because project 72b5d3aef4214073b745477d3d48442b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:39.022164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.022813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.027570 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1887/3803] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:38 2022] DELETE /identity/v3/projects/72b5d3aef4214073b745477d3d48442b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:39.027570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.027570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.086198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec23ad4f-5fd3-4427-998e-73434efa5ea8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.092137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.092782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.093065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.093393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] PATH_INFO: `/v3/users/d8443bf33bba4b2db81c37c918c7299c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.094705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8443bf33bba4b2db81c37c918c7299c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.096712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.103830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00890da-ae72-4b1c-89b9-34b539db27c7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.109399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4841bb-7f7e-452b-a734-936715400fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.110296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4841bb-7f7e-452b-a734-936715400fab admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.110582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4841bb-7f7e-452b-a734-936715400fab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.110857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4841bb-7f7e-452b-a734-936715400fab admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.111633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4841bb-7f7e-452b-a734-936715400fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:39.112607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4841bb-7f7e-452b-a734-936715400fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.114403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4841bb-7f7e-452b-a734-936715400fab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.128559 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1888/3804] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:39.135209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8daf78-ea09-4008-8937-b6c99deb059d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.135704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8daf78-ea09-4008-8937-b6c99deb059d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.135996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8daf78-ea09-4008-8937-b6c99deb059d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.155790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8443bf33bba4b2db81c37c918c7299c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.157715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6c8daf78-ea09-4008-8937-b6c99deb059d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:39.158998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c8daf78-ea09-4008-8937-b6c99deb059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.167175 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1889/3805] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:39.167979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8daf78-ea09-4008-8937-b6c99deb059d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.169515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c8daf78-ea09-4008-8937-b6c99deb059d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.173855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8443bf33bba4b2db81c37c918c7299c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.174578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8443bf33bba4b2db81c37c918c7299c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.184587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8443bf33bba4b2db81c37c918c7299c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.184805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8daf78-ea09-4008-8937-b6c99deb059d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.190276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.191711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.192055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.192608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] PATH_INFO: `/v3/users/6a527b0a494f4fe59ebe528dad993e1b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.193764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a527b0a494f4fe59ebe528dad993e1b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.194551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8443bf33bba4b2db81c37c918c7299c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.196046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.202624 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1917/3806] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:38 2022] DELETE /identity/v3/users/d8443bf33bba4b2db81c37c918c7299c => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:39.206338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.208004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.287498 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:39.301924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a527b0a494f4fe59ebe528dad993e1b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.324289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacaaf6-717b-4ee5-b40e-38730d66ff85 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.338640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01db2f4-5b1a-40a9-8507-13f3d5c51114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.340803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01db2f4-5b1a-40a9-8507-13f3d5c51114 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.341128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01db2f4-5b1a-40a9-8507-13f3d5c51114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.341436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01db2f4-5b1a-40a9-8507-13f3d5c51114 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.343876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01db2f4-5b1a-40a9-8507-13f3d5c51114 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.349836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a527b0a494f4fe59ebe528dad993e1b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.351628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a527b0a494f4fe59ebe528dad993e1b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.353625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01db2f4-5b1a-40a9-8507-13f3d5c51114 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.373516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a527b0a494f4fe59ebe528dad993e1b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.382612 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:39.401124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a527b0a494f4fe59ebe528dad993e1b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:39.413448 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1918/3807] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:39 2022] POST /identity/v3/projects => generated 389 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:39.417715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01db2f4-5b1a-40a9-8507-13f3d5c51114 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.418529 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1890/3808] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:39 2022] DELETE /identity/v3/users/6a527b0a494f4fe59ebe528dad993e1b => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:39.419722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.421943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d01db2f4-5b1a-40a9-8507-13f3d5c51114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.424295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.545803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01db2f4-5b1a-40a9-8507-13f3d5c51114 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.575450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a5075b-3488-48eb-af22-2c2bc92a259c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.592209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.592826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.593110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.593425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.598034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.637342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.641351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.659534 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1891/3809] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:39.660174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0c5fa-f8b9-4a81-bf97-0795b9c7097a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.660354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.661009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0c5fa-f8b9-4a81-bf97-0795b9c7097a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.661419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0c5fa-f8b9-4a81-bf97-0795b9c7097a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.661743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.661845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff0c5fa-f8b9-4a81-bf97-0795b9c7097a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.663874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cff0c5fa-f8b9-4a81-bf97-0795b9c7097a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.783922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00c4d4-bef0-42e0-9fa8-0563139e4a4c service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.788005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0c5fa-f8b9-4a81-bf97-0795b9c7097a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.789726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff0c5fa-f8b9-4a81-bf97-0795b9c7097a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.790029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf923bea-6469-4146-b25c-6cd0efa1ec14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.790648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf923bea-6469-4146-b25c-6cd0efa1ec14 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.790930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf923bea-6469-4146-b25c-6cd0efa1ec14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.791316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf923bea-6469-4146-b25c-6cd0efa1ec14 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.791957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf923bea-6469-4146-b25c-6cd0efa1ec14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.794103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf923bea-6469-4146-b25c-6cd0efa1ec14 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.805078 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1919/3810] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:39.820635 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1892/3811] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:39 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:39.826220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0c5fa-f8b9-4a81-bf97-0795b9c7097a service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.838522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff0c5fa-f8b9-4a81-bf97-0795b9c7097a service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.845018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369afe-28a3-41ea-9fad-a592e4e5d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.845424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369afe-28a3-41ea-9fad-a592e4e5d793 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.845755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369afe-28a3-41ea-9fad-a592e4e5d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.846039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a369afe-28a3-41ea-9fad-a592e4e5d793 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.846677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a369afe-28a3-41ea-9fad-a592e4e5d793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.848373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a369afe-28a3-41ea-9fad-a592e4e5d793 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.860722 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1920/3812] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:39.866021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf923bea-6469-4146-b25c-6cd0efa1ec14 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.882850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf923bea-6469-4146-b25c-6cd0efa1ec14 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.890031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa4bd-0c27-42ea-9289-d80d079f0f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.890654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa4bd-0c27-42ea-9289-d80d079f0f8b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.890937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa4bd-0c27-42ea-9289-d80d079f0f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.891369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4fa4bd-0c27-42ea-9289-d80d079f0f8b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.892031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fa4bd-0c27-42ea-9289-d80d079f0f8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.894308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4fa4bd-0c27-42ea-9289-d80d079f0f8b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.910685 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1893/3813] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:39.911883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369afe-28a3-41ea-9fad-a592e4e5d793 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.929899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a369afe-28a3-41ea-9fad-a592e4e5d793 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.939116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa4bd-0c27-42ea-9289-d80d079f0f8b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:39.940709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce79bad-1870-45af-a10b-ed3672c7057b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.940902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ba4fa4bd-0c27-42ea-9289-d80d079f0f8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:39.941439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce79bad-1870-45af-a10b-ed3672c7057b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.941721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce79bad-1870-45af-a10b-ed3672c7057b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.942650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce79bad-1870-45af-a10b-ed3672c7057b admin admin] PATH_INFO: `/v3/projects/ef70895cb8074b00a5800de8113eac1c/users/04f2de8673fd4835b9382c22a1259df1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.958914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4fa4bd-0c27-42ea-9289-d80d079f0f8b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:39.959690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce79bad-1870-45af-a10b-ed3672c7057b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef70895cb8074b00a5800de8113eac1c, user_id=04f2de8673fd4835b9382c22a1259df1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.962479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce79bad-1870-45af-a10b-ed3672c7057b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:39.965051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:39.966955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:39.967883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:39.968174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] PATH_INFO: `/v3/projects/a2f1f02e88af4e77b8cc8c09da030d0d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:39.970189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f1f02e88af4e77b8cc8c09da030d0d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:39.973188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.001027 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1921/3814] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:39 2022] PUT /identity/v3/projects/ef70895cb8074b00a5800de8113eac1c/users/04f2de8673fd4835b9382c22a1259df1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:40.006440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5c6b4-8dc7-44f6-81e6-b669166c57e2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.006683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5c6b4-8dc7-44f6-81e6-b669166c57e2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.006952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad5c6b4-8dc7-44f6-81e6-b669166c57e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.038848 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:40.052107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aad5c6b4-8dc7-44f6-81e6-b669166c57e2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:40.063523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aad5c6b4-8dc7-44f6-81e6-b669166c57e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.093886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f1f02e88af4e77b8cc8c09da030d0d', 'request_id': 'req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.097841 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:40.109123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f1f02e88af4e77b8cc8c09da030d0d', 'request_id': 'req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.122633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f1f02e88af4e77b8cc8c09da030d0d', 'request_id': 'req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.139525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] The token cache is being invalidate because project a2f1f02e88af4e77b8cc8c09da030d0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:40.139829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.140481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.150821 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1894/3815] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:39 2022] DELETE /identity/v3/projects/a2f1f02e88af4e77b8cc8c09da030d0d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:40.152586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.156294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.198991 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1922/3816] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:40.199530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7c87c-835a-4750-a3a6-8a347fd0cbdd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.200484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7c87c-835a-4750-a3a6-8a347fd0cbdd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.200812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7c87c-835a-4750-a3a6-8a347fd0cbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.236612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a652e2-ae4e-4dac-bee6-77e64a1f0793 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.239536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-00c7c87c-835a-4750-a3a6-8a347fd0cbdd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:40.241189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00c7c87c-835a-4750-a3a6-8a347fd0cbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.242394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.243031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.243311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.243587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] PATH_INFO: `/v3/projects/1dc40a86798e497384f0195e9660ca34` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.244714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc40a86798e497384f0195e9660ca34)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.247226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.254028 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1923/3817] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:40.255205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7c87c-835a-4750-a3a6-8a347fd0cbdd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.256511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00c7c87c-835a-4750-a3a6-8a347fd0cbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.270345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c7c87c-835a-4750-a3a6-8a347fd0cbdd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.275480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.276110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.276396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.276682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] PATH_INFO: `/v3/projects/c0bd5630deeb45d6941c4f9c3e71e145` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.277877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0bd5630deeb45d6941c4f9c3e71e145)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.280888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.310048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc40a86798e497384f0195e9660ca34', 'request_id': 'req-2163796b-4cca-46fc-862b-e9f6d57f7dd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.316788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc40a86798e497384f0195e9660ca34', 'request_id': 'req-2163796b-4cca-46fc-862b-e9f6d57f7dd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.326737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc40a86798e497384f0195e9660ca34', 'request_id': 'req-2163796b-4cca-46fc-862b-e9f6d57f7dd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.333578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0bd5630deeb45d6941c4f9c3e71e145', 'request_id': 'req-232e2f31-b0da-493f-a650-9d5ec134063b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.339267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] The token cache is being invalidate because project 1dc40a86798e497384f0195e9660ca34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:40.339916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.340525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.342501 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1895/3818] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:40 2022] DELETE /identity/v3/projects/1dc40a86798e497384f0195e9660ca34 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:40.344750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.348030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.348733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0bd5630deeb45d6941c4f9c3e71e145', 'request_id': 'req-232e2f31-b0da-493f-a650-9d5ec134063b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.359731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0bd5630deeb45d6941c4f9c3e71e145', 'request_id': 'req-232e2f31-b0da-493f-a650-9d5ec134063b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.376084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] The token cache is being invalidate because project c0bd5630deeb45d6941c4f9c3e71e145 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:40.376428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.378953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-232e2f31-b0da-493f-a650-9d5ec134063b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:40.381419 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1924/3819] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:40 2022] DELETE /identity/v3/projects/c0bd5630deeb45d6941c4f9c3e71e145 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:40.383341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda7e73-4c1b-499f-b6da-843c7ca12366 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.383673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda7e73-4c1b-499f-b6da-843c7ca12366 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.384193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bda7e73-4c1b-499f-b6da-843c7ca12366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.415942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1bda7e73-4c1b-499f-b6da-843c7ca12366 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:40.416758 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:40.417180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1bda7e73-4c1b-499f-b6da-843c7ca12366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.437334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2163796b-4cca-46fc-862b-e9f6d57f7dd4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.500939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f578dbf-7e3b-4219-b2be-17a767d56c95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.501834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578dbf-7e3b-4219-b2be-17a767d56c95 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.502115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578dbf-7e3b-4219-b2be-17a767d56c95 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.502369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f578dbf-7e3b-4219-b2be-17a767d56c95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.506512 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1925/3820] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:40.507665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e8baa-4430-40a5-9ed6-9ab831c1069d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.508256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e8baa-4430-40a5-9ed6-9ab831c1069d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.508256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e8baa-4430-40a5-9ed6-9ab831c1069d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.514189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f578dbf-7e3b-4219-b2be-17a767d56c95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.539925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f578dbf-7e3b-4219-b2be-17a767d56c95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.541687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f578dbf-7e3b-4219-b2be-17a767d56c95 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.546489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3c6e8baa-4430-40a5-9ed6-9ab831c1069d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:40.549515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3c6e8baa-4430-40a5-9ed6-9ab831c1069d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.554902 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1896/3821] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:40.556908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774444-68b4-4a53-afe1-ae7c38b32d8c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.557260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774444-68b4-4a53-afe1-ae7c38b32d8c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.557658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c774444-68b4-4a53-afe1-ae7c38b32d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.561879 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1926/3822] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:40.563074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e8baa-4430-40a5-9ed6-9ab831c1069d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.588744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e8baa-4430-40a5-9ed6-9ab831c1069d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.592982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2c774444-68b4-4a53-afe1-ae7c38b32d8c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:40.594293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2c774444-68b4-4a53-afe1-ae7c38b32d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.598564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36733c6e-6465-49ed-83b4-c77f6e3b26f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.599644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36733c6e-6465-49ed-83b4-c77f6e3b26f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.600125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36733c6e-6465-49ed-83b4-c77f6e3b26f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.602188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36733c6e-6465-49ed-83b4-c77f6e3b26f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.603901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36733c6e-6465-49ed-83b4-c77f6e3b26f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:40.604420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36733c6e-6465-49ed-83b4-c77f6e3b26f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.605680 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1897/3823] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:40.607663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cb4e7-e643-4b9f-a03f-cb5681a89f6a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.608086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cb4e7-e643-4b9f-a03f-cb5681a89f6a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.608427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372cb4e7-e643-4b9f-a03f-cb5681a89f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.608738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36733c6e-6465-49ed-83b4-c77f6e3b26f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.624545 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1927/3824] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:40.626311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f9a0a-3e9f-44b9-ac91-afbdf707a9e6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.626311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f9a0a-3e9f-44b9-ac91-afbdf707a9e6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.626505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f9a0a-3e9f-44b9-ac91-afbdf707a9e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.636531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-372cb4e7-e643-4b9f-a03f-cb5681a89f6a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:40.638153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-372cb4e7-e643-4b9f-a03f-cb5681a89f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.648714 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1898/3825] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:40.650156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cb4e7-e643-4b9f-a03f-cb5681a89f6a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.661224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e28f9a0a-3e9f-44b9-ac91-afbdf707a9e6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:40.662866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e28f9a0a-3e9f-44b9-ac91-afbdf707a9e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:40.669102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-372cb4e7-e643-4b9f-a03f-cb5681a89f6a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.677409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1fc15-2eb4-457c-95b7-bb1db9589c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.678158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1fc15-2eb4-457c-95b7-bb1db9589c1b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.678505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1fc15-2eb4-457c-95b7-bb1db9589c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.678844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b1fc15-2eb4-457c-95b7-bb1db9589c1b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.679689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1fc15-2eb4-457c-95b7-bb1db9589c1b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.687708 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1928/3826] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:40.688333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b1fc15-2eb4-457c-95b7-bb1db9589c1b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.700972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f9a0a-3e9f-44b9-ac91-afbdf707a9e6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.725228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f9a0a-3e9f-44b9-ac91-afbdf707a9e6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.731511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22d7a-9f14-4396-a4bb-ca117b17da8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.732078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22d7a-9f14-4396-a4bb-ca117b17da8e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.732366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22d7a-9f14-4396-a4bb-ca117b17da8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.732640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab22d7a-9f14-4396-a4bb-ca117b17da8e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.733289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab22d7a-9f14-4396-a4bb-ca117b17da8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:40.733651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab22d7a-9f14-4396-a4bb-ca117b17da8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.735581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab22d7a-9f14-4396-a4bb-ca117b17da8e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.741418 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1899/3827] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:40.742329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1fc15-2eb4-457c-95b7-bb1db9589c1b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.749063 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:40.756697 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1929/3828] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:40.756697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22d7a-9f14-4396-a4bb-ca117b17da8e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.782716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab22d7a-9f14-4396-a4bb-ca117b17da8e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.843461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b1fc15-2eb4-457c-95b7-bb1db9589c1b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.850117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711c6cf-47d9-436c-bcd3-dd46be810701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.850732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711c6cf-47d9-436c-bcd3-dd46be810701 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.851014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711c6cf-47d9-436c-bcd3-dd46be810701 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.851817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3711c6cf-47d9-436c-bcd3-dd46be810701 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.853170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711c6cf-47d9-436c-bcd3-dd46be810701 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:40.853518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711c6cf-47d9-436c-bcd3-dd46be810701 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.855599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3711c6cf-47d9-436c-bcd3-dd46be810701 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.873462 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1900/3829] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:40.874314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711c6cf-47d9-436c-bcd3-dd46be810701 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.876677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df91bd2-470f-4575-bc05-0150a1c7a961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.877371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91bd2-470f-4575-bc05-0150a1c7a961 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.877650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91bd2-470f-4575-bc05-0150a1c7a961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.877963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df91bd2-470f-4575-bc05-0150a1c7a961 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.878542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df91bd2-470f-4575-bc05-0150a1c7a961 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.883500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df91bd2-470f-4575-bc05-0150a1c7a961 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.887830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3711c6cf-47d9-436c-bcd3-dd46be810701 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.893926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ce3e-1517-4680-872a-4a3271bda5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.895157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ce3e-1517-4680-872a-4a3271bda5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.895522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ce3e-1517-4680-872a-4a3271bda5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.895874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e1ce3e-1517-4680-872a-4a3271bda5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.897221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1ce3e-1517-4680-872a-4a3271bda5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.900255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e1ce3e-1517-4680-872a-4a3271bda5d5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.913443 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1930/3830] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:40.914676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df91bd2-470f-4575-bc05-0150a1c7a961 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.929130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df91bd2-470f-4575-bc05-0150a1c7a961 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:40.937643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859b2b7-a7bd-4228-9a86-966f454a0e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:40.938349 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1901/3831] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:40.939121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859b2b7-a7bd-4228-9a86-966f454a0e7e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:40.939497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ce3e-1517-4680-872a-4a3271bda5d5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:40.939762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859b2b7-a7bd-4228-9a86-966f454a0e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:40.940241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b859b2b7-a7bd-4228-9a86-966f454a0e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:40.941084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859b2b7-a7bd-4228-9a86-966f454a0e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:40.943528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b859b2b7-a7bd-4228-9a86-966f454a0e7e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:40.992821 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:41.012093 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1931/3832] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:40 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:41.013192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859b2b7-a7bd-4228-9a86-966f454a0e7e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.056920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e1ce3e-1517-4680-872a-4a3271bda5d5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.162975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b859b2b7-a7bd-4228-9a86-966f454a0e7e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.169508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1105b56-0d18-4b5b-919d-2658550b9b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.170258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1105b56-0d18-4b5b-919d-2658550b9b82 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.170625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1105b56-0d18-4b5b-919d-2658550b9b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.171021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1105b56-0d18-4b5b-919d-2658550b9b82 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.171779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1105b56-0d18-4b5b-919d-2658550b9b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.173875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1105b56-0d18-4b5b-919d-2658550b9b82 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.179143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17ed9-c0bc-426c-9472-c043a0442d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.180136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17ed9-c0bc-426c-9472-c043a0442d82 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.180895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17ed9-c0bc-426c-9472-c043a0442d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.182550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc17ed9-c0bc-426c-9472-c043a0442d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.184462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc17ed9-c0bc-426c-9472-c043a0442d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.192647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc17ed9-c0bc-426c-9472-c043a0442d82 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.208558 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1932/3833] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:41 2022] POST /identity/v3/users => generated 285 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:41.208558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1105b56-0d18-4b5b-919d-2658550b9b82 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.208826 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1902/3834] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:40 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:41.210029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17ed9-c0bc-426c-9472-c043a0442d82 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.221934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1105b56-0d18-4b5b-919d-2658550b9b82 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.228804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72135-f673-4d6e-9f30-ddcc8439a0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.230213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72135-f673-4d6e-9f30-ddcc8439a0b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.231365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72135-f673-4d6e-9f30-ddcc8439a0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.231749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e72135-f673-4d6e-9f30-ddcc8439a0b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.232560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72135-f673-4d6e-9f30-ddcc8439a0b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.232997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc17ed9-c0bc-426c-9472-c043a0442d82 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.235298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e72135-f673-4d6e-9f30-ddcc8439a0b0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.245786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51789dad-3a3f-43b4-84eb-2108e368db42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.247277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51789dad-3a3f-43b4-84eb-2108e368db42 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.247763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51789dad-3a3f-43b4-84eb-2108e368db42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.248064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51789dad-3a3f-43b4-84eb-2108e368db42 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.248679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51789dad-3a3f-43b4-84eb-2108e368db42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.250406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51789dad-3a3f-43b4-84eb-2108e368db42 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.266621 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1903/3835] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:41.267685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51789dad-3a3f-43b4-84eb-2108e368db42 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.271722 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1933/3836] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:41 2022] POST /identity/v3/users => generated 293 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:41.272722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72135-f673-4d6e-9f30-ddcc8439a0b0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.286398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e72135-f673-4d6e-9f30-ddcc8439a0b0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.288883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51789dad-3a3f-43b4-84eb-2108e368db42 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.293142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5e640-f54d-4f80-92d4-486d003923ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.294767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5e640-f54d-4f80-92d4-486d003923ab admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.295224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5e640-f54d-4f80-92d4-486d003923ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.295669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c5e640-f54d-4f80-92d4-486d003923ab admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.296153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f2100-5268-4151-b1d6-fb0de6cb879e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.296692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5e640-f54d-4f80-92d4-486d003923ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.297020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f2100-5268-4151-b1d6-fb0de6cb879e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.297394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f2100-5268-4151-b1d6-fb0de6cb879e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.297743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85f2100-5268-4151-b1d6-fb0de6cb879e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.298529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f2100-5268-4151-b1d6-fb0de6cb879e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.299376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c5e640-f54d-4f80-92d4-486d003923ab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.300412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85f2100-5268-4151-b1d6-fb0de6cb879e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.313917 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1934/3837] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:41.315342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5e640-f54d-4f80-92d4-486d003923ab admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.323507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1904/3838] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:41.324603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f2100-5268-4151-b1d6-fb0de6cb879e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.328492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c5e640-f54d-4f80-92d4-486d003923ab admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.335452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d53df7-a08f-4b66-8dc0-c76483beaffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.336380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53df7-a08f-4b66-8dc0-c76483beaffc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.336835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53df7-a08f-4b66-8dc0-c76483beaffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.337329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d53df7-a08f-4b66-8dc0-c76483beaffc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.338133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d53df7-a08f-4b66-8dc0-c76483beaffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.338235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85f2100-5268-4151-b1d6-fb0de6cb879e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.340032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d53df7-a08f-4b66-8dc0-c76483beaffc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.344140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cecd2a-baae-49f6-9123-e84acdf1f230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.344905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecd2a-baae-49f6-9123-e84acdf1f230 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.345353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecd2a-baae-49f6-9123-e84acdf1f230 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.345751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cecd2a-baae-49f6-9123-e84acdf1f230 admin admin] PATH_INFO: `/v3/projects/4d1fb9045fb74a239a8bab6c655dda9f/users/7270e730cf744dc7805317d1a18726ea/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.353037 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1935/3839] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:41.354755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d53df7-a08f-4b66-8dc0-c76483beaffc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.368070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d53df7-a08f-4b66-8dc0-c76483beaffc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.371257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cecd2a-baae-49f6-9123-e84acdf1f230 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1fb9045fb74a239a8bab6c655dda9f, user_id=7270e730cf744dc7805317d1a18726ea, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.374988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cecd2a-baae-49f6-9123-e84acdf1f230 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.376145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e6e7a-c776-4a3d-b315-4bf8bd88c4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.377031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e6e7a-c776-4a3d-b315-4bf8bd88c4a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.377514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e6e7a-c776-4a3d-b315-4bf8bd88c4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.378082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e6e7a-c776-4a3d-b315-4bf8bd88c4a6 admin admin] PATH_INFO: `/v3/projects/ac1482f4cba74c7c9a1aa00e35ec63d1/users/58d2bdfcc8f64eb7ab6ccd82bc12bf40/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.405188 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:41.406157 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1905/3840] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:41 2022] PUT /identity/v3/projects/4d1fb9045fb74a239a8bab6c655dda9f/users/7270e730cf744dc7805317d1a18726ea/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:41.406976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cecd2a-baae-49f6-9123-e84acdf1f230 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.407463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e6e7a-c776-4a3d-b315-4bf8bd88c4a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1482f4cba74c7c9a1aa00e35ec63d1, user_id=58d2bdfcc8f64eb7ab6ccd82bc12bf40, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.410553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731e6e7a-c776-4a3d-b315-4bf8bd88c4a6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.431290 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1936/3841] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:41 2022] PUT /identity/v3/projects/ac1482f4cba74c7c9a1aa00e35ec63d1/users/58d2bdfcc8f64eb7ab6ccd82bc12bf40/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:41.432984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3dee-fc7e-4579-a2d7-8a31dc51c1fa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.433472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3dee-fc7e-4579-a2d7-8a31dc51c1fa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.434014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2e3dee-fc7e-4579-a2d7-8a31dc51c1fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.488394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cecd2a-baae-49f6-9123-e84acdf1f230 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.489008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1a2e3dee-fc7e-4579-a2d7-8a31dc51c1fa None None] MFA Rules not processed for user `7270e730cf744dc7805317d1a18726ea`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:41.490523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1a2e3dee-fc7e-4579-a2d7-8a31dc51c1fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:41.607257 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:41.636388 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1937/3842] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:41.638408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1feb5-d1ac-4579-aee3-b15838c33132 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.638408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1feb5-d1ac-4579-aee3-b15838c33132 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.638700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba1feb5-d1ac-4579-aee3-b15838c33132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.666121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591e24-6e5d-4b53-a7e5-32f1e2acdc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.669044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591e24-6e5d-4b53-a7e5-32f1e2acdc01 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.669363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591e24-6e5d-4b53-a7e5-32f1e2acdc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.669633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3591e24-6e5d-4b53-a7e5-32f1e2acdc01 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.670291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3591e24-6e5d-4b53-a7e5-32f1e2acdc01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.678096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3591e24-6e5d-4b53-a7e5-32f1e2acdc01 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.702172 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1906/3843] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:41 2022] GET /identity/v3/roles => generated 1420 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:41.703301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591e24-6e5d-4b53-a7e5-32f1e2acdc01 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.718369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3591e24-6e5d-4b53-a7e5-32f1e2acdc01 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.724838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504bf7b-8a30-46d7-b3be-f6ef142df421 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7270e730cf744dc7805317d1a18726ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d1fb9045fb74a239a8bab6c655dda9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.725593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8ba1feb5-d1ac-4579-aee3-b15838c33132 None None] MFA Rules not processed for user `58d2bdfcc8f64eb7ab6ccd82bc12bf40`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:41.726041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504bf7b-8a30-46d7-b3be-f6ef142df421 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.726493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504bf7b-8a30-46d7-b3be-f6ef142df421 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.726979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504bf7b-8a30-46d7-b3be-f6ef142df421 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] PATH_INFO: `/v3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.728830 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1907/3844] 10.222.0.25 () {58 vars in 1104 bytes} [Mon Oct 24 09:08:41 2022] GET /identity/v3 => generated 255 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:41.729868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504bf7b-8a30-46d7-b3be-f6ef142df421 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.736654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8ba1feb5-d1ac-4579-aee3-b15838c33132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:41.748366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504bf7b-8a30-46d7-b3be-f6ef142df421 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.755666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13087-2d19-463f-96d9-a2f02768f361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.756800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13087-2d19-463f-96d9-a2f02768f361 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.757407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13087-2d19-463f-96d9-a2f02768f361 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.757887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f13087-2d19-463f-96d9-a2f02768f361 admin admin] PATH_INFO: `/v3/projects/735d738c5d7343778a9e9f45e1760846/users/4bf107f9fd8645ba937fb399ebec1ee7/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.782194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f13087-2d19-463f-96d9-a2f02768f361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=735d738c5d7343778a9e9f45e1760846, user_id=4bf107f9fd8645ba937fb399ebec1ee7, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:41.785825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f13087-2d19-463f-96d9-a2f02768f361 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:41.816175 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1908/3845] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:41 2022] PUT /identity/v3/projects/735d738c5d7343778a9e9f45e1760846/users/4bf107f9fd8645ba937fb399ebec1ee7/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:41.816175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13087-2d19-463f-96d9-a2f02768f361 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:41.924806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f13087-2d19-463f-96d9-a2f02768f361 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:41.930173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13694f1-ef07-4e03-8c22-2d0b1c3f69b8 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7270e730cf744dc7805317d1a18726ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d1fb9045fb74a239a8bab6c655dda9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:41.930739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13694f1-ef07-4e03-8c22-2d0b1c3f69b8 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.931472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13694f1-ef07-4e03-8c22-2d0b1c3f69b8 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.931812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13694f1-ef07-4e03-8c22-2d0b1c3f69b8 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] PATH_INFO: `/v3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.933574 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1909/3846] 10.222.0.25 () {58 vars in 1104 bytes} [Mon Oct 24 09:08:41 2022] GET /identity/v3 => generated 255 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:41.941899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e1ecc-0a0f-4351-8c56-f6aab31c2214 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:41.943042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e1ecc-0a0f-4351-8c56-f6aab31c2214 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:41.943400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78e1ecc-0a0f-4351-8c56-f6aab31c2214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:41.999154 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1938/3847] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:42.005053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1feb5-d1ac-4579-aee3-b15838c33132 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:42.008992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c78e1ecc-0a0f-4351-8c56-f6aab31c2214 None None] MFA Rules not processed for user `4bf107f9fd8645ba937fb399ebec1ee7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:42.010271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c78e1ecc-0a0f-4351-8c56-f6aab31c2214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:42.028601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba1feb5-d1ac-4579-aee3-b15838c33132 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:42.042185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc61fe2-add2-4aca-a789-c6c6eb7d2c75 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7270e730cf744dc7805317d1a18726ea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d1fb9045fb74a239a8bab6c655dda9f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:42.042723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc61fe2-add2-4aca-a789-c6c6eb7d2c75 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.043010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc61fe2-add2-4aca-a789-c6c6eb7d2c75 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.043346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc61fe2-add2-4aca-a789-c6c6eb7d2c75 tempest-TestApiDiscovery-1767624712 tempest-TestApiDiscovery-1767624712-project] PATH_INFO: `/v3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.045174 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1939/3848] 10.222.0.25 () {58 vars in 1104 bytes} [Mon Oct 24 09:08:41 2022] GET /identity/v3 => generated 255 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:42.046385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f17d-44ee-4916-9cb7-e3c6fd3fb0b1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.046660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f17d-44ee-4916-9cb7-e3c6fd3fb0b1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.048376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55f17d-44ee-4916-9cb7-e3c6fd3fb0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.099336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ed55f17d-44ee-4916-9cb7-e3c6fd3fb0b1 None None] MFA Rules not processed for user `5ae455a2351c4cf9a32ca68e686d27d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:42.100692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ed55f17d-44ee-4916-9cb7-e3c6fd3fb0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:42.167069 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1910/3849] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:42.168498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e1ecc-0a0f-4351-8c56-f6aab31c2214 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:42.219408 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:42.239200 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1940/3850] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:42.241966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78e1ecc-0a0f-4351-8c56-f6aab31c2214 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:42.246206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99996d0-1b57-4606-8c49-f39ae57bcdd7 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.247960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8ce17a-c761-4fe9-8144-dd740072650d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:42.248688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ce17a-c761-4fe9-8144-dd740072650d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.249000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99996d0-1b57-4606-8c49-f39ae57bcdd7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.249103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ce17a-c761-4fe9-8144-dd740072650d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.249330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99996d0-1b57-4606-8c49-f39ae57bcdd7 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.249705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8ce17a-c761-4fe9-8144-dd740072650d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.250444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ce17a-c761-4fe9-8144-dd740072650d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:42.255304 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1941/3851] 10.222.0.25 () {56 vars in 895 bytes} [Mon Oct 24 09:08:42 2022] GET /identity/ => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:08:42.256507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8ce17a-c761-4fe9-8144-dd740072650d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:42.260641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99996d0-1b57-4606-8c49-f39ae57bcdd7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:42.268632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b99996d0-1b57-4606-8c49-f39ae57bcdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:42.298595 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1911/3852] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:42 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:42.300185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de20a7f-3215-4c3e-9799-26f539a9c545 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.300620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de20a7f-3215-4c3e-9799-26f539a9c545 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.301018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de20a7f-3215-4c3e-9799-26f539a9c545 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.302429 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:42.302839 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1912/3853] 10.222.0.25 () {56 vars in 895 bytes} [Mon Oct 24 09:08:42 2022] GET /identity/ => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:08:42.305828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de20a7f-3215-4c3e-9799-26f539a9c545 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:42.375728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99996d0-1b57-4606-8c49-f39ae57bcdd7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:42.477403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee5d3-9154-44dc-91a4-134cc15af314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:42.477403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee5d3-9154-44dc-91a4-134cc15af314 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.478473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee5d3-9154-44dc-91a4-134cc15af314 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.479030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de20a7f-3215-4c3e-9799-26f539a9c545 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:42.479920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ee5d3-9154-44dc-91a4-134cc15af314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.494556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e7e69-6beb-4b82-ba22-ca6400bac932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:42.495185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e7e69-6beb-4b82-ba22-ca6400bac932 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.495464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e7e69-6beb-4b82-ba22-ca6400bac932 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.495741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85e7e69-6beb-4b82-ba22-ca6400bac932 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.497446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e7e69-6beb-4b82-ba22-ca6400bac932 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:42.506955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85e7e69-6beb-4b82-ba22-ca6400bac932 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:42.551866 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1913/3854] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:42 2022] POST /identity/v3/users => generated 294 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:42.554410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e7e69-6beb-4b82-ba22-ca6400bac932 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:42.585971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85e7e69-6beb-4b82-ba22-ca6400bac932 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:42.606930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:42.607586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.608140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.608638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] PATH_INFO: `/v3/users/7270e730cf744dc7805317d1a18726ea` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.613176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7270e730cf744dc7805317d1a18726ea)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:42.615850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:42.659249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee5d3-9154-44dc-91a4-134cc15af314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:42.663536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023ee5d3-9154-44dc-91a4-134cc15af314 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:42.694726 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1942/3855] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:42 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:42.695838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee5d3-9154-44dc-91a4-134cc15af314 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:42.713678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ee5d3-9154-44dc-91a4-134cc15af314 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:42.725025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb96a9e-ae4d-4bf4-abee-07a7f6577317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:42.725894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96a9e-ae4d-4bf4-abee-07a7f6577317 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.729638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96a9e-ae4d-4bf4-abee-07a7f6577317 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.729944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb96a9e-ae4d-4bf4-abee-07a7f6577317 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.731055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb96a9e-ae4d-4bf4-abee-07a7f6577317 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:42.734094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb96a9e-ae4d-4bf4-abee-07a7f6577317 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:42.736959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7270e730cf744dc7805317d1a18726ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:42.752336 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1943/3856] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:42.755743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb96a9e-ae4d-4bf4-abee-07a7f6577317 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:42.769237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7270e730cf744dc7805317d1a18726ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:42.770048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7270e730cf744dc7805317d1a18726ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:42.776146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb96a9e-ae4d-4bf4-abee-07a7f6577317 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:42.786281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b0ac4-7a03-435d-b2bc-a1d4c0a8c8e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:42.786954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7270e730cf744dc7805317d1a18726ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:42.787385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0ac4-7a03-435d-b2bc-a1d4c0a8c8e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.787710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0ac4-7a03-435d-b2bc-a1d4c0a8c8e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.787993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623b0ac4-7a03-435d-b2bc-a1d4c0a8c8e8 admin admin] PATH_INFO: `/v3/projects/2cafc30ad2b4494d8397a498298ad804/users/058d73f9eeb1466c9324a4545e6d4bdb/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.801560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-045cd409-5a8c-4f42-8f62-17858d3e0d3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7270e730cf744dc7805317d1a18726ea'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:42.812199 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1914/3857] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:42 2022] DELETE /identity/v3/users/7270e730cf744dc7805317d1a18726ea => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:42.813792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8047ab-9fca-4cf5-a91a-4a71ac90b283 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.814086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8047ab-9fca-4cf5-a91a-4a71ac90b283 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.814365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8047ab-9fca-4cf5-a91a-4a71ac90b283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.816692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b0ac4-7a03-435d-b2bc-a1d4c0a8c8e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cafc30ad2b4494d8397a498298ad804, user_id=058d73f9eeb1466c9324a4545e6d4bdb, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:42.820131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623b0ac4-7a03-435d-b2bc-a1d4c0a8c8e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:42.851378 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1944/3858] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:42 2022] PUT /identity/v3/projects/2cafc30ad2b4494d8397a498298ad804/users/058d73f9eeb1466c9324a4545e6d4bdb/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:42.856058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1e8047ab-9fca-4cf5-a91a-4a71ac90b283 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:42.856203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b0ac4-7a03-435d-b2bc-a1d4c0a8c8e8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:42.857313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e8047ab-9fca-4cf5-a91a-4a71ac90b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:42.859308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-623b0ac4-7a03-435d-b2bc-a1d4c0a8c8e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:42.890205 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:42.946778 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:42.964418 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1915/3859] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:42.975927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623b0ac4-7a03-435d-b2bc-a1d4c0a8c8e8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:42.983215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0be1a9-70bb-434c-b010-97621ab71409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:42.983973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0be1a9-70bb-434c-b010-97621ab71409 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:42.984478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0be1a9-70bb-434c-b010-97621ab71409 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:42.986791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0be1a9-70bb-434c-b010-97621ab71409 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:42.987485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0be1a9-70bb-434c-b010-97621ab71409 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:42.989103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0be1a9-70bb-434c-b010-97621ab71409 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:43.003154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8047ab-9fca-4cf5-a91a-4a71ac90b283 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:43.005419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e8047ab-9fca-4cf5-a91a-4a71ac90b283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:43.018949 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1945/3860] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:42 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:43.022954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0be1a9-70bb-434c-b010-97621ab71409 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:43.046074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0be1a9-70bb-434c-b010-97621ab71409 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:43.054889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ffbf7-4a46-4448-837e-5907a3ec3d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:43.061836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ffbf7-4a46-4448-837e-5907a3ec3d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:43.062121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ffbf7-4a46-4448-837e-5907a3ec3d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:43.062431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9ffbf7-4a46-4448-837e-5907a3ec3d30 admin admin] PATH_INFO: `/v3/projects/2cafc30ad2b4494d8397a498298ad804/users/058d73f9eeb1466c9324a4545e6d4bdb/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:43.064548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ffbf7-4a46-4448-837e-5907a3ec3d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cafc30ad2b4494d8397a498298ad804, user_id=058d73f9eeb1466c9324a4545e6d4bdb, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:43.067495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9ffbf7-4a46-4448-837e-5907a3ec3d30 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:43.101390 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1946/3861] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:43 2022] PUT /identity/v3/projects/2cafc30ad2b4494d8397a498298ad804/users/058d73f9eeb1466c9324a4545e6d4bdb/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:43.104816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ffbf7-4a46-4448-837e-5907a3ec3d30 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:43.109393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3e9ffbf7-4a46-4448-837e-5907a3ec3d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:43.166437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8047ab-9fca-4cf5-a91a-4a71ac90b283 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:43.239208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9ffbf7-4a46-4448-837e-5907a3ec3d30 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:43.252506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0a0e5-3eae-438b-8b06-44442cd9be12 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:43.254003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a0e5-3eae-438b-8b06-44442cd9be12 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:43.254380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a0e5-3eae-438b-8b06-44442cd9be12 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:43.254671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0a0e5-3eae-438b-8b06-44442cd9be12 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:43.259985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7ad0a0e5-3eae-438b-8b06-44442cd9be12 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:43.278691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0a0e5-3eae-438b-8b06-44442cd9be12 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:43.280470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0a0e5-3eae-438b-8b06-44442cd9be12 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:43.281162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df39cb5-baf1-4318-92ed-59838108d569 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:43.281959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df39cb5-baf1-4318-92ed-59838108d569 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:43.282294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df39cb5-baf1-4318-92ed-59838108d569 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:43.282570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df39cb5-baf1-4318-92ed-59838108d569 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:43.296728 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1947/3862] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:43.298685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ed3d1-ead9-4350-848b-c8acf568d59b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:43.298968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ed3d1-ead9-4350-848b-c8acf568d59b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:43.299238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71ed3d1-ead9-4350-848b-c8acf568d59b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:43.344435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c71ed3d1-ead9-4350-848b-c8acf568d59b None None] MFA Rules not processed for user `058d73f9eeb1466c9324a4545e6d4bdb`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:43.347794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c71ed3d1-ead9-4350-848b-c8acf568d59b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:43.434792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df39cb5-baf1-4318-92ed-59838108d569 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:43.436331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df39cb5-baf1-4318-92ed-59838108d569 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:43.459529 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1916/3863] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:43.473037 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1948/3864] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:43.480312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df39cb5-baf1-4318-92ed-59838108d569 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:43.500390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df39cb5-baf1-4318-92ed-59838108d569 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:43.510069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f52f0-1ea8-4201-963d-54a4dd7c70b5 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:43.510768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f52f0-1ea8-4201-963d-54a4dd7c70b5 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:43.511053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f52f0-1ea8-4201-963d-54a4dd7c70b5 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:43.511330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f52f0-1ea8-4201-963d-54a4dd7c70b5 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:43.512022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f52f0-1ea8-4201-963d-54a4dd7c70b5 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:43.512334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f52f0-1ea8-4201-963d-54a4dd7c70b5 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:43.516928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5f52f0-1ea8-4201-963d-54a4dd7c70b5 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:43.536020 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1917/3865] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:43.540297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ed3d1-ead9-4350-848b-c8acf568d59b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:43.557620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71ed3d1-ead9-4350-848b-c8acf568d59b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:43.563933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ce7ac-069c-4ee3-99eb-5aeb95075f68 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:43.564592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ce7ac-069c-4ee3-99eb-5aeb95075f68 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:43.564870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ce7ac-069c-4ee3-99eb-5aeb95075f68 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:43.565332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355ce7ac-069c-4ee3-99eb-5aeb95075f68 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:43.565998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ce7ac-069c-4ee3-99eb-5aeb95075f68 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:43.567949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355ce7ac-069c-4ee3-99eb-5aeb95075f68 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:43.640020 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1949/3866] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:43 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:43.640216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f52f0-1ea8-4201-963d-54a4dd7c70b5 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:43.654535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f52f0-1ea8-4201-963d-54a4dd7c70b5 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:43.704052 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:43.812407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7628b8a-9263-4c8b-bc9f-7cf6ad4ae69c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:43.813279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7628b8a-9263-4c8b-bc9f-7cf6ad4ae69c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:43.813703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7628b8a-9263-4c8b-bc9f-7cf6ad4ae69c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:43.814057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7628b8a-9263-4c8b-bc9f-7cf6ad4ae69c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:43.814803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7628b8a-9263-4c8b-bc9f-7cf6ad4ae69c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:43.815191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7628b8a-9263-4c8b-bc9f-7cf6ad4ae69c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:43.817075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7628b8a-9263-4c8b-bc9f-7cf6ad4ae69c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:43.834469 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1918/3867] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:44.524281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ce7ac-069c-4ee3-99eb-5aeb95075f68 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:44.529184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-355ce7ac-069c-4ee3-99eb-5aeb95075f68 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:44.639827 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:44.758952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355ce7ac-069c-4ee3-99eb-5aeb95075f68 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:44.775573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc49f7e-8e75-4dd3-92ac-21f2cf0b0691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:44.776209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc49f7e-8e75-4dd3-92ac-21f2cf0b0691 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:44.776485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc49f7e-8e75-4dd3-92ac-21f2cf0b0691 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:44.776756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc49f7e-8e75-4dd3-92ac-21f2cf0b0691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:44.792950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc49f7e-8e75-4dd3-92ac-21f2cf0b0691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:44.795207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc49f7e-8e75-4dd3-92ac-21f2cf0b0691 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:44.810272 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1950/3868] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:44.838822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520bbfc-96ae-42a8-8cf2-a97118ae24a8 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:44.839248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520bbfc-96ae-42a8-8cf2-a97118ae24a8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:44.839434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9520bbfc-96ae-42a8-8cf2-a97118ae24a8 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:44.842320 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1919/3869] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:08:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:08:44.848196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc49f7e-8e75-4dd3-92ac-21f2cf0b0691 service nova] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:08:44.870229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc49f7e-8e75-4dd3-92ac-21f2cf0b0691 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:44.890477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc49f7e-8e75-4dd3-92ac-21f2cf0b0691 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:44.904076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:44.904821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:44.905111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:44.905565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/projects/ba2baf466cf8466c936c0a7e55f630c7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:44.906844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba2baf466cf8466c936c0a7e55f630c7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:44.909875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:44.915221 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1951/3870] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:08:44 2022] GET /identity/v3/projects/ba2baf466cf8466c936c0a7e55f630c7 => generated 371 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:45.050187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e604c5b-9c74-43f0-9dcf-ffef6888fecd None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:45.050469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e604c5b-9c74-43f0-9dcf-ffef6888fecd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:45.051029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e604c5b-9c74-43f0-9dcf-ffef6888fecd None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:45.053010 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1920/3871] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:08:45.063771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:08:45.066371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:45.091793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:45.108482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1da145-304a-41d0-b9c8-e79ef87c781c tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:45.127499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579905f5-618c-4309-925f-cf1d35b1dff9 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:45.131471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579905f5-618c-4309-925f-cf1d35b1dff9 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:45.131861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579905f5-618c-4309-925f-cf1d35b1dff9 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:45.132483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579905f5-618c-4309-925f-cf1d35b1dff9 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/projects/ba2baf466cf8466c936c0a7e55f630c7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:45.134148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579905f5-618c-4309-925f-cf1d35b1dff9 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba2baf466cf8466c936c0a7e55f630c7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:45.141937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579905f5-618c-4309-925f-cf1d35b1dff9 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:45.158921 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1952/3872] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:08:45 2022] GET /identity/v3/projects/ba2baf466cf8466c936c0a7e55f630c7 => generated 371 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:45.228008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e604c5b-9c74-43f0-9dcf-ffef6888fecd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:45.259786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579905f5-618c-4309-925f-cf1d35b1dff9 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:45.261677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-579905f5-618c-4309-925f-cf1d35b1dff9 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:45.273452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e604c5b-9c74-43f0-9dcf-ffef6888fecd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:45.288799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b1b10-df4b-4b9f-9ea8-11aebc7929dc tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:45.289578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b1b10-df4b-4b9f-9ea8-11aebc7929dc tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:45.290650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b1b10-df4b-4b9f-9ea8-11aebc7929dc tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:45.290967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942b1b10-df4b-4b9f-9ea8-11aebc7929dc tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:45.291747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b1b10-df4b-4b9f-9ea8-11aebc7929dc tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:45.292147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b1b10-df4b-4b9f-9ea8-11aebc7929dc tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:45.294825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942b1b10-df4b-4b9f-9ea8-11aebc7929dc tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:45.313506 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1921/3873] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:45.319697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b1b10-df4b-4b9f-9ea8-11aebc7929dc tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:45.373064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942b1b10-df4b-4b9f-9ea8-11aebc7929dc tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:45.394865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc1a97-7e80-4866-86dc-c823138e927b tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:45.395502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc1a97-7e80-4866-86dc-c823138e927b tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:45.395786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc1a97-7e80-4866-86dc-c823138e927b tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:45.396066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dc1a97-7e80-4866-86dc-c823138e927b tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:45.396723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc1a97-7e80-4866-86dc-c823138e927b tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:45.398786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dc1a97-7e80-4866-86dc-c823138e927b tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:45.407407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579905f5-618c-4309-925f-cf1d35b1dff9 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:45.412660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:45.414526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:45.415396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:45.415745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] PATH_INFO: `/v3/projects/4d1fb9045fb74a239a8bab6c655dda9f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:45.417098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1fb9045fb74a239a8bab6c655dda9f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:45.419748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:45.452777 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1922/3874] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:45 2022] POST /identity/v3/users => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:45.458937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc1a97-7e80-4866-86dc-c823138e927b tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:45.479466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dc1a97-7e80-4866-86dc-c823138e927b tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:45.492568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1320e17-86bf-4f4f-b80f-77686da32dfb tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:45.493354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320e17-86bf-4f4f-b80f-77686da32dfb tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:45.494046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320e17-86bf-4f4f-b80f-77686da32dfb tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:45.494423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1320e17-86bf-4f4f-b80f-77686da32dfb tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:45.495091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320e17-86bf-4f4f-b80f-77686da32dfb tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:45.496119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320e17-86bf-4f4f-b80f-77686da32dfb tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:45.500563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1320e17-86bf-4f4f-b80f-77686da32dfb tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:45.540127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1fb9045fb74a239a8bab6c655dda9f', 'request_id': 'req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:45.548299 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1923/3875] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:45.564961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1fb9045fb74a239a8bab6c655dda9f', 'request_id': 'req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:45.587329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1fb9045fb74a239a8bab6c655dda9f', 'request_id': 'req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:45.615847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] The token cache is being invalidate because project 4d1fb9045fb74a239a8bab6c655dda9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:45.616338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:45.616862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a9ea2-f84b-43d4-9675-8ac3474fdbc9 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:45.617155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a9ea2-f84b-43d4-9675-8ac3474fdbc9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:45.617471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a9ea2-f84b-43d4-9675-8ac3474fdbc9 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:45.617742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:45.623294 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1924/3877] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 09:08:45.624244 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1953/3877] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:45 2022] DELETE /identity/v3/projects/4d1fb9045fb74a239a8bab6c655dda9f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:45.625166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759e511-d636-4d1c-a364-e842a61e3820 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:45.625565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759e511-d636-4d1c-a364-e842a61e3820 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:45.625850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7759e511-d636-4d1c-a364-e842a61e3820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:45.664778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:08:45.667187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:45.693986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7759e511-d636-4d1c-a364-e842a61e3820 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:45.695242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7759e511-d636-4d1c-a364-e842a61e3820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:45.784628 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:45.876334 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1925/3878] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:45.886064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096070d5-194c-4be3-a020-ad77a73457bb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:45.886531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096070d5-194c-4be3-a020-ad77a73457bb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:45.887523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096070d5-194c-4be3-a020-ad77a73457bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:45.927332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-096070d5-194c-4be3-a020-ad77a73457bb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:45.934113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-096070d5-194c-4be3-a020-ad77a73457bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:45.972192 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1926/3879] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:45.976501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096070d5-194c-4be3-a020-ad77a73457bb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:45.984734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:45.986137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:46.013024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096070d5-194c-4be3-a020-ad77a73457bb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:46.040046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f37f0-9b36-4fef-96f5-58a1d6962bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:46.040587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f37f0-9b36-4fef-96f5-58a1d6962bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:46.040868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f37f0-9b36-4fef-96f5-58a1d6962bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:46.041145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931f37f0-9b36-4fef-96f5-58a1d6962bc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:46.051666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f37f0-9b36-4fef-96f5-58a1d6962bc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:46.064933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f37f0-9b36-4fef-96f5-58a1d6962bc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:46.067000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931f37f0-9b36-4fef-96f5-58a1d6962bc2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:46.097430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1927/3880] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:08:46.101936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f37f0-9b36-4fef-96f5-58a1d6962bc2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:46.124940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931f37f0-9b36-4fef-96f5-58a1d6962bc2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:46.138783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55ad16-1d74-4ef5-ab9e-a1088fdbf09d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:46.161472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ad16-1d74-4ef5-ab9e-a1088fdbf09d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:46.161472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ad16-1d74-4ef5-ab9e-a1088fdbf09d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:46.161472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b55ad16-1d74-4ef5-ab9e-a1088fdbf09d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:46.161472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55ad16-1d74-4ef5-ab9e-a1088fdbf09d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:46.162278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b55ad16-1d74-4ef5-ab9e-a1088fdbf09d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:46.189131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19111bb7-0c4e-4cc8-a730-40a2cafa3be9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:46.199102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea8c2-1656-447c-a722-2c3ef9fb44a7 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:46.200544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea8c2-1656-447c-a722-2c3ef9fb44a7 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:46.201144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea8c2-1656-447c-a722-2c3ef9fb44a7 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:46.201579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcea8c2-1656-447c-a722-2c3ef9fb44a7 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/projects/ba2baf466cf8466c936c0a7e55f630c7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:46.205143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcea8c2-1656-447c-a722-2c3ef9fb44a7 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba2baf466cf8466c936c0a7e55f630c7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:46.208698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcea8c2-1656-447c-a722-2c3ef9fb44a7 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:46.212186 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1954/3881] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:08:45 2022] GET /identity/v3/projects/ba2baf466cf8466c936c0a7e55f630c7 => generated 371 bytes in 548 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:08:46.226090 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1928/3882] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:46 2022] POST /identity/v3/projects => generated 379 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:08:46.230312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea8c2-1656-447c-a722-2c3ef9fb44a7 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:46.272204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcea8c2-1656-447c-a722-2c3ef9fb44a7 tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:46.442104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bd90f-836c-48c2-ad2d-b0e51b534fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:46.442663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bd90f-836c-48c2-ad2d-b0e51b534fcb admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:46.442946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bd90f-836c-48c2-ad2d-b0e51b534fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:46.443413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0bd90f-836c-48c2-ad2d-b0e51b534fcb admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:46.444406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bd90f-836c-48c2-ad2d-b0e51b534fcb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:46.454325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0bd90f-836c-48c2-ad2d-b0e51b534fcb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:46.491380 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1955/3883] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:46 2022] POST /identity/v3/users => generated 296 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:46.493923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55ad16-1d74-4ef5-ab9e-a1088fdbf09d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:46.522127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b55ad16-1d74-4ef5-ab9e-a1088fdbf09d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:46.529219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070209d9-84be-45e8-9e94-d93f2d33117e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:46.530578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070209d9-84be-45e8-9e94-d93f2d33117e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:46.536349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070209d9-84be-45e8-9e94-d93f2d33117e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:46.536919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070209d9-84be-45e8-9e94-d93f2d33117e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:46.538261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070209d9-84be-45e8-9e94-d93f2d33117e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:46.540447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070209d9-84be-45e8-9e94-d93f2d33117e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:46.582282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bd90f-836c-48c2-ad2d-b0e51b534fcb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:46.583750 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1929/3884] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:46.588760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d81283-a195-4449-a56c-c8d1e7ce4381 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:46.589245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d81283-a195-4449-a56c-c8d1e7ce4381 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:46.589739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d81283-a195-4449-a56c-c8d1e7ce4381 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:46.591320 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1930/3885] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:08:46.596502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d81283-a195-4449-a56c-c8d1e7ce4381 None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:08:46.600728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0bd90f-836c-48c2-ad2d-b0e51b534fcb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:46.602962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-65d81283-a195-4449-a56c-c8d1e7ce4381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:46.641196 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:46.648662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581be434-6d08-4c87-bd2c-4fef39d7f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:46.655167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be434-6d08-4c87-bd2c-4fef39d7f98a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:46.655604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be434-6d08-4c87-bd2c-4fef39d7f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:46.656117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581be434-6d08-4c87-bd2c-4fef39d7f98a admin admin] PATH_INFO: `/v3/projects/de2965eed3784ddda3e81aa47bc88398/users/2fb32f22210b4c9dad6e140cad5bb9ce/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:46.707188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581be434-6d08-4c87-bd2c-4fef39d7f98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2965eed3784ddda3e81aa47bc88398, user_id=2fb32f22210b4c9dad6e140cad5bb9ce, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:46.717091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581be434-6d08-4c87-bd2c-4fef39d7f98a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:46.751273 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1956/3886] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:46 2022] PUT /identity/v3/projects/de2965eed3784ddda3e81aa47bc88398/users/2fb32f22210b4c9dad6e140cad5bb9ce/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:46.752817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581be434-6d08-4c87-bd2c-4fef39d7f98a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:46.779265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d81283-a195-4449-a56c-c8d1e7ce4381 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:46.863781 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:46.918937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d81283-a195-4449-a56c-c8d1e7ce4381 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:46.933391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581be434-6d08-4c87-bd2c-4fef39d7f98a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:46.942514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd63e72-f4a2-4447-8e1c-4b6425741c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:46.943266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd63e72-f4a2-4447-8e1c-4b6425741c2b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:46.943662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd63e72-f4a2-4447-8e1c-4b6425741c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:46.945160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd63e72-f4a2-4447-8e1c-4b6425741c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:46.946449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd63e72-f4a2-4447-8e1c-4b6425741c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:46.949904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd63e72-f4a2-4447-8e1c-4b6425741c2b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:46.968181 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1957/3887] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:46 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:46.969712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd63e72-f4a2-4447-8e1c-4b6425741c2b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:46.983938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd63e72-f4a2-4447-8e1c-4b6425741c2b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:46.990957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6a9fc3-f3bf-4cba-9251-89e4de816a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:46.991642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a9fc3-f3bf-4cba-9251-89e4de816a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:46.991928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a9fc3-f3bf-4cba-9251-89e4de816a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:46.993171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6a9fc3-f3bf-4cba-9251-89e4de816a79 admin admin] PATH_INFO: `/v3/projects/de2965eed3784ddda3e81aa47bc88398/users/2fb32f22210b4c9dad6e140cad5bb9ce/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:46.995693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a9fc3-f3bf-4cba-9251-89e4de816a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2965eed3784ddda3e81aa47bc88398, user_id=2fb32f22210b4c9dad6e140cad5bb9ce, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:47.000611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6a9fc3-f3bf-4cba-9251-89e4de816a79 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:47.024338 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1958/3888] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:46 2022] PUT /identity/v3/projects/de2965eed3784ddda3e81aa47bc88398/users/2fb32f22210b4c9dad6e140cad5bb9ce/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:47.026090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830ae82-f1e9-4865-a7e3-3265a38598df None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:47.026422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830ae82-f1e9-4865-a7e3-3265a38598df None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:47.027425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7830ae82-f1e9-4865-a7e3-3265a38598df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:47.070219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7830ae82-f1e9-4865-a7e3-3265a38598df None None] MFA Rules not processed for user `2fb32f22210b4c9dad6e140cad5bb9ce`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:47.072504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7830ae82-f1e9-4865-a7e3-3265a38598df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:47.130974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91453cec-04ce-466c-99f2-7fafef0db1db tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:47.131713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91453cec-04ce-466c-99f2-7fafef0db1db tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:47.132074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91453cec-04ce-466c-99f2-7fafef0db1db tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:47.132469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91453cec-04ce-466c-99f2-7fafef0db1db tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/projects/ba2baf466cf8466c936c0a7e55f630c7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:47.134335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91453cec-04ce-466c-99f2-7fafef0db1db tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:get_project(project_id=ba2baf466cf8466c936c0a7e55f630c7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:47.136549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91453cec-04ce-466c-99f2-7fafef0db1db tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:47.146354 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1931/3889] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:08:46 2022] GET /identity/v3/projects/ba2baf466cf8466c936c0a7e55f630c7 => generated 371 bytes in 549 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:47.186038 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1959/3890] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:47 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:08:47.197568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91453cec-04ce-466c-99f2-7fafef0db1db tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:47.207528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830ae82-f1e9-4865-a7e3-3265a38598df None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:47.212900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91453cec-04ce-466c-99f2-7fafef0db1db tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:47.343723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7830ae82-f1e9-4865-a7e3-3265a38598df None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:47.348450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9937e3b-a82b-404b-b904-bc6ef7693dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:47.349810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9937e3b-a82b-404b-b904-bc6ef7693dc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:47.350098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9937e3b-a82b-404b-b904-bc6ef7693dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:47.350383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9937e3b-a82b-404b-b904-bc6ef7693dc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:47.351018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9937e3b-a82b-404b-b904-bc6ef7693dc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:47.353590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:47.354242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:47.354526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:47.354801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/users/a71e2ef7a6dd406bb8400ad6ecd76da6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:47.357888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9937e3b-a82b-404b-b904-bc6ef7693dc1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:47.384503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:delete_user(user_id=a71e2ef7a6dd406bb8400ad6ecd76da6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:47.388808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:47.392187 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:47.445696 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1932/3891] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:47 2022] POST /identity/v3/projects => generated 379 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:47.448989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9937e3b-a82b-404b-b904-bc6ef7693dc1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:47.460183 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:47.483306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a71e2ef7a6dd406bb8400ad6ecd76da6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.509008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a71e2ef7a6dd406bb8400ad6ecd76da6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.517832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a71e2ef7a6dd406bb8400ad6ecd76da6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.529998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a71e2ef7a6dd406bb8400ad6ecd76da6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.542914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a71e2ef7a6dd406bb8400ad6ecd76da6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.564699 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1960/3892] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:47 2022] DELETE /identity/v3/users/a71e2ef7a6dd406bb8400ad6ecd76da6 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:47.568667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:47.573806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9937e3b-a82b-404b-b904-bc6ef7693dc1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:47.574128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:47.690161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178ea98-8314-4ce3-8928-dc55fb6d9aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:47.693763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178ea98-8314-4ce3-8928-dc55fb6d9aed admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:47.694115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178ea98-8314-4ce3-8928-dc55fb6d9aed admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:47.695364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178ea98-8314-4ce3-8928-dc55fb6d9aed admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:47.696467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178ea98-8314-4ce3-8928-dc55fb6d9aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:47.721944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178ea98-8314-4ce3-8928-dc55fb6d9aed admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:47.748231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4fe2ec-5462-4ac2-9d8b-de2291eade7d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:47.759267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '058d73f9eeb1466c9324a4545e6d4bdb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2cafc30ad2b4494d8397a498298ad804', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:47.759942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:47.760226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:47.760503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] PATH_INFO: `/v3/projects/ba2baf466cf8466c936c0a7e55f630c7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:47.762317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ba2baf466cf8466c936c0a7e55f630c7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:47.764269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:47.783182 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1933/3893] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:47 2022] POST /identity/v3/users => generated 290 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:47.790275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178ea98-8314-4ce3-8928-dc55fb6d9aed admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:47.802721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9178ea98-8314-4ce3-8928-dc55fb6d9aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:47.815147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178ea98-8314-4ce3-8928-dc55fb6d9aed admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:47.820028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db0ad-fd6f-43d7-b9e6-afdfbd9cba1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:47.820648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db0ad-fd6f-43d7-b9e6-afdfbd9cba1c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:47.820930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db0ad-fd6f-43d7-b9e6-afdfbd9cba1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:47.821206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64db0ad-fd6f-43d7-b9e6-afdfbd9cba1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:47.821893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64db0ad-fd6f-43d7-b9e6-afdfbd9cba1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:47.823508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64db0ad-fd6f-43d7-b9e6-afdfbd9cba1c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:47.838105 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1934/3894] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:47.839278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db0ad-fd6f-43d7-b9e6-afdfbd9cba1c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:47.853635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64db0ad-fd6f-43d7-b9e6-afdfbd9cba1c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:47.860892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6e5c4-c3d6-4496-bbc7-6e74f45cb564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:47.861568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e5c4-c3d6-4496-bbc7-6e74f45cb564 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:47.861849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e5c4-c3d6-4496-bbc7-6e74f45cb564 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:47.862609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e5c4-c3d6-4496-bbc7-6e74f45cb564 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:47.863330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6e5c4-c3d6-4496-bbc7-6e74f45cb564 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:47.865229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6e5c4-c3d6-4496-bbc7-6e74f45cb564 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:47.879512 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1935/3895] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:47 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:47.883643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6e5c4-c3d6-4496-bbc7-6e74f45cb564 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:47.906531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6e5c4-c3d6-4496-bbc7-6e74f45cb564 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:47.922220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba2baf466cf8466c936c0a7e55f630c7', 'request_id': 'req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.938657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba2baf466cf8466c936c0a7e55f630c7', 'request_id': 'req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.946457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba2baf466cf8466c936c0a7e55f630c7', 'request_id': 'req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.973861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] The token cache is being invalidate because project ba2baf466cf8466c936c0a7e55f630c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:47.974221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.977117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:47.978810 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1961/3896] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:47 2022] DELETE /identity/v3/projects/ba2baf466cf8466c936c0a7e55f630c7 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:47.984864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:47.986411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:48.082062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175180d5-4d72-4d64-b6dc-2826d10efa52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:48.097498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175180d5-4d72-4d64-b6dc-2826d10efa52 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:48.097498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175180d5-4d72-4d64-b6dc-2826d10efa52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:48.097498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175180d5-4d72-4d64-b6dc-2826d10efa52 admin admin] PATH_INFO: `/v3/projects/9f3a3a5c2d2c4737b6096e09564e8cdf/users/65d4000c9f924eedb16346226f373801/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:48.112171 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:48.113483 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:48.131275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175180d5-4d72-4d64-b6dc-2826d10efa52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3a3a5c2d2c4737b6096e09564e8cdf, user_id=65d4000c9f924eedb16346226f373801, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:48.136069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175180d5-4d72-4d64-b6dc-2826d10efa52 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:48.167855 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1936/3897] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:47 2022] PUT /identity/v3/projects/9f3a3a5c2d2c4737b6096e09564e8cdf/users/65d4000c9f924eedb16346226f373801/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:48.180748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fefc9-3504-4b4a-bbf2-8f93e3cca6e1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:48.181220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fefc9-3504-4b4a-bbf2-8f93e3cca6e1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:48.181692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663fefc9-3504-4b4a-bbf2-8f93e3cca6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:48.182823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc1a3c8-5f99-484b-83dc-6d12ed404e3d tempest-QuotasAdminTestV257-1252002299 tempest-QuotasAdminTestV257-1252002299-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:48.241007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-663fefc9-3504-4b4a-bbf2-8f93e3cca6e1 None None] MFA Rules not processed for user `65d4000c9f924eedb16346226f373801`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:48.243061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-663fefc9-3504-4b4a-bbf2-8f93e3cca6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:48.345466 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1937/3898] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:48.349209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:48.349912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:48.350197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:48.350607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] PATH_INFO: `/v3/users/58d2bdfcc8f64eb7ab6ccd82bc12bf40` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:48.354420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=58d2bdfcc8f64eb7ab6ccd82bc12bf40)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:48.356581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fefc9-3504-4b4a-bbf2-8f93e3cca6e1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:48.357216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-663fefc9-3504-4b4a-bbf2-8f93e3cca6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:48.358192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:48.453626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663fefc9-3504-4b4a-bbf2-8f93e3cca6e1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:48.459191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:48.460024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:48.460972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:48.462061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:48.464100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58d2bdfcc8f64eb7ab6ccd82bc12bf40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:48.464482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:48.502917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58d2bdfcc8f64eb7ab6ccd82bc12bf40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:48.504254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58d2bdfcc8f64eb7ab6ccd82bc12bf40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:48.516291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58d2bdfcc8f64eb7ab6ccd82bc12bf40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:48.537817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4cb1693e-3a62-4a48-8055-61e42bb8c75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58d2bdfcc8f64eb7ab6ccd82bc12bf40'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:48.555221 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1962/3899] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:47 2022] DELETE /identity/v3/users/58d2bdfcc8f64eb7ab6ccd82bc12bf40 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:48.561268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477fc5e-612d-4547-926c-b3942db1534d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:48.561602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477fc5e-612d-4547-926c-b3942db1534d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:48.565145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1477fc5e-612d-4547-926c-b3942db1534d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:48.599767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1477fc5e-612d-4547-926c-b3942db1534d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:48.601996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1477fc5e-612d-4547-926c-b3942db1534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:48.649527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:48.654644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:48.696037 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1938/3900] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:48 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:08:48.723016 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1963/3901] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:48.751435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:48.753653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:48.784629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477fc5e-612d-4547-926c-b3942db1534d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:48.787451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1477fc5e-612d-4547-926c-b3942db1534d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:48.810304 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:48.817026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1477fc5e-612d-4547-926c-b3942db1534d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:48.830761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:48.831427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:48.831713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:48.831987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] PATH_INFO: `/v3/users/1f771366ecb64bc38869072b6d3cc06e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:48.836153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f771366ecb64bc38869072b6d3cc06e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:48.843307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:48.874358 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:48.917742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523ace96-7fa6-4c87-a8a8-fcfcfba8875f service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:48.967369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f771366ecb64bc38869072b6d3cc06e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:48.985871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f771366ecb64bc38869072b6d3cc06e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:48.986799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f771366ecb64bc38869072b6d3cc06e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:49.002406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f771366ecb64bc38869072b6d3cc06e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:49.022481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f771366ecb64bc38869072b6d3cc06e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:49.038967 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1964/3902] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:48 2022] DELETE /identity/v3/users/1f771366ecb64bc38869072b6d3cc06e => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:49.082980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:49.083613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:49.083900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:49.084178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:49.090558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:49.120091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:49.125691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:49.151550 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1939/3903] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:49.642959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:49.645180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:49.907669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:49.911060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:49.947602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075f434-76f1-4d20-bf9a-d55ba80c79ec admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:49.961343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:49.962011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:49.962294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:49.962576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] PATH_INFO: `/v3/users/2fb32f22210b4c9dad6e140cad5bb9ce` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:49.964506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fb32f22210b4c9dad6e140cad5bb9ce)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:49.967637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:50.037076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a157a90-b526-48f9-ab21-c0d776ca3f1e service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:50.067529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:50.068181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:50.068462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:50.068738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] PATH_INFO: `/v3/projects/567f2f97a829442d95c67be784f82734` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:50.075535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=567f2f97a829442d95c67be784f82734)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:50.079899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:50.161381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fb32f22210b4c9dad6e140cad5bb9ce'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.181228 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:50.193870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fb32f22210b4c9dad6e140cad5bb9ce'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.197414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fb32f22210b4c9dad6e140cad5bb9ce'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.203635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '567f2f97a829442d95c67be784f82734', 'request_id': 'req-602be4ac-ab77-40f7-864f-83e82f395bbe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.216262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fb32f22210b4c9dad6e140cad5bb9ce'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.227756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '567f2f97a829442d95c67be784f82734', 'request_id': 'req-602be4ac-ab77-40f7-864f-83e82f395bbe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.238878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3e54afa8-d520-41c4-b0ac-8ffb356960e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fb32f22210b4c9dad6e140cad5bb9ce'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.247964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '567f2f97a829442d95c67be784f82734', 'request_id': 'req-602be4ac-ab77-40f7-864f-83e82f395bbe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.257879 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1965/3904] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:49 2022] DELETE /identity/v3/users/2fb32f22210b4c9dad6e140cad5bb9ce => generated 0 bytes in 615 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:50.274353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a5d74-3a37-4234-90f6-dd319befa9a7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:50.275087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a5d74-3a37-4234-90f6-dd319befa9a7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:50.276635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938a5d74-3a37-4234-90f6-dd319befa9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:50.284693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] The token cache is being invalidate because project 567f2f97a829442d95c67be784f82734 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:50.287494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.288753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-602be4ac-ab77-40f7-864f-83e82f395bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.293159 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1940/3905] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:49 2022] DELETE /identity/v3/projects/567f2f97a829442d95c67be784f82734 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:50.298163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4306-ef6a-4806-9b0d-74a22d9c5663 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:50.298922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4306-ef6a-4806-9b0d-74a22d9c5663 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:50.299432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213b4306-ef6a-4806-9b0d-74a22d9c5663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:50.349030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-938a5d74-3a37-4234-90f6-dd319befa9a7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:50.356261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-938a5d74-3a37-4234-90f6-dd319befa9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:50.410370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-213b4306-ef6a-4806-9b0d-74a22d9c5663 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:50.417912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-213b4306-ef6a-4806-9b0d-74a22d9c5663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:50.465632 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:50.494947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1966/3906] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:50.496363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a5d74-3a37-4234-90f6-dd319befa9a7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:50.498254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-938a5d74-3a37-4234-90f6-dd319befa9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:50.515980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938a5d74-3a37-4234-90f6-dd319befa9a7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:50.523250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:50.524294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:50.524729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:50.525396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] PATH_INFO: `/v3/projects/ac1482f4cba74c7c9a1aa00e35ec63d1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:50.529014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1482f4cba74c7c9a1aa00e35ec63d1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:50.534613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:50.606730 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1941/3907] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:50.614428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b4306-ef6a-4806-9b0d-74a22d9c5663 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:50.616840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-213b4306-ef6a-4806-9b0d-74a22d9c5663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:50.635316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1482f4cba74c7c9a1aa00e35ec63d1', 'request_id': 'req-7981b096-f9c3-4457-991b-8b046f20b254'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.650046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1482f4cba74c7c9a1aa00e35ec63d1', 'request_id': 'req-7981b096-f9c3-4457-991b-8b046f20b254'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.660908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1482f4cba74c7c9a1aa00e35ec63d1', 'request_id': 'req-7981b096-f9c3-4457-991b-8b046f20b254'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.707576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] The token cache is being invalidate because project ac1482f4cba74c7c9a1aa00e35ec63d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:50.707932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.711368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7981b096-f9c3-4457-991b-8b046f20b254 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:50.719680 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1967/3908] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:50 2022] DELETE /identity/v3/projects/ac1482f4cba74c7c9a1aa00e35ec63d1 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:50.725333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431fcb1-cbe8-43db-a6f9-4ffeac8ad4ed None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:50.725510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431fcb1-cbe8-43db-a6f9-4ffeac8ad4ed None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:50.725731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431fcb1-cbe8-43db-a6f9-4ffeac8ad4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:50.750201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213b4306-ef6a-4806-9b0d-74a22d9c5663 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:50.773330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4431fcb1-cbe8-43db-a6f9-4ffeac8ad4ed None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:50.777021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4431fcb1-cbe8-43db-a6f9-4ffeac8ad4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:50.870366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db4f4-d05e-4a27-923b-b2949d742808 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:50.870993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db4f4-d05e-4a27-923b-b2949d742808 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:50.871311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db4f4-d05e-4a27-923b-b2949d742808 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:50.872301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3db4f4-d05e-4a27-923b-b2949d742808 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:50.879501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fd3db4f4-d05e-4a27-923b-b2949d742808 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:50.915340 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:50.943596 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1968/3909] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:50.944988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431fcb1-cbe8-43db-a6f9-4ffeac8ad4ed None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:50.948321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4431fcb1-cbe8-43db-a6f9-4ffeac8ad4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:50.982767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431fcb1-cbe8-43db-a6f9-4ffeac8ad4ed None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:50.997498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:50.998507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:50.998871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:50.999155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] PATH_INFO: `/v3/users/058d73f9eeb1466c9324a4545e6d4bdb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:51.000754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] RBAC: Authorizing `identity:delete_user(user_id=058d73f9eeb1466c9324a4545e6d4bdb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:51.002775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:51.057681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3db4f4-d05e-4a27-923b-b2949d742808 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:51.059559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3db4f4-d05e-4a27-923b-b2949d742808 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:51.079459 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1942/3910] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:51.080536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db4f4-d05e-4a27-923b-b2949d742808 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:51.110225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058d73f9eeb1466c9324a4545e6d4bdb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:51.112172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3db4f4-d05e-4a27-923b-b2949d742808 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:51.123542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:51.125515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:51.125650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:51.126742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:51.127572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:51.128406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:51.131653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:51.139330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058d73f9eeb1466c9324a4545e6d4bdb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:51.142735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058d73f9eeb1466c9324a4545e6d4bdb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:51.155988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058d73f9eeb1466c9324a4545e6d4bdb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:51.165859 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1943/3911] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:51.170598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:51.173007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:51.175017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058d73f9eeb1466c9324a4545e6d4bdb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:51.195854 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1969/3912] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:50 2022] DELETE /identity/v3/users/058d73f9eeb1466c9324a4545e6d4bdb => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:51.200464 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:51.213504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7580e2-3561-44f2-8c3b-3e55a55278ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:51.353732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff80581-14cd-4bc3-a56b-585b0b425cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:51.354663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff80581-14cd-4bc3-a56b-585b0b425cec admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:51.354949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff80581-14cd-4bc3-a56b-585b0b425cec admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:51.355227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff80581-14cd-4bc3-a56b-585b0b425cec admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:51.356114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff80581-14cd-4bc3-a56b-585b0b425cec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:51.358156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff80581-14cd-4bc3-a56b-585b0b425cec admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:51.460296 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1944/3913] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:51 2022] POST /identity/v3/projects => generated 381 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:51.461588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:51.477043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab784c08-724a-4d7d-b9f6-e0fb26820401 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:51.656321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb563e-14bc-407b-a343-3b54bc2cbfca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:51.657400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb563e-14bc-407b-a343-3b54bc2cbfca admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:51.658001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb563e-14bc-407b-a343-3b54bc2cbfca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:51.658001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bb563e-14bc-407b-a343-3b54bc2cbfca admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:51.658941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb563e-14bc-407b-a343-3b54bc2cbfca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:51.660974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bb563e-14bc-407b-a343-3b54bc2cbfca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:51.707074 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1970/3914] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:51 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:51.710888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff80581-14cd-4bc3-a56b-585b0b425cec admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:51.740323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff80581-14cd-4bc3-a56b-585b0b425cec admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:51.749594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2490f-7b2a-4902-87ce-e9e331e9b0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:51.750268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2490f-7b2a-4902-87ce-e9e331e9b0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:51.750556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2490f-7b2a-4902-87ce-e9e331e9b0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:51.750832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e2490f-7b2a-4902-87ce-e9e331e9b0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:51.752619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2490f-7b2a-4902-87ce-e9e331e9b0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:51.754720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e2490f-7b2a-4902-87ce-e9e331e9b0f2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:51.767285 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1945/3915] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:51.771498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb563e-14bc-407b-a343-3b54bc2cbfca admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:51.790926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bb563e-14bc-407b-a343-3b54bc2cbfca admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:51.799053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce63bf-6529-4a71-b172-fd2c637fbc61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:51.799677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce63bf-6529-4a71-b172-fd2c637fbc61 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:51.801170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce63bf-6529-4a71-b172-fd2c637fbc61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:51.802655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce63bf-6529-4a71-b172-fd2c637fbc61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:51.803527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce63bf-6529-4a71-b172-fd2c637fbc61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:51.810778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ce63bf-6529-4a71-b172-fd2c637fbc61 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:51.833241 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1971/3916] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:51 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:51.833527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2490f-7b2a-4902-87ce-e9e331e9b0f2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:51.849182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e2490f-7b2a-4902-87ce-e9e331e9b0f2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:51.856415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b740-83c9-4bc6-a743-eb6b9822fd2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:51.858165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b740-83c9-4bc6-a743-eb6b9822fd2a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:51.858165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b740-83c9-4bc6-a743-eb6b9822fd2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:51.858165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd1b740-83c9-4bc6-a743-eb6b9822fd2a admin admin] PATH_INFO: `/v3/projects/618a2425e6cd4c0cb64f25f6fe99f778/users/fde7b27b41384ebba2211631caaeee72/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:51.880212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1b740-83c9-4bc6-a743-eb6b9822fd2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=618a2425e6cd4c0cb64f25f6fe99f778, user_id=fde7b27b41384ebba2211631caaeee72, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:51.883743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd1b740-83c9-4bc6-a743-eb6b9822fd2a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:51.906000 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1946/3917] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:51 2022] PUT /identity/v3/projects/618a2425e6cd4c0cb64f25f6fe99f778/users/fde7b27b41384ebba2211631caaeee72/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:51.910999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b9f0-79f1-4015-b6c5-5d4bb3336686 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:51.911287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b9f0-79f1-4015-b6c5-5d4bb3336686 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:51.911568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9795b9f0-79f1-4015-b6c5-5d4bb3336686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:51.951179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9795b9f0-79f1-4015-b6c5-5d4bb3336686 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:51.953916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9795b9f0-79f1-4015-b6c5-5d4bb3336686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:52.024883 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:52.049333 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1972/3918] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:52.087734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b740-83c9-4bc6-a743-eb6b9822fd2a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:52.089991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3fd1b740-83c9-4bc6-a743-eb6b9822fd2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:52.213122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd1b740-83c9-4bc6-a743-eb6b9822fd2a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:52.223424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e1a466-72ab-4997-b319-50e12bddeb8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:52.226205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1a466-72ab-4997-b319-50e12bddeb8c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:52.226757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1a466-72ab-4997-b319-50e12bddeb8c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:52.227402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e1a466-72ab-4997-b319-50e12bddeb8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:52.252291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1a466-72ab-4997-b319-50e12bddeb8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:52.254175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e1a466-72ab-4997-b319-50e12bddeb8c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:52.284944 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1947/3919] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:52.473018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795b9f0-79f1-4015-b6c5-5d4bb3336686 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:52.475705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9795b9f0-79f1-4015-b6c5-5d4bb3336686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:52.503081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9795b9f0-79f1-4015-b6c5-5d4bb3336686 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:52.508391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:52.509110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:52.509488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:52.509882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] PATH_INFO: `/v3/projects/2cafc30ad2b4494d8397a498298ad804` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:52.513741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cafc30ad2b4494d8397a498298ad804)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:52.515888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:52.680966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cafc30ad2b4494d8397a498298ad804', 'request_id': 'req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:52.700065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cafc30ad2b4494d8397a498298ad804', 'request_id': 'req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:52.718495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cafc30ad2b4494d8397a498298ad804', 'request_id': 'req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:52.734438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] The token cache is being invalidate because project 2cafc30ad2b4494d8397a498298ad804 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:52.735187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:52.736895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a76e9214-1e1e-4baa-b952-9f2e880ab9ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:52.739023 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1973/3920] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:52 2022] DELETE /identity/v3/projects/2cafc30ad2b4494d8397a498298ad804 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:52.749500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20451e4-dab7-4709-92d2-ae728857b13d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:52.749500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20451e4-dab7-4709-92d2-ae728857b13d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:52.749500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20451e4-dab7-4709-92d2-ae728857b13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:52.771683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e20451e4-dab7-4709-92d2-ae728857b13d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:52.773009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e20451e4-dab7-4709-92d2-ae728857b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:52.928449 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:52.944647 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1948/3921] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:52.955542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7913c-b7b4-42c7-89d8-8924f2acd6ab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:52.956064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7913c-b7b4-42c7-89d8-8924f2acd6ab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:52.956173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7913c-b7b4-42c7-89d8-8924f2acd6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:52.993688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b2e7913c-b7b4-42c7-89d8-8924f2acd6ab None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:53.001916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2e7913c-b7b4-42c7-89d8-8924f2acd6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:53.021550 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1974/3922] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:53.026152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20451e4-dab7-4709-92d2-ae728857b13d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:53.050383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20451e4-dab7-4709-92d2-ae728857b13d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:53.066169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7680ea2-6048-4e0a-b833-0e4e422482a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:53.066856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7680ea2-6048-4e0a-b833-0e4e422482a7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:53.067140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7680ea2-6048-4e0a-b833-0e4e422482a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:53.067418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7680ea2-6048-4e0a-b833-0e4e422482a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:53.068369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7680ea2-6048-4e0a-b833-0e4e422482a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:53.068584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7680ea2-6048-4e0a-b833-0e4e422482a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:53.071403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7680ea2-6048-4e0a-b833-0e4e422482a7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:53.073631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7913c-b7b4-42c7-89d8-8924f2acd6ab None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:53.076015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2e7913c-b7b4-42c7-89d8-8924f2acd6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:53.090931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7913c-b7b4-42c7-89d8-8924f2acd6ab None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:53.097343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:53.098196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:53.098688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:53.099128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] PATH_INFO: `/v3/projects/de2965eed3784ddda3e81aa47bc88398` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:53.100436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2965eed3784ddda3e81aa47bc88398)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:53.102529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:53.106684 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1949/3923] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:53.107634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7680ea2-6048-4e0a-b833-0e4e422482a7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:53.129644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7680ea2-6048-4e0a-b833-0e4e422482a7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:53.135334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd040f0-0cad-49a0-81b0-37e792c50b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:53.135964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd040f0-0cad-49a0-81b0-37e792c50b37 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:53.136246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd040f0-0cad-49a0-81b0-37e792c50b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:53.136521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd040f0-0cad-49a0-81b0-37e792c50b37 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:53.137203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd040f0-0cad-49a0-81b0-37e792c50b37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:53.139402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd040f0-0cad-49a0-81b0-37e792c50b37 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:53.202289 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1950/3924] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:53 2022] POST /identity/v3/projects => generated 371 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:53.204027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd040f0-0cad-49a0-81b0-37e792c50b37 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:53.244325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2965eed3784ddda3e81aa47bc88398', 'request_id': 'req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.269063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2965eed3784ddda3e81aa47bc88398', 'request_id': 'req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.282055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2965eed3784ddda3e81aa47bc88398', 'request_id': 'req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.307037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] The token cache is being invalidate because project de2965eed3784ddda3e81aa47bc88398 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:53.307706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.310481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.312348 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1975/3925] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:53 2022] DELETE /identity/v3/projects/de2965eed3784ddda3e81aa47bc88398 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:53.316344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:53.318116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:53.334953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd040f0-0cad-49a0-81b0-37e792c50b37 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:53.418775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68ea23-521e-41eb-8b30-ff4331e0bfab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:53.421324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68ea23-521e-41eb-8b30-ff4331e0bfab admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:53.421915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68ea23-521e-41eb-8b30-ff4331e0bfab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:53.423063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68ea23-521e-41eb-8b30-ff4331e0bfab admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:53.423943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68ea23-521e-41eb-8b30-ff4331e0bfab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:53.428359 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:53.435414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68ea23-521e-41eb-8b30-ff4331e0bfab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:53.470191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5bd4d0-da24-4101-96e9-1f9ff04d6176 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:53.490042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:53.492163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:53.492468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:53.492752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] PATH_INFO: `/v3/users/65d4000c9f924eedb16346226f373801` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:53.494799 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1951/3926] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:53 2022] POST /identity/v3/users => generated 286 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:53.499249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d4000c9f924eedb16346226f373801)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:53.501707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68ea23-521e-41eb-8b30-ff4331e0bfab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:53.503418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:53.506239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4e68ea23-521e-41eb-8b30-ff4331e0bfab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:53.530312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68ea23-521e-41eb-8b30-ff4331e0bfab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:53.541071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fc63a-f530-47ca-8ee3-01dd37277492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:53.543327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fc63a-f530-47ca-8ee3-01dd37277492 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:53.543697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fc63a-f530-47ca-8ee3-01dd37277492 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:53.545496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702fc63a-f530-47ca-8ee3-01dd37277492 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:53.546199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fc63a-f530-47ca-8ee3-01dd37277492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:53.551038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702fc63a-f530-47ca-8ee3-01dd37277492 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:53.586923 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1952/3927] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:53.591550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fc63a-f530-47ca-8ee3-01dd37277492 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:53.626455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702fc63a-f530-47ca-8ee3-01dd37277492 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:53.627116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d4000c9f924eedb16346226f373801'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.641694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eeec9-6612-4557-8e5a-a9281c98db83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:53.644529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eeec9-6612-4557-8e5a-a9281c98db83 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:53.645599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eeec9-6612-4557-8e5a-a9281c98db83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:53.646311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299eeec9-6612-4557-8e5a-a9281c98db83 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:53.649218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299eeec9-6612-4557-8e5a-a9281c98db83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:53.653121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299eeec9-6612-4557-8e5a-a9281c98db83 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:53.665223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d4000c9f924eedb16346226f373801'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.666549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d4000c9f924eedb16346226f373801'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.681854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d4000c9f924eedb16346226f373801'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.688632 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1953/3928] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:53 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:53.690966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eeec9-6612-4557-8e5a-a9281c98db83 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:53.697871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ef2e92d-8894-4d12-a987-334c97bb8b87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d4000c9f924eedb16346226f373801'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:53.698256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-299eeec9-6612-4557-8e5a-a9281c98db83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:53.718974 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1976/3929] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:08:53 2022] DELETE /identity/v3/users/65d4000c9f924eedb16346226f373801 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:08:53.730496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299eeec9-6612-4557-8e5a-a9281c98db83 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:53.840448 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:53.914456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ddb07-25d1-46ec-a5ce-6b356537e250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:53.915154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ddb07-25d1-46ec-a5ce-6b356537e250 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:53.916584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ddb07-25d1-46ec-a5ce-6b356537e250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:53.916884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ddb07-25d1-46ec-a5ce-6b356537e250 admin admin] PATH_INFO: `/v3/projects/1449a35c24254626bbe1449feb02e9f8/users/a943f2c455934d74a696c209c0c46ae0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:53.976387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ddb07-25d1-46ec-a5ce-6b356537e250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1449a35c24254626bbe1449feb02e9f8, user_id=a943f2c455934d74a696c209c0c46ae0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:53.981689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ddb07-25d1-46ec-a5ce-6b356537e250 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:54.022078 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1954/3930] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:53 2022] PUT /identity/v3/projects/1449a35c24254626bbe1449feb02e9f8/users/a943f2c455934d74a696c209c0c46ae0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:54.037723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cddc02-c1c4-4dac-9afb-217a8160d255 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:54.038274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cddc02-c1c4-4dac-9afb-217a8160d255 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:54.038532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cddc02-c1c4-4dac-9afb-217a8160d255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:54.112960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d9cddc02-c1c4-4dac-9afb-217a8160d255 None None] MFA Rules not processed for user `a943f2c455934d74a696c209c0c46ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:54.115314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d9cddc02-c1c4-4dac-9afb-217a8160d255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:54.294183 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1977/3931] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:54.299495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ddb07-25d1-46ec-a5ce-6b356537e250 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:54.446814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ddb07-25d1-46ec-a5ce-6b356537e250 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:54.458289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af215-3be0-460b-8c31-0d5254799231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:54.459102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af215-3be0-460b-8c31-0d5254799231 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:54.459442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af215-3be0-460b-8c31-0d5254799231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:54.460097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253af215-3be0-460b-8c31-0d5254799231 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:54.462024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253af215-3be0-460b-8c31-0d5254799231 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:54.467557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253af215-3be0-460b-8c31-0d5254799231 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:54.556538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cddc02-c1c4-4dac-9afb-217a8160d255 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:54.557676 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1955/3932] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:54 2022] POST /identity/v3/projects => generated 373 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:54.574608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cddc02-c1c4-4dac-9afb-217a8160d255 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:54.805791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ac407-a542-4a8e-9f85-6a151c47f763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:54.806441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ac407-a542-4a8e-9f85-6a151c47f763 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:54.806727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ac407-a542-4a8e-9f85-6a151c47f763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:54.807009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ac407-a542-4a8e-9f85-6a151c47f763 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:54.815387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ac407-a542-4a8e-9f85-6a151c47f763 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:54.826789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ac407-a542-4a8e-9f85-6a151c47f763 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:54.872694 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:54.906535 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1978/3933] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:54 2022] POST /identity/v3/users => generated 293 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:08:54.910378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af215-3be0-460b-8c31-0d5254799231 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:54.925954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253af215-3be0-460b-8c31-0d5254799231 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:54.939856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76014a87-d071-4897-8757-cddd4195bf5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:54.940544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76014a87-d071-4897-8757-cddd4195bf5a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:54.940832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76014a87-d071-4897-8757-cddd4195bf5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:54.941107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76014a87-d071-4897-8757-cddd4195bf5a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:54.941792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76014a87-d071-4897-8757-cddd4195bf5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:54.943429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76014a87-d071-4897-8757-cddd4195bf5a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:54.979378 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1956/3934] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:54 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:54.980483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ac407-a542-4a8e-9f85-6a151c47f763 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:54.997324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ac407-a542-4a8e-9f85-6a151c47f763 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:55.007130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfc8af-a086-48f6-a97f-e4731384d026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:55.007426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc8af-a086-48f6-a97f-e4731384d026 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:55.007704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc8af-a086-48f6-a97f-e4731384d026 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:55.007976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bfc8af-a086-48f6-a97f-e4731384d026 admin admin] PATH_INFO: `/v3/projects/d965fa6eb4064e40a0343400959d1b83/users/7a9adcee37504b19831383df6857d8e0/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:55.035229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfc8af-a086-48f6-a97f-e4731384d026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d965fa6eb4064e40a0343400959d1b83, user_id=7a9adcee37504b19831383df6857d8e0, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:55.037663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bfc8af-a086-48f6-a97f-e4731384d026 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:55.065848 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1979/3935] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:54 2022] PUT /identity/v3/projects/d965fa6eb4064e40a0343400959d1b83/users/7a9adcee37504b19831383df6857d8e0/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:55.069681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76014a87-d071-4897-8757-cddd4195bf5a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:55.085742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76014a87-d071-4897-8757-cddd4195bf5a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:55.190838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16783b-f3cc-4048-bffb-c4feb4a62826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:55.191461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16783b-f3cc-4048-bffb-c4feb4a62826 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:55.191846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16783b-f3cc-4048-bffb-c4feb4a62826 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:55.192125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16783b-f3cc-4048-bffb-c4feb4a62826 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:55.192824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16783b-f3cc-4048-bffb-c4feb4a62826 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:55.194721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16783b-f3cc-4048-bffb-c4feb4a62826 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:55.224861 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1957/3936] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:55 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:55.228779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfc8af-a086-48f6-a97f-e4731384d026 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:55.251003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bfc8af-a086-48f6-a97f-e4731384d026 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:55.258239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb733862-cc7c-49c1-b074-845252aa4193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:55.259657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733862-cc7c-49c1-b074-845252aa4193 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:55.259657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733862-cc7c-49c1-b074-845252aa4193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:55.259657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb733862-cc7c-49c1-b074-845252aa4193 admin admin] PATH_INFO: `/v3/projects/d965fa6eb4064e40a0343400959d1b83/users/7a9adcee37504b19831383df6857d8e0/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:55.272387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733862-cc7c-49c1-b074-845252aa4193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d965fa6eb4064e40a0343400959d1b83, user_id=7a9adcee37504b19831383df6857d8e0, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:55.275263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb733862-cc7c-49c1-b074-845252aa4193 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:55.313257 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1980/3937] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:55 2022] PUT /identity/v3/projects/d965fa6eb4064e40a0343400959d1b83/users/7a9adcee37504b19831383df6857d8e0/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:55.325885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e7a4-bfb9-4e53-b787-1ba32e34af66 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:55.326388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e7a4-bfb9-4e53-b787-1ba32e34af66 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:55.326678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836e7a4-bfb9-4e53-b787-1ba32e34af66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:55.391800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c836e7a4-bfb9-4e53-b787-1ba32e34af66 None None] MFA Rules not processed for user `7a9adcee37504b19831383df6857d8e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:55.393207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c836e7a4-bfb9-4e53-b787-1ba32e34af66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:55.444581 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:55.517979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59acf34-fdb9-4be2-b2e0-2768e93d3d0d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:55.518509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59acf34-fdb9-4be2-b2e0-2768e93d3d0d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:55.518877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59acf34-fdb9-4be2-b2e0-2768e93d3d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:55.542728 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1958/3938] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:55 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:55.554525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9fa0-5e36-42d1-bda4-fe266828b937 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:55.555348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9fa0-5e36-42d1-bda4-fe266828b937 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:55.555348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99af9fa0-5e36-42d1-bda4-fe266828b937 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:55.571682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c59acf34-fdb9-4be2-b2e0-2768e93d3d0d None None] MFA Rules not processed for user `04f2de8673fd4835b9382c22a1259df1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:55.573229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c59acf34-fdb9-4be2-b2e0-2768e93d3d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:55.593878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-99af9fa0-5e36-42d1-bda4-fe266828b937 None None] MFA Rules not processed for user `a943f2c455934d74a696c209c0c46ae0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:55.595243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-99af9fa0-5e36-42d1-bda4-fe266828b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:55.717519 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1981/3939] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:08:55.723154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0103-6c0b-4d5e-940f-050d019f728c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:55.723470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0103-6c0b-4d5e-940f-050d019f728c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:55.723736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770c0103-6c0b-4d5e-940f-050d019f728c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:55.760053 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1959/3940] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:55.768696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9fa0-5e36-42d1-bda4-fe266828b937 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:55.771689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-99af9fa0-5e36-42d1-bda4-fe266828b937 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:55.803692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-770c0103-6c0b-4d5e-940f-050d019f728c None None] MFA Rules not processed for user `04f2de8673fd4835b9382c22a1259df1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:55.809924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-770c0103-6c0b-4d5e-940f-050d019f728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:55.828244 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1982/3941] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:08:55.829960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c0103-6c0b-4d5e-940f-050d019f728c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:55.832213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-770c0103-6c0b-4d5e-940f-050d019f728c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:56.003716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99af9fa0-5e36-42d1-bda4-fe266828b937 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:56.033469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b0d6-f829-49a5-84eb-58086692c939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:56.034716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b0d6-f829-49a5-84eb-58086692c939 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:56.036933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b0d6-f829-49a5-84eb-58086692c939 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:56.038598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd5b0d6-f829-49a5-84eb-58086692c939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:56.050592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770c0103-6c0b-4d5e-940f-050d019f728c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:56.059667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5b0d6-f829-49a5-84eb-58086692c939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:56.062560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd5b0d6-f829-49a5-84eb-58086692c939 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:56.066229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:56.067072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:56.067316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:56.068246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] PATH_INFO: `/v3/projects/9f3a3a5c2d2c4737b6096e09564e8cdf` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:56.071564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3a3a5c2d2c4737b6096e09564e8cdf)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:56.077220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:56.080977 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1960/3942] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:08:56.082336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b0d6-f829-49a5-84eb-58086692c939 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:56.084761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cdd5b0d6-f829-49a5-84eb-58086692c939 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:56.130389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd5b0d6-f829-49a5-84eb-58086692c939 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:56.158868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca96d12-fc6b-467b-bfa2-60e1442ea4b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:56.159929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca96d12-fc6b-467b-bfa2-60e1442ea4b7 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:56.160596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca96d12-fc6b-467b-bfa2-60e1442ea4b7 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:56.161089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca96d12-fc6b-467b-bfa2-60e1442ea4b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:56.161704 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=5,keystone:SELECT=92,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:56.182615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca96d12-fc6b-467b-bfa2-60e1442ea4b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:56.187232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca96d12-fc6b-467b-bfa2-60e1442ea4b7 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:56.187497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3a3a5c2d2c4737b6096e09564e8cdf', 'request_id': 'req-412522ef-433a-4934-8bd0-5e61d152827c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:56.202501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3a3a5c2d2c4737b6096e09564e8cdf', 'request_id': 'req-412522ef-433a-4934-8bd0-5e61d152827c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:56.213460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3a3a5c2d2c4737b6096e09564e8cdf', 'request_id': 'req-412522ef-433a-4934-8bd0-5e61d152827c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:56.221069 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1961/3943] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:56 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:08:56.226760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] The token cache is being invalidate because project 9f3a3a5c2d2c4737b6096e09564e8cdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:08:56.227118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:56.227730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-412522ef-433a-4934-8bd0-5e61d152827c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:08:56.234841 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1983/3944] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:08:55 2022] DELETE /identity/v3/projects/9f3a3a5c2d2c4737b6096e09564e8cdf => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:56.238236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd6bcf-f3cf-412f-9ec2-653337f56c06 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:56.238822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd6bcf-f3cf-412f-9ec2-653337f56c06 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:56.239170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fd6bcf-f3cf-412f-9ec2-653337f56c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:56.303547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e1fd6bcf-f3cf-412f-9ec2-653337f56c06 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:56.307725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e1fd6bcf-f3cf-412f-9ec2-653337f56c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:56.384292 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:56.480740 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1962/3945] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:56.488698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc83bd7-4be3-454d-9de2-2f7d02bc8dd8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:56.489025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc83bd7-4be3-454d-9de2-2f7d02bc8dd8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:56.489319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc83bd7-4be3-454d-9de2-2f7d02bc8dd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:56.549614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ebc83bd7-4be3-454d-9de2-2f7d02bc8dd8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:56.555917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ebc83bd7-4be3-454d-9de2-2f7d02bc8dd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:56.597384 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1984/3946] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:08:56.601535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd6bcf-f3cf-412f-9ec2-653337f56c06 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:56.616273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fd6bcf-f3cf-412f-9ec2-653337f56c06 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:56.632482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719f1c-9c99-4de1-b82c-6a84b8358ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:56.633111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719f1c-9c99-4de1-b82c-6a84b8358ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:56.633429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719f1c-9c99-4de1-b82c-6a84b8358ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:56.633683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a719f1c-9c99-4de1-b82c-6a84b8358ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:56.634448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719f1c-9c99-4de1-b82c-6a84b8358ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:08:56.634753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719f1c-9c99-4de1-b82c-6a84b8358ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:56.636597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a719f1c-9c99-4de1-b82c-6a84b8358ad5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:56.671661 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1963/3947] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:08:56.673102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc83bd7-4be3-454d-9de2-2f7d02bc8dd8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:56.688810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc83bd7-4be3-454d-9de2-2f7d02bc8dd8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:56.698637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c84a-c8f7-44d8-a80b-70bf3feb7936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:56.699604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c84a-c8f7-44d8-a80b-70bf3feb7936 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:56.699884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c84a-c8f7-44d8-a80b-70bf3feb7936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:56.700527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f078c84a-c8f7-44d8-a80b-70bf3feb7936 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:56.701875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078c84a-c8f7-44d8-a80b-70bf3feb7936 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:56.703793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f078c84a-c8f7-44d8-a80b-70bf3feb7936 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:56.768386 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1985/3948] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:08:56 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:56.772460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719f1c-9c99-4de1-b82c-6a84b8358ad5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:56.787664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a719f1c-9c99-4de1-b82c-6a84b8358ad5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:56.961497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e9b6-3ee1-400c-afcd-4664ed416ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:56.961497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e9b6-3ee1-400c-afcd-4664ed416ccc admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:56.961497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e9b6-3ee1-400c-afcd-4664ed416ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:56.961497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f691e9b6-3ee1-400c-afcd-4664ed416ccc admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:56.961854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691e9b6-3ee1-400c-afcd-4664ed416ccc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:56.968475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f691e9b6-3ee1-400c-afcd-4664ed416ccc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:57.038565 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1964/3949] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:08:56 2022] POST /identity/v3/users => generated 294 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:08:57.042695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c84a-c8f7-44d8-a80b-70bf3feb7936 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:57.066626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f078c84a-c8f7-44d8-a80b-70bf3feb7936 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:57.083896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325760-41da-409d-a23e-42a00af30ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:57.084931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325760-41da-409d-a23e-42a00af30ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:57.086050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325760-41da-409d-a23e-42a00af30ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:57.086587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a325760-41da-409d-a23e-42a00af30ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:57.091607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325760-41da-409d-a23e-42a00af30ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:57.095577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a325760-41da-409d-a23e-42a00af30ec0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:57.123781 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1986/3950] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:57.127239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e9b6-3ee1-400c-afcd-4664ed416ccc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:57.153776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f691e9b6-3ee1-400c-afcd-4664ed416ccc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:57.170101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6db695-dfa4-46d5-9685-dab0328b75a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:57.171148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db695-dfa4-46d5-9685-dab0328b75a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:57.171605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db695-dfa4-46d5-9685-dab0328b75a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:57.172011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6db695-dfa4-46d5-9685-dab0328b75a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:57.172852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6db695-dfa4-46d5-9685-dab0328b75a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:57.174711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6db695-dfa4-46d5-9685-dab0328b75a2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:57.203286 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1965/3951] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:08:57.207736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325760-41da-409d-a23e-42a00af30ec0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:57.221758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a325760-41da-409d-a23e-42a00af30ec0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:57.236449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097d353-6d2f-4483-84a0-fd5b65eba272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:57.237357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097d353-6d2f-4483-84a0-fd5b65eba272 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:57.239047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097d353-6d2f-4483-84a0-fd5b65eba272 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:57.240199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4097d353-6d2f-4483-84a0-fd5b65eba272 admin admin] PATH_INFO: `/v3/projects/8d4e329b8cf84076a8b9a7ffb505828a/users/e4e4610435d54a2a91d2d7773a76ac8f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:57.279370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097d353-6d2f-4483-84a0-fd5b65eba272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d4e329b8cf84076a8b9a7ffb505828a, user_id=e4e4610435d54a2a91d2d7773a76ac8f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:57.286274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4097d353-6d2f-4483-84a0-fd5b65eba272 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:57.354927 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1987/3952] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:08:57 2022] PUT /identity/v3/projects/8d4e329b8cf84076a8b9a7ffb505828a/users/e4e4610435d54a2a91d2d7773a76ac8f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:08:57.366093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd26c1-81dc-451f-9abd-d8f28e4f3dfe None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:57.366366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd26c1-81dc-451f-9abd-d8f28e4f3dfe None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:57.366698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abd26c1-81dc-451f-9abd-d8f28e4f3dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:57.450667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5abd26c1-81dc-451f-9abd-d8f28e4f3dfe None None] MFA Rules not processed for user `e4e4610435d54a2a91d2d7773a76ac8f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:08:57.458162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5abd26c1-81dc-451f-9abd-d8f28e4f3dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:57.715511 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1966/3953] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:08:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:08:58.116178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097d353-6d2f-4483-84a0-fd5b65eba272 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:58.118733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4097d353-6d2f-4483-84a0-fd5b65eba272 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:58.315777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd26c1-81dc-451f-9abd-d8f28e4f3dfe None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:08:58.318225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5abd26c1-81dc-451f-9abd-d8f28e4f3dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:58.357895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4097d353-6d2f-4483-84a0-fd5b65eba272 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:58.374030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:58.374674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:58.374961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:58.375241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:58.384515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:08:58.388506 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:58.443506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abd26c1-81dc-451f-9abd-d8f28e4f3dfe None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:08:58.453866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571c747-5151-40e0-b960-bcd6f2c4e939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:08:58.454501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571c747-5151-40e0-b960-bcd6f2c4e939 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:08:58.454783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571c747-5151-40e0-b960-bcd6f2c4e939 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:08:58.455061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571c747-5151-40e0-b960-bcd6f2c4e939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:08:58.476362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571c747-5151-40e0-b960-bcd6f2c4e939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:58.477850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571c747-5151-40e0-b960-bcd6f2c4e939 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:58.508881 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1967/3954] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:58 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:08:58.614686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:08:58.617515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:08:58.621783 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:08:58.641009 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1988/3955] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:08:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:00.457153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571c747-5151-40e0-b960-bcd6f2c4e939 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:00.488450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:00.490495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:00.490750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571c747-5151-40e0-b960-bcd6f2c4e939 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:00.509998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c54cbdd-ab9b-4a38-b7df-e69a80857155 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:00.510627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54cbdd-ab9b-4a38-b7df-e69a80857155 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:00.510909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54cbdd-ab9b-4a38-b7df-e69a80857155 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:00.511188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c54cbdd-ab9b-4a38-b7df-e69a80857155 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:00.513517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2c54cbdd-ab9b-4a38-b7df-e69a80857155 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:00.655629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5647ad-fa32-4b63-b9c9-1c7d60b7e16a service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:00.661610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:00.663126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:00.663914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:00.664340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] PATH_INFO: `/v3/users/4bf107f9fd8645ba937fb399ebec1ee7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:00.665851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf107f9fd8645ba937fb399ebec1ee7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:00.669185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:00.738811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54cbdd-ab9b-4a38-b7df-e69a80857155 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:00.740436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c54cbdd-ab9b-4a38-b7df-e69a80857155 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:00.758571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf107f9fd8645ba937fb399ebec1ee7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:00.763883 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1968/3956] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:00.780125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf107f9fd8645ba937fb399ebec1ee7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:00.781104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf107f9fd8645ba937fb399ebec1ee7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:00.801693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf107f9fd8645ba937fb399ebec1ee7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:00.812258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf107f9fd8645ba937fb399ebec1ee7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:00.837327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1989/3957] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:09:00 2022] DELETE /identity/v3/users/4bf107f9fd8645ba937fb399ebec1ee7 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:00.837522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213adcc-4c59-4374-8f58-e8ab0b478325 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:00.837522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213adcc-4c59-4374-8f58-e8ab0b478325 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:00.837522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7213adcc-4c59-4374-8f58-e8ab0b478325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:00.855477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7213adcc-4c59-4374-8f58-e8ab0b478325 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:00.857805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7213adcc-4c59-4374-8f58-e8ab0b478325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:00.960835 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1969/3958] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:00.970796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:00.972531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:01.113795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e6cfc3-338f-43b7-9585-7d4de61627c4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:01.126067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34545fdf-0592-4e03-8b70-61c6c47fd6f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:01.126922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34545fdf-0592-4e03-8b70-61c6c47fd6f7 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:01.127285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34545fdf-0592-4e03-8b70-61c6c47fd6f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:01.127466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34545fdf-0592-4e03-8b70-61c6c47fd6f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:01.171935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34545fdf-0592-4e03-8b70-61c6c47fd6f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:01.175012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34545fdf-0592-4e03-8b70-61c6c47fd6f7 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:01.191591 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1990/3959] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:01.439316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213adcc-4c59-4374-8f58-e8ab0b478325 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:01.440898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7213adcc-4c59-4374-8f58-e8ab0b478325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:01.488526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7213adcc-4c59-4374-8f58-e8ab0b478325 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:01.505622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:01.510298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:01.510769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:01.511455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] PATH_INFO: `/v3/projects/735d738c5d7343778a9e9f45e1760846` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:01.516549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=735d738c5d7343778a9e9f45e1760846)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:01.518839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:01.759076 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:01.772775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '735d738c5d7343778a9e9f45e1760846', 'request_id': 'req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:01.784844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34545fdf-0592-4e03-8b70-61c6c47fd6f7 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:01.787008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-34545fdf-0592-4e03-8b70-61c6c47fd6f7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:01.792198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '735d738c5d7343778a9e9f45e1760846', 'request_id': 'req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:01.803126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '735d738c5d7343778a9e9f45e1760846', 'request_id': 'req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:01.821167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] The token cache is being invalidate because project 735d738c5d7343778a9e9f45e1760846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:09:01.821716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:01.823517 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:01.824721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7c0139e-4eb0-4dbd-a9a4-b6b6956fa062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:01.827293 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1970/3960] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:09:01 2022] DELETE /identity/v3/projects/735d738c5d7343778a9e9f45e1760846 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:01.833981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69a9f8-9127-48d1-8ebc-bfad60a38fc7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:01.837350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69a9f8-9127-48d1-8ebc-bfad60a38fc7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:01.838655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69a9f8-9127-48d1-8ebc-bfad60a38fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:01.882727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9b69a9f8-9127-48d1-8ebc-bfad60a38fc7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:01.884317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9b69a9f8-9127-48d1-8ebc-bfad60a38fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:01.972232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34545fdf-0592-4e03-8b70-61c6c47fd6f7 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:01.988495 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1971/3961] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:01.996474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d9186-7d69-4b45-ad90-f8bbb9fd287a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:01.997496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d9186-7d69-4b45-ad90-f8bbb9fd287a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:01.997998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d9186-7d69-4b45-ad90-f8bbb9fd287a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:02.021689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0e7d9186-7d69-4b45-ad90-f8bbb9fd287a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:02.024599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0e7d9186-7d69-4b45-ad90-f8bbb9fd287a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:02.037228 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1972/3962] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:02.041115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d9186-7d69-4b45-ad90-f8bbb9fd287a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:02.057450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d9186-7d69-4b45-ad90-f8bbb9fd287a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:02.069857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc85fa-d184-48ca-8b2d-306b26741c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:02.070481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc85fa-d184-48ca-8b2d-306b26741c50 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:02.070762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc85fa-d184-48ca-8b2d-306b26741c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:02.071040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcc85fa-d184-48ca-8b2d-306b26741c50 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:02.071701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc85fa-d184-48ca-8b2d-306b26741c50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:09:02.072009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc85fa-d184-48ca-8b2d-306b26741c50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:02.074162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcc85fa-d184-48ca-8b2d-306b26741c50 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:02.090668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5fa79-89c5-402f-94d8-4b1b426c6154 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:02.092858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5fa79-89c5-402f-94d8-4b1b426c6154 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:02.099464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5fa79-89c5-402f-94d8-4b1b426c6154 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:02.099867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a5fa79-89c5-402f-94d8-4b1b426c6154 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:02.107322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-25a5fa79-89c5-402f-94d8-4b1b426c6154 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:02.122294 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1973/3963] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:09:02.126563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc85fa-d184-48ca-8b2d-306b26741c50 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:02.138182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5fa79-89c5-402f-94d8-4b1b426c6154 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:02.140356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a5fa79-89c5-402f-94d8-4b1b426c6154 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:02.158459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcc85fa-d184-48ca-8b2d-306b26741c50 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:02.162522 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1991/3964] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:02.173429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792e680-2a8b-4030-b4c6-fafae0615f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:02.174056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792e680-2a8b-4030-b4c6-fafae0615f88 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:02.174340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792e680-2a8b-4030-b4c6-fafae0615f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:02.174678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792e680-2a8b-4030-b4c6-fafae0615f88 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:02.175332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792e680-2a8b-4030-b4c6-fafae0615f88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:02.177965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2792e680-2a8b-4030-b4c6-fafae0615f88 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:02.262594 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1974/3965] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:09:02 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:02.266387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5fa79-89c5-402f-94d8-4b1b426c6154 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:02.280812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a5fa79-89c5-402f-94d8-4b1b426c6154 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:02.407456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b7451-9222-4263-98fb-b36b93c146d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:02.408159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b7451-9222-4263-98fb-b36b93c146d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:02.408959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b7451-9222-4263-98fb-b36b93c146d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:02.409319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205b7451-9222-4263-98fb-b36b93c146d5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:02.410082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b7451-9222-4263-98fb-b36b93c146d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:02.412256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205b7451-9222-4263-98fb-b36b93c146d5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:02.461557 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1992/3966] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:09:02 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:02.462149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792e680-2a8b-4030-b4c6-fafae0615f88 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:02.486728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792e680-2a8b-4030-b4c6-fafae0615f88 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:02.501492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102791db-8145-482d-87f4-dc87ebd2191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:02.502672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102791db-8145-482d-87f4-dc87ebd2191d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:02.503105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102791db-8145-482d-87f4-dc87ebd2191d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:02.503554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102791db-8145-482d-87f4-dc87ebd2191d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:02.504714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102791db-8145-482d-87f4-dc87ebd2191d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:02.506499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102791db-8145-482d-87f4-dc87ebd2191d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:02.528956 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1975/3967] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:02.533902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b7451-9222-4263-98fb-b36b93c146d5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:02.551084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205b7451-9222-4263-98fb-b36b93c146d5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:02.566100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1822f7-3840-4700-a96f-df71f49411de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:02.567216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1822f7-3840-4700-a96f-df71f49411de admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:02.568009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1822f7-3840-4700-a96f-df71f49411de admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:02.568284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1822f7-3840-4700-a96f-df71f49411de admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:02.572459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1822f7-3840-4700-a96f-df71f49411de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:02.574219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1822f7-3840-4700-a96f-df71f49411de admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:02.601553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102791db-8145-482d-87f4-dc87ebd2191d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:02.604250 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1993/3968] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:02.618312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102791db-8145-482d-87f4-dc87ebd2191d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:02.635875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd982e-34f7-479d-8021-9ae50639d8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:02.637218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd982e-34f7-479d-8021-9ae50639d8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:02.638947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd982e-34f7-479d-8021-9ae50639d8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:02.639574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbd982e-34f7-479d-8021-9ae50639d8d8 admin admin] PATH_INFO: `/v3/projects/324550a5e9a14175805c1d0e747587d8/users/4b164e29ea254b1580dfca38e261b6d2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:02.674154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd982e-34f7-479d-8021-9ae50639d8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=324550a5e9a14175805c1d0e747587d8, user_id=4b164e29ea254b1580dfca38e261b6d2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:02.679137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbd982e-34f7-479d-8021-9ae50639d8d8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:02.708909 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1976/3969] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:09:02 2022] PUT /identity/v3/projects/324550a5e9a14175805c1d0e747587d8/users/4b164e29ea254b1580dfca38e261b6d2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:02.722063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f8109-e7f0-4315-b5e9-16e0fb6107dd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:02.722396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f8109-e7f0-4315-b5e9-16e0fb6107dd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:02.722677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095f8109-e7f0-4315-b5e9-16e0fb6107dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:02.763117 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:02.794590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-095f8109-e7f0-4315-b5e9-16e0fb6107dd None None] MFA Rules not processed for user `4b164e29ea254b1580dfca38e261b6d2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:02.796521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-095f8109-e7f0-4315-b5e9-16e0fb6107dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:02.973594 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1994/3970] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:03.048093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd982e-34f7-479d-8021-9ae50639d8d8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:03.049914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8dbd982e-34f7-479d-8021-9ae50639d8d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:03.151158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbd982e-34f7-479d-8021-9ae50639d8d8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:03.157558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e940cbb6-42b6-477e-8c52-13a3ae9887d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:03.158391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940cbb6-42b6-477e-8c52-13a3ae9887d6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:03.158775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940cbb6-42b6-477e-8c52-13a3ae9887d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:03.159754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e940cbb6-42b6-477e-8c52-13a3ae9887d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:03.171526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940cbb6-42b6-477e-8c52-13a3ae9887d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:03.173159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e940cbb6-42b6-477e-8c52-13a3ae9887d6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:03.179010 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:03.187014 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1977/3971] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:12.237497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf7e37-e802-4d65-a126-afb6356dbf0f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:12.237939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf7e37-e802-4d65-a126-afb6356dbf0f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:12.238049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdf7e37-e802-4d65-a126-afb6356dbf0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:12.302168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3bdf7e37-e802-4d65-a126-afb6356dbf0f None None] MFA Rules not processed for user `fde7b27b41384ebba2211631caaeee72`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:12.303750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3bdf7e37-e802-4d65-a126-afb6356dbf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:12.436351 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1995/3972] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:12.447197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda912-b661-4ce8-b0a5-4634eef5bf8e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:12.447727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda912-b661-4ce8-b0a5-4634eef5bf8e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:12.447937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbda912-b661-4ce8-b0a5-4634eef5bf8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:12.468843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1fbda912-b661-4ce8-b0a5-4634eef5bf8e None None] MFA Rules not processed for user `fde7b27b41384ebba2211631caaeee72`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:12.470466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1fbda912-b661-4ce8-b0a5-4634eef5bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:12.484825 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1978/3973] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:12.663121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf7e37-e802-4d65-a126-afb6356dbf0f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:12.670847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3bdf7e37-e802-4d65-a126-afb6356dbf0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:12.965754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdf7e37-e802-4d65-a126-afb6356dbf0f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:12.990106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3bec-6362-4423-adf6-20fa177e0f9a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:12.994966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3bec-6362-4423-adf6-20fa177e0f9a service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:12.996935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3bec-6362-4423-adf6-20fa177e0f9a service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:12.998170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe3bec-6362-4423-adf6-20fa177e0f9a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:13.027991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3bec-6362-4423-adf6-20fa177e0f9a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:13.029650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe3bec-6362-4423-adf6-20fa177e0f9a service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:13.042271 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1996/3974] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:12 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:22.462411 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:23.038046 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:27.221144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda912-b661-4ce8-b0a5-4634eef5bf8e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:27.223557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1fbda912-b661-4ce8-b0a5-4634eef5bf8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:27.338536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbda912-b661-4ce8-b0a5-4634eef5bf8e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:27.345437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:27.346349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:27.346980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:27.347474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:27.349463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:27.365930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:27.368431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:27.383550 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1979/3975] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:35.191946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3bec-6362-4423-adf6-20fa177e0f9a service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:35.226542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe3bec-6362-4423-adf6-20fa177e0f9a service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:35.232828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8ad976-ffbe-4610-93d3-b41baeaf9a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:35.234043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ad976-ffbe-4610-93d3-b41baeaf9a2f service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:35.234535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ad976-ffbe-4610-93d3-b41baeaf9a2f service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:35.235018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8ad976-ffbe-4610-93d3-b41baeaf9a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:35.237947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7f8ad976-ffbe-4610-93d3-b41baeaf9a2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:35.344863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ad976-ffbe-4610-93d3-b41baeaf9a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:35.347399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8ad976-ffbe-4610-93d3-b41baeaf9a2f service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:35.390848 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1997/3976] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:35 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:37.208206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:37.210413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:37.405208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725b3acf-1ba9-4dd7-86ec-9320e166a3c0 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:37.413808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:37.414459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:37.415380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:37.415809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] PATH_INFO: `/v3/users/e4e4610435d54a2a91d2d7773a76ac8f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:37.417048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4e4610435d54a2a91d2d7773a76ac8f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:37.419552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:37.490468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e4610435d54a2a91d2d7773a76ac8f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:37.505196 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:37.508517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e4610435d54a2a91d2d7773a76ac8f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:37.510058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e4610435d54a2a91d2d7773a76ac8f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:37.525947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e4610435d54a2a91d2d7773a76ac8f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:37.536131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e4610435d54a2a91d2d7773a76ac8f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:37.548961 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1980/3977] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:09:37 2022] DELETE /identity/v3/users/e4e4610435d54a2a91d2d7773a76ac8f => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:37.554384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764927d-532a-4000-8d30-ce309b33ea81 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:37.554878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764927d-532a-4000-8d30-ce309b33ea81 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:37.554978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7764927d-532a-4000-8d30-ce309b33ea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:37.595564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7764927d-532a-4000-8d30-ce309b33ea81 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:37.596937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7764927d-532a-4000-8d30-ce309b33ea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:37.693168 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1998/3978] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:37.701279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:37.704115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:37.859707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4cd0ac-96e7-4e06-ac23-8ce6f98c40e5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:37.864347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694e4d8-0f77-4b25-aeb7-6262f2a1f384 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:37.865094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e4d8-0f77-4b25-aeb7-6262f2a1f384 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:37.865476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e4d8-0f77-4b25-aeb7-6262f2a1f384 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:37.865834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694e4d8-0f77-4b25-aeb7-6262f2a1f384 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:37.879946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694e4d8-0f77-4b25-aeb7-6262f2a1f384 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:37.884307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7694e4d8-0f77-4b25-aeb7-6262f2a1f384 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:37.903841 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1981/3979] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:38.412416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764927d-532a-4000-8d30-ce309b33ea81 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:38.414600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7764927d-532a-4000-8d30-ce309b33ea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:38.445861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7764927d-532a-4000-8d30-ce309b33ea81 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:38.459188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:38.459917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:38.460218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:38.460486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] PATH_INFO: `/v3/users/04f2de8673fd4835b9382c22a1259df1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:38.462201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f2de8673fd4835b9382c22a1259df1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:38.472297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:38.495873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694e4d8-0f77-4b25-aeb7-6262f2a1f384 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:38.497464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7694e4d8-0f77-4b25-aeb7-6262f2a1f384 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:38.528472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694e4d8-0f77-4b25-aeb7-6262f2a1f384 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:38.543873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:38.545004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:38.545723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:38.546414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] PATH_INFO: `/v3/projects/8d4e329b8cf84076a8b9a7ffb505828a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:38.547865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d4e329b8cf84076a8b9a7ffb505828a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:38.551461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:38.608421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f2de8673fd4835b9382c22a1259df1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.630897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f2de8673fd4835b9382c22a1259df1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.631994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f2de8673fd4835b9382c22a1259df1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.635373 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:38.646405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d4e329b8cf84076a8b9a7ffb505828a', 'request_id': 'req-f06fd246-13ec-494a-90b2-40db7c24ae3c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.657907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d4e329b8cf84076a8b9a7ffb505828a', 'request_id': 'req-f06fd246-13ec-494a-90b2-40db7c24ae3c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.661991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f2de8673fd4835b9382c22a1259df1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.669896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d4e329b8cf84076a8b9a7ffb505828a', 'request_id': 'req-f06fd246-13ec-494a-90b2-40db7c24ae3c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.673777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f038155d-9fba-445b-a674-a0db37b08765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f2de8673fd4835b9382c22a1259df1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.685250 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 1999/3980] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:09:38 2022] DELETE /identity/v3/users/04f2de8673fd4835b9382c22a1259df1 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:38.686489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] The token cache is being invalidate because project 8d4e329b8cf84076a8b9a7ffb505828a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:09:38.686789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.688718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f06fd246-13ec-494a-90b2-40db7c24ae3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:38.690376 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1982/3981] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:09:38 2022] DELETE /identity/v3/projects/8d4e329b8cf84076a8b9a7ffb505828a => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:38.697615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d282-7c20-44aa-92e6-7e47a5efdf85 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:38.697904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d282-7c20-44aa-92e6-7e47a5efdf85 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:38.698211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4349d282-7c20-44aa-92e6-7e47a5efdf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:38.759031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4349d282-7c20-44aa-92e6-7e47a5efdf85 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:38.760313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4349d282-7c20-44aa-92e6-7e47a5efdf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:38.849058 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2000/3982] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:38.859245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab50c1b-ac4a-49eb-b24e-ff7e62e8d0d7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:38.859546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab50c1b-ac4a-49eb-b24e-ff7e62e8d0d7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:38.860239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab50c1b-ac4a-49eb-b24e-ff7e62e8d0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:38.882376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0ab50c1b-ac4a-49eb-b24e-ff7e62e8d0d7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:38.883690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ab50c1b-ac4a-49eb-b24e-ff7e62e8d0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:38.899602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d282-7c20-44aa-92e6-7e47a5efdf85 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:38.905236 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1983/3983] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:38.911101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4349d282-7c20-44aa-92e6-7e47a5efdf85 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:38.916318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fe727-937f-4c79-9e7b-90d147ffe20d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:38.917453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fe727-937f-4c79-9e7b-90d147ffe20d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:38.917957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fe727-937f-4c79-9e7b-90d147ffe20d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:38.918240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196fe727-937f-4c79-9e7b-90d147ffe20d admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:38.919060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fe727-937f-4c79-9e7b-90d147ffe20d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:09:38.919183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fe727-937f-4c79-9e7b-90d147ffe20d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:38.920795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196fe727-937f-4c79-9e7b-90d147ffe20d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:38.941257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab50c1b-ac4a-49eb-b24e-ff7e62e8d0d7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:38.953740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab50c1b-ac4a-49eb-b24e-ff7e62e8d0d7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:38.954604 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2001/3984] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:09:38.961825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a93d4-2ad8-4dbc-a4c9-26ae05c33ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:38.962806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a93d4-2ad8-4dbc-a4c9-26ae05c33ddc admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:38.963307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a93d4-2ad8-4dbc-a4c9-26ae05c33ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:38.963853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66a93d4-2ad8-4dbc-a4c9-26ae05c33ddc admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:38.965227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a93d4-2ad8-4dbc-a4c9-26ae05c33ddc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:38.967998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66a93d4-2ad8-4dbc-a4c9-26ae05c33ddc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:39.014284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fe727-937f-4c79-9e7b-90d147ffe20d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:39.023403 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1984/3985] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:09:38 2022] POST /identity/v3/projects => generated 371 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:39.030528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196fe727-937f-4c79-9e7b-90d147ffe20d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:39.110143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453e3f0-a268-402a-b86e-be5b11c9d264 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:39.111097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453e3f0-a268-402a-b86e-be5b11c9d264 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:39.111532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453e3f0-a268-402a-b86e-be5b11c9d264 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:39.111957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4453e3f0-a268-402a-b86e-be5b11c9d264 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:39.113580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453e3f0-a268-402a-b86e-be5b11c9d264 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:39.116262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4453e3f0-a268-402a-b86e-be5b11c9d264 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:39.145559 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2002/3986] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:09:39 2022] POST /identity/v3/users => generated 286 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:39.149007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a93d4-2ad8-4dbc-a4c9-26ae05c33ddc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:39.162374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66a93d4-2ad8-4dbc-a4c9-26ae05c33ddc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:39.168128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd3c28-0efc-4864-ba60-de10faf4061d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:39.169037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd3c28-0efc-4864-ba60-de10faf4061d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:39.169037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd3c28-0efc-4864-ba60-de10faf4061d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:39.169262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbd3c28-0efc-4864-ba60-de10faf4061d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:39.169931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd3c28-0efc-4864-ba60-de10faf4061d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:39.171559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbd3c28-0efc-4864-ba60-de10faf4061d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:39.184078 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1985/3987] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:39.187783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453e3f0-a268-402a-b86e-be5b11c9d264 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:39.200123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4453e3f0-a268-402a-b86e-be5b11c9d264 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:39.205004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eeb5568-bb3e-4e20-9b91-113ab6243dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:39.205675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb5568-bb3e-4e20-9b91-113ab6243dd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:39.205956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb5568-bb3e-4e20-9b91-113ab6243dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:39.206230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eeb5568-bb3e-4e20-9b91-113ab6243dd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:39.206875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb5568-bb3e-4e20-9b91-113ab6243dd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:39.208504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eeb5568-bb3e-4e20-9b91-113ab6243dd5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:39.224945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2003/3988] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:39.226776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd3c28-0efc-4864-ba60-de10faf4061d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:39.238842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbd3c28-0efc-4864-ba60-de10faf4061d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:39.244444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297b137-c7bd-4b34-bceb-ce22d76ca7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:39.245836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297b137-c7bd-4b34-bceb-ce22d76ca7d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:39.246192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297b137-c7bd-4b34-bceb-ce22d76ca7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:39.246545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5297b137-c7bd-4b34-bceb-ce22d76ca7d0 admin admin] PATH_INFO: `/v3/projects/4a9eeb3ce71a477b9f0a4b3ef4f42058/users/e6a6b9e09beb4f8db1d9fcb7bb04e04a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:39.251946 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:39.266740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297b137-c7bd-4b34-bceb-ce22d76ca7d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a9eeb3ce71a477b9f0a4b3ef4f42058, user_id=e6a6b9e09beb4f8db1d9fcb7bb04e04a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:39.269701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5297b137-c7bd-4b34-bceb-ce22d76ca7d0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:39.286265 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1986/3989] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:09:39 2022] PUT /identity/v3/projects/4a9eeb3ce71a477b9f0a4b3ef4f42058/users/e6a6b9e09beb4f8db1d9fcb7bb04e04a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:39.297822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b5e8-f135-4a73-923b-3117f6e0779b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:39.298188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b5e8-f135-4a73-923b-3117f6e0779b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:39.298542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e15b5e8-f135-4a73-923b-3117f6e0779b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:39.331381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4e15b5e8-f135-4a73-923b-3117f6e0779b None None] MFA Rules not processed for user `e6a6b9e09beb4f8db1d9fcb7bb04e04a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:39.332792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e15b5e8-f135-4a73-923b-3117f6e0779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:39.363392 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:39.434613 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2004/3990] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:39.439326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297b137-c7bd-4b34-bceb-ce22d76ca7d0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:39.441546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5297b137-c7bd-4b34-bceb-ce22d76ca7d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:39.556706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15b5e8-f135-4a73-923b-3117f6e0779b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:39.560539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e15b5e8-f135-4a73-923b-3117f6e0779b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:39.585070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5297b137-c7bd-4b34-bceb-ce22d76ca7d0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:39.602241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:39.602894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:39.603193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:39.603466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] PATH_INFO: `/v3/projects/ef70895cb8074b00a5800de8113eac1c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:39.605222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef70895cb8074b00a5800de8113eac1c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:39.607167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:39.694856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e15b5e8-f135-4a73-923b-3117f6e0779b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:39.715342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef70895cb8074b00a5800de8113eac1c', 'request_id': 'req-0f1584c5-e75a-4413-bac4-f2c0b3678538'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:39.722685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef70895cb8074b00a5800de8113eac1c', 'request_id': 'req-0f1584c5-e75a-4413-bac4-f2c0b3678538'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:39.742104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef70895cb8074b00a5800de8113eac1c', 'request_id': 'req-0f1584c5-e75a-4413-bac4-f2c0b3678538'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:39.763248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] The token cache is being invalidate because project ef70895cb8074b00a5800de8113eac1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:09:39.763552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:39.773838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f1584c5-e75a-4413-bac4-f2c0b3678538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:39.779523 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1987/3991] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:09:39 2022] DELETE /identity/v3/projects/ef70895cb8074b00a5800de8113eac1c => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:39.782341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51af5a-cc55-4534-891c-1d3cf6330d89 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:39.782634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51af5a-cc55-4534-891c-1d3cf6330d89 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:39.782941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51af5a-cc55-4534-891c-1d3cf6330d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:39.792771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2db57e-eb25-4b9d-9b87-2306267e06e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:39.793430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2db57e-eb25-4b9d-9b87-2306267e06e1 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:39.793716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2db57e-eb25-4b9d-9b87-2306267e06e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:39.793993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2db57e-eb25-4b9d-9b87-2306267e06e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:39.795907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1a2db57e-eb25-4b9d-9b87-2306267e06e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:39.834472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cf51af5a-cc55-4534-891c-1d3cf6330d89 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:39.835716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cf51af5a-cc55-4534-891c-1d3cf6330d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:39.951021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1988/3992] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:09:39.961328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ee76-2f14-4950-bcb4-f0c72070d55a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:39.961328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ee76-2f14-4950-bcb4-f0c72070d55a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:39.961328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17ee76-2f14-4950-bcb4-f0c72070d55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:39.972787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2db57e-eb25-4b9d-9b87-2306267e06e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:39.974891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2db57e-eb25-4b9d-9b87-2306267e06e1 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:40.008462 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2005/3993] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:09:40.028310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8e17ee76-2f14-4950-bcb4-f0c72070d55a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:40.030312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8e17ee76-2f14-4950-bcb4-f0c72070d55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:40.042707 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1989/3994] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:40.047016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2db57e-eb25-4b9d-9b87-2306267e06e1 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:40.075758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2db57e-eb25-4b9d-9b87-2306267e06e1 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:40.090574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c217-d57a-4cc3-b59a-bfdd80b8d821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:40.091349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c217-d57a-4cc3-b59a-bfdd80b8d821 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:40.091702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c217-d57a-4cc3-b59a-bfdd80b8d821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:40.092052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0c217-d57a-4cc3-b59a-bfdd80b8d821 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:40.092781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c217-d57a-4cc3-b59a-bfdd80b8d821 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:09:40.093161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c217-d57a-4cc3-b59a-bfdd80b8d821 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:40.095216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0c217-d57a-4cc3-b59a-bfdd80b8d821 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:40.112956 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2006/3995] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:09:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:09:40.114280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17ee76-2f14-4950-bcb4-f0c72070d55a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:40.127076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17ee76-2f14-4950-bcb4-f0c72070d55a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:40.133276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d88fa-f929-471c-ab9f-8719053fc69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:40.134030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d88fa-f929-471c-ab9f-8719053fc69a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:40.134386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d88fa-f929-471c-ab9f-8719053fc69a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:40.134879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979d88fa-f929-471c-ab9f-8719053fc69a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:40.135643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d88fa-f929-471c-ab9f-8719053fc69a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:40.151582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979d88fa-f929-471c-ab9f-8719053fc69a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:40.158265 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:40.205286 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1990/3996] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:09:40 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:40.206550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c217-d57a-4cc3-b59a-bfdd80b8d821 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:40.218920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0c217-d57a-4cc3-b59a-bfdd80b8d821 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:40.287532 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:40.342044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee90c3-b7ef-4328-b2aa-d5d6d61efc23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:40.342937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee90c3-b7ef-4328-b2aa-d5d6d61efc23 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:40.343468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee90c3-b7ef-4328-b2aa-d5d6d61efc23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:40.343850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbee90c3-b7ef-4328-b2aa-d5d6d61efc23 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:40.344600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee90c3-b7ef-4328-b2aa-d5d6d61efc23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:40.346813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbee90c3-b7ef-4328-b2aa-d5d6d61efc23 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:40.375685 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2007/3997] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:09:40 2022] POST /identity/v3/users => generated 294 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:40.379049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d88fa-f929-471c-ab9f-8719053fc69a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:40.404552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979d88fa-f929-471c-ab9f-8719053fc69a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:40.415761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038e5c1-0c3a-44dc-b4f4-03a2f1665fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:40.416649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038e5c1-0c3a-44dc-b4f4-03a2f1665fcf admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:40.417419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038e5c1-0c3a-44dc-b4f4-03a2f1665fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:40.417997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8038e5c1-0c3a-44dc-b4f4-03a2f1665fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:40.418901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038e5c1-0c3a-44dc-b4f4-03a2f1665fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:40.420687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8038e5c1-0c3a-44dc-b4f4-03a2f1665fcf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:40.442326 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1991/3998] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:40.443528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee90c3-b7ef-4328-b2aa-d5d6d61efc23 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:40.456238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbee90c3-b7ef-4328-b2aa-d5d6d61efc23 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:40.461589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590d8202-cb15-414f-b7ba-8967263db134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:40.462688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d8202-cb15-414f-b7ba-8967263db134 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:40.463084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d8202-cb15-414f-b7ba-8967263db134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:40.463461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590d8202-cb15-414f-b7ba-8967263db134 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:40.464934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d8202-cb15-414f-b7ba-8967263db134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:40.466968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590d8202-cb15-414f-b7ba-8967263db134 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:40.487296 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2008/3999] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:40.490116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038e5c1-0c3a-44dc-b4f4-03a2f1665fcf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:40.503154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8038e5c1-0c3a-44dc-b4f4-03a2f1665fcf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:40.515219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa1861-a95b-47a1-872d-866a08df7a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:40.516000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa1861-a95b-47a1-872d-866a08df7a8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:40.516385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa1861-a95b-47a1-872d-866a08df7a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:40.516793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daa1861-a95b-47a1-872d-866a08df7a8d admin admin] PATH_INFO: `/v3/projects/126c5b989a304f1cb217c95ebfbbd8b8/users/abd944e891194ac498c21b55da9cb581/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:40.538559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa1861-a95b-47a1-872d-866a08df7a8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=126c5b989a304f1cb217c95ebfbbd8b8, user_id=abd944e891194ac498c21b55da9cb581, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:40.541719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daa1861-a95b-47a1-872d-866a08df7a8d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:40.562259 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1992/4000] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:09:40 2022] PUT /identity/v3/projects/126c5b989a304f1cb217c95ebfbbd8b8/users/abd944e891194ac498c21b55da9cb581/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:40.563993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d1d0-99ba-4eac-bd88-d216aecfe19c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:40.564376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d1d0-99ba-4eac-bd88-d216aecfe19c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:40.564723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f28d1d0-99ba-4eac-bd88-d216aecfe19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:40.585010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1f28d1d0-99ba-4eac-bd88-d216aecfe19c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:40.586348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1f28d1d0-99ba-4eac-bd88-d216aecfe19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:40.673791 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2009/4001] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:40.687215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa1861-a95b-47a1-872d-866a08df7a8d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:40.689168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4daa1861-a95b-47a1-872d-866a08df7a8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:40.788924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daa1861-a95b-47a1-872d-866a08df7a8d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:40.793739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cdfb69-3349-449b-9640-89c3a86481b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:40.794135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdfb69-3349-449b-9640-89c3a86481b9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:40.794417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdfb69-3349-449b-9640-89c3a86481b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:40.794688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cdfb69-3349-449b-9640-89c3a86481b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:40.805722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdfb69-3349-449b-9640-89c3a86481b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:40.807164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cdfb69-3349-449b-9640-89c3a86481b9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:40.820672 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1993/4002] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:41.512376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28d1d0-99ba-4eac-bd88-d216aecfe19c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:41.514599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1f28d1d0-99ba-4eac-bd88-d216aecfe19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:41.686552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f28d1d0-99ba-4eac-bd88-d216aecfe19c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:41.695302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcdc67e-31f9-42a3-a21e-6fc91f81439f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:41.696282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdc67e-31f9-42a3-a21e-6fc91f81439f service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:41.696725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdc67e-31f9-42a3-a21e-6fc91f81439f service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:41.697154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcdc67e-31f9-42a3-a21e-6fc91f81439f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:41.701394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6fcdc67e-31f9-42a3-a21e-6fc91f81439f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:41.719274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdc67e-31f9-42a3-a21e-6fc91f81439f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:41.721393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcdc67e-31f9-42a3-a21e-6fc91f81439f service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:41.761860 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2010/4003] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:42.419529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57c61-9da9-4da1-b0ba-34dc3dcb1b73 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:42.420065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57c61-9da9-4da1-b0ba-34dc3dcb1b73 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:42.420065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb57c61-9da9-4da1-b0ba-34dc3dcb1b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:42.447073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8fb57c61-9da9-4da1-b0ba-34dc3dcb1b73 None None] MFA Rules not processed for user `5ae455a2351c4cf9a32ca68e686d27d0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:42.449273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8fb57c61-9da9-4da1-b0ba-34dc3dcb1b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:42.538402 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1994/4004] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:42 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:42.776990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa449b-9765-4cc6-a606-391929fead01 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:42.777871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa449b-9765-4cc6-a606-391929fead01 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:42.778313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa449b-9765-4cc6-a606-391929fead01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:42.848617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-edaa449b-9765-4cc6-a606-391929fead01 None None] MFA Rules not processed for user `abd944e891194ac498c21b55da9cb581`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:42.851259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-edaa449b-9765-4cc6-a606-391929fead01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:42.912686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57c61-9da9-4da1-b0ba-34dc3dcb1b73 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:42.914130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8fb57c61-9da9-4da1-b0ba-34dc3dcb1b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:42.917840 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:42.944955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb57c61-9da9-4da1-b0ba-34dc3dcb1b73 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:42.950673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:42.951457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:42.951741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:42.952017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] PATH_INFO: `/v3/users/4b164e29ea254b1580dfca38e261b6d2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:42.953175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b164e29ea254b1580dfca38e261b6d2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:42.955289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:43.033390 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2011/4005] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:43.047528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b7043-c32a-44c1-a4c7-7992e65f1294 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:43.048109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b7043-c32a-44c1-a4c7-7992e65f1294 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:43.049088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3b7043-c32a-44c1-a4c7-7992e65f1294 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:43.071811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3f3b7043-c32a-44c1-a4c7-7992e65f1294 None None] MFA Rules not processed for user `abd944e891194ac498c21b55da9cb581`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:43.073563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3f3b7043-c32a-44c1-a4c7-7992e65f1294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:43.080970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b164e29ea254b1580dfca38e261b6d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:43.096824 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2012/4006] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:09:43.098665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5ad7a-82ef-47bf-9a93-0420e88a4490 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:43.099382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5ad7a-82ef-47bf-9a93-0420e88a4490 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:43.099813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c5ad7a-82ef-47bf-9a93-0420e88a4490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:43.106426 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:43.127365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b164e29ea254b1580dfca38e261b6d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:43.128603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-14c5ad7a-82ef-47bf-9a93-0420e88a4490 None None] MFA Rules not processed for user `abd944e891194ac498c21b55da9cb581`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:43.128940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b164e29ea254b1580dfca38e261b6d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:43.130453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-14c5ad7a-82ef-47bf-9a93-0420e88a4490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:43.143297 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2013/4007] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:43.150914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b164e29ea254b1580dfca38e261b6d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:43.154940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5ad7a-82ef-47bf-9a93-0420e88a4490 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:43.156480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-14c5ad7a-82ef-47bf-9a93-0420e88a4490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:43.170349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-20ef1198-f817-4672-87ff-31e4efb0f17f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b164e29ea254b1580dfca38e261b6d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:43.189398 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1995/4008] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:09:42 2022] DELETE /identity/v3/users/4b164e29ea254b1580dfca38e261b6d2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:43.190886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304a084-da4f-4f98-a439-7e7d34033945 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:43.191197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304a084-da4f-4f98-a439-7e7d34033945 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:43.192303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304a084-da4f-4f98-a439-7e7d34033945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:43.248724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f304a084-da4f-4f98-a439-7e7d34033945 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:43.250011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f304a084-da4f-4f98-a439-7e7d34033945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:43.318958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c5ad7a-82ef-47bf-9a93-0420e88a4490 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:43.373057 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1996/4009] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:43.436555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304a084-da4f-4f98-a439-7e7d34033945 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:43.438170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f304a084-da4f-4f98-a439-7e7d34033945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:43.473225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:43.473853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:43.475268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:43.475572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:43.483287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:43.527189 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:43.571225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304a084-da4f-4f98-a439-7e7d34033945 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:43.575075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:43.577025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:43.579455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8a80ea-81f5-45dc-acf7-56b02b89cf43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:43.580068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a80ea-81f5-45dc-acf7-56b02b89cf43 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:43.581767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a80ea-81f5-45dc-acf7-56b02b89cf43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:43.582238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8a80ea-81f5-45dc-acf7-56b02b89cf43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:43.590393 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2014/4010] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:09:43.627407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a80ea-81f5-45dc-acf7-56b02b89cf43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:43.629416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8a80ea-81f5-45dc-acf7-56b02b89cf43 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:43.663035 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1997/4011] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:09:44.450491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:44.452471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:44.482324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474d0dd3-42ad-4bac-8b67-5d81f8d36ea7 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:44.493706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:44.494363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:44.495741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:44.496174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] PATH_INFO: `/v3/projects/324550a5e9a14175805c1d0e747587d8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:44.503513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] RBAC: Authorizing `identity:delete_project(project_id=324550a5e9a14175805c1d0e747587d8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:44.505696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:44.634912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '324550a5e9a14175805c1d0e747587d8', 'request_id': 'req-059d12db-daef-4829-b77e-718183a5b456'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:44.686498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '324550a5e9a14175805c1d0e747587d8', 'request_id': 'req-059d12db-daef-4829-b77e-718183a5b456'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:44.712415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '324550a5e9a14175805c1d0e747587d8', 'request_id': 'req-059d12db-daef-4829-b77e-718183a5b456'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:44.733920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] The token cache is being invalidate because project 324550a5e9a14175805c1d0e747587d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:09:44.734569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:44.735415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:44.747194 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2015/4012] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:09:44 2022] DELETE /identity/v3/projects/324550a5e9a14175805c1d0e747587d8 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:44.751709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d517d-923f-44e3-8c33-5dbc2e06e455 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:44.752599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d517d-923f-44e3-8c33-5dbc2e06e455 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:44.753069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d517d-923f-44e3-8c33-5dbc2e06e455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:44.802900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4c9d517d-923f-44e3-8c33-5dbc2e06e455 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:44.804296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4c9d517d-923f-44e3-8c33-5dbc2e06e455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:44.931151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:44.934295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:44.988980 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1998/4013] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:44.996736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51495-054b-4fc9-9512-324ce273f7ba None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:44.997806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51495-054b-4fc9-9512-324ce273f7ba None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:44.999208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51495-054b-4fc9-9512-324ce273f7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:45.029770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-50d51495-054b-4fc9-9512-324ce273f7ba None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:45.031548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50d51495-054b-4fc9-9512-324ce273f7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:45.048806 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 1999/4014] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:45.052869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d51495-054b-4fc9-9512-324ce273f7ba None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:45.077207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d51495-054b-4fc9-9512-324ce273f7ba None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:45.125077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2e99f-54b1-4acd-adaa-4ca78cc34fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:45.136228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2e99f-54b1-4acd-adaa-4ca78cc34fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:45.141683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2e99f-54b1-4acd-adaa-4ca78cc34fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:45.144970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2e99f-54b1-4acd-adaa-4ca78cc34fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:45.145878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2e99f-54b1-4acd-adaa-4ca78cc34fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:09:45.147233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d12db-daef-4829-b77e-718183a5b456 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:45.148441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2e99f-54b1-4acd-adaa-4ca78cc34fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:45.156956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2e99f-54b1-4acd-adaa-4ca78cc34fc1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:45.160516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:45.161175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:45.161495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:45.161768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] PATH_INFO: `/v3/users/fde7b27b41384ebba2211631caaeee72` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:45.162324 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:45.163341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fde7b27b41384ebba2211631caaeee72)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:45.166241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:45.228551 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2000/4015] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:09:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:09:45.229826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2e99f-54b1-4acd-adaa-4ca78cc34fc1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:45.266272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2e99f-54b1-4acd-adaa-4ca78cc34fc1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:45.280195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf762af2-46ed-4c77-a774-0fa94df30450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:45.282907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf762af2-46ed-4c77-a774-0fa94df30450 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:45.284515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf762af2-46ed-4c77-a774-0fa94df30450 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:45.285279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fde7b27b41384ebba2211631caaeee72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:45.286053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf762af2-46ed-4c77-a774-0fa94df30450 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:45.288451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf762af2-46ed-4c77-a774-0fa94df30450 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:45.304011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf762af2-46ed-4c77-a774-0fa94df30450 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:45.306787 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:45.316673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fde7b27b41384ebba2211631caaeee72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:45.318810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fde7b27b41384ebba2211631caaeee72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:45.338942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fde7b27b41384ebba2211631caaeee72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:45.351922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4eaee99c-f32b-4487-8084-6cc291c11386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fde7b27b41384ebba2211631caaeee72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:45.366687 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2016/4016] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:09:44 2022] DELETE /identity/v3/users/fde7b27b41384ebba2211631caaeee72 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:09:45.407084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054a6c7-6985-42de-a1c1-3982889cc79c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:45.407397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054a6c7-6985-42de-a1c1-3982889cc79c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:45.407644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2054a6c7-6985-42de-a1c1-3982889cc79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:45.447749 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2001/4017] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:09:45 2022] POST /identity/v3/projects => generated 367 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:45.451669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf762af2-46ed-4c77-a774-0fa94df30450 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:45.452952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2054a6c7-6985-42de-a1c1-3982889cc79c None None] MFA Rules not processed for user `abd944e891194ac498c21b55da9cb581`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:45.458017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cf762af2-46ed-4c77-a774-0fa94df30450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:45.460247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2054a6c7-6985-42de-a1c1-3982889cc79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:45.682327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2017/4018] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:45 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:09:45.733758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf762af2-46ed-4c77-a774-0fa94df30450 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:45.746246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b84e12-04c0-4ae4-ab68-073f1efa531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:45.748408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b84e12-04c0-4ae4-ab68-073f1efa531a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:45.763161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b84e12-04c0-4ae4-ab68-073f1efa531a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:45.765613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b84e12-04c0-4ae4-ab68-073f1efa531a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:45.766566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b84e12-04c0-4ae4-ab68-073f1efa531a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:45.776879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b84e12-04c0-4ae4-ab68-073f1efa531a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:45.864058 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2002/4019] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:09:45 2022] POST /identity/v3/users => generated 284 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:45.867993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054a6c7-6985-42de-a1c1-3982889cc79c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:45.898492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2054a6c7-6985-42de-a1c1-3982889cc79c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:45.923438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484126-6b78-41b3-a070-c01f2de3cd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:45.924155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484126-6b78-41b3-a070-c01f2de3cd0c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:45.926742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484126-6b78-41b3-a070-c01f2de3cd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:45.927699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a484126-6b78-41b3-a070-c01f2de3cd0c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:45.931801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484126-6b78-41b3-a070-c01f2de3cd0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:45.935712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a484126-6b78-41b3-a070-c01f2de3cd0c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:45.984942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b84e12-04c0-4ae4-ab68-073f1efa531a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:45.986529 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2018/4020] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:46.007953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b84e12-04c0-4ae4-ab68-073f1efa531a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:46.041440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3f2a2-5c66-46de-8640-8793f38ee77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:46.042471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3f2a2-5c66-46de-8640-8793f38ee77f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:46.042471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3f2a2-5c66-46de-8640-8793f38ee77f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:46.042756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3f2a2-5c66-46de-8640-8793f38ee77f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:46.043336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3f2a2-5c66-46de-8640-8793f38ee77f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:46.044961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3f2a2-5c66-46de-8640-8793f38ee77f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:46.086295 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2003/4021] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:46.087705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484126-6b78-41b3-a070-c01f2de3cd0c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:46.103079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a484126-6b78-41b3-a070-c01f2de3cd0c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:46.123618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3654b0-944d-46c7-8cdb-8883e4ecc3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:46.125373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3654b0-944d-46c7-8cdb-8883e4ecc3fa admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:46.125792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3654b0-944d-46c7-8cdb-8883e4ecc3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:46.126961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3654b0-944d-46c7-8cdb-8883e4ecc3fa admin admin] PATH_INFO: `/v3/projects/b434769bf888429d9c70cf9e021b06f2/users/6cf76cb0ba32427fabff64e2190a7d2b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:46.181970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3654b0-944d-46c7-8cdb-8883e4ecc3fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=b434769bf888429d9c70cf9e021b06f2, user_id=6cf76cb0ba32427fabff64e2190a7d2b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:46.193378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3654b0-944d-46c7-8cdb-8883e4ecc3fa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:46.242234 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2019/4022] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:09:46 2022] PUT /identity/v3/projects/b434769bf888429d9c70cf9e021b06f2/users/6cf76cb0ba32427fabff64e2190a7d2b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:46.245139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342f8ce-c9db-4628-ba8d-866c84b22eee None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:46.245458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342f8ce-c9db-4628-ba8d-866c84b22eee None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:46.246814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f342f8ce-c9db-4628-ba8d-866c84b22eee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:46.301736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f342f8ce-c9db-4628-ba8d-866c84b22eee None None] MFA Rules not processed for user `6cf76cb0ba32427fabff64e2190a7d2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:46.303068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f342f8ce-c9db-4628-ba8d-866c84b22eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:46.455031 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2004/4023] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:46 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:46.484359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3654b0-944d-46c7-8cdb-8883e4ecc3fa admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:46.486955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e3654b0-944d-46c7-8cdb-8883e4ecc3fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:46.658128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3654b0-944d-46c7-8cdb-8883e4ecc3fa admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:46.669103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f36e962-cbdc-4d1e-9f14-ec00a19fc076 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:46.669912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36e962-cbdc-4d1e-9f14-ec00a19fc076 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:46.670199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36e962-cbdc-4d1e-9f14-ec00a19fc076 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:46.670470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f36e962-cbdc-4d1e-9f14-ec00a19fc076 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:46.671674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342f8ce-c9db-4628-ba8d-866c84b22eee None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:46.674215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f342f8ce-c9db-4628-ba8d-866c84b22eee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:46.697326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36e962-cbdc-4d1e-9f14-ec00a19fc076 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:46.699464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f36e962-cbdc-4d1e-9f14-ec00a19fc076 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:46.742874 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2020/4024] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:46.789745 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:46.872515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f342f8ce-c9db-4628-ba8d-866c84b22eee None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:46.889709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:46.890432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:46.890768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:46.891034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] PATH_INFO: `/v3/projects/618a2425e6cd4c0cb64f25f6fe99f778` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:46.893166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=618a2425e6cd4c0cb64f25f6fe99f778)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:46.898870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:47.034153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '618a2425e6cd4c0cb64f25f6fe99f778', 'request_id': 'req-d68e0a48-2b07-4cbc-a156-410e96217f19'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:47.053685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '618a2425e6cd4c0cb64f25f6fe99f778', 'request_id': 'req-d68e0a48-2b07-4cbc-a156-410e96217f19'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:47.072595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '618a2425e6cd4c0cb64f25f6fe99f778', 'request_id': 'req-d68e0a48-2b07-4cbc-a156-410e96217f19'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:47.119200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] The token cache is being invalidate because project 618a2425e6cd4c0cb64f25f6fe99f778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:09:47.120127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:47.121110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d68e0a48-2b07-4cbc-a156-410e96217f19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:09:47.123145 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2005/4025] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:09:46 2022] DELETE /identity/v3/projects/618a2425e6cd4c0cb64f25f6fe99f778 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:09:47.130207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d28db-3f81-41e9-884d-6fb5b1332014 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:47.130784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d28db-3f81-41e9-884d-6fb5b1332014 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:47.131196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7d28db-3f81-41e9-884d-6fb5b1332014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:47.168059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6f7d28db-3f81-41e9-884d-6fb5b1332014 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:47.169533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6f7d28db-3f81-41e9-884d-6fb5b1332014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:47.309801 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:47.353398 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2021/4026] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:47.361604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dcc1b-768e-4759-b706-d2189e19266c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:47.361893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dcc1b-768e-4759-b706-d2189e19266c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:47.362200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49dcc1b-768e-4759-b706-d2189e19266c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:47.411476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a49dcc1b-768e-4759-b706-d2189e19266c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:47.412748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a49dcc1b-768e-4759-b706-d2189e19266c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:47.434807 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2006/4027] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:47.438897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d28db-3f81-41e9-884d-6fb5b1332014 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:47.453928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7d28db-3f81-41e9-884d-6fb5b1332014 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:47.467968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4454e7-661f-40f1-8c61-687f26f37b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:47.468677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4454e7-661f-40f1-8c61-687f26f37b20 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:47.468961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4454e7-661f-40f1-8c61-687f26f37b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:47.469241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4454e7-661f-40f1-8c61-687f26f37b20 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:47.469929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4454e7-661f-40f1-8c61-687f26f37b20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:09:47.470234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4454e7-661f-40f1-8c61-687f26f37b20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:47.471886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4454e7-661f-40f1-8c61-687f26f37b20 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:47.502856 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2022/4028] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:09:47.506409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dcc1b-768e-4759-b706-d2189e19266c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:47.518898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49dcc1b-768e-4759-b706-d2189e19266c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:47.532648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc14e26-535e-486f-8cac-0a87f426fcb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:47.533331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc14e26-535e-486f-8cac-0a87f426fcb7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:47.533612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc14e26-535e-486f-8cac-0a87f426fcb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:47.533885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc14e26-535e-486f-8cac-0a87f426fcb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:47.534581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc14e26-535e-486f-8cac-0a87f426fcb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:47.538820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc14e26-535e-486f-8cac-0a87f426fcb7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:47.595050 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2007/4029] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:09:47 2022] POST /identity/v3/projects => generated 377 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:47.599768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4454e7-661f-40f1-8c61-687f26f37b20 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:47.615692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4454e7-661f-40f1-8c61-687f26f37b20 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:47.786084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2e51-54e0-402e-87bc-56baf69e820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:47.786762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2e51-54e0-402e-87bc-56baf69e820f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:47.787257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2e51-54e0-402e-87bc-56baf69e820f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:47.787719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad2e51-54e0-402e-87bc-56baf69e820f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:47.788894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad2e51-54e0-402e-87bc-56baf69e820f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:47.792853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad2e51-54e0-402e-87bc-56baf69e820f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:47.843253 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2023/4030] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:09:47 2022] POST /identity/v3/users => generated 289 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:09:47.844568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc14e26-535e-486f-8cac-0a87f426fcb7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:47.859627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc14e26-535e-486f-8cac-0a87f426fcb7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:47.902427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d564ad2-a22c-4c63-8f8b-0ab9af7c7041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:47.903502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d564ad2-a22c-4c63-8f8b-0ab9af7c7041 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:47.906916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d564ad2-a22c-4c63-8f8b-0ab9af7c7041 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:47.907413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d564ad2-a22c-4c63-8f8b-0ab9af7c7041 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:47.908238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d564ad2-a22c-4c63-8f8b-0ab9af7c7041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:47.916842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d564ad2-a22c-4c63-8f8b-0ab9af7c7041 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:47.942708 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2008/4031] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:47.946637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2e51-54e0-402e-87bc-56baf69e820f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:47.959592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad2e51-54e0-402e-87bc-56baf69e820f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:47.987455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539659b6-0f3a-4368-be43-d4618a53e253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:47.988448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539659b6-0f3a-4368-be43-d4618a53e253 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:47.995143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539659b6-0f3a-4368-be43-d4618a53e253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:47.995728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539659b6-0f3a-4368-be43-d4618a53e253 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:47.999299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539659b6-0f3a-4368-be43-d4618a53e253 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:48.003726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539659b6-0f3a-4368-be43-d4618a53e253 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:48.042667 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2024/4032] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:09:48.046418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d564ad2-a22c-4c63-8f8b-0ab9af7c7041 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:48.071891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d564ad2-a22c-4c63-8f8b-0ab9af7c7041 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:48.085658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c0ef9-5717-4870-9cf9-2811e4292737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:48.086731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c0ef9-5717-4870-9cf9-2811e4292737 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:48.087222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c0ef9-5717-4870-9cf9-2811e4292737 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:48.087707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c0ef9-5717-4870-9cf9-2811e4292737 admin admin] PATH_INFO: `/v3/projects/d6c4858fe89d4bfb8b989aa476a58a84/users/d271cce474064255b276e240e88bbe0c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:48.126964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c0ef9-5717-4870-9cf9-2811e4292737 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6c4858fe89d4bfb8b989aa476a58a84, user_id=d271cce474064255b276e240e88bbe0c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:48.133088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c0ef9-5717-4870-9cf9-2811e4292737 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:48.160483 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2009/4033] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:09:48 2022] PUT /identity/v3/projects/d6c4858fe89d4bfb8b989aa476a58a84/users/d271cce474064255b276e240e88bbe0c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:09:48.165442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40d8f7-75f8-4cee-8ce5-99a7c7f551f5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:48.165748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40d8f7-75f8-4cee-8ce5-99a7c7f551f5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:48.166084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f40d8f7-75f8-4cee-8ce5-99a7c7f551f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:48.205386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7f40d8f7-75f8-4cee-8ce5-99a7c7f551f5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:48.207881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7f40d8f7-75f8-4cee-8ce5-99a7c7f551f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:48.332496 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2025/4034] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:48.357735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c0ef9-5717-4870-9cf9-2811e4292737 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:09:48.359842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d32c0ef9-5717-4870-9cf9-2811e4292737 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:48.484981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c0ef9-5717-4870-9cf9-2811e4292737 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:09:48.490939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4144-254c-4204-a67e-49990a772f76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:09:48.492144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4144-254c-4204-a67e-49990a772f76 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:48.493326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4144-254c-4204-a67e-49990a772f76 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:48.496066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaf4144-254c-4204-a67e-49990a772f76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:48.512593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf4144-254c-4204-a67e-49990a772f76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:09:48.515141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaf4144-254c-4204-a67e-49990a772f76 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:09:48.534185 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2010/4035] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:09:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:09:48.713064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430448-6979-45b6-aafe-c7134ed29c08 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:09:48.714575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430448-6979-45b6-aafe-c7134ed29c08 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:09:48.715052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb430448-6979-45b6-aafe-c7134ed29c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:09:48.746588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bb430448-6979-45b6-aafe-c7134ed29c08 None None] MFA Rules not processed for user `abd944e891194ac498c21b55da9cb581`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:09:48.748042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb430448-6979-45b6-aafe-c7134ed29c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:09:48.814901 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:48.841400 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2026/4036] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:09:48 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:09:58.528437 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:09:58.829672 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:05.371223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4144-254c-4204-a67e-49990a772f76 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:05.373983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7eaf4144-254c-4204-a67e-49990a772f76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:05.394916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaf4144-254c-4204-a67e-49990a772f76 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:05.406232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04718662-338c-4a68-b377-63cd3bc78598 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:05.406856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718662-338c-4a68-b377-63cd3bc78598 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:05.407139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718662-338c-4a68-b377-63cd3bc78598 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:05.407416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04718662-338c-4a68-b377-63cd3bc78598 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:05.409755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-04718662-338c-4a68-b377-63cd3bc78598 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:05.442296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04718662-338c-4a68-b377-63cd3bc78598 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:05.445337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04718662-338c-4a68-b377-63cd3bc78598 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:05.474493 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2011/4037] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:10:09.763494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e87b7-80c7-4540-a5fa-8c9fcbcfc432 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:09.763955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e87b7-80c7-4540-a5fa-8c9fcbcfc432 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:09.764044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105e87b7-80c7-4540-a5fa-8c9fcbcfc432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:09.828215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-105e87b7-80c7-4540-a5fa-8c9fcbcfc432 None None] MFA Rules not processed for user `d271cce474064255b276e240e88bbe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:09.830916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-105e87b7-80c7-4540-a5fa-8c9fcbcfc432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:09.967644 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2027/4038] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:09.977896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b4f8f-56a7-4bf9-a16e-60006be77098 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:09.979097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b4f8f-56a7-4bf9-a16e-60006be77098 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:09.979531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b4f8f-56a7-4bf9-a16e-60006be77098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:10.016805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bc0b4f8f-56a7-4bf9-a16e-60006be77098 None None] MFA Rules not processed for user `d271cce474064255b276e240e88bbe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:10.021959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bc0b4f8f-56a7-4bf9-a16e-60006be77098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:10.041088 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2012/4039] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:10.060038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e87b7-80c7-4540-a5fa-8c9fcbcfc432 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:10.061576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-105e87b7-80c7-4540-a5fa-8c9fcbcfc432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:10.211628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105e87b7-80c7-4540-a5fa-8c9fcbcfc432 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:10.227120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b5ded-1723-43a4-b5d0-420f17960f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:10.228337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5ded-1723-43a4-b5d0-420f17960f48 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:10.228682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5ded-1723-43a4-b5d0-420f17960f48 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:10.229001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173b5ded-1723-43a4-b5d0-420f17960f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:10.252528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b5ded-1723-43a4-b5d0-420f17960f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:10.254201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173b5ded-1723-43a4-b5d0-420f17960f48 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:10.281734 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2028/4040] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:10 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:10:14.828471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b4179-374b-4e48-b309-56a26dfa7461 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:14.829478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b4179-374b-4e48-b309-56a26dfa7461 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:14.829894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b4179-374b-4e48-b309-56a26dfa7461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:14.908196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-102b4179-374b-4e48-b309-56a26dfa7461 None None] MFA Rules not processed for user `c703cc73a22749858ffe05500e52aa03`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:14.920691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-102b4179-374b-4e48-b309-56a26dfa7461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:15.087693 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2013/4041] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:14 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:15.933571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b5ded-1723-43a4-b5d0-420f17960f48 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:15.935119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-173b5ded-1723-43a4-b5d0-420f17960f48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:15.962677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173b5ded-1723-43a4-b5d0-420f17960f48 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:15.972585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:15.977400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:15.977726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:15.978144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] PATH_INFO: `/v3/users/a943f2c455934d74a696c209c0c46ae0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:15.979944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a943f2c455934d74a696c209c0c46ae0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:15.989382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:16.092431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a943f2c455934d74a696c209c0c46ae0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:16.107869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a943f2c455934d74a696c209c0c46ae0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:16.109634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a943f2c455934d74a696c209c0c46ae0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:16.115719 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:16.123520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a943f2c455934d74a696c209c0c46ae0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:16.134218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a943f2c455934d74a696c209c0c46ae0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:16.145844 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2029/4042] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:10:15 2022] DELETE /identity/v3/users/a943f2c455934d74a696c209c0c46ae0 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:16.147394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228896b0-8d5b-40c9-b143-d47282ea23e3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:16.147862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228896b0-8d5b-40c9-b143-d47282ea23e3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:16.147940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228896b0-8d5b-40c9-b143-d47282ea23e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:16.190544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-228896b0-8d5b-40c9-b143-d47282ea23e3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:16.192256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-228896b0-8d5b-40c9-b143-d47282ea23e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:16.332300 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2014/4043] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:16.369218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:16.371626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:16.490431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b5641-9a05-4c4e-bb7c-8855bd54db04 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:16.502559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61969f1f-66ec-4a85-8602-7a9817204ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:16.503309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61969f1f-66ec-4a85-8602-7a9817204ecb service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:16.503694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61969f1f-66ec-4a85-8602-7a9817204ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:16.504074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61969f1f-66ec-4a85-8602-7a9817204ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:16.526254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61969f1f-66ec-4a85-8602-7a9817204ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:16.529101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61969f1f-66ec-4a85-8602-7a9817204ecb service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:16.547221 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2030/4044] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:10:17.390755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228896b0-8d5b-40c9-b143-d47282ea23e3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:17.392774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-228896b0-8d5b-40c9-b143-d47282ea23e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:17.440966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228896b0-8d5b-40c9-b143-d47282ea23e3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:17.453649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:17.456305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:17.459175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:17.460273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] PATH_INFO: `/v3/projects/1449a35c24254626bbe1449feb02e9f8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:17.469637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1449a35c24254626bbe1449feb02e9f8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:17.474411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:17.588268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1449a35c24254626bbe1449feb02e9f8', 'request_id': 'req-b7886751-3111-48fc-8d29-10ffc309ffcb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:17.599620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1449a35c24254626bbe1449feb02e9f8', 'request_id': 'req-b7886751-3111-48fc-8d29-10ffc309ffcb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:17.622859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1449a35c24254626bbe1449feb02e9f8', 'request_id': 'req-b7886751-3111-48fc-8d29-10ffc309ffcb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:17.646905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] The token cache is being invalidate because project 1449a35c24254626bbe1449feb02e9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:10:17.647225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:17.648338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:17.651488 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2015/4045] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:17 2022] DELETE /identity/v3/projects/1449a35c24254626bbe1449feb02e9f8 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:17.656205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61969f1f-66ec-4a85-8602-7a9817204ecb service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:17.677640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61969f1f-66ec-4a85-8602-7a9817204ecb service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:17.821677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:17.823697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:17.824265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:17.824911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] PATH_INFO: `/v3/users/7a9adcee37504b19831383df6857d8e0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:17.830209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a9adcee37504b19831383df6857d8e0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:17.832661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:17.965244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a9adcee37504b19831383df6857d8e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:17.982318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a9adcee37504b19831383df6857d8e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:17.983206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a9adcee37504b19831383df6857d8e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:17.992789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a9adcee37504b19831383df6857d8e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:18.004211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd30752d-754d-43f6-9199-824e09bc6b8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a9adcee37504b19831383df6857d8e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:18.013011 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2031/4046] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:10:17 2022] DELETE /identity/v3/users/7a9adcee37504b19831383df6857d8e0 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:18.516554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:18.519353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:18.546177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7886751-3111-48fc-8d29-10ffc309ffcb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:18.556003 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:18.654078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:18.655205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:18.655863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:18.656298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] PATH_INFO: `/v3/projects/d965fa6eb4064e40a0343400959d1b83` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:18.657948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d965fa6eb4064e40a0343400959d1b83)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:18.661909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:18.728330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd965fa6eb4064e40a0343400959d1b83', 'request_id': 'req-524b004e-8657-4a28-8ed9-7074f088b732'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:18.737662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd965fa6eb4064e40a0343400959d1b83', 'request_id': 'req-524b004e-8657-4a28-8ed9-7074f088b732'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:18.751148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd965fa6eb4064e40a0343400959d1b83', 'request_id': 'req-524b004e-8657-4a28-8ed9-7074f088b732'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:18.785536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] The token cache is being invalidate because project d965fa6eb4064e40a0343400959d1b83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:10:18.786900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:18.787750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-524b004e-8657-4a28-8ed9-7074f088b732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:18.789805 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2016/4047] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:18 2022] DELETE /identity/v3/projects/d965fa6eb4064e40a0343400959d1b83 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:18.795032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcc460-565d-4bd0-91b4-6351d184bddb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:18.795497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcc460-565d-4bd0-91b4-6351d184bddb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:18.795585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bcc460-565d-4bd0-91b4-6351d184bddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:18.826196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-54bcc460-565d-4bd0-91b4-6351d184bddb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:18.827592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-54bcc460-565d-4bd0-91b4-6351d184bddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:18.832886 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:18.953517 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2032/4048] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:18.955107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d43c-67f7-40b7-a532-080c3193c0be None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:18.955403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d43c-67f7-40b7-a532-080c3193c0be None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:18.955678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8d43c-67f7-40b7-a532-080c3193c0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:18.989436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-31e8d43c-67f7-40b7-a532-080c3193c0be None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:18.991920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31e8d43c-67f7-40b7-a532-080c3193c0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:19.003237 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2017/4049] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:19.008298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcc460-565d-4bd0-91b4-6351d184bddb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:19.021318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bcc460-565d-4bd0-91b4-6351d184bddb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:19.027262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef51f1f-fee8-4184-bd86-e33bcce6b785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:19.028265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51f1f-fee8-4184-bd86-e33bcce6b785 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:19.028629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51f1f-fee8-4184-bd86-e33bcce6b785 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:19.029201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef51f1f-fee8-4184-bd86-e33bcce6b785 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:19.029979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef51f1f-fee8-4184-bd86-e33bcce6b785 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:10:19.030364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef51f1f-fee8-4184-bd86-e33bcce6b785 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:19.033201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef51f1f-fee8-4184-bd86-e33bcce6b785 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:19.051784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d43c-67f7-40b7-a532-080c3193c0be None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:19.063324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8d43c-67f7-40b7-a532-080c3193c0be None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:19.063873 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2033/4050] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:10:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:10:19.068950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac957-0343-4135-805a-c4e1d1e17da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:19.069613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac957-0343-4135-805a-c4e1d1e17da6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:19.070200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac957-0343-4135-805a-c4e1d1e17da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:19.070486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cac957-0343-4135-805a-c4e1d1e17da6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:19.072223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cac957-0343-4135-805a-c4e1d1e17da6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:19.074442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cac957-0343-4135-805a-c4e1d1e17da6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:19.141022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef51f1f-fee8-4184-bd86-e33bcce6b785 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:19.150824 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2018/4051] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:10:19 2022] POST /identity/v3/projects => generated 381 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:10:19.156595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef51f1f-fee8-4184-bd86-e33bcce6b785 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:19.244627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cd5f2-27c5-4aa5-a5b8-88fc08af2aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:19.245556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cd5f2-27c5-4aa5-a5b8-88fc08af2aa2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:19.245977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cd5f2-27c5-4aa5-a5b8-88fc08af2aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:19.246371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537cd5f2-27c5-4aa5-a5b8-88fc08af2aa2 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:19.247140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cd5f2-27c5-4aa5-a5b8-88fc08af2aa2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:19.250726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537cd5f2-27c5-4aa5-a5b8-88fc08af2aa2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:19.292132 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2034/4052] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:10:19 2022] POST /identity/v3/users => generated 291 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:10:19.294463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac957-0343-4135-805a-c4e1d1e17da6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:19.311526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cac957-0343-4135-805a-c4e1d1e17da6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:19.320072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae0dc5-fa37-4f7d-b164-a83b65f7fc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:19.320747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae0dc5-fa37-4f7d-b164-a83b65f7fc74 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:19.321132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae0dc5-fa37-4f7d-b164-a83b65f7fc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:19.321608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ae0dc5-fa37-4f7d-b164-a83b65f7fc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:19.322895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae0dc5-fa37-4f7d-b164-a83b65f7fc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:19.324947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ae0dc5-fa37-4f7d-b164-a83b65f7fc74 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:19.343650 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2019/4053] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:10:19.347486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cd5f2-27c5-4aa5-a5b8-88fc08af2aa2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:19.366138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537cd5f2-27c5-4aa5-a5b8-88fc08af2aa2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:19.368339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff0a00-694d-4653-b23c-d181a8245414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:19.369511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff0a00-694d-4653-b23c-d181a8245414 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:19.369511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff0a00-694d-4653-b23c-d181a8245414 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:19.369725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff0a00-694d-4653-b23c-d181a8245414 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:19.370526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff0a00-694d-4653-b23c-d181a8245414 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:19.372442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff0a00-694d-4653-b23c-d181a8245414 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:19.397554 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2035/4054] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:10:19.398780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae0dc5-fa37-4f7d-b164-a83b65f7fc74 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:19.413197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ae0dc5-fa37-4f7d-b164-a83b65f7fc74 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:19.421607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb501e-fb4e-4b6a-b8d8-37dbe6366d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:19.422380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb501e-fb4e-4b6a-b8d8-37dbe6366d57 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:19.423085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb501e-fb4e-4b6a-b8d8-37dbe6366d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:19.424031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fb501e-fb4e-4b6a-b8d8-37dbe6366d57 admin admin] PATH_INFO: `/v3/projects/062ef54f319941dda2c197b8f71d2a7e/users/af8778dae08a4ab6b012ceda5af5564e/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:19.498568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb501e-fb4e-4b6a-b8d8-37dbe6366d57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=062ef54f319941dda2c197b8f71d2a7e, user_id=af8778dae08a4ab6b012ceda5af5564e, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:19.511290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fb501e-fb4e-4b6a-b8d8-37dbe6366d57 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:19.553775 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2020/4055] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:10:19 2022] PUT /identity/v3/projects/062ef54f319941dda2c197b8f71d2a7e/users/af8778dae08a4ab6b012ceda5af5564e/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:10:19.558887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb10d1e-d63a-4b7e-a32c-0fce21379cf3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:19.559951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb10d1e-d63a-4b7e-a32c-0fce21379cf3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:19.560245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb10d1e-d63a-4b7e-a32c-0fce21379cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:19.645863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-afb10d1e-d63a-4b7e-a32c-0fce21379cf3 None None] MFA Rules not processed for user `af8778dae08a4ab6b012ceda5af5564e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:19.649597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-afb10d1e-d63a-4b7e-a32c-0fce21379cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:19.853551 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2036/4056] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:19 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:19.867874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb501e-fb4e-4b6a-b8d8-37dbe6366d57 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:19.870439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-70fb501e-fb4e-4b6a-b8d8-37dbe6366d57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:19.967922 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:20.012647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fb501e-fb4e-4b6a-b8d8-37dbe6366d57 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:20.018310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5b4b-658e-4186-8a51-2c062f0d1a39 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:20.019153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5b4b-658e-4186-8a51-2c062f0d1a39 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:20.019581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5b4b-658e-4186-8a51-2c062f0d1a39 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:20.020053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6f5b4b-658e-4186-8a51-2c062f0d1a39 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:20.064936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f5b4b-658e-4186-8a51-2c062f0d1a39 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:20.068329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6f5b4b-658e-4186-8a51-2c062f0d1a39 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:20.109820 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2021/4057] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:10:21.339610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee30719-3cff-4013-bb39-f4c9129ce035 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:21.340791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee30719-3cff-4013-bb39-f4c9129ce035 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:21.341489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee30719-3cff-4013-bb39-f4c9129ce035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:21.351505 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:21.378543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3ee30719-3cff-4013-bb39-f4c9129ce035 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:21.380200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3ee30719-3cff-4013-bb39-f4c9129ce035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:21.457811 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2037/4058] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:10:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:21.568882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5b4b-658e-4186-8a51-2c062f0d1a39 service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:21.570369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6f6f5b4b-658e-4186-8a51-2c062f0d1a39 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:21.719394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6f5b4b-658e-4186-8a51-2c062f0d1a39 service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:21.725871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbf0d8-8980-4d74-998c-b451609de8af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:21.726718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf0d8-8980-4d74-998c-b451609de8af service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:21.727184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf0d8-8980-4d74-998c-b451609de8af service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:21.727613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bbf0d8-8980-4d74-998c-b451609de8af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:21.737719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbf0d8-8980-4d74-998c-b451609de8af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:21.739571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3bbf0d8-8980-4d74-998c-b451609de8af service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:21.803484 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2022/4059] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:10:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:10:23.310819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07673d36-bc62-4a88-b452-f4f8899325f7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:23.311856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07673d36-bc62-4a88-b452-f4f8899325f7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:23.312340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07673d36-bc62-4a88-b452-f4f8899325f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:23.348181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-07673d36-bc62-4a88-b452-f4f8899325f7 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:23.350010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-07673d36-bc62-4a88-b452-f4f8899325f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:23.373485 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2038/4060] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:10:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:23.380977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbf0d8-8980-4d74-998c-b451609de8af service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:23.393606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bbf0d8-8980-4d74-998c-b451609de8af service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:23.400537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656a78-6cd3-4cf9-8fb2-59aca23b5aca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:23.401546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656a78-6cd3-4cf9-8fb2-59aca23b5aca service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:23.402025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656a78-6cd3-4cf9-8fb2-59aca23b5aca service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:23.402369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6656a78-6cd3-4cf9-8fb2-59aca23b5aca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:23.411971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656a78-6cd3-4cf9-8fb2-59aca23b5aca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:23.413747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6656a78-6cd3-4cf9-8fb2-59aca23b5aca service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:23.437656 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2023/4061] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:10:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:10:25.400021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ce2f-0933-42d5-895b-80592e086d2f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:25.401112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ce2f-0933-42d5-895b-80592e086d2f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:25.401200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5ce2f-0933-42d5-895b-80592e086d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:25.436390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e5c5ce2f-0933-42d5-895b-80592e086d2f None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:25.456851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e5c5ce2f-0933-42d5-895b-80592e086d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:25.471389 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2039/4062] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:10:25 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:25.488995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656a78-6cd3-4cf9-8fb2-59aca23b5aca service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:25.505247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6656a78-6cd3-4cf9-8fb2-59aca23b5aca service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:25.513626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33027880-c438-4d43-a4ee-7f22954c1e4f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:25.516271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33027880-c438-4d43-a4ee-7f22954c1e4f service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:25.516782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33027880-c438-4d43-a4ee-7f22954c1e4f service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:25.517273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33027880-c438-4d43-a4ee-7f22954c1e4f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:25.532897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33027880-c438-4d43-a4ee-7f22954c1e4f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:25.535021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33027880-c438-4d43-a4ee-7f22954c1e4f service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:25.559207 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2024/4063] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:10:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:10:25.992380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803e1fd-6bc4-45a9-8f22-306be19aa1fb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:25.992665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803e1fd-6bc4-45a9-8f22-306be19aa1fb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:25.992945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8803e1fd-6bc4-45a9-8f22-306be19aa1fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:26.032329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8803e1fd-6bc4-45a9-8f22-306be19aa1fb None None] MFA Rules not processed for user `af8778dae08a4ab6b012ceda5af5564e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:26.033613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8803e1fd-6bc4-45a9-8f22-306be19aa1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:26.041994 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2040/4064] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:25 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:27.553974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba387d47-4ca8-488b-be25-ca08dfa63802 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:27.554949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba387d47-4ca8-488b-be25-ca08dfa63802 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:27.555438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba387d47-4ca8-488b-be25-ca08dfa63802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:27.599485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ba387d47-4ca8-488b-be25-ca08dfa63802 None None] MFA Rules not processed for user `af8778dae08a4ab6b012ceda5af5564e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:27.600743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ba387d47-4ca8-488b-be25-ca08dfa63802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:27.620703 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2025/4065] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:31.576370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803e1fd-6bc4-45a9-8f22-306be19aa1fb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:31.580039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8803e1fd-6bc4-45a9-8f22-306be19aa1fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:31.791936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8803e1fd-6bc4-45a9-8f22-306be19aa1fb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:31.797070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:31.797761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:31.798705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:31.798999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] PATH_INFO: `/v3/users/b245555254674c8eac74a684b9da59cc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:31.800199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b245555254674c8eac74a684b9da59cc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:31.802594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:31.898854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b245555254674c8eac74a684b9da59cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:31.919013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b245555254674c8eac74a684b9da59cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:31.920381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b245555254674c8eac74a684b9da59cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:31.940913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b245555254674c8eac74a684b9da59cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:31.965898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b245555254674c8eac74a684b9da59cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:31.986655 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:31.987990 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2041/4066] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:10:31 2022] DELETE /identity/v3/users/b245555254674c8eac74a684b9da59cc => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:32.582946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba387d47-4ca8-488b-be25-ca08dfa63802 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:32.600566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba387d47-4ca8-488b-be25-ca08dfa63802 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:32.679999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:32.681482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:32.682121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:32.682787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] PATH_INFO: `/v3/projects/3c86dafe5aca46ecac15a54389270136` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:32.684720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c86dafe5aca46ecac15a54389270136)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:32.687872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:32.738298 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:32.753486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c86dafe5aca46ecac15a54389270136', 'request_id': 'req-05d64c59-9583-426f-86df-141f07faf5d1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:32.761278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c86dafe5aca46ecac15a54389270136', 'request_id': 'req-05d64c59-9583-426f-86df-141f07faf5d1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:32.771986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c86dafe5aca46ecac15a54389270136', 'request_id': 'req-05d64c59-9583-426f-86df-141f07faf5d1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:32.786368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] The token cache is being invalidate because project 3c86dafe5aca46ecac15a54389270136 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:10:32.786859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:32.787716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:32.789659 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2026/4067] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:32 2022] DELETE /identity/v3/projects/3c86dafe5aca46ecac15a54389270136 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:32.794413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:32.796483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:32.818468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e5e14b-bb41-43a6-b41c-811ab897c8f8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:32.844168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:32.846276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:32.929671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:32.930815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:32.931381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:32.932035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] PATH_INFO: `/v3/users/72840d50401e45fca15c0a521b6a1ea6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:32.965618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] RBAC: Authorizing `identity:delete_user(user_id=72840d50401e45fca15c0a521b6a1ea6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:32.969096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:33.043544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d64c59-9583-426f-86df-141f07faf5d1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:33.049790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:33.050491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:33.050779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:33.051108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] PATH_INFO: `/v3/users/5ae455a2351c4cf9a32ca68e686d27d0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:33.052463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae455a2351c4cf9a32ca68e686d27d0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:33.054757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:33.096775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72840d50401e45fca15c0a521b6a1ea6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.126813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72840d50401e45fca15c0a521b6a1ea6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.127610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72840d50401e45fca15c0a521b6a1ea6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.139610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72840d50401e45fca15c0a521b6a1ea6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.147572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae455a2351c4cf9a32ca68e686d27d0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.152377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72840d50401e45fca15c0a521b6a1ea6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.161690 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2042/4068] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:10:32 2022] DELETE /identity/v3/users/72840d50401e45fca15c0a521b6a1ea6 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:33.171303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae455a2351c4cf9a32ca68e686d27d0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.172134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae455a2351c4cf9a32ca68e686d27d0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.188895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae455a2351c4cf9a32ca68e686d27d0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.198712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd75da6d-81c7-4f83-8666-2a811fe70370 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae455a2351c4cf9a32ca68e686d27d0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:33.205421 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2027/4069] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:10:32 2022] DELETE /identity/v3/users/5ae455a2351c4cf9a32ca68e686d27d0 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:10:33.742238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:33.744774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:33.855681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7631704-cce3-41e4-8dd9-8e2d199bf47c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:33.873751 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:33.933504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:33.934164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:33.934445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:33.934722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] PATH_INFO: `/v3/projects/82888bc2bd7c40dcbae68a5e4fa6c4f2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:33.935900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82888bc2bd7c40dcbae68a5e4fa6c4f2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:33.937912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:33.994927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'request_id': 'req-55c47c88-ae1f-4dd5-a028-10bc32bf9983'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.002659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'request_id': 'req-55c47c88-ae1f-4dd5-a028-10bc32bf9983'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.010738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82888bc2bd7c40dcbae68a5e4fa6c4f2', 'request_id': 'req-55c47c88-ae1f-4dd5-a028-10bc32bf9983'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.021666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] The token cache is being invalidate because project 82888bc2bd7c40dcbae68a5e4fa6c4f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:10:34.021957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.022653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55c47c88-ae1f-4dd5-a028-10bc32bf9983 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.024259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2043/4070] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:33 2022] DELETE /identity/v3/projects/82888bc2bd7c40dcbae68a5e4fa6c4f2 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:34.031043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119824d-b833-4b0a-a0c6-2131db48128d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.031596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119824d-b833-4b0a-a0c6-2131db48128d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.031794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119824d-b833-4b0a-a0c6-2131db48128d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.054217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0119824d-b833-4b0a-a0c6-2131db48128d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:34.055451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0119824d-b833-4b0a-a0c6-2131db48128d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:34.099140 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:34.122129 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2028/4071] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:10:34.130503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd4f0f-400e-49fd-8217-3d36b3b216d5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.130791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd4f0f-400e-49fd-8217-3d36b3b216d5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.131068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cd4f0f-400e-49fd-8217-3d36b3b216d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.152698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a1cd4f0f-400e-49fd-8217-3d36b3b216d5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:34.153963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a1cd4f0f-400e-49fd-8217-3d36b3b216d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:34.162123 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2044/4072] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:34.166291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119824d-b833-4b0a-a0c6-2131db48128d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:34.176090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119824d-b833-4b0a-a0c6-2131db48128d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:34.180611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101c5b5-d938-4893-a31c-f0f85b436086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:34.181776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101c5b5-d938-4893-a31c-f0f85b436086 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.182057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101c5b5-d938-4893-a31c-f0f85b436086 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.182329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6101c5b5-d938-4893-a31c-f0f85b436086 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.182997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101c5b5-d938-4893-a31c-f0f85b436086 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:10:34.183312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101c5b5-d938-4893-a31c-f0f85b436086 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:34.184889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6101c5b5-d938-4893-a31c-f0f85b436086 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:34.197490 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2029/4073] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:10:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:10:34.201811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd4f0f-400e-49fd-8217-3d36b3b216d5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:34.211306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cd4f0f-400e-49fd-8217-3d36b3b216d5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:34.216149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954448a4-06fe-4a31-8e9b-77f7d7b071ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:34.216868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954448a4-06fe-4a31-8e9b-77f7d7b071ee admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.217150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954448a4-06fe-4a31-8e9b-77f7d7b071ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.217458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954448a4-06fe-4a31-8e9b-77f7d7b071ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.218087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954448a4-06fe-4a31-8e9b-77f7d7b071ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:34.219992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954448a4-06fe-4a31-8e9b-77f7d7b071ee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:34.253035 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2045/4074] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:10:34 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:10:34.254282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101c5b5-d938-4893-a31c-f0f85b436086 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:34.266586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6101c5b5-d938-4893-a31c-f0f85b436086 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:34.343598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51978add-c1fd-4ce8-93a6-ae18ee4784fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:34.344254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51978add-c1fd-4ce8-93a6-ae18ee4784fa admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.345154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51978add-c1fd-4ce8-93a6-ae18ee4784fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.345928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51978add-c1fd-4ce8-93a6-ae18ee4784fa admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.346594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51978add-c1fd-4ce8-93a6-ae18ee4784fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:34.352263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51978add-c1fd-4ce8-93a6-ae18ee4784fa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:34.382641 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2030/4075] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:10:34 2022] POST /identity/v3/users => generated 293 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:10:34.386533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954448a4-06fe-4a31-8e9b-77f7d7b071ee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:34.403561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954448a4-06fe-4a31-8e9b-77f7d7b071ee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:34.409029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2eb60-a24e-4458-aba3-73e5e02a2236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:34.409772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2eb60-a24e-4458-aba3-73e5e02a2236 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.410339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2eb60-a24e-4458-aba3-73e5e02a2236 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.410452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2eb60-a24e-4458-aba3-73e5e02a2236 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.411242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2eb60-a24e-4458-aba3-73e5e02a2236 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:34.413220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d2eb60-a24e-4458-aba3-73e5e02a2236 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:34.436780 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2046/4076] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:10:34.438177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51978add-c1fd-4ce8-93a6-ae18ee4784fa admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:34.468733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51978add-c1fd-4ce8-93a6-ae18ee4784fa admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:34.484566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcab27-a3dc-459b-b520-f7f58c815a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:34.485559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcab27-a3dc-459b-b520-f7f58c815a63 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.486031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcab27-a3dc-459b-b520-f7f58c815a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.486608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffcab27-a3dc-459b-b520-f7f58c815a63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.488212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcab27-a3dc-459b-b520-f7f58c815a63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:34.490331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffcab27-a3dc-459b-b520-f7f58c815a63 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:34.492689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2eb60-a24e-4458-aba3-73e5e02a2236 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:34.495168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4d2eb60-a24e-4458-aba3-73e5e02a2236 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:34.523685 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2031/4077] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:10:34 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:10:34.525017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcab27-a3dc-459b-b520-f7f58c815a63 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:34.527189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d2eb60-a24e-4458-aba3-73e5e02a2236 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:34.537248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:34.537935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.538222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.538503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] PATH_INFO: `/v3/projects/a11faf4fdc2e47faab6c0f0b0df5858c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.559160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffcab27-a3dc-459b-b520-f7f58c815a63 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:34.582666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a11faf4fdc2e47faab6c0f0b0df5858c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:34.583907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637614c7-06b2-4132-9cd2-204b60c2406f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:34.584594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637614c7-06b2-4132-9cd2-204b60c2406f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.584882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637614c7-06b2-4132-9cd2-204b60c2406f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.585159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637614c7-06b2-4132-9cd2-204b60c2406f admin admin] PATH_INFO: `/v3/projects/e4098b77de8d4b07853cf61416c0b870/users/a170d67efe094c4e8b9267e33e4e476d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.588780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:34.617189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637614c7-06b2-4132-9cd2-204b60c2406f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4098b77de8d4b07853cf61416c0b870, user_id=a170d67efe094c4e8b9267e33e4e476d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:34.620561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637614c7-06b2-4132-9cd2-204b60c2406f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:34.673437 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2032/4078] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:10:34 2022] PUT /identity/v3/projects/e4098b77de8d4b07853cf61416c0b870/users/a170d67efe094c4e8b9267e33e4e476d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:34.679380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871a3d-2f77-48ad-817b-2ae201fc2523 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.679380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871a3d-2f77-48ad-817b-2ae201fc2523 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.679380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed871a3d-2f77-48ad-817b-2ae201fc2523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.719756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a11faf4fdc2e47faab6c0f0b0df5858c', 'request_id': 'req-e400de5d-3ff1-48ad-9a3c-41ba79f33320'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.726703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ed871a3d-2f77-48ad-817b-2ae201fc2523 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:34.729320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ed871a3d-2f77-48ad-817b-2ae201fc2523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:34.737118 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:34.747347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a11faf4fdc2e47faab6c0f0b0df5858c', 'request_id': 'req-e400de5d-3ff1-48ad-9a3c-41ba79f33320'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.759753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a11faf4fdc2e47faab6c0f0b0df5858c', 'request_id': 'req-e400de5d-3ff1-48ad-9a3c-41ba79f33320'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.783353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] The token cache is being invalidate because project a11faf4fdc2e47faab6c0f0b0df5858c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:10:34.783628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.784717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e400de5d-3ff1-48ad-9a3c-41ba79f33320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:10:34.798907 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2047/4079] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:10:34 2022] DELETE /identity/v3/projects/a11faf4fdc2e47faab6c0f0b0df5858c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:10:34.804146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4a47-71c7-4027-940e-04485855438b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:34.804419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4a47-71c7-4027-940e-04485855438b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:34.808386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d4a47-71c7-4027-940e-04485855438b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:34.876195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a38d4a47-71c7-4027-940e-04485855438b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:34.880991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a38d4a47-71c7-4027-940e-04485855438b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:34.922753 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2033/4080] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:34.953329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed871a3d-2f77-48ad-817b-2ae201fc2523 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:34.955472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ed871a3d-2f77-48ad-817b-2ae201fc2523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:35.043147 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2048/4081] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:35.062090 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:35.069469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e86ab-df24-44bb-a53b-bff9cc2f6ef6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.071121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e86ab-df24-44bb-a53b-bff9cc2f6ef6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.071592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4e86ab-df24-44bb-a53b-bff9cc2f6ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.121700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed871a3d-2f77-48ad-817b-2ae201fc2523 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:35.125385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5b4e86ab-df24-44bb-a53b-bff9cc2f6ef6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:35.127299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c65b-0844-4693-93d1-abf5e89b18e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:35.128147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c65b-0844-4693-93d1-abf5e89b18e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.128589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c65b-0844-4693-93d1-abf5e89b18e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.129045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5768c65b-0844-4693-93d1-abf5e89b18e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.129179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5b4e86ab-df24-44bb-a53b-bff9cc2f6ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:35.141955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768c65b-0844-4693-93d1-abf5e89b18e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:35.143929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5768c65b-0844-4693-93d1-abf5e89b18e8 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:35.156666 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2049/4082] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:35.157806 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2034/4083] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:10:35.161062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e86ab-df24-44bb-a53b-bff9cc2f6ef6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:35.178092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4e86ab-df24-44bb-a53b-bff9cc2f6ef6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:35.190148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef7065-908d-44fc-abf4-96bf0a56818c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:35.190788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef7065-908d-44fc-abf4-96bf0a56818c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.191062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef7065-908d-44fc-abf4-96bf0a56818c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.191333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ef7065-908d-44fc-abf4-96bf0a56818c admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.192164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef7065-908d-44fc-abf4-96bf0a56818c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:10:35.192618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef7065-908d-44fc-abf4-96bf0a56818c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:35.194461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ef7065-908d-44fc-abf4-96bf0a56818c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:35.211776 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2050/4084] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:10:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:10:35.216202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c65b-0844-4693-93d1-abf5e89b18e8 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:35.231810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5768c65b-0844-4693-93d1-abf5e89b18e8 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:35.238871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245c78-3b48-43b9-89b8-f77ce3c8d12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:35.240577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245c78-3b48-43b9-89b8-f77ce3c8d12b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.241470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245c78-3b48-43b9-89b8-f77ce3c8d12b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.241974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2245c78-3b48-43b9-89b8-f77ce3c8d12b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.242787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2245c78-3b48-43b9-89b8-f77ce3c8d12b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:35.246090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2245c78-3b48-43b9-89b8-f77ce3c8d12b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:35.299195 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2035/4085] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:10:35 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:10:35.303209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef7065-908d-44fc-abf4-96bf0a56818c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:35.316257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ef7065-908d-44fc-abf4-96bf0a56818c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:35.391818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89aaa1-246c-48cb-9488-24529fc30b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:35.392712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89aaa1-246c-48cb-9488-24529fc30b6f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.393003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89aaa1-246c-48cb-9488-24529fc30b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.393371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c89aaa1-246c-48cb-9488-24529fc30b6f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.394349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89aaa1-246c-48cb-9488-24529fc30b6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:35.396660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c89aaa1-246c-48cb-9488-24529fc30b6f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:35.424983 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2051/4086] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:10:35 2022] POST /identity/v3/users => generated 290 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:10:35.426415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245c78-3b48-43b9-89b8-f77ce3c8d12b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:35.438059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2245c78-3b48-43b9-89b8-f77ce3c8d12b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:35.445085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a40196-d8c0-4650-b9c1-c1e67a593b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:35.445527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a40196-d8c0-4650-b9c1-c1e67a593b48 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.445803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a40196-d8c0-4650-b9c1-c1e67a593b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.446069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a40196-d8c0-4650-b9c1-c1e67a593b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.446712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a40196-d8c0-4650-b9c1-c1e67a593b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:35.448842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a40196-d8c0-4650-b9c1-c1e67a593b48 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:35.477389 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2036/4087] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:10:35.482111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89aaa1-246c-48cb-9488-24529fc30b6f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:35.496467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c89aaa1-246c-48cb-9488-24529fc30b6f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:35.509933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557c7223-905e-4096-8dad-490421a57a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:35.510701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c7223-905e-4096-8dad-490421a57a21 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.510998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c7223-905e-4096-8dad-490421a57a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.513329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557c7223-905e-4096-8dad-490421a57a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.513329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c7223-905e-4096-8dad-490421a57a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:35.517946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557c7223-905e-4096-8dad-490421a57a21 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:35.542044 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2052/4088] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:10:35 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:10:35.546927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a40196-d8c0-4650-b9c1-c1e67a593b48 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:35.559268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a40196-d8c0-4650-b9c1-c1e67a593b48 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:35.564863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a636193-3729-4d59-abbf-dac69b52ab34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:35.565671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a636193-3729-4d59-abbf-dac69b52ab34 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.566020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a636193-3729-4d59-abbf-dac69b52ab34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.566364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a636193-3729-4d59-abbf-dac69b52ab34 admin admin] PATH_INFO: `/v3/projects/a1021217d2904d5190dd4a82db7007fd/users/af9c3d9be3f2494a8eb2394e48bdeca6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.584296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a636193-3729-4d59-abbf-dac69b52ab34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1021217d2904d5190dd4a82db7007fd, user_id=af9c3d9be3f2494a8eb2394e48bdeca6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:35.587352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a636193-3729-4d59-abbf-dac69b52ab34 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:35.608668 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2037/4089] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:10:35 2022] PUT /identity/v3/projects/a1021217d2904d5190dd4a82db7007fd/users/af9c3d9be3f2494a8eb2394e48bdeca6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:10:35.613717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4706a-1812-4251-bc1e-c063aa2b0d4a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.614269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4706a-1812-4251-bc1e-c063aa2b0d4a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.614810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4706a-1812-4251-bc1e-c063aa2b0d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.647308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d2a4706a-1812-4251-bc1e-c063aa2b0d4a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:35.648694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d2a4706a-1812-4251-bc1e-c063aa2b0d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:35.737025 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:35.823688 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2053/4090] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:35.857528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a636193-3729-4d59-abbf-dac69b52ab34 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:35.859964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5a636193-3729-4d59-abbf-dac69b52ab34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:35.946621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a636193-3729-4d59-abbf-dac69b52ab34 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:35.951507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a9b81-db2b-44a2-9964-4f626fdb206d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:35.953707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a9b81-db2b-44a2-9964-4f626fdb206d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:35.954155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a9b81-db2b-44a2-9964-4f626fdb206d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:35.954589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-559a9b81-db2b-44a2-9964-4f626fdb206d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:35.967877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a9b81-db2b-44a2-9964-4f626fdb206d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:35.969651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-559a9b81-db2b-44a2-9964-4f626fdb206d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:35.985569 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2038/4091] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:10:42.491194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7773-5133-432e-a639-a82947a43043 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:42.491789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7773-5133-432e-a639-a82947a43043 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:42.491789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ef7773-5133-432e-a639-a82947a43043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:42.535338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c8ef7773-5133-432e-a639-a82947a43043 None None] MFA Rules not processed for user `c703cc73a22749858ffe05500e52aa03`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:42.536602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8ef7773-5133-432e-a639-a82947a43043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:42.645347 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2054/4092] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:45.979406 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=64,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:52.184910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a9b81-db2b-44a2-9964-4f626fdb206d service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:52.202793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-559a9b81-db2b-44a2-9964-4f626fdb206d service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:52.216384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00b7c7-954a-416b-aeda-5b4d47ee44ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:52.217147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00b7c7-954a-416b-aeda-5b4d47ee44ea service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:52.217654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00b7c7-954a-416b-aeda-5b4d47ee44ea service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:52.218027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00b7c7-954a-416b-aeda-5b4d47ee44ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:52.220180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0c00b7c7-954a-416b-aeda-5b4d47ee44ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:52.387705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00b7c7-954a-416b-aeda-5b4d47ee44ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:52.395804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c00b7c7-954a-416b-aeda-5b4d47ee44ea service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:52.426347 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2039/4093] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:10:52.631975 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=34 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:10:53.602686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5b09-d4d9-4665-8bdd-48b506fb2ef1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:53.603082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5b09-d4d9-4665-8bdd-48b506fb2ef1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:53.603314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8c5b09-d4d9-4665-8bdd-48b506fb2ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:53.665376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4a8c5b09-d4d9-4665-8bdd-48b506fb2ef1 None None] MFA Rules not processed for user `af9c3d9be3f2494a8eb2394e48bdeca6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:53.669142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4a8c5b09-d4d9-4665-8bdd-48b506fb2ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:53.787090 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2055/4094] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:53.801591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e6c40-fc15-4dad-851b-a1776ef8c4a5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:53.802511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e6c40-fc15-4dad-851b-a1776ef8c4a5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:53.803016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7e6c40-fc15-4dad-851b-a1776ef8c4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:53.844803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cc7e6c40-fc15-4dad-851b-a1776ef8c4a5 None None] MFA Rules not processed for user `af9c3d9be3f2494a8eb2394e48bdeca6`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:53.849006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cc7e6c40-fc15-4dad-851b-a1776ef8c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:53.863848 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2040/4095] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:54.022291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5b09-d4d9-4665-8bdd-48b506fb2ef1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:54.024013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4a8c5b09-d4d9-4665-8bdd-48b506fb2ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:54.059364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8c5b09-d4d9-4665-8bdd-48b506fb2ef1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:54.076619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597d191-9fc2-4c92-a5ef-f9d26752584a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:54.077255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d191-9fc2-4c92-a5ef-f9d26752584a service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:54.077563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d191-9fc2-4c92-a5ef-f9d26752584a service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:54.077839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597d191-9fc2-4c92-a5ef-f9d26752584a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:54.101468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597d191-9fc2-4c92-a5ef-f9d26752584a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:54.103136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597d191-9fc2-4c92-a5ef-f9d26752584a service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:54.158702 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2056/4096] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:54 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:10:54.204401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e6c40-fc15-4dad-851b-a1776ef8c4a5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:54.205906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cc7e6c40-fc15-4dad-851b-a1776ef8c4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:54.470683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7e6c40-fc15-4dad-851b-a1776ef8c4a5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:54.476847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7123d2-8017-46fd-9f7f-7d87d30046cf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:54.478163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7123d2-8017-46fd-9f7f-7d87d30046cf service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:54.478466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7123d2-8017-46fd-9f7f-7d87d30046cf service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:54.478745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7123d2-8017-46fd-9f7f-7d87d30046cf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:54.480687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cd7123d2-8017-46fd-9f7f-7d87d30046cf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:54.551414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7123d2-8017-46fd-9f7f-7d87d30046cf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:54.553981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7123d2-8017-46fd-9f7f-7d87d30046cf service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:54.592211 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2041/4097] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:10:54.916915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048710a-bb1b-4de2-8a54-a3f36b9e1bed None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:54.917440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048710a-bb1b-4de2-8a54-a3f36b9e1bed None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:54.917538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048710a-bb1b-4de2-8a54-a3f36b9e1bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:54.979802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3048710a-bb1b-4de2-8a54-a3f36b9e1bed None None] MFA Rules not processed for user `a170d67efe094c4e8b9267e33e4e476d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:10:54.981340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3048710a-bb1b-4de2-8a54-a3f36b9e1bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:55.079560 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2057/4098] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:10:54 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:10:56.451933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7123d2-8017-46fd-9f7f-7d87d30046cf service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:56.474954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7123d2-8017-46fd-9f7f-7d87d30046cf service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:56.491872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b09587-50ab-4971-b1e8-9301dcb83b69 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:56.492497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b09587-50ab-4971-b1e8-9301dcb83b69 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:56.492779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b09587-50ab-4971-b1e8-9301dcb83b69 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:56.493055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b09587-50ab-4971-b1e8-9301dcb83b69 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:56.516044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b09587-50ab-4971-b1e8-9301dcb83b69 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:56.517623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b09587-50ab-4971-b1e8-9301dcb83b69 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:56.553849 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2042/4099] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:10:59.409036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048710a-bb1b-4de2-8a54-a3f36b9e1bed None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:10:59.425174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048710a-bb1b-4de2-8a54-a3f36b9e1bed None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:10:59.452758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a001a7d-c82f-4660-bc9b-3132d72207a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:10:59.453861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a001a7d-c82f-4660-bc9b-3132d72207a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:10:59.454595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a001a7d-c82f-4660-bc9b-3132d72207a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:10:59.455035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a001a7d-c82f-4660-bc9b-3132d72207a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:10:59.458637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9a001a7d-c82f-4660-bc9b-3132d72207a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:10:59.478057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a001a7d-c82f-4660-bc9b-3132d72207a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:10:59.481870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a001a7d-c82f-4660-bc9b-3132d72207a9 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:10:59.495250 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2058/4100] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:10:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:11:03.733865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf5a97-2bb0-4b65-beee-1f1e04393d39 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:03.733865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf5a97-2bb0-4b65-beee-1f1e04393d39 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:03.734443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf5a97-2bb0-4b65-beee-1f1e04393d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:03.759782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1fbf5a97-2bb0-4b65-beee-1f1e04393d39 None None] MFA Rules not processed for user `a170d67efe094c4e8b9267e33e4e476d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:03.761563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1fbf5a97-2bb0-4b65-beee-1f1e04393d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:03.774328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2043/4101] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:03 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:04.687330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46032-27b0-42d8-b31e-1df87c1f2f19 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:04.687867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46032-27b0-42d8-b31e-1df87c1f2f19 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:04.688455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f46032-27b0-42d8-b31e-1df87c1f2f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:04.826530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a8f46032-27b0-42d8-b31e-1df87c1f2f19 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:04.828242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a8f46032-27b0-42d8-b31e-1df87c1f2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:04.871262 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:04.881390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf5a97-2bb0-4b65-beee-1f1e04393d39 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:04.899971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf5a97-2bb0-4b65-beee-1f1e04393d39 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:04.910391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55d587-649b-4521-bae7-51505f142e5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:04.912633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55d587-649b-4521-bae7-51505f142e5d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:04.914683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55d587-649b-4521-bae7-51505f142e5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:04.916854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55d587-649b-4521-bae7-51505f142e5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:04.920656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f55d587-649b-4521-bae7-51505f142e5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:04.945136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55d587-649b-4521-bae7-51505f142e5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:04.951758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55d587-649b-4521-bae7-51505f142e5d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:04.958433 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2059/4102] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:11:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:04.970341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f46032-27b0-42d8-b31e-1df87c1f2f19 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:04.971971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a8f46032-27b0-42d8-b31e-1df87c1f2f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:04.978514 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2044/4103] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:11:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:11:05.175254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f46032-27b0-42d8-b31e-1df87c1f2f19 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:05.182537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71280ec-307e-4ddb-be49-6ef377ac633a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:05.183360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71280ec-307e-4ddb-be49-6ef377ac633a service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:05.183753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71280ec-307e-4ddb-be49-6ef377ac633a service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:05.184139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71280ec-307e-4ddb-be49-6ef377ac633a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:05.195080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71280ec-307e-4ddb-be49-6ef377ac633a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:05.197073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71280ec-307e-4ddb-be49-6ef377ac633a service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:05.208436 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2060/4104] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:11:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:11:09.385867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca62a2-9cd7-4ae2-9697-745b595bbd1e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:09.386327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca62a2-9cd7-4ae2-9697-745b595bbd1e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:09.386582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca62a2-9cd7-4ae2-9697-745b595bbd1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:09.433217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6eca62a2-9cd7-4ae2-9697-745b595bbd1e None None] MFA Rules not processed for user `d271cce474064255b276e240e88bbe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:09.434520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6eca62a2-9cd7-4ae2-9697-745b595bbd1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:09.632114 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:09.665534 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2045/4105] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:12.850099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71280ec-307e-4ddb-be49-6ef377ac633a service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:12.851631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b71280ec-307e-4ddb-be49-6ef377ac633a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:13.042559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71280ec-307e-4ddb-be49-6ef377ac633a service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:13.048248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31448-8bea-4d58-82ad-6646c170f180 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:13.048870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31448-8bea-4d58-82ad-6646c170f180 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:13.049883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31448-8bea-4d58-82ad-6646c170f180 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:13.050190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b31448-8bea-4d58-82ad-6646c170f180 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:13.052032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-31b31448-8bea-4d58-82ad-6646c170f180 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:13.083756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31448-8bea-4d58-82ad-6646c170f180 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:13.085553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b31448-8bea-4d58-82ad-6646c170f180 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:13.099716 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2061/4106] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:11:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:11:16.624343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59b42-dd0b-40d7-b8cd-41da50781006 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:16.624343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59b42-dd0b-40d7-b8cd-41da50781006 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:16.624343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e59b42-dd0b-40d7-b8cd-41da50781006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:16.662954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b3e59b42-dd0b-40d7-b8cd-41da50781006 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:16.676600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b3e59b42-dd0b-40d7-b8cd-41da50781006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:16.702258 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2046/4107] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:11:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:16.728115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31448-8bea-4d58-82ad-6646c170f180 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:16.757710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b31448-8bea-4d58-82ad-6646c170f180 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:16.772428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bface-99ce-4fe4-b43e-40ad6ee090eb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:16.773166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bface-99ce-4fe4-b43e-40ad6ee090eb service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:16.773761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bface-99ce-4fe4-b43e-40ad6ee090eb service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:16.774194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7bface-99ce-4fe4-b43e-40ad6ee090eb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:16.815128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bface-99ce-4fe4-b43e-40ad6ee090eb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:16.823611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7bface-99ce-4fe4-b43e-40ad6ee090eb service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:16.842703 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2062/4108] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:11:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:11:26.650916 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:26.846189 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:26.900528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c0cbe-fc4c-4e6f-b3a0-6e3dda125361 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:26.900729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c0cbe-fc4c-4e6f-b3a0-6e3dda125361 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:26.901525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486c0cbe-fc4c-4e6f-b3a0-6e3dda125361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:26.968192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-486c0cbe-fc4c-4e6f-b3a0-6e3dda125361 None None] MFA Rules not processed for user `af9c3d9be3f2494a8eb2394e48bdeca6`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:26.975955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-486c0cbe-fc4c-4e6f-b3a0-6e3dda125361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:27.007759 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2047/4109] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:28.943818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bface-99ce-4fe4-b43e-40ad6ee090eb service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:28.946225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6c7bface-99ce-4fe4-b43e-40ad6ee090eb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:28.978893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7bface-99ce-4fe4-b43e-40ad6ee090eb service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:28.997868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:28.998456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:28.998739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:28.999016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] PATH_INFO: `/v3/users/abd944e891194ac498c21b55da9cb581` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:29.009630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] RBAC: Authorizing `identity:delete_user(user_id=abd944e891194ac498c21b55da9cb581)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:29.033287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:29.165492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abd944e891194ac498c21b55da9cb581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:29.219736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abd944e891194ac498c21b55da9cb581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:29.220653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abd944e891194ac498c21b55da9cb581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:29.244546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abd944e891194ac498c21b55da9cb581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:29.263700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abd944e891194ac498c21b55da9cb581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:29.281836 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2063/4110] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:11:28 2022] DELETE /identity/v3/users/abd944e891194ac498c21b55da9cb581 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:11:31.767039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c0cbe-fc4c-4e6f-b3a0-6e3dda125361 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:31.795661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486c0cbe-fc4c-4e6f-b3a0-6e3dda125361 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:32.015747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066ee64-27ca-4bef-8dbf-05eb1c50b034 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:32.016113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ee64-27ca-4bef-8dbf-05eb1c50b034 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:32.016295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ee64-27ca-4bef-8dbf-05eb1c50b034 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:32.016737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066ee64-27ca-4bef-8dbf-05eb1c50b034 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:32.028175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2066ee64-27ca-4bef-8dbf-05eb1c50b034 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:32.064730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066ee64-27ca-4bef-8dbf-05eb1c50b034 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:32.067823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2066ee64-27ca-4bef-8dbf-05eb1c50b034 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:32.100813 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2048/4111] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:11:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:11:33.157242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:33.158867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:33.184589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059d5aea-254a-44d8-89f2-54d529a2413f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:33.198632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:33.200588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:33.202210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:33.202656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:33.209582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:33.271951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:33.276238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:33.330344 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2064/4112] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:11:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:11:33.584569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113a8fc-eaea-4927-9788-8ed2d4e29141 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:33.585431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113a8fc-eaea-4927-9788-8ed2d4e29141 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:33.585873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113a8fc-eaea-4927-9788-8ed2d4e29141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:33.647151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2113a8fc-eaea-4927-9788-8ed2d4e29141 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:33.650245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2113a8fc-eaea-4927-9788-8ed2d4e29141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:33.788015 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2049/4113] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:11:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:33.820710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:33.823674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:33.831670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113a8fc-eaea-4927-9788-8ed2d4e29141 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:33.833797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2113a8fc-eaea-4927-9788-8ed2d4e29141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:33.975050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113a8fc-eaea-4927-9788-8ed2d4e29141 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:33.991641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:33.992877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:33.993363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:33.993799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] PATH_INFO: `/v3/projects/126c5b989a304f1cb217c95ebfbbd8b8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:33.995932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=126c5b989a304f1cb217c95ebfbbd8b8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:33.998081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:34.052591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab58fe-a8c3-4bdb-9872-ce3f3da679f1 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:34.066009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456aafa2-f130-45f4-9ea4-fe817bc4f2b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:34.066810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aafa2-f130-45f4-9ea4-fe817bc4f2b1 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:34.067201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aafa2-f130-45f4-9ea4-fe817bc4f2b1 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:34.067586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456aafa2-f130-45f4-9ea4-fe817bc4f2b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:34.078620 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:34.087994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456aafa2-f130-45f4-9ea4-fe817bc4f2b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:34.089837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456aafa2-f130-45f4-9ea4-fe817bc4f2b1 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:34.114776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '126c5b989a304f1cb217c95ebfbbd8b8', 'request_id': 'req-f6e2a3a1-6da6-4e12-9c97-880861605c4d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:34.115638 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2065/4114] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:11:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:11:34.137064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '126c5b989a304f1cb217c95ebfbbd8b8', 'request_id': 'req-f6e2a3a1-6da6-4e12-9c97-880861605c4d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:34.163761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '126c5b989a304f1cb217c95ebfbbd8b8', 'request_id': 'req-f6e2a3a1-6da6-4e12-9c97-880861605c4d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:34.189814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] The token cache is being invalidate because project 126c5b989a304f1cb217c95ebfbbd8b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:11:34.190304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:34.191299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6e2a3a1-6da6-4e12-9c97-880861605c4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:34.193582 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2050/4115] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:33 2022] DELETE /identity/v3/projects/126c5b989a304f1cb217c95ebfbbd8b8 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:11:34.198803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a729-d252-40cf-b71d-0dbab589b4a7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:34.198803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a729-d252-40cf-b71d-0dbab589b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:34.199400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a05a729-d252-40cf-b71d-0dbab589b4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:34.241447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2a05a729-d252-40cf-b71d-0dbab589b4a7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:34.247532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a05a729-d252-40cf-b71d-0dbab589b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:34.390368 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:34.418690 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2066/4116] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:34.426842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8722e2d-136e-4620-9444-ff63f320cbca None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:34.427304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8722e2d-136e-4620-9444-ff63f320cbca None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:34.427889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8722e2d-136e-4620-9444-ff63f320cbca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:34.459321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d8722e2d-136e-4620-9444-ff63f320cbca None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:34.461801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d8722e2d-136e-4620-9444-ff63f320cbca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:34.471866 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2051/4117] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:34.476141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a729-d252-40cf-b71d-0dbab589b4a7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:34.488196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a05a729-d252-40cf-b71d-0dbab589b4a7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:34.494404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3a3b2-6fd1-4849-a099-a9e1cb3cacbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:34.495123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a3b2-6fd1-4849-a099-a9e1cb3cacbb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:34.495480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a3b2-6fd1-4849-a099-a9e1cb3cacbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:34.495829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d3a3b2-6fd1-4849-a099-a9e1cb3cacbb admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:34.496614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3a3b2-6fd1-4849-a099-a9e1cb3cacbb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:11:34.496997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3a3b2-6fd1-4849-a099-a9e1cb3cacbb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:34.498735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d3a3b2-6fd1-4849-a099-a9e1cb3cacbb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:34.516640 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2067/4118] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:11:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:11:34.520845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8722e2d-136e-4620-9444-ff63f320cbca None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:34.541985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8722e2d-136e-4620-9444-ff63f320cbca None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:34.556868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03ad31-bb39-427f-83c2-31d7d99fbffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:34.558643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03ad31-bb39-427f-83c2-31d7d99fbffe admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:34.560653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03ad31-bb39-427f-83c2-31d7d99fbffe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:34.561053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03ad31-bb39-427f-83c2-31d7d99fbffe admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:34.562108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03ad31-bb39-427f-83c2-31d7d99fbffe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:34.567935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03ad31-bb39-427f-83c2-31d7d99fbffe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:34.686024 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2052/4119] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:11:34 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:11:34.689248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3a3b2-6fd1-4849-a099-a9e1cb3cacbb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:34.705494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d3a3b2-6fd1-4849-a099-a9e1cb3cacbb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:34.935879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af4541-1064-4715-bbd6-f5ce45d6920f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:34.937359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af4541-1064-4715-bbd6-f5ce45d6920f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:34.939491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af4541-1064-4715-bbd6-f5ce45d6920f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:34.939491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af4541-1064-4715-bbd6-f5ce45d6920f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:34.943817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af4541-1064-4715-bbd6-f5ce45d6920f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:34.949879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81af4541-1064-4715-bbd6-f5ce45d6920f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:35.036811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03ad31-bb39-427f-83c2-31d7d99fbffe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:35.046862 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2068/4120] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:11:34 2022] POST /identity/v3/users => generated 290 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:11:35.056681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03ad31-bb39-427f-83c2-31d7d99fbffe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:35.076577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7261ecc-3bcb-44d1-8adf-580bcb9b0d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:35.077212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261ecc-3bcb-44d1-8adf-580bcb9b0d28 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:35.081561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261ecc-3bcb-44d1-8adf-580bcb9b0d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:35.086671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7261ecc-3bcb-44d1-8adf-580bcb9b0d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:35.087474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7261ecc-3bcb-44d1-8adf-580bcb9b0d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:35.092063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7261ecc-3bcb-44d1-8adf-580bcb9b0d28 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:35.137549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af4541-1064-4715-bbd6-f5ce45d6920f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:35.145716 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2053/4121] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:11:35.161627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81af4541-1064-4715-bbd6-f5ce45d6920f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:35.182550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc47c75-a704-4472-be25-faa821e9b184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:35.183233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc47c75-a704-4472-be25-faa821e9b184 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:35.183506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc47c75-a704-4472-be25-faa821e9b184 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:35.183801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc47c75-a704-4472-be25-faa821e9b184 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:35.184455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc47c75-a704-4472-be25-faa821e9b184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:35.199143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc47c75-a704-4472-be25-faa821e9b184 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:35.239181 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2069/4122] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:11:35.240726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7261ecc-3bcb-44d1-8adf-580bcb9b0d28 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:35.263837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7261ecc-3bcb-44d1-8adf-580bcb9b0d28 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:35.289167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9387d1b8-36a6-46fd-8bd7-c1691fb75dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:35.293091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d1b8-36a6-46fd-8bd7-c1691fb75dad admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:35.293414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d1b8-36a6-46fd-8bd7-c1691fb75dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:35.293705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9387d1b8-36a6-46fd-8bd7-c1691fb75dad admin admin] PATH_INFO: `/v3/projects/d0f667f944db47a5868be25e2e771c9a/users/5683b4795abc4111aa9fcf809652c979/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:35.373287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387d1b8-36a6-46fd-8bd7-c1691fb75dad admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0f667f944db47a5868be25e2e771c9a, user_id=5683b4795abc4111aa9fcf809652c979, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:35.376100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9387d1b8-36a6-46fd-8bd7-c1691fb75dad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:35.418497 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2054/4123] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:11:35 2022] PUT /identity/v3/projects/d0f667f944db47a5868be25e2e771c9a/users/5683b4795abc4111aa9fcf809652c979/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:11:35.429879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056ecd1-df53-4d93-9956-ac3cc892e39e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:35.429879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056ecd1-df53-4d93-9956-ac3cc892e39e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:35.430507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3056ecd1-df53-4d93-9956-ac3cc892e39e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:35.526663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3056ecd1-df53-4d93-9956-ac3cc892e39e None None] MFA Rules not processed for user `5683b4795abc4111aa9fcf809652c979`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:35.527930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3056ecd1-df53-4d93-9956-ac3cc892e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:35.881660 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2070/4124] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 448 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:35.887085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1def957-5107-484e-a453-8168f0a6961e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:35.887565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1def957-5107-484e-a453-8168f0a6961e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:35.887685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1def957-5107-484e-a453-8168f0a6961e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:35.954522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a1def957-5107-484e-a453-8168f0a6961e None None] MFA Rules not processed for user `5683b4795abc4111aa9fcf809652c979`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:35.956308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a1def957-5107-484e-a453-8168f0a6961e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:35.970501 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2055/4125] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:38.708735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056ecd1-df53-4d93-9956-ac3cc892e39e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:38.710378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3056ecd1-df53-4d93-9956-ac3cc892e39e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:38.846158 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:38.938425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3056ecd1-df53-4d93-9956-ac3cc892e39e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:38.947797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ccc0f-0bf2-4e29-bb25-5d7148ed5f57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:38.948485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ccc0f-0bf2-4e29-bb25-5d7148ed5f57 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:38.948771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ccc0f-0bf2-4e29-bb25-5d7148ed5f57 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:38.949046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ccc0f-0bf2-4e29-bb25-5d7148ed5f57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:38.958878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ccc0f-0bf2-4e29-bb25-5d7148ed5f57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:38.960644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ccc0f-0bf2-4e29-bb25-5d7148ed5f57 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:38.985610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2071/4126] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:11:38 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:11:45.936213 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=6,keystone:SELECT=48,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:48.979766 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=14 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:54.720802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1def957-5107-484e-a453-8168f0a6961e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:54.888278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1def957-5107-484e-a453-8168f0a6961e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:54.901927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:54.902651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:54.902935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:54.903209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] PATH_INFO: `/v3/users/5683b4795abc4111aa9fcf809652c979` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:54.904359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5683b4795abc4111aa9fcf809652c979)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:54.921632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:55.022911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5683b4795abc4111aa9fcf809652c979'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:55.086387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5683b4795abc4111aa9fcf809652c979'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:55.094604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5683b4795abc4111aa9fcf809652c979'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:55.114417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5683b4795abc4111aa9fcf809652c979'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:55.130577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5683b4795abc4111aa9fcf809652c979'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:55.164000 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2056/4127] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:11:54 2022] DELETE /identity/v3/users/5683b4795abc4111aa9fcf809652c979 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:11:55.168931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedd749-a800-4d75-8e42-5b6da4472baa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:55.169865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedd749-a800-4d75-8e42-5b6da4472baa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:55.170837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bedd749-a800-4d75-8e42-5b6da4472baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:55.206253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8bedd749-a800-4d75-8e42-5b6da4472baa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:55.207516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8bedd749-a800-4d75-8e42-5b6da4472baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:55.371477 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2072/4128] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:55.400782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:55.402436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:55.487341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e597e41-3049-40b2-8977-6d5ecd504b8f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:55.491297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a888505c-dc6e-4b47-9757-8291e4c08ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:55.492183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888505c-dc6e-4b47-9757-8291e4c08ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:55.493502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888505c-dc6e-4b47-9757-8291e4c08ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:55.493947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a888505c-dc6e-4b47-9757-8291e4c08ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:55.509705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888505c-dc6e-4b47-9757-8291e4c08ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:55.511228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a888505c-dc6e-4b47-9757-8291e4c08ad0 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:55.528609 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2057/4129] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:11:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:11:56.352774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedd749-a800-4d75-8e42-5b6da4472baa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:56.354471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8bedd749-a800-4d75-8e42-5b6da4472baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:56.383522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bedd749-a800-4d75-8e42-5b6da4472baa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:56.399680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:56.400695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:56.402220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:56.402720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] PATH_INFO: `/v3/projects/d0f667f944db47a5868be25e2e771c9a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:56.405963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0f667f944db47a5868be25e2e771c9a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:56.407876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:56.513219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0f667f944db47a5868be25e2e771c9a', 'request_id': 'req-ed925a0d-b91e-41db-9df5-edca81095a17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:56.527594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0f667f944db47a5868be25e2e771c9a', 'request_id': 'req-ed925a0d-b91e-41db-9df5-edca81095a17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:56.539074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0f667f944db47a5868be25e2e771c9a', 'request_id': 'req-ed925a0d-b91e-41db-9df5-edca81095a17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:56.555157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] The token cache is being invalidate because project d0f667f944db47a5868be25e2e771c9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:11:56.555981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:56.556843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ed925a0d-b91e-41db-9df5-edca81095a17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:11:56.559048 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2073/4130] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:11:56 2022] DELETE /identity/v3/projects/d0f667f944db47a5868be25e2e771c9a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:11:56.566129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6abda5-9b04-48d5-9790-98311f28d671 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:56.566606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6abda5-9b04-48d5-9790-98311f28d671 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:56.566700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6abda5-9b04-48d5-9790-98311f28d671 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:56.606189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1a6abda5-9b04-48d5-9790-98311f28d671 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:56.607407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a6abda5-9b04-48d5-9790-98311f28d671 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:56.660215 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:56.756050 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2058/4131] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:56.764682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eda20-465c-4b22-bd60-8df15e6e75bc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:56.764957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eda20-465c-4b22-bd60-8df15e6e75bc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:56.765250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051eda20-465c-4b22-bd60-8df15e6e75bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:56.793628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-051eda20-465c-4b22-bd60-8df15e6e75bc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:56.796002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-051eda20-465c-4b22-bd60-8df15e6e75bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:56.812360 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2074/4132] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:56.816629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6abda5-9b04-48d5-9790-98311f28d671 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:56.835959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6abda5-9b04-48d5-9790-98311f28d671 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:56.847411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b681d0-cc95-45f9-990e-355d8e3233a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:56.847770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b681d0-cc95-45f9-990e-355d8e3233a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:56.847964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b681d0-cc95-45f9-990e-355d8e3233a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:56.848229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b681d0-cc95-45f9-990e-355d8e3233a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:56.848894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b681d0-cc95-45f9-990e-355d8e3233a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:11:56.849184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b681d0-cc95-45f9-990e-355d8e3233a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:56.851441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b681d0-cc95-45f9-990e-355d8e3233a8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:56.873613 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2059/4133] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:11:56.878819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eda20-465c-4b22-bd60-8df15e6e75bc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:56.902468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051eda20-465c-4b22-bd60-8df15e6e75bc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:56.909895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd407d3-825a-4e16-a03f-e3fcab2ac145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:56.911886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd407d3-825a-4e16-a03f-e3fcab2ac145 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:56.912174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd407d3-825a-4e16-a03f-e3fcab2ac145 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:56.912492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd407d3-825a-4e16-a03f-e3fcab2ac145 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:56.913146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd407d3-825a-4e16-a03f-e3fcab2ac145 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:56.915571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd407d3-825a-4e16-a03f-e3fcab2ac145 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:56.964692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b681d0-cc95-45f9-990e-355d8e3233a8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:56.965031 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2075/4134] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:11:56 2022] POST /identity/v3/projects => generated 375 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:11:56.976748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b681d0-cc95-45f9-990e-355d8e3233a8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:57.141037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b826fd-33a1-42fe-900e-818226f28921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:57.150408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b826fd-33a1-42fe-900e-818226f28921 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:57.150607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b826fd-33a1-42fe-900e-818226f28921 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:57.150886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b826fd-33a1-42fe-900e-818226f28921 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:57.151655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b826fd-33a1-42fe-900e-818226f28921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:57.155414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b826fd-33a1-42fe-900e-818226f28921 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:57.213834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd407d3-825a-4e16-a03f-e3fcab2ac145 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:57.214258 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2060/4135] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:11:56 2022] POST /identity/v3/users => generated 288 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:11:57.225487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd407d3-825a-4e16-a03f-e3fcab2ac145 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:57.231107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170df21-cf80-4b18-aa4e-8c68678279fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:57.231728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170df21-cf80-4b18-aa4e-8c68678279fb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:57.232004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170df21-cf80-4b18-aa4e-8c68678279fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:57.232274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3170df21-cf80-4b18-aa4e-8c68678279fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:57.232969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170df21-cf80-4b18-aa4e-8c68678279fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:57.234971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3170df21-cf80-4b18-aa4e-8c68678279fb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:57.252675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b826fd-33a1-42fe-900e-818226f28921 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:57.260833 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2076/4136] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:11:57.266984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b826fd-33a1-42fe-900e-818226f28921 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:57.274332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffbcf5a-ebc6-4386-bdf1-1d8871d1d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:57.275022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbcf5a-ebc6-4386-bdf1-1d8871d1d23c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:57.275368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbcf5a-ebc6-4386-bdf1-1d8871d1d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:57.275755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffbcf5a-ebc6-4386-bdf1-1d8871d1d23c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:57.276650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbcf5a-ebc6-4386-bdf1-1d8871d1d23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:57.278705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffbcf5a-ebc6-4386-bdf1-1d8871d1d23c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:57.296040 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2061/4137] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:11:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:11:57.300571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170df21-cf80-4b18-aa4e-8c68678279fb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:57.329044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3170df21-cf80-4b18-aa4e-8c68678279fb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:57.342089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c654086-d8e0-4166-92ed-2b03275927f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:57.342881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c654086-d8e0-4166-92ed-2b03275927f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:57.343269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c654086-d8e0-4166-92ed-2b03275927f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:57.343652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c654086-d8e0-4166-92ed-2b03275927f3 admin admin] PATH_INFO: `/v3/projects/0a93a7edd7324574b19ec5c7847f9f03/users/c8cc22ca64db4c86827f1262cdddf2d7/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:57.361760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c654086-d8e0-4166-92ed-2b03275927f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a93a7edd7324574b19ec5c7847f9f03, user_id=c8cc22ca64db4c86827f1262cdddf2d7, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:57.364590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c654086-d8e0-4166-92ed-2b03275927f3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:57.393255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c3b48-56c9-41a9-aeb8-b38d5f468e26 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:57.393695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c3b48-56c9-41a9-aeb8-b38d5f468e26 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:57.394076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897c3b48-56c9-41a9-aeb8-b38d5f468e26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:57.397750 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2077/4138] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:11:57 2022] PUT /identity/v3/projects/0a93a7edd7324574b19ec5c7847f9f03/users/c8cc22ca64db4c86827f1262cdddf2d7/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:11:57.425420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-897c3b48-56c9-41a9-aeb8-b38d5f468e26 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:11:57.427068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-897c3b48-56c9-41a9-aeb8-b38d5f468e26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:57.533553 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2062/4139] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:11:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:11:57.556557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c654086-d8e0-4166-92ed-2b03275927f3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:11:57.560527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c654086-d8e0-4166-92ed-2b03275927f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:11:57.605413 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:11:57.661994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c654086-d8e0-4166-92ed-2b03275927f3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:11:57.668930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dbdb5-11b1-43bf-b27d-2887d2a6de16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:11:57.670078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dbdb5-11b1-43bf-b27d-2887d2a6de16 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:11:57.670340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dbdb5-11b1-43bf-b27d-2887d2a6de16 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:11:57.670652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dbdb5-11b1-43bf-b27d-2887d2a6de16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:11:57.687880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dbdb5-11b1-43bf-b27d-2887d2a6de16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:11:57.689571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3dbdb5-11b1-43bf-b27d-2887d2a6de16 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:11:57.701380 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2078/4140] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:11:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:12:04.079823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8648ba-4e45-4843-95af-0a12658c0c89 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:04.081022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8648ba-4e45-4843-95af-0a12658c0c89 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:04.081587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8648ba-4e45-4843-95af-0a12658c0c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:04.108975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1f8648ba-4e45-4843-95af-0a12658c0c89 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:04.110672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f8648ba-4e45-4843-95af-0a12658c0c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:04.143858 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:04.208986 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2063/4141] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:12:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:04.228970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dbdb5-11b1-43bf-b27d-2887d2a6de16 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:04.230768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb3dbdb5-11b1-43bf-b27d-2887d2a6de16 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:04.538912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3dbdb5-11b1-43bf-b27d-2887d2a6de16 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:04.553272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8be7cf-e97c-4f9c-acd6-170c8a23c8f0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:04.554090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be7cf-e97c-4f9c-acd6-170c8a23c8f0 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:04.554488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be7cf-e97c-4f9c-acd6-170c8a23c8f0 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:04.554876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8be7cf-e97c-4f9c-acd6-170c8a23c8f0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:04.576063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8be7cf-e97c-4f9c-acd6-170c8a23c8f0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:04.578294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8be7cf-e97c-4f9c-acd6-170c8a23c8f0 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:04.601890 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2079/4142] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:12:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:08.205385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8648ba-4e45-4843-95af-0a12658c0c89 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:08.215936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f8648ba-4e45-4843-95af-0a12658c0c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:08.499675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8648ba-4e45-4843-95af-0a12658c0c89 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:08.513334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:08.513991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:08.514274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:08.514641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:08.516835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:08.553407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:08.557438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:08.611340 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2064/4143] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:12:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:12:11.085682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cdfd9-d1ac-4f88-b20f-438fdba9f67d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:11.086213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cdfd9-d1ac-4f88-b20f-438fdba9f67d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:11.086213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784cdfd9-d1ac-4f88-b20f-438fdba9f67d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:11.193649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-784cdfd9-d1ac-4f88-b20f-438fdba9f67d None None] MFA Rules not processed for user `c8cc22ca64db4c86827f1262cdddf2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:11.199268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-784cdfd9-d1ac-4f88-b20f-438fdba9f67d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:11.439980 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2080/4144] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:11 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:11.634745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:11.636785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:11.672066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b39803d-7546-4f4e-9c42-59b5bf5fe687 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:11.702289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5965a-c2e6-4741-b31b-e332672cc2db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:11.702926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5965a-c2e6-4741-b31b-e332672cc2db service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:11.703214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5965a-c2e6-4741-b31b-e332672cc2db service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:11.703489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5965a-c2e6-4741-b31b-e332672cc2db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:11.752438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5965a-c2e6-4741-b31b-e332672cc2db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:11.754115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b5965a-c2e6-4741-b31b-e332672cc2db service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:11.775828 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2065/4145] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:12:11 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:12:16.151984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f28951-d627-4a56-982c-1c3419e1e053 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:16.152427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f28951-d627-4a56-982c-1c3419e1e053 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:16.152555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f28951-d627-4a56-982c-1c3419e1e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:16.225444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b5f28951-d627-4a56-982c-1c3419e1e053 None None] MFA Rules not processed for user `c8cc22ca64db4c86827f1262cdddf2d7`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:16.263752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b5f28951-d627-4a56-982c-1c3419e1e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:16.317889 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2081/4146] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:18.783068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5965a-c2e6-4741-b31b-e332672cc2db service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:18.785085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-26b5965a-c2e6-4741-b31b-e332672cc2db service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:18.826734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5965a-c2e6-4741-b31b-e332672cc2db service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:18.852474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:18.853124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:18.853440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:18.853722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] PATH_INFO: `/v3/users/af9c3d9be3f2494a8eb2394e48bdeca6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:18.876878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af9c3d9be3f2494a8eb2394e48bdeca6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:18.892080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:19.051346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af9c3d9be3f2494a8eb2394e48bdeca6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:19.087529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af9c3d9be3f2494a8eb2394e48bdeca6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:19.088475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af9c3d9be3f2494a8eb2394e48bdeca6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:19.109980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af9c3d9be3f2494a8eb2394e48bdeca6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:19.123017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4a128509-40c6-48d3-ad21-1aac64cb01a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af9c3d9be3f2494a8eb2394e48bdeca6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:19.141957 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2066/4147] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:12:18 2022] DELETE /identity/v3/users/af9c3d9be3f2494a8eb2394e48bdeca6 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:12:20.448498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f28951-d627-4a56-982c-1c3419e1e053 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:20.465167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f28951-d627-4a56-982c-1c3419e1e053 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:20.629732 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:20.748929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:20.749622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:20.749908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:20.750190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] PATH_INFO: `/v3/projects/a1021217d2904d5190dd4a82db7007fd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:20.759316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1021217d2904d5190dd4a82db7007fd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:20.766888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:20.940485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1021217d2904d5190dd4a82db7007fd', 'request_id': 'req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:20.958466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1021217d2904d5190dd4a82db7007fd', 'request_id': 'req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:20.989004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1021217d2904d5190dd4a82db7007fd', 'request_id': 'req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:21.040287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] The token cache is being invalidate because project a1021217d2904d5190dd4a82db7007fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:12:21.043567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:21.044047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-03161cc5-0b1e-45f5-90ba-2d8dc4eea9d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:21.046945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2082/4148] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:20 2022] DELETE /identity/v3/projects/a1021217d2904d5190dd4a82db7007fd => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:12:21.053163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c276e-955c-4008-9691-963832b471ef None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:21.054439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c276e-955c-4008-9691-963832b471ef None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:21.054606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627c276e-955c-4008-9691-963832b471ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:21.117997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-627c276e-955c-4008-9691-963832b471ef None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:21.122153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-627c276e-955c-4008-9691-963832b471ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:21.190923 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:21.395253 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2067/4149] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:21.398319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb307e-bf95-4098-b31d-ebc56d204c03 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:21.398584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb307e-bf95-4098-b31d-ebc56d204c03 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:21.398904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cb307e-bf95-4098-b31d-ebc56d204c03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:21.431332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-68cb307e-bf95-4098-b31d-ebc56d204c03 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:21.432611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-68cb307e-bf95-4098-b31d-ebc56d204c03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:21.445486 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2083/4150] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:21.447078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c276e-955c-4008-9691-963832b471ef None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:21.468315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627c276e-955c-4008-9691-963832b471ef None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:21.479134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b688d-d483-4e4c-ab36-aa67167bcd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:21.479838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b688d-d483-4e4c-ab36-aa67167bcd3b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:21.480280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b688d-d483-4e4c-ab36-aa67167bcd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:21.480566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b688d-d483-4e4c-ab36-aa67167bcd3b admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:21.481242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b688d-d483-4e4c-ab36-aa67167bcd3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:12:21.481583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b688d-d483-4e4c-ab36-aa67167bcd3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:21.485835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b688d-d483-4e4c-ab36-aa67167bcd3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:21.526291 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2068/4151] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:12:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:12:21.530640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb307e-bf95-4098-b31d-ebc56d204c03 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:21.543135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68cb307e-bf95-4098-b31d-ebc56d204c03 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:21.548868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bd1a-05af-4b89-b799-ba1ff683a9e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:21.550557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bd1a-05af-4b89-b799-ba1ff683a9e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:21.551094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bd1a-05af-4b89-b799-ba1ff683a9e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:21.551994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84bd1a-05af-4b89-b799-ba1ff683a9e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:21.552884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84bd1a-05af-4b89-b799-ba1ff683a9e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:21.557878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b84bd1a-05af-4b89-b799-ba1ff683a9e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:21.613768 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2084/4152] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:12:21 2022] POST /identity/v3/projects => generated 379 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:12:21.618033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b688d-d483-4e4c-ab36-aa67167bcd3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:21.635581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b688d-d483-4e4c-ab36-aa67167bcd3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:21.824804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c61b7-776c-4ada-bb17-cfabd3d3b8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:21.825742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c61b7-776c-4ada-bb17-cfabd3d3b8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:21.826179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c61b7-776c-4ada-bb17-cfabd3d3b8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:21.826626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94c61b7-776c-4ada-bb17-cfabd3d3b8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:21.827434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c61b7-776c-4ada-bb17-cfabd3d3b8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:21.829628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94c61b7-776c-4ada-bb17-cfabd3d3b8f8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:21.930332 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2069/4153] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:12:21 2022] POST /identity/v3/users => generated 290 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:12:21.934396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bd1a-05af-4b89-b799-ba1ff683a9e8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:21.958876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b84bd1a-05af-4b89-b799-ba1ff683a9e8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:21.974181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a1ca9-7034-455e-bddb-c322dd27ec94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:21.976883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a1ca9-7034-455e-bddb-c322dd27ec94 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:21.977805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a1ca9-7034-455e-bddb-c322dd27ec94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:21.980312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a1ca9-7034-455e-bddb-c322dd27ec94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:21.981890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a1ca9-7034-455e-bddb-c322dd27ec94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:21.987839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13a1ca9-7034-455e-bddb-c322dd27ec94 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:22.026171 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2085/4154] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:12:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:12:22.030688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c61b7-776c-4ada-bb17-cfabd3d3b8f8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:22.050029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94c61b7-776c-4ada-bb17-cfabd3d3b8f8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:22.068799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cc3295-6df6-44c4-89ca-33e40c6c2410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:22.070229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc3295-6df6-44c4-89ca-33e40c6c2410 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:22.074783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc3295-6df6-44c4-89ca-33e40c6c2410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:22.075443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cc3295-6df6-44c4-89ca-33e40c6c2410 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:22.076162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc3295-6df6-44c4-89ca-33e40c6c2410 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:22.079682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cc3295-6df6-44c4-89ca-33e40c6c2410 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:22.114939 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2070/4155] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:12:22 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:12:22.118823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a1ca9-7034-455e-bddb-c322dd27ec94 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:22.134385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13a1ca9-7034-455e-bddb-c322dd27ec94 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:22.161264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bb47e-3503-4616-b762-013443420892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:22.161264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bb47e-3503-4616-b762-013443420892 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:22.161264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bb47e-3503-4616-b762-013443420892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:22.161264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84bb47e-3503-4616-b762-013443420892 admin admin] PATH_INFO: `/v3/projects/1d3b5e6b605e4c109a407f253b5aac17/users/32660741092146d490982e08873cfb04/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:22.202856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bb47e-3503-4616-b762-013443420892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3b5e6b605e4c109a407f253b5aac17, user_id=32660741092146d490982e08873cfb04, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:22.208647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84bb47e-3503-4616-b762-013443420892 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:22.241460 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2086/4156] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:12:22 2022] PUT /identity/v3/projects/1d3b5e6b605e4c109a407f253b5aac17/users/32660741092146d490982e08873cfb04/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:12:22.247320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2e371-66f4-478b-b936-268872e85b9c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:22.248008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2e371-66f4-478b-b936-268872e85b9c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:22.248505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b2e371-66f4-478b-b936-268872e85b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:22.289322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c7b2e371-66f4-478b-b936-268872e85b9c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:22.293209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c7b2e371-66f4-478b-b936-268872e85b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:22.627461 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2071/4157] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:22.709481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bb47e-3503-4616-b762-013443420892 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:22.711656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c84bb47e-3503-4616-b762-013443420892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:22.878740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84bb47e-3503-4616-b762-013443420892 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:22.892263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd220878-d220-4e31-ac40-4555c32086ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:22.892902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd220878-d220-4e31-ac40-4555c32086ca service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:22.893181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd220878-d220-4e31-ac40-4555c32086ca service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:22.893488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd220878-d220-4e31-ac40-4555c32086ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:22.918053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd220878-d220-4e31-ac40-4555c32086ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:22.925635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd220878-d220-4e31-ac40-4555c32086ca service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:22.965398 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2087/4158] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:12:32.345780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e43a2-1066-4b89-a0e1-ac0fc5017560 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:32.346353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e43a2-1066-4b89-a0e1-ac0fc5017560 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:32.346353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874e43a2-1066-4b89-a0e1-ac0fc5017560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:32.372238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-874e43a2-1066-4b89-a0e1-ac0fc5017560 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:32.373976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-874e43a2-1066-4b89-a0e1-ac0fc5017560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:32.430211 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:32.515122 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2072/4159] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:12:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:32.544169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd220878-d220-4e31-ac40-4555c32086ca service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:32.545960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dd220878-d220-4e31-ac40-4555c32086ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:32.553045 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:32.753459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd220878-d220-4e31-ac40-4555c32086ca service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:32.760674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f28a4da-672c-4b19-84e9-18618a1407d3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:32.761480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28a4da-672c-4b19-84e9-18618a1407d3 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:32.762716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28a4da-672c-4b19-84e9-18618a1407d3 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:32.763101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f28a4da-672c-4b19-84e9-18618a1407d3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:32.778218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28a4da-672c-4b19-84e9-18618a1407d3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:32.780180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f28a4da-672c-4b19-84e9-18618a1407d3 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:32.791179 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2088/4160] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:12:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:12:36.564370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e43a2-1066-4b89-a0e1-ac0fc5017560 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:36.566011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-874e43a2-1066-4b89-a0e1-ac0fc5017560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:36.816726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874e43a2-1066-4b89-a0e1-ac0fc5017560 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:36.825419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83186-9b1c-4252-8448-e98c1ea327f8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:36.826334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83186-9b1c-4252-8448-e98c1ea327f8 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:36.826981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83186-9b1c-4252-8448-e98c1ea327f8 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:36.827424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e83186-9b1c-4252-8448-e98c1ea327f8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:36.830701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e0e83186-9b1c-4252-8448-e98c1ea327f8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:36.856491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83186-9b1c-4252-8448-e98c1ea327f8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:36.859303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e83186-9b1c-4252-8448-e98c1ea327f8 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:36.940884 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2073/4161] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:12:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:12:41.201156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826cb3-69af-44c9-894d-ff40c8ae5eda None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:41.201706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826cb3-69af-44c9-894d-ff40c8ae5eda None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:41.201833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66826cb3-69af-44c9-894d-ff40c8ae5eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:41.262348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-66826cb3-69af-44c9-894d-ff40c8ae5eda None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:41.265310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-66826cb3-69af-44c9-894d-ff40c8ae5eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:41.290124 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2089/4162] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:12:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:41.304111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83186-9b1c-4252-8448-e98c1ea327f8 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:41.323793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e83186-9b1c-4252-8448-e98c1ea327f8 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:41.336976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a39ddf-70e2-4785-96e8-e7fdd9c37662 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:41.340633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a39ddf-70e2-4785-96e8-e7fdd9c37662 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:41.341857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a39ddf-70e2-4785-96e8-e7fdd9c37662 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:41.342464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a39ddf-70e2-4785-96e8-e7fdd9c37662 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:41.369556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a39ddf-70e2-4785-96e8-e7fdd9c37662 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:41.377231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a39ddf-70e2-4785-96e8-e7fdd9c37662 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:41.397749 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2074/4163] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:12:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:42.191324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b068122-9fe0-4237-be7d-1bce0d7a8e89 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:42.191612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b068122-9fe0-4237-be7d-1bce0d7a8e89 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:42.191888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b068122-9fe0-4237-be7d-1bce0d7a8e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:42.256001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3b068122-9fe0-4237-be7d-1bce0d7a8e89 None None] MFA Rules not processed for user `32660741092146d490982e08873cfb04`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:42.260872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3b068122-9fe0-4237-be7d-1bce0d7a8e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:42.399629 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2090/4164] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:42 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:42.429183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb911b-c447-4a24-a812-2ba860bc1565 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:42.430287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb911b-c447-4a24-a812-2ba860bc1565 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:42.430784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edb911b-c447-4a24-a812-2ba860bc1565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:42.464685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1edb911b-c447-4a24-a812-2ba860bc1565 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:42.468250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1edb911b-c447-4a24-a812-2ba860bc1565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:42.481984 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2075/4165] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:12:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:42.509729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b068122-9fe0-4237-be7d-1bce0d7a8e89 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:42.529876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b068122-9fe0-4237-be7d-1bce0d7a8e89 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:42.551016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c3bb7f-d51a-43e1-b5cd-078f12d153ea service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:42.551909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3bb7f-d51a-43e1-b5cd-078f12d153ea service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:42.552372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3bb7f-d51a-43e1-b5cd-078f12d153ea service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:42.552799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3bb7f-d51a-43e1-b5cd-078f12d153ea service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:42.574819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3bb7f-d51a-43e1-b5cd-078f12d153ea service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:42.576863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c3bb7f-d51a-43e1-b5cd-078f12d153ea service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:42.593272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb911b-c447-4a24-a812-2ba860bc1565 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:42.595538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1edb911b-c447-4a24-a812-2ba860bc1565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:42.617643 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2091/4166] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:12:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:12:42.878225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edb911b-c447-4a24-a812-2ba860bc1565 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:42.891373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6a9d1-f8ea-4ec5-a358-b158473b38f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:42.892133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6a9d1-f8ea-4ec5-a358-b158473b38f7 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:42.892337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6a9d1-f8ea-4ec5-a358-b158473b38f7 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:42.892662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d6a9d1-f8ea-4ec5-a358-b158473b38f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:42.911290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6a9d1-f8ea-4ec5-a358-b158473b38f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:42.949985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d6a9d1-f8ea-4ec5-a358-b158473b38f7 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:42.991494 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2076/4167] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:12:42 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:12:43.370382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f3b0f-ba60-4044-a310-7c1c78319cc3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:43.370905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f3b0f-ba60-4044-a310-7c1c78319cc3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:43.370905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2f3b0f-ba60-4044-a310-7c1c78319cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:43.407110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-be2f3b0f-ba60-4044-a310-7c1c78319cc3 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:43.411238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-be2f3b0f-ba60-4044-a310-7c1c78319cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:43.434995 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2092/4168] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:12:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:43.435690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6a9d1-f8ea-4ec5-a358-b158473b38f7 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:43.457822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d6a9d1-f8ea-4ec5-a358-b158473b38f7 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:43.468670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ddd71-2ba0-4024-bf30-727c943ed202 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:43.469513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ddd71-2ba0-4024-bf30-727c943ed202 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:43.469850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ddd71-2ba0-4024-bf30-727c943ed202 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:43.470177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ddd71-2ba0-4024-bf30-727c943ed202 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:43.500830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ddd71-2ba0-4024-bf30-727c943ed202 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:43.503005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ddd71-2ba0-4024-bf30-727c943ed202 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:43.566131 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2077/4169] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:12:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:12:49.307331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe2aa9-bc69-4179-b912-338d86f6f89e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:49.307881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe2aa9-bc69-4179-b912-338d86f6f89e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:49.307881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe2aa9-bc69-4179-b912-338d86f6f89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:49.359531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-53fe2aa9-bc69-4179-b912-338d86f6f89e None None] MFA Rules not processed for user `a170d67efe094c4e8b9267e33e4e476d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:49.360765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-53fe2aa9-bc69-4179-b912-338d86f6f89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:49.506078 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2093/4170] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:50.997033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ddd71-2ba0-4024-bf30-727c943ed202 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:51.018056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ddd71-2ba0-4024-bf30-727c943ed202 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:51.022530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372a80-0000-4ae5-849c-ec8448756a25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:51.023152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372a80-0000-4ae5-849c-ec8448756a25 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:51.023428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372a80-0000-4ae5-849c-ec8448756a25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:51.023702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f372a80-0000-4ae5-849c-ec8448756a25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:51.029570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f372a80-0000-4ae5-849c-ec8448756a25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:51.061710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f372a80-0000-4ae5-849c-ec8448756a25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:51.063682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f372a80-0000-4ae5-849c-ec8448756a25 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:51.074617 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:51.083130 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2078/4171] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:12:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:12:51.761558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe2aa9-bc69-4179-b912-338d86f6f89e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:51.764165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-53fe2aa9-bc69-4179-b912-338d86f6f89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:51.777082 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:51.794247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe2aa9-bc69-4179-b912-338d86f6f89e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:51.801394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:51.802219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:51.802684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:51.803106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] PATH_INFO: `/v3/users/d271cce474064255b276e240e88bbe0c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:51.814322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=d271cce474064255b276e240e88bbe0c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:51.817664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:51.925151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd271cce474064255b276e240e88bbe0c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:51.949734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd271cce474064255b276e240e88bbe0c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:51.952997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd271cce474064255b276e240e88bbe0c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:51.973630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd271cce474064255b276e240e88bbe0c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:51.984113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-065ef650-f47b-4e6b-9f99-8a6a988b34cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd271cce474064255b276e240e88bbe0c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:52.004299 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2094/4172] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:12:51 2022] DELETE /identity/v3/users/d271cce474064255b276e240e88bbe0c => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:12:52.601641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372a80-0000-4ae5-849c-ec8448756a25 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:52.622735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f372a80-0000-4ae5-849c-ec8448756a25 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:52.845892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:52.846561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:52.847027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:52.847467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] PATH_INFO: `/v3/projects/d6c4858fe89d4bfb8b989aa476a58a84` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:52.852431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6c4858fe89d4bfb8b989aa476a58a84)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:52.855833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:53.000188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6c4858fe89d4bfb8b989aa476a58a84', 'request_id': 'req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:53.014387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6c4858fe89d4bfb8b989aa476a58a84', 'request_id': 'req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:53.034959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6c4858fe89d4bfb8b989aa476a58a84', 'request_id': 'req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:53.100209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] The token cache is being invalidate because project d6c4858fe89d4bfb8b989aa476a58a84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:12:53.100510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:53.105734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd5bae2f-fdb2-4930-bbc0-f29fe5f52683 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:53.107361 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2079/4173] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:52 2022] DELETE /identity/v3/projects/d6c4858fe89d4bfb8b989aa476a58a84 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:12:53.112343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb524a7-e176-48b5-ac51-75fb581487ef None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:53.113269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb524a7-e176-48b5-ac51-75fb581487ef None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:53.113803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb524a7-e176-48b5-ac51-75fb581487ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:53.154244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dbb524a7-e176-48b5-ac51-75fb581487ef None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:53.155656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dbb524a7-e176-48b5-ac51-75fb581487ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:53.375319 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2095/4174] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:53.375772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b66d-5d1c-4d64-a5ee-cac8a6ddfa8a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:53.376221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b66d-5d1c-4d64-a5ee-cac8a6ddfa8a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:53.376632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023b66d-5d1c-4d64-a5ee-cac8a6ddfa8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:53.417162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f023b66d-5d1c-4d64-a5ee-cac8a6ddfa8a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:53.418538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f023b66d-5d1c-4d64-a5ee-cac8a6ddfa8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:53.445948 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2080/4175] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:53.448122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb524a7-e176-48b5-ac51-75fb581487ef None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:53.480613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb524a7-e176-48b5-ac51-75fb581487ef None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:53.486194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d436-c193-457c-a733-3384c7884aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:53.487130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d436-c193-457c-a733-3384c7884aee admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:53.487685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d436-c193-457c-a733-3384c7884aee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:53.488132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e5d436-c193-457c-a733-3384c7884aee admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:53.488937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5d436-c193-457c-a733-3384c7884aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:12:53.489422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5d436-c193-457c-a733-3384c7884aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:53.492300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e5d436-c193-457c-a733-3384c7884aee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:53.509573 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2096/4176] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:12:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:12:53.513613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b66d-5d1c-4d64-a5ee-cac8a6ddfa8a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:53.528172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023b66d-5d1c-4d64-a5ee-cac8a6ddfa8a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:53.545472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ae88-22fd-4aae-98d2-d036d330857c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:53.545472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ae88-22fd-4aae-98d2-d036d330857c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:53.545472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ae88-22fd-4aae-98d2-d036d330857c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:53.545472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa21ae88-22fd-4aae-98d2-d036d330857c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:53.545919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ae88-22fd-4aae-98d2-d036d330857c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:53.545919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa21ae88-22fd-4aae-98d2-d036d330857c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:53.589386 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2081/4177] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:12:53 2022] POST /identity/v3/projects => generated 393 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:12:53.594337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d436-c193-457c-a733-3384c7884aee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:53.605580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e5d436-c193-457c-a733-3384c7884aee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:53.747811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19750d5c-51d3-4d36-abbc-3f6ef6f237d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:53.748752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19750d5c-51d3-4d36-abbc-3f6ef6f237d1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:53.749235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19750d5c-51d3-4d36-abbc-3f6ef6f237d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:53.750280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19750d5c-51d3-4d36-abbc-3f6ef6f237d1 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:53.751093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19750d5c-51d3-4d36-abbc-3f6ef6f237d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:53.765427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19750d5c-51d3-4d36-abbc-3f6ef6f237d1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:53.778843 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:53.803323 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2097/4178] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:12:53 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:12:53.804204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ae88-22fd-4aae-98d2-d036d330857c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:53.825467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa21ae88-22fd-4aae-98d2-d036d330857c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:53.838318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3f8c-3b33-4dc8-9127-e10c99056b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:53.839393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3f8c-3b33-4dc8-9127-e10c99056b73 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:53.839924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3f8c-3b33-4dc8-9127-e10c99056b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:53.840354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fa3f8c-3b33-4dc8-9127-e10c99056b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:53.841408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3f8c-3b33-4dc8-9127-e10c99056b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:53.843776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fa3f8c-3b33-4dc8-9127-e10c99056b73 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:53.858771 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2082/4179] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:12:53.863508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19750d5c-51d3-4d36-abbc-3f6ef6f237d1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:53.890071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19750d5c-51d3-4d36-abbc-3f6ef6f237d1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:53.895839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc609d1-c0f1-4df3-a23b-bf4dc292ce0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:53.897341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc609d1-c0f1-4df3-a23b-bf4dc292ce0a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:53.898535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc609d1-c0f1-4df3-a23b-bf4dc292ce0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:53.899008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc609d1-c0f1-4df3-a23b-bf4dc292ce0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:53.902543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc609d1-c0f1-4df3-a23b-bf4dc292ce0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:53.905037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc609d1-c0f1-4df3-a23b-bf4dc292ce0a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:53.940994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3f8c-3b33-4dc8-9127-e10c99056b73 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:53.949513 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2098/4180] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:12:53 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:12:53.963349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fa3f8c-3b33-4dc8-9127-e10c99056b73 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:53.978059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb4efc-af31-4b06-b88e-4e32152b0d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:53.978738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb4efc-af31-4b06-b88e-4e32152b0d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:53.979214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb4efc-af31-4b06-b88e-4e32152b0d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:53.979640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb4efc-af31-4b06-b88e-4e32152b0d33 admin admin] PATH_INFO: `/v3/projects/5a7f312d12224117b8c8a1f167d901b8/users/79772a24d13244809f7dad6e8d29bd7f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:54.008938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb4efc-af31-4b06-b88e-4e32152b0d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a7f312d12224117b8c8a1f167d901b8, user_id=79772a24d13244809f7dad6e8d29bd7f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:54.015614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb4efc-af31-4b06-b88e-4e32152b0d33 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:54.037070 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2083/4181] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:12:53 2022] PUT /identity/v3/projects/5a7f312d12224117b8c8a1f167d901b8/users/79772a24d13244809f7dad6e8d29bd7f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:12:54.042512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8e3fb-f4dc-435e-9999-19b9c4f46c73 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:54.042867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8e3fb-f4dc-435e-9999-19b9c4f46c73 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:54.043150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8e3fb-f4dc-435e-9999-19b9c4f46c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:54.079571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dcf8e3fb-f4dc-435e-9999-19b9c4f46c73 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:54.087607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dcf8e3fb-f4dc-435e-9999-19b9c4f46c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:54.196399 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2099/4182] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:54.215907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb4efc-af31-4b06-b88e-4e32152b0d33 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:54.218955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-72bb4efc-af31-4b06-b88e-4e32152b0d33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:54.254649 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:54.308950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb4efc-af31-4b06-b88e-4e32152b0d33 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:54.313543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04710e34-d264-484c-a5f3-5e328c1f5b57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:54.314246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04710e34-d264-484c-a5f3-5e328c1f5b57 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:54.314594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04710e34-d264-484c-a5f3-5e328c1f5b57 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:54.315083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04710e34-d264-484c-a5f3-5e328c1f5b57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:54.326617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04710e34-d264-484c-a5f3-5e328c1f5b57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:54.328375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04710e34-d264-484c-a5f3-5e328c1f5b57 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:54.341438 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2084/4183] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:12:56.701538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8e3fb-f4dc-435e-9999-19b9c4f46c73 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:56.704036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dcf8e3fb-f4dc-435e-9999-19b9c4f46c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:56.733645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8e3fb-f4dc-435e-9999-19b9c4f46c73 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:56.753619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:56.754762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:56.755536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:56.756759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] PATH_INFO: `/v3/users/32660741092146d490982e08873cfb04` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:56.758327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32660741092146d490982e08873cfb04)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:56.761187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:56.863741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32660741092146d490982e08873cfb04'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:56.881598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32660741092146d490982e08873cfb04'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:56.882619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32660741092146d490982e08873cfb04'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:56.893828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32660741092146d490982e08873cfb04'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:56.906696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee020235-18d7-4f5a-adc3-d9b07f5f8715 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32660741092146d490982e08873cfb04'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:56.915936 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2100/4184] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:12:56 2022] DELETE /identity/v3/users/32660741092146d490982e08873cfb04 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:12:58.094554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04710e34-d264-484c-a5f3-5e328c1f5b57 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:58.113326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04710e34-d264-484c-a5f3-5e328c1f5b57 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:58.296213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:58.297674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:58.299457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:58.299897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] PATH_INFO: `/v3/projects/1d3b5e6b605e4c109a407f253b5aac17` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:58.303444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3b5e6b605e4c109a407f253b5aac17)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:58.305514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:58.421565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3b5e6b605e4c109a407f253b5aac17', 'request_id': 'req-405eb8b7-8e63-430f-a473-578cdba5cdc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:58.434615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3b5e6b605e4c109a407f253b5aac17', 'request_id': 'req-405eb8b7-8e63-430f-a473-578cdba5cdc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:58.452912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3b5e6b605e4c109a407f253b5aac17', 'request_id': 'req-405eb8b7-8e63-430f-a473-578cdba5cdc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:58.475691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] The token cache is being invalidate because project 1d3b5e6b605e4c109a407f253b5aac17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:12:58.476042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:58.478865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-405eb8b7-8e63-430f-a473-578cdba5cdc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:12:58.486937 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2085/4185] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:12:58 2022] DELETE /identity/v3/projects/1d3b5e6b605e4c109a407f253b5aac17 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:12:58.488890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a929e6-4444-4d10-b787-ddc95859837f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:58.490369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a929e6-4444-4d10-b787-ddc95859837f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:58.490369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a929e6-4444-4d10-b787-ddc95859837f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:58.552596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-42a929e6-4444-4d10-b787-ddc95859837f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:58.554005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42a929e6-4444-4d10-b787-ddc95859837f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:58.657564 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:58.687397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2101/4186] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:58.689803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902b5c9-12d1-4bd2-8f58-cca674074960 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:58.690207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902b5c9-12d1-4bd2-8f58-cca674074960 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:58.691440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c902b5c9-12d1-4bd2-8f58-cca674074960 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:58.739644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c902b5c9-12d1-4bd2-8f58-cca674074960 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:58.741688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c902b5c9-12d1-4bd2-8f58-cca674074960 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:58.753019 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2086/4187] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:58.758436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a929e6-4444-4d10-b787-ddc95859837f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:58.775742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a929e6-4444-4d10-b787-ddc95859837f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:58.782371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a2e7-b507-4c2a-be89-a11cb98c4bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:58.783095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a2e7-b507-4c2a-be89-a11cb98c4bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:58.783453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a2e7-b507-4c2a-be89-a11cb98c4bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:58.783801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d9a2e7-b507-4c2a-be89-a11cb98c4bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:58.784536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a2e7-b507-4c2a-be89-a11cb98c4bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:12:58.784912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a2e7-b507-4c2a-be89-a11cb98c4bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:58.786679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d9a2e7-b507-4c2a-be89-a11cb98c4bb9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:58.803799 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2102/4188] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:12:58.809328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902b5c9-12d1-4bd2-8f58-cca674074960 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:58.823493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c902b5c9-12d1-4bd2-8f58-cca674074960 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:58.829788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c749b40-ac00-4afb-a300-19bccc9f608c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:58.831017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c749b40-ac00-4afb-a300-19bccc9f608c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:58.831452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c749b40-ac00-4afb-a300-19bccc9f608c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:58.831758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c749b40-ac00-4afb-a300-19bccc9f608c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:58.832580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c749b40-ac00-4afb-a300-19bccc9f608c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:58.836283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c749b40-ac00-4afb-a300-19bccc9f608c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:58.895507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2087/4189] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:12:58 2022] POST /identity/v3/projects => generated 371 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:12:58.900281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a2e7-b507-4c2a-be89-a11cb98c4bb9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:58.923253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d9a2e7-b507-4c2a-be89-a11cb98c4bb9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:59.050118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ab606-4381-4966-89b7-80208a9d573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:59.050958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab606-4381-4966-89b7-80208a9d573c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:59.051431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab606-4381-4966-89b7-80208a9d573c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:59.051990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4ab606-4381-4966-89b7-80208a9d573c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:59.052881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ab606-4381-4966-89b7-80208a9d573c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:59.055199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4ab606-4381-4966-89b7-80208a9d573c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:59.094474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c749b40-ac00-4afb-a300-19bccc9f608c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:59.101174 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2103/4190] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:12:58 2022] POST /identity/v3/users => generated 286 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:12:59.106900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c749b40-ac00-4afb-a300-19bccc9f608c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:59.112818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1b466-c785-41a5-916c-7159e85298bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:59.113474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1b466-c785-41a5-916c-7159e85298bc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:59.113760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1b466-c785-41a5-916c-7159e85298bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:59.114600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc1b466-c785-41a5-916c-7159e85298bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:59.114725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1b466-c785-41a5-916c-7159e85298bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:59.116327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc1b466-c785-41a5-916c-7159e85298bc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:59.134627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ab606-4381-4966-89b7-80208a9d573c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:59.135751 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2088/4191] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:12:59.148550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4ab606-4381-4966-89b7-80208a9d573c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:59.175090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345d6cf5-b7e4-48fc-8eef-b334b581f461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:59.175090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6cf5-b7e4-48fc-8eef-b334b581f461 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:59.175090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6cf5-b7e4-48fc-8eef-b334b581f461 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:59.175090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345d6cf5-b7e4-48fc-8eef-b334b581f461 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:59.175887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6cf5-b7e4-48fc-8eef-b334b581f461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:59.175887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345d6cf5-b7e4-48fc-8eef-b334b581f461 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:59.199034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1b466-c785-41a5-916c-7159e85298bc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:59.206110 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2104/4192] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:12:59.211247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc1b466-c785-41a5-916c-7159e85298bc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:59.232324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbca920f-6de1-4b6b-b3bf-8be29f9b8bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:59.233101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca920f-6de1-4b6b-b3bf-8be29f9b8bec admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:59.233490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca920f-6de1-4b6b-b3bf-8be29f9b8bec admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:59.233845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbca920f-6de1-4b6b-b3bf-8be29f9b8bec admin admin] PATH_INFO: `/v3/projects/4d6d22d767ae45c5a743f1ea344a3d9e/users/f80f666981ad4c04b1122d6d640065e8/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:59.276017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca920f-6de1-4b6b-b3bf-8be29f9b8bec admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d6d22d767ae45c5a743f1ea344a3d9e, user_id=f80f666981ad4c04b1122d6d640065e8, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:59.282309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbca920f-6de1-4b6b-b3bf-8be29f9b8bec admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:59.289106 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:59.317367 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2089/4193] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:12:59 2022] PUT /identity/v3/projects/4d6d22d767ae45c5a743f1ea344a3d9e/users/f80f666981ad4c04b1122d6d640065e8/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:12:59.329682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46b91f-23c1-409d-a2d3-f4904b953071 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:59.329997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46b91f-23c1-409d-a2d3-f4904b953071 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:59.330660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a46b91f-23c1-409d-a2d3-f4904b953071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:59.388348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3a46b91f-23c1-409d-a2d3-f4904b953071 None None] MFA Rules not processed for user `f80f666981ad4c04b1122d6d640065e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:59.389712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3a46b91f-23c1-409d-a2d3-f4904b953071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:59.492729 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2105/4194] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:59.504603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd8a7c-2bad-4eeb-b6cd-478c44e1d207 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:59.505597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd8a7c-2bad-4eeb-b6cd-478c44e1d207 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:59.506216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cd8a7c-2bad-4eeb-b6cd-478c44e1d207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:59.559849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-23cd8a7c-2bad-4eeb-b6cd-478c44e1d207 None None] MFA Rules not processed for user `f80f666981ad4c04b1122d6d640065e8`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:12:59.561084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-23cd8a7c-2bad-4eeb-b6cd-478c44e1d207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:59.570259 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2090/4195] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:12:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:12:59.583482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46b91f-23c1-409d-a2d3-f4904b953071 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:12:59.583482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3a46b91f-23c1-409d-a2d3-f4904b953071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:12:59.705705 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:12:59.764020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a46b91f-23c1-409d-a2d3-f4904b953071 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:12:59.772920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e3a88-4d32-4945-b170-1c15431318c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:12:59.774152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e3a88-4d32-4945-b170-1c15431318c3 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:12:59.774585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e3a88-4d32-4945-b170-1c15431318c3 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:12:59.774996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60e3a88-4d32-4945-b170-1c15431318c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:12:59.786142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e3a88-4d32-4945-b170-1c15431318c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:12:59.788135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60e3a88-4d32-4945-b170-1c15431318c3 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:12:59.799770 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2106/4196] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:12:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:00.306470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf989af-58ea-4f6b-8e63-0f6cd880f5b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:00.307143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf989af-58ea-4f6b-8e63-0f6cd880f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:00.307527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf989af-58ea-4f6b-8e63-0f6cd880f5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:00.360314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-faf989af-58ea-4f6b-8e63-0f6cd880f5b9 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:00.364426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-faf989af-58ea-4f6b-8e63-0f6cd880f5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:00.487584 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2091/4197] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:13:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:00.507504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e3a88-4d32-4945-b170-1c15431318c3 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:00.510176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d60e3a88-4d32-4945-b170-1c15431318c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:00.678601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60e3a88-4d32-4945-b170-1c15431318c3 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:00.687977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288e71-02f5-4b3f-b3af-298fa4598297 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:00.688883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288e71-02f5-4b3f-b3af-298fa4598297 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:00.689250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288e71-02f5-4b3f-b3af-298fa4598297 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:00.689584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42288e71-02f5-4b3f-b3af-298fa4598297 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:00.700447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42288e71-02f5-4b3f-b3af-298fa4598297 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:00.702108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42288e71-02f5-4b3f-b3af-298fa4598297 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:00.712868 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2107/4198] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:13:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:13:00.914306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237c288-1314-45c9-9327-e8277456a65c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:00.914885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237c288-1314-45c9-9327-e8277456a65c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:00.915727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b237c288-1314-45c9-9327-e8277456a65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:00.979993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b237c288-1314-45c9-9327-e8277456a65c None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:00.981540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b237c288-1314-45c9-9327-e8277456a65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:00.991661 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2092/4199] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:13:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:01.009826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288e71-02f5-4b3f-b3af-298fa4598297 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:01.024514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42288e71-02f5-4b3f-b3af-298fa4598297 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:01.048640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e69a1-1f01-4ab1-8d3e-ea8131886cbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:01.049638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e69a1-1f01-4ab1-8d3e-ea8131886cbc service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:01.050164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e69a1-1f01-4ab1-8d3e-ea8131886cbc service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:01.052025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e69a1-1f01-4ab1-8d3e-ea8131886cbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:01.069947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e69a1-1f01-4ab1-8d3e-ea8131886cbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:01.072718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138e69a1-1f01-4ab1-8d3e-ea8131886cbc service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:01.086414 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2108/4200] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:13:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:13:01.590423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088080f5-1e09-427d-a64e-28131167f067 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:01.591306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088080f5-1e09-427d-a64e-28131167f067 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:01.591599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088080f5-1e09-427d-a64e-28131167f067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:01.617672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-088080f5-1e09-427d-a64e-28131167f067 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:01.623385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-088080f5-1e09-427d-a64e-28131167f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:01.636879 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2093/4201] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:13:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:01.651803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e69a1-1f01-4ab1-8d3e-ea8131886cbc service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:01.670056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138e69a1-1f01-4ab1-8d3e-ea8131886cbc service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:01.679527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf7e164-a8e5-4a12-8840-4667fb4b683e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:01.682283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7e164-a8e5-4a12-8840-4667fb4b683e service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:01.682834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7e164-a8e5-4a12-8840-4667fb4b683e service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:01.683443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf7e164-a8e5-4a12-8840-4667fb4b683e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:01.700262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7e164-a8e5-4a12-8840-4667fb4b683e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:01.704639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf7e164-a8e5-4a12-8840-4667fb4b683e service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:01.733064 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2109/4202] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:13:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:13:01.883740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088080f5-1e09-427d-a64e-28131167f067 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:01.885465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-088080f5-1e09-427d-a64e-28131167f067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:02.031157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088080f5-1e09-427d-a64e-28131167f067 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:02.040709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:02.041405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:02.041942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:02.042458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] PATH_INFO: `/v3/users/af8778dae08a4ab6b012ceda5af5564e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:02.043913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8778dae08a4ab6b012ceda5af5564e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:02.046108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:02.115598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8778dae08a4ab6b012ceda5af5564e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:02.147370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8778dae08a4ab6b012ceda5af5564e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:02.148603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8778dae08a4ab6b012ceda5af5564e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:02.162784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8778dae08a4ab6b012ceda5af5564e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:02.178149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8778dae08a4ab6b012ceda5af5564e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:02.180655 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:02.187266 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2094/4203] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:01 2022] DELETE /identity/v3/users/af8778dae08a4ab6b012ceda5af5564e => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:02.192717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd7d96-7586-4873-8799-60652e840ccc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:02.193554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd7d96-7586-4873-8799-60652e840ccc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:02.194006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fd7d96-7586-4873-8799-60652e840ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:02.221911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-71fd7d96-7586-4873-8799-60652e840ccc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:02.223631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-71fd7d96-7586-4873-8799-60652e840ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:02.308615 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2110/4204] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:02.341642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:02.344282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:02.431874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce8a3f8-6574-48f6-bb71-e325888ab9c0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:02.436528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482f2f6a-5852-4ba3-8fcb-3cf4331707c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:02.437564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f2f6a-5852-4ba3-8fcb-3cf4331707c1 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:02.438067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f2f6a-5852-4ba3-8fcb-3cf4331707c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:02.438574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482f2f6a-5852-4ba3-8fcb-3cf4331707c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:02.451854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f2f6a-5852-4ba3-8fcb-3cf4331707c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:02.453603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482f2f6a-5852-4ba3-8fcb-3cf4331707c1 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:02.467021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2095/4205] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:03.667176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd7d96-7586-4873-8799-60652e840ccc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:03.669050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-71fd7d96-7586-4873-8799-60652e840ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:03.695438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fd7d96-7586-4873-8799-60652e840ccc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:03.708913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:03.711130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:03.711589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:03.712126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] PATH_INFO: `/v3/projects/062ef54f319941dda2c197b8f71d2a7e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:03.715362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=062ef54f319941dda2c197b8f71d2a7e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:03.717941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:03.866113 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:03.914485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '062ef54f319941dda2c197b8f71d2a7e', 'request_id': 'req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:03.947113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '062ef54f319941dda2c197b8f71d2a7e', 'request_id': 'req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:03.963437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '062ef54f319941dda2c197b8f71d2a7e', 'request_id': 'req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:03.979667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] The token cache is being invalidate because project 062ef54f319941dda2c197b8f71d2a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:03.980309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:03.982413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f8ed4fc0-9414-46d0-a70b-4d6af6e60f8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:03.984440 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2111/4206] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:03 2022] DELETE /identity/v3/projects/062ef54f319941dda2c197b8f71d2a7e => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:03.989440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43804064-9955-4121-ba94-699baf78e723 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:03.991284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43804064-9955-4121-ba94-699baf78e723 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:03.991721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43804064-9955-4121-ba94-699baf78e723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:04.046331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-43804064-9955-4121-ba94-699baf78e723 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:04.049691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-43804064-9955-4121-ba94-699baf78e723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:04.212393 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2096/4207] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:04.221016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097dc3d-c198-4878-9309-f6090235fc8e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:04.221826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097dc3d-c198-4878-9309-f6090235fc8e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:04.222358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b097dc3d-c198-4878-9309-f6090235fc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:04.277471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b097dc3d-c198-4878-9309-f6090235fc8e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:04.279846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b097dc3d-c198-4878-9309-f6090235fc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:04.303206 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2112/4208] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:04.307278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43804064-9955-4121-ba94-699baf78e723 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:04.321423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43804064-9955-4121-ba94-699baf78e723 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:04.336138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:04.339674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:04.339674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:04.339674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:04.339674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:04.339674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:04.343640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:04.381548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097dc3d-c198-4878-9309-f6090235fc8e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:04.386879 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2097/4209] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:13:04.392878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b097dc3d-c198-4878-9309-f6090235fc8e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:04.396875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:04.399667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:04.412547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16187d30-e168-4e0c-81f3-b28411123d24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:04.413364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16187d30-e168-4e0c-81f3-b28411123d24 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:04.415737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16187d30-e168-4e0c-81f3-b28411123d24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:04.416212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16187d30-e168-4e0c-81f3-b28411123d24 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:04.417098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16187d30-e168-4e0c-81f3-b28411123d24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:04.430761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16187d30-e168-4e0c-81f3-b28411123d24 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:04.436611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136ca0f7-4fb0-4263-92d5-75f342383c0a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:04.452716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:04.453474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:04.454618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:04.455448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] PATH_INFO: `/v3/users/e6a6b9e09beb4f8db1d9fcb7bb04e04a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:04.459288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6a6b9e09beb4f8db1d9fcb7bb04e04a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:04.465893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:04.503162 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2113/4210] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:04 2022] POST /identity/v3/projects => generated 373 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:04.509449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16187d30-e168-4e0c-81f3-b28411123d24 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:04.557377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6a6b9e09beb4f8db1d9fcb7bb04e04a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:04.601541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6a6b9e09beb4f8db1d9fcb7bb04e04a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:04.608557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6a6b9e09beb4f8db1d9fcb7bb04e04a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:04.627481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6a6b9e09beb4f8db1d9fcb7bb04e04a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:04.653449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-855fa489-80ca-4161-bb4a-568d9c80b204 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6a6b9e09beb4f8db1d9fcb7bb04e04a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:04.661109 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:04.669104 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2098/4211] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:04 2022] DELETE /identity/v3/users/e6a6b9e09beb4f8db1d9fcb7bb04e04a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:04.673992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce4fa9-75ee-43d3-887e-f98748ca0aff None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:04.675368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce4fa9-75ee-43d3-887e-f98748ca0aff None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:04.675626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dce4fa9-75ee-43d3-887e-f98748ca0aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:04.713464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16187d30-e168-4e0c-81f3-b28411123d24 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:04.724592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5dce4fa9-75ee-43d3-887e-f98748ca0aff None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:04.727804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5dce4fa9-75ee-43d3-887e-f98748ca0aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:04.872764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8bf2-8b1c-45fb-9b9a-aae6e78b7ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:04.874497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8bf2-8b1c-45fb-9b9a-aae6e78b7ce5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:04.875603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8bf2-8b1c-45fb-9b9a-aae6e78b7ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:04.875603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cb8bf2-8b1c-45fb-9b9a-aae6e78b7ce5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:04.875828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb8bf2-8b1c-45fb-9b9a-aae6e78b7ce5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:04.881913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cb8bf2-8b1c-45fb-9b9a-aae6e78b7ce5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:04.905838 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2099/4212] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:04.940797 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2114/4213] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:04 2022] POST /identity/v3/users => generated 287 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:04.945337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce4fa9-75ee-43d3-887e-f98748ca0aff None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:04.946753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5dce4fa9-75ee-43d3-887e-f98748ca0aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:04.967256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dce4fa9-75ee-43d3-887e-f98748ca0aff None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:04.974189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb5c4c-defd-4b44-8c74-2c1fad841ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:04.974918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb5c4c-defd-4b44-8c74-2c1fad841ab8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:04.975198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb5c4c-defd-4b44-8c74-2c1fad841ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:04.975472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fb5c4c-defd-4b44-8c74-2c1fad841ab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:04.976126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb5c4c-defd-4b44-8c74-2c1fad841ab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:04.977862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fb5c4c-defd-4b44-8c74-2c1fad841ab8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:04.993821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8bf2-8b1c-45fb-9b9a-aae6e78b7ce5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:04.995985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-95cb8bf2-8b1c-45fb-9b9a-aae6e78b7ce5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:05.007094 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2100/4214] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:04 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:05.008613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb5c4c-defd-4b44-8c74-2c1fad841ab8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:05.042961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fb5c4c-defd-4b44-8c74-2c1fad841ab8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:05.062434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cc624-77fa-4e1c-b33f-f486e2052d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:05.063406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cc624-77fa-4e1c-b33f-f486e2052d82 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:05.063796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cc624-77fa-4e1c-b33f-f486e2052d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:05.064650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1cc624-77fa-4e1c-b33f-f486e2052d82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:05.065452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cc624-77fa-4e1c-b33f-f486e2052d82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:05.067431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1cc624-77fa-4e1c-b33f-f486e2052d82 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:05.084792 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2101/4215] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:05 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:05.086566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cc624-77fa-4e1c-b33f-f486e2052d82 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:05.087450 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:05.122318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1cc624-77fa-4e1c-b33f-f486e2052d82 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:05.137828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cb8bf2-8b1c-45fb-9b9a-aae6e78b7ce5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:05.150096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4babc-2ab5-48aa-ae71-eb25765981fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:05.150815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4babc-2ab5-48aa-ae71-eb25765981fb admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:05.151203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4babc-2ab5-48aa-ae71-eb25765981fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:05.151369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade4babc-2ab5-48aa-ae71-eb25765981fb admin admin] PATH_INFO: `/v3/projects/302e20a71db842a38a9621bac995e083/users/c32503ad06d54903aa2eaec5b53bc3b0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:05.159019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ecc063-5e12-4b05-9a03-f9693a1d39bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:05.160055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc063-5e12-4b05-9a03-f9693a1d39bd service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:05.160507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc063-5e12-4b05-9a03-f9693a1d39bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:05.161041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ecc063-5e12-4b05-9a03-f9693a1d39bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:05.190733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecc063-5e12-4b05-9a03-f9693a1d39bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:05.192212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ecc063-5e12-4b05-9a03-f9693a1d39bd service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:05.193852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4babc-2ab5-48aa-ae71-eb25765981fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=302e20a71db842a38a9621bac995e083, user_id=c32503ad06d54903aa2eaec5b53bc3b0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:05.196810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade4babc-2ab5-48aa-ae71-eb25765981fb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:05.216320 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2115/4216] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:13:05.223771 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2102/4217] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:05 2022] PUT /identity/v3/projects/302e20a71db842a38a9621bac995e083/users/c32503ad06d54903aa2eaec5b53bc3b0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:05.235090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed060f-ef68-41f2-b14a-0abf91b990b3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:05.235377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed060f-ef68-41f2-b14a-0abf91b990b3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:05.235652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fed060f-ef68-41f2-b14a-0abf91b990b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:05.274630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4fed060f-ef68-41f2-b14a-0abf91b990b3 None None] MFA Rules not processed for user `c32503ad06d54903aa2eaec5b53bc3b0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:05.276038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4fed060f-ef68-41f2-b14a-0abf91b990b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:05.383394 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2116/4218] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:05.631957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4babc-2ab5-48aa-ae71-eb25765981fb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:05.636741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ade4babc-2ab5-48aa-ae71-eb25765981fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:05.856056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade4babc-2ab5-48aa-ae71-eb25765981fb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:05.874438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf750e-166c-4045-bd1d-e0f8e0a2d3ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:05.875258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf750e-166c-4045-bd1d-e0f8e0a2d3ac service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:05.875669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf750e-166c-4045-bd1d-e0f8e0a2d3ac service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:05.876064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf750e-166c-4045-bd1d-e0f8e0a2d3ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:05.895591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf750e-166c-4045-bd1d-e0f8e0a2d3ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:05.901137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf750e-166c-4045-bd1d-e0f8e0a2d3ac service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:05.925127 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2103/4219] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:07.030782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed060f-ef68-41f2-b14a-0abf91b990b3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:07.155346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fed060f-ef68-41f2-b14a-0abf91b990b3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:07.160155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:07.161168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:07.161168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:07.161480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] PATH_INFO: `/v3/users/c32503ad06d54903aa2eaec5b53bc3b0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:07.162961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32503ad06d54903aa2eaec5b53bc3b0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:07.164788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:07.230433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32503ad06d54903aa2eaec5b53bc3b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.250185 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:07.251079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32503ad06d54903aa2eaec5b53bc3b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.253816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32503ad06d54903aa2eaec5b53bc3b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.269933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32503ad06d54903aa2eaec5b53bc3b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.294504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32503ad06d54903aa2eaec5b53bc3b0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.309396 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2117/4220] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:07 2022] DELETE /identity/v3/users/c32503ad06d54903aa2eaec5b53bc3b0 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:07.314919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d20f4d-0ec5-42ee-a22f-19288560c908 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:07.315790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d20f4d-0ec5-42ee-a22f-19288560c908 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:07.316241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d20f4d-0ec5-42ee-a22f-19288560c908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:07.400889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:07.403325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:07.403919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-18d20f4d-0ec5-42ee-a22f-19288560c908 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:07.405103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-18d20f4d-0ec5-42ee-a22f-19288560c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:07.502162 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:07.529724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cec1f0-c5ca-4d0a-a149-af08d83e2e56 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:07.530517 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2104/4221] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:07.537614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:07.538262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:07.538541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:07.538808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] PATH_INFO: `/v3/projects/4a9eeb3ce71a477b9f0a4b3ef4f42058` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:07.540146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a9eeb3ce71a477b9f0a4b3ef4f42058)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:07.542074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:07.589035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d20f4d-0ec5-42ee-a22f-19288560c908 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:07.594667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-18d20f4d-0ec5-42ee-a22f-19288560c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:07.611458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a9eeb3ce71a477b9f0a4b3ef4f42058', 'request_id': 'req-c42d142c-995b-4a76-87a0-87ae96079296'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.627541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a9eeb3ce71a477b9f0a4b3ef4f42058', 'request_id': 'req-c42d142c-995b-4a76-87a0-87ae96079296'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.643900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a9eeb3ce71a477b9f0a4b3ef4f42058', 'request_id': 'req-c42d142c-995b-4a76-87a0-87ae96079296'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.663477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] The token cache is being invalidate because project 4a9eeb3ce71a477b9f0a4b3ef4f42058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:07.664095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.666884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c42d142c-995b-4a76-87a0-87ae96079296 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:07.669109 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2118/4222] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:07 2022] DELETE /identity/v3/projects/4a9eeb3ce71a477b9f0a4b3ef4f42058 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:13:07.674288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae508682-667f-43f4-8929-2e9174ed98b3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:07.674964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae508682-667f-43f4-8929-2e9174ed98b3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:07.675437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae508682-667f-43f4-8929-2e9174ed98b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:07.712393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ae508682-667f-43f4-8929-2e9174ed98b3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:07.713943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ae508682-667f-43f4-8929-2e9174ed98b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:07.749174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d20f4d-0ec5-42ee-a22f-19288560c908 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:07.815327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2119/4223] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:07.824697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab1a6-8ac3-4cf7-949c-5016091fc9a8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:07.825179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab1a6-8ac3-4cf7-949c-5016091fc9a8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:07.825655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ab1a6-8ac3-4cf7-949c-5016091fc9a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:07.863772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e5fd-207b-49ee-b40b-f8c508249b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:07.865186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e5fd-207b-49ee-b40b-f8c508249b1c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:07.865621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e5fd-207b-49ee-b40b-f8c508249b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:07.865899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a6e5fd-207b-49ee-b40b-f8c508249b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:07.868613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16a6e5fd-207b-49ee-b40b-f8c508249b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:07.877228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-db6ab1a6-8ac3-4cf7-949c-5016091fc9a8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:07.881602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-db6ab1a6-8ac3-4cf7-949c-5016091fc9a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:07.888174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6e5fd-207b-49ee-b40b-f8c508249b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:07.889775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a6e5fd-207b-49ee-b40b-f8c508249b1c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:07.912256 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2120/4224] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:07.916236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ab1a6-8ac3-4cf7-949c-5016091fc9a8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:07.931324 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2105/4225] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:13:07.931814 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:07.936870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ab1a6-8ac3-4cf7-949c-5016091fc9a8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:07.945117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c78bef-0006-4016-a282-5cc77664cf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:07.947334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c78bef-0006-4016-a282-5cc77664cf48 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:07.947744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c78bef-0006-4016-a282-5cc77664cf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:07.948543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c78bef-0006-4016-a282-5cc77664cf48 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:07.949320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c78bef-0006-4016-a282-5cc77664cf48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:07.950242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c78bef-0006-4016-a282-5cc77664cf48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:07.951443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c78bef-0006-4016-a282-5cc77664cf48 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:07.969489 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2121/4226] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:13:07.971802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e5fd-207b-49ee-b40b-f8c508249b1c service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:07.984866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a6e5fd-207b-49ee-b40b-f8c508249b1c service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:07.996168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0c013-d97b-48dc-af38-8817cb327b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:07.996654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c013-d97b-48dc-af38-8817cb327b87 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:07.996946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c013-d97b-48dc-af38-8817cb327b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:07.997641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a0c013-d97b-48dc-af38-8817cb327b87 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:07.997901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0c013-d97b-48dc-af38-8817cb327b87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:08.000321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a0c013-d97b-48dc-af38-8817cb327b87 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:08.062750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c78bef-0006-4016-a282-5cc77664cf48 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:08.069403 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2106/4227] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:07 2022] POST /identity/v3/projects => generated 375 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:08.077708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c78bef-0006-4016-a282-5cc77664cf48 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:08.265046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708eaaf-6987-4c04-8035-3ce4a1fdaab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:08.266019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708eaaf-6987-4c04-8035-3ce4a1fdaab6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:08.266318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708eaaf-6987-4c04-8035-3ce4a1fdaab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:08.266612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708eaaf-6987-4c04-8035-3ce4a1fdaab6 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:08.267261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708eaaf-6987-4c04-8035-3ce4a1fdaab6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:08.277856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5708eaaf-6987-4c04-8035-3ce4a1fdaab6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:08.350842 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2122/4228] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:08 2022] POST /identity/v3/users => generated 288 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:08.353905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0c013-d97b-48dc-af38-8817cb327b87 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:08.369008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a0c013-d97b-48dc-af38-8817cb327b87 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:08.384849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99555a0e-9019-4833-acb1-4dac4315008a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:08.385715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99555a0e-9019-4833-acb1-4dac4315008a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:08.386095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99555a0e-9019-4833-acb1-4dac4315008a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:08.386615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99555a0e-9019-4833-acb1-4dac4315008a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:08.387368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99555a0e-9019-4833-acb1-4dac4315008a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:08.389083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99555a0e-9019-4833-acb1-4dac4315008a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:08.413590 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2107/4229] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:08.417549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708eaaf-6987-4c04-8035-3ce4a1fdaab6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:08.434237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708eaaf-6987-4c04-8035-3ce4a1fdaab6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:08.439910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f3ca6-941c-4b1b-85b6-89abc80fd7ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:08.440642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f3ca6-941c-4b1b-85b6-89abc80fd7ec admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:08.441004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f3ca6-941c-4b1b-85b6-89abc80fd7ec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:08.441384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f3ca6-941c-4b1b-85b6-89abc80fd7ec admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:08.442287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f3ca6-941c-4b1b-85b6-89abc80fd7ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:08.444198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f3ca6-941c-4b1b-85b6-89abc80fd7ec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:08.486917 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2123/4230] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:08 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:13:08.491944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99555a0e-9019-4833-acb1-4dac4315008a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:08.507759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99555a0e-9019-4833-acb1-4dac4315008a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:08.513690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9416f9-09f1-4e21-8712-4ab77d4466f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:08.514359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9416f9-09f1-4e21-8712-4ab77d4466f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:08.514722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9416f9-09f1-4e21-8712-4ab77d4466f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:08.515002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9416f9-09f1-4e21-8712-4ab77d4466f4 admin admin] PATH_INFO: `/v3/projects/75060d27b5d34928a37204f3e97a6faf/users/78c0bdf9416d4a20850799146fea13dc/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:08.535993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9416f9-09f1-4e21-8712-4ab77d4466f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=75060d27b5d34928a37204f3e97a6faf, user_id=78c0bdf9416d4a20850799146fea13dc, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:08.540686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9416f9-09f1-4e21-8712-4ab77d4466f4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:08.581574 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2108/4231] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:08 2022] PUT /identity/v3/projects/75060d27b5d34928a37204f3e97a6faf/users/78c0bdf9416d4a20850799146fea13dc/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:08.592137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab1d4-ca6b-41b1-a2b3-cff6d645c4e4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:08.592438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab1d4-ca6b-41b1-a2b3-cff6d645c4e4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:08.592723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ab1d4-ca6b-41b1-a2b3-cff6d645c4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:08.672948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-347ab1d4-ca6b-41b1-a2b3-cff6d645c4e4 None None] MFA Rules not processed for user `78c0bdf9416d4a20850799146fea13dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:08.676107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-347ab1d4-ca6b-41b1-a2b3-cff6d645c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:08.827497 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2124/4232] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:08.850494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9416f9-09f1-4e21-8712-4ab77d4466f4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:08.854088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8e9416f9-09f1-4e21-8712-4ab77d4466f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:08.858522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ab1d4-ca6b-41b1-a2b3-cff6d645c4e4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:08.860240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-347ab1d4-ca6b-41b1-a2b3-cff6d645c4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:08.916859 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:08.937774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9416f9-09f1-4e21-8712-4ab77d4466f4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:08.941770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a32e7-4961-45ce-8b5e-b9b950199417 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:08.942484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a32e7-4961-45ce-8b5e-b9b950199417 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:08.943400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a32e7-4961-45ce-8b5e-b9b950199417 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:08.943754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a32e7-4961-45ce-8b5e-b9b950199417 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:08.956131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a32e7-4961-45ce-8b5e-b9b950199417 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:08.959540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a32e7-4961-45ce-8b5e-b9b950199417 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:08.971795 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2109/4233] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:09.003423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a32e7-4961-45ce-8b5e-b9b950199417 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:09.017565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ab1d4-ca6b-41b1-a2b3-cff6d645c4e4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:09.031122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b21263-0416-4ec6-a3df-c2f8f31bc67a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:09.032022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b21263-0416-4ec6-a3df-c2f8f31bc67a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:09.034902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b21263-0416-4ec6-a3df-c2f8f31bc67a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:09.034902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b21263-0416-4ec6-a3df-c2f8f31bc67a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:09.041509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-12b21263-0416-4ec6-a3df-c2f8f31bc67a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:09.073589 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:09.159618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a32e7-4961-45ce-8b5e-b9b950199417 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:09.167532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:09.168925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:09.169218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:09.169535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] PATH_INFO: `/v3/users/78c0bdf9416d4a20850799146fea13dc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:09.170845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78c0bdf9416d4a20850799146fea13dc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:09.172885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:09.227410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b21263-0416-4ec6-a3df-c2f8f31bc67a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:09.232252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b21263-0416-4ec6-a3df-c2f8f31bc67a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:09.257586 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2125/4234] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:09.283698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78c0bdf9416d4a20850799146fea13dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:09.300019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78c0bdf9416d4a20850799146fea13dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:09.300880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78c0bdf9416d4a20850799146fea13dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:09.320079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78c0bdf9416d4a20850799146fea13dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:09.330261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78c0bdf9416d4a20850799146fea13dc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:09.340977 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2110/4235] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:09 2022] DELETE /identity/v3/users/78c0bdf9416d4a20850799146fea13dc => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:09.346031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0475515-2612-485f-9ef6-11539e8b77e5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:09.346689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0475515-2612-485f-9ef6-11539e8b77e5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:09.348316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0475515-2612-485f-9ef6-11539e8b77e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:09.383159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c0475515-2612-485f-9ef6-11539e8b77e5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:09.385072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c0475515-2612-485f-9ef6-11539e8b77e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:09.493142 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2126/4236] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:09.528320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:09.531480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:09.639183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e05389-e338-4244-8705-0abc6a2b9e04 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:09.644554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3479-0675-4341-97db-34dd727d3cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:09.646363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3479-0675-4341-97db-34dd727d3cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:09.646680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3479-0675-4341-97db-34dd727d3cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:09.646959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa3479-0675-4341-97db-34dd727d3cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:09.675022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3479-0675-4341-97db-34dd727d3cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:09.678552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa3479-0675-4341-97db-34dd727d3cf4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:09.695421 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2111/4237] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:09.868683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0475515-2612-485f-9ef6-11539e8b77e5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:09.871216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c0475515-2612-485f-9ef6-11539e8b77e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:09.879341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3479-0675-4341-97db-34dd727d3cf4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:09.881568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7afa3479-0675-4341-97db-34dd727d3cf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:09.888275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0475515-2612-485f-9ef6-11539e8b77e5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:09.895087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:09.895863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:09.896838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:09.897244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] PATH_INFO: `/v3/users/c8cc22ca64db4c86827f1262cdddf2d7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:09.898758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8cc22ca64db4c86827f1262cdddf2d7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:09.901162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:09.905550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa3479-0675-4341-97db-34dd727d3cf4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:09.916355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:09.917000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:09.917279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:09.917581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] PATH_INFO: `/v3/projects/302e20a71db842a38a9621bac995e083` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:09.918859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=302e20a71db842a38a9621bac995e083)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:09.920796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:09.928024 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:09.979224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8cc22ca64db4c86827f1262cdddf2d7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.008243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8cc22ca64db4c86827f1262cdddf2d7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.010045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8cc22ca64db4c86827f1262cdddf2d7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.022755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8cc22ca64db4c86827f1262cdddf2d7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.027284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '302e20a71db842a38a9621bac995e083', 'request_id': 'req-e7433d6d-4507-47d6-8cbd-aa257a62bba9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.034061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6db2f32c-aef6-40b5-87ce-f53ac4ecee81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8cc22ca64db4c86827f1262cdddf2d7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.040966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '302e20a71db842a38a9621bac995e083', 'request_id': 'req-e7433d6d-4507-47d6-8cbd-aa257a62bba9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.047151 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2127/4238] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:09 2022] DELETE /identity/v3/users/c8cc22ca64db4c86827f1262cdddf2d7 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:10.056590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '302e20a71db842a38a9621bac995e083', 'request_id': 'req-e7433d6d-4507-47d6-8cbd-aa257a62bba9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.071462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] The token cache is being invalidate because project 302e20a71db842a38a9621bac995e083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:10.072116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.073214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e7433d6d-4507-47d6-8cbd-aa257a62bba9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:10.075843 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2112/4239] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:09 2022] DELETE /identity/v3/projects/302e20a71db842a38a9621bac995e083 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:13:10.080846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376e2f-9976-4520-8efe-42f9c11feb08 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:10.081504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376e2f-9976-4520-8efe-42f9c11feb08 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:10.081759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93376e2f-9976-4520-8efe-42f9c11feb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:10.118585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-93376e2f-9976-4520-8efe-42f9c11feb08 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:10.120402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93376e2f-9976-4520-8efe-42f9c11feb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:10.155584 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:10.229510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60c051-f4e5-4567-af2f-a7cb748346dc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:10.229807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60c051-f4e5-4567-af2f-a7cb748346dc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:10.230395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f60c051-f4e5-4567-af2f-a7cb748346dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:10.234347 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2128/4240] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:10.276433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7f60c051-f4e5-4567-af2f-a7cb748346dc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:10.282482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7f60c051-f4e5-4567-af2f-a7cb748346dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:10.310364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376e2f-9976-4520-8efe-42f9c11feb08 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:10.326439 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2113/4241] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:10.328537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93376e2f-9976-4520-8efe-42f9c11feb08 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:10.339035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2b8f1-5eed-4b4f-83f9-42b3290fe8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:10.339668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2b8f1-5eed-4b4f-83f9-42b3290fe8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:10.339949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2b8f1-5eed-4b4f-83f9-42b3290fe8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:10.340221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e2b8f1-5eed-4b4f-83f9-42b3290fe8e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:10.340872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2b8f1-5eed-4b4f-83f9-42b3290fe8e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:10.341174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2b8f1-5eed-4b4f-83f9-42b3290fe8e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:10.343858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e2b8f1-5eed-4b4f-83f9-42b3290fe8e1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:10.369825 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2129/4242] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:13:10.374763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60c051-f4e5-4567-af2f-a7cb748346dc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:10.385047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f60c051-f4e5-4567-af2f-a7cb748346dc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:10.390210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2bc47-9706-4d2e-9aef-e5bf6e2792b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:10.390971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2bc47-9706-4d2e-9aef-e5bf6e2792b4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:10.391346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2bc47-9706-4d2e-9aef-e5bf6e2792b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:10.391718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df2bc47-9706-4d2e-9aef-e5bf6e2792b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:10.392456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2bc47-9706-4d2e-9aef-e5bf6e2792b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:10.394832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df2bc47-9706-4d2e-9aef-e5bf6e2792b4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:10.454114 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2114/4243] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:10 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:10.459364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2b8f1-5eed-4b4f-83f9-42b3290fe8e1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:10.470799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e2b8f1-5eed-4b4f-83f9-42b3290fe8e1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:10.545644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deeeaff-f638-456a-8e27-6aa83f43a08d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:10.546572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeeaff-f638-456a-8e27-6aa83f43a08d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:10.547126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeeaff-f638-456a-8e27-6aa83f43a08d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:10.547653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deeeaff-f638-456a-8e27-6aa83f43a08d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:10.548446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deeeaff-f638-456a-8e27-6aa83f43a08d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:10.552087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deeeaff-f638-456a-8e27-6aa83f43a08d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:10.588756 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2130/4244] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:10 2022] POST /identity/v3/users => generated 288 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:10.589118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2bc47-9706-4d2e-9aef-e5bf6e2792b4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:10.606436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df2bc47-9706-4d2e-9aef-e5bf6e2792b4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:10.628894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c63ed0-4ebe-4957-a6c6-ae28996a2f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:10.630947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63ed0-4ebe-4957-a6c6-ae28996a2f67 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:10.631697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63ed0-4ebe-4957-a6c6-ae28996a2f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:10.632136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c63ed0-4ebe-4957-a6c6-ae28996a2f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:10.633443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c63ed0-4ebe-4957-a6c6-ae28996a2f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:10.636090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c63ed0-4ebe-4957-a6c6-ae28996a2f67 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:10.679745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deeeaff-f638-456a-8e27-6aa83f43a08d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:10.680066 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2115/4245] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:13:10.694014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deeeaff-f638-456a-8e27-6aa83f43a08d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:10.709851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b60c0-5ab4-44fa-8356-01eb2da0a4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:10.710592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b60c0-5ab4-44fa-8356-01eb2da0a4d3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:10.711007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b60c0-5ab4-44fa-8356-01eb2da0a4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:10.711329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1b60c0-5ab4-44fa-8356-01eb2da0a4d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:10.712040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b60c0-5ab4-44fa-8356-01eb2da0a4d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:10.713968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1b60c0-5ab4-44fa-8356-01eb2da0a4d3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:10.741089 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2131/4246] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:10.742661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c63ed0-4ebe-4957-a6c6-ae28996a2f67 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:10.763952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c63ed0-4ebe-4957-a6c6-ae28996a2f67 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:10.778336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdf019-2da7-4c1d-8745-9aed36a90f65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:10.779139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdf019-2da7-4c1d-8745-9aed36a90f65 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:10.779519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdf019-2da7-4c1d-8745-9aed36a90f65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:10.779935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdf019-2da7-4c1d-8745-9aed36a90f65 admin admin] PATH_INFO: `/v3/projects/a4329719ac6b4fc0894b1f642a068376/users/d9ac971da2614beab2e4598795ed9583/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:10.810661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdf019-2da7-4c1d-8745-9aed36a90f65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4329719ac6b4fc0894b1f642a068376, user_id=d9ac971da2614beab2e4598795ed9583, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:10.814039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdf019-2da7-4c1d-8745-9aed36a90f65 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:10.838183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b60c0-5ab4-44fa-8356-01eb2da0a4d3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:10.839982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6b1b60c0-5ab4-44fa-8356-01eb2da0a4d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:10.859381 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2116/4247] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:10 2022] PUT /identity/v3/projects/a4329719ac6b4fc0894b1f642a068376/users/d9ac971da2614beab2e4598795ed9583/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:10.859381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdf019-2da7-4c1d-8745-9aed36a90f65 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:10.866055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f8fdf019-2da7-4c1d-8745-9aed36a90f65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:10.871765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1b60c0-5ab4-44fa-8356-01eb2da0a4d3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:11.014158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:11.015282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.015282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.015696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] PATH_INFO: `/v3/projects/0a93a7edd7324574b19ec5c7847f9f03` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.017052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a93a7edd7324574b19ec5c7847f9f03)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:11.019113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:11.070661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdf019-2da7-4c1d-8745-9aed36a90f65 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:11.085776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:11.086809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.088174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.090641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] PATH_INFO: `/v3/projects/75060d27b5d34928a37204f3e97a6faf` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.094950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] RBAC: Authorizing `identity:delete_project(project_id=75060d27b5d34928a37204f3e97a6faf)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:11.101846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:11.126856 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:11.171039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a93a7edd7324574b19ec5c7847f9f03', 'request_id': 'req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.189530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a93a7edd7324574b19ec5c7847f9f03', 'request_id': 'req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.208061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a93a7edd7324574b19ec5c7847f9f03', 'request_id': 'req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.216781 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:11.250899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75060d27b5d34928a37204f3e97a6faf', 'request_id': 'req-ed34ad22-dfc3-43f2-8535-938073fe328d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.251907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] The token cache is being invalidate because project 0a93a7edd7324574b19ec5c7847f9f03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:11.252303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.253099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0b9c0dc0-cbeb-4b88-93a1-8b0b886298d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.254977 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2132/4248] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:10 2022] DELETE /identity/v3/projects/0a93a7edd7324574b19ec5c7847f9f03 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:11.256760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9417a-c08a-48a1-9d20-331056c943db None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.257148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9417a-c08a-48a1-9d20-331056c943db None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.257622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb9417a-c08a-48a1-9d20-331056c943db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.278267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75060d27b5d34928a37204f3e97a6faf', 'request_id': 'req-ed34ad22-dfc3-43f2-8535-938073fe328d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.303724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75060d27b5d34928a37204f3e97a6faf', 'request_id': 'req-ed34ad22-dfc3-43f2-8535-938073fe328d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.306025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9bb9417a-c08a-48a1-9d20-331056c943db None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:11.311024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9bb9417a-c08a-48a1-9d20-331056c943db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:11.335771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] The token cache is being invalidate because project 75060d27b5d34928a37204f3e97a6faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:11.336096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.338209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ed34ad22-dfc3-43f2-8535-938073fe328d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:11.344676 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2117/4249] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:10 2022] DELETE /identity/v3/projects/75060d27b5d34928a37204f3e97a6faf => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:11.349455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28075dbe-a9b7-41fe-92b4-7ea58cdffd5b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.360152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28075dbe-a9b7-41fe-92b4-7ea58cdffd5b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.360152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28075dbe-a9b7-41fe-92b4-7ea58cdffd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.419553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-28075dbe-a9b7-41fe-92b4-7ea58cdffd5b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:11.421929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-28075dbe-a9b7-41fe-92b4-7ea58cdffd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:11.538506 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2133/4250] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:11.539888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f2b47-f288-4c38-bdbe-76629b209f9a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.540272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f2b47-f288-4c38-bdbe-76629b209f9a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.540644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f2b47-f288-4c38-bdbe-76629b209f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.585171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3f6f2b47-f288-4c38-bdbe-76629b209f9a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:11.586512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3f6f2b47-f288-4c38-bdbe-76629b209f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:11.614664 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2134/4251] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:11.614664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f2b47-f288-4c38-bdbe-76629b209f9a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:11.614664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3f6f2b47-f288-4c38-bdbe-76629b209f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:11.620455 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2118/4252] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:11.624224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ea5b-babb-4bbf-bcb0-5a744b1af746 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.624607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ea5b-babb-4bbf-bcb0-5a744b1af746 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.624979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5316ea5b-babb-4bbf-bcb0-5a744b1af746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.683447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5316ea5b-babb-4bbf-bcb0-5a744b1af746 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:11.684680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5316ea5b-babb-4bbf-bcb0-5a744b1af746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:11.710512 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2119/4253] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:11.712536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b38adb-d380-4fa4-9ad7-75fc15ef4334 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.712822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b38adb-d380-4fa4-9ad7-75fc15ef4334 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.713095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b38adb-d380-4fa4-9ad7-75fc15ef4334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.749198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-76b38adb-d380-4fa4-9ad7-75fc15ef4334 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:11.751442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-76b38adb-d380-4fa4-9ad7-75fc15ef4334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:11.762531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f2b47-f288-4c38-bdbe-76629b209f9a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:11.767986 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2120/4254] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:11.767986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b38adb-d380-4fa4-9ad7-75fc15ef4334 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:11.780409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231181b-4603-48c0-bdc0-a93d787ed055 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:11.781052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231181b-4603-48c0-bdc0-a93d787ed055 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.781416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231181b-4603-48c0-bdc0-a93d787ed055 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.781690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231181b-4603-48c0-bdc0-a93d787ed055 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.806076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b38adb-d380-4fa4-9ad7-75fc15ef4334 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:11.814555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264343a9-a701-44ad-8dc9-c3c508d416e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:11.815974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264343a9-a701-44ad-8dc9-c3c508d416e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.816424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264343a9-a701-44ad-8dc9-c3c508d416e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.816824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264343a9-a701-44ad-8dc9-c3c508d416e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.817879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264343a9-a701-44ad-8dc9-c3c508d416e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:11.819844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264343a9-a701-44ad-8dc9-c3c508d416e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:11.821545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264343a9-a701-44ad-8dc9-c3c508d416e6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:11.824122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231181b-4603-48c0-bdc0-a93d787ed055 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:11.825603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231181b-4603-48c0-bdc0-a93d787ed055 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:11.841918 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2121/4255] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:13:11.842661 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2135/4256] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:11.843596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264343a9-a701-44ad-8dc9-c3c508d416e6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:11.846183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231181b-4603-48c0-bdc0-a93d787ed055 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:11.866595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264343a9-a701-44ad-8dc9-c3c508d416e6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:11.866940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231181b-4603-48c0-bdc0-a93d787ed055 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:11.882478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9116c-d8ca-4113-be28-9ed6b0179900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:11.883110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9116c-d8ca-4113-be28-9ed6b0179900 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.883391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9116c-d8ca-4113-be28-9ed6b0179900 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.883668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad9116c-d8ca-4113-be28-9ed6b0179900 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.884324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9116c-d8ca-4113-be28-9ed6b0179900 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:11.886252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad9116c-d8ca-4113-be28-9ed6b0179900 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:11.893971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046884f8-9c5b-4cd2-8188-c1b0408837a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:11.895386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046884f8-9c5b-4cd2-8188-c1b0408837a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:11.895969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046884f8-9c5b-4cd2-8188-c1b0408837a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:11.898553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046884f8-9c5b-4cd2-8188-c1b0408837a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:11.899609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046884f8-9c5b-4cd2-8188-c1b0408837a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:11.900479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046884f8-9c5b-4cd2-8188-c1b0408837a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:11.919621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046884f8-9c5b-4cd2-8188-c1b0408837a2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:11.946249 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2122/4257] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:13:11.951031 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2136/4258] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:11 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:11.955737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9116c-d8ca-4113-be28-9ed6b0179900 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:11.955909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046884f8-9c5b-4cd2-8188-c1b0408837a2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:11.971287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046884f8-9c5b-4cd2-8188-c1b0408837a2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:12.036902 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:12.094552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad9116c-d8ca-4113-be28-9ed6b0179900 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:12.112521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd3e2b-4042-4499-9bcd-603b37549b61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:12.113480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd3e2b-4042-4499-9bcd-603b37549b61 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.113779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd3e2b-4042-4499-9bcd-603b37549b61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.114672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cd3e2b-4042-4499-9bcd-603b37549b61 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.116475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd3e2b-4042-4499-9bcd-603b37549b61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:12.118476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cd3e2b-4042-4499-9bcd-603b37549b61 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:12.147085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cadd6d-ba1a-4317-ab78-411d1dc34113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:12.148639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cadd6d-ba1a-4317-ab78-411d1dc34113 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.150449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cadd6d-ba1a-4317-ab78-411d1dc34113 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.151516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cadd6d-ba1a-4317-ab78-411d1dc34113 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.153476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cadd6d-ba1a-4317-ab78-411d1dc34113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:12.160672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cadd6d-ba1a-4317-ab78-411d1dc34113 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:12.170016 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2137/4259] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:11 2022] POST /identity/v3/users => generated 302 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:12.171278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd3e2b-4042-4499-9bcd-603b37549b61 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:12.196015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cd3e2b-4042-4499-9bcd-603b37549b61 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:12.208277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aa443-1463-438c-bd9b-9289ca20d46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:12.210889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa443-1463-438c-bd9b-9289ca20d46e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.211172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa443-1463-438c-bd9b-9289ca20d46e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.211448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9aa443-1463-438c-bd9b-9289ca20d46e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.212115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aa443-1463-438c-bd9b-9289ca20d46e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:12.219348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9aa443-1463-438c-bd9b-9289ca20d46e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:12.238764 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2123/4260] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:11 2022] POST /identity/v3/projects => generated 377 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:12.243818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cadd6d-ba1a-4317-ab78-411d1dc34113 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:12.248400 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2138/4261] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:12.251127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aa443-1463-438c-bd9b-9289ca20d46e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:12.252950 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:12.277655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9aa443-1463-438c-bd9b-9289ca20d46e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:12.407314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cadd6d-ba1a-4317-ab78-411d1dc34113 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:12.426665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca0466-e353-4082-9d7e-48b8d17379c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:12.426665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca0466-e353-4082-9d7e-48b8d17379c9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.426665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca0466-e353-4082-9d7e-48b8d17379c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.426665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca0466-e353-4082-9d7e-48b8d17379c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.427711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca0466-e353-4082-9d7e-48b8d17379c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:12.429150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca0466-e353-4082-9d7e-48b8d17379c9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:12.435179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c24ef-7692-456f-93f5-a34f5e87ecbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:12.435881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c24ef-7692-456f-93f5-a34f5e87ecbc admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.436291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c24ef-7692-456f-93f5-a34f5e87ecbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.436429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c24ef-7692-456f-93f5-a34f5e87ecbc admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.437198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c24ef-7692-456f-93f5-a34f5e87ecbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:12.450870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c24ef-7692-456f-93f5-a34f5e87ecbc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:12.453025 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2139/4262] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:12.457368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca0466-e353-4082-9d7e-48b8d17379c9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:12.475742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca0466-e353-4082-9d7e-48b8d17379c9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:12.489126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3f40e-dbaa-43cb-8e64-da2cd02fd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:12.490476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3f40e-dbaa-43cb-8e64-da2cd02fd0ee admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.490819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3f40e-dbaa-43cb-8e64-da2cd02fd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.491158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3f40e-dbaa-43cb-8e64-da2cd02fd0ee admin admin] PATH_INFO: `/v3/projects/4ed313e540244a9499773802fa0c1fbb/users/883d4356bb134cce953ed362ade73c3d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.530252 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2124/4263] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:12 2022] POST /identity/v3/users => generated 289 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:12.534366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c24ef-7692-456f-93f5-a34f5e87ecbc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:12.543955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3f40e-dbaa-43cb-8e64-da2cd02fd0ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ed313e540244a9499773802fa0c1fbb, user_id=883d4356bb134cce953ed362ade73c3d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:12.547807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3f40e-dbaa-43cb-8e64-da2cd02fd0ee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:12.555919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c24ef-7692-456f-93f5-a34f5e87ecbc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:12.572412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c55788-dc52-4b4c-be47-aad80c61e169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:12.573153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55788-dc52-4b4c-be47-aad80c61e169 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.573493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55788-dc52-4b4c-be47-aad80c61e169 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.573777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c55788-dc52-4b4c-be47-aad80c61e169 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.574426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c55788-dc52-4b4c-be47-aad80c61e169 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:12.575654 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2140/4264] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:12 2022] PUT /identity/v3/projects/4ed313e540244a9499773802fa0c1fbb/users/883d4356bb134cce953ed362ade73c3d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:13:12.578646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c55788-dc52-4b4c-be47-aad80c61e169 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:12.580523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f634e-d37d-4131-82d3-90d8d2a91dee None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.580915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f634e-d37d-4131-82d3-90d8d2a91dee None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.581286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f634e-d37d-4131-82d3-90d8d2a91dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.601951 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2125/4265] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:12.605608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c55788-dc52-4b4c-be47-aad80c61e169 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:12.626676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aa5f634e-d37d-4131-82d3-90d8d2a91dee None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:12.629208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa5f634e-d37d-4131-82d3-90d8d2a91dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:12.632983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c55788-dc52-4b4c-be47-aad80c61e169 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:12.789721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d4de2-ddc3-435c-829e-52b6f1842ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:12.790352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d4de2-ddc3-435c-829e-52b6f1842ee4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.790796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d4de2-ddc3-435c-829e-52b6f1842ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.791082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5d4de2-ddc3-435c-829e-52b6f1842ee4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.792041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d4de2-ddc3-435c-829e-52b6f1842ee4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:12.794777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5d4de2-ddc3-435c-829e-52b6f1842ee4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:12.808008 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2141/4266] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:12.815951 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2126/4267] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:12 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:12.820875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f634e-d37d-4131-82d3-90d8d2a91dee None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:12.836194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f634e-d37d-4131-82d3-90d8d2a91dee None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:12.845535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f41816-de92-40e1-86bd-d8e02b4a1194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:12.846232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f41816-de92-40e1-86bd-d8e02b4a1194 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.846513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f41816-de92-40e1-86bd-d8e02b4a1194 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.846792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f41816-de92-40e1-86bd-d8e02b4a1194 admin admin] PATH_INFO: `/v3/projects/7ee7511c75374ba599216666ba191e9e/users/de6929c304ff4260b9e7c4d469b71a0d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.870776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f41816-de92-40e1-86bd-d8e02b4a1194 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ee7511c75374ba599216666ba191e9e, user_id=de6929c304ff4260b9e7c4d469b71a0d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:12.874232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f41816-de92-40e1-86bd-d8e02b4a1194 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:12.879101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d4de2-ddc3-435c-829e-52b6f1842ee4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:12.900251 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:12.904887 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2142/4268] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:12 2022] PUT /identity/v3/projects/7ee7511c75374ba599216666ba191e9e/users/de6929c304ff4260b9e7c4d469b71a0d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:13:12.910771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c144d8-302a-4b69-9d9a-093f447ce6ce None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:12.911885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c144d8-302a-4b69-9d9a-093f447ce6ce None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:12.912894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c144d8-302a-4b69-9d9a-093f447ce6ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:12.939877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-24c144d8-302a-4b69-9d9a-093f447ce6ce None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:12.942429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-24c144d8-302a-4b69-9d9a-093f447ce6ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:12.996290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5d4de2-ddc3-435c-829e-52b6f1842ee4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:13.050447 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:13.100401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27947fd6-f81c-48ab-9b88-7a1cb44cb4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:13.101022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27947fd6-f81c-48ab-9b88-7a1cb44cb4bb service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:13.101348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27947fd6-f81c-48ab-9b88-7a1cb44cb4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:13.101707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27947fd6-f81c-48ab-9b88-7a1cb44cb4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:13.111055 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2143/4269] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:13.123339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27947fd6-f81c-48ab-9b88-7a1cb44cb4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:13.124954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27947fd6-f81c-48ab-9b88-7a1cb44cb4bb service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:13.138162 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2127/4270] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:13.183326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c144d8-302a-4b69-9d9a-093f447ce6ce None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:13.198959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c144d8-302a-4b69-9d9a-093f447ce6ce None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:13.210227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed53e515-47e3-4a91-b630-ab001e8626e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:13.210818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53e515-47e3-4a91-b630-ab001e8626e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:13.211164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53e515-47e3-4a91-b630-ab001e8626e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:13.211371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed53e515-47e3-4a91-b630-ab001e8626e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:13.229916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53e515-47e3-4a91-b630-ab001e8626e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:13.231244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed53e515-47e3-4a91-b630-ab001e8626e2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:13.252730 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2144/4271] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:15.591559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0385-94c3-4afa-bd1c-bffed81d61fe None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:15.592452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0385-94c3-4afa-bd1c-bffed81d61fe None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:15.593398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06af0385-94c3-4afa-bd1c-bffed81d61fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:15.648749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-06af0385-94c3-4afa-bd1c-bffed81d61fe None None] MFA Rules not processed for user `79772a24d13244809f7dad6e8d29bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:15.650626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06af0385-94c3-4afa-bd1c-bffed81d61fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:15.819945 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2128/4272] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:15.821799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765472f0-cef4-4dc3-b6e5-9b00f4f22280 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:15.822286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765472f0-cef4-4dc3-b6e5-9b00f4f22280 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:15.822899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765472f0-cef4-4dc3-b6e5-9b00f4f22280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:15.855030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-765472f0-cef4-4dc3-b6e5-9b00f4f22280 None None] MFA Rules not processed for user `79772a24d13244809f7dad6e8d29bd7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:15.856376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-765472f0-cef4-4dc3-b6e5-9b00f4f22280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:15.882426 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2145/4273] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:15 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:15.893559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af0385-94c3-4afa-bd1c-bffed81d61fe None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:15.894998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06af0385-94c3-4afa-bd1c-bffed81d61fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:16.062369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06af0385-94c3-4afa-bd1c-bffed81d61fe None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:16.076139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4fad7-4c3e-40b3-8fbd-f859821d1048 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:16.076882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4fad7-4c3e-40b3-8fbd-f859821d1048 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:16.077305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4fad7-4c3e-40b3-8fbd-f859821d1048 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:16.077696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f4fad7-4c3e-40b3-8fbd-f859821d1048 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:16.094006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4fad7-4c3e-40b3-8fbd-f859821d1048 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:16.095911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f4fad7-4c3e-40b3-8fbd-f859821d1048 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:16.111937 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2129/4274] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:15 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:13:16.426471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8131868-ca41-433b-8a81-2915020a90df None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:16.427529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8131868-ca41-433b-8a81-2915020a90df None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:16.427971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8131868-ca41-433b-8a81-2915020a90df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:16.508948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a8131868-ca41-433b-8a81-2915020a90df None None] MFA Rules not processed for user `883d4356bb134cce953ed362ade73c3d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:16.510263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a8131868-ca41-433b-8a81-2915020a90df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:16.678305 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2146/4275] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:16 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:16.683036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4fad7-4c3e-40b3-8fbd-f859821d1048 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:16.702025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f4fad7-4c3e-40b3-8fbd-f859821d1048 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:16.716955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95506948-e5e9-4657-b15e-8dac30a2d6ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:16.717894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95506948-e5e9-4657-b15e-8dac30a2d6ed admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:16.718373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95506948-e5e9-4657-b15e-8dac30a2d6ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:16.718824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95506948-e5e9-4657-b15e-8dac30a2d6ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:16.719641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95506948-e5e9-4657-b15e-8dac30a2d6ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:16.721761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95506948-e5e9-4657-b15e-8dac30a2d6ed admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:16.787005 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2130/4276] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:16 2022] POST /identity/v3/projects => generated 403 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:13:16.791088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8131868-ca41-433b-8a81-2915020a90df None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:16.806481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8131868-ca41-433b-8a81-2915020a90df None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:16.941788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e3764-5057-46d3-a870-4d28d4566dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:16.943220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e3764-5057-46d3-a870-4d28d4566dd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:16.943663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e3764-5057-46d3-a870-4d28d4566dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:16.944098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e3764-5057-46d3-a870-4d28d4566dd4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:16.944895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e3764-5057-46d3-a870-4d28d4566dd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:16.947080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e3764-5057-46d3-a870-4d28d4566dd4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:17.002008 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:17.009212 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2147/4277] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:16 2022] POST /identity/v3/users => generated 308 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:13:17.010798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95506948-e5e9-4657-b15e-8dac30a2d6ed admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:17.030961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95506948-e5e9-4657-b15e-8dac30a2d6ed admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:17.043346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d660f6c-a27f-41f2-b36a-d42b8f6ad2cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:17.043986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d660f6c-a27f-41f2-b36a-d42b8f6ad2cf admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:17.044272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d660f6c-a27f-41f2-b36a-d42b8f6ad2cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:17.044548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d660f6c-a27f-41f2-b36a-d42b8f6ad2cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:17.045377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d660f6c-a27f-41f2-b36a-d42b8f6ad2cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:17.047202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d660f6c-a27f-41f2-b36a-d42b8f6ad2cf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:17.072839 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2131/4278] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:17.077490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e3764-5057-46d3-a870-4d28d4566dd4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:17.091353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e3764-5057-46d3-a870-4d28d4566dd4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:17.098604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3141ba5-b43f-456b-be41-2945146ebbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:17.100227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3141ba5-b43f-456b-be41-2945146ebbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:17.100804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3141ba5-b43f-456b-be41-2945146ebbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:17.101515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3141ba5-b43f-456b-be41-2945146ebbfb admin admin] PATH_INFO: `/v3/projects/dd461f5f0eaa4a7583de3c03e75c85db/users/830efb9030404f99ade8e32a44366fb8/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:17.121358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3141ba5-b43f-456b-be41-2945146ebbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd461f5f0eaa4a7583de3c03e75c85db, user_id=830efb9030404f99ade8e32a44366fb8, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:17.126412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3141ba5-b43f-456b-be41-2945146ebbfb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:17.165755 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2148/4279] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:17 2022] PUT /identity/v3/projects/dd461f5f0eaa4a7583de3c03e75c85db/users/830efb9030404f99ade8e32a44366fb8/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:17.169818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d660f6c-a27f-41f2-b36a-d42b8f6ad2cf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:17.193690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d660f6c-a27f-41f2-b36a-d42b8f6ad2cf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:17.232093 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:17.330053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36849-3ec2-42c1-8aa6-83b3ea95ae55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:17.331223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36849-3ec2-42c1-8aa6-83b3ea95ae55 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:17.332065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36849-3ec2-42c1-8aa6-83b3ea95ae55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:17.332595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d36849-3ec2-42c1-8aa6-83b3ea95ae55 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:17.334257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36849-3ec2-42c1-8aa6-83b3ea95ae55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:17.336226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d36849-3ec2-42c1-8aa6-83b3ea95ae55 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:17.359165 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2132/4280] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:17 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:13:17.364671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3141ba5-b43f-456b-be41-2945146ebbfb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:17.377698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3141ba5-b43f-456b-be41-2945146ebbfb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:17.386670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f8894-3a9d-49e4-8501-6cc83dbad2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:17.391109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f8894-3a9d-49e4-8501-6cc83dbad2a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:17.391715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f8894-3a9d-49e4-8501-6cc83dbad2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:17.393245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660f8894-3a9d-49e4-8501-6cc83dbad2a3 admin admin] PATH_INFO: `/v3/projects/dd461f5f0eaa4a7583de3c03e75c85db/users/830efb9030404f99ade8e32a44366fb8/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:17.397191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f8894-3a9d-49e4-8501-6cc83dbad2a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd461f5f0eaa4a7583de3c03e75c85db, user_id=830efb9030404f99ade8e32a44366fb8, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:17.410456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660f8894-3a9d-49e4-8501-6cc83dbad2a3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:17.442258 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2149/4281] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:17 2022] PUT /identity/v3/projects/dd461f5f0eaa4a7583de3c03e75c85db/users/830efb9030404f99ade8e32a44366fb8/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:21.859630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36849-3ec2-42c1-8aa6-83b3ea95ae55 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:21.861679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57d36849-3ec2-42c1-8aa6-83b3ea95ae55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:21.881815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d36849-3ec2-42c1-8aa6-83b3ea95ae55 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:22.012565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:22.012565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:22.012565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:22.012565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] PATH_INFO: `/v3/users/c703cc73a22749858ffe05500e52aa03` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:22.018416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c703cc73a22749858ffe05500e52aa03)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:22.020741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:22.078301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c703cc73a22749858ffe05500e52aa03'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.109956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c703cc73a22749858ffe05500e52aa03'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.111349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c703cc73a22749858ffe05500e52aa03'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.133851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c703cc73a22749858ffe05500e52aa03'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.156660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c91256d8-d5e2-4328-98de-98e7de2f0a3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c703cc73a22749858ffe05500e52aa03'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.167379 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2133/4282] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:21 2022] DELETE /identity/v3/users/c703cc73a22749858ffe05500e52aa03 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:22.486999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f8894-3a9d-49e4-8501-6cc83dbad2a3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:22.489359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-660f8894-3a9d-49e4-8501-6cc83dbad2a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:22.512708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660f8894-3a9d-49e4-8501-6cc83dbad2a3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:22.651070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:22.651866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:22.652215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:22.652604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] PATH_INFO: `/v3/users/6cf76cb0ba32427fabff64e2190a7d2b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:22.653920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf76cb0ba32427fabff64e2190a7d2b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:22.656072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:22.724601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf76cb0ba32427fabff64e2190a7d2b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.740537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf76cb0ba32427fabff64e2190a7d2b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.741756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf76cb0ba32427fabff64e2190a7d2b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.756498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf76cb0ba32427fabff64e2190a7d2b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.767984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf76cb0ba32427fabff64e2190a7d2b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:22.776157 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2150/4283] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:22 2022] DELETE /identity/v3/users/6cf76cb0ba32427fabff64e2190a7d2b => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:22.780806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d7fe4-fe64-4aa2-90b8-682dc984a833 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:22.780999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d7fe4-fe64-4aa2-90b8-682dc984a833 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:22.781283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d7fe4-fe64-4aa2-90b8-682dc984a833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:22.841657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-497d7fe4-fe64-4aa2-90b8-682dc984a833 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:22.847832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-497d7fe4-fe64-4aa2-90b8-682dc984a833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:22.906113 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:22.968349 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2134/4284] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:22.978844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:22.982233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:23.049282 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:23.064687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38f9d88-dd2f-46d9-b37b-bf534cdd023c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:23.070506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7840010c-6e02-4a7a-a420-b057e1780af2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:23.071265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840010c-6e02-4a7a-a420-b057e1780af2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:23.071619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840010c-6e02-4a7a-a420-b057e1780af2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:23.071957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7840010c-6e02-4a7a-a420-b057e1780af2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:23.084858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840010c-6e02-4a7a-a420-b057e1780af2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:23.086319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7840010c-6e02-4a7a-a420-b057e1780af2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:23.099094 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2151/4285] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:23.252869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d7fe4-fe64-4aa2-90b8-682dc984a833 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:23.254657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-497d7fe4-fe64-4aa2-90b8-682dc984a833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:23.273642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497d7fe4-fe64-4aa2-90b8-682dc984a833 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:23.280407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:23.281433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:23.282102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:23.282617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] PATH_INFO: `/v3/projects/be8fffe9b0994ded9f07301735105917` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:23.284054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=be8fffe9b0994ded9f07301735105917)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:23.287747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:23.312813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7a618-bcc1-40ad-a946-c31ec0f9f469 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:23.313104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7a618-bcc1-40ad-a946-c31ec0f9f469 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:23.313418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc7a618-bcc1-40ad-a946-c31ec0f9f469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:23.373180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bfc7a618-bcc1-40ad-a946-c31ec0f9f469 None None] MFA Rules not processed for user `830efb9030404f99ade8e32a44366fb8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:23.376412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bfc7a618-bcc1-40ad-a946-c31ec0f9f469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:23.383051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be8fffe9b0994ded9f07301735105917', 'request_id': 'req-c8065c55-1472-444c-845d-ea6a20223d9d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.398739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be8fffe9b0994ded9f07301735105917', 'request_id': 'req-c8065c55-1472-444c-845d-ea6a20223d9d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.409281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be8fffe9b0994ded9f07301735105917', 'request_id': 'req-c8065c55-1472-444c-845d-ea6a20223d9d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.427602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] The token cache is being invalidate because project be8fffe9b0994ded9f07301735105917 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:23.428573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.429660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.436204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2135/4286] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:23 2022] DELETE /identity/v3/projects/be8fffe9b0994ded9f07301735105917 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:23.437333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:23.440774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:23.519750 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2152/4287] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:23 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:23.539075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a61cdd-9d68-49e8-843a-6edf726545fe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:23.539507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a61cdd-9d68-49e8-843a-6edf726545fe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:23.539904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a61cdd-9d68-49e8-843a-6edf726545fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:23.562476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8065c55-1472-444c-845d-ea6a20223d9d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:23.576209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-05a61cdd-9d68-49e8-843a-6edf726545fe None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:23.576443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:23.576907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:23.577195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:23.577517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] PATH_INFO: `/v3/projects/b434769bf888429d9c70cf9e021b06f2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:23.578175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-05a61cdd-9d68-49e8-843a-6edf726545fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:23.580806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b434769bf888429d9c70cf9e021b06f2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:23.582813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:23.597713 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2153/4288] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:23.606747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d39e6-d163-4d00-ae6e-92e7312d3de2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:23.607154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d39e6-d163-4d00-ae6e-92e7312d3de2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:23.607504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95d39e6-d163-4d00-ae6e-92e7312d3de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:23.643971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b95d39e6-d163-4d00-ae6e-92e7312d3de2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:23.645406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b95d39e6-d163-4d00-ae6e-92e7312d3de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:23.657769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2154/4289] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:23.658880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d39e6-d163-4d00-ae6e-92e7312d3de2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:23.674737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95d39e6-d163-4d00-ae6e-92e7312d3de2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:23.697769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27243f7b-a7f6-4301-a753-8c7733ed9602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:23.698696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27243f7b-a7f6-4301-a753-8c7733ed9602 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:23.699906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27243f7b-a7f6-4301-a753-8c7733ed9602 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:23.701386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27243f7b-a7f6-4301-a753-8c7733ed9602 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:23.702211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27243f7b-a7f6-4301-a753-8c7733ed9602 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:23.703388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27243f7b-a7f6-4301-a753-8c7733ed9602 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:23.706977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27243f7b-a7f6-4301-a753-8c7733ed9602 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:23.730785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b434769bf888429d9c70cf9e021b06f2', 'request_id': 'req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.748201 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2155/4290] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:13:23.749349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27243f7b-a7f6-4301-a753-8c7733ed9602 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:23.754332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b434769bf888429d9c70cf9e021b06f2', 'request_id': 'req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.759452 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:23.800710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b434769bf888429d9c70cf9e021b06f2', 'request_id': 'req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.811016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27243f7b-a7f6-4301-a753-8c7733ed9602 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:23.825698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] The token cache is being invalidate because project b434769bf888429d9c70cf9e021b06f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:23.826062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.827188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e03c87c7-4b04-47d7-89c9-99e6bc44e90c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:23.829542 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2136/4291] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:23 2022] DELETE /identity/v3/projects/b434769bf888429d9c70cf9e021b06f2 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:23.834584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5416d31-3f17-482b-9cb8-99e0ee5b7baf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:23.835611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5416d31-3f17-482b-9cb8-99e0ee5b7baf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:23.835611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5416d31-3f17-482b-9cb8-99e0ee5b7baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:23.887894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f5416d31-3f17-482b-9cb8-99e0ee5b7baf None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:23.889217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f5416d31-3f17-482b-9cb8-99e0ee5b7baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:23.970937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b517a-088b-4e41-82b3-bcbfa3d62733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:23.971685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b517a-088b-4e41-82b3-bcbfa3d62733 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:23.972039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b517a-088b-4e41-82b3-bcbfa3d62733 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:23.972385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599b517a-088b-4e41-82b3-bcbfa3d62733 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:23.973374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b517a-088b-4e41-82b3-bcbfa3d62733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:23.987995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599b517a-088b-4e41-82b3-bcbfa3d62733 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:24.068303 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2156/4292] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:23 2022] POST /identity/v3/projects => generated 397 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:24.071243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b517a-088b-4e41-82b3-bcbfa3d62733 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:24.074839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-599b517a-088b-4e41-82b3-bcbfa3d62733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:24.085644 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2137/4293] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:24.094753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7995bd4-4421-4344-a5d1-10e75d43fc3c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.095181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7995bd4-4421-4344-a5d1-10e75d43fc3c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.095570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7995bd4-4421-4344-a5d1-10e75d43fc3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.140484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f7995bd4-4421-4344-a5d1-10e75d43fc3c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:24.145341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f7995bd4-4421-4344-a5d1-10e75d43fc3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:24.285560 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2138/4294] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:24.289754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7995bd4-4421-4344-a5d1-10e75d43fc3c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:24.308099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7995bd4-4421-4344-a5d1-10e75d43fc3c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:24.314442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ffffd-bd2f-42e1-9a51-a3c30a96bc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:24.315657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ffffd-bd2f-42e1-9a51-a3c30a96bc6a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.315937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ffffd-bd2f-42e1-9a51-a3c30a96bc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.316206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01ffffd-bd2f-42e1-9a51-a3c30a96bc6a admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.316864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ffffd-bd2f-42e1-9a51-a3c30a96bc6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:24.318561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ffffd-bd2f-42e1-9a51-a3c30a96bc6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:24.320236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a01ffffd-bd2f-42e1-9a51-a3c30a96bc6a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:24.336333 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:24.347110 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2139/4295] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:13:24.352423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ffffd-bd2f-42e1-9a51-a3c30a96bc6a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:24.386796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01ffffd-bd2f-42e1-9a51-a3c30a96bc6a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:24.403130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b2cf3-db62-443d-b3ad-325515a3511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:24.403688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b2cf3-db62-443d-b3ad-325515a3511f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.408960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b2cf3-db62-443d-b3ad-325515a3511f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.409322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3b2cf3-db62-443d-b3ad-325515a3511f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.409861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599b517a-088b-4e41-82b3-bcbfa3d62733 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:24.412889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b2cf3-db62-443d-b3ad-325515a3511f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:24.417372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3b2cf3-db62-443d-b3ad-325515a3511f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:24.420147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d3057-e398-4ad3-908c-2274def59041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:24.420778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3057-e398-4ad3-908c-2274def59041 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.421060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3057-e398-4ad3-908c-2274def59041 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.421358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3057-e398-4ad3-908c-2274def59041 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.422003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d3057-e398-4ad3-908c-2274def59041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:24.424006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d3057-e398-4ad3-908c-2274def59041 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:24.466579 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2157/4296] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:24 2022] POST /identity/v3/users => generated 299 bytes in 396 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:24.470646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d3057-e398-4ad3-908c-2274def59041 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:24.490666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d3057-e398-4ad3-908c-2274def59041 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:24.494377 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2140/4297] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:24 2022] POST /identity/v3/projects => generated 375 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:24.496303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b2cf3-db62-443d-b3ad-325515a3511f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:24.639773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4279d4-bf41-417c-9977-bb9c283b22ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:24.640396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4279d4-bf41-417c-9977-bb9c283b22ca admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.640684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4279d4-bf41-417c-9977-bb9c283b22ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.640959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4279d4-bf41-417c-9977-bb9c283b22ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.641634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4279d4-bf41-417c-9977-bb9c283b22ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:24.643243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4279d4-bf41-417c-9977-bb9c283b22ca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:24.662217 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2158/4298] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:13:24.665726 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:24.665910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4279d4-bf41-417c-9977-bb9c283b22ca admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:24.694615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3b2cf3-db62-443d-b3ad-325515a3511f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:24.694853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4279d4-bf41-417c-9977-bb9c283b22ca admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:24.709204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd50029-5759-4083-87ed-2a1e48c659ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:24.709809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd50029-5759-4083-87ed-2a1e48c659ac admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.709951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2191-d82f-4dee-a728-a983c19d878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:24.710462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd50029-5759-4083-87ed-2a1e48c659ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.710583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2191-d82f-4dee-a728-a983c19d878c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.710751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd50029-5759-4083-87ed-2a1e48c659ac admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.710860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2191-d82f-4dee-a728-a983c19d878c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.711051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e2191-d82f-4dee-a728-a983c19d878c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.711384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd50029-5759-4083-87ed-2a1e48c659ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:24.711679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e2191-d82f-4dee-a728-a983c19d878c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:24.713280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e2191-d82f-4dee-a728-a983c19d878c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:24.715846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd50029-5759-4083-87ed-2a1e48c659ac admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:24.741102 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2159/4299] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:24.746183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2191-d82f-4dee-a728-a983c19d878c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:24.767023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e2191-d82f-4dee-a728-a983c19d878c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:24.780490 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2141/4300] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:24 2022] POST /identity/v3/users => generated 288 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:24.781819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd50029-5759-4083-87ed-2a1e48c659ac admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:24.791202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625420c7-8356-49d4-b6f4-c76475fd404e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:24.791902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625420c7-8356-49d4-b6f4-c76475fd404e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.792187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625420c7-8356-49d4-b6f4-c76475fd404e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.792468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625420c7-8356-49d4-b6f4-c76475fd404e admin admin] PATH_INFO: `/v3/projects/154609c5bdf3461aaab4bd699351fb12/users/8cfd0f5d7dcd444a9414c69b41044a0a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.822116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd50029-5759-4083-87ed-2a1e48c659ac admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:24.831625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625420c7-8356-49d4-b6f4-c76475fd404e admin admin] RBAC: Authorizing `identity:create_grant(project_id=154609c5bdf3461aaab4bd699351fb12, user_id=8cfd0f5d7dcd444a9414c69b41044a0a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:24.835900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625420c7-8356-49d4-b6f4-c76475fd404e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:24.837483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8bef-e854-497e-85cc-af48d1300d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:24.838862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8bef-e854-497e-85cc-af48d1300d43 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.839158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8bef-e854-497e-85cc-af48d1300d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.840219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f8bef-e854-497e-85cc-af48d1300d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.840922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8bef-e854-497e-85cc-af48d1300d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:24.853058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f8bef-e854-497e-85cc-af48d1300d43 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:24.866653 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2160/4301] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:24 2022] PUT /identity/v3/projects/154609c5bdf3461aaab4bd699351fb12/users/8cfd0f5d7dcd444a9414c69b41044a0a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:24.871842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66b942-ab20-4e0d-9373-2b635658860b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:24.872134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66b942-ab20-4e0d-9373-2b635658860b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:24.872416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c66b942-ab20-4e0d-9373-2b635658860b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:24.888507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2142/4302] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:24.898798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8bef-e854-497e-85cc-af48d1300d43 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:24.928326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9c66b942-ab20-4e0d-9373-2b635658860b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:24.929582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c66b942-ab20-4e0d-9373-2b635658860b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:24.933164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f8bef-e854-497e-85cc-af48d1300d43 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:25.080981 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2161/4303] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:25.082066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d9e85-7de1-4e33-82d8-cc81bfcf5100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:25.083081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d9e85-7de1-4e33-82d8-cc81bfcf5100 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:25.083527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d9e85-7de1-4e33-82d8-cc81bfcf5100 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:25.084030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2d9e85-7de1-4e33-82d8-cc81bfcf5100 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:25.084853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d9e85-7de1-4e33-82d8-cc81bfcf5100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:25.091288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2d9e85-7de1-4e33-82d8-cc81bfcf5100 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:25.118059 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2143/4304] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:24 2022] GET /identity/v3/roles => generated 1420 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:25.122264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66b942-ab20-4e0d-9373-2b635658860b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:25.136998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c66b942-ab20-4e0d-9373-2b635658860b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:25.140081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d9e85-7de1-4e33-82d8-cc81bfcf5100 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:25.148830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5a2d9e85-7de1-4e33-82d8-cc81bfcf5100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:25.175243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c224bce-58bf-4e55-9501-47a79dfd8406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:25.176262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c224bce-58bf-4e55-9501-47a79dfd8406 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:25.178822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c224bce-58bf-4e55-9501-47a79dfd8406 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:25.179324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c224bce-58bf-4e55-9501-47a79dfd8406 admin admin] PATH_INFO: `/v3/projects/33041ce290314504a599830cf86f3af2/users/c6ac0db1931444fdbae884ac07c7b3f2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:25.228585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c224bce-58bf-4e55-9501-47a79dfd8406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33041ce290314504a599830cf86f3af2, user_id=c6ac0db1931444fdbae884ac07c7b3f2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:25.232368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c224bce-58bf-4e55-9501-47a79dfd8406 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:25.245324 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:25.264691 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2162/4305] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:25 2022] PUT /identity/v3/projects/33041ce290314504a599830cf86f3af2/users/c6ac0db1931444fdbae884ac07c7b3f2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:25.274676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ae7b3-5d10-45fa-8e41-b789b7e3cc1f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:25.275415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ae7b3-5d10-45fa-8e41-b789b7e3cc1f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:25.275642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887ae7b3-5d10-45fa-8e41-b789b7e3cc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:25.302727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2d9e85-7de1-4e33-82d8-cc81bfcf5100 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:25.374792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-887ae7b3-5d10-45fa-8e41-b789b7e3cc1f None None] MFA Rules not processed for user `c6ac0db1931444fdbae884ac07c7b3f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:25.376608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-887ae7b3-5d10-45fa-8e41-b789b7e3cc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:25.387766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c861a-24d3-4084-a095-ae546ed89ff4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:25.389581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c861a-24d3-4084-a095-ae546ed89ff4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:25.396593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c861a-24d3-4084-a095-ae546ed89ff4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:25.397577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5c861a-24d3-4084-a095-ae546ed89ff4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:25.457181 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:25.507550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c861a-24d3-4084-a095-ae546ed89ff4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:25.509108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5c861a-24d3-4084-a095-ae546ed89ff4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:25.524777 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2144/4306] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:13:25.559052 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2163/4307] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:25.650168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c861a-24d3-4084-a095-ae546ed89ff4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:25.664485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5c861a-24d3-4084-a095-ae546ed89ff4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:25.675878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b997255-6445-467c-bb3a-7e65181fdac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:25.676717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b997255-6445-467c-bb3a-7e65181fdac8 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:25.677106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b997255-6445-467c-bb3a-7e65181fdac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:25.677738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b997255-6445-467c-bb3a-7e65181fdac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:25.707773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b997255-6445-467c-bb3a-7e65181fdac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:25.711125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b997255-6445-467c-bb3a-7e65181fdac8 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:25.732732 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2145/4308] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:27.297957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ae7b3-5d10-45fa-8e41-b789b7e3cc1f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:27.316418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887ae7b3-5d10-45fa-8e41-b789b7e3cc1f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:27.329142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:27.329830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:27.330108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:27.330381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] PATH_INFO: `/v3/users/c6ac0db1931444fdbae884ac07c7b3f2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:27.331629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6ac0db1931444fdbae884ac07c7b3f2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:27.333695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:27.433826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6ac0db1931444fdbae884ac07c7b3f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:27.476996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6ac0db1931444fdbae884ac07c7b3f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:27.478629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6ac0db1931444fdbae884ac07c7b3f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:27.494118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6ac0db1931444fdbae884ac07c7b3f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:27.517238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6ac0db1931444fdbae884ac07c7b3f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:27.526754 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2164/4309] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:27 2022] DELETE /identity/v3/users/c6ac0db1931444fdbae884ac07c7b3f2 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:27.531047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b510e-6ae6-4644-8dfd-01da9c248b40 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:27.531554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b510e-6ae6-4644-8dfd-01da9c248b40 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:27.531646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557b510e-6ae6-4644-8dfd-01da9c248b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:27.557461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-557b510e-6ae6-4644-8dfd-01da9c248b40 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:27.559337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-557b510e-6ae6-4644-8dfd-01da9c248b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:27.714882 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2146/4310] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:27.786515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:27.788237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:27.965101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ba869-c884-47a2-b9ed-a7ba263ad101 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:27.972147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74e7fc-106c-4127-ad0a-b51215919df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:27.973273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74e7fc-106c-4127-ad0a-b51215919df5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:27.973845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74e7fc-106c-4127-ad0a-b51215919df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:27.974541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc74e7fc-106c-4127-ad0a-b51215919df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:27.985384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74e7fc-106c-4127-ad0a-b51215919df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:27.987192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc74e7fc-106c-4127-ad0a-b51215919df5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:27.996210 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:28.002585 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2165/4311] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:29.033973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b510e-6ae6-4644-8dfd-01da9c248b40 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:29.037025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-557b510e-6ae6-4644-8dfd-01da9c248b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:29.064715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557b510e-6ae6-4644-8dfd-01da9c248b40 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:29.075904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:29.076703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:29.084476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:29.087277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] PATH_INFO: `/v3/users/883d4356bb134cce953ed362ade73c3d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:29.091721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] RBAC: Authorizing `identity:delete_user(user_id=883d4356bb134cce953ed362ade73c3d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:29.097098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:29.215167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '883d4356bb134cce953ed362ade73c3d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.255278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '883d4356bb134cce953ed362ade73c3d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.256484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '883d4356bb134cce953ed362ade73c3d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.272331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '883d4356bb134cce953ed362ade73c3d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.310185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a3dacc0-6f2b-493a-badc-2b4e3a54f952 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '883d4356bb134cce953ed362ade73c3d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.326322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74e7fc-106c-4127-ad0a-b51215919df5 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:29.328967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fc74e7fc-106c-4127-ad0a-b51215919df5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:29.345850 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2147/4312] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:29 2022] DELETE /identity/v3/users/883d4356bb134cce953ed362ade73c3d => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:29.351012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc74e7fc-106c-4127-ad0a-b51215919df5 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:29.466284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:29.466937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:29.467219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:29.467497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] PATH_INFO: `/v3/projects/33041ce290314504a599830cf86f3af2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:29.478535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=33041ce290314504a599830cf86f3af2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:29.483495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:29.567646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33041ce290314504a599830cf86f3af2', 'request_id': 'req-ff701513-8913-4817-9a2f-a9469cb15bfe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.579228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33041ce290314504a599830cf86f3af2', 'request_id': 'req-ff701513-8913-4817-9a2f-a9469cb15bfe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.594382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33041ce290314504a599830cf86f3af2', 'request_id': 'req-ff701513-8913-4817-9a2f-a9469cb15bfe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.637997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] The token cache is being invalidate because project 33041ce290314504a599830cf86f3af2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:29.638655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.640050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff701513-8913-4817-9a2f-a9469cb15bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:29.642635 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2166/4313] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:29 2022] DELETE /identity/v3/projects/33041ce290314504a599830cf86f3af2 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:29.648272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218fbb-61c1-4c9c-9c13-88889f41ef68 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:29.648559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218fbb-61c1-4c9c-9c13-88889f41ef68 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:29.648837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24218fbb-61c1-4c9c-9c13-88889f41ef68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:29.685672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-24218fbb-61c1-4c9c-9c13-88889f41ef68 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:29.686980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-24218fbb-61c1-4c9c-9c13-88889f41ef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:29.801389 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:29.858165 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2148/4314] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:29.865381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614303d-e5ba-4613-8295-6f29f50101ee None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:29.865669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614303d-e5ba-4613-8295-6f29f50101ee None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:29.865945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3614303d-e5ba-4613-8295-6f29f50101ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:29.896113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3614303d-e5ba-4613-8295-6f29f50101ee None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:29.897374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3614303d-e5ba-4613-8295-6f29f50101ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:29.912646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2167/4315] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:29.917741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218fbb-61c1-4c9c-9c13-88889f41ef68 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:29.932438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24218fbb-61c1-4c9c-9c13-88889f41ef68 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:29.937495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc8346-ee04-440b-b9e7-c91ffd7654ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:29.938084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc8346-ee04-440b-b9e7-c91ffd7654ab admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:29.938350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc8346-ee04-440b-b9e7-c91ffd7654ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:29.938992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc8346-ee04-440b-b9e7-c91ffd7654ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:29.939275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc8346-ee04-440b-b9e7-c91ffd7654ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:29.939575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc8346-ee04-440b-b9e7-c91ffd7654ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:29.941867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babc8346-ee04-440b-b9e7-c91ffd7654ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:29.964516 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2149/4316] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:13:29.965691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614303d-e5ba-4613-8295-6f29f50101ee None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:29.978169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3614303d-e5ba-4613-8295-6f29f50101ee None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:29.982987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e00cc-ce2c-44f9-91f7-816c681c01e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:29.983663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e00cc-ce2c-44f9-91f7-816c681c01e2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:29.983884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e00cc-ce2c-44f9-91f7-816c681c01e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:29.984157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56e00cc-ce2c-44f9-91f7-816c681c01e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:29.985044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e00cc-ce2c-44f9-91f7-816c681c01e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:29.987162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56e00cc-ce2c-44f9-91f7-816c681c01e2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:30.038476 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2168/4317] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:29 2022] POST /identity/v3/projects => generated 375 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:30.039667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc8346-ee04-440b-b9e7-c91ffd7654ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:30.062758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc8346-ee04-440b-b9e7-c91ffd7654ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:30.178728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb17703-c5db-4e6e-93f4-6d266ba4a3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:30.179640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb17703-c5db-4e6e-93f4-6d266ba4a3b8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:30.179640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb17703-c5db-4e6e-93f4-6d266ba4a3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:30.180037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb17703-c5db-4e6e-93f4-6d266ba4a3b8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:30.180693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb17703-c5db-4e6e-93f4-6d266ba4a3b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:30.188476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb17703-c5db-4e6e-93f4-6d266ba4a3b8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:30.250827 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2150/4318] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:30 2022] POST /identity/v3/users => generated 288 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:30.255623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e00cc-ce2c-44f9-91f7-816c681c01e2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:30.272513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56e00cc-ce2c-44f9-91f7-816c681c01e2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:30.288367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1768-a7d0-4121-a769-46b0b53ea088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:30.289079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1768-a7d0-4121-a769-46b0b53ea088 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:30.289389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1768-a7d0-4121-a769-46b0b53ea088 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:30.289663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b1768-a7d0-4121-a769-46b0b53ea088 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:30.290313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1768-a7d0-4121-a769-46b0b53ea088 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:30.291956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b1768-a7d0-4121-a769-46b0b53ea088 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:30.328652 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2169/4319] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:30.329990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb17703-c5db-4e6e-93f4-6d266ba4a3b8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:30.365087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb17703-c5db-4e6e-93f4-6d266ba4a3b8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:30.376788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586163b-6955-40ce-af5b-3788f18f87b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:30.377542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586163b-6955-40ce-af5b-3788f18f87b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:30.377826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586163b-6955-40ce-af5b-3788f18f87b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:30.378102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f586163b-6955-40ce-af5b-3788f18f87b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:30.378749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586163b-6955-40ce-af5b-3788f18f87b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:30.387013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f586163b-6955-40ce-af5b-3788f18f87b9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:30.417587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1768-a7d0-4121-a769-46b0b53ea088 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:30.419743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5f8b1768-a7d0-4121-a769-46b0b53ea088 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:30.429711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2151/4320] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:30 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:30.434350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586163b-6955-40ce-af5b-3788f18f87b9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:30.449091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f586163b-6955-40ce-af5b-3788f18f87b9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:30.451326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b1768-a7d0-4121-a769-46b0b53ea088 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:30.455219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f263e8f0-0483-45b5-bdf4-ad3dae8121dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:30.455901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263e8f0-0483-45b5-bdf4-ad3dae8121dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:30.456186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263e8f0-0483-45b5-bdf4-ad3dae8121dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:30.456463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f263e8f0-0483-45b5-bdf4-ad3dae8121dc admin admin] PATH_INFO: `/v3/projects/0bac94b8c28d4c20aacbcd2f7b5b40d2/users/d48df3c4c2b8424b8e04461eef77cde2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:30.467871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:30.468530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:30.468811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:30.469085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] PATH_INFO: `/v3/projects/4ed313e540244a9499773802fa0c1fbb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:30.477471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263e8f0-0483-45b5-bdf4-ad3dae8121dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bac94b8c28d4c20aacbcd2f7b5b40d2, user_id=d48df3c4c2b8424b8e04461eef77cde2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:30.481027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ed313e540244a9499773802fa0c1fbb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:30.482259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f263e8f0-0483-45b5-bdf4-ad3dae8121dc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:30.483011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:30.514616 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2152/4321] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:30 2022] PUT /identity/v3/projects/0bac94b8c28d4c20aacbcd2f7b5b40d2/users/d48df3c4c2b8424b8e04461eef77cde2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:30.525332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4153-1730-44f8-bf93-7445b1128417 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:30.525994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4153-1730-44f8-bf93-7445b1128417 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:30.526505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e4153-1730-44f8-bf93-7445b1128417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:30.590063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5f3e4153-1730-44f8-bf93-7445b1128417 None None] MFA Rules not processed for user `d48df3c4c2b8424b8e04461eef77cde2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:30.591335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5f3e4153-1730-44f8-bf93-7445b1128417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:30.743840 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:30.755884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ed313e540244a9499773802fa0c1fbb', 'request_id': 'req-ff807a62-957a-437c-95eb-e930941cdd5d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:30.775367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ed313e540244a9499773802fa0c1fbb', 'request_id': 'req-ff807a62-957a-437c-95eb-e930941cdd5d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:30.793984 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2153/4322] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:30.806357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ed313e540244a9499773802fa0c1fbb', 'request_id': 'req-ff807a62-957a-437c-95eb-e930941cdd5d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:30.835496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] The token cache is being invalidate because project 4ed313e540244a9499773802fa0c1fbb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:30.836102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:30.837222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:30.843773 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2170/4323] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:30 2022] DELETE /identity/v3/projects/4ed313e540244a9499773802fa0c1fbb => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:30.845930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e4153-1730-44f8-bf93-7445b1128417 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:30.852789 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:30.976513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e4153-1730-44f8-bf93-7445b1128417 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:31.007428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:31.011311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:31.135901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:31.136554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:31.136976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:31.137369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] PATH_INFO: `/v3/users/830efb9030404f99ade8e32a44366fb8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:31.138691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=830efb9030404f99ade8e32a44366fb8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:31.140948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:31.154954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff807a62-957a-437c-95eb-e930941cdd5d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:31.190476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db81ac-ea2e-44fe-8e59-345f73156484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:31.191152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db81ac-ea2e-44fe-8e59-345f73156484 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:31.191430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db81ac-ea2e-44fe-8e59-345f73156484 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:31.191710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db81ac-ea2e-44fe-8e59-345f73156484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:31.203523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-02db81ac-ea2e-44fe-8e59-345f73156484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:31.294705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '830efb9030404f99ade8e32a44366fb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.325005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '830efb9030404f99ade8e32a44366fb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.325005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '830efb9030404f99ade8e32a44366fb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.337116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db81ac-ea2e-44fe-8e59-345f73156484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:31.337116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db81ac-ea2e-44fe-8e59-345f73156484 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:31.341530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '830efb9030404f99ade8e32a44366fb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.350093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '830efb9030404f99ade8e32a44366fb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.359796 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2171/4324] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:31.363986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb02826-a051-4a5b-b43f-1eac90d8e85f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:31.364310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb02826-a051-4a5b-b43f-1eac90d8e85f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:31.364588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb02826-a051-4a5b-b43f-1eac90d8e85f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:31.367455 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2154/4325] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:30 2022] DELETE /identity/v3/users/830efb9030404f99ade8e32a44366fb8 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:31.374841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:31.376273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:31.433417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6eb02826-a051-4a5b-b43f-1eac90d8e85f None None] MFA Rules not processed for user `d9ac971da2614beab2e4598795ed9583`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:31.434648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6eb02826-a051-4a5b-b43f-1eac90d8e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:31.452855 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:31.526986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e3c46e-d6c8-4761-a7c8-00709b4ab6fb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:31.541924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:31.543006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:31.544442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:31.545947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] PATH_INFO: `/v3/users/d48df3c4c2b8424b8e04461eef77cde2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:31.548812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d48df3c4c2b8424b8e04461eef77cde2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:31.551200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:31.602766 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2172/4326] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:31.651281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd48df3c4c2b8424b8e04461eef77cde2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.687398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd48df3c4c2b8424b8e04461eef77cde2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.688305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd48df3c4c2b8424b8e04461eef77cde2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.696847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb02826-a051-4a5b-b43f-1eac90d8e85f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:31.700132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6eb02826-a051-4a5b-b43f-1eac90d8e85f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:31.726785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd48df3c4c2b8424b8e04461eef77cde2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.751089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a3ae51b0-e4bd-4cd0-8211-bda516919caa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd48df3c4c2b8424b8e04461eef77cde2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:31.765935 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2155/4327] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:31 2022] DELETE /identity/v3/users/d48df3c4c2b8424b8e04461eef77cde2 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:13:31.770099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f9f9-25f5-49b7-809d-b032e8830299 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:31.771063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f9f9-25f5-49b7-809d-b032e8830299 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:31.771445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f895f9f9-25f5-49b7-809d-b032e8830299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:31.786995 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:31.815921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f895f9f9-25f5-49b7-809d-b032e8830299 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:31.819584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f895f9f9-25f5-49b7-809d-b032e8830299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:31.903232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb02826-a051-4a5b-b43f-1eac90d8e85f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:32.001332 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2156/4328] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:32.023325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d5f27-983b-45b6-93f2-855427200169 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:32.024061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d5f27-983b-45b6-93f2-855427200169 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:32.024410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d5f27-983b-45b6-93f2-855427200169 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:32.024749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d5f27-983b-45b6-93f2-855427200169 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:32.030192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-338d5f27-983b-45b6-93f2-855427200169 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:32.034809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f9f9-25f5-49b7-809d-b032e8830299 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:32.036895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f895f9f9-25f5-49b7-809d-b032e8830299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:32.059565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f895f9f9-25f5-49b7-809d-b032e8830299 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:32.076877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144f72-6a42-41fa-996b-f4d2ecfd9c44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:32.077838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144f72-6a42-41fa-996b-f4d2ecfd9c44 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:32.078127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144f72-6a42-41fa-996b-f4d2ecfd9c44 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:32.078408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b144f72-6a42-41fa-996b-f4d2ecfd9c44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:32.126367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b144f72-6a42-41fa-996b-f4d2ecfd9c44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:32.128743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b144f72-6a42-41fa-996b-f4d2ecfd9c44 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:32.172913 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2157/4329] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:13:32.174681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d5f27-983b-45b6-93f2-855427200169 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:32.178450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d5f27-983b-45b6-93f2-855427200169 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:32.187948 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2173/4330] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:31 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:32.293051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144f72-6a42-41fa-996b-f4d2ecfd9c44 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:32.295585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b144f72-6a42-41fa-996b-f4d2ecfd9c44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:32.319351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b144f72-6a42-41fa-996b-f4d2ecfd9c44 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:32.326440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:32.327382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:32.327829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:32.328314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] PATH_INFO: `/v3/projects/dd461f5f0eaa4a7583de3c03e75c85db` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:32.329799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd461f5f0eaa4a7583de3c03e75c85db)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:32.332552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:32.428310 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:32.459800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd461f5f0eaa4a7583de3c03e75c85db', 'request_id': 'req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:32.469611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd461f5f0eaa4a7583de3c03e75c85db', 'request_id': 'req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:32.488088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd461f5f0eaa4a7583de3c03e75c85db', 'request_id': 'req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:32.508418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] The token cache is being invalidate because project dd461f5f0eaa4a7583de3c03e75c85db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:32.509112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:32.510285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-db80a9b7-2c8b-47b8-ae26-a3f33a9fd901 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:32.513837 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2158/4331] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:32 2022] DELETE /identity/v3/projects/dd461f5f0eaa4a7583de3c03e75c85db => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:32.518878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2079d-0b9f-446f-a4bc-5d3d8b4979e9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:32.519901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2079d-0b9f-446f-a4bc-5d3d8b4979e9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:32.520303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d2079d-0b9f-446f-a4bc-5d3d8b4979e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:32.545370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-27d2079d-0b9f-446f-a4bc-5d3d8b4979e9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:32.547071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-27d2079d-0b9f-446f-a4bc-5d3d8b4979e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:32.641017 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2174/4332] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:32.648498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb77778-a13b-45d4-b5cc-5c0ac4258610 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:32.648837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb77778-a13b-45d4-b5cc-5c0ac4258610 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:32.649118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb77778-a13b-45d4-b5cc-5c0ac4258610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:32.676219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9cb77778-a13b-45d4-b5cc-5c0ac4258610 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:32.678247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9cb77778-a13b-45d4-b5cc-5c0ac4258610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:32.689317 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2159/4333] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:32.694546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2079d-0b9f-446f-a4bc-5d3d8b4979e9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:32.707157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d2079d-0b9f-446f-a4bc-5d3d8b4979e9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:32.716684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081324f-e17d-4f3a-9e04-f920499bab84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:32.717744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081324f-e17d-4f3a-9e04-f920499bab84 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:32.718776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081324f-e17d-4f3a-9e04-f920499bab84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:32.719356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f081324f-e17d-4f3a-9e04-f920499bab84 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:32.720957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081324f-e17d-4f3a-9e04-f920499bab84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:32.721526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081324f-e17d-4f3a-9e04-f920499bab84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:32.723610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f081324f-e17d-4f3a-9e04-f920499bab84 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:32.738255 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2175/4334] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:13:32.742633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb77778-a13b-45d4-b5cc-5c0ac4258610 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:32.761056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb77778-a13b-45d4-b5cc-5c0ac4258610 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:32.767708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af1fd7-5bae-439e-8f53-ad8f2a370b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:32.769623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af1fd7-5bae-439e-8f53-ad8f2a370b7d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:32.770130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af1fd7-5bae-439e-8f53-ad8f2a370b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:32.771019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66af1fd7-5bae-439e-8f53-ad8f2a370b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:32.771900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af1fd7-5bae-439e-8f53-ad8f2a370b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:32.775525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66af1fd7-5bae-439e-8f53-ad8f2a370b7d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:32.836514 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2160/4335] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:32 2022] POST /identity/v3/projects => generated 365 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:32.840965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081324f-e17d-4f3a-9e04-f920499bab84 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:32.859450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f081324f-e17d-4f3a-9e04-f920499bab84 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:32.918207 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:33.028869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7e91c-62f0-437a-a18b-54025afd44c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:33.029743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7e91c-62f0-437a-a18b-54025afd44c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:33.030388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7e91c-62f0-437a-a18b-54025afd44c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:33.030770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7e91c-62f0-437a-a18b-54025afd44c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:33.031511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7e91c-62f0-437a-a18b-54025afd44c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:33.035612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf7e91c-62f0-437a-a18b-54025afd44c5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:33.134523 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2176/4336] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:32 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:33.138921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af1fd7-5bae-439e-8f53-ad8f2a370b7d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:33.157820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66af1fd7-5bae-439e-8f53-ad8f2a370b7d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:33.179000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f9316-6c74-4e9f-8425-071bef2e5f67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:33.179744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f9316-6c74-4e9f-8425-071bef2e5f67 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:33.180069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f9316-6c74-4e9f-8425-071bef2e5f67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:33.180755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4f9316-6c74-4e9f-8425-071bef2e5f67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:33.181496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f9316-6c74-4e9f-8425-071bef2e5f67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:33.183115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4f9316-6c74-4e9f-8425-071bef2e5f67 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:33.202728 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2161/4337] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:33.205884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7e91c-62f0-437a-a18b-54025afd44c5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:33.220813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7e91c-62f0-437a-a18b-54025afd44c5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:33.236257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e8c72-e607-4333-9c9c-880fe83c6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:33.238077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e8c72-e607-4333-9c9c-880fe83c6730 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:33.241228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e8c72-e607-4333-9c9c-880fe83c6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:33.242349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e8c72-e607-4333-9c9c-880fe83c6730 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:33.246820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e8c72-e607-4333-9c9c-880fe83c6730 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:33.251107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e8c72-e607-4333-9c9c-880fe83c6730 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:33.280311 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2177/4338] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:33 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:33.284868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f9316-6c74-4e9f-8425-071bef2e5f67 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:33.303148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4f9316-6c74-4e9f-8425-071bef2e5f67 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:33.312752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3781fffc-c669-4adb-85e6-0cfeb33dc61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:33.313077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781fffc-c669-4adb-85e6-0cfeb33dc61c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:33.314346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781fffc-c669-4adb-85e6-0cfeb33dc61c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:33.314657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3781fffc-c669-4adb-85e6-0cfeb33dc61c admin admin] PATH_INFO: `/v3/projects/df0378616c52465eaa510e4fa862104d/users/1a80467a0730410092ae40e1fbe70a65/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:33.351770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781fffc-c669-4adb-85e6-0cfeb33dc61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0378616c52465eaa510e4fa862104d, user_id=1a80467a0730410092ae40e1fbe70a65, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:33.355011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3781fffc-c669-4adb-85e6-0cfeb33dc61c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:33.380771 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2162/4339] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:33 2022] PUT /identity/v3/projects/df0378616c52465eaa510e4fa862104d/users/1a80467a0730410092ae40e1fbe70a65/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:33.392767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d50013-c43b-49fd-8a6d-e5367ebeef21 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:33.393180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d50013-c43b-49fd-8a6d-e5367ebeef21 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:33.393451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d50013-c43b-49fd-8a6d-e5367ebeef21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:33.455591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-67d50013-c43b-49fd-8a6d-e5367ebeef21 None None] MFA Rules not processed for user `1a80467a0730410092ae40e1fbe70a65`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:33.456810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-67d50013-c43b-49fd-8a6d-e5367ebeef21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:33.508966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba7b9e-de7a-4032-83b0-90773937e056 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:33.509533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba7b9e-de7a-4032-83b0-90773937e056 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:33.510014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba7b9e-de7a-4032-83b0-90773937e056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:33.590644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-34ba7b9e-de7a-4032-83b0-90773937e056 None None] MFA Rules not processed for user `de6929c304ff4260b9e7c4d469b71a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:33.595457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-34ba7b9e-de7a-4032-83b0-90773937e056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:33.639963 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2178/4340] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:33.643942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d50013-c43b-49fd-8a6d-e5367ebeef21 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:33.701342 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2163/4341] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:33.717391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba7b9e-de7a-4032-83b0-90773937e056 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:33.721702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-34ba7b9e-de7a-4032-83b0-90773937e056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:33.761243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d50013-c43b-49fd-8a6d-e5367ebeef21 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:33.770755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc97cd-fcb9-48f8-ac39-90632b102a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:33.771443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc97cd-fcb9-48f8-ac39-90632b102a21 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:33.771727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc97cd-fcb9-48f8-ac39-90632b102a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:33.771994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcc97cd-fcb9-48f8-ac39-90632b102a21 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:33.772631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc97cd-fcb9-48f8-ac39-90632b102a21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:33.778639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcc97cd-fcb9-48f8-ac39-90632b102a21 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:33.826159 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:33.846843 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2179/4342] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:33 2022] POST /identity/v3/projects => generated 363 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:13:33.854582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc97cd-fcb9-48f8-ac39-90632b102a21 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:33.871180 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:33.901806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba7b9e-de7a-4032-83b0-90773937e056 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:33.972320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcc97cd-fcb9-48f8-ac39-90632b102a21 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:33.984742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b225d-8a9f-4ddd-a1da-c91a692749f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:33.985948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b225d-8a9f-4ddd-a1da-c91a692749f0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:33.986941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b225d-8a9f-4ddd-a1da-c91a692749f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:33.987724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b225d-8a9f-4ddd-a1da-c91a692749f0 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:33.988814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b225d-8a9f-4ddd-a1da-c91a692749f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:33.991982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b225d-8a9f-4ddd-a1da-c91a692749f0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:34.017541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b60db-e68e-4726-aed8-cb0dab525028 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:34.025139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b60db-e68e-4726-aed8-cb0dab525028 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:34.025885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b60db-e68e-4726-aed8-cb0dab525028 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:34.029822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174b60db-e68e-4726-aed8-cb0dab525028 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:34.031416 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2180/4343] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:33 2022] POST /identity/v3/users => generated 288 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:13:34.038029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b225d-8a9f-4ddd-a1da-c91a692749f0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:34.081045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b225d-8a9f-4ddd-a1da-c91a692749f0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:34.102820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfd374-42e7-43fb-bf25-cea106cb7332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:34.102820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfd374-42e7-43fb-bf25-cea106cb7332 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:34.102820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfd374-42e7-43fb-bf25-cea106cb7332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:34.102820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bfd374-42e7-43fb-bf25-cea106cb7332 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:34.105329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfd374-42e7-43fb-bf25-cea106cb7332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:34.110300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bfd374-42e7-43fb-bf25-cea106cb7332 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:34.148798 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2181/4344] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:34.148798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfd374-42e7-43fb-bf25-cea106cb7332 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:34.165459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bfd374-42e7-43fb-bf25-cea106cb7332 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:34.172895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f3978-6778-446d-817b-5a614b2ad1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:34.175856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f3978-6778-446d-817b-5a614b2ad1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:34.176202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f3978-6778-446d-817b-5a614b2ad1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:34.177444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f3978-6778-446d-817b-5a614b2ad1ea admin admin] PATH_INFO: `/v3/projects/0f3c88d7be7f4f08a8e1a2ccfea73633/users/ed57438b32fe433a8618c7cc03fa5453/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:34.205234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b60db-e68e-4726-aed8-cb0dab525028 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:34.207510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174b60db-e68e-4726-aed8-cb0dab525028 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:34.230511 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2164/4345] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:13:34.276840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f3978-6778-446d-817b-5a614b2ad1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3c88d7be7f4f08a8e1a2ccfea73633, user_id=ed57438b32fe433a8618c7cc03fa5453, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:34.280473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f3978-6778-446d-817b-5a614b2ad1ea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:34.334625 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2182/4346] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:34 2022] PUT /identity/v3/projects/0f3c88d7be7f4f08a8e1a2ccfea73633/users/ed57438b32fe433a8618c7cc03fa5453/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:34.338973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b60db-e68e-4726-aed8-cb0dab525028 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:34.355050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174b60db-e68e-4726-aed8-cb0dab525028 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:34.506341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3dd574-5b61-4393-bb42-275418e1241a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:34.509194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dd574-5b61-4393-bb42-275418e1241a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:34.509533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dd574-5b61-4393-bb42-275418e1241a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:34.510528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3dd574-5b61-4393-bb42-275418e1241a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:34.513369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dd574-5b61-4393-bb42-275418e1241a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:34.518906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3dd574-5b61-4393-bb42-275418e1241a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:34.550308 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2165/4347] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:34 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:34.552729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f3978-6778-446d-817b-5a614b2ad1ea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:34.569529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f3978-6778-446d-817b-5a614b2ad1ea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:34.576267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9734-b146-4677-9797-64a4beca1cb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:34.576575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9734-b146-4677-9797-64a4beca1cb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:34.576944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9734-b146-4677-9797-64a4beca1cb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:34.577455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220d9734-b146-4677-9797-64a4beca1cb5 admin admin] PATH_INFO: `/v3/projects/0f3c88d7be7f4f08a8e1a2ccfea73633/users/ed57438b32fe433a8618c7cc03fa5453/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:34.594809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d9734-b146-4677-9797-64a4beca1cb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f3c88d7be7f4f08a8e1a2ccfea73633, user_id=ed57438b32fe433a8618c7cc03fa5453, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:34.599608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220d9734-b146-4677-9797-64a4beca1cb5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:34.636209 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2183/4348] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:34 2022] PUT /identity/v3/projects/0f3c88d7be7f4f08a8e1a2ccfea73633/users/ed57438b32fe433a8618c7cc03fa5453/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:34.648145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7db72-b51d-4367-913f-84142781cbb5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:34.648145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7db72-b51d-4367-913f-84142781cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:34.648145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa7db72-b51d-4367-913f-84142781cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:34.670836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9734-b146-4677-9797-64a4beca1cb5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:34.678478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-220d9734-b146-4677-9797-64a4beca1cb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:34.750014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5aa7db72-b51d-4367-913f-84142781cbb5 None None] MFA Rules not processed for user `ed57438b32fe433a8618c7cc03fa5453`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:34.753263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5aa7db72-b51d-4367-913f-84142781cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:34.779042 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:34.896469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220d9734-b146-4677-9797-64a4beca1cb5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:34.909356 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2166/4349] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:34.915286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:34.915720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:34.916111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:34.916435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] PATH_INFO: `/v3/projects/0bac94b8c28d4c20aacbcd2f7b5b40d2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:34.917740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bac94b8c28d4c20aacbcd2f7b5b40d2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:34.919698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:34.929194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7db72-b51d-4367-913f-84142781cbb5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:34.934724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5aa7db72-b51d-4367-913f-84142781cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:34.983178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bac94b8c28d4c20aacbcd2f7b5b40d2', 'request_id': 'req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:34.995619 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:INSERT=6,keystone:DELETE=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:35.000558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bac94b8c28d4c20aacbcd2f7b5b40d2', 'request_id': 'req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:35.019021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bac94b8c28d4c20aacbcd2f7b5b40d2', 'request_id': 'req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:35.055747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] The token cache is being invalidate because project 0bac94b8c28d4c20aacbcd2f7b5b40d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:35.056055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:35.062229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c35a820f-ddb2-4ab3-b080-c8dd6df1b9a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:35.065401 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2184/4350] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:34 2022] DELETE /identity/v3/projects/0bac94b8c28d4c20aacbcd2f7b5b40d2 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:13:35.070209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23201f-7c7c-41f1-b2fa-20e2a1420a82 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:35.070492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23201f-7c7c-41f1-b2fa-20e2a1420a82 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:35.070824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c23201f-7c7c-41f1-b2fa-20e2a1420a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:35.104175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa7db72-b51d-4367-913f-84142781cbb5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:35.116690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7c23201f-7c7c-41f1-b2fa-20e2a1420a82 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:35.118046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7c23201f-7c7c-41f1-b2fa-20e2a1420a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:35.218385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad6756-19db-450d-bed4-cc0a44566339 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:35.219782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad6756-19db-450d-bed4-cc0a44566339 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:35.220281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad6756-19db-450d-bed4-cc0a44566339 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:35.220932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad6756-19db-450d-bed4-cc0a44566339 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:35.225610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-56ad6756-19db-450d-bed4-cc0a44566339 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:35.261832 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2185/4351] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:35.268340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbdcc-d3d6-4438-b065-4c59febe2e72 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:35.268704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbdcc-d3d6-4438-b065-4c59febe2e72 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:35.269044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35bbdcc-d3d6-4438-b065-4c59febe2e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:35.313057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a35bbdcc-d3d6-4438-b065-4c59febe2e72 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:35.316278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a35bbdcc-d3d6-4438-b065-4c59febe2e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:35.342714 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2186/4352] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:35.343843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bbdcc-d3d6-4438-b065-4c59febe2e72 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:35.367950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35bbdcc-d3d6-4438-b065-4c59febe2e72 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:35.389313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b5b8-296f-4a34-8a52-02e0f735f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:35.391345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b5b8-296f-4a34-8a52-02e0f735f22e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:35.391785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b5b8-296f-4a34-8a52-02e0f735f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:35.393280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a36b5b8-296f-4a34-8a52-02e0f735f22e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:35.394200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36b5b8-296f-4a34-8a52-02e0f735f22e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:35.395599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36b5b8-296f-4a34-8a52-02e0f735f22e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:35.396849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad6756-19db-450d-bed4-cc0a44566339 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:35.399712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad6756-19db-450d-bed4-cc0a44566339 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:35.400559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a36b5b8-296f-4a34-8a52-02e0f735f22e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:35.439540 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2187/4353] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:13:35.440771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b5b8-296f-4a34-8a52-02e0f735f22e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:35.446647 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2167/4354] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:35.462981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a36b5b8-296f-4a34-8a52-02e0f735f22e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:35.474813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64c34-b55a-4ede-a574-a939074ca600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:35.475428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64c34-b55a-4ede-a574-a939074ca600 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:35.475771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64c34-b55a-4ede-a574-a939074ca600 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:35.476106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b64c34-b55a-4ede-a574-a939074ca600 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:35.476860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b64c34-b55a-4ede-a574-a939074ca600 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:35.478889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b64c34-b55a-4ede-a574-a939074ca600 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:35.595432 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2188/4355] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:35 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:35.598093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad6756-19db-450d-bed4-cc0a44566339 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:35.609630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad6756-19db-450d-bed4-cc0a44566339 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:35.615662 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:35.739573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa0b23-1076-44ba-bc99-ede263fefb0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:35.740218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa0b23-1076-44ba-bc99-ede263fefb0f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:35.740506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa0b23-1076-44ba-bc99-ede263fefb0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:35.740786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfa0b23-1076-44ba-bc99-ede263fefb0f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:35.741456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa0b23-1076-44ba-bc99-ede263fefb0f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:35.743402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfa0b23-1076-44ba-bc99-ede263fefb0f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:35.797926 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2168/4356] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:35 2022] POST /identity/v3/users => generated 287 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:35.802355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64c34-b55a-4ede-a574-a939074ca600 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:35.821128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b64c34-b55a-4ede-a574-a939074ca600 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:35.839193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c8ba1-2819-4f6c-9384-6f7c7234cf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:35.839193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c8ba1-2819-4f6c-9384-6f7c7234cf9b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:35.839193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c8ba1-2819-4f6c-9384-6f7c7234cf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:35.839193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690c8ba1-2819-4f6c-9384-6f7c7234cf9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:35.839589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c8ba1-2819-4f6c-9384-6f7c7234cf9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:35.840076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690c8ba1-2819-4f6c-9384-6f7c7234cf9b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:35.867582 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2189/4357] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:35.872791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa0b23-1076-44ba-bc99-ede263fefb0f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:35.886979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfa0b23-1076-44ba-bc99-ede263fefb0f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:35.894561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462ceb21-816b-44d0-bb98-a45aa0afdd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:35.895335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ceb21-816b-44d0-bb98-a45aa0afdd0a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:35.895678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ceb21-816b-44d0-bb98-a45aa0afdd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:35.896020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462ceb21-816b-44d0-bb98-a45aa0afdd0a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:35.896737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ceb21-816b-44d0-bb98-a45aa0afdd0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:35.898717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462ceb21-816b-44d0-bb98-a45aa0afdd0a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:35.916620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c8ba1-2819-4f6c-9384-6f7c7234cf9b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:35.930229 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2169/4358] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:35 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:35.933267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690c8ba1-2819-4f6c-9384-6f7c7234cf9b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:35.942469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3403500-1933-48d7-b952-a416d9af846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:35.943157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3403500-1933-48d7-b952-a416d9af846e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:35.943445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3403500-1933-48d7-b952-a416d9af846e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:35.943726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3403500-1933-48d7-b952-a416d9af846e admin admin] PATH_INFO: `/v3/projects/1066478a14ef460c9b37077ab5732b24/users/8500417d6411466b84aa1c55deb848a0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:35.961864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3403500-1933-48d7-b952-a416d9af846e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1066478a14ef460c9b37077ab5732b24, user_id=8500417d6411466b84aa1c55deb848a0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:35.966263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3403500-1933-48d7-b952-a416d9af846e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:36.005631 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2190/4359] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:35 2022] PUT /identity/v3/projects/1066478a14ef460c9b37077ab5732b24/users/8500417d6411466b84aa1c55deb848a0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:36.010180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432320bc-1002-4e94-9f85-f647f6510ecf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:36.010576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432320bc-1002-4e94-9f85-f647f6510ecf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:36.010951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432320bc-1002-4e94-9f85-f647f6510ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:36.087722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-432320bc-1002-4e94-9f85-f647f6510ecf None None] MFA Rules not processed for user `8500417d6411466b84aa1c55deb848a0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:36.089055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-432320bc-1002-4e94-9f85-f647f6510ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:36.205205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3403500-1933-48d7-b952-a416d9af846e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:36.205378 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2170/4360] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:36.429983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3403500-1933-48d7-b952-a416d9af846e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:36.450416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec1e7f-454f-414c-8e9a-400cab745fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:36.451173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec1e7f-454f-414c-8e9a-400cab745fee admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:36.452050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec1e7f-454f-414c-8e9a-400cab745fee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:36.452425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffec1e7f-454f-414c-8e9a-400cab745fee admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:36.453168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec1e7f-454f-414c-8e9a-400cab745fee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:36.462461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffec1e7f-454f-414c-8e9a-400cab745fee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:36.488650 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:36.514773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432320bc-1002-4e94-9f85-f647f6510ecf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:36.516257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-432320bc-1002-4e94-9f85-f647f6510ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:36.556782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432320bc-1002-4e94-9f85-f647f6510ecf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:36.564371 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2191/4361] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:36 2022] POST /identity/v3/projects => generated 373 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:13:36.565786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec1e7f-454f-414c-8e9a-400cab745fee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:36.572321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:36.572979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:36.573329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:36.573614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] PATH_INFO: `/v3/users/1a80467a0730410092ae40e1fbe70a65` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:36.574780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a80467a0730410092ae40e1fbe70a65)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:36.577651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:36.685240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a80467a0730410092ae40e1fbe70a65'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:36.707317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a80467a0730410092ae40e1fbe70a65'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:36.708799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a80467a0730410092ae40e1fbe70a65'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:36.729136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a80467a0730410092ae40e1fbe70a65'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:36.731128 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:36.747785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffec1e7f-454f-414c-8e9a-400cab745fee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:36.770030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab04fe-72a9-4368-b52e-a74625308154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:36.771473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab04fe-72a9-4368-b52e-a74625308154 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:36.773120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab04fe-72a9-4368-b52e-a74625308154 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:36.773602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab04fe-72a9-4368-b52e-a74625308154 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:36.774420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab04fe-72a9-4368-b52e-a74625308154 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:36.782783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dab04fe-72a9-4368-b52e-a74625308154 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:36.794601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-206da3f0-9d43-4211-afa8-7249307ef972 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a80467a0730410092ae40e1fbe70a65'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:36.810684 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2171/4362] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:36 2022] DELETE /identity/v3/users/1a80467a0730410092ae40e1fbe70a65 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:13:36.816391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165ddf2-f63e-419f-a80b-05c23090b75a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:36.816916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165ddf2-f63e-419f-a80b-05c23090b75a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:36.818468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0165ddf2-f63e-419f-a80b-05c23090b75a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:36.842107 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2192/4363] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:36 2022] POST /identity/v3/users => generated 293 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:36.843938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab04fe-72a9-4368-b52e-a74625308154 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:36.846186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7dab04fe-72a9-4368-b52e-a74625308154 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:36.861186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dab04fe-72a9-4368-b52e-a74625308154 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:36.899688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0165ddf2-f63e-419f-a80b-05c23090b75a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:36.906226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0165ddf2-f63e-419f-a80b-05c23090b75a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:37.032306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8d18-e191-4d77-bd47-7fe23eb8337b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:37.033116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8d18-e191-4d77-bd47-7fe23eb8337b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:37.034025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8d18-e191-4d77-bd47-7fe23eb8337b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:37.034328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e8d18-e191-4d77-bd47-7fe23eb8337b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:37.038826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e8d18-e191-4d77-bd47-7fe23eb8337b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:37.045973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932e8d18-e191-4d77-bd47-7fe23eb8337b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:37.068513 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2193/4364] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:37.069654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8d18-e191-4d77-bd47-7fe23eb8337b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:37.087265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e8d18-e191-4d77-bd47-7fe23eb8337b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:37.097135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37e2a-860e-40ee-ab04-3984c891a113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:37.107762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37e2a-860e-40ee-ab04-3984c891a113 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:37.108050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37e2a-860e-40ee-ab04-3984c891a113 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:37.108423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e37e2a-860e-40ee-ab04-3984c891a113 admin admin] PATH_INFO: `/v3/projects/7fcf582d3e4f43828ccab6013657f2b8/users/9d6d17e1ee1b4d4dae9c3d24bf026c64/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:37.130778 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2172/4365] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:37.143669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37e2a-860e-40ee-ab04-3984c891a113 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcf582d3e4f43828ccab6013657f2b8, user_id=9d6d17e1ee1b4d4dae9c3d24bf026c64, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:37.148247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e37e2a-860e-40ee-ab04-3984c891a113 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:37.168768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc84d03-c2da-4b12-a31c-1eb05317df33 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:37.168768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc84d03-c2da-4b12-a31c-1eb05317df33 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:37.169057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc84d03-c2da-4b12-a31c-1eb05317df33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:37.174307 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2194/4366] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:37 2022] PUT /identity/v3/projects/7fcf582d3e4f43828ccab6013657f2b8/users/9d6d17e1ee1b4d4dae9c3d24bf026c64/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:37.175667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37e2a-860e-40ee-ab04-3984c891a113 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:37.206387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6cc84d03-c2da-4b12-a31c-1eb05317df33 None None] MFA Rules not processed for user `d9ac971da2614beab2e4598795ed9583`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:37.207635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6cc84d03-c2da-4b12-a31c-1eb05317df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:37.279470 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:37.299663 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2173/4367] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:37.301214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc84d03-c2da-4b12-a31c-1eb05317df33 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:37.303052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6cc84d03-c2da-4b12-a31c-1eb05317df33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:37.307669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e37e2a-860e-40ee-ab04-3984c891a113 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:37.314899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3c737-0cff-40cb-b11d-2da051e0ccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:37.315881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3c737-0cff-40cb-b11d-2da051e0ccbb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:37.316506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3c737-0cff-40cb-b11d-2da051e0ccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:37.317041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c3c737-0cff-40cb-b11d-2da051e0ccbb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:37.318099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3c737-0cff-40cb-b11d-2da051e0ccbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:37.319993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c3c737-0cff-40cb-b11d-2da051e0ccbb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:37.343185 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2195/4368] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:37 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:37.347568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3c737-0cff-40cb-b11d-2da051e0ccbb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:37.374994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c3c737-0cff-40cb-b11d-2da051e0ccbb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:37.388450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd048f6-1c51-4c83-9b3a-2ee10d4610ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:37.389132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd048f6-1c51-4c83-9b3a-2ee10d4610ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:37.389465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd048f6-1c51-4c83-9b3a-2ee10d4610ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:37.389737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd048f6-1c51-4c83-9b3a-2ee10d4610ed admin admin] PATH_INFO: `/v3/projects/7fcf582d3e4f43828ccab6013657f2b8/users/9d6d17e1ee1b4d4dae9c3d24bf026c64/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:37.396803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd048f6-1c51-4c83-9b3a-2ee10d4610ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcf582d3e4f43828ccab6013657f2b8, user_id=9d6d17e1ee1b4d4dae9c3d24bf026c64, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:37.399716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd048f6-1c51-4c83-9b3a-2ee10d4610ed admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:37.463636 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2196/4369] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:37 2022] PUT /identity/v3/projects/7fcf582d3e4f43828ccab6013657f2b8/users/9d6d17e1ee1b4d4dae9c3d24bf026c64/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:13:37.474171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7920cc0-0aa1-490d-b6f0-2c35287ecfbe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:37.474568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7920cc0-0aa1-490d-b6f0-2c35287ecfbe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:37.474867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7920cc0-0aa1-490d-b6f0-2c35287ecfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:37.497342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc84d03-c2da-4b12-a31c-1eb05317df33 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:37.539304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a7920cc0-0aa1-490d-b6f0-2c35287ecfbe None None] MFA Rules not processed for user `9d6d17e1ee1b4d4dae9c3d24bf026c64`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:37.543692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7920cc0-0aa1-490d-b6f0-2c35287ecfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:37.605224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feedb3-b1b9-42f7-a228-a1816a927163 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:37.610151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feedb3-b1b9-42f7-a228-a1816a927163 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:37.610589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feedb3-b1b9-42f7-a228-a1816a927163 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:37.611113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feedb3-b1b9-42f7-a228-a1816a927163 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:37.625778 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:37.736672 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2197/4370] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:37 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:37.746278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8feedb3-b1b9-42f7-a228-a1816a927163 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:37.747062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7920cc0-0aa1-490d-b6f0-2c35287ecfbe None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:37.750814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8feedb3-b1b9-42f7-a228-a1816a927163 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:37.767692 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2174/4371] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:37.772885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7920cc0-0aa1-490d-b6f0-2c35287ecfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:37.906976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7920cc0-0aa1-490d-b6f0-2c35287ecfbe None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:37.913163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285089ea-4e7d-4689-9a82-315751fc81ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:37.913908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285089ea-4e7d-4689-9a82-315751fc81ac service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:37.914264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285089ea-4e7d-4689-9a82-315751fc81ac service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:37.914610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285089ea-4e7d-4689-9a82-315751fc81ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:37.931653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285089ea-4e7d-4689-9a82-315751fc81ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:37.934607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285089ea-4e7d-4689-9a82-315751fc81ac service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:37.947386 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2198/4372] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:37 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:13:38.114738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feedb3-b1b9-42f7-a228-a1816a927163 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:38.133000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feedb3-b1b9-42f7-a228-a1816a927163 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:38.146458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:38.147111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:38.147398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:38.147677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:38.154096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:38.319108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:38.320654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:38.353961 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2175/4373] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:39.448922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21580c7a-7b52-4bc7-9824-7c95bbcb06e7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:39.449610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21580c7a-7b52-4bc7-9824-7c95bbcb06e7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:39.449610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21580c7a-7b52-4bc7-9824-7c95bbcb06e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:39.494104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:39.499103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:39.526604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-21580c7a-7b52-4bc7-9824-7c95bbcb06e7 None None] MFA Rules not processed for user `8cfd0f5d7dcd444a9414c69b41044a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:39.527822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-21580c7a-7b52-4bc7-9824-7c95bbcb06e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:39.537826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a737f1ac-06e4-4c0d-bcdf-44d92acac2f8 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:39.544147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:39.546024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:39.546795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:39.547426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] PATH_INFO: `/v3/projects/df0378616c52465eaa510e4fa862104d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:39.548863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0378616c52465eaa510e4fa862104d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:39.551288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:39.625174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0378616c52465eaa510e4fa862104d', 'request_id': 'req-434887d4-363f-4845-ae8f-75fb64310757'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:39.635324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0378616c52465eaa510e4fa862104d', 'request_id': 'req-434887d4-363f-4845-ae8f-75fb64310757'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:39.657373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0378616c52465eaa510e4fa862104d', 'request_id': 'req-434887d4-363f-4845-ae8f-75fb64310757'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:39.662775 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:39.681114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] The token cache is being invalidate because project df0378616c52465eaa510e4fa862104d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:39.681509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:39.683031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:39.688676 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2176/4374] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:39 2022] DELETE /identity/v3/projects/df0378616c52465eaa510e4fa862104d => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:39.692511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:39.695263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:39.704257 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2199/4375] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:39.716193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20791c1-ed41-4688-a935-4b9dbbd18f12 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:39.716586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20791c1-ed41-4688-a935-4b9dbbd18f12 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:39.717013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20791c1-ed41-4688-a935-4b9dbbd18f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:39.780109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e20791c1-ed41-4688-a935-4b9dbbd18f12 None None] MFA Rules not processed for user `8cfd0f5d7dcd444a9414c69b41044a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:39.780109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e20791c1-ed41-4688-a935-4b9dbbd18f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:39.793753 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:39.898370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434887d4-363f-4845-ae8f-75fb64310757 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:39.904971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:39.905778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:39.906130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:39.906500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] PATH_INFO: `/v3/users/ed57438b32fe433a8618c7cc03fa5453` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:39.908695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed57438b32fe433a8618c7cc03fa5453)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:39.914390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:39.988129 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2200/4376] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:39 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:40.002191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20791c1-ed41-4688-a935-4b9dbbd18f12 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:40.004849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e20791c1-ed41-4688-a935-4b9dbbd18f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:40.070830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed57438b32fe433a8618c7cc03fa5453'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:40.090888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed57438b32fe433a8618c7cc03fa5453'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:40.092321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed57438b32fe433a8618c7cc03fa5453'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:40.106284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed57438b32fe433a8618c7cc03fa5453'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:40.121219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de3e407-984e-4512-a8c3-31f9a867ea10 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed57438b32fe433a8618c7cc03fa5453'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:40.140293 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2177/4377] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:39 2022] DELETE /identity/v3/users/ed57438b32fe433a8618c7cc03fa5453 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:40.142466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e957c-a840-435e-8d96-beaf977acbeb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:40.142766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e957c-a840-435e-8d96-beaf977acbeb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:40.143099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e957c-a840-435e-8d96-beaf977acbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:40.172500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ab9e957c-a840-435e-8d96-beaf977acbeb None None] MFA Rules not processed for user `de6929c304ff4260b9e7c4d469b71a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:40.174795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab9e957c-a840-435e-8d96-beaf977acbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:40.240938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20791c1-ed41-4688-a935-4b9dbbd18f12 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:40.324147 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2178/4378] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:40.388068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d1de54-5d49-4a8c-9ff6-540b460d1813 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:40.391118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1de54-5d49-4a8c-9ff6-540b460d1813 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:40.392087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1de54-5d49-4a8c-9ff6-540b460d1813 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:40.393106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d1de54-5d49-4a8c-9ff6-540b460d1813 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:40.398831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f9d1de54-5d49-4a8c-9ff6-540b460d1813 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:40.469702 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:40.507904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1de54-5d49-4a8c-9ff6-540b460d1813 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:40.510977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d1de54-5d49-4a8c-9ff6-540b460d1813 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:40.523955 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2201/4379] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:40 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:40.824095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e957c-a840-435e-8d96-beaf977acbeb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:40.826169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab9e957c-a840-435e-8d96-beaf977acbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:40.926685 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:40.963495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e957c-a840-435e-8d96-beaf977acbeb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:40.976216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:40.976873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:40.977152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:40.977486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] PATH_INFO: `/v3/projects/0f3c88d7be7f4f08a8e1a2ccfea73633` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:40.978649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f3c88d7be7f4f08a8e1a2ccfea73633)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:40.980628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:41.092480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f3c88d7be7f4f08a8e1a2ccfea73633', 'request_id': 'req-7cae08b8-9422-4d07-92d6-0c68e958f137'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:41.106228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f3c88d7be7f4f08a8e1a2ccfea73633', 'request_id': 'req-7cae08b8-9422-4d07-92d6-0c68e958f137'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:41.131457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f3c88d7be7f4f08a8e1a2ccfea73633', 'request_id': 'req-7cae08b8-9422-4d07-92d6-0c68e958f137'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:41.149428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] The token cache is being invalidate because project 0f3c88d7be7f4f08a8e1a2ccfea73633 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:41.149723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:41.151415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7cae08b8-9422-4d07-92d6-0c68e958f137 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:41.160356 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2179/4380] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:40 2022] DELETE /identity/v3/projects/0f3c88d7be7f4f08a8e1a2ccfea73633 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:41.167039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a7e5-b774-4eca-be79-56c0b376608f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:41.167540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a7e5-b774-4eca-be79-56c0b376608f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:41.168000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c0a7e5-b774-4eca-be79-56c0b376608f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:41.223784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-32c0a7e5-b774-4eca-be79-56c0b376608f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:41.231729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-32c0a7e5-b774-4eca-be79-56c0b376608f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:41.382012 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2202/4381] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:41.394986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105657e0-322d-4610-b609-91f73da3eb8c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:41.396066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105657e0-322d-4610-b609-91f73da3eb8c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:41.396501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105657e0-322d-4610-b609-91f73da3eb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:41.445822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-105657e0-322d-4610-b609-91f73da3eb8c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:41.447391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-105657e0-322d-4610-b609-91f73da3eb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:41.462530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a7e5-b774-4eca-be79-56c0b376608f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:41.467366 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2180/4382] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:41.479613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c0a7e5-b774-4eca-be79-56c0b376608f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:41.492642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8353-159d-4ada-ba92-01004f75d9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:41.493669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8353-159d-4ada-ba92-01004f75d9fa admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:41.493964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8353-159d-4ada-ba92-01004f75d9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:41.494249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac8353-159d-4ada-ba92-01004f75d9fa admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:41.494906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac8353-159d-4ada-ba92-01004f75d9fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:41.495221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac8353-159d-4ada-ba92-01004f75d9fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:41.496855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ac8353-159d-4ada-ba92-01004f75d9fa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:41.522811 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2203/4383] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:13:41.527156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105657e0-322d-4610-b609-91f73da3eb8c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:41.547686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105657e0-322d-4610-b609-91f73da3eb8c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:41.553307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650085c7-21b2-438c-925c-0e48ec0c32de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:41.554275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650085c7-21b2-438c-925c-0e48ec0c32de admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:41.554275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650085c7-21b2-438c-925c-0e48ec0c32de admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:41.554493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650085c7-21b2-438c-925c-0e48ec0c32de admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:41.555354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650085c7-21b2-438c-925c-0e48ec0c32de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:41.557016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650085c7-21b2-438c-925c-0e48ec0c32de admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:41.622201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8353-159d-4ada-ba92-01004f75d9fa admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:41.622648 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2181/4384] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:41 2022] POST /identity/v3/projects => generated 363 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:13:41.636060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac8353-159d-4ada-ba92-01004f75d9fa admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:41.761781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd98a47-20a8-45e9-bcf7-410ccdaa30ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:41.762709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd98a47-20a8-45e9-bcf7-410ccdaa30ee admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:41.763393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd98a47-20a8-45e9-bcf7-410ccdaa30ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:41.763800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd98a47-20a8-45e9-bcf7-410ccdaa30ee admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:41.764690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd98a47-20a8-45e9-bcf7-410ccdaa30ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:41.766787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd98a47-20a8-45e9-bcf7-410ccdaa30ee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:41.832829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650085c7-21b2-438c-925c-0e48ec0c32de admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:41.833843 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2204/4385] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:41 2022] POST /identity/v3/users => generated 282 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:13:41.851261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650085c7-21b2-438c-925c-0e48ec0c32de admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:41.861947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5754b4-536d-4e3a-8799-b5c43c4a1c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:41.862576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5754b4-536d-4e3a-8799-b5c43c4a1c43 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:41.862855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5754b4-536d-4e3a-8799-b5c43c4a1c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:41.863127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5754b4-536d-4e3a-8799-b5c43c4a1c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:41.868649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5754b4-536d-4e3a-8799-b5c43c4a1c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:41.871158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5754b4-536d-4e3a-8799-b5c43c4a1c43 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:41.930480 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2182/4386] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:41.930882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd98a47-20a8-45e9-bcf7-410ccdaa30ee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:41.965270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd98a47-20a8-45e9-bcf7-410ccdaa30ee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:41.999263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd73f85-c09c-4ac8-aeb8-0f7850e02e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:41.999911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd73f85-c09c-4ac8-aeb8-0f7850e02e61 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:42.000175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd73f85-c09c-4ac8-aeb8-0f7850e02e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:42.000448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd73f85-c09c-4ac8-aeb8-0f7850e02e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:42.001087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd73f85-c09c-4ac8-aeb8-0f7850e02e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:42.002793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd73f85-c09c-4ac8-aeb8-0f7850e02e61 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:42.061070 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2205/4387] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:41 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:42.063938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5754b4-536d-4e3a-8799-b5c43c4a1c43 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:42.095310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5754b4-536d-4e3a-8799-b5c43c4a1c43 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:42.110485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf74e8-b24e-4d46-b56a-cf8dfecf856f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:42.111981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf74e8-b24e-4d46-b56a-cf8dfecf856f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:42.113665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf74e8-b24e-4d46-b56a-cf8dfecf856f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:42.114815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aaf74e8-b24e-4d46-b56a-cf8dfecf856f admin admin] PATH_INFO: `/v3/projects/ae5952afadaf4ad4902011af67f55b61/users/4707b07f351e4ef9ba09b8e0453e9372/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:42.151298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf74e8-b24e-4d46-b56a-cf8dfecf856f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae5952afadaf4ad4902011af67f55b61, user_id=4707b07f351e4ef9ba09b8e0453e9372, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:42.155655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aaf74e8-b24e-4d46-b56a-cf8dfecf856f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:42.183650 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2183/4388] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:42 2022] PUT /identity/v3/projects/ae5952afadaf4ad4902011af67f55b61/users/4707b07f351e4ef9ba09b8e0453e9372/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:42.195049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf5e40-4dca-4be4-906c-244f011c4f58 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:42.195049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf5e40-4dca-4be4-906c-244f011c4f58 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:42.195257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf5e40-4dca-4be4-906c-244f011c4f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:42.275533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2faf5e40-4dca-4be4-906c-244f011c4f58 None None] MFA Rules not processed for user `4707b07f351e4ef9ba09b8e0453e9372`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:42.277221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2faf5e40-4dca-4be4-906c-244f011c4f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:42.375067 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:42.464102 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2206/4389] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:42.468284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf74e8-b24e-4d46-b56a-cf8dfecf856f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:42.582679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf5e40-4dca-4be4-906c-244f011c4f58 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:42.584985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2faf5e40-4dca-4be4-906c-244f011c4f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:42.665651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aaf74e8-b24e-4d46-b56a-cf8dfecf856f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:42.694308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227ae5b-5fa9-4132-986b-840f5b0e0e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:42.695762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227ae5b-5fa9-4132-986b-840f5b0e0e33 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:42.696297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227ae5b-5fa9-4132-986b-840f5b0e0e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:42.696975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8227ae5b-5fa9-4132-986b-840f5b0e0e33 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:42.701460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227ae5b-5fa9-4132-986b-840f5b0e0e33 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:42.710072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8227ae5b-5fa9-4132-986b-840f5b0e0e33 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:42.775114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf5e40-4dca-4be4-906c-244f011c4f58 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:42.780513 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:42.782145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:42.782998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:42.783611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:42.784248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] PATH_INFO: `/v3/users/f80f666981ad4c04b1122d6d640065e8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:42.786605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f80f666981ad4c04b1122d6d640065e8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:42.790883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:42.808915 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2184/4390] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:42 2022] POST /identity/v3/projects => generated 361 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:42.811118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227ae5b-5fa9-4132-986b-840f5b0e0e33 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:43.008687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f80f666981ad4c04b1122d6d640065e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:43.143409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8227ae5b-5fa9-4132-986b-840f5b0e0e33 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:43.144370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f80f666981ad4c04b1122d6d640065e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:43.146348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f80f666981ad4c04b1122d6d640065e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:43.153439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637da29-7217-46ca-8266-c47a36a13a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:43.154294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637da29-7217-46ca-8266-c47a36a13a0e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:43.154668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637da29-7217-46ca-8266-c47a36a13a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:43.155071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b637da29-7217-46ca-8266-c47a36a13a0e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:43.156730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637da29-7217-46ca-8266-c47a36a13a0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:43.162400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b637da29-7217-46ca-8266-c47a36a13a0e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:43.168933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f80f666981ad4c04b1122d6d640065e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:43.179223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6c7984ae-012d-4198-bb01-a2e9f901e458 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f80f666981ad4c04b1122d6d640065e8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:43.196041 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2207/4391] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:13:42 2022] DELETE /identity/v3/users/f80f666981ad4c04b1122d6d640065e8 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:43.202615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734fbcb-b45c-44c0-993c-12cf524f54fb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:43.202905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734fbcb-b45c-44c0-993c-12cf524f54fb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:43.203183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4734fbcb-b45c-44c0-993c-12cf524f54fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:43.251775 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2185/4392] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:42 2022] POST /identity/v3/users => generated 287 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:43.252831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4734fbcb-b45c-44c0-993c-12cf524f54fb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:43.256151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637da29-7217-46ca-8266-c47a36a13a0e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:43.260483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4734fbcb-b45c-44c0-993c-12cf524f54fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:43.261214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b637da29-7217-46ca-8266-c47a36a13a0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:43.292765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b637da29-7217-46ca-8266-c47a36a13a0e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:43.387736 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:43.438768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9acc-4032-463c-ba9f-f136c3e7bf33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:43.440638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9acc-4032-463c-ba9f-f136c3e7bf33 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:43.441050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9acc-4032-463c-ba9f-f136c3e7bf33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:43.441455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dea9acc-4032-463c-ba9f-f136c3e7bf33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:43.444692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9acc-4032-463c-ba9f-f136c3e7bf33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:43.449661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dea9acc-4032-463c-ba9f-f136c3e7bf33 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:43.467359 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2208/4393] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:13:43.471684 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2186/4394] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:43.476361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734fbcb-b45c-44c0-993c-12cf524f54fb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:43.491327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9acc-4032-463c-ba9f-f136c3e7bf33 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:43.491451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4734fbcb-b45c-44c0-993c-12cf524f54fb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:43.493563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4dea9acc-4032-463c-ba9f-f136c3e7bf33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:43.518931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d783a-bee0-4b50-b08a-a152bf85fe6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:43.519626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d783a-bee0-4b50-b08a-a152bf85fe6d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:43.519940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d783a-bee0-4b50-b08a-a152bf85fe6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:43.525521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2d783a-bee0-4b50-b08a-a152bf85fe6d admin admin] PATH_INFO: `/v3/projects/ccb4410d6e234d89afe4c2b0bc90db41/users/644cc23f7b5c4ea29a6036d58164eb88/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:43.562953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d783a-bee0-4b50-b08a-a152bf85fe6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb4410d6e234d89afe4c2b0bc90db41, user_id=644cc23f7b5c4ea29a6036d58164eb88, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:43.570891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2d783a-bee0-4b50-b08a-a152bf85fe6d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:43.599412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2209/4395] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:43 2022] PUT /identity/v3/projects/ccb4410d6e234d89afe4c2b0bc90db41/users/644cc23f7b5c4ea29a6036d58164eb88/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:13:43.605558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d783a-bee0-4b50-b08a-a152bf85fe6d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:43.657534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dea9acc-4032-463c-ba9f-f136c3e7bf33 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:43.776988 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:43.784598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2d783a-bee0-4b50-b08a-a152bf85fe6d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:43.797852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6cde2-4fcd-4068-900c-e03cbc58b7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:43.799912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6cde2-4fcd-4068-900c-e03cbc58b7d0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:43.801075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6cde2-4fcd-4068-900c-e03cbc58b7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:43.802808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec6cde2-4fcd-4068-900c-e03cbc58b7d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:43.804836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6cde2-4fcd-4068-900c-e03cbc58b7d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:43.808686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec6cde2-4fcd-4068-900c-e03cbc58b7d0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:43.813816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838a705-7014-4553-97c4-84f5b5ac89ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:43.815751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838a705-7014-4553-97c4-84f5b5ac89ec service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:43.816251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838a705-7014-4553-97c4-84f5b5ac89ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:43.817546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6838a705-7014-4553-97c4-84f5b5ac89ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:43.854599 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2210/4396] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:43 2022] GET /identity/v3/roles => generated 1420 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:43.855822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6cde2-4fcd-4068-900c-e03cbc58b7d0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:43.864533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838a705-7014-4553-97c4-84f5b5ac89ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:43.875971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec6cde2-4fcd-4068-900c-e03cbc58b7d0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:43.882288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6838a705-7014-4553-97c4-84f5b5ac89ec service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:43.896204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66949938-4ede-4bde-b0c7-a083ae101243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:43.897965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66949938-4ede-4bde-b0c7-a083ae101243 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:43.899397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66949938-4ede-4bde-b0c7-a083ae101243 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:43.899994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66949938-4ede-4bde-b0c7-a083ae101243 admin admin] PATH_INFO: `/v3/projects/ccb4410d6e234d89afe4c2b0bc90db41/users/644cc23f7b5c4ea29a6036d58164eb88/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:43.909478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66949938-4ede-4bde-b0c7-a083ae101243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccb4410d6e234d89afe4c2b0bc90db41, user_id=644cc23f7b5c4ea29a6036d58164eb88, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:43.913972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66949938-4ede-4bde-b0c7-a083ae101243 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:43.934370 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2211/4397] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:43 2022] PUT /identity/v3/projects/ccb4410d6e234d89afe4c2b0bc90db41/users/644cc23f7b5c4ea29a6036d58164eb88/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:43.950076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e1c46-b099-49b5-a97e-f70120c61395 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:43.952608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e1c46-b099-49b5-a97e-f70120c61395 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:43.953892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099e1c46-b099-49b5-a97e-f70120c61395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:43.960640 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2187/4398] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:44.042281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-099e1c46-b099-49b5-a97e-f70120c61395 None None] MFA Rules not processed for user `644cc23f7b5c4ea29a6036d58164eb88`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:44.043777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-099e1c46-b099-49b5-a97e-f70120c61395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:44.280911 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2212/4399] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:43 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:44.303773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838a705-7014-4553-97c4-84f5b5ac89ec service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:44.305314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6838a705-7014-4553-97c4-84f5b5ac89ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:44.488244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6838a705-7014-4553-97c4-84f5b5ac89ec service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:44.583622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563feffb-5118-4d20-b3b1-a02129567058 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:44.584457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563feffb-5118-4d20-b3b1-a02129567058 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:44.585001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563feffb-5118-4d20-b3b1-a02129567058 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:44.585429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563feffb-5118-4d20-b3b1-a02129567058 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:44.598282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563feffb-5118-4d20-b3b1-a02129567058 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:44.599928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563feffb-5118-4d20-b3b1-a02129567058 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:44.644372 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2188/4400] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:44 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:44.800680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e1c46-b099-49b5-a97e-f70120c61395 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:44.806108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-099e1c46-b099-49b5-a97e-f70120c61395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:44.811927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563feffb-5118-4d20-b3b1-a02129567058 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:44.829226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563feffb-5118-4d20-b3b1-a02129567058 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:44.844612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22642a39-a2ef-4218-b4c7-19847548a1b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:44.848720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22642a39-a2ef-4218-b4c7-19847548a1b9 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:44.855181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22642a39-a2ef-4218-b4c7-19847548a1b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:44.856228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22642a39-a2ef-4218-b4c7-19847548a1b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:44.870283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-22642a39-a2ef-4218-b4c7-19847548a1b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:44.927582 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:45.003444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099e1c46-b099-49b5-a97e-f70120c61395 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:45.013215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:45.013907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:45.014893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:45.015169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] PATH_INFO: `/v3/projects/4d6d22d767ae45c5a743f1ea344a3d9e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:45.017267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d6d22d767ae45c5a743f1ea344a3d9e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:45.025668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:45.037722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22642a39-a2ef-4218-b4c7-19847548a1b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:45.039316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22642a39-a2ef-4218-b4c7-19847548a1b9 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:45.117104 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2189/4401] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:13:45.201503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d6d22d767ae45c5a743f1ea344a3d9e', 'request_id': 'req-53ca519a-6d55-4313-9556-0e022c6eb17b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:45.215843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d6d22d767ae45c5a743f1ea344a3d9e', 'request_id': 'req-53ca519a-6d55-4313-9556-0e022c6eb17b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:45.225890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d6d22d767ae45c5a743f1ea344a3d9e', 'request_id': 'req-53ca519a-6d55-4313-9556-0e022c6eb17b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:45.255139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] The token cache is being invalidate because project 4d6d22d767ae45c5a743f1ea344a3d9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:13:45.260612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:45.261964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53ca519a-6d55-4313-9556-0e022c6eb17b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:13:45.267421 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2213/4402] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:13:44 2022] DELETE /identity/v3/projects/4d6d22d767ae45c5a743f1ea344a3d9e => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:45.273534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876c84c-b8c9-4122-a7b8-c9af03a90281 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:45.273879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876c84c-b8c9-4122-a7b8-c9af03a90281 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:45.274160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876c84c-b8c9-4122-a7b8-c9af03a90281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:45.745942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1876c84c-b8c9-4122-a7b8-c9af03a90281 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:45.747514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1876c84c-b8c9-4122-a7b8-c9af03a90281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:45.842482 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:45.917854 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2190/4403] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 645 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:46.033995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f47a8-bf6d-424a-8252-eb74a4afa90d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:46.034440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f47a8-bf6d-424a-8252-eb74a4afa90d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:46.034548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f47a8-bf6d-424a-8252-eb74a4afa90d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:46.102708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-223f47a8-bf6d-424a-8252-eb74a4afa90d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:46.104203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-223f47a8-bf6d-424a-8252-eb74a4afa90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:46.132627 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2214/4404] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:46.136902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876c84c-b8c9-4122-a7b8-c9af03a90281 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:46.152755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876c84c-b8c9-4122-a7b8-c9af03a90281 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:46.166527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d7ddf-b8a2-4cca-a39f-c0c8f02f2b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:46.171231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7ddf-b8a2-4cca-a39f-c0c8f02f2b51 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:46.172977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7ddf-b8a2-4cca-a39f-c0c8f02f2b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:46.173892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5d7ddf-b8a2-4cca-a39f-c0c8f02f2b51 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:46.176771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d7ddf-b8a2-4cca-a39f-c0c8f02f2b51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:13:46.177459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d7ddf-b8a2-4cca-a39f-c0c8f02f2b51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:46.180529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5d7ddf-b8a2-4cca-a39f-c0c8f02f2b51 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:46.195679 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2191/4405] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:13:46.200044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f47a8-bf6d-424a-8252-eb74a4afa90d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:46.210222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f47a8-bf6d-424a-8252-eb74a4afa90d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:46.215492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f40e0-5eaa-4ef7-97ab-bfc6c6cb53ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:46.216399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f40e0-5eaa-4ef7-97ab-bfc6c6cb53ef admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:46.216861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f40e0-5eaa-4ef7-97ab-bfc6c6cb53ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:46.217323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f40e0-5eaa-4ef7-97ab-bfc6c6cb53ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:46.218135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f40e0-5eaa-4ef7-97ab-bfc6c6cb53ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:46.225543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f40e0-5eaa-4ef7-97ab-bfc6c6cb53ef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:46.263356 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2215/4406] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:13:46 2022] POST /identity/v3/projects => generated 405 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:46.267525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d7ddf-b8a2-4cca-a39f-c0c8f02f2b51 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:46.283297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5d7ddf-b8a2-4cca-a39f-c0c8f02f2b51 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:46.436236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c2ddf-3a28-43a6-ad2b-7dc9d1fd2546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:46.437219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c2ddf-3a28-43a6-ad2b-7dc9d1fd2546 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:46.437219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c2ddf-3a28-43a6-ad2b-7dc9d1fd2546 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:46.437461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c2ddf-3a28-43a6-ad2b-7dc9d1fd2546 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:46.438083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c2ddf-3a28-43a6-ad2b-7dc9d1fd2546 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:46.450903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c2ddf-3a28-43a6-ad2b-7dc9d1fd2546 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:46.499939 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2192/4407] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:13:46 2022] POST /identity/v3/users => generated 303 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:13:46.503822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f40e0-5eaa-4ef7-97ab-bfc6c6cb53ef admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:46.522632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f40e0-5eaa-4ef7-97ab-bfc6c6cb53ef admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:46.554360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a92f54-8f80-4581-9758-68150a21a4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:46.555019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a92f54-8f80-4581-9758-68150a21a4aa admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:46.555304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a92f54-8f80-4581-9758-68150a21a4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:46.555586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a92f54-8f80-4581-9758-68150a21a4aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:46.556238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a92f54-8f80-4581-9758-68150a21a4aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:46.557889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a92f54-8f80-4581-9758-68150a21a4aa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:46.578422 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2216/4408] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:46.583432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c2ddf-3a28-43a6-ad2b-7dc9d1fd2546 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:46.615639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c2ddf-3a28-43a6-ad2b-7dc9d1fd2546 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:46.644621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df6546-42eb-497e-b7fc-6ee748b84210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:46.645464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6546-42eb-497e-b7fc-6ee748b84210 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:46.645853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6546-42eb-497e-b7fc-6ee748b84210 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:46.646249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df6546-42eb-497e-b7fc-6ee748b84210 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:46.647733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df6546-42eb-497e-b7fc-6ee748b84210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:46.649575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22df6546-42eb-497e-b7fc-6ee748b84210 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:46.680744 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2193/4409] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:13:46 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:13:46.682010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a92f54-8f80-4581-9758-68150a21a4aa admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:46.696238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a92f54-8f80-4581-9758-68150a21a4aa admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:46.716557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fd5d-f9fc-4530-82db-be3d8e6b188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:46.717258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fd5d-f9fc-4530-82db-be3d8e6b188e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:46.717554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fd5d-f9fc-4530-82db-be3d8e6b188e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:46.717833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8137fd5d-f9fc-4530-82db-be3d8e6b188e admin admin] PATH_INFO: `/v3/projects/d7deb9c74f124ab5947e4fba6320d70f/users/b1dd46553649476ca54adf47ecf1a009/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:46.750924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137fd5d-f9fc-4530-82db-be3d8e6b188e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7deb9c74f124ab5947e4fba6320d70f, user_id=b1dd46553649476ca54adf47ecf1a009, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:46.753687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8137fd5d-f9fc-4530-82db-be3d8e6b188e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:46.785945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2217/4410] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:13:46 2022] PUT /identity/v3/projects/d7deb9c74f124ab5947e4fba6320d70f/users/b1dd46553649476ca54adf47ecf1a009/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:13:46.792143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bd2ae-27c5-4764-aba8-6eea686783ff None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:46.792992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bd2ae-27c5-4764-aba8-6eea686783ff None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:46.793744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8bd2ae-27c5-4764-aba8-6eea686783ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:46.937997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5c8bd2ae-27c5-4764-aba8-6eea686783ff None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:13:46.955575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5c8bd2ae-27c5-4764-aba8-6eea686783ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:47.304864 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2194/4411] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:13:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:13:47.315133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fd5d-f9fc-4530-82db-be3d8e6b188e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:13:47.317542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8137fd5d-f9fc-4530-82db-be3d8e6b188e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:13:47.456734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8137fd5d-f9fc-4530-82db-be3d8e6b188e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:13:47.462909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89728fb-813f-4719-87e8-1a265e1fc171 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:13:47.463639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89728fb-813f-4719-87e8-1a265e1fc171 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:13:47.464743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89728fb-813f-4719-87e8-1a265e1fc171 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:13:47.465241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89728fb-813f-4719-87e8-1a265e1fc171 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:13:47.499082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89728fb-813f-4719-87e8-1a265e1fc171 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:13:47.501163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89728fb-813f-4719-87e8-1a265e1fc171 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:13:47.509058 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:13:47.529634 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2218/4412] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:13:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:13:57.285944 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=76,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:09.431027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bd2ae-27c5-4764-aba8-6eea686783ff None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:09.433385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5c8bd2ae-27c5-4764-aba8-6eea686783ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:09.627464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8bd2ae-27c5-4764-aba8-6eea686783ff None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:09.633664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ba4c0-282c-4530-aa1c-c3f9ebb2fae1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:09.634501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ba4c0-282c-4530-aa1c-c3f9ebb2fae1 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:09.634958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ba4c0-282c-4530-aa1c-c3f9ebb2fae1 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:09.635549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ba4c0-282c-4530-aa1c-c3f9ebb2fae1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:09.639708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ff3ba4c0-282c-4530-aa1c-c3f9ebb2fae1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:09.655217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ba4c0-282c-4530-aa1c-c3f9ebb2fae1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:09.657059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ba4c0-282c-4530-aa1c-c3f9ebb2fae1 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:09.678320 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2195/4413] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:11.083581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6259e-a80d-484a-bd18-9fffba2ad340 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:11.084522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6259e-a80d-484a-bd18-9fffba2ad340 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:11.084967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d6259e-a80d-484a-bd18-9fffba2ad340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:11.169889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e5d6259e-a80d-484a-bd18-9fffba2ad340 None None] MFA Rules not processed for user `b1dd46553649476ca54adf47ecf1a009`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:11.176746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e5d6259e-a80d-484a-bd18-9fffba2ad340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:11.403602 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2219/4414] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:11.404907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ba4c0-282c-4530-aa1c-c3f9ebb2fae1 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:11.443044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ba4c0-282c-4530-aa1c-c3f9ebb2fae1 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:11.448553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040a53-8c35-4696-a316-54822925779f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:11.449592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040a53-8c35-4696-a316-54822925779f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:11.450093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040a53-8c35-4696-a316-54822925779f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:11.450581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58040a53-8c35-4696-a316-54822925779f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:11.451738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58040a53-8c35-4696-a316-54822925779f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:11.454581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58040a53-8c35-4696-a316-54822925779f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:11.503406 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2196/4415] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:14:11 2022] POST /identity/v3/projects => generated 403 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:11.505042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6259e-a80d-484a-bd18-9fffba2ad340 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:11.524210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d6259e-a80d-484a-bd18-9fffba2ad340 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:11.661705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f9f67-6b0e-4ea5-84de-19955c1b7584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:11.662239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f9f67-6b0e-4ea5-84de-19955c1b7584 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:11.662522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f9f67-6b0e-4ea5-84de-19955c1b7584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:11.662798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480f9f67-6b0e-4ea5-84de-19955c1b7584 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:11.663449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f9f67-6b0e-4ea5-84de-19955c1b7584 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:11.665401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480f9f67-6b0e-4ea5-84de-19955c1b7584 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:11.733682 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2220/4416] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:14:11 2022] POST /identity/v3/users => generated 302 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:14:11.738561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040a53-8c35-4696-a316-54822925779f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:11.773563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58040a53-8c35-4696-a316-54822925779f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:11.789841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac494-7d32-43f0-97a3-723546c41dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:11.793397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac494-7d32-43f0-97a3-723546c41dcd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:11.794971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac494-7d32-43f0-97a3-723546c41dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:11.795444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edac494-7d32-43f0-97a3-723546c41dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:11.796297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edac494-7d32-43f0-97a3-723546c41dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:11.799934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edac494-7d32-43f0-97a3-723546c41dcd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:11.836973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f9f67-6b0e-4ea5-84de-19955c1b7584 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:11.837557 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2197/4417] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:11.852782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480f9f67-6b0e-4ea5-84de-19955c1b7584 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:11.868937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba50717-17d4-4545-91c0-3e1f2b2ab704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:11.870730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba50717-17d4-4545-91c0-3e1f2b2ab704 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:11.871257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba50717-17d4-4545-91c0-3e1f2b2ab704 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:11.871717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba50717-17d4-4545-91c0-3e1f2b2ab704 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:11.873201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba50717-17d4-4545-91c0-3e1f2b2ab704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:11.875472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba50717-17d4-4545-91c0-3e1f2b2ab704 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:11.907114 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2221/4418] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:11 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:14:11.912373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac494-7d32-43f0-97a3-723546c41dcd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:11.925594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edac494-7d32-43f0-97a3-723546c41dcd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:11.940365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d811cfa-0865-4d1a-886c-3690ca53e905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:11.941985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811cfa-0865-4d1a-886c-3690ca53e905 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:11.942492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811cfa-0865-4d1a-886c-3690ca53e905 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:11.943001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d811cfa-0865-4d1a-886c-3690ca53e905 admin admin] PATH_INFO: `/v3/projects/06ffb746b2354d3689043de0992af392/users/c1cd5b3a0d6c4133894caea52ddc488e/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:11.982456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d811cfa-0865-4d1a-886c-3690ca53e905 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ffb746b2354d3689043de0992af392, user_id=c1cd5b3a0d6c4133894caea52ddc488e, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:11.985263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d811cfa-0865-4d1a-886c-3690ca53e905 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:12.009825 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2198/4419] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:14:11 2022] PUT /identity/v3/projects/06ffb746b2354d3689043de0992af392/users/c1cd5b3a0d6c4133894caea52ddc488e/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:15.595197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042be8-8db5-4dfa-b276-88299a721ccd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:15.596808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042be8-8db5-4dfa-b276-88299a721ccd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:15.597249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c042be8-8db5-4dfa-b276-88299a721ccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:15.680401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4c042be8-8db5-4dfa-b276-88299a721ccd None None] MFA Rules not processed for user `8cfd0f5d7dcd444a9414c69b41044a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:15.691883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c042be8-8db5-4dfa-b276-88299a721ccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:15.873966 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2222/4420] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:15 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:16.028369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d45f3b-16ec-45f8-91aa-89168fab24f3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:16.028909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d45f3b-16ec-45f8-91aa-89168fab24f3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:16.029290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d45f3b-16ec-45f8-91aa-89168fab24f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:16.085427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-90d45f3b-16ec-45f8-91aa-89168fab24f3 None None] MFA Rules not processed for user `8cfd0f5d7dcd444a9414c69b41044a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:16.092346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-90d45f3b-16ec-45f8-91aa-89168fab24f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:16.121163 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2199/4421] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:16.169617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290c524-b679-4d75-a18d-cb46824a7a1d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:16.170144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290c524-b679-4d75-a18d-cb46824a7a1d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:16.170575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a290c524-b679-4d75-a18d-cb46824a7a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:16.225342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a290c524-b679-4d75-a18d-cb46824a7a1d None None] MFA Rules not processed for user `8cfd0f5d7dcd444a9414c69b41044a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:16.225342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a290c524-b679-4d75-a18d-cb46824a7a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:16.251560 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2223/4422] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:16.630946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3eea-5a46-4ec9-9a13-c75de74baa92 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:16.631236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3eea-5a46-4ec9-9a13-c75de74baa92 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:16.631514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eea3eea-5a46-4ec9-9a13-c75de74baa92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:16.694784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2eea3eea-5a46-4ec9-9a13-c75de74baa92 None None] MFA Rules not processed for user `8cfd0f5d7dcd444a9414c69b41044a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:16.695823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2eea3eea-5a46-4ec9-9a13-c75de74baa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:16.716535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2200/4423] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:16.851841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158814af-4765-4d96-b339-bc1f5cf41028 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:16.852333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158814af-4765-4d96-b339-bc1f5cf41028 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:16.852444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158814af-4765-4d96-b339-bc1f5cf41028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:16.889559 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:16.910498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-158814af-4765-4d96-b339-bc1f5cf41028 None None] MFA Rules not processed for user `8cfd0f5d7dcd444a9414c69b41044a0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:16.911730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-158814af-4765-4d96-b339-bc1f5cf41028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:16.950840 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2224/4424] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:16 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:21.384762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3eea-5a46-4ec9-9a13-c75de74baa92 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:21.387225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2eea3eea-5a46-4ec9-9a13-c75de74baa92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:21.585325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eea3eea-5a46-4ec9-9a13-c75de74baa92 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:21.609974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:21.610626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:21.610900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:21.611171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] PATH_INFO: `/v3/users/4707b07f351e4ef9ba09b8e0453e9372` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:21.616858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4707b07f351e4ef9ba09b8e0453e9372)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:21.619091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:21.678058 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:21.733742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4707b07f351e4ef9ba09b8e0453e9372'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:21.762633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4707b07f351e4ef9ba09b8e0453e9372'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:21.763419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4707b07f351e4ef9ba09b8e0453e9372'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:21.779218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4707b07f351e4ef9ba09b8e0453e9372'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:21.791424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4707b07f351e4ef9ba09b8e0453e9372'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:21.808821 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2201/4425] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:14:21 2022] DELETE /identity/v3/users/4707b07f351e4ef9ba09b8e0453e9372 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:21.809461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929b90-8aaa-4d9b-aa2b-d23b0eb50c1a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:21.809934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929b90-8aaa-4d9b-aa2b-d23b0eb50c1a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:21.810047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0929b90-8aaa-4d9b-aa2b-d23b0eb50c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:21.864378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f0929b90-8aaa-4d9b-aa2b-d23b0eb50c1a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:21.867807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f0929b90-8aaa-4d9b-aa2b-d23b0eb50c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:22.073259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2225/4426] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:22.110437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:22.114064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:22.280743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872678e-1c5a-4948-ad6b-dad0986173f4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:22.288541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be6a91-0fec-4a6d-8f8a-c3ec31e5e1b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:22.289409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be6a91-0fec-4a6d-8f8a-c3ec31e5e1b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:22.289771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be6a91-0fec-4a6d-8f8a-c3ec31e5e1b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:22.290043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be6a91-0fec-4a6d-8f8a-c3ec31e5e1b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:22.312463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be6a91-0fec-4a6d-8f8a-c3ec31e5e1b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:22.315362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52be6a91-0fec-4a6d-8f8a-c3ec31e5e1b2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:22.344125 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2202/4427] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:25.323132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929b90-8aaa-4d9b-aa2b-d23b0eb50c1a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:25.326306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f0929b90-8aaa-4d9b-aa2b-d23b0eb50c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:25.391173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0929b90-8aaa-4d9b-aa2b-d23b0eb50c1a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:25.399908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:25.400898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:25.401378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:25.401875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] PATH_INFO: `/v3/projects/ae5952afadaf4ad4902011af67f55b61` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:25.404255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae5952afadaf4ad4902011af67f55b61)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:25.407672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:25.558556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae5952afadaf4ad4902011af67f55b61', 'request_id': 'req-5e03a48b-695e-4dd1-a39a-aa257daae2e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.572028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae5952afadaf4ad4902011af67f55b61', 'request_id': 'req-5e03a48b-695e-4dd1-a39a-aa257daae2e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.582457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae5952afadaf4ad4902011af67f55b61', 'request_id': 'req-5e03a48b-695e-4dd1-a39a-aa257daae2e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.606094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] The token cache is being invalidate because project ae5952afadaf4ad4902011af67f55b61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:14:25.606525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.607288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.610297 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2226/4428] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:14:25 2022] DELETE /identity/v3/projects/ae5952afadaf4ad4902011af67f55b61 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:25.614814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be6a91-0fec-4a6d-8f8a-c3ec31e5e1b2 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:25.626610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be6a91-0fec-4a6d-8f8a-c3ec31e5e1b2 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:25.734696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:25.736491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:25.737400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:25.737914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] PATH_INFO: `/v3/users/644cc23f7b5c4ea29a6036d58164eb88` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:25.739874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=644cc23f7b5c4ea29a6036d58164eb88)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:25.744740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:25.848951 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:25.858277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '644cc23f7b5c4ea29a6036d58164eb88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.883632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '644cc23f7b5c4ea29a6036d58164eb88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.885958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '644cc23f7b5c4ea29a6036d58164eb88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.896405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '644cc23f7b5c4ea29a6036d58164eb88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.907542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2d55a213-c5b8-435f-822c-369f3e331d00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '644cc23f7b5c4ea29a6036d58164eb88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:25.918807 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2203/4429] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:14:25 2022] DELETE /identity/v3/users/644cc23f7b5c4ea29a6036d58164eb88 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:26.912331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:26.913899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:26.931721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e03a48b-695e-4dd1-a39a-aa257daae2e0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:27.010082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:27.010816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.011098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.011372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] PATH_INFO: `/v3/projects/ccb4410d6e234d89afe4c2b0bc90db41` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.012698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccb4410d6e234d89afe4c2b0bc90db41)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:27.014836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:27.057379 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:27.086529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccb4410d6e234d89afe4c2b0bc90db41', 'request_id': 'req-2c3a1757-db1d-4d75-903d-5e47ae9c1575'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:27.104801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccb4410d6e234d89afe4c2b0bc90db41', 'request_id': 'req-2c3a1757-db1d-4d75-903d-5e47ae9c1575'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:27.114578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccb4410d6e234d89afe4c2b0bc90db41', 'request_id': 'req-2c3a1757-db1d-4d75-903d-5e47ae9c1575'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:27.127475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] The token cache is being invalidate because project ccb4410d6e234d89afe4c2b0bc90db41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:14:27.127915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:27.128835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c3a1757-db1d-4d75-903d-5e47ae9c1575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:27.134561 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2227/4430] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:14:26 2022] DELETE /identity/v3/projects/ccb4410d6e234d89afe4c2b0bc90db41 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:27.135886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776ba49-df68-4289-99b8-6f7cacf53d3e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.137610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776ba49-df68-4289-99b8-6f7cacf53d3e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.138061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4776ba49-df68-4289-99b8-6f7cacf53d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.164234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4776ba49-df68-4289-99b8-6f7cacf53d3e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:27.167440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4776ba49-df68-4289-99b8-6f7cacf53d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:27.264276 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2204/4431] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:27.272858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de4fcf-4dc4-48e4-a59d-9929db393cae None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.273719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de4fcf-4dc4-48e4-a59d-9929db393cae None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.274287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de4fcf-4dc4-48e4-a59d-9929db393cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.303584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-31de4fcf-4dc4-48e4-a59d-9929db393cae None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:27.310112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-31de4fcf-4dc4-48e4-a59d-9929db393cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:27.320402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2228/4432] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:27.324432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776ba49-df68-4289-99b8-6f7cacf53d3e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:27.340636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4776ba49-df68-4289-99b8-6f7cacf53d3e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:27.351082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e73d-c5a2-45f6-82fa-cdae07e67314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:27.352959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e73d-c5a2-45f6-82fa-cdae07e67314 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.353250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e73d-c5a2-45f6-82fa-cdae07e67314 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.353648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5682e73d-c5a2-45f6-82fa-cdae07e67314 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.359564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e73d-c5a2-45f6-82fa-cdae07e67314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:14:27.360000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e73d-c5a2-45f6-82fa-cdae07e67314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:27.364937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5682e73d-c5a2-45f6-82fa-cdae07e67314 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:27.386984 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2205/4433] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:14:27.388325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de4fcf-4dc4-48e4-a59d-9929db393cae None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:27.399166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de4fcf-4dc4-48e4-a59d-9929db393cae None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:27.408651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f4005-1dbf-457b-ba1b-5d82def6373b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:27.409552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f4005-1dbf-457b-ba1b-5d82def6373b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.409919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f4005-1dbf-457b-ba1b-5d82def6373b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.410475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098f4005-1dbf-457b-ba1b-5d82def6373b admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.411296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f4005-1dbf-457b-ba1b-5d82def6373b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:27.413728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098f4005-1dbf-457b-ba1b-5d82def6373b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:27.467483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2229/4434] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:14:27 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:27.473116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e73d-c5a2-45f6-82fa-cdae07e67314 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:27.495228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5682e73d-c5a2-45f6-82fa-cdae07e67314 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:27.584690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c080-109d-4f28-b7a5-b9106c23cf8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:27.585067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c080-109d-4f28-b7a5-b9106c23cf8d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.585496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c080-109d-4f28-b7a5-b9106c23cf8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.586146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8645c080-109d-4f28-b7a5-b9106c23cf8d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.587675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645c080-109d-4f28-b7a5-b9106c23cf8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:27.590265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8645c080-109d-4f28-b7a5-b9106c23cf8d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:27.642518 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2206/4435] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:14:27 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:27.646565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f4005-1dbf-457b-ba1b-5d82def6373b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:27.659182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098f4005-1dbf-457b-ba1b-5d82def6373b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:27.671386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e12daf-5580-4118-bff9-fbe61cc05bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:27.672026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12daf-5580-4118-bff9-fbe61cc05bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.672458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12daf-5580-4118-bff9-fbe61cc05bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.672858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e12daf-5580-4118-bff9-fbe61cc05bf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.673413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e12daf-5580-4118-bff9-fbe61cc05bf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:27.675893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e12daf-5580-4118-bff9-fbe61cc05bf5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:27.698465 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2230/4436] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:27.702694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c080-109d-4f28-b7a5-b9106c23cf8d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:27.716424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8645c080-109d-4f28-b7a5-b9106c23cf8d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:27.722877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9b9dce-ba80-4a17-a7ed-f722726e77fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:27.723653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b9dce-ba80-4a17-a7ed-f722726e77fe admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.724011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b9dce-ba80-4a17-a7ed-f722726e77fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.724356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9b9dce-ba80-4a17-a7ed-f722726e77fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.725188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b9dce-ba80-4a17-a7ed-f722726e77fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:27.727225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9b9dce-ba80-4a17-a7ed-f722726e77fe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:27.745560 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2207/4437] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:27.750119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e12daf-5580-4118-bff9-fbe61cc05bf5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:27.761310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e12daf-5580-4118-bff9-fbe61cc05bf5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:27.767668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac599-0c3b-4490-a1f8-3bbe053e844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:27.768269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac599-0c3b-4490-a1f8-3bbe053e844a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.768544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac599-0c3b-4490-a1f8-3bbe053e844a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.768869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794ac599-0c3b-4490-a1f8-3bbe053e844a admin admin] PATH_INFO: `/v3/projects/fd768ca22de048b3883dbb0910509ee0/users/dcfed366881e46b98bf653bbc2355e26/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.786150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ac599-0c3b-4490-a1f8-3bbe053e844a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd768ca22de048b3883dbb0910509ee0, user_id=dcfed366881e46b98bf653bbc2355e26, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:27.788907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794ac599-0c3b-4490-a1f8-3bbe053e844a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:27.806735 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2231/4438] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:14:27 2022] PUT /identity/v3/projects/fd768ca22de048b3883dbb0910509ee0/users/dcfed366881e46b98bf653bbc2355e26/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:27.818136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e52c16-ebce-4f0d-9a67-acf651f73c0c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:27.818422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e52c16-ebce-4f0d-9a67-acf651f73c0c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:27.818695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e52c16-ebce-4f0d-9a67-acf651f73c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:27.886936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-88e52c16-ebce-4f0d-9a67-acf651f73c0c None None] MFA Rules not processed for user `dcfed366881e46b98bf653bbc2355e26`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:27.888230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-88e52c16-ebce-4f0d-9a67-acf651f73c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:27.938383 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:28.106683 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2208/4439] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:28.112150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac599-0c3b-4490-a1f8-3bbe053e844a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:28.236445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794ac599-0c3b-4490-a1f8-3bbe053e844a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:28.243604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12907659-1afb-41d7-b2fd-5a542cb06311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:28.244516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12907659-1afb-41d7-b2fd-5a542cb06311 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:28.245030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12907659-1afb-41d7-b2fd-5a542cb06311 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:28.246192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12907659-1afb-41d7-b2fd-5a542cb06311 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:28.247070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12907659-1afb-41d7-b2fd-5a542cb06311 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:28.249490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12907659-1afb-41d7-b2fd-5a542cb06311 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:28.294968 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2232/4440] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:14:28 2022] POST /identity/v3/projects => generated 363 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:28.299076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e52c16-ebce-4f0d-9a67-acf651f73c0c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:28.315721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e52c16-ebce-4f0d-9a67-acf651f73c0c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:28.389143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ffd8-4586-44cc-8dc8-b452e30f691f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:28.389595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ffd8-4586-44cc-8dc8-b452e30f691f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:28.389991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef64ffd8-4586-44cc-8dc8-b452e30f691f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:28.426910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa49f5-528a-4024-baf0-affcb09fb1b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:28.427822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa49f5-528a-4024-baf0-affcb09fb1b1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:28.428373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa49f5-528a-4024-baf0-affcb09fb1b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:28.429178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfa49f5-528a-4024-baf0-affcb09fb1b1 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:28.430940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa49f5-528a-4024-baf0-affcb09fb1b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:28.433061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfa49f5-528a-4024-baf0-affcb09fb1b1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:28.439544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ef64ffd8-4586-44cc-8dc8-b452e30f691f None None] MFA Rules not processed for user `c1cd5b3a0d6c4133894caea52ddc488e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:28.441165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef64ffd8-4586-44cc-8dc8-b452e30f691f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:28.478653 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:28.490607 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2209/4441] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:14:28 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:28.491681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa49f5-528a-4024-baf0-affcb09fb1b1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:28.510920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfa49f5-528a-4024-baf0-affcb09fb1b1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:28.518136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af315ebd-7556-4a09-8521-00bf6d37c0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:28.519878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af315ebd-7556-4a09-8521-00bf6d37c0b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:28.520999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af315ebd-7556-4a09-8521-00bf6d37c0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:28.522268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af315ebd-7556-4a09-8521-00bf6d37c0b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:28.522946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af315ebd-7556-4a09-8521-00bf6d37c0b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:28.525272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af315ebd-7556-4a09-8521-00bf6d37c0b9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:28.541941 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2210/4442] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:14:28.544883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af315ebd-7556-4a09-8521-00bf6d37c0b9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:28.558849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af315ebd-7556-4a09-8521-00bf6d37c0b9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:28.559341 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2233/4443] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:28 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:28.564168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65feb287-b4ba-40d3-a486-a8947a19364e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:28.565050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feb287-b4ba-40d3-a486-a8947a19364e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:28.566071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feb287-b4ba-40d3-a486-a8947a19364e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:28.566536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65feb287-b4ba-40d3-a486-a8947a19364e admin admin] PATH_INFO: `/v3/projects/d57cad14f501476b9eef529920d36a92/users/b3daf8263812404bb8a9e0521e89128c/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:28.571089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebce0-a006-4508-a65d-0ab93f94ccde None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:28.571089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebce0-a006-4508-a65d-0ab93f94ccde None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:28.571385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81ebce0-a006-4508-a65d-0ab93f94ccde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:28.585622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65feb287-b4ba-40d3-a486-a8947a19364e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57cad14f501476b9eef529920d36a92, user_id=b3daf8263812404bb8a9e0521e89128c, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:28.588840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65feb287-b4ba-40d3-a486-a8947a19364e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:28.600576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a81ebce0-a006-4508-a65d-0ab93f94ccde None None] MFA Rules not processed for user `b1dd46553649476ca54adf47ecf1a009`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:28.604159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a81ebce0-a006-4508-a65d-0ab93f94ccde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:28.618430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2211/4444] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:14:28 2022] PUT /identity/v3/projects/d57cad14f501476b9eef529920d36a92/users/b3daf8263812404bb8a9e0521e89128c/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:14:28.620279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65feb287-b4ba-40d3-a486-a8947a19364e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:28.723610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2234/4445] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:14:28.734106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65feb287-b4ba-40d3-a486-a8947a19364e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:28.735668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebce0-a006-4508-a65d-0ab93f94ccde None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:28.738928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a81ebce0-a006-4508-a65d-0ab93f94ccde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:28.750273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d7722-0ad5-49b9-bb05-4c15c0b6da57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:28.750887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d7722-0ad5-49b9-bb05-4c15c0b6da57 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:28.751169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d7722-0ad5-49b9-bb05-4c15c0b6da57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:28.751441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245d7722-0ad5-49b9-bb05-4c15c0b6da57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:28.752110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d7722-0ad5-49b9-bb05-4c15c0b6da57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:28.754505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245d7722-0ad5-49b9-bb05-4c15c0b6da57 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:28.781786 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2212/4446] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:28 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:28.786301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d7722-0ad5-49b9-bb05-4c15c0b6da57 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:28.800410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245d7722-0ad5-49b9-bb05-4c15c0b6da57 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:28.806629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f32d1-e85f-489a-8308-97a87f8ce68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:28.807311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f32d1-e85f-489a-8308-97a87f8ce68b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:28.807588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f32d1-e85f-489a-8308-97a87f8ce68b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:28.807864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f32d1-e85f-489a-8308-97a87f8ce68b admin admin] PATH_INFO: `/v3/projects/d57cad14f501476b9eef529920d36a92/users/b3daf8263812404bb8a9e0521e89128c/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:28.810331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f32d1-e85f-489a-8308-97a87f8ce68b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d57cad14f501476b9eef529920d36a92, user_id=b3daf8263812404bb8a9e0521e89128c, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:28.813480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f32d1-e85f-489a-8308-97a87f8ce68b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:28.816994 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:28.837160 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2213/4447] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:14:28 2022] PUT /identity/v3/projects/d57cad14f501476b9eef529920d36a92/users/b3daf8263812404bb8a9e0521e89128c/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:28.848199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49698b-2bee-4c12-ba03-0f7a92f30050 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:28.848446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49698b-2bee-4c12-ba03-0f7a92f30050 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:28.848698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd49698b-2bee-4c12-ba03-0f7a92f30050 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:28.885602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dd49698b-2bee-4c12-ba03-0f7a92f30050 None None] MFA Rules not processed for user `b3daf8263812404bb8a9e0521e89128c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:28.886999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dd49698b-2bee-4c12-ba03-0f7a92f30050 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:28.941773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81ebce0-a006-4508-a65d-0ab93f94ccde None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:29.017541 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2214/4448] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:28 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:14:29.021417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b4fc-8d2b-4acd-b209-5a6958213906 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:29.021651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b4fc-8d2b-4acd-b209-5a6958213906 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:29.021940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff5b4fc-8d2b-4acd-b209-5a6958213906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:29.060323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-eff5b4fc-8d2b-4acd-b209-5a6958213906 None None] MFA Rules not processed for user `a170d67efe094c4e8b9267e33e4e476d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:29.061496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eff5b4fc-8d2b-4acd-b209-5a6958213906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:29.073892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd9bbe-e714-454d-a585-c4960fa41064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:29.077242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd9bbe-e714-454d-a585-c4960fa41064 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:29.077793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd9bbe-e714-454d-a585-c4960fa41064 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:29.078183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfd9bbe-e714-454d-a585-c4960fa41064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:29.082461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fbfd9bbe-e714-454d-a585-c4960fa41064 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:29.103019 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:29.225729 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2215/4449] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:29.225729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b4fc-8d2b-4acd-b209-5a6958213906 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:29.226834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eff5b4fc-8d2b-4acd-b209-5a6958213906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:29.285024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd9bbe-e714-454d-a585-c4960fa41064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:29.286784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfd9bbe-e714-454d-a585-c4960fa41064 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:29.311216 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2235/4450] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:28 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:29.349284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff5b4fc-8d2b-4acd-b209-5a6958213906 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:29.355023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e0a8-0e1a-499f-a422-f30fcd893c38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:29.355648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e0a8-0e1a-499f-a422-f30fcd893c38 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:29.355923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e0a8-0e1a-499f-a422-f30fcd893c38 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:29.356197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585e0a8-0e1a-499f-a422-f30fcd893c38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:29.377416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585e0a8-0e1a-499f-a422-f30fcd893c38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:29.379558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585e0a8-0e1a-499f-a422-f30fcd893c38 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:29.390934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2216/4451] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:29 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:29.534749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd9bbe-e714-454d-a585-c4960fa41064 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:29.554615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfd9bbe-e714-454d-a585-c4960fa41064 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:29.564535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07339d28-01d7-4ab9-b285-8d4dd5508408 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:29.565455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339d28-01d7-4ab9-b285-8d4dd5508408 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:29.566475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339d28-01d7-4ab9-b285-8d4dd5508408 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:29.566906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07339d28-01d7-4ab9-b285-8d4dd5508408 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:29.689608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07339d28-01d7-4ab9-b285-8d4dd5508408 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:29.692033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07339d28-01d7-4ab9-b285-8d4dd5508408 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:29.724227 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2236/4452] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:29 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:30.700877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e0a8-0e1a-499f-a422-f30fcd893c38 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:30.702775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9585e0a8-0e1a-499f-a422-f30fcd893c38 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:30.763522 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:30.805808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585e0a8-0e1a-499f-a422-f30fcd893c38 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:30.810329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:30.811019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:30.811368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:30.811714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:30.813618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:30.827814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:30.830741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:30.846412 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2217/4453] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:33.330212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07339d28-01d7-4ab9-b285-8d4dd5508408 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:33.553346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07339d28-01d7-4ab9-b285-8d4dd5508408 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:33.580376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:33.581243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:33.583938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:33.584327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] PATH_INFO: `/v3/users/dcfed366881e46b98bf653bbc2355e26` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:33.585684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcfed366881e46b98bf653bbc2355e26)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:33.592450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:33.725995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:33.727811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:33.748627 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:33.761446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcfed366881e46b98bf653bbc2355e26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:33.797630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcfed366881e46b98bf653bbc2355e26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:33.802091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcfed366881e46b98bf653bbc2355e26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:33.817837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcfed366881e46b98bf653bbc2355e26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:33.830354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72982d74-1945-4bd8-8f98-1c6fd9e698ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcfed366881e46b98bf653bbc2355e26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:33.831141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa44c3-179b-4830-a5cf-7c030a138bdf service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:33.837825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:33.838609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:33.838978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:33.839445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:33.841408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:33.855229 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2237/4454] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:14:33 2022] DELETE /identity/v3/users/dcfed366881e46b98bf653bbc2355e26 => generated 0 bytes in 525 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:33.859175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e002bf7-88cd-4356-81a2-4e7a1b961c29 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:33.859476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e002bf7-88cd-4356-81a2-4e7a1b961c29 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:33.859761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e002bf7-88cd-4356-81a2-4e7a1b961c29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:33.875540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:33.877173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:33.920419 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2218/4455] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:14:33.925821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5e002bf7-88cd-4356-81a2-4e7a1b961c29 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:33.927426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5e002bf7-88cd-4356-81a2-4e7a1b961c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:34.116224 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2238/4456] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:34.253623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:34.255001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:34.317154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715fe710-fae5-4b9d-b248-9d43d86d479d service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:34.500901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386297-3ae3-4437-afec-bced712ce33c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:34.501564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386297-3ae3-4437-afec-bced712ce33c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:34.503826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386297-3ae3-4437-afec-bced712ce33c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:34.504546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78386297-3ae3-4437-afec-bced712ce33c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:34.530102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386297-3ae3-4437-afec-bced712ce33c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:34.531919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78386297-3ae3-4437-afec-bced712ce33c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:34.551381 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2219/4457] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:35.744060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e002bf7-88cd-4356-81a2-4e7a1b961c29 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:35.745693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5e002bf7-88cd-4356-81a2-4e7a1b961c29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:35.766828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e002bf7-88cd-4356-81a2-4e7a1b961c29 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:35.779161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:35.779727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:35.780011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:35.780416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] PATH_INFO: `/v3/projects/fd768ca22de048b3883dbb0910509ee0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:35.781702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd768ca22de048b3883dbb0910509ee0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:35.785896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:35.899226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd768ca22de048b3883dbb0910509ee0', 'request_id': 'req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:35.913106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd768ca22de048b3883dbb0910509ee0', 'request_id': 'req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:35.922470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd768ca22de048b3883dbb0910509ee0', 'request_id': 'req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:35.938854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] The token cache is being invalidate because project fd768ca22de048b3883dbb0910509ee0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:14:35.939315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:35.941470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:35.949733 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2239/4458] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:14:35 2022] DELETE /identity/v3/projects/fd768ca22de048b3883dbb0910509ee0 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:35.954701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386297-3ae3-4437-afec-bced712ce33c service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:35.975731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78386297-3ae3-4437-afec-bced712ce33c service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:36.100231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:36.100937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:36.101287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:36.101588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] PATH_INFO: `/v3/users/b3daf8263812404bb8a9e0521e89128c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:36.104099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3daf8263812404bb8a9e0521e89128c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:36.110590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:36.115403 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:36.231108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3daf8263812404bb8a9e0521e89128c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:36.261849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3daf8263812404bb8a9e0521e89128c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:36.262853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3daf8263812404bb8a9e0521e89128c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:36.279598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3daf8263812404bb8a9e0521e89128c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:36.288194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3daf8263812404bb8a9e0521e89128c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:36.300718 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2220/4459] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:14:35 2022] DELETE /identity/v3/users/b3daf8263812404bb8a9e0521e89128c => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:36.692020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:36.693549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:36.721344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a36d2fc-26a6-4fe0-a207-a3dc9f722f51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:36.839602 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:36.869999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:36.878507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:36.878808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:36.879075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] PATH_INFO: `/v3/users/8cfd0f5d7dcd444a9414c69b41044a0a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:36.885201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cfd0f5d7dcd444a9414c69b41044a0a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:36.887536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:36.993096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cfd0f5d7dcd444a9414c69b41044a0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:37.008880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cfd0f5d7dcd444a9414c69b41044a0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:37.010199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cfd0f5d7dcd444a9414c69b41044a0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:37.023801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cfd0f5d7dcd444a9414c69b41044a0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:37.041354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7956fb1a-b3bd-44d9-bc79-6c8bbb5dc3b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cfd0f5d7dcd444a9414c69b41044a0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:37.059109 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2240/4460] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:14:36 2022] DELETE /identity/v3/users/8cfd0f5d7dcd444a9414c69b41044a0a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:38.645912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:38.649966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:38.668654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645ab5e-43c4-4226-966d-a3576d1ff2ca admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:38.862189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:38.862865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:38.863150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:38.863860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] PATH_INFO: `/v3/projects/154609c5bdf3461aaab4bd699351fb12` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:38.864586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=154609c5bdf3461aaab4bd699351fb12)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:38.866532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:38.975487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154609c5bdf3461aaab4bd699351fb12', 'request_id': 'req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:38.984668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154609c5bdf3461aaab4bd699351fb12', 'request_id': 'req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:38.998359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154609c5bdf3461aaab4bd699351fb12', 'request_id': 'req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:39.022701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] The token cache is being invalidate because project 154609c5bdf3461aaab4bd699351fb12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:14:39.023255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:39.024422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0ce0c6a-7b10-4f4a-9edf-cf05a5d079f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:39.031805 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2221/4461] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:14:38 2022] DELETE /identity/v3/projects/154609c5bdf3461aaab4bd699351fb12 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:39.035381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f121d75-0bb5-409c-b805-d70fd48f7c2a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.035979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f121d75-0bb5-409c-b805-d70fd48f7c2a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.036104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f121d75-0bb5-409c-b805-d70fd48f7c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.068346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0f121d75-0bb5-409c-b805-d70fd48f7c2a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:39.070652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0f121d75-0bb5-409c-b805-d70fd48f7c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:39.155685 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2241/4462] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:39.159133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb581af6-bb73-4351-9cb6-0d6aec4b8d60 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.160510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb581af6-bb73-4351-9cb6-0d6aec4b8d60 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.160791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb581af6-bb73-4351-9cb6-0d6aec4b8d60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.183366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cb581af6-bb73-4351-9cb6-0d6aec4b8d60 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:39.184716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cb581af6-bb73-4351-9cb6-0d6aec4b8d60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:39.199291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f121d75-0bb5-409c-b805-d70fd48f7c2a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.207499 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2222/4463] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:39.212923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f121d75-0bb5-409c-b805-d70fd48f7c2a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:39.217905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:39.218808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.219187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.219569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.220336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:14:39.220742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:39.222589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:39.238348 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2242/4464] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:14:39.242355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb581af6-bb73-4351-9cb6-0d6aec4b8d60 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.249476 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:39.254364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb581af6-bb73-4351-9cb6-0d6aec4b8d60 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:39.267678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.269508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:39.273390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cb6e8-5b9c-44a0-9b55-446540bc6347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:39.274015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cb6e8-5b9c-44a0-9b55-446540bc6347 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.274297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cb6e8-5b9c-44a0-9b55-446540bc6347 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.274571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73cb6e8-5b9c-44a0-9b55-446540bc6347 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.275209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cb6e8-5b9c-44a0-9b55-446540bc6347 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:39.278069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73cb6e8-5b9c-44a0-9b55-446540bc6347 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:39.303330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca90db0-0c90-441a-aa51-3bf218e538e1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:39.321020 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2223/4465] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:14:39 2022] POST /identity/v3/projects => generated 367 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:39.322327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cb6e8-5b9c-44a0-9b55-446540bc6347 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.356425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:39.357315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.357816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.359482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] PATH_INFO: `/v3/projects/d57cad14f501476b9eef529920d36a92` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.366462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d57cad14f501476b9eef529920d36a92)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:39.368594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:39.448653 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:39.468110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd57cad14f501476b9eef529920d36a92', 'request_id': 'req-4724c772-5d9e-403e-9b27-7cefa507af0c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:39.481440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73cb6e8-5b9c-44a0-9b55-446540bc6347 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:39.492530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd57cad14f501476b9eef529920d36a92', 'request_id': 'req-4724c772-5d9e-403e-9b27-7cefa507af0c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:39.504540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd57cad14f501476b9eef529920d36a92', 'request_id': 'req-4724c772-5d9e-403e-9b27-7cefa507af0c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:39.522107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] The token cache is being invalidate because project d57cad14f501476b9eef529920d36a92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:14:39.522453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:39.523114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4724c772-5d9e-403e-9b27-7cefa507af0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:39.531531 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2243/4466] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:14:39 2022] DELETE /identity/v3/projects/d57cad14f501476b9eef529920d36a92 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:14:39.532743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05850fdf-cb55-41f9-885a-31d0e0714193 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.533495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05850fdf-cb55-41f9-885a-31d0e0714193 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.533782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05850fdf-cb55-41f9-885a-31d0e0714193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.575873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-05850fdf-cb55-41f9-885a-31d0e0714193 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:39.578909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-05850fdf-cb55-41f9-885a-31d0e0714193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:39.606829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d667c97-c49a-4b71-84b5-6a8f39e09418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:39.608110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d667c97-c49a-4b71-84b5-6a8f39e09418 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.608682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d667c97-c49a-4b71-84b5-6a8f39e09418 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.609180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d667c97-c49a-4b71-84b5-6a8f39e09418 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.610192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d667c97-c49a-4b71-84b5-6a8f39e09418 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:39.613463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d667c97-c49a-4b71-84b5-6a8f39e09418 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:39.643908 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2224/4467] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:14:39 2022] POST /identity/v3/users => generated 284 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:39.647412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d667c97-c49a-4b71-84b5-6a8f39e09418 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.650765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3d667c97-c49a-4b71-84b5-6a8f39e09418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:39.666824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d667c97-c49a-4b71-84b5-6a8f39e09418 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:39.674011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41fc21-06a5-435a-991b-369429051ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:39.674671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41fc21-06a5-435a-991b-369429051ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.675457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41fc21-06a5-435a-991b-369429051ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.675731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c41fc21-06a5-435a-991b-369429051ac2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.676379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41fc21-06a5-435a-991b-369429051ac2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:39.678106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c41fc21-06a5-435a-991b-369429051ac2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:39.690716 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2225/4468] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:39.694704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41fc21-06a5-435a-991b-369429051ac2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.706995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c41fc21-06a5-435a-991b-369429051ac2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:39.713449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed37ee-ff2c-4b05-8c0f-51b9d280e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:39.714345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed37ee-ff2c-4b05-8c0f-51b9d280e09c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.714637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed37ee-ff2c-4b05-8c0f-51b9d280e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.715291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ed37ee-ff2c-4b05-8c0f-51b9d280e09c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.715952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed37ee-ff2c-4b05-8c0f-51b9d280e09c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:39.718465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ed37ee-ff2c-4b05-8c0f-51b9d280e09c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:39.735923 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2226/4469] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:39 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:39.736787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed37ee-ff2c-4b05-8c0f-51b9d280e09c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.738912 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2244/4470] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:39.747814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c3a8-57b7-43a2-8ccf-67f105e71ed8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.748390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ed37ee-ff2c-4b05-8c0f-51b9d280e09c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:39.753357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c3a8-57b7-43a2-8ccf-67f105e71ed8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.753690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef34c3a8-57b7-43a2-8ccf-67f105e71ed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.753967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2976b9-4e53-4d4a-93d1-253ea55fdf5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:39.754848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2976b9-4e53-4d4a-93d1-253ea55fdf5e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.755134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2976b9-4e53-4d4a-93d1-253ea55fdf5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.755445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2976b9-4e53-4d4a-93d1-253ea55fdf5e admin admin] PATH_INFO: `/v3/projects/2ef8299318ec4b59a75e26867a009a2f/users/b1ae9fcca02548dfa6e29d2787288e49/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.772621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2976b9-4e53-4d4a-93d1-253ea55fdf5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ef8299318ec4b59a75e26867a009a2f, user_id=b1ae9fcca02548dfa6e29d2787288e49, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:39.775708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2976b9-4e53-4d4a-93d1-253ea55fdf5e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:39.797408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ef34c3a8-57b7-43a2-8ccf-67f105e71ed8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:39.800722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef34c3a8-57b7-43a2-8ccf-67f105e71ed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:39.804932 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2227/4471] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:14:39 2022] PUT /identity/v3/projects/2ef8299318ec4b59a75e26867a009a2f/users/b1ae9fcca02548dfa6e29d2787288e49/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:39.810325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9d013-7839-4826-b03f-b476bc0d7ccb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.810613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9d013-7839-4826-b03f-b476bc0d7ccb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.810889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb9d013-7839-4826-b03f-b476bc0d7ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.841546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7eb9d013-7839-4826-b03f-b476bc0d7ccb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:39.842881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7eb9d013-7839-4826-b03f-b476bc0d7ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:39.877351 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:39.905618 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2245/4472] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:39.907638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34c3a8-57b7-43a2-8ccf-67f105e71ed8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.926585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef34c3a8-57b7-43a2-8ccf-67f105e71ed8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:39.934008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683ebf5-d409-4503-b18b-f867daf00089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:39.935549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683ebf5-d409-4503-b18b-f867daf00089 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.935973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683ebf5-d409-4503-b18b-f867daf00089 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.936216 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2228/4473] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:39.936361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1683ebf5-d409-4503-b18b-f867daf00089 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:39.937085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683ebf5-d409-4503-b18b-f867daf00089 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:14:39.937685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683ebf5-d409-4503-b18b-f867daf00089 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:39.939351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1683ebf5-d409-4503-b18b-f867daf00089 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:39.946462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9d013-7839-4826-b03f-b476bc0d7ccb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.952118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7eb9d013-7839-4826-b03f-b476bc0d7ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:39.955007 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2246/4474] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:14:39.960475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683ebf5-d409-4503-b18b-f867daf00089 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:39.987018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1683ebf5-d409-4503-b18b-f867daf00089 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:39.998142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae97a-b6b7-4b8d-a2fc-ecfe1a604c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:39.999139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae97a-b6b7-4b8d-a2fc-ecfe1a604c2d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:39.999288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae97a-b6b7-4b8d-a2fc-ecfe1a604c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:39.999572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ae97a-b6b7-4b8d-a2fc-ecfe1a604c2d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:40.000218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae97a-b6b7-4b8d-a2fc-ecfe1a604c2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:40.003397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772ae97a-b6b7-4b8d-a2fc-ecfe1a604c2d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:40.030208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb9d013-7839-4826-b03f-b476bc0d7ccb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:40.034316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8efb2-dafe-4c93-9791-863a8275f994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:40.034930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8efb2-dafe-4c93-9791-863a8275f994 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:40.035256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8efb2-dafe-4c93-9791-863a8275f994 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:40.035541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8efb2-dafe-4c93-9791-863a8275f994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:40.053694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8efb2-dafe-4c93-9791-863a8275f994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:40.062082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8efb2-dafe-4c93-9791-863a8275f994 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:40.064093 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2247/4475] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:14:39 2022] POST /identity/v3/projects => generated 399 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:40.068860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae97a-b6b7-4b8d-a2fc-ecfe1a604c2d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:40.076777 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2229/4476] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:40.122931 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:40.145430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ae97a-b6b7-4b8d-a2fc-ecfe1a604c2d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:40.150591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b629ed-715a-4032-8128-61835cadd0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:40.151476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b629ed-715a-4032-8128-61835cadd0c4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:40.151838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b629ed-715a-4032-8128-61835cadd0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:40.152192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b629ed-715a-4032-8128-61835cadd0c4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:40.153085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b629ed-715a-4032-8128-61835cadd0c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:40.155419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b629ed-715a-4032-8128-61835cadd0c4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:40.213069 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2248/4477] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:14:40 2022] POST /identity/v3/users => generated 300 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:14:40.223703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8efb2-dafe-4c93-9791-863a8275f994 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:40.238648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8efb2-dafe-4c93-9791-863a8275f994 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:40.246135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c367666-c12b-4f82-839a-c81936626e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:40.247071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c367666-c12b-4f82-839a-c81936626e1f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:40.247634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c367666-c12b-4f82-839a-c81936626e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:40.248163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c367666-c12b-4f82-839a-c81936626e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:40.249261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c367666-c12b-4f82-839a-c81936626e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:40.251322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c367666-c12b-4f82-839a-c81936626e1f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:40.266596 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2230/4478] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:40.270818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b629ed-715a-4032-8128-61835cadd0c4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:40.282078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b629ed-715a-4032-8128-61835cadd0c4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:40.288274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7ff5fa-04f0-4b04-9e0e-c68499c161e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:40.289057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff5fa-04f0-4b04-9e0e-c68499c161e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:40.289359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff5fa-04f0-4b04-9e0e-c68499c161e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:40.289650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7ff5fa-04f0-4b04-9e0e-c68499c161e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:40.290339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ff5fa-04f0-4b04-9e0e-c68499c161e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:40.292229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7ff5fa-04f0-4b04-9e0e-c68499c161e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:40.304493 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2249/4479] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:40.308665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c367666-c12b-4f82-839a-c81936626e1f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:40.321807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c367666-c12b-4f82-839a-c81936626e1f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:40.335156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89b3f-faf0-46b6-89e4-a4be816799cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:40.335837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89b3f-faf0-46b6-89e4-a4be816799cc admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:40.336119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89b3f-faf0-46b6-89e4-a4be816799cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:40.336400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d89b3f-faf0-46b6-89e4-a4be816799cc admin admin] PATH_INFO: `/v3/projects/80735495ea354c829a431a41c3f26018/users/2122db0b4c964f95bb3795a9f4cec892/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:40.392765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89b3f-faf0-46b6-89e4-a4be816799cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=80735495ea354c829a431a41c3f26018, user_id=2122db0b4c964f95bb3795a9f4cec892, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:40.407511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d89b3f-faf0-46b6-89e4-a4be816799cc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:40.439040 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2231/4480] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:14:40 2022] PUT /identity/v3/projects/80735495ea354c829a431a41c3f26018/users/2122db0b4c964f95bb3795a9f4cec892/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:40.454786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05d165-adc3-4c8f-b70f-20947bc39c67 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:40.455085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05d165-adc3-4c8f-b70f-20947bc39c67 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:40.455353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05d165-adc3-4c8f-b70f-20947bc39c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:40.531103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9b05d165-adc3-4c8f-b70f-20947bc39c67 None None] MFA Rules not processed for user `2122db0b4c964f95bb3795a9f4cec892`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:40.533178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b05d165-adc3-4c8f-b70f-20947bc39c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:40.686346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89b3f-faf0-46b6-89e4-a4be816799cc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:40.692908 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2250/4481] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:40 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:40.818915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d89b3f-faf0-46b6-89e4-a4be816799cc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:40.836409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcaddf-468a-465a-a2bc-3b950653e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:40.837288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcaddf-468a-465a-a2bc-3b950653e1e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:40.837827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcaddf-468a-465a-a2bc-3b950653e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:40.838264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dcaddf-468a-465a-a2bc-3b950653e1e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:40.839088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcaddf-468a-465a-a2bc-3b950653e1e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:40.841333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dcaddf-468a-465a-a2bc-3b950653e1e4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:40.894405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05d165-adc3-4c8f-b70f-20947bc39c67 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:40.903407 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2232/4482] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:14:40 2022] POST /identity/v3/projects => generated 401 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:40.908186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05d165-adc3-4c8f-b70f-20947bc39c67 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:41.026109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c4003-ea52-490a-bc81-c2b4f971933d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:41.026941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4003-ea52-490a-bc81-c2b4f971933d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:41.027244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4003-ea52-490a-bc81-c2b4f971933d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:41.027504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c4003-ea52-490a-bc81-c2b4f971933d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:41.028196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c4003-ea52-490a-bc81-c2b4f971933d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:41.031003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c4003-ea52-490a-bc81-c2b4f971933d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:41.085330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcaddf-468a-465a-a2bc-3b950653e1e4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:41.094162 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2251/4483] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:14:40 2022] POST /identity/v3/users => generated 307 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:14:41.097899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dcaddf-468a-465a-a2bc-3b950653e1e4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:41.103023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5723a-6bb5-494d-9f55-edb22a94eb89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:41.104066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5723a-6bb5-494d-9f55-edb22a94eb89 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:41.104453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5723a-6bb5-494d-9f55-edb22a94eb89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:41.104817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc5723a-6bb5-494d-9f55-edb22a94eb89 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:41.105569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5723a-6bb5-494d-9f55-edb22a94eb89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:41.108157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc5723a-6bb5-494d-9f55-edb22a94eb89 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:41.127178 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2233/4484] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:41.131547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c4003-ea52-490a-bc81-c2b4f971933d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:41.146405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c4003-ea52-490a-bc81-c2b4f971933d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:41.165733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d424a5-678a-4895-83d0-cb309fbf7b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:41.166437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d424a5-678a-4895-83d0-cb309fbf7b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:41.166718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d424a5-678a-4895-83d0-cb309fbf7b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:41.166995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d424a5-678a-4895-83d0-cb309fbf7b86 admin admin] PATH_INFO: `/v3/projects/b15d297d4d7248458708ad0c29739d7a/users/c1a0881ab973405eb098f393ad19373d/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:41.207756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d424a5-678a-4895-83d0-cb309fbf7b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15d297d4d7248458708ad0c29739d7a, user_id=c1a0881ab973405eb098f393ad19373d, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:41.210568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d424a5-678a-4895-83d0-cb309fbf7b86 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:41.242482 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2252/4485] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:14:41 2022] PUT /identity/v3/projects/b15d297d4d7248458708ad0c29739d7a/users/c1a0881ab973405eb098f393ad19373d/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:41.243961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5723a-6bb5-494d-9f55-edb22a94eb89 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:41.257401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc5723a-6bb5-494d-9f55-edb22a94eb89 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:41.297920 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:41.419676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfc8a3d-5dcc-43c0-808c-3760df4fa7e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:41.420547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8a3d-5dcc-43c0-808c-3760df4fa7e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:41.421070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8a3d-5dcc-43c0-808c-3760df4fa7e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:41.421677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfc8a3d-5dcc-43c0-808c-3760df4fa7e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:41.422291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc8a3d-5dcc-43c0-808c-3760df4fa7e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:41.427865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dfc8a3d-5dcc-43c0-808c-3760df4fa7e0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:41.454718 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2234/4486] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:14:41.459345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d424a5-678a-4895-83d0-cb309fbf7b86 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:41.476506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d424a5-678a-4895-83d0-cb309fbf7b86 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:41.487592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284f444-4565-4fdb-a704-6c89f106753e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:41.488277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f444-4565-4fdb-a704-6c89f106753e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:41.488556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f444-4565-4fdb-a704-6c89f106753e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:41.489727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a284f444-4565-4fdb-a704-6c89f106753e admin admin] PATH_INFO: `/v3/projects/b15d297d4d7248458708ad0c29739d7a/users/c1a0881ab973405eb098f393ad19373d/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:41.495013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f444-4565-4fdb-a704-6c89f106753e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b15d297d4d7248458708ad0c29739d7a, user_id=c1a0881ab973405eb098f393ad19373d, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:41.500597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a284f444-4565-4fdb-a704-6c89f106753e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:41.532631 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2253/4487] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:14:41 2022] PUT /identity/v3/projects/b15d297d4d7248458708ad0c29739d7a/users/c1a0881ab973405eb098f393ad19373d/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:41.548428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972b1ef-d541-420d-98c3-f3013ed11959 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:41.549106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972b1ef-d541-420d-98c3-f3013ed11959 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:41.549687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972b1ef-d541-420d-98c3-f3013ed11959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:41.623964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a972b1ef-d541-420d-98c3-f3013ed11959 None None] MFA Rules not processed for user `c1a0881ab973405eb098f393ad19373d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:41.627523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a972b1ef-d541-420d-98c3-f3013ed11959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:41.844804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284f444-4565-4fdb-a704-6c89f106753e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:41.847909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a284f444-4565-4fdb-a704-6c89f106753e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:41.853689 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:41.853899 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2235/4488] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:41 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:41.951154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a284f444-4565-4fdb-a704-6c89f106753e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:41.955852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eca5b9-6b82-4048-aa21-6fd44bef718d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:41.956559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eca5b9-6b82-4048-aa21-6fd44bef718d service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:41.956846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eca5b9-6b82-4048-aa21-6fd44bef718d service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:41.957409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eca5b9-6b82-4048-aa21-6fd44bef718d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:41.968865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eca5b9-6b82-4048-aa21-6fd44bef718d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:41.970449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eca5b9-6b82-4048-aa21-6fd44bef718d service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:41.983592 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2254/4489] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:41 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:42.086037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972b1ef-d541-420d-98c3-f3013ed11959 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:42.100427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972b1ef-d541-420d-98c3-f3013ed11959 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:42.105594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b5dc3-35c7-4c3e-a0ac-2c7f7576bb22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:42.106581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b5dc3-35c7-4c3e-a0ac-2c7f7576bb22 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:42.107195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b5dc3-35c7-4c3e-a0ac-2c7f7576bb22 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:42.107680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01b5dc3-35c7-4c3e-a0ac-2c7f7576bb22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:42.184000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b5dc3-35c7-4c3e-a0ac-2c7f7576bb22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:42.186163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01b5dc3-35c7-4c3e-a0ac-2c7f7576bb22 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:42.201513 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2236/4490] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:42 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:51.978216 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=25 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:51.997079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eca5b9-6b82-4048-aa21-6fd44bef718d service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:51.998917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f8eca5b9-6b82-4048-aa21-6fd44bef718d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:52.167034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eca5b9-6b82-4048-aa21-6fd44bef718d service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:52.178429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a285bee-9841-41d8-a054-686d13b557be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:52.179360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a285bee-9841-41d8-a054-686d13b557be service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:52.180023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a285bee-9841-41d8-a054-686d13b557be service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:52.180414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a285bee-9841-41d8-a054-686d13b557be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:52.183061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6a285bee-9841-41d8-a054-686d13b557be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:52.195331 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:52.207095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a285bee-9841-41d8-a054-686d13b557be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:52.211526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a285bee-9841-41d8-a054-686d13b557be service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:52.249972 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2255/4491] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:53.741588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b5dc3-35c7-4c3e-a0ac-2c7f7576bb22 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:53.909732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01b5dc3-35c7-4c3e-a0ac-2c7f7576bb22 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:53.934932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:53.937253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:53.940461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:53.941684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] PATH_INFO: `/v3/users/2122db0b4c964f95bb3795a9f4cec892` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:53.945183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2122db0b4c964f95bb3795a9f4cec892)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:53.949035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:54.064441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2122db0b4c964f95bb3795a9f4cec892'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:54.094536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2122db0b4c964f95bb3795a9f4cec892'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:54.097007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2122db0b4c964f95bb3795a9f4cec892'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:54.126955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2122db0b4c964f95bb3795a9f4cec892'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:54.159307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2122db0b4c964f95bb3795a9f4cec892'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:54.185819 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2237/4492] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:14:53 2022] DELETE /identity/v3/users/2122db0b4c964f95bb3795a9f4cec892 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:54.188000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcad2f7-168b-473e-b3bb-ec8fd5a869e2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:54.188475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcad2f7-168b-473e-b3bb-ec8fd5a869e2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:54.188631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcad2f7-168b-473e-b3bb-ec8fd5a869e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:54.243890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5fcad2f7-168b-473e-b3bb-ec8fd5a869e2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:54.247235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5fcad2f7-168b-473e-b3bb-ec8fd5a869e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:54.506586 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2256/4493] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:54.560733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:54.567760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:54.809901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2850dc-0ff1-45da-88c5-b4274b265e29 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:54.824321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a8e5c0-20e4-40ef-832c-af8017184d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:54.824966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e5c0-20e4-40ef-832c-af8017184d47 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:54.825245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e5c0-20e4-40ef-832c-af8017184d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:54.828949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a8e5c0-20e4-40ef-832c-af8017184d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:54.871112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8e5c0-20e4-40ef-832c-af8017184d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:54.876600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a8e5c0-20e4-40ef-832c-af8017184d47 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:54.920664 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2238/4494] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:56.102771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ab74-be92-4abe-8249-01f2b28b045c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:56.103260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ab74-be92-4abe-8249-01f2b28b045c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:56.103371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2ab74-be92-4abe-8249-01f2b28b045c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:56.181518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6eb2ab74-be92-4abe-8249-01f2b28b045c None None] MFA Rules not processed for user `b1ae9fcca02548dfa6e29d2787288e49`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:56.185451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6eb2ab74-be92-4abe-8249-01f2b28b045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:56.378167 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2257/4495] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:56.383474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f14cd-e0e7-4bb9-a67f-3af7d5d6ce35 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:56.383985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f14cd-e0e7-4bb9-a67f-3af7d5d6ce35 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:56.384726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7f14cd-e0e7-4bb9-a67f-3af7d5d6ce35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:56.453398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2c7f14cd-e0e7-4bb9-a67f-3af7d5d6ce35 None None] MFA Rules not processed for user `b1ae9fcca02548dfa6e29d2787288e49`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:14:56.462077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2c7f14cd-e0e7-4bb9-a67f-3af7d5d6ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:56.500184 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2239/4496] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:14:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:14:56.779662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ab74-be92-4abe-8249-01f2b28b045c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:56.781091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6eb2ab74-be92-4abe-8249-01f2b28b045c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:56.827854 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:57.001420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2ab74-be92-4abe-8249-01f2b28b045c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:57.019032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8be5e-b937-4070-a618-563d16dcc042 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:57.019670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8be5e-b937-4070-a618-563d16dcc042 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:57.020096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8be5e-b937-4070-a618-563d16dcc042 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:57.020226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b8be5e-b937-4070-a618-563d16dcc042 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:57.043101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8be5e-b937-4070-a618-563d16dcc042 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:57.044818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b8be5e-b937-4070-a618-563d16dcc042 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:57.078259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2258/4497] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:57.322411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f14cd-e0e7-4bb9-a67f-3af7d5d6ce35 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:57.323800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2c7f14cd-e0e7-4bb9-a67f-3af7d5d6ce35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:57.363204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7f14cd-e0e7-4bb9-a67f-3af7d5d6ce35 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:57.387085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e3d4f-5d41-405f-b699-2a09482312ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:57.387780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e3d4f-5d41-405f-b699-2a09482312ef service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:57.387969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e3d4f-5d41-405f-b699-2a09482312ef service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:57.388444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47e3d4f-5d41-405f-b699-2a09482312ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:57.390650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b47e3d4f-5d41-405f-b699-2a09482312ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:57.431282 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:14:57.602607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e3d4f-5d41-405f-b699-2a09482312ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:57.607543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47e3d4f-5d41-405f-b699-2a09482312ef service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:57.656520 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2240/4498] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:14:57 2022] GET /identity/v3/auth/tokens => generated 3280 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:14:57.753093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8be5e-b937-4070-a618-563d16dcc042 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:57.756003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e5b8be5e-b937-4070-a618-563d16dcc042 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:14:57.801569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b8be5e-b937-4070-a618-563d16dcc042 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:57.818153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:57.819247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:57.819754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:57.820318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] PATH_INFO: `/v3/projects/80735495ea354c829a431a41c3f26018` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:57.822742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80735495ea354c829a431a41c3f26018)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:57.826431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:58.047225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80735495ea354c829a431a41c3f26018', 'request_id': 'req-e3c5777f-e348-450c-b1f8-86f20cf28ab6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.067484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80735495ea354c829a431a41c3f26018', 'request_id': 'req-e3c5777f-e348-450c-b1f8-86f20cf28ab6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.077697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80735495ea354c829a431a41c3f26018', 'request_id': 'req-e3c5777f-e348-450c-b1f8-86f20cf28ab6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.102108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] The token cache is being invalidate because project 80735495ea354c829a431a41c3f26018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:14:58.102805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.103608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.108581 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2259/4499] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:14:57 2022] DELETE /identity/v3/projects/80735495ea354c829a431a41c3f26018 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:14:58.112588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e3d4f-5d41-405f-b699-2a09482312ef service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:14:58.125028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47e3d4f-5d41-405f-b699-2a09482312ef service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:14:58.273003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:14:58.273930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:14:58.274331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:14:58.274721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] PATH_INFO: `/v3/users/c1a0881ab973405eb098f393ad19373d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:14:58.277850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1a0881ab973405eb098f393ad19373d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:14:58.280228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:14:58.385541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1a0881ab973405eb098f393ad19373d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.415670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1a0881ab973405eb098f393ad19373d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.424852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1a0881ab973405eb098f393ad19373d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.437482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1a0881ab973405eb098f393ad19373d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.454369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-df67c563-f777-4b5a-80ff-7371e910ae83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1a0881ab973405eb098f393ad19373d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:14:58.469202 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2241/4500] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:14:58 2022] DELETE /identity/v3/users/c1a0881ab973405eb098f393ad19373d => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:00.067862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:00.069561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:00.100642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c5777f-e348-450c-b1f8-86f20cf28ab6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:00.264133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:00.269913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:00.271081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:00.271804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] PATH_INFO: `/v3/projects/b15d297d4d7248458708ad0c29739d7a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:00.274363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b15d297d4d7248458708ad0c29739d7a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:00.279513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:00.404321 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:00.442052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b15d297d4d7248458708ad0c29739d7a', 'request_id': 'req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:00.483485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b15d297d4d7248458708ad0c29739d7a', 'request_id': 'req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:00.528593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b15d297d4d7248458708ad0c29739d7a', 'request_id': 'req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:00.577231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] The token cache is being invalidate because project b15d297d4d7248458708ad0c29739d7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:00.577592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:00.582685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94c9f7c0-8aee-4e57-82e8-eac50868a0b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:00.610427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdf591-7362-4426-a2b0-031fada4c499 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:00.610973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdf591-7362-4426-a2b0-031fada4c499 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:00.610973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cdf591-7362-4426-a2b0-031fada4c499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:00.612116 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2260/4501] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:00 2022] DELETE /identity/v3/projects/b15d297d4d7248458708ad0c29739d7a => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:00.678535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e7cdf591-7362-4426-a2b0-031fada4c499 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:00.687154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e7cdf591-7362-4426-a2b0-031fada4c499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:00.787667 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:00.872077 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2242/4502] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:00.993746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676694b4-8579-4489-ae21-95b79caa22a0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:00.994334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676694b4-8579-4489-ae21-95b79caa22a0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:00.994674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676694b4-8579-4489-ae21-95b79caa22a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:01.077828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-676694b4-8579-4489-ae21-95b79caa22a0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:01.082033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-676694b4-8579-4489-ae21-95b79caa22a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:01.115262 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2261/4503] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:01.120565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdf591-7362-4426-a2b0-031fada4c499 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:01.153012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7cdf591-7362-4426-a2b0-031fada4c499 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:01.163562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e37549-ab21-449a-acba-66994ea73a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:01.179352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e37549-ab21-449a-acba-66994ea73a47 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:01.200409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e37549-ab21-449a-acba-66994ea73a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:01.203267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e37549-ab21-449a-acba-66994ea73a47 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:01.205832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e37549-ab21-449a-acba-66994ea73a47 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:01.206440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e37549-ab21-449a-acba-66994ea73a47 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:01.213765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e37549-ab21-449a-acba-66994ea73a47 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:01.247333 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2243/4504] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:01.253267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676694b4-8579-4489-ae21-95b79caa22a0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:01.271096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676694b4-8579-4489-ae21-95b79caa22a0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:01.289619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5851fc-9fb1-4070-b49d-a3f5c9018e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:01.290588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5851fc-9fb1-4070-b49d-a3f5c9018e78 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:01.291040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5851fc-9fb1-4070-b49d-a3f5c9018e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:01.291492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5851fc-9fb1-4070-b49d-a3f5c9018e78 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:01.292464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5851fc-9fb1-4070-b49d-a3f5c9018e78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:01.295426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5851fc-9fb1-4070-b49d-a3f5c9018e78 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:01.358947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2262/4505] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:01 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:01.363801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e37549-ab21-449a-acba-66994ea73a47 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:01.377814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e37549-ab21-449a-acba-66994ea73a47 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:01.528721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84424bd-ce84-4655-bbf1-1e266d1a0b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:01.529596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84424bd-ce84-4655-bbf1-1e266d1a0b03 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:01.529993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84424bd-ce84-4655-bbf1-1e266d1a0b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:01.530386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84424bd-ce84-4655-bbf1-1e266d1a0b03 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:01.531404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84424bd-ce84-4655-bbf1-1e266d1a0b03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:01.533528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84424bd-ce84-4655-bbf1-1e266d1a0b03 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:01.593383 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2244/4506] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:01 2022] POST /identity/v3/users => generated 295 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:01.593933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5851fc-9fb1-4070-b49d-a3f5c9018e78 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:01.610091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5851fc-9fb1-4070-b49d-a3f5c9018e78 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:01.622391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ff606-b752-40ab-9672-234814892e6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:01.624659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ff606-b752-40ab-9672-234814892e6b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:01.625184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ff606-b752-40ab-9672-234814892e6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:01.626822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5ff606-b752-40ab-9672-234814892e6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:01.630827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ff606-b752-40ab-9672-234814892e6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:01.632722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5ff606-b752-40ab-9672-234814892e6b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:01.661409 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2263/4507] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:01.663550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84424bd-ce84-4655-bbf1-1e266d1a0b03 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:01.676538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84424bd-ce84-4655-bbf1-1e266d1a0b03 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:01.705038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa265118-9579-4d3b-ac0b-17dd8508a790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:01.706692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa265118-9579-4d3b-ac0b-17dd8508a790 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:01.708050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa265118-9579-4d3b-ac0b-17dd8508a790 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:01.708353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa265118-9579-4d3b-ac0b-17dd8508a790 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:01.709585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa265118-9579-4d3b-ac0b-17dd8508a790 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:01.713834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa265118-9579-4d3b-ac0b-17dd8508a790 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:01.748008 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2245/4508] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:01 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:01.753905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ff606-b752-40ab-9672-234814892e6b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:01.782045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5ff606-b752-40ab-9672-234814892e6b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:01.801488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3cff3-e620-4a36-b7c1-18e05e2f379a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:01.804310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3cff3-e620-4a36-b7c1-18e05e2f379a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:01.805144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3cff3-e620-4a36-b7c1-18e05e2f379a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:01.806824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd3cff3-e620-4a36-b7c1-18e05e2f379a admin admin] PATH_INFO: `/v3/projects/e8fd1f544361412e9513c6d9c5a9dbef/users/87649913f46c492bbafcba54278eda26/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:01.856338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3cff3-e620-4a36-b7c1-18e05e2f379a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fd1f544361412e9513c6d9c5a9dbef, user_id=87649913f46c492bbafcba54278eda26, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:01.863543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd3cff3-e620-4a36-b7c1-18e05e2f379a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:01.893372 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2264/4509] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:01 2022] PUT /identity/v3/projects/e8fd1f544361412e9513c6d9c5a9dbef/users/87649913f46c492bbafcba54278eda26/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:01.904063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf75e6-9f7c-4729-a443-b4501d471b16 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:01.904557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf75e6-9f7c-4729-a443-b4501d471b16 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:01.904997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cf75e6-9f7c-4729-a443-b4501d471b16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:02.008273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-42cf75e6-9f7c-4729-a443-b4501d471b16 None None] MFA Rules not processed for user `87649913f46c492bbafcba54278eda26`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:02.012496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42cf75e6-9f7c-4729-a443-b4501d471b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:02.231118 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2246/4510] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:01 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:02.232476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3cff3-e620-4a36-b7c1-18e05e2f379a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:02.403903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd3cff3-e620-4a36-b7c1-18e05e2f379a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:02.415469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec431-ca05-422e-875c-4c154254d938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:02.417543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec431-ca05-422e-875c-4c154254d938 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:02.420115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec431-ca05-422e-875c-4c154254d938 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:02.420689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decec431-ca05-422e-875c-4c154254d938 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:02.421557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decec431-ca05-422e-875c-4c154254d938 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:02.423622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decec431-ca05-422e-875c-4c154254d938 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:02.491969 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2265/4511] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:02 2022] POST /identity/v3/projects => generated 389 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:02.495259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf75e6-9f7c-4729-a443-b4501d471b16 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:02.514038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cf75e6-9f7c-4729-a443-b4501d471b16 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:02.574742 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:02.630570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eed20b-d49e-41b0-9295-d3f32a3aba41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:02.631971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed20b-d49e-41b0-9295-d3f32a3aba41 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:02.632439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed20b-d49e-41b0-9295-d3f32a3aba41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:02.633129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46eed20b-d49e-41b0-9295-d3f32a3aba41 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:02.634074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eed20b-d49e-41b0-9295-d3f32a3aba41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:02.638475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46eed20b-d49e-41b0-9295-d3f32a3aba41 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:02.753815 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2247/4512] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:02 2022] POST /identity/v3/users => generated 301 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:02.754811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec431-ca05-422e-875c-4c154254d938 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:02.782134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decec431-ca05-422e-875c-4c154254d938 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:02.812738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb26e7-18b8-4f34-85c1-c004021ed8a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:02.812738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb26e7-18b8-4f34-85c1-c004021ed8a2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:02.812738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb26e7-18b8-4f34-85c1-c004021ed8a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:02.812738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb26e7-18b8-4f34-85c1-c004021ed8a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:02.813092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb26e7-18b8-4f34-85c1-c004021ed8a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:02.816721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb26e7-18b8-4f34-85c1-c004021ed8a2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:02.875757 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2266/4513] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:02 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:02.880375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eed20b-d49e-41b0-9295-d3f32a3aba41 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:02.921762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46eed20b-d49e-41b0-9295-d3f32a3aba41 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:02.933554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c6a5-6884-444e-820e-890310f4309a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:02.943794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c6a5-6884-444e-820e-890310f4309a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:02.946013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c6a5-6884-444e-820e-890310f4309a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:02.946291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c6a5-6884-444e-820e-890310f4309a admin admin] PATH_INFO: `/v3/projects/626a499a07d9469e9a18957f6bef4492/users/c53ffb57560c4a019287c7207bbc8e45/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:03.023030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08c6a5-6884-444e-820e-890310f4309a admin admin] RBAC: Authorizing `identity:create_grant(project_id=626a499a07d9469e9a18957f6bef4492, user_id=c53ffb57560c4a019287c7207bbc8e45, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:03.030918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd08c6a5-6884-444e-820e-890310f4309a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:03.089353 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2248/4514] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:02 2022] PUT /identity/v3/projects/626a499a07d9469e9a18957f6bef4492/users/c53ffb57560c4a019287c7207bbc8e45/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:03.092914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb26e7-18b8-4f34-85c1-c004021ed8a2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:03.156073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb26e7-18b8-4f34-85c1-c004021ed8a2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:03.202536 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:03.277814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934a737-9222-4e8b-b000-5e82304b47cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:03.278508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a737-9222-4e8b-b000-5e82304b47cf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:03.278803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a737-9222-4e8b-b000-5e82304b47cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:03.279037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934a737-9222-4e8b-b000-5e82304b47cf admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:03.279798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934a737-9222-4e8b-b000-5e82304b47cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:03.281419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934a737-9222-4e8b-b000-5e82304b47cf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:03.312216 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2267/4515] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:03 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:03.313538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c6a5-6884-444e-820e-890310f4309a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:03.332957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c6a5-6884-444e-820e-890310f4309a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:03.347692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa6464-c060-4143-b504-823d64d3f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:03.348580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa6464-c060-4143-b504-823d64d3f71c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:03.348856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa6464-c060-4143-b504-823d64d3f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:03.349159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa6464-c060-4143-b504-823d64d3f71c admin admin] PATH_INFO: `/v3/projects/626a499a07d9469e9a18957f6bef4492/users/c53ffb57560c4a019287c7207bbc8e45/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:03.353663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa6464-c060-4143-b504-823d64d3f71c admin admin] RBAC: Authorizing `identity:create_grant(project_id=626a499a07d9469e9a18957f6bef4492, user_id=c53ffb57560c4a019287c7207bbc8e45, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:03.359610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa6464-c060-4143-b504-823d64d3f71c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:03.402655 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2249/4516] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:03 2022] PUT /identity/v3/projects/626a499a07d9469e9a18957f6bef4492/users/c53ffb57560c4a019287c7207bbc8e45/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:03.414286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a72d2-12e6-45e1-b8d6-b9162a6215d5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:03.414628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a72d2-12e6-45e1-b8d6-b9162a6215d5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:03.415072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33a72d2-12e6-45e1-b8d6-b9162a6215d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:03.479973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c33a72d2-12e6-45e1-b8d6-b9162a6215d5 None None] MFA Rules not processed for user `c53ffb57560c4a019287c7207bbc8e45`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:03.484419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c33a72d2-12e6-45e1-b8d6-b9162a6215d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:03.574407 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2268/4517] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:03.586677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa6464-c060-4143-b504-823d64d3f71c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:03.588530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-17fa6464-c060-4143-b504-823d64d3f71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:03.667865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa6464-c060-4143-b504-823d64d3f71c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:03.672167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae1856c-f9b7-4aa4-be33-f09947b13d6b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:03.673629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1856c-f9b7-4aa4-be33-f09947b13d6b service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:03.674012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1856c-f9b7-4aa4-be33-f09947b13d6b service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:03.674353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae1856c-f9b7-4aa4-be33-f09947b13d6b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:03.685010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1856c-f9b7-4aa4-be33-f09947b13d6b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:03.686510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae1856c-f9b7-4aa4-be33-f09947b13d6b service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:03.698362 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2250/4518] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:03.891776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a72d2-12e6-45e1-b8d6-b9162a6215d5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:04.012877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374080-e486-4ef8-b643-59061dd67efb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:04.013347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33a72d2-12e6-45e1-b8d6-b9162a6215d5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:04.013456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374080-e486-4ef8-b643-59061dd67efb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:04.013456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec374080-e486-4ef8-b643-59061dd67efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:04.019012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:04.019542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:04.019895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:04.021247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] PATH_INFO: `/v3/users/87649913f46c492bbafcba54278eda26` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:04.021486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=87649913f46c492bbafcba54278eda26)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:04.036974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:04.054853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ec374080-e486-4ef8-b643-59061dd67efb None None] MFA Rules not processed for user `d9ac971da2614beab2e4598795ed9583`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:04.056139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ec374080-e486-4ef8-b643-59061dd67efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:04.148365 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2251/4519] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:04.178705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87649913f46c492bbafcba54278eda26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:04.185810 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:04.209243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87649913f46c492bbafcba54278eda26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:04.211256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87649913f46c492bbafcba54278eda26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:04.234887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87649913f46c492bbafcba54278eda26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:04.255090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87649913f46c492bbafcba54278eda26'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:04.270085 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2269/4520] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:03 2022] DELETE /identity/v3/users/87649913f46c492bbafcba54278eda26 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:04.274714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3ef03-467d-4a60-932c-2e4e90da5b31 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:04.274714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3ef03-467d-4a60-932c-2e4e90da5b31 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:04.275006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f3ef03-467d-4a60-932c-2e4e90da5b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:04.322445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a6f3ef03-467d-4a60-932c-2e4e90da5b31 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:04.323676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a6f3ef03-467d-4a60-932c-2e4e90da5b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:04.423395 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:04.531315 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2252/4521] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:04.632820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:04.635795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:04.843064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce408905-7bd3-4dfb-b005-8d84a1be98fe admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:04.851033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e1dba-eed4-4e1b-94e1-1dbca092b8a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:04.851897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e1dba-eed4-4e1b-94e1-1dbca092b8a3 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:04.852412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e1dba-eed4-4e1b-94e1-1dbca092b8a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:04.852883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73e1dba-eed4-4e1b-94e1-1dbca092b8a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:04.876290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e1dba-eed4-4e1b-94e1-1dbca092b8a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:04.878663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73e1dba-eed4-4e1b-94e1-1dbca092b8a3 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:04.894190 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2270/4522] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:05.875135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3ef03-467d-4a60-932c-2e4e90da5b31 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:05.876924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a6f3ef03-467d-4a60-932c-2e4e90da5b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:05.898001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f3ef03-467d-4a60-932c-2e4e90da5b31 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:05.911151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:05.911815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:05.912096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:05.912369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] PATH_INFO: `/v3/projects/e8fd1f544361412e9513c6d9c5a9dbef` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:05.917498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8fd1f544361412e9513c6d9c5a9dbef)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:05.920147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:06.026166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8fd1f544361412e9513c6d9c5a9dbef', 'request_id': 'req-3453d8ea-43e5-40cf-a664-80d60eaecd03'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.048012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8fd1f544361412e9513c6d9c5a9dbef', 'request_id': 'req-3453d8ea-43e5-40cf-a664-80d60eaecd03'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.065885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8fd1f544361412e9513c6d9c5a9dbef', 'request_id': 'req-3453d8ea-43e5-40cf-a664-80d60eaecd03'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.083244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] The token cache is being invalidate because project e8fd1f544361412e9513c6d9c5a9dbef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:06.083542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.087461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.089185 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2253/4523] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:05 2022] DELETE /identity/v3/projects/e8fd1f544361412e9513c6d9c5a9dbef => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:06.093554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e1dba-eed4-4e1b-94e1-1dbca092b8a3 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:06.113510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73e1dba-eed4-4e1b-94e1-1dbca092b8a3 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:06.286227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:06.287475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:06.288003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:06.288859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] PATH_INFO: `/v3/users/c53ffb57560c4a019287c7207bbc8e45` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:06.290941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c53ffb57560c4a019287c7207bbc8e45)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:06.294862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:06.427143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c53ffb57560c4a019287c7207bbc8e45'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.460055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c53ffb57560c4a019287c7207bbc8e45'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.461683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c53ffb57560c4a019287c7207bbc8e45'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.491573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c53ffb57560c4a019287c7207bbc8e45'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.496572 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:06.514412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5101f14-5c20-4634-a7d9-4b4d9592ba37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c53ffb57560c4a019287c7207bbc8e45'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:06.526263 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2271/4524] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:06 2022] DELETE /identity/v3/users/c53ffb57560c4a019287c7207bbc8e45 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:07.812986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:07.815065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:07.848730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3453d8ea-43e5-40cf-a664-80d60eaecd03 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:08.045281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:08.046149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:08.046631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:08.047089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] PATH_INFO: `/v3/projects/626a499a07d9469e9a18957f6bef4492` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:08.050422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] RBAC: Authorizing `identity:delete_project(project_id=626a499a07d9469e9a18957f6bef4492)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:08.052487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:08.193308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '626a499a07d9469e9a18957f6bef4492', 'request_id': 'req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:08.217357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '626a499a07d9469e9a18957f6bef4492', 'request_id': 'req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:08.224080 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:08.239604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '626a499a07d9469e9a18957f6bef4492', 'request_id': 'req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:08.269728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] The token cache is being invalidate because project 626a499a07d9469e9a18957f6bef4492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:08.270389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:08.273316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec3ff5a-5faf-4bba-81f5-bad6bca9f71c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:08.277079 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2254/4525] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:07 2022] DELETE /identity/v3/projects/626a499a07d9469e9a18957f6bef4492 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:08.281907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72973ac3-44cb-4371-ac6f-25163c93443e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:08.281907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72973ac3-44cb-4371-ac6f-25163c93443e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:08.282529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72973ac3-44cb-4371-ac6f-25163c93443e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:08.327550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-72973ac3-44cb-4371-ac6f-25163c93443e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:08.332968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-72973ac3-44cb-4371-ac6f-25163c93443e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:08.538181 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2272/4526] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:08.547648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17c5c3-c984-4f8d-ae69-afabc9c58aba None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:08.547822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17c5c3-c984-4f8d-ae69-afabc9c58aba None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:08.549501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca17c5c3-c984-4f8d-ae69-afabc9c58aba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:08.603797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ca17c5c3-c984-4f8d-ae69-afabc9c58aba None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:08.606276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ca17c5c3-c984-4f8d-ae69-afabc9c58aba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:08.624919 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2255/4527] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:08.629938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72973ac3-44cb-4371-ac6f-25163c93443e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:08.647010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72973ac3-44cb-4371-ac6f-25163c93443e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:08.655234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9a0df-7dfa-4527-b8a9-3deeacd605e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:08.655922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a0df-7dfa-4527-b8a9-3deeacd605e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:08.656153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a0df-7dfa-4527-b8a9-3deeacd605e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:08.656429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe9a0df-7dfa-4527-b8a9-3deeacd605e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:08.657085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9a0df-7dfa-4527-b8a9-3deeacd605e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:08.657608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9a0df-7dfa-4527-b8a9-3deeacd605e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:08.662352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe9a0df-7dfa-4527-b8a9-3deeacd605e4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:08.682358 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2273/4528] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:08.686896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17c5c3-c984-4f8d-ae69-afabc9c58aba None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:08.715222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca17c5c3-c984-4f8d-ae69-afabc9c58aba None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:08.723756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9c452-64c7-48c3-b5ff-475d17f7693e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:08.725594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9c452-64c7-48c3-b5ff-475d17f7693e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:08.726783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9c452-64c7-48c3-b5ff-475d17f7693e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:08.737531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9c452-64c7-48c3-b5ff-475d17f7693e admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:08.738364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9c452-64c7-48c3-b5ff-475d17f7693e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:08.740303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9c452-64c7-48c3-b5ff-475d17f7693e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:08.809760 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2256/4529] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:08 2022] POST /identity/v3/projects => generated 409 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:08.814141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9a0df-7dfa-4527-b8a9-3deeacd605e4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:08.830696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe9a0df-7dfa-4527-b8a9-3deeacd605e4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:08.945581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec862e8-4bd7-49ab-8b94-3dc1aa11ce61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:08.953003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec862e8-4bd7-49ab-8b94-3dc1aa11ce61 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:08.953308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec862e8-4bd7-49ab-8b94-3dc1aa11ce61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:08.953588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec862e8-4bd7-49ab-8b94-3dc1aa11ce61 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:08.954247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec862e8-4bd7-49ab-8b94-3dc1aa11ce61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:08.956341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec862e8-4bd7-49ab-8b94-3dc1aa11ce61 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:09.001653 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2274/4530] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:08 2022] POST /identity/v3/users => generated 305 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:09.006075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9c452-64c7-48c3-b5ff-475d17f7693e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:09.023209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9c452-64c7-48c3-b5ff-475d17f7693e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:09.064987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498758ac-3af7-402d-8547-5a2872695b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:09.065672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498758ac-3af7-402d-8547-5a2872695b3b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:09.066021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498758ac-3af7-402d-8547-5a2872695b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:09.066273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498758ac-3af7-402d-8547-5a2872695b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:09.067120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498758ac-3af7-402d-8547-5a2872695b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:09.069016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498758ac-3af7-402d-8547-5a2872695b3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:09.104029 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2257/4531] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:09.105686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec862e8-4bd7-49ab-8b94-3dc1aa11ce61 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:09.127273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec862e8-4bd7-49ab-8b94-3dc1aa11ce61 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:09.160187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064b5fad-7174-41e1-94a8-86c2130a395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:09.161016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5fad-7174-41e1-94a8-86c2130a395b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:09.161515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5fad-7174-41e1-94a8-86c2130a395b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:09.161779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064b5fad-7174-41e1-94a8-86c2130a395b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:09.162569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5fad-7174-41e1-94a8-86c2130a395b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:09.164323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-064b5fad-7174-41e1-94a8-86c2130a395b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:09.209375 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2275/4532] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:09.213962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498758ac-3af7-402d-8547-5a2872695b3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:09.247923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498758ac-3af7-402d-8547-5a2872695b3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:09.258045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fbfba-0911-4d67-a956-69d8ac1b8a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:09.259196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fbfba-0911-4d67-a956-69d8ac1b8a88 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:09.259651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fbfba-0911-4d67-a956-69d8ac1b8a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:09.260103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3fbfba-0911-4d67-a956-69d8ac1b8a88 admin admin] PATH_INFO: `/v3/projects/fbc4cc939815487baff8b00d690d20ba/users/b3be74d675b44a0fa0c95c5decc76aa6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:09.290166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fbfba-0911-4d67-a956-69d8ac1b8a88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbc4cc939815487baff8b00d690d20ba, user_id=b3be74d675b44a0fa0c95c5decc76aa6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:09.294169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3fbfba-0911-4d67-a956-69d8ac1b8a88 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:09.316726 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2258/4533] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:09 2022] PUT /identity/v3/projects/fbc4cc939815487baff8b00d690d20ba/users/b3be74d675b44a0fa0c95c5decc76aa6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:09.332357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbbda3-6449-4c77-9edf-f54c59fe07c9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:09.333483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbbda3-6449-4c77-9edf-f54c59fe07c9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:09.334291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbbda3-6449-4c77-9edf-f54c59fe07c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:09.392832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e5cbbda3-6449-4c77-9edf-f54c59fe07c9 None None] MFA Rules not processed for user `b3be74d675b44a0fa0c95c5decc76aa6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:09.394347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e5cbbda3-6449-4c77-9edf-f54c59fe07c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:09.460083 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:09.496769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2276/4534] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:09 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:09.501159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fbfba-0911-4d67-a956-69d8ac1b8a88 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:09.666565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3fbfba-0911-4d67-a956-69d8ac1b8a88 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:09.666565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f3fb5-11b6-457d-9ce8-95683be4b8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:09.666565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3fb5-11b6-457d-9ce8-95683be4b8a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:09.666565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3fb5-11b6-457d-9ce8-95683be4b8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:09.667571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3fb5-11b6-457d-9ce8-95683be4b8a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:09.667571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f3fb5-11b6-457d-9ce8-95683be4b8a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:09.668677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f3fb5-11b6-457d-9ce8-95683be4b8a6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:09.740657 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2259/4535] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:09 2022] POST /identity/v3/projects => generated 409 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:09.744365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbbda3-6449-4c77-9edf-f54c59fe07c9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:09.759043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbbda3-6449-4c77-9edf-f54c59fe07c9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:09.906049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1d988-3ef5-4c1d-84ea-b825dbbaa619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:09.906752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1d988-3ef5-4c1d-84ea-b825dbbaa619 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:09.906966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1d988-3ef5-4c1d-84ea-b825dbbaa619 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:09.907248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd1d988-3ef5-4c1d-84ea-b825dbbaa619 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:09.907897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1d988-3ef5-4c1d-84ea-b825dbbaa619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:09.910219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfd1d988-3ef5-4c1d-84ea-b825dbbaa619 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:09.962680 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2277/4536] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:09 2022] POST /identity/v3/users => generated 311 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:09.964053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f3fb5-11b6-457d-9ce8-95683be4b8a6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:09.980478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f3fb5-11b6-457d-9ce8-95683be4b8a6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:10.004452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d59dc4-00c4-426d-a692-e9d9a9507e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:10.005410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d59dc4-00c4-426d-a692-e9d9a9507e5f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:10.006197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d59dc4-00c4-426d-a692-e9d9a9507e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:10.017778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d59dc4-00c4-426d-a692-e9d9a9507e5f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:10.019083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d59dc4-00c4-426d-a692-e9d9a9507e5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:10.021889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d59dc4-00c4-426d-a692-e9d9a9507e5f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:10.058793 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2260/4537] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:09 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:10.062678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1d988-3ef5-4c1d-84ea-b825dbbaa619 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:10.077671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd1d988-3ef5-4c1d-84ea-b825dbbaa619 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:10.089154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef29839-d8c6-4ef8-8929-58a9a065d28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:10.089873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef29839-d8c6-4ef8-8929-58a9a065d28d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:10.090155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef29839-d8c6-4ef8-8929-58a9a065d28d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:10.090435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef29839-d8c6-4ef8-8929-58a9a065d28d admin admin] PATH_INFO: `/v3/projects/e1652f532af94172a35917db8de624bf/users/6bfb9dcd13474209b0a387a72ff9c433/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:10.127586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef29839-d8c6-4ef8-8929-58a9a065d28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1652f532af94172a35917db8de624bf, user_id=6bfb9dcd13474209b0a387a72ff9c433, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:10.132521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef29839-d8c6-4ef8-8929-58a9a065d28d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:10.161240 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2278/4538] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:10 2022] PUT /identity/v3/projects/e1652f532af94172a35917db8de624bf/users/6bfb9dcd13474209b0a387a72ff9c433/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:10.165490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d59dc4-00c4-426d-a692-e9d9a9507e5f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:10.180282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d59dc4-00c4-426d-a692-e9d9a9507e5f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:10.270029 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=4,keystone:DELETE=3,keystone:SELECT=93 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:10.274922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07701e9-a91e-493e-8316-6fc4965e1765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:10.275686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07701e9-a91e-493e-8316-6fc4965e1765 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:10.276079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07701e9-a91e-493e-8316-6fc4965e1765 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:10.276837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07701e9-a91e-493e-8316-6fc4965e1765 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:10.277733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07701e9-a91e-493e-8316-6fc4965e1765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:10.279723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07701e9-a91e-493e-8316-6fc4965e1765 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:10.300544 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2261/4539] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:10 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:10.302942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef29839-d8c6-4ef8-8929-58a9a065d28d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:10.328711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef29839-d8c6-4ef8-8929-58a9a065d28d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:10.344217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dc548-6cf5-47ab-9c05-0afdfa1b5950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:10.344981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dc548-6cf5-47ab-9c05-0afdfa1b5950 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:10.345345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dc548-6cf5-47ab-9c05-0afdfa1b5950 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:10.346478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3dc548-6cf5-47ab-9c05-0afdfa1b5950 admin admin] PATH_INFO: `/v3/projects/e1652f532af94172a35917db8de624bf/users/6bfb9dcd13474209b0a387a72ff9c433/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:10.348979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dc548-6cf5-47ab-9c05-0afdfa1b5950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1652f532af94172a35917db8de624bf, user_id=6bfb9dcd13474209b0a387a72ff9c433, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:10.352883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3dc548-6cf5-47ab-9c05-0afdfa1b5950 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:10.379610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2279/4540] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:10 2022] PUT /identity/v3/projects/e1652f532af94172a35917db8de624bf/users/6bfb9dcd13474209b0a387a72ff9c433/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:10.391494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200b2ae-68dd-4d64-9a70-94bf0712fc11 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:10.392006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200b2ae-68dd-4d64-9a70-94bf0712fc11 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:10.392357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9200b2ae-68dd-4d64-9a70-94bf0712fc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:10.454919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9200b2ae-68dd-4d64-9a70-94bf0712fc11 None None] MFA Rules not processed for user `6bfb9dcd13474209b0a387a72ff9c433`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:10.460644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9200b2ae-68dd-4d64-9a70-94bf0712fc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:10.654992 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2262/4541] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:10 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:10.670501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dc548-6cf5-47ab-9c05-0afdfa1b5950 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:10.672823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a3dc548-6cf5-47ab-9c05-0afdfa1b5950 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:10.831766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3dc548-6cf5-47ab-9c05-0afdfa1b5950 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:10.850642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a012e6e-67ae-4424-bc3f-eaae95f1e7b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:10.853257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a012e6e-67ae-4424-bc3f-eaae95f1e7b8 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:10.853883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a012e6e-67ae-4424-bc3f-eaae95f1e7b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:10.855076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a012e6e-67ae-4424-bc3f-eaae95f1e7b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:10.878274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a012e6e-67ae-4424-bc3f-eaae95f1e7b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:10.882484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a012e6e-67ae-4424-bc3f-eaae95f1e7b8 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:10.907885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2280/4542] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:10 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:11.238099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200b2ae-68dd-4d64-9a70-94bf0712fc11 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:11.254482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9200b2ae-68dd-4d64-9a70-94bf0712fc11 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:11.266301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdc8b8-5792-4add-93f3-3af29fd2ec48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:11.267040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc8b8-5792-4add-93f3-3af29fd2ec48 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:11.267324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc8b8-5792-4add-93f3-3af29fd2ec48 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:11.268169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cdc8b8-5792-4add-93f3-3af29fd2ec48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:11.359763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdc8b8-5792-4add-93f3-3af29fd2ec48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:11.362464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cdc8b8-5792-4add-93f3-3af29fd2ec48 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:11.386174 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2263/4543] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:11 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:11.401072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a012e6e-67ae-4424-bc3f-eaae95f1e7b8 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:11.403871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9a012e6e-67ae-4424-bc3f-eaae95f1e7b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:11.523595 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:11.596886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a012e6e-67ae-4424-bc3f-eaae95f1e7b8 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:11.632892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:11.635182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:11.635840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:11.636843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] PATH_INFO: `/v3/users/79772a24d13244809f7dad6e8d29bd7f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:11.640592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] RBAC: Authorizing `identity:delete_user(user_id=79772a24d13244809f7dad6e8d29bd7f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:11.646388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:11.781355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79772a24d13244809f7dad6e8d29bd7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:11.824472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79772a24d13244809f7dad6e8d29bd7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:11.825906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79772a24d13244809f7dad6e8d29bd7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:11.842725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79772a24d13244809f7dad6e8d29bd7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:11.853033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-13f8b8aa-9c25-4d15-808f-853980f3d625 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79772a24d13244809f7dad6e8d29bd7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:11.868587 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2281/4544] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:11 2022] DELETE /identity/v3/users/79772a24d13244809f7dad6e8d29bd7f => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:12.355017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdc8b8-5792-4add-93f3-3af29fd2ec48 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:12.374678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cdc8b8-5792-4add-93f3-3af29fd2ec48 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:12.538772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:12.539494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:12.539781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:12.540050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] PATH_INFO: `/v3/projects/5a7f312d12224117b8c8a1f167d901b8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:12.542617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a7f312d12224117b8c8a1f167d901b8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:12.544659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:12.589372 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:12.663843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a7f312d12224117b8c8a1f167d901b8', 'request_id': 'req-1beb17b5-0903-4488-b840-82f3f5c6cf72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:12.693594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a7f312d12224117b8c8a1f167d901b8', 'request_id': 'req-1beb17b5-0903-4488-b840-82f3f5c6cf72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:12.718540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a7f312d12224117b8c8a1f167d901b8', 'request_id': 'req-1beb17b5-0903-4488-b840-82f3f5c6cf72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:12.742720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] The token cache is being invalidate because project 5a7f312d12224117b8c8a1f167d901b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:12.743319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:12.745329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1beb17b5-0903-4488-b840-82f3f5c6cf72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:12.749320 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2264/4545] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:12 2022] DELETE /identity/v3/projects/5a7f312d12224117b8c8a1f167d901b8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:12.754778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e6a3a-cd7c-4f81-a7ec-8a1ce6f7abdf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:12.755325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e6a3a-cd7c-4f81-a7ec-8a1ce6f7abdf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:12.755325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e6a3a-cd7c-4f81-a7ec-8a1ce6f7abdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:12.799416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-728e6a3a-cd7c-4f81-a7ec-8a1ce6f7abdf None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:12.805088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-728e6a3a-cd7c-4f81-a7ec-8a1ce6f7abdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:12.944327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2282/4546] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:12.953995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2f3df-0004-4d1e-8d78-30bde83d4ee0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:12.956291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2f3df-0004-4d1e-8d78-30bde83d4ee0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:12.958608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec2f3df-0004-4d1e-8d78-30bde83d4ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.026662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0ec2f3df-0004-4d1e-8d78-30bde83d4ee0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:13.029902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ec2f3df-0004-4d1e-8d78-30bde83d4ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:13.071051 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2265/4547] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:13.075650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e6a3a-cd7c-4f81-a7ec-8a1ce6f7abdf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:13.096652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e6a3a-cd7c-4f81-a7ec-8a1ce6f7abdf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:13.105908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb743-0b1f-4a27-a52a-ad998c7abb1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:13.106546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb743-0b1f-4a27-a52a-ad998c7abb1d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:13.106830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb743-0b1f-4a27-a52a-ad998c7abb1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:13.107107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09afb743-0b1f-4a27-a52a-ad998c7abb1d admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.107768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb743-0b1f-4a27-a52a-ad998c7abb1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:13.108076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb743-0b1f-4a27-a52a-ad998c7abb1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:13.113429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09afb743-0b1f-4a27-a52a-ad998c7abb1d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:13.143729 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2283/4548] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:13.151955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2f3df-0004-4d1e-8d78-30bde83d4ee0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:13.172950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec2f3df-0004-4d1e-8d78-30bde83d4ee0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:13.183915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f170c-3d37-4f69-aee9-b010a75b66c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:13.184957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f170c-3d37-4f69-aee9-b010a75b66c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:13.185523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f170c-3d37-4f69-aee9-b010a75b66c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:13.186045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3f170c-3d37-4f69-aee9-b010a75b66c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.188294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f170c-3d37-4f69-aee9-b010a75b66c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:13.192572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3f170c-3d37-4f69-aee9-b010a75b66c3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:13.251084 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2266/4549] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:13 2022] POST /identity/v3/projects => generated 373 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:13.255438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb743-0b1f-4a27-a52a-ad998c7abb1d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:13.290330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09afb743-0b1f-4a27-a52a-ad998c7abb1d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:13.357694 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:13.380287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe0297-8826-4593-a9ab-6b195573943b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:13.381277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe0297-8826-4593-a9ab-6b195573943b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:13.383555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe0297-8826-4593-a9ab-6b195573943b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:13.383989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe0297-8826-4593-a9ab-6b195573943b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.384825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe0297-8826-4593-a9ab-6b195573943b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:13.387196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe0297-8826-4593-a9ab-6b195573943b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:13.427120 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2284/4550] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:13 2022] POST /identity/v3/users => generated 287 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:13.428302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f170c-3d37-4f69-aee9-b010a75b66c3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:13.444484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3f170c-3d37-4f69-aee9-b010a75b66c3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:13.453508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed804d-e485-4139-8161-87643675bcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:13.454406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed804d-e485-4139-8161-87643675bcc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:13.455574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed804d-e485-4139-8161-87643675bcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:13.456053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed804d-e485-4139-8161-87643675bcc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.456918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed804d-e485-4139-8161-87643675bcc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:13.458920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed804d-e485-4139-8161-87643675bcc6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:13.478390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2267/4551] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:13.483936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe0297-8826-4593-a9ab-6b195573943b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:13.504280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe0297-8826-4593-a9ab-6b195573943b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:13.514810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e1481-9bd3-4b12-9fb7-f5db5eb07df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:13.515876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e1481-9bd3-4b12-9fb7-f5db5eb07df9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:13.516244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e1481-9bd3-4b12-9fb7-f5db5eb07df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:13.516678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e1481-9bd3-4b12-9fb7-f5db5eb07df9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.517741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e1481-9bd3-4b12-9fb7-f5db5eb07df9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:13.519888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e1481-9bd3-4b12-9fb7-f5db5eb07df9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:13.553855 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2285/4552] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:13 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:13.554210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed804d-e485-4139-8161-87643675bcc6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:13.567708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed804d-e485-4139-8161-87643675bcc6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:13.582221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f03f6-c701-42f7-b803-fad4981a3032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:13.582999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f03f6-c701-42f7-b803-fad4981a3032 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:13.583302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f03f6-c701-42f7-b803-fad4981a3032 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:13.583728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2f03f6-c701-42f7-b803-fad4981a3032 admin admin] PATH_INFO: `/v3/projects/91a35426751247d7a80934483412ba31/users/8b20c6dc0656476e8635c0f2807ce469/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.613699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f03f6-c701-42f7-b803-fad4981a3032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91a35426751247d7a80934483412ba31, user_id=8b20c6dc0656476e8635c0f2807ce469, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:13.616896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2f03f6-c701-42f7-b803-fad4981a3032 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:13.635056 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2268/4553] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:13 2022] PUT /identity/v3/projects/91a35426751247d7a80934483412ba31/users/8b20c6dc0656476e8635c0f2807ce469/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:13.645951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dafd6-75a1-447d-8ed7-fe0abe7bdfb1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:13.646251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dafd6-75a1-447d-8ed7-fe0abe7bdfb1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:13.646519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86dafd6-75a1-447d-8ed7-fe0abe7bdfb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.687296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a86dafd6-75a1-447d-8ed7-fe0abe7bdfb1 None None] MFA Rules not processed for user `8b20c6dc0656476e8635c0f2807ce469`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:13.688694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a86dafd6-75a1-447d-8ed7-fe0abe7bdfb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:13.721703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f03f6-c701-42f7-b803-fad4981a3032 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:13.724581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2d2f03f6-c701-42f7-b803-fad4981a3032 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:13.855993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2286/4554] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:13.867092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e9c13-5d8c-46c1-8f7a-d2b7ec7d6867 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:13.867720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e9c13-5d8c-46c1-8f7a-d2b7ec7d6867 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:13.868158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e9c13-5d8c-46c1-8f7a-d2b7ec7d6867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.871187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2f03f6-c701-42f7-b803-fad4981a3032 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:13.879842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:13.880964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:13.881189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:13.881557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] PATH_INFO: `/v3/users/8500417d6411466b84aa1c55deb848a0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:13.882782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8500417d6411466b84aa1c55deb848a0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:13.888106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:13.927687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-797e9c13-5d8c-46c1-8f7a-d2b7ec7d6867 None None] MFA Rules not processed for user `8b20c6dc0656476e8635c0f2807ce469`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:13.929165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-797e9c13-5d8c-46c1-8f7a-d2b7ec7d6867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:13.945651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2287/4555] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:13.962966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e9c13-5d8c-46c1-8f7a-d2b7ec7d6867 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:13.965377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-797e9c13-5d8c-46c1-8f7a-d2b7ec7d6867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:13.978476 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:13.987574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8500417d6411466b84aa1c55deb848a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:14.013774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8500417d6411466b84aa1c55deb848a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:14.018244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8500417d6411466b84aa1c55deb848a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:14.038118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8500417d6411466b84aa1c55deb848a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:14.056264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68725826-143b-4c69-94ca-37634568f882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8500417d6411466b84aa1c55deb848a0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:14.074893 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2269/4556] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:13 2022] DELETE /identity/v3/users/8500417d6411466b84aa1c55deb848a0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:14.077376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4173cc-55b7-462b-b9a3-fd0a3bb984e0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:14.077813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4173cc-55b7-462b-b9a3-fd0a3bb984e0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:14.078495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4173cc-55b7-462b-b9a3-fd0a3bb984e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:14.079706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e9c13-5d8c-46c1-8f7a-d2b7ec7d6867 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:14.120328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bf4173cc-55b7-462b-b9a3-fd0a3bb984e0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:14.121937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bf4173cc-55b7-462b-b9a3-fd0a3bb984e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:14.222611 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:14.246313 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2270/4557] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:14.254613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5e26ae-cfa5-413a-9fc8-ff56d35d7bb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:14.255393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e26ae-cfa5-413a-9fc8-ff56d35d7bb9 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:14.256027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e26ae-cfa5-413a-9fc8-ff56d35d7bb9 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:14.256400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5e26ae-cfa5-413a-9fc8-ff56d35d7bb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:14.259076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1b5e26ae-cfa5-413a-9fc8-ff56d35d7bb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:14.287916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4173cc-55b7-462b-b9a3-fd0a3bb984e0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:14.289607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bf4173cc-55b7-462b-b9a3-fd0a3bb984e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:14.394182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e26ae-cfa5-413a-9fc8-ff56d35d7bb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:14.395822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5e26ae-cfa5-413a-9fc8-ff56d35d7bb9 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:14.415911 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2288/4558] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:14.492883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4173cc-55b7-462b-b9a3-fd0a3bb984e0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:14.523566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12430b96-04f2-4959-a0fa-84445e3d7a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:14.523915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12430b96-04f2-4959-a0fa-84445e3d7a4a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:14.524200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12430b96-04f2-4959-a0fa-84445e3d7a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:14.524473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12430b96-04f2-4959-a0fa-84445e3d7a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:14.564522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12430b96-04f2-4959-a0fa-84445e3d7a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:14.566032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12430b96-04f2-4959-a0fa-84445e3d7a4a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:14.597621 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2271/4559] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:14.977141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d1563-6852-4d8c-bd08-f966da746ae5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:14.978240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d1563-6852-4d8c-bd08-f966da746ae5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:14.978863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d1563-6852-4d8c-bd08-f966da746ae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:15.010734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6f5d1563-6852-4d8c-bd08-f966da746ae5 None None] MFA Rules not processed for user `8b20c6dc0656476e8635c0f2807ce469`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:15.012762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6f5d1563-6852-4d8c-bd08-f966da746ae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:15.044325 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2289/4560] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:15.181810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12430b96-04f2-4959-a0fa-84445e3d7a4a service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:15.183521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-12430b96-04f2-4959-a0fa-84445e3d7a4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:15.212097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12430b96-04f2-4959-a0fa-84445e3d7a4a service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:15.223495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:15.225242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:15.225718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:15.226163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] PATH_INFO: `/v3/projects/1066478a14ef460c9b37077ab5732b24` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:15.228703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1066478a14ef460c9b37077ab5732b24)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:15.234029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:15.325628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1066478a14ef460c9b37077ab5732b24', 'request_id': 'req-e5c6623a-de1f-4d16-ba67-0d8c699ed423'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.333778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1066478a14ef460c9b37077ab5732b24', 'request_id': 'req-e5c6623a-de1f-4d16-ba67-0d8c699ed423'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.337281 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:15.348875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1066478a14ef460c9b37077ab5732b24', 'request_id': 'req-e5c6623a-de1f-4d16-ba67-0d8c699ed423'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.369568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] The token cache is being invalidate because project 1066478a14ef460c9b37077ab5732b24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:15.369997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.372387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.374973 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2272/4561] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:15 2022] DELETE /identity/v3/projects/1066478a14ef460c9b37077ab5732b24 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:15.379685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d1563-6852-4d8c-bd08-f966da746ae5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:15.396126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d1563-6852-4d8c-bd08-f966da746ae5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:15.481836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:15.482583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:15.482975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:15.483320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] PATH_INFO: `/v3/users/9d6d17e1ee1b4d4dae9c3d24bf026c64` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:15.484737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d6d17e1ee1b4d4dae9c3d24bf026c64)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:15.487866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:15.584143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d6d17e1ee1b4d4dae9c3d24bf026c64'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.616651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d6d17e1ee1b4d4dae9c3d24bf026c64'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.617719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d6d17e1ee1b4d4dae9c3d24bf026c64'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.631757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d6d17e1ee1b4d4dae9c3d24bf026c64'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.642246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-42c75d60-6018-4ef4-bf98-20ec4a6265cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d6d17e1ee1b4d4dae9c3d24bf026c64'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:15.645268 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:15.676431 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2290/4562] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:15 2022] DELETE /identity/v3/users/9d6d17e1ee1b4d4dae9c3d24bf026c64 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:17.448096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:17.450257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:17.491852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6623a-de1f-4d16-ba67-0d8c699ed423 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:17.564032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:17.565413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:17.565697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:17.565972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] PATH_INFO: `/v3/projects/7fcf582d3e4f43828ccab6013657f2b8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:17.567154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcf582d3e4f43828ccab6013657f2b8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:17.569493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:17.650686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcf582d3e4f43828ccab6013657f2b8', 'request_id': 'req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:17.659853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcf582d3e4f43828ccab6013657f2b8', 'request_id': 'req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:17.669747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcf582d3e4f43828ccab6013657f2b8', 'request_id': 'req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:17.683101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] The token cache is being invalidate because project 7fcf582d3e4f43828ccab6013657f2b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:17.683394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:17.684213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5a9273b4-d9e1-45e2-b293-dc65cb1bc12b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:17.685733 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2273/4563] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:17 2022] DELETE /identity/v3/projects/7fcf582d3e4f43828ccab6013657f2b8 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:17.691167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37010b7e-a3a0-4bc7-b8a0-d3364a80d604 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:17.691684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37010b7e-a3a0-4bc7-b8a0-d3364a80d604 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:17.691791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37010b7e-a3a0-4bc7-b8a0-d3364a80d604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:17.713583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-37010b7e-a3a0-4bc7-b8a0-d3364a80d604 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:17.715320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37010b7e-a3a0-4bc7-b8a0-d3364a80d604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:17.830588 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2291/4564] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:17.838962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee908fa-c569-4f03-b982-0d97f4a9353b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:17.839550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee908fa-c569-4f03-b982-0d97f4a9353b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:17.840202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee908fa-c569-4f03-b982-0d97f4a9353b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:17.873916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cee908fa-c569-4f03-b982-0d97f4a9353b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:17.875134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cee908fa-c569-4f03-b982-0d97f4a9353b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:17.899122 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2274/4565] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:17.900779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37010b7e-a3a0-4bc7-b8a0-d3364a80d604 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:17.930488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37010b7e-a3a0-4bc7-b8a0-d3364a80d604 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:17.940108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecafe8-fafa-4809-8a4a-a8550c5dfda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:17.940793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecafe8-fafa-4809-8a4a-a8550c5dfda2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:17.941458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecafe8-fafa-4809-8a4a-a8550c5dfda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:17.941904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ecafe8-fafa-4809-8a4a-a8550c5dfda2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:17.942783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecafe8-fafa-4809-8a4a-a8550c5dfda2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:17.943253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecafe8-fafa-4809-8a4a-a8550c5dfda2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:17.945142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ecafe8-fafa-4809-8a4a-a8550c5dfda2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:17.982220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee908fa-c569-4f03-b982-0d97f4a9353b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:17.996420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee908fa-c569-4f03-b982-0d97f4a9353b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:17.996652 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2292/4566] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:18.002625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e5e83-d236-424a-a613-b16b7655fdf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:18.004458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e5e83-d236-424a-a613-b16b7655fdf7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:18.006559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e5e83-d236-424a-a613-b16b7655fdf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:18.006559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e5e83-d236-424a-a613-b16b7655fdf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:18.006559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e5e83-d236-424a-a613-b16b7655fdf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:18.008304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e5e83-d236-424a-a613-b16b7655fdf7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:18.058501 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2275/4567] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:17 2022] POST /identity/v3/projects => generated 381 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:18.060649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecafe8-fafa-4809-8a4a-a8550c5dfda2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:18.075783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ecafe8-fafa-4809-8a4a-a8550c5dfda2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:18.189795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5f87c-241c-422a-ab15-078d2b8f00bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:18.191034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5f87c-241c-422a-ab15-078d2b8f00bf admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:18.191395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5f87c-241c-422a-ab15-078d2b8f00bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:18.191739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5f87c-241c-422a-ab15-078d2b8f00bf admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:18.192456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5f87c-241c-422a-ab15-078d2b8f00bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:18.194815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5f87c-241c-422a-ab15-078d2b8f00bf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:18.235201 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2293/4568] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:18 2022] POST /identity/v3/users => generated 291 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:18.237816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e5e83-d236-424a-a613-b16b7655fdf7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:18.253870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e5e83-d236-424a-a613-b16b7655fdf7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:18.261600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734aec7-cf5c-4924-99a5-7376f6917544 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:18.262232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734aec7-cf5c-4924-99a5-7376f6917544 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:18.262513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734aec7-cf5c-4924-99a5-7376f6917544 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:18.262842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6734aec7-cf5c-4924-99a5-7376f6917544 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:18.263496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734aec7-cf5c-4924-99a5-7376f6917544 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:18.266128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6734aec7-cf5c-4924-99a5-7376f6917544 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:18.285355 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2276/4569] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:18.286586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5f87c-241c-422a-ab15-078d2b8f00bf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:18.307878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5f87c-241c-422a-ab15-078d2b8f00bf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:18.317717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f03877d-09ae-485d-8ca6-10077d8a813e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:18.318345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03877d-09ae-485d-8ca6-10077d8a813e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:18.318627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03877d-09ae-485d-8ca6-10077d8a813e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:18.318933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f03877d-09ae-485d-8ca6-10077d8a813e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:18.319551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03877d-09ae-485d-8ca6-10077d8a813e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:18.321549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f03877d-09ae-485d-8ca6-10077d8a813e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:18.339676 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2294/4570] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:18 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:15:18.340806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734aec7-cf5c-4924-99a5-7376f6917544 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:18.352025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6734aec7-cf5c-4924-99a5-7376f6917544 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:18.357359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c4c6d-8c74-429b-b24e-0d3ec3cdda31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:18.357602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c4c6d-8c74-429b-b24e-0d3ec3cdda31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:18.357722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c4c6d-8c74-429b-b24e-0d3ec3cdda31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:18.358090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c4c6d-8c74-429b-b24e-0d3ec3cdda31 admin admin] PATH_INFO: `/v3/projects/30cb07c00fae41b2911d2c02cb1c55e1/users/30871fbb6a284b13831cc6f172a49717/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:18.382111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c4c6d-8c74-429b-b24e-0d3ec3cdda31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30cb07c00fae41b2911d2c02cb1c55e1, user_id=30871fbb6a284b13831cc6f172a49717, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:18.386171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2c4c6d-8c74-429b-b24e-0d3ec3cdda31 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:18.403349 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2277/4571] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:18 2022] PUT /identity/v3/projects/30cb07c00fae41b2911d2c02cb1c55e1/users/30871fbb6a284b13831cc6f172a49717/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:18.416393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b8817-99a1-4d9b-b14d-23458afb6394 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:18.416681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b8817-99a1-4d9b-b14d-23458afb6394 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:18.417009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b8817-99a1-4d9b-b14d-23458afb6394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:18.453417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bc6b8817-99a1-4d9b-b14d-23458afb6394 None None] MFA Rules not processed for user `30871fbb6a284b13831cc6f172a49717`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:18.456012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc6b8817-99a1-4d9b-b14d-23458afb6394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:18.535236 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:18.580955 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2295/4572] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:18.585540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c4c6d-8c74-429b-b24e-0d3ec3cdda31 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:18.608400 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:18.715295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c4c6d-8c74-429b-b24e-0d3ec3cdda31 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:18.744809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57842db-f52b-4bd7-9f55-a4001681fa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:18.745470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57842db-f52b-4bd7-9f55-a4001681fa3e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:18.745753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57842db-f52b-4bd7-9f55-a4001681fa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:18.746033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57842db-f52b-4bd7-9f55-a4001681fa3e admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:18.746686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57842db-f52b-4bd7-9f55-a4001681fa3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:18.748649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57842db-f52b-4bd7-9f55-a4001681fa3e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:18.810103 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2278/4573] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:18 2022] POST /identity/v3/projects => generated 379 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:18.813729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b8817-99a1-4d9b-b14d-23458afb6394 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:18.833735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b8817-99a1-4d9b-b14d-23458afb6394 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:18.965423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3a8988-04cb-44ac-b491-1bd7d4e93f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:18.965994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8988-04cb-44ac-b491-1bd7d4e93f98 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:18.966489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8988-04cb-44ac-b491-1bd7d4e93f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:18.966771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3a8988-04cb-44ac-b491-1bd7d4e93f98 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:18.967418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a8988-04cb-44ac-b491-1bd7d4e93f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:18.969843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3a8988-04cb-44ac-b491-1bd7d4e93f98 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:19.018665 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2296/4574] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:18 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:19.023383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57842db-f52b-4bd7-9f55-a4001681fa3e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:19.060903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57842db-f52b-4bd7-9f55-a4001681fa3e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:19.061153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90179a5c-dd5f-44d1-abf5-6459e4b63048 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:19.061153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90179a5c-dd5f-44d1-abf5-6459e4b63048 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:19.061354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90179a5c-dd5f-44d1-abf5-6459e4b63048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:19.068995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370170f-8c81-4039-8f8d-c6999b67d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:19.069853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370170f-8c81-4039-8f8d-c6999b67d8df admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:19.070295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370170f-8c81-4039-8f8d-c6999b67d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:19.070625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370170f-8c81-4039-8f8d-c6999b67d8df admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:19.072933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370170f-8c81-4039-8f8d-c6999b67d8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:19.074583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370170f-8c81-4039-8f8d-c6999b67d8df admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:19.085161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-90179a5c-dd5f-44d1-abf5-6459e4b63048 None None] MFA Rules not processed for user `b1ae9fcca02548dfa6e29d2787288e49`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:19.087231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-90179a5c-dd5f-44d1-abf5-6459e4b63048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:19.094565 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2279/4575] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:19.096996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370170f-8c81-4039-8f8d-c6999b67d8df admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:19.144342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370170f-8c81-4039-8f8d-c6999b67d8df admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:19.163295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bee53-b27b-4ce8-88a0-33bf008e51ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:19.164033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bee53-b27b-4ce8-88a0-33bf008e51ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:19.164315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bee53-b27b-4ce8-88a0-33bf008e51ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:19.164591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bee53-b27b-4ce8-88a0-33bf008e51ac admin admin] PATH_INFO: `/v3/projects/6987b1a11bf548579cb545c6ca0640f3/users/d3600bf77eae48e9a22b4763384a8196/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:19.216578 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2297/4576] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:19 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:19.220248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bee53-b27b-4ce8-88a0-33bf008e51ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=6987b1a11bf548579cb545c6ca0640f3, user_id=d3600bf77eae48e9a22b4763384a8196, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:19.225466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bee53-b27b-4ce8-88a0-33bf008e51ac admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:19.265117 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2280/4577] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:19 2022] PUT /identity/v3/projects/6987b1a11bf548579cb545c6ca0640f3/users/d3600bf77eae48e9a22b4763384a8196/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:19.266242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90179a5c-dd5f-44d1-abf5-6459e4b63048 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:19.280240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90179a5c-dd5f-44d1-abf5-6459e4b63048 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:19.412912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36da91a-7771-4e9e-9b73-dba1f71ce371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:19.413853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36da91a-7771-4e9e-9b73-dba1f71ce371 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:19.414408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36da91a-7771-4e9e-9b73-dba1f71ce371 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:19.415082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36da91a-7771-4e9e-9b73-dba1f71ce371 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:19.416139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36da91a-7771-4e9e-9b73-dba1f71ce371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:19.431652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36da91a-7771-4e9e-9b73-dba1f71ce371 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:19.473650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bee53-b27b-4ce8-88a0-33bf008e51ac admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:19.476494 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2298/4578] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:19 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:19.491965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bee53-b27b-4ce8-88a0-33bf008e51ac admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:19.503028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a07a8a-6d33-4342-8dce-7d510c7c4a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:19.503722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a07a8a-6d33-4342-8dce-7d510c7c4a75 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:19.504011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a07a8a-6d33-4342-8dce-7d510c7c4a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:19.504291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a07a8a-6d33-4342-8dce-7d510c7c4a75 admin admin] PATH_INFO: `/v3/projects/6987b1a11bf548579cb545c6ca0640f3/users/d3600bf77eae48e9a22b4763384a8196/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:19.508572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a07a8a-6d33-4342-8dce-7d510c7c4a75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6987b1a11bf548579cb545c6ca0640f3, user_id=d3600bf77eae48e9a22b4763384a8196, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:19.512625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a07a8a-6d33-4342-8dce-7d510c7c4a75 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:19.529350 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2281/4579] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:19 2022] PUT /identity/v3/projects/6987b1a11bf548579cb545c6ca0640f3/users/d3600bf77eae48e9a22b4763384a8196/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:19.537189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42cf89-957f-4a34-a98b-07a71daa4e56 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:19.537500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42cf89-957f-4a34-a98b-07a71daa4e56 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:19.537775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c42cf89-957f-4a34-a98b-07a71daa4e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:19.570299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0c42cf89-957f-4a34-a98b-07a71daa4e56 None None] MFA Rules not processed for user `d3600bf77eae48e9a22b4763384a8196`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:19.571301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0c42cf89-957f-4a34-a98b-07a71daa4e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:19.584348 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:19.670796 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2299/4580] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:19 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:19.684228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a07a8a-6d33-4342-8dce-7d510c7c4a75 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:19.685875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c3a07a8a-6d33-4342-8dce-7d510c7c4a75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:19.791147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a07a8a-6d33-4342-8dce-7d510c7c4a75 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:19.802493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae197a-4f5b-4880-99d6-958c2bc5d763 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:19.803168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae197a-4f5b-4880-99d6-958c2bc5d763 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:19.804399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae197a-4f5b-4880-99d6-958c2bc5d763 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:19.804688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ae197a-4f5b-4880-99d6-958c2bc5d763 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:19.832423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae197a-4f5b-4880-99d6-958c2bc5d763 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:19.833957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ae197a-4f5b-4880-99d6-958c2bc5d763 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:19.864479 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2282/4581] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:19.996945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42cf89-957f-4a34-a98b-07a71daa4e56 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:20.012079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c42cf89-957f-4a34-a98b-07a71daa4e56 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:20.031850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d55866d-faf1-4218-a9a1-8bd5da1995a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:20.032402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55866d-faf1-4218-a9a1-8bd5da1995a2 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:20.032716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55866d-faf1-4218-a9a1-8bd5da1995a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:20.033602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d55866d-faf1-4218-a9a1-8bd5da1995a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:20.168870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55866d-faf1-4218-a9a1-8bd5da1995a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:20.170884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d55866d-faf1-4218-a9a1-8bd5da1995a2 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:20.184272 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2300/4582] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:19 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:21.219896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae197a-4f5b-4880-99d6-958c2bc5d763 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:21.222108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a8ae197a-4f5b-4880-99d6-958c2bc5d763 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:21.333822 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:21.372258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ae197a-4f5b-4880-99d6-958c2bc5d763 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:21.398079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:21.399288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:21.400827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:21.401345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:21.407269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:21.428870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:21.430981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:21.449239 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2283/4583] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:21.600802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc7a4c-ce5d-4173-b3c6-1332a54df940 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:21.601420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc7a4c-ce5d-4173-b3c6-1332a54df940 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:21.601420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dc7a4c-ce5d-4173-b3c6-1332a54df940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:21.645978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-49dc7a4c-ce5d-4173-b3c6-1332a54df940 None None] MFA Rules not processed for user `b1ae9fcca02548dfa6e29d2787288e49`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:21.651017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-49dc7a4c-ce5d-4173-b3c6-1332a54df940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:21.817982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:21.819671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:21.842696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6716a-cef3-4b53-8eb9-3b548a7e6f5d service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:21.869022 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2301/4584] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:21 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:21.873532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0396f5cb-e0cf-486d-9b02-51cd3317fe63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:21.875261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396f5cb-e0cf-486d-9b02-51cd3317fe63 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:21.875752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396f5cb-e0cf-486d-9b02-51cd3317fe63 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:21.876228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0396f5cb-e0cf-486d-9b02-51cd3317fe63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:21.880498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0396f5cb-e0cf-486d-9b02-51cd3317fe63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:21.917907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396f5cb-e0cf-486d-9b02-51cd3317fe63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:21.920072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0396f5cb-e0cf-486d-9b02-51cd3317fe63 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:21.943399 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2284/4585] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:25.352623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc7a4c-ce5d-4173-b3c6-1332a54df940 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:25.355677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-49dc7a4c-ce5d-4173-b3c6-1332a54df940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:25.436635 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:25.457081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dc7a4c-ce5d-4173-b3c6-1332a54df940 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:25.462753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:25.463564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:25.463946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:25.464319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] PATH_INFO: `/v3/users/b3be74d675b44a0fa0c95c5decc76aa6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:25.465621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3be74d675b44a0fa0c95c5decc76aa6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:25.467666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:25.535329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3be74d675b44a0fa0c95c5decc76aa6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:25.552512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3be74d675b44a0fa0c95c5decc76aa6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:25.554253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3be74d675b44a0fa0c95c5decc76aa6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:25.566002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3be74d675b44a0fa0c95c5decc76aa6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:25.576031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3be74d675b44a0fa0c95c5decc76aa6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:25.586556 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2302/4586] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:25 2022] DELETE /identity/v3/users/b3be74d675b44a0fa0c95c5decc76aa6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:25.588684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683504f0-bac3-4b7f-81a6-6534d0729e12 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:25.589561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683504f0-bac3-4b7f-81a6-6534d0729e12 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:25.590013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683504f0-bac3-4b7f-81a6-6534d0729e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:25.643144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-683504f0-bac3-4b7f-81a6-6534d0729e12 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:25.644648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-683504f0-bac3-4b7f-81a6-6534d0729e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:25.732830 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2285/4587] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:25.757416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:25.758990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:25.868662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbb2c7-9199-4cba-b79f-0a00af1ead8c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:25.872676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f21b-f679-46cc-b777-25b53ca6502f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:25.873318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f21b-f679-46cc-b777-25b53ca6502f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:25.873603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f21b-f679-46cc-b777-25b53ca6502f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:25.873879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c43f21b-f679-46cc-b777-25b53ca6502f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:25.885662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f21b-f679-46cc-b777-25b53ca6502f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:25.887121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c43f21b-f679-46cc-b777-25b53ca6502f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:25.945243 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2303/4588] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:26.163201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683504f0-bac3-4b7f-81a6-6534d0729e12 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:26.165710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-683504f0-bac3-4b7f-81a6-6534d0729e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:26.331921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683504f0-bac3-4b7f-81a6-6534d0729e12 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:26.341272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:26.341945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:26.342195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:26.342470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:26.346766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:26.385008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:26.386668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:26.417702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f21b-f679-46cc-b777-25b53ca6502f service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:26.419433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c43f21b-f679-46cc-b777-25b53ca6502f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:26.446163 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2286/4589] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:26.454311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c43f21b-f679-46cc-b777-25b53ca6502f service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:26.486591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:26.491711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:26.492048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:26.492371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] PATH_INFO: `/v3/users/b1dd46553649476ca54adf47ecf1a009` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:26.498083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1dd46553649476ca54adf47ecf1a009)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:26.508493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:26.534769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:26.536238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:26.586543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d51660c-3b35-4ea8-96a0-472af57c68e7 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:26.598335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:26.599014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:26.599241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:26.599515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] PATH_INFO: `/v3/projects/fbc4cc939815487baff8b00d690d20ba` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:26.610567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbc4cc939815487baff8b00d690d20ba)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:26.613863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:26.708047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1dd46553649476ca54adf47ecf1a009'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.746050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1dd46553649476ca54adf47ecf1a009'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.747529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1dd46553649476ca54adf47ecf1a009'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.764000 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:26.782335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1dd46553649476ca54adf47ecf1a009'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.807325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1dd46553649476ca54adf47ecf1a009'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.824252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbc4cc939815487baff8b00d690d20ba', 'request_id': 'req-11779dc5-e68b-436b-b892-eabb2032991b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.831043 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:26.849766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbc4cc939815487baff8b00d690d20ba', 'request_id': 'req-11779dc5-e68b-436b-b892-eabb2032991b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.852629 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2304/4590] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:26 2022] DELETE /identity/v3/users/b1dd46553649476ca54adf47ecf1a009 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:26.873035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbc4cc939815487baff8b00d690d20ba', 'request_id': 'req-11779dc5-e68b-436b-b892-eabb2032991b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.901684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] The token cache is being invalidate because project fbc4cc939815487baff8b00d690d20ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:26.902272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.904253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:26.908033 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2287/4591] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:26 2022] DELETE /identity/v3/projects/fbc4cc939815487baff8b00d690d20ba => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:26.914275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:26.915900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:27.090119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b608d6-090c-4bf6-a7f1-4eff1759e4a7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:27.097017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:27.097708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:27.097991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:27.098267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] PATH_INFO: `/v3/users/6bfb9dcd13474209b0a387a72ff9c433` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:27.099730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bfb9dcd13474209b0a387a72ff9c433)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:27.102011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:27.206156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bfb9dcd13474209b0a387a72ff9c433'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.233895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bfb9dcd13474209b0a387a72ff9c433'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.234654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bfb9dcd13474209b0a387a72ff9c433'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.262102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bfb9dcd13474209b0a387a72ff9c433'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.279022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bfb9dcd13474209b0a387a72ff9c433'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.289087 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2305/4592] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:26 2022] DELETE /identity/v3/users/6bfb9dcd13474209b0a387a72ff9c433 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:27.484342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:27.486383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:27.591767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11779dc5-e68b-436b-b892-eabb2032991b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:27.660422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:27.661472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:27.661472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:27.661835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] PATH_INFO: `/v3/projects/d7deb9c74f124ab5947e4fba6320d70f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:27.663192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7deb9c74f124ab5947e4fba6320d70f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:27.666127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:27.726514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7deb9c74f124ab5947e4fba6320d70f', 'request_id': 'req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.733493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7deb9c74f124ab5947e4fba6320d70f', 'request_id': 'req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.742914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7deb9c74f124ab5947e4fba6320d70f', 'request_id': 'req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.756927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] The token cache is being invalidate because project d7deb9c74f124ab5947e4fba6320d70f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:27.757413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.758397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:27.764840 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2288/4593] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:27 2022] DELETE /identity/v3/projects/d7deb9c74f124ab5947e4fba6320d70f => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:27.767330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:27.768840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:27.802026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfacff9f-ba10-42f8-8f3e-27b6ebba7935 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:27.824819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:27.827317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:27.873182 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:27.944247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:27.945400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:27.945915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:27.946287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] PATH_INFO: `/v3/users/c1cd5b3a0d6c4133894caea52ddc488e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:27.948049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1cd5b3a0d6c4133894caea52ddc488e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:27.950757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:27.958814 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:27.985141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab218f6b-80bd-4908-93a2-b15f8abdd8a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:27.998760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:27.999727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:28.000302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:28.001012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] PATH_INFO: `/v3/projects/e1652f532af94172a35917db8de624bf` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:28.003829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1652f532af94172a35917db8de624bf)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:28.008748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:28.065254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1cd5b3a0d6c4133894caea52ddc488e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.097656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1cd5b3a0d6c4133894caea52ddc488e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.099567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1cd5b3a0d6c4133894caea52ddc488e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.100473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1652f532af94172a35917db8de624bf', 'request_id': 'req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.115026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1cd5b3a0d6c4133894caea52ddc488e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.115299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1652f532af94172a35917db8de624bf', 'request_id': 'req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.126152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1652f532af94172a35917db8de624bf', 'request_id': 'req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.145559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] The token cache is being invalidate because project e1652f532af94172a35917db8de624bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:28.146085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.146861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aafc53ab-1e21-4439-a1ba-0ef4eb6a6a76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.148749 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2289/4594] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:27 2022] DELETE /identity/v3/projects/e1652f532af94172a35917db8de624bf => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:28.157611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776a131-c18f-49c9-9224-89c7ab6ecfac None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:28.159079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776a131-c18f-49c9-9224-89c7ab6ecfac None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:28.159079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f776a131-c18f-49c9-9224-89c7ab6ecfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:28.167403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b7b7342a-9f08-4d42-b8b6-4ce616117d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1cd5b3a0d6c4133894caea52ddc488e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.190434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2306/4595] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:27 2022] DELETE /identity/v3/users/c1cd5b3a0d6c4133894caea52ddc488e => generated 0 bytes in 425 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:28.208063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f776a131-c18f-49c9-9224-89c7ab6ecfac None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:28.209307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f776a131-c18f-49c9-9224-89c7ab6ecfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:28.340458 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2290/4596] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:28.348761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496d58-9915-409c-9d66-d36a60ff2638 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:28.349251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496d58-9915-409c-9d66-d36a60ff2638 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:28.349744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5496d58-9915-409c-9d66-d36a60ff2638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:28.398281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f5496d58-9915-409c-9d66-d36a60ff2638 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:28.399545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f5496d58-9915-409c-9d66-d36a60ff2638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:28.422557 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2307/4597] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:28.423858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776a131-c18f-49c9-9224-89c7ab6ecfac None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:28.434889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f776a131-c18f-49c9-9224-89c7ab6ecfac None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:28.441358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:28.441987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:28.442263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:28.442616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:28.443369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:28.443596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:28.445217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:28.460557 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2291/4598] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:28.466466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496d58-9915-409c-9d66-d36a60ff2638 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:28.480425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5496d58-9915-409c-9d66-d36a60ff2638 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:28.494916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37d37-7cc7-405c-aefe-729a053ee82c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:28.496340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37d37-7cc7-405c-aefe-729a053ee82c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:28.496880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37d37-7cc7-405c-aefe-729a053ee82c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:28.497372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed37d37-7cc7-405c-aefe-729a053ee82c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:28.498497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37d37-7cc7-405c-aefe-729a053ee82c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:28.504188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed37d37-7cc7-405c-aefe-729a053ee82c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:28.530084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:28.532311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:28.572160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8abce8-4f23-446d-b02d-9cc0762afd75 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:28.584696 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2308/4599] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:28 2022] POST /identity/v3/projects => generated 385 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:28.596090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37d37-7cc7-405c-aefe-729a053ee82c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:28.596676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:28.596676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:28.596676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:28.596676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] PATH_INFO: `/v3/projects/06ffb746b2354d3689043de0992af392` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:28.600288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ffb746b2354d3689043de0992af392)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:28.605519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:28.717347 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:28.753600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ffb746b2354d3689043de0992af392', 'request_id': 'req-ab0a64b9-dc08-498b-9e3e-11436f16421f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.765015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ffb746b2354d3689043de0992af392', 'request_id': 'req-ab0a64b9-dc08-498b-9e3e-11436f16421f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.765514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed37d37-7cc7-405c-aefe-729a053ee82c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:28.783602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ffb746b2354d3689043de0992af392', 'request_id': 'req-ab0a64b9-dc08-498b-9e3e-11436f16421f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.804361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] The token cache is being invalidate because project 06ffb746b2354d3689043de0992af392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:28.804932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.806111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab0a64b9-dc08-498b-9e3e-11436f16421f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:28.815498 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2292/4600] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:28 2022] DELETE /identity/v3/projects/06ffb746b2354d3689043de0992af392 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:28.818578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce397a-8289-4882-b0e8-cd14adb91ff3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:28.818947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce397a-8289-4882-b0e8-cd14adb91ff3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:28.819378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ce397a-8289-4882-b0e8-cd14adb91ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:28.868157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e0ce397a-8289-4882-b0e8-cd14adb91ff3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:28.875111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e0ce397a-8289-4882-b0e8-cd14adb91ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:28.981266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e666f3a-96ab-4692-a2bb-376cd7b73ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:28.981912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e666f3a-96ab-4692-a2bb-376cd7b73ca4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:28.982189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e666f3a-96ab-4692-a2bb-376cd7b73ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:28.982659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e666f3a-96ab-4692-a2bb-376cd7b73ca4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:28.983476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e666f3a-96ab-4692-a2bb-376cd7b73ca4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:28.985611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e666f3a-96ab-4692-a2bb-376cd7b73ca4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.010544 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:29.016274 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2293/4601] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:29.024874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58512-0d6d-4cc9-8679-8cc7bcb0271b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.025399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58512-0d6d-4cc9-8679-8cc7bcb0271b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.025823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd58512-0d6d-4cc9-8679-8cc7bcb0271b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.042708 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2309/4602] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:28 2022] POST /identity/v3/users => generated 293 bytes in 454 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:29.046547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e666f3a-96ab-4692-a2bb-376cd7b73ca4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.052768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0e666f3a-96ab-4692-a2bb-376cd7b73ca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:29.062905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1cd58512-0d6d-4cc9-8679-8cc7bcb0271b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:29.068471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1cd58512-0d6d-4cc9-8679-8cc7bcb0271b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:29.075945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e666f3a-96ab-4692-a2bb-376cd7b73ca4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.082213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e82dd7-4603-4c3b-a051-548c5402c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.083033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e82dd7-4603-4c3b-a051-548c5402c3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.083473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e82dd7-4603-4c3b-a051-548c5402c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.083898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e82dd7-4603-4c3b-a051-548c5402c3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.084688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e82dd7-4603-4c3b-a051-548c5402c3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.087355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e82dd7-4603-4c3b-a051-548c5402c3d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.091672 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2294/4603] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:29.096667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58512-0d6d-4cc9-8679-8cc7bcb0271b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.115290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd58512-0d6d-4cc9-8679-8cc7bcb0271b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.124742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2f196-9b3d-4d6b-bb40-b2958cddb394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.125629 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2310/4604] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:29.125770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2f196-9b3d-4d6b-bb40-b2958cddb394 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.126004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2f196-9b3d-4d6b-bb40-b2958cddb394 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.127491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc2f196-9b3d-4d6b-bb40-b2958cddb394 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.128226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2f196-9b3d-4d6b-bb40-b2958cddb394 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:29.128534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2f196-9b3d-4d6b-bb40-b2958cddb394 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.128842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e82dd7-4603-4c3b-a051-548c5402c3d7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.135626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc2f196-9b3d-4d6b-bb40-b2958cddb394 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.160821 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2295/4605] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:15:29.165102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2f196-9b3d-4d6b-bb40-b2958cddb394 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.169807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e82dd7-4603-4c3b-a051-548c5402c3d7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.187789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657aa8-24bc-4a4e-bf56-a2877782bd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.188506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657aa8-24bc-4a4e-bf56-a2877782bd7f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.189327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657aa8-24bc-4a4e-bf56-a2877782bd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.195434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee657aa8-24bc-4a4e-bf56-a2877782bd7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.197220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc2f196-9b3d-4d6b-bb40-b2958cddb394 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.204200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee657aa8-24bc-4a4e-bf56-a2877782bd7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.206716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d07bd8-bbf5-4ce4-aa2d-707ccfb364c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.207334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07bd8-bbf5-4ce4-aa2d-707ccfb364c1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.207611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07bd8-bbf5-4ce4-aa2d-707ccfb364c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.207880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d07bd8-bbf5-4ce4-aa2d-707ccfb364c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.208675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07bd8-bbf5-4ce4-aa2d-707ccfb364c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.209504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee657aa8-24bc-4a4e-bf56-a2877782bd7f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.210732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d07bd8-bbf5-4ce4-aa2d-707ccfb364c1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.243646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2311/4606] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:29.245337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657aa8-24bc-4a4e-bf56-a2877782bd7f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.262678 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2296/4607] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:29 2022] POST /identity/v3/projects => generated 363 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:29.267750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d07bd8-bbf5-4ce4-aa2d-707ccfb364c1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.274481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee657aa8-24bc-4a4e-bf56-a2877782bd7f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.387119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d07bd8-bbf5-4ce4-aa2d-707ccfb364c1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.397903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3bf8e-fb4e-403e-9012-82b9d9155a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.398518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3bf8e-fb4e-403e-9012-82b9d9155a37 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.399208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3bf8e-fb4e-403e-9012-82b9d9155a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.399208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf3bf8e-fb4e-403e-9012-82b9d9155a37 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.399675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3bf8e-fb4e-403e-9012-82b9d9155a37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.403167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf3bf8e-fb4e-403e-9012-82b9d9155a37 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.404694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59b54bb-6e2e-406e-931f-4f5b72d52631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.405732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b54bb-6e2e-406e-931f-4f5b72d52631 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.406184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b54bb-6e2e-406e-931f-4f5b72d52631 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.406628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59b54bb-6e2e-406e-931f-4f5b72d52631 admin admin] PATH_INFO: `/v3/projects/7d10637d95834ec0877153a3c30a3437/users/0301ee7cf0d74c09ad5902e7fb4133b9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.425951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b54bb-6e2e-406e-931f-4f5b72d52631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d10637d95834ec0877153a3c30a3437, user_id=0301ee7cf0d74c09ad5902e7fb4133b9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.444064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59b54bb-6e2e-406e-931f-4f5b72d52631 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.460493 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2297/4608] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:29 2022] POST /identity/v3/users => generated 282 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:29.464395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3bf8e-fb4e-403e-9012-82b9d9155a37 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.468087 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2312/4609] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:29 2022] PUT /identity/v3/projects/7d10637d95834ec0877153a3c30a3437/users/0301ee7cf0d74c09ad5902e7fb4133b9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:29.479185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a1617-78c2-45a0-ae66-10b11e21831f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.480512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a1617-78c2-45a0-ae66-10b11e21831f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.480975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14a1617-78c2-45a0-ae66-10b11e21831f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.482537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf3bf8e-fb4e-403e-9012-82b9d9155a37 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.492944 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:29.561029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b14a1617-78c2-45a0-ae66-10b11e21831f None None] MFA Rules not processed for user `0301ee7cf0d74c09ad5902e7fb4133b9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:29.562293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b14a1617-78c2-45a0-ae66-10b11e21831f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:29.598867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61657f8f-ea17-4369-a52f-8659231cfda6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.599802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61657f8f-ea17-4369-a52f-8659231cfda6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.600243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61657f8f-ea17-4369-a52f-8659231cfda6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.600685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61657f8f-ea17-4369-a52f-8659231cfda6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.601549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61657f8f-ea17-4369-a52f-8659231cfda6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.603315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61657f8f-ea17-4369-a52f-8659231cfda6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.627606 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2298/4610] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:29.636698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61657f8f-ea17-4369-a52f-8659231cfda6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.649009 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2313/4611] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:29.653113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a1617-78c2-45a0-ae66-10b11e21831f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.654840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61657f8f-ea17-4369-a52f-8659231cfda6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.667064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14a1617-78c2-45a0-ae66-10b11e21831f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.667647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0a019-6e3c-4849-ae8f-66c7441dad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.668267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0a019-6e3c-4849-ae8f-66c7441dad4a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.668543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0a019-6e3c-4849-ae8f-66c7441dad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.668823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0a019-6e3c-4849-ae8f-66c7441dad4a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.669493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0a019-6e3c-4849-ae8f-66c7441dad4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.671073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0a019-6e3c-4849-ae8f-66c7441dad4a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.685135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f8bee-ad8e-467d-b67f-5283d3cab582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.685135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f8bee-ad8e-467d-b67f-5283d3cab582 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.685135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f8bee-ad8e-467d-b67f-5283d3cab582 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.685135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f8bee-ad8e-467d-b67f-5283d3cab582 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.685636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f8bee-ad8e-467d-b67f-5283d3cab582 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.693158 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2299/4612] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:29.696945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0a019-6e3c-4849-ae8f-66c7441dad4a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.698882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f8bee-ad8e-467d-b67f-5283d3cab582 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.709109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0a019-6e3c-4849-ae8f-66c7441dad4a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.715220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bb349-8803-437f-9efb-268674db526e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.716367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb349-8803-437f-9efb-268674db526e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.716866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb349-8803-437f-9efb-268674db526e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.718135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb349-8803-437f-9efb-268674db526e admin admin] PATH_INFO: `/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd/users/40113756c05741519abdecafeca161e2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.744333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bb349-8803-437f-9efb-268674db526e admin admin] RBAC: Authorizing `identity:create_grant(project_id=20e50dc64ab24fa68a122b10e4cb6acd, user_id=40113756c05741519abdecafeca161e2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:29.747624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bb349-8803-437f-9efb-268674db526e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:29.755255 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2314/4613] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:29 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:29.757275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f8bee-ad8e-467d-b67f-5283d3cab582 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:29.787698 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2300/4614] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:29 2022] PUT /identity/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd/users/40113756c05741519abdecafeca161e2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:29.789317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73dc54-6ed6-474e-af43-202e0d6cf9aa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.791477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73dc54-6ed6-474e-af43-202e0d6cf9aa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.791858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b73dc54-6ed6-474e-af43-202e0d6cf9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.813899 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:29.857053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1b73dc54-6ed6-474e-af43-202e0d6cf9aa None None] MFA Rules not processed for user `40113756c05741519abdecafeca161e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:29.861494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b73dc54-6ed6-474e-af43-202e0d6cf9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:29.893605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f8bee-ad8e-467d-b67f-5283d3cab582 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:29.988581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb752e-da7c-4a35-a5ea-f80b8f731d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:29.989488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb752e-da7c-4a35-a5ea-f80b8f731d29 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:29.989637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb752e-da7c-4a35-a5ea-f80b8f731d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:29.989930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb752e-da7c-4a35-a5ea-f80b8f731d29 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:29.994188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb752e-da7c-4a35-a5ea-f80b8f731d29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:30.007189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cb752e-da7c-4a35-a5ea-f80b8f731d29 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:30.023016 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2301/4615] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:29 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:30.038925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73dc54-6ed6-474e-af43-202e0d6cf9aa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:30.042700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b73dc54-6ed6-474e-af43-202e0d6cf9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:30.060065 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2315/4616] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:29 2022] POST /identity/v3/users => generated 300 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:30.065186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb752e-da7c-4a35-a5ea-f80b8f731d29 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:30.086750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb752e-da7c-4a35-a5ea-f80b8f731d29 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:30.105232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42b6f1-dbb1-4693-928e-a3f8f2054bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:30.110483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42b6f1-dbb1-4693-928e-a3f8f2054bff admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.110483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42b6f1-dbb1-4693-928e-a3f8f2054bff admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.110765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df42b6f1-dbb1-4693-928e-a3f8f2054bff admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.111483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42b6f1-dbb1-4693-928e-a3f8f2054bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:30.113126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df42b6f1-dbb1-4693-928e-a3f8f2054bff admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:30.149847 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2316/4617] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:30.151860 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:30.155714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42b6f1-dbb1-4693-928e-a3f8f2054bff admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:30.182807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b73dc54-6ed6-474e-af43-202e0d6cf9aa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:30.189678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df42b6f1-dbb1-4693-928e-a3f8f2054bff admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:30.197973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf2014-d974-4e4e-85fc-ccfb403f35d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:30.198662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf2014-d974-4e4e-85fc-ccfb403f35d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.198943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf2014-d974-4e4e-85fc-ccfb403f35d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.199220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedf2014-d974-4e4e-85fc-ccfb403f35d5 admin admin] PATH_INFO: `/v3/projects/ddf2a17fbb804446bb2c755df4c82020/users/2f6607fd4cd148289ff588d2e388b466/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.201664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a90e933-9dd4-4cb3-88ff-396e650b4a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:30.202367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90e933-9dd4-4cb3-88ff-396e650b4a2f service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.202645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90e933-9dd4-4cb3-88ff-396e650b4a2f service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.202916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a90e933-9dd4-4cb3-88ff-396e650b4a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.222891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90e933-9dd4-4cb3-88ff-396e650b4a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:30.224496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a90e933-9dd4-4cb3-88ff-396e650b4a2f service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:30.243994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf2014-d974-4e4e-85fc-ccfb403f35d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf2a17fbb804446bb2c755df4c82020, user_id=2f6607fd4cd148289ff588d2e388b466, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:30.252173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedf2014-d974-4e4e-85fc-ccfb403f35d5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:30.262705 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2302/4618] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:15:30.287903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f100a-739c-46c8-b5ec-e8db23ef834c None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.288196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f100a-739c-46c8-b5ec-e8db23ef834c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.288469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0f100a-739c-46c8-b5ec-e8db23ef834c None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.290048 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2303/4619] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:15:30.298733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f100a-739c-46c8-b5ec-e8db23ef834c None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:15:30.303444 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2317/4620] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:30 2022] PUT /identity/v3/projects/ddf2a17fbb804446bb2c755df4c82020/users/2f6607fd4cd148289ff588d2e388b466/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:30.304748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf2014-d974-4e4e-85fc-ccfb403f35d5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:30.408001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedf2014-d974-4e4e-85fc-ccfb403f35d5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:30.414030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b148c-5555-47d8-b793-0df29c8c9719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:30.414650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b148c-5555-47d8-b793-0df29c8c9719 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.415068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b148c-5555-47d8-b793-0df29c8c9719 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.415400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b148c-5555-47d8-b793-0df29c8c9719 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.416304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b148c-5555-47d8-b793-0df29c8c9719 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:30.418200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b148c-5555-47d8-b793-0df29c8c9719 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:30.430829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f100a-739c-46c8-b5ec-e8db23ef834c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:30.434277 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2318/4621] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:30.436404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b148c-5555-47d8-b793-0df29c8c9719 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:30.448530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b148c-5555-47d8-b793-0df29c8c9719 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:30.453967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7871b2f1-188d-4c0c-b20c-7319dd4e72c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:30.455015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871b2f1-188d-4c0c-b20c-7319dd4e72c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.455469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871b2f1-188d-4c0c-b20c-7319dd4e72c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.456039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7871b2f1-188d-4c0c-b20c-7319dd4e72c3 admin admin] PATH_INFO: `/v3/projects/ddf2a17fbb804446bb2c755df4c82020/users/2f6607fd4cd148289ff588d2e388b466/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.458399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871b2f1-188d-4c0c-b20c-7319dd4e72c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddf2a17fbb804446bb2c755df4c82020, user_id=2f6607fd4cd148289ff588d2e388b466, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:30.463143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7871b2f1-188d-4c0c-b20c-7319dd4e72c3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:30.485344 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2319/4622] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:30 2022] PUT /identity/v3/projects/ddf2a17fbb804446bb2c755df4c82020/users/2f6607fd4cd148289ff588d2e388b466/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:30.490634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a1b02-093c-4a47-865c-5bc4d984efbf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.490954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a1b02-093c-4a47-865c-5bc4d984efbf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.491208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250a1b02-093c-4a47-865c-5bc4d984efbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.500530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0f100a-739c-46c8-b5ec-e8db23ef834c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:30.511933 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:30.533533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-250a1b02-093c-4a47-865c-5bc4d984efbf None None] MFA Rules not processed for user `2f6607fd4cd148289ff588d2e388b466`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:30.535415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-250a1b02-093c-4a47-865c-5bc4d984efbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:30.614261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1edee7-23cc-4c26-a445-7831729e917d tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40113756c05741519abdecafeca161e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20e50dc64ab24fa68a122b10e4cb6acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:30.614915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1edee7-23cc-4c26-a445-7831729e917d tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.616771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1edee7-23cc-4c26-a445-7831729e917d tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.617073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1edee7-23cc-4c26-a445-7831729e917d tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] PATH_INFO: `/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.621209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1edee7-23cc-4c26-a445-7831729e917d tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorizing `identity:get_project(project_id=20e50dc64ab24fa68a122b10e4cb6acd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:30.627282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1edee7-23cc-4c26-a445-7831729e917d tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:30.629083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2304/4623] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:15:30 2022] GET /identity/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd => generated 363 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:15:30.681486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13fc4b-02f0-42e5-b15f-5ab473b3ac4f None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.681816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13fc4b-02f0-42e5-b15f-5ab473b3ac4f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.682099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de13fc4b-02f0-42e5-b15f-5ab473b3ac4f None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.684063 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2305/4624] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:15:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:15:30.690918 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2320/4625] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:30 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:30.692900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13fc4b-02f0-42e5-b15f-5ab473b3ac4f None None] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:15:30.713715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a1b02-093c-4a47-865c-5bc4d984efbf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:30.716897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-250a1b02-093c-4a47-865c-5bc4d984efbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:30.753136 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:30.849147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250a1b02-093c-4a47-865c-5bc4d984efbf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:30.853380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13fc4b-02f0-42e5-b15f-5ab473b3ac4f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:30.894065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4459f885-92e0-430c-8013-7e59ec252f48 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:30.894715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459f885-92e0-430c-8013-7e59ec252f48 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.895008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459f885-92e0-430c-8013-7e59ec252f48 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.895264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4459f885-92e0-430c-8013-7e59ec252f48 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.899892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de13fc4b-02f0-42e5-b15f-5ab473b3ac4f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:30.912750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b1a76-209a-48e1-a00a-606ba239933e tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40113756c05741519abdecafeca161e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20e50dc64ab24fa68a122b10e4cb6acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:30.913436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b1a76-209a-48e1-a00a-606ba239933e tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.914101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459f885-92e0-430c-8013-7e59ec252f48 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:30.915735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4459f885-92e0-430c-8013-7e59ec252f48 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:30.924419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b1a76-209a-48e1-a00a-606ba239933e tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.924792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27b1a76-209a-48e1-a00a-606ba239933e tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] PATH_INFO: `/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.926213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b1a76-209a-48e1-a00a-606ba239933e tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorizing `identity:get_project(project_id=20e50dc64ab24fa68a122b10e4cb6acd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:30.927145 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2321/4626] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:30 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:30.941685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27b1a76-209a-48e1-a00a-606ba239933e tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:30.948911 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2306/4627] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:15:30 2022] GET /identity/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd => generated 363 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:15:30.991710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b29f0-5787-4c1e-8c12-f2a24bc41cae None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:30.992228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b29f0-5787-4c1e-8c12-f2a24bc41cae None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:30.992765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4b29f0-5787-4c1e-8c12-f2a24bc41cae None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:30.994236 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2322/4628] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:15:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:15:30.999981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b1a76-209a-48e1-a00a-606ba239933e tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:15:31.027458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b1a76-209a-48e1-a00a-606ba239933e tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:31.040104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27b1a76-209a-48e1-a00a-606ba239933e tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:31.044557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013e111-31fd-43c6-9a79-05f17c373be4 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40113756c05741519abdecafeca161e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20e50dc64ab24fa68a122b10e4cb6acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:31.045189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013e111-31fd-43c6-9a79-05f17c373be4 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:31.045517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013e111-31fd-43c6-9a79-05f17c373be4 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:31.045854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7013e111-31fd-43c6-9a79-05f17c373be4 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] PATH_INFO: `/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:31.046969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013e111-31fd-43c6-9a79-05f17c373be4 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorizing `identity:get_project(project_id=20e50dc64ab24fa68a122b10e4cb6acd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:31.048873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7013e111-31fd-43c6-9a79-05f17c373be4 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:31.052010 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2307/4629] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:15:30 2022] GET /identity/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd => generated 363 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:31.250467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c71d1d-33e9-4e00-98f6-7979ff647d70 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:31.250973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c71d1d-33e9-4e00-98f6-7979ff647d70 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:31.251492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c71d1d-33e9-4e00-98f6-7979ff647d70 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:31.253455 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2323/4630] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:15:31.259825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013e111-31fd-43c6-9a79-05f17c373be4 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:15:31.278316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013e111-31fd-43c6-9a79-05f17c373be4 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:31.288023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7013e111-31fd-43c6-9a79-05f17c373be4 tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:31.292925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b65e5-81bc-442c-9007-202fb9de46ad tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40113756c05741519abdecafeca161e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20e50dc64ab24fa68a122b10e4cb6acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:31.293594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b65e5-81bc-442c-9007-202fb9de46ad tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:31.293881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b65e5-81bc-442c-9007-202fb9de46ad tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:31.294353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3b65e5-81bc-442c-9007-202fb9de46ad tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] PATH_INFO: `/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:31.296293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b65e5-81bc-442c-9007-202fb9de46ad tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorizing `identity:get_project(project_id=20e50dc64ab24fa68a122b10e4cb6acd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:31.300350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3b65e5-81bc-442c-9007-202fb9de46ad tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:31.308487 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2308/4631] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:15:31 2022] GET /identity/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd => generated 363 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:15:31.542977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdd4ba-ff1b-45fe-8626-4fc87445147c None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:31.543494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdd4ba-ff1b-45fe-8626-4fc87445147c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:31.544101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bdd4ba-ff1b-45fe-8626-4fc87445147c None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:31.546101 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2324/4632] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:15:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:15:31.551688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b65e5-81bc-442c-9007-202fb9de46ad tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:15:31.567557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b65e5-81bc-442c-9007-202fb9de46ad tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:31.577049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3b65e5-81bc-442c-9007-202fb9de46ad tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:31.585706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3bb21-90d5-4a04-8bc2-66959cd22d9a tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '40113756c05741519abdecafeca161e2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '20e50dc64ab24fa68a122b10e4cb6acd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:31.585930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3bb21-90d5-4a04-8bc2-66959cd22d9a tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:31.586129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3bb21-90d5-4a04-8bc2-66959cd22d9a tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:31.587944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3bb21-90d5-4a04-8bc2-66959cd22d9a tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] PATH_INFO: `/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:31.589755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3bb21-90d5-4a04-8bc2-66959cd22d9a tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorizing `identity:get_project(project_id=20e50dc64ab24fa68a122b10e4cb6acd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:31.591649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3bb21-90d5-4a04-8bc2-66959cd22d9a tempest-QuotasTestJSON-809984873 tempest-QuotasTestJSON-809984873-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:31.609238 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2309/4633] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:15:31 2022] GET /identity/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd => generated 363 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:31.632323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdd4ba-ff1b-45fe-8626-4fc87445147c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:31.772958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bdd4ba-ff1b-45fe-8626-4fc87445147c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:31.795745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:31.797071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:31.797894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:31.798424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] PATH_INFO: `/v3/users/40113756c05741519abdecafeca161e2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:31.800120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] RBAC: Authorizing `identity:delete_user(user_id=40113756c05741519abdecafeca161e2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:31.802752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:31.865803 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:31.880296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40113756c05741519abdecafeca161e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:31.898814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40113756c05741519abdecafeca161e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:31.899615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40113756c05741519abdecafeca161e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:31.912693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40113756c05741519abdecafeca161e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:31.927149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40113756c05741519abdecafeca161e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:31.945531 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2325/4634] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:31 2022] DELETE /identity/v3/users/40113756c05741519abdecafeca161e2 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:31.948065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0644d6-65b5-47f6-97b4-af636ff83ed4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:31.948570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0644d6-65b5-47f6-97b4-af636ff83ed4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:31.948669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0644d6-65b5-47f6-97b4-af636ff83ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:31.968911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:31.971541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:31.983267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bb0644d6-65b5-47f6-97b4-af636ff83ed4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:31.984998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bb0644d6-65b5-47f6-97b4-af636ff83ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:32.074066 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2310/4635] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:32.091575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0644d6-65b5-47f6-97b4-af636ff83ed4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:32.094212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bb0644d6-65b5-47f6-97b4-af636ff83ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:32.117015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f562941f-fe2c-4ad3-963a-44540acc73de admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:32.123883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:32.124617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:32.124975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:32.125467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] PATH_INFO: `/v3/users/0301ee7cf0d74c09ad5902e7fb4133b9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:32.127247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0301ee7cf0d74c09ad5902e7fb4133b9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:32.129307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:32.213012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0644d6-65b5-47f6-97b4-af636ff83ed4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:32.217940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb79bee8-c3fc-4f4d-84c2-d2642b7a3498 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:32.218548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79bee8-c3fc-4f4d-84c2-d2642b7a3498 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:32.218838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79bee8-c3fc-4f4d-84c2-d2642b7a3498 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:32.219166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb79bee8-c3fc-4f4d-84c2-d2642b7a3498 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:32.219376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0301ee7cf0d74c09ad5902e7fb4133b9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:32.231706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0301ee7cf0d74c09ad5902e7fb4133b9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:32.232478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0301ee7cf0d74c09ad5902e7fb4133b9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:32.241207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0301ee7cf0d74c09ad5902e7fb4133b9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:32.241570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79bee8-c3fc-4f4d-84c2-d2642b7a3498 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:32.242949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb79bee8-c3fc-4f4d-84c2-d2642b7a3498 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:32.249945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0301ee7cf0d74c09ad5902e7fb4133b9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:32.254509 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2311/4636] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:15:32.260160 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2326/4637] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:31 2022] DELETE /identity/v3/users/0301ee7cf0d74c09ad5902e7fb4133b9 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:32.264948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e854e-905a-4964-aeb7-01c556a5f7e5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:32.265244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e854e-905a-4964-aeb7-01c556a5f7e5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:32.265546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409e854e-905a-4964-aeb7-01c556a5f7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:32.289203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-409e854e-905a-4964-aeb7-01c556a5f7e5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:32.289960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-409e854e-905a-4964-aeb7-01c556a5f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:32.342806 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:32.378015 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2312/4638] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:32.388525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:32.390053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:32.442287 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:32.483527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3771d5-891d-483a-962f-a20ba802c597 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:32.511977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f887321-6c33-4ea2-9d8f-2138e6df3df5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:32.513947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887321-6c33-4ea2-9d8f-2138e6df3df5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:32.514232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887321-6c33-4ea2-9d8f-2138e6df3df5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:32.514509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f887321-6c33-4ea2-9d8f-2138e6df3df5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:32.536701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f887321-6c33-4ea2-9d8f-2138e6df3df5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:32.538203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f887321-6c33-4ea2-9d8f-2138e6df3df5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:32.561868 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2327/4639] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:32.779701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e854e-905a-4964-aeb7-01c556a5f7e5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:32.781460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-409e854e-905a-4964-aeb7-01c556a5f7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:32.804200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409e854e-905a-4964-aeb7-01c556a5f7e5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:32.823974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:32.825154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:32.827649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:32.830740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] PATH_INFO: `/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:32.840615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] RBAC: Authorizing `identity:delete_project(project_id=20e50dc64ab24fa68a122b10e4cb6acd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:32.843743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:32.969102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20e50dc64ab24fa68a122b10e4cb6acd', 'request_id': 'req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:32.979432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20e50dc64ab24fa68a122b10e4cb6acd', 'request_id': 'req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:32.999206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20e50dc64ab24fa68a122b10e4cb6acd', 'request_id': 'req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.018429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] The token cache is being invalidate because project 20e50dc64ab24fa68a122b10e4cb6acd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:33.018925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.021722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.033396 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2313/4640] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:32 2022] DELETE /identity/v3/projects/20e50dc64ab24fa68a122b10e4cb6acd => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:33.036002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad50c3-d0cb-47d9-8ca7-f158461c92af None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.036354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad50c3-d0cb-47d9-8ca7-f158461c92af None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.036909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ad50c3-d0cb-47d9-8ca7-f158461c92af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.076760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e8ad50c3-d0cb-47d9-8ca7-f158461c92af None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:33.078421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e8ad50c3-d0cb-47d9-8ca7-f158461c92af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:33.224583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:33.226036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:33.249889 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2328/4641] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:33.251637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93929d-f172-4cb1-b432-d2eebc857e7c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.252167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93929d-f172-4cb1-b432-d2eebc857e7c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.252602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b93929d-f172-4cb1-b432-d2eebc857e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.294530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4b93929d-f172-4cb1-b432-d2eebc857e7c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:33.297269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4b93929d-f172-4cb1-b432-d2eebc857e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:33.324685 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2329/4642] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:33.326268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93929d-f172-4cb1-b432-d2eebc857e7c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:33.360559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b93929d-f172-4cb1-b432-d2eebc857e7c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:33.365342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b52c08-cc33-4fbe-8cf5-bde72cb8a51c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:33.368210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d960f-3491-40ea-a592-0c0b349f3493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:33.368845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d960f-3491-40ea-a592-0c0b349f3493 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.369155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d960f-3491-40ea-a592-0c0b349f3493 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.369490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88d960f-3491-40ea-a592-0c0b349f3493 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.370158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d960f-3491-40ea-a592-0c0b349f3493 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:33.370462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d960f-3491-40ea-a592-0c0b349f3493 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:33.372071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88d960f-3491-40ea-a592-0c0b349f3493 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:33.375758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:33.376624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.376736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.376970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] PATH_INFO: `/v3/projects/7d10637d95834ec0877153a3c30a3437` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.386838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d10637d95834ec0877153a3c30a3437)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:33.388854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:33.411146 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2330/4643] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:33.412461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d960f-3491-40ea-a592-0c0b349f3493 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:33.425691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88d960f-3491-40ea-a592-0c0b349f3493 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:33.436090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab7675-677f-4d23-a011-0caa1b83c916 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:33.436965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab7675-677f-4d23-a011-0caa1b83c916 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.437265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab7675-677f-4d23-a011-0caa1b83c916 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.437596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ab7675-677f-4d23-a011-0caa1b83c916 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.438766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab7675-677f-4d23-a011-0caa1b83c916 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:33.441044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ab7675-677f-4d23-a011-0caa1b83c916 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:33.480643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d10637d95834ec0877153a3c30a3437', 'request_id': 'req-5eed7749-d663-44d0-a4ac-adf8cecab6f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.506856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d10637d95834ec0877153a3c30a3437', 'request_id': 'req-5eed7749-d663-44d0-a4ac-adf8cecab6f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.507178 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2331/4644] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:33 2022] POST /identity/v3/projects => generated 389 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:33.510689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab7675-677f-4d23-a011-0caa1b83c916 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:33.528572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d10637d95834ec0877153a3c30a3437', 'request_id': 'req-5eed7749-d663-44d0-a4ac-adf8cecab6f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.546403 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:33.552622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] The token cache is being invalidate because project 7d10637d95834ec0877153a3c30a3437 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:33.553512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.557752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.564256 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2314/4645] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:33 2022] DELETE /identity/v3/projects/7d10637d95834ec0877153a3c30a3437 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:33.565776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:33.567837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:33.620310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ab7675-677f-4d23-a011-0caa1b83c916 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:33.626791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c272-2b21-4f98-b141-d87c2a386f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:33.627438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c272-2b21-4f98-b141-d87c2a386f59 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.627921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c272-2b21-4f98-b141-d87c2a386f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.628743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332c272-2b21-4f98-b141-d87c2a386f59 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.629475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c272-2b21-4f98-b141-d87c2a386f59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:33.632085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332c272-2b21-4f98-b141-d87c2a386f59 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:33.665648 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2332/4646] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:33 2022] POST /identity/v3/users => generated 295 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:33.666869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c272-2b21-4f98-b141-d87c2a386f59 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:33.675303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6332c272-2b21-4f98-b141-d87c2a386f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:33.692012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332c272-2b21-4f98-b141-d87c2a386f59 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:33.698308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53851b-b6a4-4fd2-911d-f916b41cfa7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:33.699825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53851b-b6a4-4fd2-911d-f916b41cfa7b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.700537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53851b-b6a4-4fd2-911d-f916b41cfa7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.701916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b53851b-b6a4-4fd2-911d-f916b41cfa7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.702695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53851b-b6a4-4fd2-911d-f916b41cfa7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:33.705520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b53851b-b6a4-4fd2-911d-f916b41cfa7b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:33.706366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed7749-d663-44d0-a4ac-adf8cecab6f3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:33.718061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:33.718942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.721135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.721561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] PATH_INFO: `/v3/users/2f6607fd4cd148289ff588d2e388b466` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.726451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6607fd4cd148289ff588d2e388b466)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:33.728960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:33.729618 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2333/4647] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:33.737680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53851b-b6a4-4fd2-911d-f916b41cfa7b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:33.754759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b53851b-b6a4-4fd2-911d-f916b41cfa7b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:33.768407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b903cd-d3c5-4acf-afa5-2f10a558b4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:33.770196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b903cd-d3c5-4acf-afa5-2f10a558b4dd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.770582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b903cd-d3c5-4acf-afa5-2f10a558b4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.770976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b903cd-d3c5-4acf-afa5-2f10a558b4dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.771795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b903cd-d3c5-4acf-afa5-2f10a558b4dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:33.776755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b903cd-d3c5-4acf-afa5-2f10a558b4dd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:33.814324 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2334/4648] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:33.815402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b903cd-d3c5-4acf-afa5-2f10a558b4dd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:33.824607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6607fd4cd148289ff588d2e388b466'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.827454 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:33.842781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b903cd-d3c5-4acf-afa5-2f10a558b4dd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:33.853932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6607fd4cd148289ff588d2e388b466'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.855616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88f7c-016f-4526-b9d0-f05fca07c647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:33.856238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6607fd4cd148289ff588d2e388b466'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.857572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88f7c-016f-4526-b9d0-f05fca07c647 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.858546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88f7c-016f-4526-b9d0-f05fca07c647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.858893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c88f7c-016f-4526-b9d0-f05fca07c647 admin admin] PATH_INFO: `/v3/projects/c6f88028805e42a0a83e7de1f6f39d99/users/b2755c3ea93440999d287890d328ecd6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:33.874768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6607fd4cd148289ff588d2e388b466'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.891235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dd3f1763-bf13-4d9e-a7db-d30248384209 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6607fd4cd148289ff588d2e388b466'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:33.900430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c88f7c-016f-4526-b9d0-f05fca07c647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f88028805e42a0a83e7de1f6f39d99, user_id=b2755c3ea93440999d287890d328ecd6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:33.907301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c88f7c-016f-4526-b9d0-f05fca07c647 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:33.910476 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2315/4649] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:33 2022] DELETE /identity/v3/users/2f6607fd4cd148289ff588d2e388b466 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:33.945018 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2335/4650] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:33 2022] PUT /identity/v3/projects/c6f88028805e42a0a83e7de1f6f39d99/users/b2755c3ea93440999d287890d328ecd6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:33.950538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359919-a6c2-41eb-b0b1-9721cf583eaf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:33.951200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359919-a6c2-41eb-b0b1-9721cf583eaf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:33.951801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb359919-a6c2-41eb-b0b1-9721cf583eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:34.003083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-eb359919-a6c2-41eb-b0b1-9721cf583eaf None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:34.004451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eb359919-a6c2-41eb-b0b1-9721cf583eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:34.113580 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2316/4651] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:34.123000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88f7c-016f-4526-b9d0-f05fca07c647 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:34.124839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-15c88f7c-016f-4526-b9d0-f05fca07c647 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:34.225130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c88f7c-016f-4526-b9d0-f05fca07c647 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:34.230741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00144add-2e58-412b-a99d-fc2873fdba64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:34.231412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144add-2e58-412b-a99d-fc2873fdba64 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:34.231747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144add-2e58-412b-a99d-fc2873fdba64 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:34.232033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00144add-2e58-412b-a99d-fc2873fdba64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:34.246984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00144add-2e58-412b-a99d-fc2873fdba64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:34.249424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00144add-2e58-412b-a99d-fc2873fdba64 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:34.274749 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2336/4652] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:34.583093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb359919-a6c2-41eb-b0b1-9721cf583eaf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:34.584895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eb359919-a6c2-41eb-b0b1-9721cf583eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:34.612436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb359919-a6c2-41eb-b0b1-9721cf583eaf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:34.638611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:34.642481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:34.643402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:34.645254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] PATH_INFO: `/v3/projects/ddf2a17fbb804446bb2c755df4c82020` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:34.653792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddf2a17fbb804446bb2c755df4c82020)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:34.662986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:34.717894 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:34.868488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddf2a17fbb804446bb2c755df4c82020', 'request_id': 'req-fca2b4d2-3402-4d6c-8194-1bcd18244229'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:34.885371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddf2a17fbb804446bb2c755df4c82020', 'request_id': 'req-fca2b4d2-3402-4d6c-8194-1bcd18244229'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:34.906384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddf2a17fbb804446bb2c755df4c82020', 'request_id': 'req-fca2b4d2-3402-4d6c-8194-1bcd18244229'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:34.929026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] The token cache is being invalidate because project ddf2a17fbb804446bb2c755df4c82020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:34.929528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:34.931492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fca2b4d2-3402-4d6c-8194-1bcd18244229 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:34.937943 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2317/4653] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:34 2022] DELETE /identity/v3/projects/ddf2a17fbb804446bb2c755df4c82020 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:34.941052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42f953-69ee-47c8-abf3-bd05eac75b63 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:34.941374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42f953-69ee-47c8-abf3-bd05eac75b63 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:34.941651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42f953-69ee-47c8-abf3-bd05eac75b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:34.967364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ec42f953-69ee-47c8-abf3-bd05eac75b63 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:34.971180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ec42f953-69ee-47c8-abf3-bd05eac75b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:35.061626 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2337/4654] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:35.069095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4761f1f-e1ed-479f-a440-577847fff1a6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.072576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4761f1f-e1ed-479f-a440-577847fff1a6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.072990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4761f1f-e1ed-479f-a440-577847fff1a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.105688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b4761f1f-e1ed-479f-a440-577847fff1a6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:35.109832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b4761f1f-e1ed-479f-a440-577847fff1a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:35.141632 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2318/4655] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:35.142407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42f953-69ee-47c8-abf3-bd05eac75b63 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:35.153799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42f953-69ee-47c8-abf3-bd05eac75b63 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:35.177052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c384-cf0f-45ed-a625-6f55f27e6edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:35.177833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c384-cf0f-45ed-a625-6f55f27e6edf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.178112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c384-cf0f-45ed-a625-6f55f27e6edf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.178384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf58c384-cf0f-45ed-a625-6f55f27e6edf admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.179030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c384-cf0f-45ed-a625-6f55f27e6edf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:35.179329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c384-cf0f-45ed-a625-6f55f27e6edf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:35.185212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf58c384-cf0f-45ed-a625-6f55f27e6edf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:35.214603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4761f1f-e1ed-479f-a440-577847fff1a6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:35.215611 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2338/4656] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:35.228705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4761f1f-e1ed-479f-a440-577847fff1a6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:35.244559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a133b42-243b-4e80-a403-3ab03e5adda4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:35.245840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a133b42-243b-4e80-a403-3ab03e5adda4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.246388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a133b42-243b-4e80-a403-3ab03e5adda4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.246893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a133b42-243b-4e80-a403-3ab03e5adda4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.247744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a133b42-243b-4e80-a403-3ab03e5adda4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:35.253715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a133b42-243b-4e80-a403-3ab03e5adda4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:35.324176 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2319/4657] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:35 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:35.327219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c384-cf0f-45ed-a625-6f55f27e6edf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:35.345490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf58c384-cf0f-45ed-a625-6f55f27e6edf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:35.470431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e62f58-e558-4450-b385-52c2b57b9a56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:35.471070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e62f58-e558-4450-b385-52c2b57b9a56 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.471914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e62f58-e558-4450-b385-52c2b57b9a56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.472193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e62f58-e558-4450-b385-52c2b57b9a56 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.472842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e62f58-e558-4450-b385-52c2b57b9a56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:35.477687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e62f58-e558-4450-b385-52c2b57b9a56 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:35.516478 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:35.527325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a133b42-243b-4e80-a403-3ab03e5adda4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:35.527856 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2339/4658] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:35 2022] POST /identity/v3/users => generated 291 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:35.528919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e62f58-e558-4450-b385-52c2b57b9a56 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:35.530403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2a133b42-243b-4e80-a403-3ab03e5adda4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:35.547440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e62f58-e558-4450-b385-52c2b57b9a56 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:35.554508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a133b42-243b-4e80-a403-3ab03e5adda4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:35.561666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548fea9-8061-4904-baaa-67ceee3e7b1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:35.562284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548fea9-8061-4904-baaa-67ceee3e7b1f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.563136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548fea9-8061-4904-baaa-67ceee3e7b1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.563420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1548fea9-8061-4904-baaa-67ceee3e7b1f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.566631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548fea9-8061-4904-baaa-67ceee3e7b1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:35.568298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1548fea9-8061-4904-baaa-67ceee3e7b1f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:35.569089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:35.571480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.572586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.574334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] PATH_INFO: `/v3/users/30871fbb6a284b13831cc6f172a49717` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.590319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=30871fbb6a284b13831cc6f172a49717)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:35.599557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:35.599913 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2340/4659] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:35.600862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548fea9-8061-4904-baaa-67ceee3e7b1f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:35.628693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1548fea9-8061-4904-baaa-67ceee3e7b1f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:35.643758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7508c-557a-4458-86dc-ae0ea3433a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:35.644387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7508c-557a-4458-86dc-ae0ea3433a4e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.644664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7508c-557a-4458-86dc-ae0ea3433a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.644937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac7508c-557a-4458-86dc-ae0ea3433a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.645607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7508c-557a-4458-86dc-ae0ea3433a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:35.647204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac7508c-557a-4458-86dc-ae0ea3433a4e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:35.677807 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2341/4660] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:35 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:35.687950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7508c-557a-4458-86dc-ae0ea3433a4e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:35.706211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30871fbb6a284b13831cc6f172a49717'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:35.713857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac7508c-557a-4458-86dc-ae0ea3433a4e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:35.719714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2219c36-56cc-40ba-8bad-84b45f0f5bd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:35.720842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2219c36-56cc-40ba-8bad-84b45f0f5bd2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.721122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2219c36-56cc-40ba-8bad-84b45f0f5bd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.721423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2219c36-56cc-40ba-8bad-84b45f0f5bd2 admin admin] PATH_INFO: `/v3/projects/1b0b3296e1e14daabb6fa2cc06645cf3/users/ac4795c1920a4f5ea214d1c3747e8488/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.743698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2219c36-56cc-40ba-8bad-84b45f0f5bd2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b0b3296e1e14daabb6fa2cc06645cf3, user_id=ac4795c1920a4f5ea214d1c3747e8488, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:35.746885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2219c36-56cc-40ba-8bad-84b45f0f5bd2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:35.754415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30871fbb6a284b13831cc6f172a49717'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:35.755977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30871fbb6a284b13831cc6f172a49717'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:35.768286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30871fbb6a284b13831cc6f172a49717'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:35.779970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-78733fda-e3f6-45d7-a61e-101ecf4bbb6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30871fbb6a284b13831cc6f172a49717'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:35.790707 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2342/4661] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:35 2022] PUT /identity/v3/projects/1b0b3296e1e14daabb6fa2cc06645cf3/users/ac4795c1920a4f5ea214d1c3747e8488/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:35.796841 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2320/4662] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:35 2022] DELETE /identity/v3/users/30871fbb6a284b13831cc6f172a49717 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:35.802145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f3be0-e52d-4a51-9f59-37829ca8c9f3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.802426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f3be0-e52d-4a51-9f59-37829ca8c9f3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.802698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2f3be0-e52d-4a51-9f59-37829ca8c9f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.807028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f3652-3dc7-415a-b0af-b1ba2d50bd79 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:35.807322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f3652-3dc7-415a-b0af-b1ba2d50bd79 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:35.807596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843f3652-3dc7-415a-b0af-b1ba2d50bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:35.841777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8a2f3be0-e52d-4a51-9f59-37829ca8c9f3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:35.843002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8a2f3be0-e52d-4a51-9f59-37829ca8c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:35.862226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-843f3652-3dc7-415a-b0af-b1ba2d50bd79 None None] MFA Rules not processed for user `ac4795c1920a4f5ea214d1c3747e8488`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:35.863653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-843f3652-3dc7-415a-b0af-b1ba2d50bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:35.926431 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=80,keystone:DELETE=17,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:35.927173 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2343/4663] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:35.934954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f3be0-e52d-4a51-9f59-37829ca8c9f3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:35.935820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8a2f3be0-e52d-4a51-9f59-37829ca8c9f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:36.012988 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2321/4664] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:35 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:36.018168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f3652-3dc7-415a-b0af-b1ba2d50bd79 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:36.020108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-843f3652-3dc7-415a-b0af-b1ba2d50bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:36.056017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843f3652-3dc7-415a-b0af-b1ba2d50bd79 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:36.072027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaca16-b8b8-4b49-a6ad-0b96a4dfe64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:36.073584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaca16-b8b8-4b49-a6ad-0b96a4dfe64a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:36.074099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaca16-b8b8-4b49-a6ad-0b96a4dfe64a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:36.074590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eaca16-b8b8-4b49-a6ad-0b96a4dfe64a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:36.075700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaca16-b8b8-4b49-a6ad-0b96a4dfe64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:36.077903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1eaca16-b8b8-4b49-a6ad-0b96a4dfe64a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:36.078440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2f3be0-e52d-4a51-9f59-37829ca8c9f3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:36.087557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b12ff-c390-4de0-b4ec-5f3e7d2735d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:36.088181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b12ff-c390-4de0-b4ec-5f3e7d2735d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:36.089490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b12ff-c390-4de0-b4ec-5f3e7d2735d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:36.091473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6b12ff-c390-4de0-b4ec-5f3e7d2735d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:36.127445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b12ff-c390-4de0-b4ec-5f3e7d2735d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:36.129692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6b12ff-c390-4de0-b4ec-5f3e7d2735d9 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:36.156931 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2344/4665] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:36.171409 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2322/4666] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:36 2022] POST /identity/v3/projects => generated 379 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:36.175110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b12ff-c390-4de0-b4ec-5f3e7d2735d9 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:36.189358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6b12ff-c390-4de0-b4ec-5f3e7d2735d9 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:36.305503 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:36.324311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d208b6-ef19-4c6b-89bd-12052a28d6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:36.324930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d208b6-ef19-4c6b-89bd-12052a28d6c5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:36.325197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d208b6-ef19-4c6b-89bd-12052a28d6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:36.325774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d208b6-ef19-4c6b-89bd-12052a28d6c5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:36.326741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d208b6-ef19-4c6b-89bd-12052a28d6c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:36.328849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d208b6-ef19-4c6b-89bd-12052a28d6c5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:36.375187 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2345/4667] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:36 2022] POST /identity/v3/users => generated 296 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:36.379691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaca16-b8b8-4b49-a6ad-0b96a4dfe64a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:36.395631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eaca16-b8b8-4b49-a6ad-0b96a4dfe64a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:36.413323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da41d9-e412-48a8-a0c2-491556890331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:36.414971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da41d9-e412-48a8-a0c2-491556890331 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:36.415678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da41d9-e412-48a8-a0c2-491556890331 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:36.416126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da41d9-e412-48a8-a0c2-491556890331 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:36.416972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da41d9-e412-48a8-a0c2-491556890331 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:36.418821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da41d9-e412-48a8-a0c2-491556890331 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:36.447313 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2323/4668] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:36.451159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d208b6-ef19-4c6b-89bd-12052a28d6c5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:36.464662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d208b6-ef19-4c6b-89bd-12052a28d6c5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:36.471140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c733-fb41-473e-837d-16c959a888d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:36.472292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c733-fb41-473e-837d-16c959a888d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:36.472791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c733-fb41-473e-837d-16c959a888d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:36.473262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0c733-fb41-473e-837d-16c959a888d7 admin admin] PATH_INFO: `/v3/projects/c5a90d3cc7e24db2b6ba936b8ec6bbae/users/b19007f809614dc0a0b81235d0d2d34a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:36.522000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0c733-fb41-473e-837d-16c959a888d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a90d3cc7e24db2b6ba936b8ec6bbae, user_id=b19007f809614dc0a0b81235d0d2d34a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:36.526369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0c733-fb41-473e-837d-16c959a888d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:36.550836 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2346/4669] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:36 2022] PUT /identity/v3/projects/c5a90d3cc7e24db2b6ba936b8ec6bbae/users/b19007f809614dc0a0b81235d0d2d34a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:36.555555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da41d9-e412-48a8-a0c2-491556890331 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:36.567377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da41d9-e412-48a8-a0c2-491556890331 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:36.683174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9832da67-21c3-4074-9365-ace76eefbe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:36.684442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832da67-21c3-4074-9365-ace76eefbe9b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:36.684442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832da67-21c3-4074-9365-ace76eefbe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:36.684442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9832da67-21c3-4074-9365-ace76eefbe9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:36.685218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832da67-21c3-4074-9365-ace76eefbe9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:36.689227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9832da67-21c3-4074-9365-ace76eefbe9b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:36.716646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c733-fb41-473e-837d-16c959a888d7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:36.730192 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2324/4670] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:36 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:36.738425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0c733-fb41-473e-837d-16c959a888d7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:36.749675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4f34b-b748-4427-a839-baf25270df3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:36.750706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4f34b-b748-4427-a839-baf25270df3b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:36.750995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4f34b-b748-4427-a839-baf25270df3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:36.752339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4f34b-b748-4427-a839-baf25270df3b admin admin] PATH_INFO: `/v3/projects/c5a90d3cc7e24db2b6ba936b8ec6bbae/users/b19007f809614dc0a0b81235d0d2d34a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:36.757440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4f34b-b748-4427-a839-baf25270df3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a90d3cc7e24db2b6ba936b8ec6bbae, user_id=b19007f809614dc0a0b81235d0d2d34a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:36.760812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd4f34b-b748-4427-a839-baf25270df3b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:36.803411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f52cac-89b6-45ff-8a0a-d38a84c84cea None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:36.803773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f52cac-89b6-45ff-8a0a-d38a84c84cea None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:36.803985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f52cac-89b6-45ff-8a0a-d38a84c84cea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:36.806646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2347/4671] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:36 2022] PUT /identity/v3/projects/c5a90d3cc7e24db2b6ba936b8ec6bbae/users/b19007f809614dc0a0b81235d0d2d34a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:36.858295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-41f52cac-89b6-45ff-8a0a-d38a84c84cea None None] MFA Rules not processed for user `b19007f809614dc0a0b81235d0d2d34a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:36.859550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-41f52cac-89b6-45ff-8a0a-d38a84c84cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:36.927364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4f34b-b748-4427-a839-baf25270df3b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:36.930453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5dd4f34b-b748-4427-a839-baf25270df3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:36.995809 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2325/4672] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:37.014218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f52cac-89b6-45ff-8a0a-d38a84c84cea None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:37.016276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-41f52cac-89b6-45ff-8a0a-d38a84c84cea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:37.047136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4f34b-b748-4427-a839-baf25270df3b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:37.066685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:37.067684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:37.068102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:37.068478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] PATH_INFO: `/v3/projects/30cb07c00fae41b2911d2c02cb1c55e1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:37.070675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] RBAC: Authorizing `identity:delete_project(project_id=30cb07c00fae41b2911d2c02cb1c55e1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:37.073493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:37.082373 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:37.190983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f52cac-89b6-45ff-8a0a-d38a84c84cea None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:37.202426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b888c9-9ef3-40e2-9bf1-c3bf37f59e83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:37.205031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b888c9-9ef3-40e2-9bf1-c3bf37f59e83 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:37.205379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b888c9-9ef3-40e2-9bf1-c3bf37f59e83 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:37.205666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b888c9-9ef3-40e2-9bf1-c3bf37f59e83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:37.248133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b888c9-9ef3-40e2-9bf1-c3bf37f59e83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:37.252135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b888c9-9ef3-40e2-9bf1-c3bf37f59e83 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:37.258401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30cb07c00fae41b2911d2c02cb1c55e1', 'request_id': 'req-51488b6a-6204-4ef5-a19b-4a6f744e1dae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.279362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30cb07c00fae41b2911d2c02cb1c55e1', 'request_id': 'req-51488b6a-6204-4ef5-a19b-4a6f744e1dae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.302029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30cb07c00fae41b2911d2c02cb1c55e1', 'request_id': 'req-51488b6a-6204-4ef5-a19b-4a6f744e1dae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.312856 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2326/4673] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:37 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:37.328421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] The token cache is being invalidate because project 30cb07c00fae41b2911d2c02cb1c55e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:37.328791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.331561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.336366 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2348/4674] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:36 2022] DELETE /identity/v3/projects/30cb07c00fae41b2911d2c02cb1c55e1 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:37.342383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b888c9-9ef3-40e2-9bf1-c3bf37f59e83 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:37.362558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b888c9-9ef3-40e2-9bf1-c3bf37f59e83 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:37.518154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:37.518816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:37.519100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:37.519377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] PATH_INFO: `/v3/users/d3600bf77eae48e9a22b4763384a8196` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:37.520855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3600bf77eae48e9a22b4763384a8196)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:37.522645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:37.645124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3600bf77eae48e9a22b4763384a8196'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.676607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3600bf77eae48e9a22b4763384a8196'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.677607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3600bf77eae48e9a22b4763384a8196'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.697881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3600bf77eae48e9a22b4763384a8196'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.709098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3600bf77eae48e9a22b4763384a8196'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:37.721386 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2327/4675] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:37 2022] DELETE /identity/v3/users/d3600bf77eae48e9a22b4763384a8196 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:38.213006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:38.214862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:38.242043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51488b6a-6204-4ef5-a19b-4a6f744e1dae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:38.340673 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:INSERT=6,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:38.372165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:38.372813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:38.373096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:38.373410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] PATH_INFO: `/v3/users/ac4795c1920a4f5ea214d1c3747e8488` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:38.375058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac4795c1920a4f5ea214d1c3747e8488)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:38.377840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:38.442531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:38.444003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:38.488848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b27b7f5-c6a0-40d6-af58-504c5b64ac80 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:38.512351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:38.512914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:38.513191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:38.513500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] PATH_INFO: `/v3/projects/6987b1a11bf548579cb545c6ca0640f3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:38.514845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=6987b1a11bf548579cb545c6ca0640f3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:38.516799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:38.519348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac4795c1920a4f5ea214d1c3747e8488'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.551044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac4795c1920a4f5ea214d1c3747e8488'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.552718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac4795c1920a4f5ea214d1c3747e8488'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.566568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac4795c1920a4f5ea214d1c3747e8488'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.576233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9bb302ef-4acb-4b5f-8ae2-255ac1c7f96f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac4795c1920a4f5ea214d1c3747e8488'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.584634 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2349/4676] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:38 2022] DELETE /identity/v3/users/ac4795c1920a4f5ea214d1c3747e8488 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:38.588943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fc14a-e447-4361-86b3-9e46142f9c0c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:38.589232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fc14a-e447-4361-86b3-9e46142f9c0c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:38.589563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-798fc14a-e447-4361-86b3-9e46142f9c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:38.617331 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:38.617552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-798fc14a-e447-4361-86b3-9e46142f9c0c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:38.618805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-798fc14a-e447-4361-86b3-9e46142f9c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:38.640645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6987b1a11bf548579cb545c6ca0640f3', 'request_id': 'req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.656100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6987b1a11bf548579cb545c6ca0640f3', 'request_id': 'req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.672453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6987b1a11bf548579cb545c6ca0640f3', 'request_id': 'req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.696097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] The token cache is being invalidate because project 6987b1a11bf548579cb545c6ca0640f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:38.696313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.697356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aadd1add-8c4d-4a21-a4c3-e9e0f26d62fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:38.700149 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2328/4677] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:38 2022] DELETE /identity/v3/projects/6987b1a11bf548579cb545c6ca0640f3 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:38.714292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba4f4f-b434-414a-96e4-a9f422515483 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:38.714778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba4f4f-b434-414a-96e4-a9f422515483 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:38.717226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ba4f4f-b434-414a-96e4-a9f422515483 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:38.797450 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2350/4678] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:38.809282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fc14a-e447-4361-86b3-9e46142f9c0c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:38.814509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-798fc14a-e447-4361-86b3-9e46142f9c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:38.820659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-15ba4f4f-b434-414a-96e4-a9f422515483 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:38.825272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-15ba4f4f-b434-414a-96e4-a9f422515483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:38.869379 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2329/4679] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:38.877849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720808a-c736-4b19-80a2-d91d699c2abb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:38.878164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720808a-c736-4b19-80a2-d91d699c2abb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:38.878404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720808a-c736-4b19-80a2-d91d699c2abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:38.942085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4720808a-c736-4b19-80a2-d91d699c2abb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:38.944288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4720808a-c736-4b19-80a2-d91d699c2abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:38.963730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-798fc14a-e447-4361-86b3-9e46142f9c0c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:38.968193 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2330/4680] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:38.968936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720808a-c736-4b19-80a2-d91d699c2abb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:38.974469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0c516-39fc-4ed9-9023-802dc1fbdfe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:38.975885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0c516-39fc-4ed9-9023-802dc1fbdfe4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:38.975885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0c516-39fc-4ed9-9023-802dc1fbdfe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:38.975885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0c516-39fc-4ed9-9023-802dc1fbdfe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:38.987912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0c516-39fc-4ed9-9023-802dc1fbdfe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:38.989422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0c516-39fc-4ed9-9023-802dc1fbdfe4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:38.996128 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:38.996501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720808a-c736-4b19-80a2-d91d699c2abb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:39.007222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a929-dc82-4db9-bdcd-77c62eff8ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:39.008439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a929-dc82-4db9-bdcd-77c62eff8ea5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:39.008733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a929-dc82-4db9-bdcd-77c62eff8ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:39.009013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57a929-dc82-4db9-bdcd-77c62eff8ea5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:39.012337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57a929-dc82-4db9-bdcd-77c62eff8ea5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:39.012718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57a929-dc82-4db9-bdcd-77c62eff8ea5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:39.014661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57a929-dc82-4db9-bdcd-77c62eff8ea5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:39.031802 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2351/4681] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:15:39.052736 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2331/4682] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:39.054041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0c516-39fc-4ed9-9023-802dc1fbdfe4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:39.072930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0c516-39fc-4ed9-9023-802dc1fbdfe4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:39.085165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfbab2-bfb5-49b1-9202-a419bbee58ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:39.087275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfbab2-bfb5-49b1-9202-a419bbee58ea admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:39.088473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfbab2-bfb5-49b1-9202-a419bbee58ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:39.089372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dfbab2-bfb5-49b1-9202-a419bbee58ea admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:39.090973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfbab2-bfb5-49b1-9202-a419bbee58ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:39.095599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9dfbab2-bfb5-49b1-9202-a419bbee58ea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:39.174596 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2352/4683] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:39 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:39.180110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a929-dc82-4db9-bdcd-77c62eff8ea5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:39.203084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57a929-dc82-4db9-bdcd-77c62eff8ea5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:39.372664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22ff2-3ca2-4386-8a7e-5adb49d6db76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:39.373593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22ff2-3ca2-4386-8a7e-5adb49d6db76 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:39.374064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22ff2-3ca2-4386-8a7e-5adb49d6db76 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:39.374520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d22ff2-3ca2-4386-8a7e-5adb49d6db76 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:39.375330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d22ff2-3ca2-4386-8a7e-5adb49d6db76 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:39.378038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d22ff2-3ca2-4386-8a7e-5adb49d6db76 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:39.419266 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2332/4684] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:39 2022] POST /identity/v3/users => generated 286 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:39.424247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfbab2-bfb5-49b1-9202-a419bbee58ea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:39.458997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dfbab2-bfb5-49b1-9202-a419bbee58ea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:39.465923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e079d6-23f1-4f4a-a719-1805425584d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:39.466542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e079d6-23f1-4f4a-a719-1805425584d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:39.466955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e079d6-23f1-4f4a-a719-1805425584d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:39.467239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e079d6-23f1-4f4a-a719-1805425584d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:39.467886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e079d6-23f1-4f4a-a719-1805425584d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:39.470296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e079d6-23f1-4f4a-a719-1805425584d4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:39.495069 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2353/4685] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:39.499332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22ff2-3ca2-4386-8a7e-5adb49d6db76 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:39.518768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d22ff2-3ca2-4386-8a7e-5adb49d6db76 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:39.526505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216697d-7762-475a-a85b-747c6cfee828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:39.527444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216697d-7762-475a-a85b-747c6cfee828 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:39.527598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216697d-7762-475a-a85b-747c6cfee828 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:39.527949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216697d-7762-475a-a85b-747c6cfee828 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:39.529056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216697d-7762-475a-a85b-747c6cfee828 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:39.530265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216697d-7762-475a-a85b-747c6cfee828 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:39.560863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e079d6-23f1-4f4a-a719-1805425584d4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:39.562453 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2333/4686] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:39 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:39.585704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e079d6-23f1-4f4a-a719-1805425584d4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:39.613545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129aa872-ada7-4d72-adfa-1c78bea37963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:39.614471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129aa872-ada7-4d72-adfa-1c78bea37963 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:39.616761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129aa872-ada7-4d72-adfa-1c78bea37963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:39.618029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129aa872-ada7-4d72-adfa-1c78bea37963 admin admin] PATH_INFO: `/v3/projects/017657cdaa56458ebb093091f50eb72c/users/1430b6e0e5174d0bb15dd5ce0e89a581/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:39.658768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129aa872-ada7-4d72-adfa-1c78bea37963 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017657cdaa56458ebb093091f50eb72c, user_id=1430b6e0e5174d0bb15dd5ce0e89a581, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:39.662217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129aa872-ada7-4d72-adfa-1c78bea37963 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:39.693371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216697d-7762-475a-a85b-747c6cfee828 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:39.695276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7216697d-7762-475a-a85b-747c6cfee828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:39.702016 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2354/4687] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:39 2022] PUT /identity/v3/projects/017657cdaa56458ebb093091f50eb72c/users/1430b6e0e5174d0bb15dd5ce0e89a581/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:39.712523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eed779-12b3-49d1-b900-7786d73e93af None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:39.713070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eed779-12b3-49d1-b900-7786d73e93af None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:39.713625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eed779-12b3-49d1-b900-7786d73e93af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:39.723815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216697d-7762-475a-a85b-747c6cfee828 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:39.802653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-11eed779-12b3-49d1-b900-7786d73e93af None None] MFA Rules not processed for user `1430b6e0e5174d0bb15dd5ce0e89a581`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:39.810811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-11eed779-12b3-49d1-b900-7786d73e93af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:39.860093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:39.860804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:39.861093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:39.861403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] PATH_INFO: `/v3/projects/1b0b3296e1e14daabb6fa2cc06645cf3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:39.869173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b0b3296e1e14daabb6fa2cc06645cf3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:39.875215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:39.942646 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:40.010847 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2355/4688] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:40.012408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eed779-12b3-49d1-b900-7786d73e93af None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:40.013425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b0b3296e1e14daabb6fa2cc06645cf3', 'request_id': 'req-42c213bb-a292-41c2-abc5-752b29814ba0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.024338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b0b3296e1e14daabb6fa2cc06645cf3', 'request_id': 'req-42c213bb-a292-41c2-abc5-752b29814ba0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.036087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b0b3296e1e14daabb6fa2cc06645cf3', 'request_id': 'req-42c213bb-a292-41c2-abc5-752b29814ba0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.037623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eed779-12b3-49d1-b900-7786d73e93af None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:40.097199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] The token cache is being invalidate because project 1b0b3296e1e14daabb6fa2cc06645cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:40.099185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.101767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.109056 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2334/4689] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:39 2022] DELETE /identity/v3/projects/1b0b3296e1e14daabb6fa2cc06645cf3 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:40.111047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:40.116091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:40.193527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83eab1-9b5b-4b43-9030-0d588f03b4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:40.194664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83eab1-9b5b-4b43-9030-0d588f03b4ad admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:40.196000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83eab1-9b5b-4b43-9030-0d588f03b4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:40.196448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d83eab1-9b5b-4b43-9030-0d588f03b4ad admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:40.197277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83eab1-9b5b-4b43-9030-0d588f03b4ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:40.199454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d83eab1-9b5b-4b43-9030-0d588f03b4ad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:40.247286 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2356/4690] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:40 2022] POST /identity/v3/projects => generated 373 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:40.248544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83eab1-9b5b-4b43-9030-0d588f03b4ad admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:40.250499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5d83eab1-9b5b-4b43-9030-0d588f03b4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:40.264336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c213bb-a292-41c2-abc5-752b29814ba0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:40.286087 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:40.358982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d83eab1-9b5b-4b43-9030-0d588f03b4ad admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:40.378273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707fa20-5ead-4f58-bc1e-d1c5865622ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:40.379393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707fa20-5ead-4f58-bc1e-d1c5865622ff admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:40.379859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707fa20-5ead-4f58-bc1e-d1c5865622ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:40.380302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707fa20-5ead-4f58-bc1e-d1c5865622ff admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:40.381397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707fa20-5ead-4f58-bc1e-d1c5865622ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:40.384406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707fa20-5ead-4f58-bc1e-d1c5865622ff admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:40.417621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:40.418350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:40.420955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:40.421262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] PATH_INFO: `/v3/users/b19007f809614dc0a0b81235d0d2d34a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:40.424371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b19007f809614dc0a0b81235d0d2d34a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:40.431344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:40.440955 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2357/4691] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:40 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:40.446199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707fa20-5ead-4f58-bc1e-d1c5865622ff admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:40.466819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707fa20-5ead-4f58-bc1e-d1c5865622ff admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:40.483110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd9d2-0051-48c7-9b20-8429cec1d067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:40.484281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd9d2-0051-48c7-9b20-8429cec1d067 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:40.484675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd9d2-0051-48c7-9b20-8429cec1d067 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:40.485541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdfd9d2-0051-48c7-9b20-8429cec1d067 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:40.486336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfd9d2-0051-48c7-9b20-8429cec1d067 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:40.488276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecdfd9d2-0051-48c7-9b20-8429cec1d067 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:40.512054 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2358/4692] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:40.513455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd9d2-0051-48c7-9b20-8429cec1d067 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:40.524426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b19007f809614dc0a0b81235d0d2d34a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.529013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdfd9d2-0051-48c7-9b20-8429cec1d067 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:40.536530 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:40.537655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bbad8-8a12-48be-a124-6cec8a4eeb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:40.539430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bbad8-8a12-48be-a124-6cec8a4eeb7a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:40.539787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bbad8-8a12-48be-a124-6cec8a4eeb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:40.540133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39bbad8-8a12-48be-a124-6cec8a4eeb7a admin admin] PATH_INFO: `/v3/projects/5ac70cb794e84f0c8980d703b1ba2b70/users/6d9473e394f8446f84b2ae570a811945/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:40.548413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b19007f809614dc0a0b81235d0d2d34a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.550229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b19007f809614dc0a0b81235d0d2d34a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.603785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bbad8-8a12-48be-a124-6cec8a4eeb7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac70cb794e84f0c8980d703b1ba2b70, user_id=6d9473e394f8446f84b2ae570a811945, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:40.606611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39bbad8-8a12-48be-a124-6cec8a4eeb7a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:40.607513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b19007f809614dc0a0b81235d0d2d34a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.633228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b19007f809614dc0a0b81235d0d2d34a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:40.640575 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2359/4693] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:40 2022] PUT /identity/v3/projects/5ac70cb794e84f0c8980d703b1ba2b70/users/6d9473e394f8446f84b2ae570a811945/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:40.642509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bbad8-8a12-48be-a124-6cec8a4eeb7a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:40.644376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c39bbad8-8a12-48be-a124-6cec8a4eeb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:40.648415 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2335/4694] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:40 2022] DELETE /identity/v3/users/b19007f809614dc0a0b81235d0d2d34a => generated 0 bytes in 537 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:40.771139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39bbad8-8a12-48be-a124-6cec8a4eeb7a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:40.873070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b925d33-a511-41d6-b8af-3fc72952ab50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:40.873772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925d33-a511-41d6-b8af-3fc72952ab50 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:40.874064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925d33-a511-41d6-b8af-3fc72952ab50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:40.874327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b925d33-a511-41d6-b8af-3fc72952ab50 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:40.874993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b925d33-a511-41d6-b8af-3fc72952ab50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:40.877374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b925d33-a511-41d6-b8af-3fc72952ab50 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:40.890756 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2360/4695] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:40.895524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:40.908175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de91a78-19a7-4451-a0f5-2f0f7cea63b1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:40.914835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faadac-4b91-4334-88e3-e4fc77c0281f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:40.915916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faadac-4b91-4334-88e3-e4fc77c0281f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:40.919173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faadac-4b91-4334-88e3-e4fc77c0281f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:40.919173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49faadac-4b91-4334-88e3-e4fc77c0281f admin admin] PATH_INFO: `/v3/projects/5ac70cb794e84f0c8980d703b1ba2b70/users/6d9473e394f8446f84b2ae570a811945/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:40.919597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49faadac-4b91-4334-88e3-e4fc77c0281f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ac70cb794e84f0c8980d703b1ba2b70, user_id=6d9473e394f8446f84b2ae570a811945, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:40.922694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49faadac-4b91-4334-88e3-e4fc77c0281f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:40.949623 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2336/4696] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:40 2022] PUT /identity/v3/projects/5ac70cb794e84f0c8980d703b1ba2b70/users/6d9473e394f8446f84b2ae570a811945/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:40.950917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d82668-e208-46cf-8553-435d3055ee7d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:40.951209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d82668-e208-46cf-8553-435d3055ee7d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:40.951483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d82668-e208-46cf-8553-435d3055ee7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:40.995654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e4d82668-e208-46cf-8553-435d3055ee7d None None] MFA Rules not processed for user `6d9473e394f8446f84b2ae570a811945`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:40.997270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4d82668-e208-46cf-8553-435d3055ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:41.003645 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:41.095415 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2361/4697] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:40 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:41.102770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faadac-4b91-4334-88e3-e4fc77c0281f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:41.104881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-49faadac-4b91-4334-88e3-e4fc77c0281f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:41.194350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49faadac-4b91-4334-88e3-e4fc77c0281f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:41.198250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86100973-78b4-4f7e-882b-645512ba1c98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:41.198867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86100973-78b4-4f7e-882b-645512ba1c98 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:41.199146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86100973-78b4-4f7e-882b-645512ba1c98 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:41.199419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86100973-78b4-4f7e-882b-645512ba1c98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:41.211225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86100973-78b4-4f7e-882b-645512ba1c98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:41.212860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86100973-78b4-4f7e-882b-645512ba1c98 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:41.224228 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2337/4698] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:41 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:41.310001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d82668-e208-46cf-8553-435d3055ee7d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:41.311871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4d82668-e208-46cf-8553-435d3055ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:41.440478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d82668-e208-46cf-8553-435d3055ee7d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:41.446506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:41.447338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:41.447694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:41.453932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] PATH_INFO: `/v3/projects/c5a90d3cc7e24db2b6ba936b8ec6bbae` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:41.455505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a90d3cc7e24db2b6ba936b8ec6bbae)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:41.458117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:41.537244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a90d3cc7e24db2b6ba936b8ec6bbae', 'request_id': 'req-c2e8a98a-cdf4-482c-8574-d803ad67dca3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:41.549259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a90d3cc7e24db2b6ba936b8ec6bbae', 'request_id': 'req-c2e8a98a-cdf4-482c-8574-d803ad67dca3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:41.565323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a90d3cc7e24db2b6ba936b8ec6bbae', 'request_id': 'req-c2e8a98a-cdf4-482c-8574-d803ad67dca3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:41.573964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] The token cache is being invalidate because project c5a90d3cc7e24db2b6ba936b8ec6bbae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:41.573964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:41.576110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2e8a98a-cdf4-482c-8574-d803ad67dca3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:41.578931 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2362/4699] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:41 2022] DELETE /identity/v3/projects/c5a90d3cc7e24db2b6ba936b8ec6bbae => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:41.584069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdec8c4-389c-42dc-9ea8-a79aadccbbc4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:41.584612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdec8c4-389c-42dc-9ea8-a79aadccbbc4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:41.584612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdec8c4-389c-42dc-9ea8-a79aadccbbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:41.615364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6cdec8c4-389c-42dc-9ea8-a79aadccbbc4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:41.616953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6cdec8c4-389c-42dc-9ea8-a79aadccbbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:41.717257 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2338/4700] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:41.726307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04481cdb-a2cc-4c67-b422-eb5eff549b38 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:41.728103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04481cdb-a2cc-4c67-b422-eb5eff549b38 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:41.728548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04481cdb-a2cc-4c67-b422-eb5eff549b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:41.769448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-04481cdb-a2cc-4c67-b422-eb5eff549b38 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:41.770704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-04481cdb-a2cc-4c67-b422-eb5eff549b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:41.795312 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2363/4701] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:41.796595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdec8c4-389c-42dc-9ea8-a79aadccbbc4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:41.814314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdec8c4-389c-42dc-9ea8-a79aadccbbc4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:41.839883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dff21-f32e-4e54-93be-ea7de1f1b071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:41.840971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dff21-f32e-4e54-93be-ea7de1f1b071 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:41.841363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dff21-f32e-4e54-93be-ea7de1f1b071 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:41.841782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dff21-f32e-4e54-93be-ea7de1f1b071 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:41.844179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dff21-f32e-4e54-93be-ea7de1f1b071 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:41.845571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dff21-f32e-4e54-93be-ea7de1f1b071 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:41.847329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04481cdb-a2cc-4c67-b422-eb5eff549b38 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:41.852648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-04481cdb-a2cc-4c67-b422-eb5eff549b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:41.855151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dff21-f32e-4e54-93be-ea7de1f1b071 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:41.868270 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2339/4702] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:41.873057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dff21-f32e-4e54-93be-ea7de1f1b071 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:41.877125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04481cdb-a2cc-4c67-b422-eb5eff549b38 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:41.882992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:41.883718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:41.884602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:41.884718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dff21-f32e-4e54-93be-ea7de1f1b071 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:41.884913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] PATH_INFO: `/v3/users/1430b6e0e5174d0bb15dd5ce0e89a581` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:41.886218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1430b6e0e5174d0bb15dd5ce0e89a581)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:41.888361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:41.889999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08908551-888e-426b-9f7e-97684a469156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:41.891222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08908551-888e-426b-9f7e-97684a469156 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:41.891222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08908551-888e-426b-9f7e-97684a469156 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:41.891222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08908551-888e-426b-9f7e-97684a469156 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:41.892323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08908551-888e-426b-9f7e-97684a469156 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:41.894443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08908551-888e-426b-9f7e-97684a469156 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:41.915737 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:41.925015 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2340/4703] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:41 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:41.929614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08908551-888e-426b-9f7e-97684a469156 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:41.958557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1430b6e0e5174d0bb15dd5ce0e89a581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:41.967381 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:41.979924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1430b6e0e5174d0bb15dd5ce0e89a581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:41.980832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1430b6e0e5174d0bb15dd5ce0e89a581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:41.993164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1430b6e0e5174d0bb15dd5ce0e89a581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:42.004564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d04bdeb-5a95-436c-9210-f99fd10d5249 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1430b6e0e5174d0bb15dd5ce0e89a581'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:42.010815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08908551-888e-426b-9f7e-97684a469156 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:42.012419 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2364/4704] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:41 2022] DELETE /identity/v3/users/1430b6e0e5174d0bb15dd5ce0e89a581 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:42.017424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2383369-ec14-43ed-9f0b-4b9f6ae4ad92 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:42.018250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2383369-ec14-43ed-9f0b-4b9f6ae4ad92 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:42.018250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2383369-ec14-43ed-9f0b-4b9f6ae4ad92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:42.037831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e2383369-ec14-43ed-9f0b-4b9f6ae4ad92 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:42.039186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e2383369-ec14-43ed-9f0b-4b9f6ae4ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:42.100206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bb676-82e4-4f97-a591-53baa4a5bca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:42.100834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bb676-82e4-4f97-a591-53baa4a5bca0 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:42.101277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bb676-82e4-4f97-a591-53baa4a5bca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:42.101861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1bb676-82e4-4f97-a591-53baa4a5bca0 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:42.102513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bb676-82e4-4f97-a591-53baa4a5bca0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:42.104954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1bb676-82e4-4f97-a591-53baa4a5bca0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:42.127525 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2365/4705] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:42.137719 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2341/4706] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:41 2022] POST /identity/v3/users => generated 287 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:42.137927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2383369-ec14-43ed-9f0b-4b9f6ae4ad92 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:42.139311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e2383369-ec14-43ed-9f0b-4b9f6ae4ad92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:42.142813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bb676-82e4-4f97-a591-53baa4a5bca0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:42.144894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0a1bb676-82e4-4f97-a591-53baa4a5bca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:42.157935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1bb676-82e4-4f97-a591-53baa4a5bca0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:42.163116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85c67-7ce9-4199-ac09-d8e1bdb25466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:42.163726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85c67-7ce9-4199-ac09-d8e1bdb25466 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:42.164005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85c67-7ce9-4199-ac09-d8e1bdb25466 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:42.164305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d85c67-7ce9-4199-ac09-d8e1bdb25466 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:42.164941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d85c67-7ce9-4199-ac09-d8e1bdb25466 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:42.166592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d85c67-7ce9-4199-ac09-d8e1bdb25466 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:42.177122 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2342/4707] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:15:42.180916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85c67-7ce9-4199-ac09-d8e1bdb25466 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:42.193456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d85c67-7ce9-4199-ac09-d8e1bdb25466 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:42.198393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e715c0-7bd4-4906-ac57-7360465b8fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:42.199537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e715c0-7bd4-4906-ac57-7360465b8fe7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:42.199537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e715c0-7bd4-4906-ac57-7360465b8fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:42.199742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e715c0-7bd4-4906-ac57-7360465b8fe7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:42.200586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e715c0-7bd4-4906-ac57-7360465b8fe7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:42.202252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e715c0-7bd4-4906-ac57-7360465b8fe7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:42.220394 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2343/4708] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:15:42.221765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e715c0-7bd4-4906-ac57-7360465b8fe7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:42.225979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2383369-ec14-43ed-9f0b-4b9f6ae4ad92 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:42.233101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5af0ab3-76ed-499a-87f3-296780b17932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:42.233604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af0ab3-76ed-499a-87f3-296780b17932 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:42.233792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e715c0-7bd4-4906-ac57-7360465b8fe7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:42.233917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af0ab3-76ed-499a-87f3-296780b17932 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:42.234106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5af0ab3-76ed-499a-87f3-296780b17932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:42.240788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6aa7-94df-469d-819b-e95107688b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:42.241541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6aa7-94df-469d-819b-e95107688b6c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:42.242100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6aa7-94df-469d-819b-e95107688b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:42.242384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c6aa7-94df-469d-819b-e95107688b6c admin admin] PATH_INFO: `/v3/projects/18457e5a700d42d3a801bf6c0aac9012/users/ad4971882991469488f51d0af1dc470f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:42.249558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af0ab3-76ed-499a-87f3-296780b17932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:42.253398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5af0ab3-76ed-499a-87f3-296780b17932 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:42.261858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c6aa7-94df-469d-819b-e95107688b6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=18457e5a700d42d3a801bf6c0aac9012, user_id=ad4971882991469488f51d0af1dc470f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:42.265035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011c6aa7-94df-469d-819b-e95107688b6c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:42.265871 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2366/4709] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:15:42.286375 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2344/4710] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:42 2022] PUT /identity/v3/projects/18457e5a700d42d3a801bf6c0aac9012/users/ad4971882991469488f51d0af1dc470f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:42.299150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9398e7-d293-44b5-b29d-4f30d3926804 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:42.299706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9398e7-d293-44b5-b29d-4f30d3926804 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:42.300483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9398e7-d293-44b5-b29d-4f30d3926804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:42.341552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8c9398e7-d293-44b5-b29d-4f30d3926804 None None] MFA Rules not processed for user `ad4971882991469488f51d0af1dc470f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:42.343253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8c9398e7-d293-44b5-b29d-4f30d3926804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:42.431931 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:42.527748 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2367/4711] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:42.546166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6aa7-94df-469d-819b-e95107688b6c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:42.551689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-011c6aa7-94df-469d-819b-e95107688b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:42.743546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c6aa7-94df-469d-819b-e95107688b6c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:42.769274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c714524-b882-4116-bb6e-b8f2343b2083 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:42.769944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c714524-b882-4116-bb6e-b8f2343b2083 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:42.770216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c714524-b882-4116-bb6e-b8f2343b2083 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:42.770490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c714524-b882-4116-bb6e-b8f2343b2083 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:42.804166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c714524-b882-4116-bb6e-b8f2343b2083 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:42.805671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c714524-b882-4116-bb6e-b8f2343b2083 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:42.813387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9398e7-d293-44b5-b29d-4f30d3926804 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:42.816607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8c9398e7-d293-44b5-b29d-4f30d3926804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:42.836477 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2345/4712] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:42.979032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9398e7-d293-44b5-b29d-4f30d3926804 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:42.990734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:42.995047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:42.995347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:42.995635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] PATH_INFO: `/v3/projects/017657cdaa56458ebb093091f50eb72c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:42.999061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017657cdaa56458ebb093091f50eb72c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:43.005401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:43.116575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017657cdaa56458ebb093091f50eb72c', 'request_id': 'req-37ac4b58-e430-43cc-8079-b9ef69d8d436'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.145721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017657cdaa56458ebb093091f50eb72c', 'request_id': 'req-37ac4b58-e430-43cc-8079-b9ef69d8d436'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.160557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017657cdaa56458ebb093091f50eb72c', 'request_id': 'req-37ac4b58-e430-43cc-8079-b9ef69d8d436'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.176102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] The token cache is being invalidate because project 017657cdaa56458ebb093091f50eb72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:43.176518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.177610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.183939 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2368/4713] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:42 2022] DELETE /identity/v3/projects/017657cdaa56458ebb093091f50eb72c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:43.184365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c714524-b882-4116-bb6e-b8f2343b2083 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:43.200728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c714524-b882-4116-bb6e-b8f2343b2083 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:43.238028 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:43.348101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:43.348750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:43.349029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:43.349751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] PATH_INFO: `/v3/users/6d9473e394f8446f84b2ae570a811945` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:43.351617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d9473e394f8446f84b2ae570a811945)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:43.353681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:43.449819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d9473e394f8446f84b2ae570a811945'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.471981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d9473e394f8446f84b2ae570a811945'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.472950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d9473e394f8446f84b2ae570a811945'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.493512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d9473e394f8446f84b2ae570a811945'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.505426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-94602a7e-df9b-4d65-aacc-37f9cea1b620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d9473e394f8446f84b2ae570a811945'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:43.513477 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2346/4714] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:43 2022] DELETE /identity/v3/users/6d9473e394f8446f84b2ae570a811945 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:15:44.116080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:44.117798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:44.141234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac4b58-e430-43cc-8079-b9ef69d8d436 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:44.256445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:44.256885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:44.257253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:44.257621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] PATH_INFO: `/v3/projects/5ac70cb794e84f0c8980d703b1ba2b70` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:44.259573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ac70cb794e84f0c8980d703b1ba2b70)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:44.263617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:44.268118 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:44.357161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ac70cb794e84f0c8980d703b1ba2b70', 'request_id': 'req-506f12f0-b166-42f0-ab4e-65c687d97d2a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:44.375057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ac70cb794e84f0c8980d703b1ba2b70', 'request_id': 'req-506f12f0-b166-42f0-ab4e-65c687d97d2a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:44.390999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ac70cb794e84f0c8980d703b1ba2b70', 'request_id': 'req-506f12f0-b166-42f0-ab4e-65c687d97d2a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:44.411359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] The token cache is being invalidate because project 5ac70cb794e84f0c8980d703b1ba2b70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:44.411776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:44.412568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-506f12f0-b166-42f0-ab4e-65c687d97d2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:44.417346 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2369/4715] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:44 2022] DELETE /identity/v3/projects/5ac70cb794e84f0c8980d703b1ba2b70 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:44.419747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead7d70-6fb3-4875-9dab-94576a33caa6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:44.420260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead7d70-6fb3-4875-9dab-94576a33caa6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:44.420353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead7d70-6fb3-4875-9dab-94576a33caa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:44.460692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cead7d70-6fb3-4875-9dab-94576a33caa6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:44.461955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cead7d70-6fb3-4875-9dab-94576a33caa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:44.632672 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2347/4716] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:44.642515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f10d7-4c9e-4c5b-bb38-4eb52efcba1f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:44.643154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f10d7-4c9e-4c5b-bb38-4eb52efcba1f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:44.643658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f10d7-4c9e-4c5b-bb38-4eb52efcba1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:44.680827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-193f10d7-4c9e-4c5b-bb38-4eb52efcba1f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:44.682900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-193f10d7-4c9e-4c5b-bb38-4eb52efcba1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:44.719733 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2370/4717] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:44.726143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead7d70-6fb3-4875-9dab-94576a33caa6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:44.758308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead7d70-6fb3-4875-9dab-94576a33caa6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:44.784198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af42d0-f2d3-45c3-9c49-c178e656f8a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:44.785367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af42d0-f2d3-45c3-9c49-c178e656f8a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:44.785765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af42d0-f2d3-45c3-9c49-c178e656f8a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:44.786170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af42d0-f2d3-45c3-9c49-c178e656f8a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:44.788689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af42d0-f2d3-45c3-9c49-c178e656f8a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:44.789081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af42d0-f2d3-45c3-9c49-c178e656f8a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:44.790941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af42d0-f2d3-45c3-9c49-c178e656f8a1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:44.811271 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2348/4718] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:44.812451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f10d7-4c9e-4c5b-bb38-4eb52efcba1f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:44.824890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f10d7-4c9e-4c5b-bb38-4eb52efcba1f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:44.830730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d503c21-b988-4ab6-b6dc-2c7206162700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:44.831351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d503c21-b988-4ab6-b6dc-2c7206162700 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:44.831629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d503c21-b988-4ab6-b6dc-2c7206162700 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:44.831903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d503c21-b988-4ab6-b6dc-2c7206162700 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:44.833446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d503c21-b988-4ab6-b6dc-2c7206162700 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:44.835383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d503c21-b988-4ab6-b6dc-2c7206162700 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:44.887917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af42d0-f2d3-45c3-9c49-c178e656f8a1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:44.897403 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2371/4719] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:44 2022] POST /identity/v3/projects => generated 383 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:44.903079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af42d0-f2d3-45c3-9c49-c178e656f8a1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:44.942931 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:45.052191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173004d-2f4e-4701-813d-41c0a05c475c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:45.052804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173004d-2f4e-4701-813d-41c0a05c475c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:45.053094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173004d-2f4e-4701-813d-41c0a05c475c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:45.053400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1173004d-2f4e-4701-813d-41c0a05c475c admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:45.054658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173004d-2f4e-4701-813d-41c0a05c475c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:45.057618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1173004d-2f4e-4701-813d-41c0a05c475c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:45.104528 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2349/4720] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:44 2022] POST /identity/v3/users => generated 292 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:45.108650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d503c21-b988-4ab6-b6dc-2c7206162700 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:45.121708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d503c21-b988-4ab6-b6dc-2c7206162700 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:45.136829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9ab8aa-60ca-42e4-9aef-7900504119dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:45.137742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab8aa-60ca-42e4-9aef-7900504119dc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:45.138217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab8aa-60ca-42e4-9aef-7900504119dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:45.138656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9ab8aa-60ca-42e4-9aef-7900504119dc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:45.139466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ab8aa-60ca-42e4-9aef-7900504119dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:45.141248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9ab8aa-60ca-42e4-9aef-7900504119dc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:45.162777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173004d-2f4e-4701-813d-41c0a05c475c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:45.163050 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2372/4721] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:45.176003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1173004d-2f4e-4701-813d-41c0a05c475c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:45.191264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d002-5bf1-48e0-bc97-67cbe17d7d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:45.191886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d002-5bf1-48e0-bc97-67cbe17d7d3f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:45.192158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d002-5bf1-48e0-bc97-67cbe17d7d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:45.192536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5324d002-5bf1-48e0-bc97-67cbe17d7d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:45.193071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d002-5bf1-48e0-bc97-67cbe17d7d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:45.194718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5324d002-5bf1-48e0-bc97-67cbe17d7d3f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:45.211904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced436-525f-4e5c-9c7c-c26db2efa7d4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:45.212189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced436-525f-4e5c-9c7c-c26db2efa7d4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:45.212525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbced436-525f-4e5c-9c7c-c26db2efa7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:45.239649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2350/4722] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:45.243808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d002-5bf1-48e0-bc97-67cbe17d7d3f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:45.247239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dbced436-525f-4e5c-9c7c-c26db2efa7d4 None None] MFA Rules not processed for user `b1ae9fcca02548dfa6e29d2787288e49`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:45.249865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dbced436-525f-4e5c-9c7c-c26db2efa7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:45.264452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5324d002-5bf1-48e0-bc97-67cbe17d7d3f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:45.270660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedccc9b-5c61-4f7d-96a2-91dfe8d2dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:45.271602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedccc9b-5c61-4f7d-96a2-91dfe8d2dc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:45.272119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedccc9b-5c61-4f7d-96a2-91dfe8d2dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:45.272576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedccc9b-5c61-4f7d-96a2-91dfe8d2dc10 admin admin] PATH_INFO: `/v3/projects/ca25b8c67d5d4f9f9258039b17e5197d/users/bcaf1ae42fc54cdbb32efa43c64aceef/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:45.323972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedccc9b-5c61-4f7d-96a2-91dfe8d2dc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca25b8c67d5d4f9f9258039b17e5197d, user_id=bcaf1ae42fc54cdbb32efa43c64aceef, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:45.332574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedccc9b-5c61-4f7d-96a2-91dfe8d2dc10 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:45.379889 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2351/4723] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:45 2022] PUT /identity/v3/projects/ca25b8c67d5d4f9f9258039b17e5197d/users/bcaf1ae42fc54cdbb32efa43c64aceef/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:45.388990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f03c-ccc6-45ee-acc4-ccf4aecb89a6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:45.389236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f03c-ccc6-45ee-acc4-ccf4aecb89a6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:45.389564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6366f03c-ccc6-45ee-acc4-ccf4aecb89a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:45.420465 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2373/4724] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:45.469044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6366f03c-ccc6-45ee-acc4-ccf4aecb89a6 None None] MFA Rules not processed for user `bcaf1ae42fc54cdbb32efa43c64aceef`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:45.471437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6366f03c-ccc6-45ee-acc4-ccf4aecb89a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:45.630117 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2352/4725] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:45.636024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced436-525f-4e5c-9c7c-c26db2efa7d4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:45.654767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbced436-525f-4e5c-9c7c-c26db2efa7d4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:45.764935 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:45.782644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98a1ff-3e9f-4a69-b71a-26865331d65e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:45.783727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98a1ff-3e9f-4a69-b71a-26865331d65e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:45.784092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98a1ff-3e9f-4a69-b71a-26865331d65e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:45.784439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a98a1ff-3e9f-4a69-b71a-26865331d65e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:45.785434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98a1ff-3e9f-4a69-b71a-26865331d65e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:45.790286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a98a1ff-3e9f-4a69-b71a-26865331d65e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:45.863021 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2374/4726] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:45 2022] POST /identity/v3/projects => generated 383 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:45.867841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f03c-ccc6-45ee-acc4-ccf4aecb89a6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:45.881471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6366f03c-ccc6-45ee-acc4-ccf4aecb89a6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:46.000556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7473c-0e31-4878-9ccd-d7fe2f7493df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:46.002326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7473c-0e31-4878-9ccd-d7fe2f7493df admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:46.002526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7473c-0e31-4878-9ccd-d7fe2f7493df admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:46.004050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7473c-0e31-4878-9ccd-d7fe2f7493df admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:46.005508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7473c-0e31-4878-9ccd-d7fe2f7493df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:46.008329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad7473c-0e31-4878-9ccd-d7fe2f7493df admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:46.045414 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2353/4727] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:45 2022] POST /identity/v3/users => generated 298 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:46.049840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98a1ff-3e9f-4a69-b71a-26865331d65e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:46.077542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a98a1ff-3e9f-4a69-b71a-26865331d65e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:46.082517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7e428-8c9f-486a-9e97-7396cec2bfb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:46.083183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7e428-8c9f-486a-9e97-7396cec2bfb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:46.083470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7e428-8c9f-486a-9e97-7396cec2bfb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:46.083747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df7e428-8c9f-486a-9e97-7396cec2bfb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:46.084819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7e428-8c9f-486a-9e97-7396cec2bfb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:46.086615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df7e428-8c9f-486a-9e97-7396cec2bfb8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:46.105377 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2375/4728] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:46.110813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7473c-0e31-4878-9ccd-d7fe2f7493df admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:46.117345 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:46.124724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7473c-0e31-4878-9ccd-d7fe2f7493df admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:46.156615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9646660-08f0-45c5-b94a-86b30e120c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:46.157698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646660-08f0-45c5-b94a-86b30e120c0c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:46.157982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646660-08f0-45c5-b94a-86b30e120c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:46.158256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9646660-08f0-45c5-b94a-86b30e120c0c admin admin] PATH_INFO: `/v3/projects/c4659ec4607d4aae893c1223f0484c85/users/5ae2aeaa3f0746fb9e87351c91bb19db/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:46.203467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9646660-08f0-45c5-b94a-86b30e120c0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4659ec4607d4aae893c1223f0484c85, user_id=5ae2aeaa3f0746fb9e87351c91bb19db, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:46.206678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9646660-08f0-45c5-b94a-86b30e120c0c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:46.234352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7e428-8c9f-486a-9e97-7396cec2bfb8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:46.240277 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2354/4729] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:46 2022] PUT /identity/v3/projects/c4659ec4607d4aae893c1223f0484c85/users/5ae2aeaa3f0746fb9e87351c91bb19db/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:46.246757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df7e428-8c9f-486a-9e97-7396cec2bfb8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:46.412442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6927f60-c346-4e16-a8f1-6f92c6ccb906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:46.413073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6927f60-c346-4e16-a8f1-6f92c6ccb906 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:46.413431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6927f60-c346-4e16-a8f1-6f92c6ccb906 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:46.413712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6927f60-c346-4e16-a8f1-6f92c6ccb906 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:46.414468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6927f60-c346-4e16-a8f1-6f92c6ccb906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:46.418851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6927f60-c346-4e16-a8f1-6f92c6ccb906 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:46.449756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9646660-08f0-45c5-b94a-86b30e120c0c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:46.450120 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2376/4730] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:46.472983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9646660-08f0-45c5-b94a-86b30e120c0c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:46.496294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a806b-544a-454b-ae28-19f28ad0ac00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:46.502175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a806b-544a-454b-ae28-19f28ad0ac00 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:46.502456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a806b-544a-454b-ae28-19f28ad0ac00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:46.502952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a806b-544a-454b-ae28-19f28ad0ac00 admin admin] PATH_INFO: `/v3/projects/c4659ec4607d4aae893c1223f0484c85/users/5ae2aeaa3f0746fb9e87351c91bb19db/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:46.510113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a806b-544a-454b-ae28-19f28ad0ac00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4659ec4607d4aae893c1223f0484c85, user_id=5ae2aeaa3f0746fb9e87351c91bb19db, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:46.513893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a806b-544a-454b-ae28-19f28ad0ac00 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:46.569505 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2355/4731] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:46 2022] PUT /identity/v3/projects/c4659ec4607d4aae893c1223f0484c85/users/5ae2aeaa3f0746fb9e87351c91bb19db/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:46.574617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7290-ca58-4803-bf8b-9d79c8bfa2db None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:46.575501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7290-ca58-4803-bf8b-9d79c8bfa2db None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:46.576600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ac7290-ca58-4803-bf8b-9d79c8bfa2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:46.692926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d6ac7290-ca58-4803-bf8b-9d79c8bfa2db None None] MFA Rules not processed for user `5ae2aeaa3f0746fb9e87351c91bb19db`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:46.699199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d6ac7290-ca58-4803-bf8b-9d79c8bfa2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:46.782487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aba3d-df1b-44d7-969e-d404ff2d227f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:46.783005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aba3d-df1b-44d7-969e-d404ff2d227f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:46.783468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389aba3d-df1b-44d7-969e-d404ff2d227f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:46.804006 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2377/4732] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:46 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:46.867358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-389aba3d-df1b-44d7-969e-d404ff2d227f None None] MFA Rules not processed for user `b2755c3ea93440999d287890d328ecd6`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:46.881730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-389aba3d-df1b-44d7-969e-d404ff2d227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:46.920468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac7290-ca58-4803-bf8b-9d79c8bfa2db None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:46.923989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d6ac7290-ca58-4803-bf8b-9d79c8bfa2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:47.027019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ac7290-ca58-4803-bf8b-9d79c8bfa2db None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:47.031147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c1542-3851-4369-8e76-c5eee4b2b543 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:47.032050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1542-3851-4369-8e76-c5eee4b2b543 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:47.033056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1542-3851-4369-8e76-c5eee4b2b543 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:47.033594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c1542-3851-4369-8e76-c5eee4b2b543 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:47.038770 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:47.120151 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2356/4733] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:46 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:47.144647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c1542-3851-4369-8e76-c5eee4b2b543 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:47.146662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c1542-3851-4369-8e76-c5eee4b2b543 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:47.166439 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2378/4734] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:47.215799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aba3d-df1b-44d7-969e-d404ff2d227f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:47.220722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-389aba3d-df1b-44d7-969e-d404ff2d227f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:47.372395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389aba3d-df1b-44d7-969e-d404ff2d227f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:47.379982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ad101-d170-4ee2-8592-c71a62f57822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:47.388129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad101-d170-4ee2-8592-c71a62f57822 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:47.396053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad101-d170-4ee2-8592-c71a62f57822 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:47.396488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3ad101-d170-4ee2-8592-c71a62f57822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:47.416144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ad101-d170-4ee2-8592-c71a62f57822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:47.419524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3ad101-d170-4ee2-8592-c71a62f57822 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:47.443434 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2357/4735] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:47 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:50.820815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b08942-af26-4742-b444-bb6c3880fb27 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:50.821308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b08942-af26-4742-b444-bb6c3880fb27 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:50.826534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b08942-af26-4742-b444-bb6c3880fb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:50.914930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-45b08942-af26-4742-b444-bb6c3880fb27 None None] MFA Rules not processed for user `b2755c3ea93440999d287890d328ecd6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:50.918652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-45b08942-af26-4742-b444-bb6c3880fb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:50.944397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2379/4736] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:50 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:51.644118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ad101-d170-4ee2-8592-c71a62f57822 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:51.645553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2e3ad101-d170-4ee2-8592-c71a62f57822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:51.766684 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:51.823852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3ad101-d170-4ee2-8592-c71a62f57822 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:51.837610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:51.843537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:51.845628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:51.845922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] PATH_INFO: `/v3/users/ad4971882991469488f51d0af1dc470f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:51.851616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad4971882991469488f51d0af1dc470f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:51.857090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:52.053337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad4971882991469488f51d0af1dc470f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:52.086286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad4971882991469488f51d0af1dc470f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:52.087218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad4971882991469488f51d0af1dc470f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:52.105078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad4971882991469488f51d0af1dc470f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:52.122157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad4971882991469488f51d0af1dc470f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:52.135572 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2358/4737] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:15:51 2022] DELETE /identity/v3/users/ad4971882991469488f51d0af1dc470f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:52.140613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db1d65-fbca-46d5-9c05-d02b67631f1a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:52.142497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db1d65-fbca-46d5-9c05-d02b67631f1a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:52.143247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19db1d65-fbca-46d5-9c05-d02b67631f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:52.179453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-19db1d65-fbca-46d5-9c05-d02b67631f1a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:52.181423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19db1d65-fbca-46d5-9c05-d02b67631f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:52.287428 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2380/4738] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:52.369096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:52.370574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:52.505511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828cfaab-7875-4a2e-82e5-eb215c4d905c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:52.510206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a3053-2c98-4d9a-9d19-f90df7d5d9a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:52.510826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a3053-2c98-4d9a-9d19-f90df7d5d9a9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:52.511155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a3053-2c98-4d9a-9d19-f90df7d5d9a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:52.511426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5a3053-2c98-4d9a-9d19-f90df7d5d9a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:52.525986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a3053-2c98-4d9a-9d19-f90df7d5d9a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:52.527634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5a3053-2c98-4d9a-9d19-f90df7d5d9a9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:52.559376 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2359/4739] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:53.065062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db1d65-fbca-46d5-9c05-d02b67631f1a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:53.067830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19db1d65-fbca-46d5-9c05-d02b67631f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:53.111599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19db1d65-fbca-46d5-9c05-d02b67631f1a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:53.131940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb55c1-a902-4c9d-a7d8-07d106aace3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:53.132573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb55c1-a902-4c9d-a7d8-07d106aace3a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:53.132861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb55c1-a902-4c9d-a7d8-07d106aace3a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:53.133138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb55c1-a902-4c9d-a7d8-07d106aace3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:53.136884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a2fb55c1-a902-4c9d-a7d8-07d106aace3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:53.314555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb55c1-a902-4c9d-a7d8-07d106aace3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:53.316174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb55c1-a902-4c9d-a7d8-07d106aace3a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:53.349984 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2381/4740] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:54.574718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a3053-2c98-4d9a-9d19-f90df7d5d9a9 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:54.576145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bc5a3053-2c98-4d9a-9d19-f90df7d5d9a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:54.596651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5a3053-2c98-4d9a-9d19-f90df7d5d9a9 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:54.616703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:54.618229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:54.618401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:54.618868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] PATH_INFO: `/v3/projects/18457e5a700d42d3a801bf6c0aac9012` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:54.620368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18457e5a700d42d3a801bf6c0aac9012)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:54.623226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:54.691375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18457e5a700d42d3a801bf6c0aac9012', 'request_id': 'req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:54.698811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18457e5a700d42d3a801bf6c0aac9012', 'request_id': 'req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:54.702568 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:54.712284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18457e5a700d42d3a801bf6c0aac9012', 'request_id': 'req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:54.728083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] The token cache is being invalidate because project 18457e5a700d42d3a801bf6c0aac9012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:15:54.729049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:54.729804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fac45cb4-df1f-4d5c-bcc3-d34db21ca214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:15:54.732236 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2360/4741] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:15:54 2022] DELETE /identity/v3/projects/18457e5a700d42d3a801bf6c0aac9012 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:54.737581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f9d9-43be-48b0-88d7-a68f15c95cf3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:54.738102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f9d9-43be-48b0-88d7-a68f15c95cf3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:54.738290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76f9d9-43be-48b0-88d7-a68f15c95cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:54.780718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2e76f9d9-43be-48b0-88d7-a68f15c95cf3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:54.783713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e76f9d9-43be-48b0-88d7-a68f15c95cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:54.833133 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:54.915480 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2382/4742] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:15:54.917381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164c3cb-edf5-4606-82e6-38a5056c1a2e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:54.917816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164c3cb-edf5-4606-82e6-38a5056c1a2e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:54.918160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164c3cb-edf5-4606-82e6-38a5056c1a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:54.930430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76f9d9-43be-48b0-88d7-a68f15c95cf3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:54.932148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e76f9d9-43be-48b0-88d7-a68f15c95cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:54.951647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b164c3cb-edf5-4606-82e6-38a5056c1a2e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:54.954721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b164c3cb-edf5-4606-82e6-38a5056c1a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:54.983640 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2361/4743] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:54.988083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164c3cb-edf5-4606-82e6-38a5056c1a2e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:54.991612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b164c3cb-edf5-4606-82e6-38a5056c1a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:55.080839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76f9d9-43be-48b0-88d7-a68f15c95cf3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:55.090999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f11e84-f0af-4ec0-b4fc-adb9dfffcda5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:55.091233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f11e84-f0af-4ec0-b4fc-adb9dfffcda5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:55.091527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f11e84-f0af-4ec0-b4fc-adb9dfffcda5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:55.094579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f11e84-f0af-4ec0-b4fc-adb9dfffcda5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:55.098575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-06f11e84-f0af-4ec0-b4fc-adb9dfffcda5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:55.173470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164c3cb-edf5-4606-82e6-38a5056c1a2e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:55.191192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f01b2e-7adf-4c5a-b253-dc861614e3b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:55.191832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01b2e-7adf-4c5a-b253-dc861614e3b9 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:55.192175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01b2e-7adf-4c5a-b253-dc861614e3b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:55.192399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f01b2e-7adf-4c5a-b253-dc861614e3b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:55.199659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-13f01b2e-7adf-4c5a-b253-dc861614e3b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:55.442354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f11e84-f0af-4ec0-b4fc-adb9dfffcda5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:55.445326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f11e84-f0af-4ec0-b4fc-adb9dfffcda5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:55.476246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f01b2e-7adf-4c5a-b253-dc861614e3b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:55.477757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f01b2e-7adf-4c5a-b253-dc861614e3b9 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:55.480066 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2383/4744] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:55.480985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f11e84-f0af-4ec0-b4fc-adb9dfffcda5 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:55.498541 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2362/4745] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:54 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:55.501993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f11e84-f0af-4ec0-b4fc-adb9dfffcda5 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:55.507276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8d315-4e7b-4790-83ff-137fd9ea21d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:55.507904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8d315-4e7b-4790-83ff-137fd9ea21d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:55.508189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8d315-4e7b-4790-83ff-137fd9ea21d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:55.508469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb8d315-4e7b-4790-83ff-137fd9ea21d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:55.509119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8d315-4e7b-4790-83ff-137fd9ea21d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:15:55.509451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8d315-4e7b-4790-83ff-137fd9ea21d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:55.511058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb8d315-4e7b-4790-83ff-137fd9ea21d8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:55.524278 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2384/4746] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:15:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:15:55.528672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f01b2e-7adf-4c5a-b253-dc861614e3b9 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:55.543477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f01b2e-7adf-4c5a-b253-dc861614e3b9 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:55.548689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a378ac-c883-4ef6-a776-52f1b04b9aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:55.549327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a378ac-c883-4ef6-a776-52f1b04b9aeb admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:55.549623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a378ac-c883-4ef6-a776-52f1b04b9aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:55.549901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a378ac-c883-4ef6-a776-52f1b04b9aeb admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:55.550553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a378ac-c883-4ef6-a776-52f1b04b9aeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:55.552664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a378ac-c883-4ef6-a776-52f1b04b9aeb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:55.593007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8d315-4e7b-4790-83ff-137fd9ea21d8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:55.609720 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2363/4747] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:55 2022] POST /identity/v3/projects => generated 383 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:55.614969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb8d315-4e7b-4790-83ff-137fd9ea21d8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:55.756240 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:55.767806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f554632-1201-453a-b1b7-9d28fb29431b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:55.768572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554632-1201-453a-b1b7-9d28fb29431b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:55.768971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554632-1201-453a-b1b7-9d28fb29431b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:55.769383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f554632-1201-453a-b1b7-9d28fb29431b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:55.770207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f554632-1201-453a-b1b7-9d28fb29431b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:55.772816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f554632-1201-453a-b1b7-9d28fb29431b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:55.807123 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2385/4748] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:55 2022] POST /identity/v3/users => generated 292 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:15:55.811046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a378ac-c883-4ef6-a776-52f1b04b9aeb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:55.826101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a378ac-c883-4ef6-a776-52f1b04b9aeb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:55.859583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccec86-66b0-4966-abb8-536669e5d97e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:55.862460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccec86-66b0-4966-abb8-536669e5d97e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:55.862940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccec86-66b0-4966-abb8-536669e5d97e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:55.863394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccec86-66b0-4966-abb8-536669e5d97e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:55.864269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccec86-66b0-4966-abb8-536669e5d97e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:55.866825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccec86-66b0-4966-abb8-536669e5d97e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:55.904752 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2364/4749] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:55.906473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f554632-1201-453a-b1b7-9d28fb29431b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:55.920495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f554632-1201-453a-b1b7-9d28fb29431b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:55.931060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f7708-a2ea-436d-b241-54c5656e376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:55.931458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7708-a2ea-436d-b241-54c5656e376d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:55.931753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7708-a2ea-436d-b241-54c5656e376d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:55.932057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f7708-a2ea-436d-b241-54c5656e376d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:55.932925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7708-a2ea-436d-b241-54c5656e376d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:55.941347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f7708-a2ea-436d-b241-54c5656e376d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:55.963947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2386/4750] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:55.968445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccec86-66b0-4966-abb8-536669e5d97e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:55.981829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccec86-66b0-4966-abb8-536669e5d97e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:55.990116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8be6e9-d72d-4769-bc74-add91e1c4864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:55.991441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8be6e9-d72d-4769-bc74-add91e1c4864 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:55.992194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8be6e9-d72d-4769-bc74-add91e1c4864 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:55.992579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8be6e9-d72d-4769-bc74-add91e1c4864 admin admin] PATH_INFO: `/v3/projects/74592032542e4b9d9d87ae794dfe1737/users/634c9b1f50bc4411a204cce8e9e3c962/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:56.022203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8be6e9-d72d-4769-bc74-add91e1c4864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=74592032542e4b9d9d87ae794dfe1737, user_id=634c9b1f50bc4411a204cce8e9e3c962, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:56.025518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8be6e9-d72d-4769-bc74-add91e1c4864 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:56.044600 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2365/4751] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:55 2022] PUT /identity/v3/projects/74592032542e4b9d9d87ae794dfe1737/users/634c9b1f50bc4411a204cce8e9e3c962/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:56.057101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b934-f4f4-4450-8c78-ab5b6d875b3a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:56.057531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b934-f4f4-4450-8c78-ab5b6d875b3a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:56.057911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d3b934-f4f4-4450-8c78-ab5b6d875b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:56.109545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c1d3b934-f4f4-4450-8c78-ab5b6d875b3a None None] MFA Rules not processed for user `634c9b1f50bc4411a204cce8e9e3c962`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:56.112259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c1d3b934-f4f4-4450-8c78-ab5b6d875b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:56.217455 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2387/4752] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:56.222296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8be6e9-d72d-4769-bc74-add91e1c4864 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:56.268483 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:56.316521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8be6e9-d72d-4769-bc74-add91e1c4864 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:56.331630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6c191-fccf-4fe0-9441-10dec3901550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:56.332343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6c191-fccf-4fe0-9441-10dec3901550 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:56.332631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6c191-fccf-4fe0-9441-10dec3901550 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:56.332914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a6c191-fccf-4fe0-9441-10dec3901550 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:56.333756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6c191-fccf-4fe0-9441-10dec3901550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:56.336031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a6c191-fccf-4fe0-9441-10dec3901550 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:56.371755 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2366/4753] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:56 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:56.376727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b934-f4f4-4450-8c78-ab5b6d875b3a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:56.393635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d3b934-f4f4-4450-8c78-ab5b6d875b3a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:56.499883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34bea2-8895-4ef9-988a-b43aba73a136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:56.501153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34bea2-8895-4ef9-988a-b43aba73a136 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:56.501731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34bea2-8895-4ef9-988a-b43aba73a136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:56.502155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a34bea2-8895-4ef9-988a-b43aba73a136 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:56.508716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34bea2-8895-4ef9-988a-b43aba73a136 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:56.511308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a34bea2-8895-4ef9-988a-b43aba73a136 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:56.556459 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2388/4754] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:56 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:56.561672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6c191-fccf-4fe0-9441-10dec3901550 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:56.582331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a6c191-fccf-4fe0-9441-10dec3901550 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:56.596006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0abfc0-cc27-4e18-8211-e2563201b9be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:56.597114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0abfc0-cc27-4e18-8211-e2563201b9be admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:56.597645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0abfc0-cc27-4e18-8211-e2563201b9be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:56.598086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0abfc0-cc27-4e18-8211-e2563201b9be admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:56.598927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0abfc0-cc27-4e18-8211-e2563201b9be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:56.600865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0abfc0-cc27-4e18-8211-e2563201b9be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:56.616195 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2367/4755] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:56.619863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34bea2-8895-4ef9-988a-b43aba73a136 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:56.632203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a34bea2-8895-4ef9-988a-b43aba73a136 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:56.638843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fdbf7-2a9b-4a68-a672-c18b39824c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:56.639753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fdbf7-2a9b-4a68-a672-c18b39824c91 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:56.640240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fdbf7-2a9b-4a68-a672-c18b39824c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:56.640805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fdbf7-2a9b-4a68-a672-c18b39824c91 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:56.641684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fdbf7-2a9b-4a68-a672-c18b39824c91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:56.643489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fdbf7-2a9b-4a68-a672-c18b39824c91 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:56.682895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0abfc0-cc27-4e18-8211-e2563201b9be admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:56.683619 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2389/4756] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:56 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:56.702642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0abfc0-cc27-4e18-8211-e2563201b9be admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:56.710286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171adec5-2ecb-45e7-87d1-0a64487de9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:56.711273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171adec5-2ecb-45e7-87d1-0a64487de9ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:56.711724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171adec5-2ecb-45e7-87d1-0a64487de9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:56.712178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171adec5-2ecb-45e7-87d1-0a64487de9ea admin admin] PATH_INFO: `/v3/projects/5208480e351f4597869149ad676c7eea/users/037faa5521f84575ae4fb4c5762bb775/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:56.790102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171adec5-2ecb-45e7-87d1-0a64487de9ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=5208480e351f4597869149ad676c7eea, user_id=037faa5521f84575ae4fb4c5762bb775, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:56.830626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171adec5-2ecb-45e7-87d1-0a64487de9ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:56.865264 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2368/4757] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:56 2022] PUT /identity/v3/projects/5208480e351f4597869149ad676c7eea/users/037faa5521f84575ae4fb4c5762bb775/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:56.879891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c237d-d321-4308-808e-b19fd72a2b5d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:56.883069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c237d-d321-4308-808e-b19fd72a2b5d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:56.883426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574c237d-d321-4308-808e-b19fd72a2b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:56.969480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-574c237d-d321-4308-808e-b19fd72a2b5d None None] MFA Rules not processed for user `037faa5521f84575ae4fb4c5762bb775`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:56.970746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-574c237d-d321-4308-808e-b19fd72a2b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:57.039845 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:57.145862 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2390/4758] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:57.149904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171adec5-2ecb-45e7-87d1-0a64487de9ea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:57.163718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c237d-d321-4308-808e-b19fd72a2b5d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:57.170188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-574c237d-d321-4308-808e-b19fd72a2b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:57.333802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171adec5-2ecb-45e7-87d1-0a64487de9ea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:57.344266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b88c-a1eb-40e5-89a0-cfe5527cb9a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:57.344758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b88c-a1eb-40e5-89a0-cfe5527cb9a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:57.345038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b88c-a1eb-40e5-89a0-cfe5527cb9a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:57.345355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c3b88c-a1eb-40e5-89a0-cfe5527cb9a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:57.345999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3b88c-a1eb-40e5-89a0-cfe5527cb9a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:57.348002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c3b88c-a1eb-40e5-89a0-cfe5527cb9a0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:57.399094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574c237d-d321-4308-808e-b19fd72a2b5d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:57.429905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b7bdf-0567-401b-8fc3-c91832175f79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:57.430540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b7bdf-0567-401b-8fc3-c91832175f79 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:57.430824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b7bdf-0567-401b-8fc3-c91832175f79 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:57.431100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75b7bdf-0567-401b-8fc3-c91832175f79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:57.450214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d75b7bdf-0567-401b-8fc3-c91832175f79 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:57.471148 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2369/4759] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:15:57 2022] POST /identity/v3/projects => generated 383 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:57.472101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b88c-a1eb-40e5-89a0-cfe5527cb9a0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:57.643055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c3b88c-a1eb-40e5-89a0-cfe5527cb9a0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:57.663822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f8c4f-bd5e-44ab-b7da-0294fc1f598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:57.664665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8c4f-bd5e-44ab-b7da-0294fc1f598f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:57.665122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8c4f-bd5e-44ab-b7da-0294fc1f598f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:57.665590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f8c4f-bd5e-44ab-b7da-0294fc1f598f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:57.666418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f8c4f-bd5e-44ab-b7da-0294fc1f598f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:57.671357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f8c4f-bd5e-44ab-b7da-0294fc1f598f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:57.676091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b7bdf-0567-401b-8fc3-c91832175f79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:57.680829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75b7bdf-0567-401b-8fc3-c91832175f79 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:57.706025 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:57.716007 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2391/4760] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:57 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:15:57.730246 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2370/4761] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:15:57 2022] POST /identity/v3/users => generated 298 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:15:57.731551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b7bdf-0567-401b-8fc3-c91832175f79 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:57.756815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75b7bdf-0567-401b-8fc3-c91832175f79 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:57.770043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8364249-9b9e-41d8-a11c-ff1f339f6973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:57.770689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364249-9b9e-41d8-a11c-ff1f339f6973 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:57.770966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364249-9b9e-41d8-a11c-ff1f339f6973 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:57.771418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8364249-9b9e-41d8-a11c-ff1f339f6973 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:57.772068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8364249-9b9e-41d8-a11c-ff1f339f6973 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:57.773797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8364249-9b9e-41d8-a11c-ff1f339f6973 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:57.813151 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2392/4762] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:57.817136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f8c4f-bd5e-44ab-b7da-0294fc1f598f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:57.847041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f8c4f-bd5e-44ab-b7da-0294fc1f598f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:57.862396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7d7dd-0044-417d-8142-715172aba80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:57.863795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7d7dd-0044-417d-8142-715172aba80f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:57.864179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7d7dd-0044-417d-8142-715172aba80f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:57.864552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca7d7dd-0044-417d-8142-715172aba80f admin admin] PATH_INFO: `/v3/projects/32a4c34a2f7343a198cdf0167740a32d/users/a89882f4f31c4f34ac377b3737f209fe/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:57.910270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7d7dd-0044-417d-8142-715172aba80f admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a4c34a2f7343a198cdf0167740a32d, user_id=a89882f4f31c4f34ac377b3737f209fe, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:57.913105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca7d7dd-0044-417d-8142-715172aba80f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:57.959949 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2371/4763] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:57 2022] PUT /identity/v3/projects/32a4c34a2f7343a198cdf0167740a32d/users/a89882f4f31c4f34ac377b3737f209fe/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:57.969251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8364249-9b9e-41d8-a11c-ff1f339f6973 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:57.986426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8364249-9b9e-41d8-a11c-ff1f339f6973 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:58.168202 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:15:58.192408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee76605-fc7d-48d2-ae48-59ecb0d121ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:58.196324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76605-fc7d-48d2-ae48-59ecb0d121ef admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:58.197781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76605-fc7d-48d2-ae48-59ecb0d121ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:58.202338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee76605-fc7d-48d2-ae48-59ecb0d121ef admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:58.206337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76605-fc7d-48d2-ae48-59ecb0d121ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:58.217535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee76605-fc7d-48d2-ae48-59ecb0d121ef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:58.278887 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2393/4764] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:15:57 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:15:58.290987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7d7dd-0044-417d-8142-715172aba80f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:58.357066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca7d7dd-0044-417d-8142-715172aba80f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:58.374296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f6b2e-cf41-4e4b-863a-56749c5a85d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:58.374696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f6b2e-cf41-4e4b-863a-56749c5a85d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:58.375039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f6b2e-cf41-4e4b-863a-56749c5a85d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:58.376053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f6b2e-cf41-4e4b-863a-56749c5a85d4 admin admin] PATH_INFO: `/v3/projects/32a4c34a2f7343a198cdf0167740a32d/users/a89882f4f31c4f34ac377b3737f209fe/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:58.379200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f6b2e-cf41-4e4b-863a-56749c5a85d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a4c34a2f7343a198cdf0167740a32d, user_id=a89882f4f31c4f34ac377b3737f209fe, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:58.382700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85f6b2e-cf41-4e4b-863a-56749c5a85d4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:58.405194 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2372/4765] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:15:58 2022] PUT /identity/v3/projects/32a4c34a2f7343a198cdf0167740a32d/users/a89882f4f31c4f34ac377b3737f209fe/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:15:58.424223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66d67d-fd75-41bf-adff-f5567f668a45 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:58.424515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66d67d-fd75-41bf-adff-f5567f668a45 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:58.424786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db66d67d-fd75-41bf-adff-f5567f668a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:58.492883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-db66d67d-fd75-41bf-adff-f5567f668a45 None None] MFA Rules not processed for user `a89882f4f31c4f34ac377b3737f209fe`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:15:58.494204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-db66d67d-fd75-41bf-adff-f5567f668a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:58.601391 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2394/4766] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:15:58 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:15:58.612552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f6b2e-cf41-4e4b-863a-56749c5a85d4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:15:58.614316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a85f6b2e-cf41-4e4b-863a-56749c5a85d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:15:58.774865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85f6b2e-cf41-4e4b-863a-56749c5a85d4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:15:58.778680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19979acc-82a4-4afe-a326-db737637099b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:15:58.779574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19979acc-82a4-4afe-a326-db737637099b service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:15:58.779858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19979acc-82a4-4afe-a326-db737637099b service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:15:58.780124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19979acc-82a4-4afe-a326-db737637099b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:15:58.877385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19979acc-82a4-4afe-a326-db737637099b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:15:58.878984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19979acc-82a4-4afe-a326-db737637099b service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:15:58.893052 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2373/4767] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:15:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:00.367417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66d67d-fd75-41bf-adff-f5567f668a45 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:00.368952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-db66d67d-fd75-41bf-adff-f5567f668a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:00.512505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db66d67d-fd75-41bf-adff-f5567f668a45 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:00.524295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:00.524957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:00.525246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:00.525552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] PATH_INFO: `/v3/users/d9ac971da2614beab2e4598795ed9583` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:00.528578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9ac971da2614beab2e4598795ed9583)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:00.530572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:00.643281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9ac971da2614beab2e4598795ed9583'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:00.660214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9ac971da2614beab2e4598795ed9583'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:00.660981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9ac971da2614beab2e4598795ed9583'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:00.671100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9ac971da2614beab2e4598795ed9583'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:00.681789 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:00.684720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9ac971da2614beab2e4598795ed9583'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:00.698422 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2395/4768] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:00 2022] DELETE /identity/v3/users/d9ac971da2614beab2e4598795ed9583 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:01.581376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19979acc-82a4-4afe-a326-db737637099b service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:01.644261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19979acc-82a4-4afe-a326-db737637099b service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:01.672729 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:01.699188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:01.700110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:01.700572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:01.701023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:01.703034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:01.717531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:01.719923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:01.731129 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2374/4769] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:02.087203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:02.090646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:02.091214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:02.096761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:02.246454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80f1dd2-e15e-4336-a40e-8154e920f064 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:02.251905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdab632-6260-4e0a-8134-02d80672d11c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:02.252858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab632-6260-4e0a-8134-02d80672d11c service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:02.253225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab632-6260-4e0a-8134-02d80672d11c service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:02.253618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdab632-6260-4e0a-8134-02d80672d11c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:02.255518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0fdab632-6260-4e0a-8134-02d80672d11c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:02.277503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4138bb8-88d4-4785-a59c-cfa552589aa9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:02.283735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:02.284945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:02.285320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:02.285842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] PATH_INFO: `/v3/projects/a4329719ac6b4fc0894b1f642a068376` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:02.287249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4329719ac6b4fc0894b1f642a068376)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:02.289391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:02.334410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdab632-6260-4e0a-8134-02d80672d11c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:02.335888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdab632-6260-4e0a-8134-02d80672d11c service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:02.349831 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2375/4770] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:02.379199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4329719ac6b4fc0894b1f642a068376', 'request_id': 'req-56a34280-0c55-41fa-8c9a-dd1e7b727981'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:02.393962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4329719ac6b4fc0894b1f642a068376', 'request_id': 'req-56a34280-0c55-41fa-8c9a-dd1e7b727981'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:02.404663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4329719ac6b4fc0894b1f642a068376', 'request_id': 'req-56a34280-0c55-41fa-8c9a-dd1e7b727981'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:02.422429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] The token cache is being invalidate because project a4329719ac6b4fc0894b1f642a068376 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:02.423227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:02.426268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a34280-0c55-41fa-8c9a-dd1e7b727981 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:02.429389 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2396/4771] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:02 2022] DELETE /identity/v3/projects/a4329719ac6b4fc0894b1f642a068376 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:02.434634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dd4fe-125b-4422-a8a2-0c832cfaf4bc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:02.434780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dd4fe-125b-4422-a8a2-0c832cfaf4bc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:02.435026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dd4fe-125b-4422-a8a2-0c832cfaf4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:02.459786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-be2dd4fe-125b-4422-a8a2-0c832cfaf4bc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:02.460997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-be2dd4fe-125b-4422-a8a2-0c832cfaf4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:02.643855 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2376/4772] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:02.655617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6465-a531-4f3e-a86a-582ec6c49052 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:02.655832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6465-a531-4f3e-a86a-582ec6c49052 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:02.656112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ff6465-a531-4f3e-a86a-582ec6c49052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:02.705559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-63ff6465-a531-4f3e-a86a-582ec6c49052 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:02.707903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-63ff6465-a531-4f3e-a86a-582ec6c49052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:02.722952 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2397/4773] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:02.727778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dd4fe-125b-4422-a8a2-0c832cfaf4bc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:02.742989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dd4fe-125b-4422-a8a2-0c832cfaf4bc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:02.749963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359aaeb2-a119-4067-8495-e65e9e2e3cd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:02.751613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aaeb2-a119-4067-8495-e65e9e2e3cd0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:02.752130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aaeb2-a119-4067-8495-e65e9e2e3cd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:02.752812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359aaeb2-a119-4067-8495-e65e9e2e3cd0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:02.754044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359aaeb2-a119-4067-8495-e65e9e2e3cd0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:02.754437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359aaeb2-a119-4067-8495-e65e9e2e3cd0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:02.756527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359aaeb2-a119-4067-8495-e65e9e2e3cd0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:02.787436 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2377/4774] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:02.793192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6465-a531-4f3e-a86a-582ec6c49052 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:02.805102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ff6465-a531-4f3e-a86a-582ec6c49052 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:02.814981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08151b1a-d008-4ea4-a44e-8ba398de4a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:02.815489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08151b1a-d008-4ea4-a44e-8ba398de4a08 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:02.815808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08151b1a-d008-4ea4-a44e-8ba398de4a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:02.816117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08151b1a-d008-4ea4-a44e-8ba398de4a08 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:02.816942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08151b1a-d008-4ea4-a44e-8ba398de4a08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:02.822260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08151b1a-d008-4ea4-a44e-8ba398de4a08 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:02.856230 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2398/4775] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:02 2022] POST /identity/v3/projects => generated 379 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:02.860906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359aaeb2-a119-4067-8495-e65e9e2e3cd0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:02.879846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359aaeb2-a119-4067-8495-e65e9e2e3cd0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:02.898547 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:02.970235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8299e2-ce8d-4bf5-827f-b2e6073f8606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:02.970848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8299e2-ce8d-4bf5-827f-b2e6073f8606 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:02.971152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8299e2-ce8d-4bf5-827f-b2e6073f8606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:02.971970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8299e2-ce8d-4bf5-827f-b2e6073f8606 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:02.972619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8299e2-ce8d-4bf5-827f-b2e6073f8606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:02.974656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8299e2-ce8d-4bf5-827f-b2e6073f8606 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:02.997352 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2378/4776] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:02 2022] POST /identity/v3/users => generated 290 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:03.002520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08151b1a-d008-4ea4-a44e-8ba398de4a08 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:03.017268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08151b1a-d008-4ea4-a44e-8ba398de4a08 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:03.066480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaa3d6-4ef8-409c-b923-b5e5f31cbc6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:03.067230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaa3d6-4ef8-409c-b923-b5e5f31cbc6d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:03.067655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaa3d6-4ef8-409c-b923-b5e5f31cbc6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:03.068393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfaa3d6-4ef8-409c-b923-b5e5f31cbc6d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:03.068946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaa3d6-4ef8-409c-b923-b5e5f31cbc6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:03.071245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfaa3d6-4ef8-409c-b923-b5e5f31cbc6d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:03.084662 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2399/4777] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:03.088609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8299e2-ce8d-4bf5-827f-b2e6073f8606 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:03.102899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8299e2-ce8d-4bf5-827f-b2e6073f8606 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:03.132101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb84a773-a54c-4e6b-bffa-fbbb51b4f98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:03.133770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84a773-a54c-4e6b-bffa-fbbb51b4f98c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:03.134108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84a773-a54c-4e6b-bffa-fbbb51b4f98c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:03.134858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb84a773-a54c-4e6b-bffa-fbbb51b4f98c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:03.135947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84a773-a54c-4e6b-bffa-fbbb51b4f98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:03.138746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb84a773-a54c-4e6b-bffa-fbbb51b4f98c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:03.180160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaa3d6-4ef8-409c-b923-b5e5f31cbc6d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:03.180755 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2379/4778] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:03 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:03.192877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfaa3d6-4ef8-409c-b923-b5e5f31cbc6d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:03.197647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250a6b0-821c-415d-a1c3-0bf7f95e8250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:03.198306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a6b0-821c-415d-a1c3-0bf7f95e8250 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:03.198588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a6b0-821c-415d-a1c3-0bf7f95e8250 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:03.198864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6250a6b0-821c-415d-a1c3-0bf7f95e8250 admin admin] PATH_INFO: `/v3/projects/49837016a43847f0b145aa177b5bc08d/users/e1fd438c83414de8b742cfc444739fd8/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:03.225875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250a6b0-821c-415d-a1c3-0bf7f95e8250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49837016a43847f0b145aa177b5bc08d, user_id=e1fd438c83414de8b742cfc444739fd8, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:03.230006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6250a6b0-821c-415d-a1c3-0bf7f95e8250 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:03.249134 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2400/4779] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:03 2022] PUT /identity/v3/projects/49837016a43847f0b145aa177b5bc08d/users/e1fd438c83414de8b742cfc444739fd8/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:03.255603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e7b93-e770-4496-a439-aeede893ba86 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:03.257281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e7b93-e770-4496-a439-aeede893ba86 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:03.257660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e7b93-e770-4496-a439-aeede893ba86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:03.286570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250a6b0-821c-415d-a1c3-0bf7f95e8250 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:03.288845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6250a6b0-821c-415d-a1c3-0bf7f95e8250 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:03.293276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ba9e7b93-e770-4496-a439-aeede893ba86 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:03.295258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ba9e7b93-e770-4496-a439-aeede893ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:03.328234 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:03.377615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6250a6b0-821c-415d-a1c3-0bf7f95e8250 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:03.381650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:03.382260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:03.382536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:03.382804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:03.385183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:03.401778 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2380/4780] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:03.412331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e7b93-e770-4496-a439-aeede893ba86 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:03.414220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ba9e7b93-e770-4496-a439-aeede893ba86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:03.492054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e7b93-e770-4496-a439-aeede893ba86 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:03.494927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:03.496483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:03.499414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ec338-cfc7-47dc-b300-ddf16c00057f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:03.501243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ec338-cfc7-47dc-b300-ddf16c00057f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:03.501556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ec338-cfc7-47dc-b300-ddf16c00057f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:03.502125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ec338-cfc7-47dc-b300-ddf16c00057f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:03.514992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ec338-cfc7-47dc-b300-ddf16c00057f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:03.516661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ec338-cfc7-47dc-b300-ddf16c00057f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:03.521818 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2401/4781] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:03.530477 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2381/4782] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:05.649785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:05.652019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:05.676996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e550438-e54f-41f4-b79a-42d14e1f7324 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:05.707117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:05.711810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:05.713779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:05.714305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:05.725984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:05.783689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:05.788435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:05.829323 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2402/4783] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:10.696492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b12eb3-4798-4afa-8acb-7ea840ddb805 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:10.697031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b12eb3-4798-4afa-8acb-7ea840ddb805 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:10.697031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b12eb3-4798-4afa-8acb-7ea840ddb805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:10.745571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-50b12eb3-4798-4afa-8acb-7ea840ddb805 None None] MFA Rules not processed for user `b1ae9fcca02548dfa6e29d2787288e49`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:10.748550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50b12eb3-4798-4afa-8acb-7ea840ddb805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:10.823790 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:10.893370 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2382/4784] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:11.043858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:11.045868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:11.089645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c38202-4a22-4dfa-9c38-bbbe052033a4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:11.113953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:11.114407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:11.114691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:11.114973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] PATH_INFO: `/v3/users/8b20c6dc0656476e8635c0f2807ce469` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:11.116351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b20c6dc0656476e8635c0f2807ce469)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:11.118362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:11.245874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b20c6dc0656476e8635c0f2807ce469'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:11.284411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b20c6dc0656476e8635c0f2807ce469'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:11.287382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b20c6dc0656476e8635c0f2807ce469'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:11.301336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b20c6dc0656476e8635c0f2807ce469'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:11.314664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b20c6dc0656476e8635c0f2807ce469'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:11.331287 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2403/4785] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:11 2022] DELETE /identity/v3/users/8b20c6dc0656476e8635c0f2807ce469 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:11.336101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82502551-ba2c-4cc6-963b-9054de19be58 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:11.336415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82502551-ba2c-4cc6-963b-9054de19be58 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:11.336662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82502551-ba2c-4cc6-963b-9054de19be58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:11.370458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-82502551-ba2c-4cc6-963b-9054de19be58 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:11.371589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82502551-ba2c-4cc6-963b-9054de19be58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:11.591018 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2383/4786] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:11.633158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:11.634705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:11.761629 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:11.801790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5167689-e5ff-4cf6-bb76-4ef4ca03147c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:11.811953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b928db-4403-49bd-8bef-6cd6d63b2cb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:11.813633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b928db-4403-49bd-8bef-6cd6d63b2cb3 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:11.815346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b928db-4403-49bd-8bef-6cd6d63b2cb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:11.816064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b928db-4403-49bd-8bef-6cd6d63b2cb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:11.842480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b928db-4403-49bd-8bef-6cd6d63b2cb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:11.844978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b928db-4403-49bd-8bef-6cd6d63b2cb3 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:11.861234 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2404/4787] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:12.296539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ab2b-1c09-4329-8ef1-4d61793733a9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:12.297605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ab2b-1c09-4329-8ef1-4d61793733a9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:12.297713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb0ab2b-1c09-4329-8ef1-4d61793733a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:12.319921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4cb0ab2b-1c09-4329-8ef1-4d61793733a9 None None] MFA Rules not processed for user `a170d67efe094c4e8b9267e33e4e476d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:12.321380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4cb0ab2b-1c09-4329-8ef1-4d61793733a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:12.397747 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2384/4788] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:12.910485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b928db-4403-49bd-8bef-6cd6d63b2cb3 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:12.912451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-58b928db-4403-49bd-8bef-6cd6d63b2cb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:12.936110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b928db-4403-49bd-8bef-6cd6d63b2cb3 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:12.951065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:12.951815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:12.952164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:12.952507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] PATH_INFO: `/v3/users/bcaf1ae42fc54cdbb32efa43c64aceef` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:12.954600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcaf1ae42fc54cdbb32efa43c64aceef)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:12.956632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:13.064661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcaf1ae42fc54cdbb32efa43c64aceef'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:13.097999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcaf1ae42fc54cdbb32efa43c64aceef'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:13.101284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcaf1ae42fc54cdbb32efa43c64aceef'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:13.120128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcaf1ae42fc54cdbb32efa43c64aceef'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:13.139094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcaf1ae42fc54cdbb32efa43c64aceef'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:13.149781 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2405/4789] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:12 2022] DELETE /identity/v3/users/bcaf1ae42fc54cdbb32efa43c64aceef => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:13.154538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111a902-3cef-4ffa-9591-3ac4237dee30 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:13.154863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111a902-3cef-4ffa-9591-3ac4237dee30 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:13.154986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111a902-3cef-4ffa-9591-3ac4237dee30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:13.202352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3111a902-3cef-4ffa-9591-3ac4237dee30 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:13.207790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3111a902-3cef-4ffa-9591-3ac4237dee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:13.341078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:13.342038 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2385/4790] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:13.347791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:13.353250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111a902-3cef-4ffa-9591-3ac4237dee30 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:13.355148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3111a902-3cef-4ffa-9591-3ac4237dee30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:13.416718 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:13.480335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111a902-3cef-4ffa-9591-3ac4237dee30 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:13.492271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ce790-5822-4f0d-bc93-db5fca7fd7d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:13.493347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ce790-5822-4f0d-bc93-db5fca7fd7d9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:13.493821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ce790-5822-4f0d-bc93-db5fca7fd7d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:13.494259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ce790-5822-4f0d-bc93-db5fca7fd7d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:13.525965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ce790-5822-4f0d-bc93-db5fca7fd7d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:13.527582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189ce790-5822-4f0d-bc93-db5fca7fd7d9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:13.568853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26332a4-2d0f-430d-a28b-ab89f52a978c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:13.571250 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2386/4791] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:13.585318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fea773-25e2-46f0-b5ef-741c3adca645 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:13.588568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fea773-25e2-46f0-b5ef-741c3adca645 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:13.589067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fea773-25e2-46f0-b5ef-741c3adca645 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:13.590231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fea773-25e2-46f0-b5ef-741c3adca645 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:13.594974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-02fea773-25e2-46f0-b5ef-741c3adca645 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:13.629816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fea773-25e2-46f0-b5ef-741c3adca645 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:13.632710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fea773-25e2-46f0-b5ef-741c3adca645 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:13.659810 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2406/4792] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:14.978084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ce790-5822-4f0d-bc93-db5fca7fd7d9 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:14.979644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-189ce790-5822-4f0d-bc93-db5fca7fd7d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:15.039236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189ce790-5822-4f0d-bc93-db5fca7fd7d9 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:15.068069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:15.068942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:15.069549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:15.069994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] PATH_INFO: `/v3/projects/91a35426751247d7a80934483412ba31` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:15.071715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91a35426751247d7a80934483412ba31)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:15.074569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:15.173503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91a35426751247d7a80934483412ba31', 'request_id': 'req-bb5b68b8-3953-4ff2-805b-7f888a799837'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:15.192670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91a35426751247d7a80934483412ba31', 'request_id': 'req-bb5b68b8-3953-4ff2-805b-7f888a799837'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:15.214026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91a35426751247d7a80934483412ba31', 'request_id': 'req-bb5b68b8-3953-4ff2-805b-7f888a799837'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:15.235091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] The token cache is being invalidate because project 91a35426751247d7a80934483412ba31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:15.235688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:15.236606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bb5b68b8-3953-4ff2-805b-7f888a799837 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:15.243233 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2387/4793] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:14 2022] DELETE /identity/v3/projects/91a35426751247d7a80934483412ba31 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:15.249741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27b56-bf22-4e5b-bcdc-f6efdfb9c5df None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:15.249741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27b56-bf22-4e5b-bcdc-f6efdfb9c5df None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:15.249741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b27b56-bf22-4e5b-bcdc-f6efdfb9c5df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:15.331840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-18b27b56-bf22-4e5b-bcdc-f6efdfb9c5df None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:15.352799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-18b27b56-bf22-4e5b-bcdc-f6efdfb9c5df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:15.414705 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:15.497533 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2407/4794] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:15.506504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096ef95-607b-4472-844b-665876d5807f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:15.506794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096ef95-607b-4472-844b-665876d5807f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:15.512575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096ef95-607b-4472-844b-665876d5807f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:15.557740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8096ef95-607b-4472-844b-665876d5807f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:15.559521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8096ef95-607b-4472-844b-665876d5807f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:15.573141 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2388/4795] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:15.574827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27b56-bf22-4e5b-bcdc-f6efdfb9c5df None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:15.592569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b27b56-bf22-4e5b-bcdc-f6efdfb9c5df None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:15.611084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af792ff-15af-4327-9d6a-2149b715dac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:15.611883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af792ff-15af-4327-9d6a-2149b715dac4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:15.612270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af792ff-15af-4327-9d6a-2149b715dac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:15.612648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af792ff-15af-4327-9d6a-2149b715dac4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:15.613467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af792ff-15af-4327-9d6a-2149b715dac4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:15.613882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af792ff-15af-4327-9d6a-2149b715dac4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:15.615705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af792ff-15af-4327-9d6a-2149b715dac4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:15.647801 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2408/4796] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:15.653355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096ef95-607b-4472-844b-665876d5807f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:15.669405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096ef95-607b-4472-844b-665876d5807f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:15.683622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821e26a-19e1-4a04-b743-bacfff40a4e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:15.684189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821e26a-19e1-4a04-b743-bacfff40a4e9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:15.684468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821e26a-19e1-4a04-b743-bacfff40a4e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:15.684747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821e26a-19e1-4a04-b743-bacfff40a4e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:15.685404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821e26a-19e1-4a04-b743-bacfff40a4e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:15.689366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821e26a-19e1-4a04-b743-bacfff40a4e9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:15.757513 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2389/4797] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:15 2022] POST /identity/v3/projects => generated 363 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:15.762797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af792ff-15af-4327-9d6a-2149b715dac4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:15.789716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af792ff-15af-4327-9d6a-2149b715dac4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:16.016818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9b9b9-b12b-4f02-a55e-5154154c5c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:16.017491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9b9b9-b12b-4f02-a55e-5154154c5c47 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:16.017777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9b9b9-b12b-4f02-a55e-5154154c5c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:16.018056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9b9b9-b12b-4f02-a55e-5154154c5c47 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:16.025440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9b9b9-b12b-4f02-a55e-5154154c5c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:16.027556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9b9b9-b12b-4f02-a55e-5154154c5c47 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:16.104147 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2409/4798] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:15 2022] POST /identity/v3/users => generated 282 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:16.108922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821e26a-19e1-4a04-b743-bacfff40a4e9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:16.124498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9b9b9-b12b-4f02-a55e-5154154c5c47 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:16.131935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-edf9b9b9-b12b-4f02-a55e-5154154c5c47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:16.134679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821e26a-19e1-4a04-b743-bacfff40a4e9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:16.150386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9b9b9-b12b-4f02-a55e-5154154c5c47 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:16.159416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:16.160074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:16.160360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:16.161017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] PATH_INFO: `/v3/users/634c9b1f50bc4411a204cce8e9e3c962` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:16.162001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] RBAC: Authorizing `identity:delete_user(user_id=634c9b1f50bc4411a204cce8e9e3c962)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:16.164722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:16.165665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377aed0-f4aa-42fd-8bfe-f0d16bcc9ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:16.168091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377aed0-f4aa-42fd-8bfe-f0d16bcc9ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:16.170704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377aed0-f4aa-42fd-8bfe-f0d16bcc9ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:16.171225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f377aed0-f4aa-42fd-8bfe-f0d16bcc9ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:16.174412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377aed0-f4aa-42fd-8bfe-f0d16bcc9ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:16.176384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f377aed0-f4aa-42fd-8bfe-f0d16bcc9ca8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:16.219789 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2390/4799] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:16.220722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377aed0-f4aa-42fd-8bfe-f0d16bcc9ca8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:16.228243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f377aed0-f4aa-42fd-8bfe-f0d16bcc9ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:16.248502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f377aed0-f4aa-42fd-8bfe-f0d16bcc9ca8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:16.254529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:16.255470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:16.256311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:16.256775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] PATH_INFO: `/v3/projects/ca25b8c67d5d4f9f9258039b17e5197d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:16.258248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca25b8c67d5d4f9f9258039b17e5197d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:16.260412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:16.291936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '634c9b1f50bc4411a204cce8e9e3c962'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.385104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '634c9b1f50bc4411a204cce8e9e3c962'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.396001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '634c9b1f50bc4411a204cce8e9e3c962'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.413110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca25b8c67d5d4f9f9258039b17e5197d', 'request_id': 'req-516c1aa3-283b-43e5-8ba9-5207560a3ee1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.414527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '634c9b1f50bc4411a204cce8e9e3c962'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.427224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '634c9b1f50bc4411a204cce8e9e3c962'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.432315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca25b8c67d5d4f9f9258039b17e5197d', 'request_id': 'req-516c1aa3-283b-43e5-8ba9-5207560a3ee1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.444069 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2410/4800] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:16 2022] DELETE /identity/v3/users/634c9b1f50bc4411a204cce8e9e3c962 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:16.444921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:16.445811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca25b8c67d5d4f9f9258039b17e5197d', 'request_id': 'req-516c1aa3-283b-43e5-8ba9-5207560a3ee1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.448030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:16.457843 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:16.477735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] The token cache is being invalidate because project ca25b8c67d5d4f9f9258039b17e5197d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:16.479601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.481434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-516c1aa3-283b-43e5-8ba9-5207560a3ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.485939 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2391/4801] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:16 2022] DELETE /identity/v3/projects/ca25b8c67d5d4f9f9258039b17e5197d => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:16.492875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e3896-16dd-462f-a692-e34ef35b4aa6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:16.493417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e3896-16dd-462f-a692-e34ef35b4aa6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:16.494516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60e3896-16dd-462f-a692-e34ef35b4aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:16.522476 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:16.550599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c60e3896-16dd-462f-a692-e34ef35b4aa6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:16.552230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c60e3896-16dd-462f-a692-e34ef35b4aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:16.652323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751e06f-b646-4918-a20b-a4d2e448431d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:16.669099 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2392/4802] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:16.675845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e3896-16dd-462f-a692-e34ef35b4aa6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:16.676884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26103918-e88e-4917-93f2-da55ea7485b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:16.677602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c60e3896-16dd-462f-a692-e34ef35b4aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:16.677907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26103918-e88e-4917-93f2-da55ea7485b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:16.678349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26103918-e88e-4917-93f2-da55ea7485b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:16.678781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26103918-e88e-4917-93f2-da55ea7485b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:16.679610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26103918-e88e-4917-93f2-da55ea7485b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:16.681406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26103918-e88e-4917-93f2-da55ea7485b1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:16.722448 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2411/4803] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:16.723442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26103918-e88e-4917-93f2-da55ea7485b1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:16.725483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60e3896-16dd-462f-a692-e34ef35b4aa6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:16.726786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-26103918-e88e-4917-93f2-da55ea7485b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:16.752004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:16.752724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:16.754012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:16.756919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] PATH_INFO: `/v3/users/5ae2aeaa3f0746fb9e87351c91bb19db` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:16.759166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ae2aeaa3f0746fb9e87351c91bb19db)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:16.763141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:16.934997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ae2aeaa3f0746fb9e87351c91bb19db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.986974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ae2aeaa3f0746fb9e87351c91bb19db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:16.989624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ae2aeaa3f0746fb9e87351c91bb19db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:17.008073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26103918-e88e-4917-93f2-da55ea7485b1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:17.016145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ae2aeaa3f0746fb9e87351c91bb19db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:17.026148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33868d91-51ce-464a-9905-dfad7af4ab63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:17.026807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33868d91-51ce-464a-9905-dfad7af4ab63 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:17.027100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33868d91-51ce-464a-9905-dfad7af4ab63 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:17.027349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33868d91-51ce-464a-9905-dfad7af4ab63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:17.035889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-33868d91-51ce-464a-9905-dfad7af4ab63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:17.038659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ae2aeaa3f0746fb9e87351c91bb19db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:17.090095 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2393/4804] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:16 2022] DELETE /identity/v3/users/5ae2aeaa3f0746fb9e87351c91bb19db => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:17.091911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:17.101393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:17.115526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33868d91-51ce-464a-9905-dfad7af4ab63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:17.117258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33868d91-51ce-464a-9905-dfad7af4ab63 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:17.157256 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2412/4805] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:17.298342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98860945-246b-4c44-bc2e-f99963065d83 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:17.306931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627c8b6-699d-45bc-9473-c875f6899def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:17.307541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627c8b6-699d-45bc-9473-c875f6899def admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:17.307825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627c8b6-699d-45bc-9473-c875f6899def admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:17.308107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5627c8b6-699d-45bc-9473-c875f6899def admin admin] PATH_INFO: `/v3/projects/faf564eb551040f397de5f79a996ec15/users/e9a705cc5cbc4b21b95db10dce753108/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:17.332256 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:17.339506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627c8b6-699d-45bc-9473-c875f6899def admin admin] RBAC: Authorizing `identity:create_grant(project_id=faf564eb551040f397de5f79a996ec15, user_id=e9a705cc5cbc4b21b95db10dce753108, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:17.346870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5627c8b6-699d-45bc-9473-c875f6899def admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:17.370430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2394/4806] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:17 2022] PUT /identity/v3/projects/faf564eb551040f397de5f79a996ec15/users/e9a705cc5cbc4b21b95db10dce753108/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:17.382131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeabd3b-e624-423c-b9de-aade46a64ffc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:17.383014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeabd3b-e624-423c-b9de-aade46a64ffc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:17.383014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeabd3b-e624-423c-b9de-aade46a64ffc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:17.435246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cbeabd3b-e624-423c-b9de-aade46a64ffc None None] MFA Rules not processed for user `e9a705cc5cbc4b21b95db10dce753108`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:17.437196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cbeabd3b-e624-423c-b9de-aade46a64ffc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:17.558451 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2413/4807] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:17.573250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627c8b6-699d-45bc-9473-c875f6899def admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:17.575932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5627c8b6-699d-45bc-9473-c875f6899def admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:17.733009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5627c8b6-699d-45bc-9473-c875f6899def admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:17.741884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fec96e-cc66-4fb2-b6e4-9715d3d0dba7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:17.742699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fec96e-cc66-4fb2-b6e4-9715d3d0dba7 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:17.743013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fec96e-cc66-4fb2-b6e4-9715d3d0dba7 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:17.743343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fec96e-cc66-4fb2-b6e4-9715d3d0dba7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:17.767193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d1d1e-9983-477d-88e5-d99ca480fd09 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:17.767766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d1d1e-9983-477d-88e5-d99ca480fd09 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:17.768685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48d1d1e-9983-477d-88e5-d99ca480fd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:17.775132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fec96e-cc66-4fb2-b6e4-9715d3d0dba7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:17.776850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fec96e-cc66-4fb2-b6e4-9715d3d0dba7 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:17.787832 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2395/4808] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:17.848523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c48d1d1e-9983-477d-88e5-d99ca480fd09 None None] MFA Rules not processed for user `e1fd438c83414de8b742cfc444739fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:17.850019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c48d1d1e-9983-477d-88e5-d99ca480fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:17.855118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fec96e-cc66-4fb2-b6e4-9715d3d0dba7 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:17.959058 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:17.965567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fec96e-cc66-4fb2-b6e4-9715d3d0dba7 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:17.977771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:17.978428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:17.978696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:17.978970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] PATH_INFO: `/v3/users/e9a705cc5cbc4b21b95db10dce753108` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:17.980770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9a705cc5cbc4b21b95db10dce753108)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:17.985112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:18.011165 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2414/4809] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:18.015219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d1d1e-9983-477d-88e5-d99ca480fd09 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:18.017782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c48d1d1e-9983-477d-88e5-d99ca480fd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:18.044932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48d1d1e-9983-477d-88e5-d99ca480fd09 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:18.054669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079a84-3af7-45c9-a7b5-00e7d4ff9f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:18.055358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079a84-3af7-45c9-a7b5-00e7d4ff9f74 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:18.055636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079a84-3af7-45c9-a7b5-00e7d4ff9f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:18.055910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079a84-3af7-45c9-a7b5-00e7d4ff9f74 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:18.056552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5079a84-3af7-45c9-a7b5-00e7d4ff9f74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:18.058733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5079a84-3af7-45c9-a7b5-00e7d4ff9f74 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:18.089398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9a705cc5cbc4b21b95db10dce753108'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:18.116962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9a705cc5cbc4b21b95db10dce753108'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:18.121714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9a705cc5cbc4b21b95db10dce753108'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:18.134968 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2415/4810] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:18 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:18.139203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079a84-3af7-45c9-a7b5-00e7d4ff9f74 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:18.143257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9a705cc5cbc4b21b95db10dce753108'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:18.143423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e5079a84-3af7-45c9-a7b5-00e7d4ff9f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:18.161987 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:18.161987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f17437-4596-4d1f-af0b-e781e4f6c63f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9a705cc5cbc4b21b95db10dce753108'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:18.172694 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2396/4811] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:17 2022] DELETE /identity/v3/users/e9a705cc5cbc4b21b95db10dce753108 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:18.177092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262e9e-74cc-4f3b-86de-f10107ba8c74 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:18.177699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262e9e-74cc-4f3b-86de-f10107ba8c74 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:18.178308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03262e9e-74cc-4f3b-86de-f10107ba8c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:18.201651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-03262e9e-74cc-4f3b-86de-f10107ba8c74 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:18.204727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-03262e9e-74cc-4f3b-86de-f10107ba8c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:18.288412 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2397/4812] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:18.340354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079a84-3af7-45c9-a7b5-00e7d4ff9f74 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:18.351759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e824037-4d8b-4c31-97c0-b1b6218d619a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:18.352396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824037-4d8b-4c31-97c0-b1b6218d619a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:18.352675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824037-4d8b-4c31-97c0-b1b6218d619a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:18.352954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e824037-4d8b-4c31-97c0-b1b6218d619a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:18.353634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e824037-4d8b-4c31-97c0-b1b6218d619a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:18.355584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e824037-4d8b-4c31-97c0-b1b6218d619a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:18.402784 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2416/4813] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:18 2022] POST /identity/v3/users => generated 296 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:18.403965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262e9e-74cc-4f3b-86de-f10107ba8c74 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:18.414822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e824037-4d8b-4c31-97c0-b1b6218d619a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:18.416702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0e824037-4d8b-4c31-97c0-b1b6218d619a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:18.419196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03262e9e-74cc-4f3b-86de-f10107ba8c74 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:18.431982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac4d5c-af48-4877-b6bc-332fd7a8f582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:18.434282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4d5c-af48-4877-b6bc-332fd7a8f582 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:18.435578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4d5c-af48-4877-b6bc-332fd7a8f582 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:18.435971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac4d5c-af48-4877-b6bc-332fd7a8f582 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:18.438352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac4d5c-af48-4877-b6bc-332fd7a8f582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:18.442131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cac4d5c-af48-4877-b6bc-332fd7a8f582 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:18.472416 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2398/4814] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:18.476087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac4d5c-af48-4877-b6bc-332fd7a8f582 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:18.500432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac4d5c-af48-4877-b6bc-332fd7a8f582 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:18.511066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7f5d-6dc2-4a58-a533-aa0b768e4a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:18.512722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7f5d-6dc2-4a58-a533-aa0b768e4a07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:18.515427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7f5d-6dc2-4a58-a533-aa0b768e4a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:18.518273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab7f5d-6dc2-4a58-a533-aa0b768e4a07 admin admin] PATH_INFO: `/v3/projects/9f3b4ec019854618be7a2b1ff515bff6/users/2f12eb63d7194738b3272197d4894871/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:18.581545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab7f5d-6dc2-4a58-a533-aa0b768e4a07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3b4ec019854618be7a2b1ff515bff6, user_id=2f12eb63d7194738b3272197d4894871, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:18.587090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab7f5d-6dc2-4a58-a533-aa0b768e4a07 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:18.604387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e824037-4d8b-4c31-97c0-b1b6218d619a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:18.615954 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2399/4815] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:18 2022] PUT /identity/v3/projects/9f3b4ec019854618be7a2b1ff515bff6/users/2f12eb63d7194738b3272197d4894871/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:18.620414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7f5d-6dc2-4a58-a533-aa0b768e4a07 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:18.723422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e04da-f0ff-4481-b865-08ac76e26a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:18.724139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e04da-f0ff-4481-b865-08ac76e26a21 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:18.724360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e04da-f0ff-4481-b865-08ac76e26a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:18.724643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e04da-f0ff-4481-b865-08ac76e26a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:18.771818 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:18.772028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab7f5d-6dc2-4a58-a533-aa0b768e4a07 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:18.791444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6fef-a3c2-4278-97d1-0d9530f4bc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:18.792166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6fef-a3c2-4278-97d1-0d9530f4bc3c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:18.792448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6fef-a3c2-4278-97d1-0d9530f4bc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:18.792725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec6fef-a3c2-4278-97d1-0d9530f4bc3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:18.793414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6fef-a3c2-4278-97d1-0d9530f4bc3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:18.801156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ec6fef-a3c2-4278-97d1-0d9530f4bc3c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:18.833085 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2400/4816] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:18 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:16:18.837772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6fef-a3c2-4278-97d1-0d9530f4bc3c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:18.866967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ec6fef-a3c2-4278-97d1-0d9530f4bc3c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:18.895132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619b6a1-aad1-4cb1-9d20-08a37cb1d514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:18.895861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619b6a1-aad1-4cb1-9d20-08a37cb1d514 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:18.896141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619b6a1-aad1-4cb1-9d20-08a37cb1d514 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:18.896417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619b6a1-aad1-4cb1-9d20-08a37cb1d514 admin admin] PATH_INFO: `/v3/projects/9f3b4ec019854618be7a2b1ff515bff6/users/2f12eb63d7194738b3272197d4894871/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:18.900675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619b6a1-aad1-4cb1-9d20-08a37cb1d514 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f3b4ec019854618be7a2b1ff515bff6, user_id=2f12eb63d7194738b3272197d4894871, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:18.902964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e04da-f0ff-4481-b865-08ac76e26a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:18.904670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5e04da-f0ff-4481-b865-08ac76e26a21 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:18.910986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619b6a1-aad1-4cb1-9d20-08a37cb1d514 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:18.931135 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2417/4817] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:18.947080 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2401/4818] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:18 2022] PUT /identity/v3/projects/9f3b4ec019854618be7a2b1ff515bff6/users/2f12eb63d7194738b3272197d4894871/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:19.696783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e04da-f0ff-4481-b865-08ac76e26a21 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:19.698255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fb5e04da-f0ff-4481-b865-08ac76e26a21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:19.717203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619b6a1-aad1-4cb1-9d20-08a37cb1d514 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:19.719877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3619b6a1-aad1-4cb1-9d20-08a37cb1d514 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:19.729542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e04da-f0ff-4481-b865-08ac76e26a21 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:19.889980 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:19.922703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:19.923374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:19.923647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:19.924137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] PATH_INFO: `/v3/projects/c4659ec4607d4aae893c1223f0484c85` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:19.927259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4659ec4607d4aae893c1223f0484c85)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:19.930746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:19.939891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619b6a1-aad1-4cb1-9d20-08a37cb1d514 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:19.956592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:19.957653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:19.958221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:19.958737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] PATH_INFO: `/v3/projects/74592032542e4b9d9d87ae794dfe1737` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:19.960551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=74592032542e4b9d9d87ae794dfe1737)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:19.963320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:20.045389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4659ec4607d4aae893c1223f0484c85', 'request_id': 'req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.066257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4659ec4607d4aae893c1223f0484c85', 'request_id': 'req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.067257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74592032542e4b9d9d87ae794dfe1737', 'request_id': 'req-209fb5b4-8441-4c54-bc75-727629bf2d1f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.079696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74592032542e4b9d9d87ae794dfe1737', 'request_id': 'req-209fb5b4-8441-4c54-bc75-727629bf2d1f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.081045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4659ec4607d4aae893c1223f0484c85', 'request_id': 'req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.096976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74592032542e4b9d9d87ae794dfe1737', 'request_id': 'req-209fb5b4-8441-4c54-bc75-727629bf2d1f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.099034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] The token cache is being invalidate because project c4659ec4607d4aae893c1223f0484c85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:20.099670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.100572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0aaa41f-8c97-4c5d-bd2e-ad839c5be7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.102857 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2418/4819] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:19 2022] DELETE /identity/v3/projects/c4659ec4607d4aae893c1223f0484c85 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:20.108321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f045cb7-6f80-4fc9-8f9f-d1b26a4d01c9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:20.109133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f045cb7-6f80-4fc9-8f9f-d1b26a4d01c9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:20.109742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f045cb7-6f80-4fc9-8f9f-d1b26a4d01c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:20.121943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] The token cache is being invalidate because project 74592032542e4b9d9d87ae794dfe1737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:20.122422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.125352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.132160 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2402/4820] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:19 2022] DELETE /identity/v3/projects/74592032542e4b9d9d87ae794dfe1737 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:20.138220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:20.152276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:20.163702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5f045cb7-6f80-4fc9-8f9f-d1b26a4d01c9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:20.166199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5f045cb7-6f80-4fc9-8f9f-d1b26a4d01c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:20.273007 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:20.321366 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2419/4821] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:20.326864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fb5b4-8441-4c54-bc75-727629bf2d1f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:20.330998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc2e0e-1f3e-4013-be19-42ae72b76481 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:20.331574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc2e0e-1f3e-4013-be19-42ae72b76481 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:20.332095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdc2e0e-1f3e-4013-be19-42ae72b76481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:20.339412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:20.340088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:20.340386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:20.340665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] PATH_INFO: `/v3/users/037faa5521f84575ae4fb4c5762bb775` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:20.345912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=037faa5521f84575ae4fb4c5762bb775)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:20.350602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:20.382496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6cdc2e0e-1f3e-4013-be19-42ae72b76481 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:20.386249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6cdc2e0e-1f3e-4013-be19-42ae72b76481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:20.411018 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2420/4822] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:20.418168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc2e0e-1f3e-4013-be19-42ae72b76481 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:20.436868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdc2e0e-1f3e-4013-be19-42ae72b76481 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:20.451355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbc37c-07f8-4c31-bb92-0f83f93abc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:20.451986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbc37c-07f8-4c31-bb92-0f83f93abc15 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:20.452280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbc37c-07f8-4c31-bb92-0f83f93abc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:20.452603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefbc37c-07f8-4c31-bb92-0f83f93abc15 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:20.454586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbc37c-07f8-4c31-bb92-0f83f93abc15 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:20.455971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbc37c-07f8-4c31-bb92-0f83f93abc15 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:20.460770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefbc37c-07f8-4c31-bb92-0f83f93abc15 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:20.478040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '037faa5521f84575ae4fb4c5762bb775'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.496235 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2421/4823] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:16:20.501213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbc37c-07f8-4c31-bb92-0f83f93abc15 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:20.519003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '037faa5521f84575ae4fb4c5762bb775'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.520231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '037faa5521f84575ae4fb4c5762bb775'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.527201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefbc37c-07f8-4c31-bb92-0f83f93abc15 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:20.540410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bc81a-12b3-47ef-95f7-8ed137592271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:20.540835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '037faa5521f84575ae4fb4c5762bb775'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.542870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bc81a-12b3-47ef-95f7-8ed137592271 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:20.543399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bc81a-12b3-47ef-95f7-8ed137592271 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:20.543995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4bc81a-12b3-47ef-95f7-8ed137592271 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:20.545175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bc81a-12b3-47ef-95f7-8ed137592271 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:20.551154 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:20.553414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4bc81a-12b3-47ef-95f7-8ed137592271 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:20.559701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '037faa5521f84575ae4fb4c5762bb775'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:20.590613 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2403/4824] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:20 2022] DELETE /identity/v3/users/037faa5521f84575ae4fb4c5762bb775 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:20.639974 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2422/4825] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:20 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:20.641320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:20.643428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:20.813237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1c9408-9926-45be-acf5-ba2483c23f5c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:21.018974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f7a52-3793-4448-8e10-d65db8c0ea17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:21.019601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f7a52-3793-4448-8e10-d65db8c0ea17 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:21.019876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f7a52-3793-4448-8e10-d65db8c0ea17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:21.020193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f7a52-3793-4448-8e10-d65db8c0ea17 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:21.020877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f7a52-3793-4448-8e10-d65db8c0ea17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:21.027674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f7a52-3793-4448-8e10-d65db8c0ea17 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:21.079704 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2404/4826] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:20 2022] POST /identity/v3/users => generated 290 bytes in 439 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:21.083810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bc81a-12b3-47ef-95f7-8ed137592271 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:21.124720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4bc81a-12b3-47ef-95f7-8ed137592271 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:21.138316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e5841-074f-42fc-8b94-220190e2b12b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:21.139918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e5841-074f-42fc-8b94-220190e2b12b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:21.140471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e5841-074f-42fc-8b94-220190e2b12b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:21.141680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3e5841-074f-42fc-8b94-220190e2b12b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:21.143449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e5841-074f-42fc-8b94-220190e2b12b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:21.145640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3e5841-074f-42fc-8b94-220190e2b12b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:21.167231 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2423/4827] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:21.171088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f7a52-3793-4448-8e10-d65db8c0ea17 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:21.186586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f7a52-3793-4448-8e10-d65db8c0ea17 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:21.197436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5eecd4e-2d55-45b5-97cd-4d44300ea2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:21.198054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eecd4e-2d55-45b5-97cd-4d44300ea2e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:21.198335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eecd4e-2d55-45b5-97cd-4d44300ea2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:21.198610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5eecd4e-2d55-45b5-97cd-4d44300ea2e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:21.201871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eecd4e-2d55-45b5-97cd-4d44300ea2e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:21.203809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5eecd4e-2d55-45b5-97cd-4d44300ea2e9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:21.229399 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2405/4828] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:21.233598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e5841-074f-42fc-8b94-220190e2b12b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:21.250104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3e5841-074f-42fc-8b94-220190e2b12b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:21.268887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1105bab-282c-4222-ba81-4ce41ea86d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:21.270029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1105bab-282c-4222-ba81-4ce41ea86d70 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:21.270550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1105bab-282c-4222-ba81-4ce41ea86d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:21.271059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1105bab-282c-4222-ba81-4ce41ea86d70 admin admin] PATH_INFO: `/v3/projects/ae34f891049644e6b71c17c1551cd34f/users/49f5ab4fe8b44318930c0bf3051e0b4c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:21.314418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1105bab-282c-4222-ba81-4ce41ea86d70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ae34f891049644e6b71c17c1551cd34f, user_id=49f5ab4fe8b44318930c0bf3051e0b4c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:21.319026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1105bab-282c-4222-ba81-4ce41ea86d70 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:21.350993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2424/4829] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:21 2022] PUT /identity/v3/projects/ae34f891049644e6b71c17c1551cd34f/users/49f5ab4fe8b44318930c0bf3051e0b4c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:21.363487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df434-d8f2-4a97-ade2-0b150ce01bb3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:21.363861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df434-d8f2-4a97-ade2-0b150ce01bb3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:21.365985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796df434-d8f2-4a97-ade2-0b150ce01bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:21.428175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-796df434-d8f2-4a97-ade2-0b150ce01bb3 None None] MFA Rules not processed for user `49f5ab4fe8b44318930c0bf3051e0b4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:21.431700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-796df434-d8f2-4a97-ade2-0b150ce01bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:21.608981 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2406/4830] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:21.614194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1105bab-282c-4222-ba81-4ce41ea86d70 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:21.785689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1105bab-282c-4222-ba81-4ce41ea86d70 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:21.803561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e38a2-61cf-408a-96dc-4cef77855281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:21.804356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e38a2-61cf-408a-96dc-4cef77855281 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:21.804750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e38a2-61cf-408a-96dc-4cef77855281 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:21.805135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2e38a2-61cf-408a-96dc-4cef77855281 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:21.805926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e38a2-61cf-408a-96dc-4cef77855281 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:21.808242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2e38a2-61cf-408a-96dc-4cef77855281 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:21.886644 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2425/4831] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:21 2022] POST /identity/v3/projects => generated 379 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:21.889592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df434-d8f2-4a97-ade2-0b150ce01bb3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:21.906935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796df434-d8f2-4a97-ade2-0b150ce01bb3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:21.916317 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:22.043351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaefa6-85c7-4c5d-a3b4-d116df517826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:22.044839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaefa6-85c7-4c5d-a3b4-d116df517826 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:22.047468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaefa6-85c7-4c5d-a3b4-d116df517826 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:22.048136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceaefa6-85c7-4c5d-a3b4-d116df517826 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:22.049794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaefa6-85c7-4c5d-a3b4-d116df517826 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:22.055988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceaefa6-85c7-4c5d-a3b4-d116df517826 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:22.071879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e38a2-61cf-408a-96dc-4cef77855281 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:22.074633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5b2e38a2-61cf-408a-96dc-4cef77855281 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:22.111582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2e38a2-61cf-408a-96dc-4cef77855281 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:22.120274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:22.121109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:22.121406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:22.121945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] PATH_INFO: `/v3/projects/faf564eb551040f397de5f79a996ec15` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:22.123097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] RBAC: Authorizing `identity:delete_project(project_id=faf564eb551040f397de5f79a996ec15)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:22.144323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:22.149732 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2407/4832] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:21 2022] POST /identity/v3/users => generated 296 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:22.176535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaefa6-85c7-4c5d-a3b4-d116df517826 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:22.199487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceaefa6-85c7-4c5d-a3b4-d116df517826 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:22.218429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e488cd-ede8-4101-9981-a6f1a89c7099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:22.219632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e488cd-ede8-4101-9981-a6f1a89c7099 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:22.219910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e488cd-ede8-4101-9981-a6f1a89c7099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:22.220180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e488cd-ede8-4101-9981-a6f1a89c7099 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:22.220826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e488cd-ede8-4101-9981-a6f1a89c7099 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:22.236450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e488cd-ede8-4101-9981-a6f1a89c7099 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:22.271823 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2408/4833] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:22.272739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e488cd-ede8-4101-9981-a6f1a89c7099 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:22.299451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e488cd-ede8-4101-9981-a6f1a89c7099 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:22.305965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'faf564eb551040f397de5f79a996ec15', 'request_id': 'req-632e90cd-a500-457b-82fe-c17034c8b72f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.310754 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:22.326594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'faf564eb551040f397de5f79a996ec15', 'request_id': 'req-632e90cd-a500-457b-82fe-c17034c8b72f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.342325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'faf564eb551040f397de5f79a996ec15', 'request_id': 'req-632e90cd-a500-457b-82fe-c17034c8b72f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.369996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] The token cache is being invalidate because project faf564eb551040f397de5f79a996ec15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:22.372086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.372976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-632e90cd-a500-457b-82fe-c17034c8b72f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.379214 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2426/4834] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:22 2022] DELETE /identity/v3/projects/faf564eb551040f397de5f79a996ec15 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:22.381218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43bae9-6e66-4403-8b1a-3780c3c6a49b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:22.381218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43bae9-6e66-4403-8b1a-3780c3c6a49b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:22.381520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f43bae9-6e66-4403-8b1a-3780c3c6a49b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:22.410336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4f43bae9-6e66-4403-8b1a-3780c3c6a49b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:22.412151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4f43bae9-6e66-4403-8b1a-3780c3c6a49b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:22.418466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de664b-6184-4f99-b1d6-277535261f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:22.419149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de664b-6184-4f99-b1d6-277535261f79 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:22.419427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de664b-6184-4f99-b1d6-277535261f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:22.419700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2de664b-6184-4f99-b1d6-277535261f79 admin admin] PATH_INFO: `/v3/projects/b4663a546122409a81c03c9f7d6a9cb0/users/e1ded6da9d9841be9b9592512a004662/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:22.437836 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2427/4835] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:22.445813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbce3f2-ba04-47d9-92ee-a0d5483ad5f8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:22.446154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbce3f2-ba04-47d9-92ee-a0d5483ad5f8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:22.446434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbce3f2-ba04-47d9-92ee-a0d5483ad5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:22.460081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de664b-6184-4f99-b1d6-277535261f79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4663a546122409a81c03c9f7d6a9cb0, user_id=e1ded6da9d9841be9b9592512a004662, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:22.462795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2de664b-6184-4f99-b1d6-277535261f79 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:22.487170 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2409/4836] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:22 2022] PUT /identity/v3/projects/b4663a546122409a81c03c9f7d6a9cb0/users/e1ded6da9d9841be9b9592512a004662/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:22.488907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ebbce3f2-ba04-47d9-92ee-a0d5483ad5f8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:22.490370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de664b-6184-4f99-b1d6-277535261f79 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:22.492369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ebbce3f2-ba04-47d9-92ee-a0d5483ad5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:22.495021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c2de664b-6184-4f99-b1d6-277535261f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:22.692631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2de664b-6184-4f99-b1d6-277535261f79 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:22.706606 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2428/4837] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:22.707946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbce3f2-ba04-47d9-92ee-a0d5483ad5f8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:22.709741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:22.711938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ebbce3f2-ba04-47d9-92ee-a0d5483ad5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:22.712216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:22.712724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:22.713231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] PATH_INFO: `/v3/projects/5208480e351f4597869149ad676c7eea` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:22.719128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5208480e351f4597869149ad676c7eea)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:22.723718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:22.743757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbce3f2-ba04-47d9-92ee-a0d5483ad5f8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:22.748623 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:22.756118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726cfa8-0c9f-4249-bcae-9bb986f5c7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:22.757870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726cfa8-0c9f-4249-bcae-9bb986f5c7b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:22.759538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726cfa8-0c9f-4249-bcae-9bb986f5c7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:22.759991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9726cfa8-0c9f-4249-bcae-9bb986f5c7b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:22.760875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726cfa8-0c9f-4249-bcae-9bb986f5c7b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:22.763543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9726cfa8-0c9f-4249-bcae-9bb986f5c7b2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:22.795762 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2429/4838] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:22.798558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726cfa8-0c9f-4249-bcae-9bb986f5c7b2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:22.830907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9726cfa8-0c9f-4249-bcae-9bb986f5c7b2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:22.844807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5208480e351f4597869149ad676c7eea', 'request_id': 'req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.859665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5208480e351f4597869149ad676c7eea', 'request_id': 'req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.877598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5208480e351f4597869149ad676c7eea', 'request_id': 'req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.920451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] The token cache is being invalidate because project 5208480e351f4597869149ad676c7eea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:22.921141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.922489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:22.926301 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2410/4839] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:22 2022] DELETE /identity/v3/projects/5208480e351f4597869149ad676c7eea => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:22.927210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:22.930433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:22.970347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:22.971038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:22.972041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:22.972041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:22.972883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:22.973202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:22.976204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:23.018485 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2430/4840] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:23.021555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:23.026808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:23.069963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfb436-7813-4ee4-8989-ee3cd27869a8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:23.075681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:23.077364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:23.078647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:23.079093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] PATH_INFO: `/v3/users/a89882f4f31c4f34ac377b3737f209fe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:23.080562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a89882f4f31c4f34ac377b3737f209fe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:23.084121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:23.117001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f28178-8edc-4a56-8ed8-f4f41325a8d4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:23.135376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5d375-e201-4cbf-860e-8c2d91659ceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:23.136431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5d375-e201-4cbf-860e-8c2d91659ceb admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:23.136965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5d375-e201-4cbf-860e-8c2d91659ceb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:23.137493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f5d375-e201-4cbf-860e-8c2d91659ceb admin admin] PATH_INFO: `/v3/projects/b4663a546122409a81c03c9f7d6a9cb0/users/e1ded6da9d9841be9b9592512a004662/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:23.140151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5d375-e201-4cbf-860e-8c2d91659ceb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4663a546122409a81c03c9f7d6a9cb0, user_id=e1ded6da9d9841be9b9592512a004662, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:23.143647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f5d375-e201-4cbf-860e-8c2d91659ceb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:23.166753 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2411/4841] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:22 2022] PUT /identity/v3/projects/b4663a546122409a81c03c9f7d6a9cb0/users/e1ded6da9d9841be9b9592512a004662/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:23.168204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5d375-e201-4cbf-860e-8c2d91659ceb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:23.178610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-91f5d375-e201-4cbf-860e-8c2d91659ceb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:23.219248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a89882f4f31c4f34ac377b3737f209fe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:23.223007 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=1,keystone:DELETE=10,keystone:SELECT=89 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:23.249264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a89882f4f31c4f34ac377b3737f209fe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:23.251306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a89882f4f31c4f34ac377b3737f209fe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:23.266197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a89882f4f31c4f34ac377b3737f209fe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:23.278184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75cab6-8bed-4df0-8e9e-6c46d366218d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a89882f4f31c4f34ac377b3737f209fe'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:23.290793 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2431/4842] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:23 2022] DELETE /identity/v3/users/a89882f4f31c4f34ac377b3737f209fe => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:23.306625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49061f-9dc4-43f9-afb3-af08f9991133 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:23.306939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49061f-9dc4-43f9-afb3-af08f9991133 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:23.307567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c49061f-9dc4-43f9-afb3-af08f9991133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:23.345225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f5d375-e201-4cbf-860e-8c2d91659ceb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:23.408260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9c49061f-9dc4-43f9-afb3-af08f9991133 None None] MFA Rules not processed for user `e1ded6da9d9841be9b9592512a004662`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:23.409883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c49061f-9dc4-43f9-afb3-af08f9991133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:23.464102 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:23.508608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5651-5197-4673-8e3b-157c001480e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:23.512790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5651-5197-4673-8e3b-157c001480e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:23.513069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5651-5197-4673-8e3b-157c001480e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:23.517377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd5651-5197-4673-8e3b-157c001480e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:23.518819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd5651-5197-4673-8e3b-157c001480e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:23.527431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd5651-5197-4673-8e3b-157c001480e7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:23.613734 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2412/4843] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:23 2022] POST /identity/v3/projects => generated 375 bytes in 446 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:23.631158 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2432/4844] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:23 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:23.635574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5651-5197-4673-8e3b-157c001480e7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:23.641644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-48bd5651-5197-4673-8e3b-157c001480e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:23.658088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49061f-9dc4-43f9-afb3-af08f9991133 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:23.659672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c49061f-9dc4-43f9-afb3-af08f9991133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:23.801672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c49061f-9dc4-43f9-afb3-af08f9991133 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:23.825256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd5651-5197-4673-8e3b-157c001480e7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:23.837716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079b298-2693-48ff-9539-ebbc729806c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:23.838331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079b298-2693-48ff-9539-ebbc729806c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:23.838614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079b298-2693-48ff-9539-ebbc729806c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:23.838890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f079b298-2693-48ff-9539-ebbc729806c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:23.839532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079b298-2693-48ff-9539-ebbc729806c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:23.841511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f079b298-2693-48ff-9539-ebbc729806c8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:23.905711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2413/4845] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:23 2022] POST /identity/v3/users => generated 288 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:23.906708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079b298-2693-48ff-9539-ebbc729806c8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:23.932425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f079b298-2693-48ff-9539-ebbc729806c8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:23.936761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1be7aa-9c1b-453f-ac95-ee468ee60787 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:23.938606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be7aa-9c1b-453f-ac95-ee468ee60787 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:23.938955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be7aa-9c1b-453f-ac95-ee468ee60787 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:23.939294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1be7aa-9c1b-453f-ac95-ee468ee60787 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:23.939489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39930a9f-0d0c-4bd9-a55d-36f25a808100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:23.940098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39930a9f-0d0c-4bd9-a55d-36f25a808100 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:23.940376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39930a9f-0d0c-4bd9-a55d-36f25a808100 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:23.940647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39930a9f-0d0c-4bd9-a55d-36f25a808100 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:23.941412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39930a9f-0d0c-4bd9-a55d-36f25a808100 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:23.943215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39930a9f-0d0c-4bd9-a55d-36f25a808100 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:23.945934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c1be7aa-9c1b-453f-ac95-ee468ee60787 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:23.977793 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2414/4846] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:23.978732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39930a9f-0d0c-4bd9-a55d-36f25a808100 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:23.980673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-39930a9f-0d0c-4bd9-a55d-36f25a808100 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:23.984649 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:24.026002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39930a9f-0d0c-4bd9-a55d-36f25a808100 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:24.039500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:24.050957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:24.077874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:24.078855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] PATH_INFO: `/v3/projects/32a4c34a2f7343a198cdf0167740a32d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:24.082368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a4c34a2f7343a198cdf0167740a32d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:24.092875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:24.102290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1be7aa-9c1b-453f-ac95-ee468ee60787 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:24.107004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1be7aa-9c1b-453f-ac95-ee468ee60787 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:24.124205 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2433/4847] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:24.126872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1be7aa-9c1b-453f-ac95-ee468ee60787 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:24.149680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1be7aa-9c1b-453f-ac95-ee468ee60787 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:24.168369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fc9f3-0dd7-4358-b1a2-4f3b5d8e8ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:24.169532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fc9f3-0dd7-4358-b1a2-4f3b5d8e8ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:24.170040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fc9f3-0dd7-4358-b1a2-4f3b5d8e8ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:24.170555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fc9f3-0dd7-4358-b1a2-4f3b5d8e8ad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:24.171478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fc9f3-0dd7-4358-b1a2-4f3b5d8e8ad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:24.174583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fc9f3-0dd7-4358-b1a2-4f3b5d8e8ad5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:24.209381 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2434/4848] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:24.210905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fc9f3-0dd7-4358-b1a2-4f3b5d8e8ad5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:24.241260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fc9f3-0dd7-4358-b1a2-4f3b5d8e8ad5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:24.256125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a4c34a2f7343a198cdf0167740a32d', 'request_id': 'req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:24.263599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a4c34a2f7343a198cdf0167740a32d', 'request_id': 'req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:24.277714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a4c34a2f7343a198cdf0167740a32d', 'request_id': 'req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:24.295688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] The token cache is being invalidate because project 32a4c34a2f7343a198cdf0167740a32d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:24.296297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:24.297464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28fc4319-13cc-453f-95a9-65c2cfb6cc3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:24.299445 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2415/4849] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:23 2022] DELETE /identity/v3/projects/32a4c34a2f7343a198cdf0167740a32d => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:24.306570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d627-4c5b-46f5-8524-2540859da43c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:24.307499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d627-4c5b-46f5-8524-2540859da43c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:24.307797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc0d627-4c5b-46f5-8524-2540859da43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:24.337599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2cc0d627-4c5b-46f5-8524-2540859da43c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:24.338941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2cc0d627-4c5b-46f5-8524-2540859da43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:24.387585 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:24.441602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55d4422-8976-46bb-af7c-71f5533f265c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:24.442132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d4422-8976-46bb-af7c-71f5533f265c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:24.442414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d4422-8976-46bb-af7c-71f5533f265c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:24.442691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55d4422-8976-46bb-af7c-71f5533f265c admin admin] PATH_INFO: `/v3/projects/d5a5ed8f05734a0abc4272c34dd291b6/users/30e8e31bef1a435c97f69cce0c6d3893/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:24.479599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d4422-8976-46bb-af7c-71f5533f265c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a5ed8f05734a0abc4272c34dd291b6, user_id=30e8e31bef1a435c97f69cce0c6d3893, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:24.490243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55d4422-8976-46bb-af7c-71f5533f265c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:24.500465 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2416/4850] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:24.512175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649780f-ae3e-4622-91b8-3f82f3745a20 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:24.512175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649780f-ae3e-4622-91b8-3f82f3745a20 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:24.512175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5649780f-ae3e-4622-91b8-3f82f3745a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:24.555352 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2435/4851] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:24 2022] PUT /identity/v3/projects/d5a5ed8f05734a0abc4272c34dd291b6/users/30e8e31bef1a435c97f69cce0c6d3893/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:24.565102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1678-9416-41e5-9a74-f1507b8c312f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:24.565722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1678-9416-41e5-9a74-f1507b8c312f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:24.566241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1678-9416-41e5-9a74-f1507b8c312f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:24.612810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5649780f-ae3e-4622-91b8-3f82f3745a20 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:24.616399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5649780f-ae3e-4622-91b8-3f82f3745a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:24.628734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ed4c1678-9416-41e5-9a74-f1507b8c312f None None] MFA Rules not processed for user `30e8e31bef1a435c97f69cce0c6d3893`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:24.630266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ed4c1678-9416-41e5-9a74-f1507b8c312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:24.811937 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2436/4852] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:24.821785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1678-9416-41e5-9a74-f1507b8c312f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:24.824304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ed4c1678-9416-41e5-9a74-f1507b8c312f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:24.856418 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2417/4853] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:24.865616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649780f-ae3e-4622-91b8-3f82f3745a20 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:24.888473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5649780f-ae3e-4622-91b8-3f82f3745a20 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:24.905585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e45492-9006-4b62-b4d4-51972c816a84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:24.906396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e45492-9006-4b62-b4d4-51972c816a84 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:24.911631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e45492-9006-4b62-b4d4-51972c816a84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:24.912043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e45492-9006-4b62-b4d4-51972c816a84 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:24.912715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e45492-9006-4b62-b4d4-51972c816a84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:24.913005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e45492-9006-4b62-b4d4-51972c816a84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:24.914688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e45492-9006-4b62-b4d4-51972c816a84 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:24.935303 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:24.985993 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2418/4854] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:24.988592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e45492-9006-4b62-b4d4-51972c816a84 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:25.009657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e45492-9006-4b62-b4d4-51972c816a84 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:25.014669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f579301-81d8-48c4-a7a5-081c437a87cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:25.015404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f579301-81d8-48c4-a7a5-081c437a87cf admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:25.015695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f579301-81d8-48c4-a7a5-081c437a87cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:25.016101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f579301-81d8-48c4-a7a5-081c437a87cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:25.016802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f579301-81d8-48c4-a7a5-081c437a87cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:25.019025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f579301-81d8-48c4-a7a5-081c437a87cf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:25.054964 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2419/4855] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:24 2022] POST /identity/v3/projects => generated 379 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:25.059333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f579301-81d8-48c4-a7a5-081c437a87cf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:25.102268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1678-9416-41e5-9a74-f1507b8c312f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:25.179271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f579301-81d8-48c4-a7a5-081c437a87cf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:25.190572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005f9d8-4b0e-45bb-a5e0-b22ddd4ecd16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:25.191351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005f9d8-4b0e-45bb-a5e0-b22ddd4ecd16 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:25.191763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005f9d8-4b0e-45bb-a5e0-b22ddd4ecd16 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:25.192142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f005f9d8-4b0e-45bb-a5e0-b22ddd4ecd16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:25.195523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33c80d-b26e-451e-9945-5130ac5b14db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:25.196516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33c80d-b26e-451e-9945-5130ac5b14db admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:25.197037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33c80d-b26e-451e-9945-5130ac5b14db admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:25.197788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a33c80d-b26e-451e-9945-5130ac5b14db admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:25.198790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33c80d-b26e-451e-9945-5130ac5b14db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:25.204259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a33c80d-b26e-451e-9945-5130ac5b14db admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:25.264393 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2420/4856] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:25 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:25.268304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33c80d-b26e-451e-9945-5130ac5b14db admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:25.292137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a33c80d-b26e-451e-9945-5130ac5b14db admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:25.293869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005f9d8-4b0e-45bb-a5e0-b22ddd4ecd16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:25.295986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f005f9d8-4b0e-45bb-a5e0-b22ddd4ecd16 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:25.305846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37753178-a8ea-4434-9787-442d613c532f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:25.306940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37753178-a8ea-4434-9787-442d613c532f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:25.307425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37753178-a8ea-4434-9787-442d613c532f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:25.308046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37753178-a8ea-4434-9787-442d613c532f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:25.308963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37753178-a8ea-4434-9787-442d613c532f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:25.310992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37753178-a8ea-4434-9787-442d613c532f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:25.327216 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2421/4857] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:25.329060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37753178-a8ea-4434-9787-442d613c532f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:25.346188 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2437/4858] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:25.349340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37753178-a8ea-4434-9787-442d613c532f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:25.360387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa99a25-024c-48a2-b191-28f04829a180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:25.363177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa99a25-024c-48a2-b191-28f04829a180 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:25.363177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa99a25-024c-48a2-b191-28f04829a180 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:25.363177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa99a25-024c-48a2-b191-28f04829a180 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:25.364774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa99a25-024c-48a2-b191-28f04829a180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:25.369068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa99a25-024c-48a2-b191-28f04829a180 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:25.407439 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2422/4859] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:25.407856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005f9d8-4b0e-45bb-a5e0-b22ddd4ecd16 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:25.432540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f005f9d8-4b0e-45bb-a5e0-b22ddd4ecd16 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:25.446448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91254a-c15a-4c28-a813-dc48a7029b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:25.447133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91254a-c15a-4c28-a813-dc48a7029b37 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:25.447410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91254a-c15a-4c28-a813-dc48a7029b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:25.448045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91254a-c15a-4c28-a813-dc48a7029b37 admin admin] PATH_INFO: `/v3/projects/68d5c998dfc84f7095ffa41bcee90a7c/users/fbb0eb733f7443399dda4149fffc7042/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:25.529399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91254a-c15a-4c28-a813-dc48a7029b37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68d5c998dfc84f7095ffa41bcee90a7c, user_id=fbb0eb733f7443399dda4149fffc7042, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:25.534422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91254a-c15a-4c28-a813-dc48a7029b37 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:25.564789 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2438/4860] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:25 2022] PUT /identity/v3/projects/68d5c998dfc84f7095ffa41bcee90a7c/users/fbb0eb733f7443399dda4149fffc7042/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:25.576784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e929-b788-4ea8-9d00-8a0e44876ed2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:25.576998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e929-b788-4ea8-9d00-8a0e44876ed2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:25.577248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a8e929-b788-4ea8-9d00-8a0e44876ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:25.590008 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:25.648573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-74a8e929-b788-4ea8-9d00-8a0e44876ed2 None None] MFA Rules not processed for user `fbb0eb733f7443399dda4149fffc7042`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:25.649840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-74a8e929-b788-4ea8-9d00-8a0e44876ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:25.695958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91254a-c15a-4c28-a813-dc48a7029b37 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:25.697831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a91254a-c15a-4c28-a813-dc48a7029b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:25.793221 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2423/4861] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:25.801596 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:25.806696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8e929-b788-4ea8-9d00-8a0e44876ed2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:25.820257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-74a8e929-b788-4ea8-9d00-8a0e44876ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:25.903073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91254a-c15a-4c28-a813-dc48a7029b37 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:25.920056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:25.921154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:25.921481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:25.921846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] PATH_INFO: `/v3/users/30e8e31bef1a435c97f69cce0c6d3893` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:25.925399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e8e31bef1a435c97f69cce0c6d3893)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:25.931385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:25.996958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a8e929-b788-4ea8-9d00-8a0e44876ed2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:26.002382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fa17a4-476c-42d8-9887-5fb7488a456f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:26.003548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa17a4-476c-42d8-9887-5fb7488a456f service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:26.004071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa17a4-476c-42d8-9887-5fb7488a456f service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:26.005263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fa17a4-476c-42d8-9887-5fb7488a456f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:26.017571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa17a4-476c-42d8-9887-5fb7488a456f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:26.019484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fa17a4-476c-42d8-9887-5fb7488a456f service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:26.039290 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2424/4862] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:26.089580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e8e31bef1a435c97f69cce0c6d3893'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:26.128551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e8e31bef1a435c97f69cce0c6d3893'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:26.132903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e8e31bef1a435c97f69cce0c6d3893'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:26.153585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e8e31bef1a435c97f69cce0c6d3893'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:26.175741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e8e31bef1a435c97f69cce0c6d3893'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:26.205752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9038-ae20-4661-a98d-a0e1c7b98638 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:26.206254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9038-ae20-4661-a98d-a0e1c7b98638 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:26.206710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e9038-ae20-4661-a98d-a0e1c7b98638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:26.206849 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2439/4863] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:25 2022] DELETE /identity/v3/users/30e8e31bef1a435c97f69cce0c6d3893 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:26.245629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e10e9038-ae20-4661-a98d-a0e1c7b98638 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:26.247231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e10e9038-ae20-4661-a98d-a0e1c7b98638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:26.408519 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2425/4864] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:26.418275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:26.421333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:26.554084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bbcd29-c1dc-487e-b177-dd6036576641 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:26.580095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871d840-3276-466a-9aff-2349bb5d8fb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:26.581330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871d840-3276-466a-9aff-2349bb5d8fb9 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:26.581908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871d840-3276-466a-9aff-2349bb5d8fb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:26.582386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1871d840-3276-466a-9aff-2349bb5d8fb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:26.611440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871d840-3276-466a-9aff-2349bb5d8fb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:26.615890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1871d840-3276-466a-9aff-2349bb5d8fb9 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:26.660938 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2440/4865] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:27.914314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e9038-ae20-4661-a98d-a0e1c7b98638 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:27.920538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e10e9038-ae20-4661-a98d-a0e1c7b98638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:27.965413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e9038-ae20-4661-a98d-a0e1c7b98638 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:27.977155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:27.978229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:27.978680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:27.979210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] PATH_INFO: `/v3/projects/d5a5ed8f05734a0abc4272c34dd291b6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:27.981519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a5ed8f05734a0abc4272c34dd291b6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:27.985055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:28.087691 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:28.142236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a5ed8f05734a0abc4272c34dd291b6', 'request_id': 'req-35488d4a-b623-4a0e-b96b-65f6231f4534'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:28.143493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871d840-3276-466a-9aff-2349bb5d8fb9 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:28.148865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1871d840-3276-466a-9aff-2349bb5d8fb9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:28.164129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a5ed8f05734a0abc4272c34dd291b6', 'request_id': 'req-35488d4a-b623-4a0e-b96b-65f6231f4534'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:28.187879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a5ed8f05734a0abc4272c34dd291b6', 'request_id': 'req-35488d4a-b623-4a0e-b96b-65f6231f4534'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:28.222195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] The token cache is being invalidate because project d5a5ed8f05734a0abc4272c34dd291b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:28.222491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:28.225862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35488d4a-b623-4a0e-b96b-65f6231f4534 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:28.229541 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2426/4866] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:27 2022] DELETE /identity/v3/projects/d5a5ed8f05734a0abc4272c34dd291b6 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:28.235860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a15f7-ab47-4cac-bef9-a8a1c8d8a183 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:28.236068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a15f7-ab47-4cac-bef9-a8a1c8d8a183 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:28.236202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60a15f7-ab47-4cac-bef9-a8a1c8d8a183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:28.252110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1871d840-3276-466a-9aff-2349bb5d8fb9 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:28.277670 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:28.278802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a60a15f7-ab47-4cac-bef9-a8a1c8d8a183 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:28.281630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a60a15f7-ab47-4cac-bef9-a8a1c8d8a183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:28.359466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5514b7b-ddc5-413b-b4e8-045472185592 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:28.360266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5514b7b-ddc5-413b-b4e8-045472185592 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:28.360779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5514b7b-ddc5-413b-b4e8-045472185592 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:28.361063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5514b7b-ddc5-413b-b4e8-045472185592 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:28.362952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a5514b7b-ddc5-413b-b4e8-045472185592 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:28.423060 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2427/4867] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:28.440353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771786-ca01-40c0-aa4d-c54c613aaa25 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:28.442071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771786-ca01-40c0-aa4d-c54c613aaa25 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:28.442427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55771786-ca01-40c0-aa4d-c54c613aaa25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:28.466641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5514b7b-ddc5-413b-b4e8-045472185592 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:28.468114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5514b7b-ddc5-413b-b4e8-045472185592 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:28.493476 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2441/4868] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:28.519097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-55771786-ca01-40c0-aa4d-c54c613aaa25 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:28.520479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-55771786-ca01-40c0-aa4d-c54c613aaa25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:28.542741 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2428/4869] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:28.554528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5514b7b-ddc5-413b-b4e8-045472185592 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:28.585662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5514b7b-ddc5-413b-b4e8-045472185592 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:28.602268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a68d7-608f-4998-a78e-ff7d98a72ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:28.603157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a68d7-608f-4998-a78e-ff7d98a72ebf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:28.603645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a68d7-608f-4998-a78e-ff7d98a72ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:28.604175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670a68d7-608f-4998-a78e-ff7d98a72ebf admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:28.605059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a68d7-608f-4998-a78e-ff7d98a72ebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:28.605642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a68d7-608f-4998-a78e-ff7d98a72ebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:28.607657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670a68d7-608f-4998-a78e-ff7d98a72ebf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:28.636249 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2442/4870] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:28.640198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55771786-ca01-40c0-aa4d-c54c613aaa25 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:28.655526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55771786-ca01-40c0-aa4d-c54c613aaa25 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:28.672455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233073-0c7f-48cf-82b8-4d4823996df8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:28.673528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233073-0c7f-48cf-82b8-4d4823996df8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:28.673918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233073-0c7f-48cf-82b8-4d4823996df8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:28.674300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0233073-0c7f-48cf-82b8-4d4823996df8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:28.675052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0233073-0c7f-48cf-82b8-4d4823996df8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:28.677431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0233073-0c7f-48cf-82b8-4d4823996df8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:28.774529 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2429/4871] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:28 2022] POST /identity/v3/projects => generated 381 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:28.795107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a68d7-608f-4998-a78e-ff7d98a72ebf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:28.821329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670a68d7-608f-4998-a78e-ff7d98a72ebf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:28.958159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016fbf0-594a-4122-a24a-4351cd3d4d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:28.958849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016fbf0-594a-4122-a24a-4351cd3d4d03 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:28.959136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016fbf0-594a-4122-a24a-4351cd3d4d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:28.959416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9016fbf0-594a-4122-a24a-4351cd3d4d03 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:28.960057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016fbf0-594a-4122-a24a-4351cd3d4d03 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:28.966909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9016fbf0-594a-4122-a24a-4351cd3d4d03 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:29.020543 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2443/4872] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:28 2022] POST /identity/v3/users => generated 291 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:29.024638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233073-0c7f-48cf-82b8-4d4823996df8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:29.039579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0233073-0c7f-48cf-82b8-4d4823996df8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:29.051296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33af5a8-bebc-4a67-a4e4-213a838be155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:29.051925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33af5a8-bebc-4a67-a4e4-213a838be155 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:29.052204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33af5a8-bebc-4a67-a4e4-213a838be155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:29.052482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33af5a8-bebc-4a67-a4e4-213a838be155 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:29.053131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33af5a8-bebc-4a67-a4e4-213a838be155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:29.055052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33af5a8-bebc-4a67-a4e4-213a838be155 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:29.071095 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2430/4873] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:29.072291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016fbf0-594a-4122-a24a-4351cd3d4d03 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:29.088076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9016fbf0-594a-4122-a24a-4351cd3d4d03 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:29.095272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995da367-7b33-40c2-95e9-4290312251c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:29.096157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da367-7b33-40c2-95e9-4290312251c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:29.096631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da367-7b33-40c2-95e9-4290312251c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:29.096911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995da367-7b33-40c2-95e9-4290312251c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:29.097591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da367-7b33-40c2-95e9-4290312251c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:29.099359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995da367-7b33-40c2-95e9-4290312251c1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:29.114441 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2444/4874] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:29.118460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33af5a8-bebc-4a67-a4e4-213a838be155 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:29.130204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33af5a8-bebc-4a67-a4e4-213a838be155 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:29.136200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529cd09-e2a5-4e4a-8f8e-7ac86c1f19d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:29.137068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529cd09-e2a5-4e4a-8f8e-7ac86c1f19d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:29.137464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529cd09-e2a5-4e4a-8f8e-7ac86c1f19d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:29.137818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4529cd09-e2a5-4e4a-8f8e-7ac86c1f19d6 admin admin] PATH_INFO: `/v3/projects/124a526abd874d099ffc568eb0098574/users/46bad9fee47a43b4a68c9c4e3d34fbb3/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:29.162494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529cd09-e2a5-4e4a-8f8e-7ac86c1f19d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=124a526abd874d099ffc568eb0098574, user_id=46bad9fee47a43b4a68c9c4e3d34fbb3, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:29.166784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4529cd09-e2a5-4e4a-8f8e-7ac86c1f19d6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:29.192210 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2431/4875] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:29 2022] PUT /identity/v3/projects/124a526abd874d099ffc568eb0098574/users/46bad9fee47a43b4a68c9c4e3d34fbb3/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:29.203505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8ee59-b8e0-4c6b-88ed-41d001eeb2ea None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:29.204394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8ee59-b8e0-4c6b-88ed-41d001eeb2ea None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:29.204839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c8ee59-b8e0-4c6b-88ed-41d001eeb2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:29.251424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-71c8ee59-b8e0-4c6b-88ed-41d001eeb2ea None None] MFA Rules not processed for user `46bad9fee47a43b4a68c9c4e3d34fbb3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:29.253134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-71c8ee59-b8e0-4c6b-88ed-41d001eeb2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:29.276525 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:29.367103 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2445/4876] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:29 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:29.368526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529cd09-e2a5-4e4a-8f8e-7ac86c1f19d6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:29.484773 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:29.492504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4529cd09-e2a5-4e4a-8f8e-7ac86c1f19d6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:29.510778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997339b6-2de8-4916-8791-82351b837016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:29.511755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997339b6-2de8-4916-8791-82351b837016 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:29.512251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997339b6-2de8-4916-8791-82351b837016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:29.512788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997339b6-2de8-4916-8791-82351b837016 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:29.513657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997339b6-2de8-4916-8791-82351b837016 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:29.516246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997339b6-2de8-4916-8791-82351b837016 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:29.592727 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2432/4877] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:29 2022] POST /identity/v3/projects => generated 381 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:29.597219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8ee59-b8e0-4c6b-88ed-41d001eeb2ea None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:29.623952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c8ee59-b8e0-4c6b-88ed-41d001eeb2ea None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:29.748913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52824ca4-2f09-4512-9327-7b7cbf9bfd5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:29.750260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52824ca4-2f09-4512-9327-7b7cbf9bfd5f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:29.750701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52824ca4-2f09-4512-9327-7b7cbf9bfd5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:29.751038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52824ca4-2f09-4512-9327-7b7cbf9bfd5f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:29.751845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52824ca4-2f09-4512-9327-7b7cbf9bfd5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:29.754193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52824ca4-2f09-4512-9327-7b7cbf9bfd5f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:29.829760 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2446/4878] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:29 2022] POST /identity/v3/users => generated 297 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:29.834173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997339b6-2de8-4916-8791-82351b837016 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:29.847573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997339b6-2de8-4916-8791-82351b837016 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:29.853106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e46aa8-e8ec-40fc-be79-5ebc2362db68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:29.853906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46aa8-e8ec-40fc-be79-5ebc2362db68 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:29.854177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46aa8-e8ec-40fc-be79-5ebc2362db68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:29.854455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e46aa8-e8ec-40fc-be79-5ebc2362db68 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:29.855419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e46aa8-e8ec-40fc-be79-5ebc2362db68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:29.857054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e46aa8-e8ec-40fc-be79-5ebc2362db68 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:29.892557 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2433/4879] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:29.893750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52824ca4-2f09-4512-9327-7b7cbf9bfd5f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:29.912383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52824ca4-2f09-4512-9327-7b7cbf9bfd5f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:29.932328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93e265-03ce-4490-a7a8-55ff21be936e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:29.933015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93e265-03ce-4490-a7a8-55ff21be936e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:29.933417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93e265-03ce-4490-a7a8-55ff21be936e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:29.933609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef93e265-03ce-4490-a7a8-55ff21be936e admin admin] PATH_INFO: `/v3/projects/6f8fa16c099f4fcea5c3f90893905dfc/users/3c67e08d6bc64802bc10da30b376067f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:29.978519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93e265-03ce-4490-a7a8-55ff21be936e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8fa16c099f4fcea5c3f90893905dfc, user_id=3c67e08d6bc64802bc10da30b376067f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:29.983954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef93e265-03ce-4490-a7a8-55ff21be936e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:30.023892 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2447/4880] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:29 2022] PUT /identity/v3/projects/6f8fa16c099f4fcea5c3f90893905dfc/users/3c67e08d6bc64802bc10da30b376067f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:30.028262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e46aa8-e8ec-40fc-be79-5ebc2362db68 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:30.042683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e46aa8-e8ec-40fc-be79-5ebc2362db68 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:30.252845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38281f74-b593-4717-add4-d463aaaf3150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:30.259758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38281f74-b593-4717-add4-d463aaaf3150 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:30.261962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38281f74-b593-4717-add4-d463aaaf3150 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:30.262513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38281f74-b593-4717-add4-d463aaaf3150 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:30.267991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38281f74-b593-4717-add4-d463aaaf3150 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:30.275753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38281f74-b593-4717-add4-d463aaaf3150 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:30.306796 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2434/4881] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:30.307048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93e265-03ce-4490-a7a8-55ff21be936e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:30.330786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef93e265-03ce-4490-a7a8-55ff21be936e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:30.347485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67819b06-d5bc-4c1e-bdbb-5f1cb3eb5b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:30.348167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67819b06-d5bc-4c1e-bdbb-5f1cb3eb5b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:30.348458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67819b06-d5bc-4c1e-bdbb-5f1cb3eb5b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:30.348718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67819b06-d5bc-4c1e-bdbb-5f1cb3eb5b5a admin admin] PATH_INFO: `/v3/projects/6f8fa16c099f4fcea5c3f90893905dfc/users/3c67e08d6bc64802bc10da30b376067f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:30.357959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67819b06-d5bc-4c1e-bdbb-5f1cb3eb5b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f8fa16c099f4fcea5c3f90893905dfc, user_id=3c67e08d6bc64802bc10da30b376067f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:30.366046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67819b06-d5bc-4c1e-bdbb-5f1cb3eb5b5a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:30.401778 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2448/4882] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:30 2022] PUT /identity/v3/projects/6f8fa16c099f4fcea5c3f90893905dfc/users/3c67e08d6bc64802bc10da30b376067f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:30.414865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfed4d8-3a5c-447a-81c5-de4cf409115f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:30.415524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfed4d8-3a5c-447a-81c5-de4cf409115f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:30.416302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfed4d8-3a5c-447a-81c5-de4cf409115f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:30.502134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-edfed4d8-3a5c-447a-81c5-de4cf409115f None None] MFA Rules not processed for user `3c67e08d6bc64802bc10da30b376067f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:30.503802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-edfed4d8-3a5c-447a-81c5-de4cf409115f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:30.709860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2435/4883] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:30 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:30.711557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67819b06-d5bc-4c1e-bdbb-5f1cb3eb5b5a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:30.731844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67819b06-d5bc-4c1e-bdbb-5f1cb3eb5b5a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:30.738033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d904-d711-4f15-9b47-c2d13b190381 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:30.738762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d904-d711-4f15-9b47-c2d13b190381 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:30.739741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d904-d711-4f15-9b47-c2d13b190381 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:30.740400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c5d904-d711-4f15-9b47-c2d13b190381 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:30.748021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d904-d711-4f15-9b47-c2d13b190381 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:30.750871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c5d904-d711-4f15-9b47-c2d13b190381 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-47c5d904-d711-4f15-9b47-c2d13b190381 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invalid input for field 'name': '' is too short Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'minLength' in schema['properties']['name']: Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: On instance['name']: Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'minLength' in schema['properties']['name']: Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: On instance['name']: Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: '' Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise error Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['name']: Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application '' Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:30.783332 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 24 09:16:30.785399 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 24 09:16:30.786812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 24 09:16:30.786812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 24 09:16:30.786812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:30.786812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 24 09:16:30.786812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:16:30.786812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:30.786812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['name']: Oct 24 09:16:30.786812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application '' Oct 24 09:16:30.786812 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:30.788119 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2449/4884] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:30 2022] POST /identity/v3/domains => generated 283 bytes in 77 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 24 09:16:30.799895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfed4d8-3a5c-447a-81c5-de4cf409115f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:30.825203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfed4d8-3a5c-447a-81c5-de4cf409115f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:30.837988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:30.838748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:30.838918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:30.839210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:30.841567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:30.844223 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:30.844223 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:16:30.844223 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:16:30.845138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: Failed validating 'maxLength' in schema['properties']['name']: Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: On instance['name']: Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: Failed validating 'maxLength' in schema['properties']['name']: Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: On instance['name']: Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise error Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:16:30.862369 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application On instance['name']: Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 115, in post Oct 24 09:16:30.863889 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application validation.lazy_validate(schema.domain_create, domain) Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application On instance['name']: Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 09:16:30.865143 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:30.872615 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2436/4885] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:30 2022] POST /identity/v3/domains => generated 412 bytes in 73 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 24 09:16:30.878704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d904-d711-4f15-9b47-c2d13b190381 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:30.897837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c5d904-d711-4f15-9b47-c2d13b190381 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:30.913090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d1f3-2fc4-4aae-b0f7-7b50fd5283fa tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:30.913862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d1f3-2fc4-4aae-b0f7-7b50fd5283fa tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:30.914252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d1f3-2fc4-4aae-b0f7-7b50fd5283fa tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:30.914636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2753d1f3-2fc4-4aae-b0f7-7b50fd5283fa tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:30.915425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d1f3-2fc4-4aae-b0f7-7b50fd5283fa tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:30.917200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2753d1f3-2fc4-4aae-b0f7-7b50fd5283fa tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:30.956487 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2450/4886] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:30 2022] POST /identity/v3/domains => generated 276 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:30.960408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:30.978910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1abe6c3-8715-479a-ac27-0d8b9deac57e tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:31.098023 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:31.128017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:31.129202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:31.129798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:31.130323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains/b42a54d7634947f0b32414c4a3022242` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:31.154056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b42a54d7634947f0b32414c4a3022242)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:31.156531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Cannot delete a domain that is enabled, please disable it first.: keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 151, in delete Oct 24 09:16:31.181258 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_domain( Oct 24 09:16:31.182481 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:16:31.182481 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:16:31.182481 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 802, in delete_domain Oct 24 09:16:31.182481 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._delete_domain(domain, initiator) Oct 24 09:16:31.182481 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 815, in _delete_domain Oct 24 09:16:31.182481 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ForbiddenNotSecurity( Oct 24 09:16:31.182481 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ForbiddenNotSecurity: Cannot delete a domain that is enabled, please disable it first. Oct 24 09:16:31.182481 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:31.187030 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2437/4887] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:16:30 2022] DELETE /identity/v3/domains/b42a54d7634947f0b32414c4a3022242 => generated 120 bytes in 227 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:16:31.188733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d1f3-2fc4-4aae-b0f7-7b50fd5283fa tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:31.200238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2753d1f3-2fc4-4aae-b0f7-7b50fd5283fa tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:31.206042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:31.214214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:31.215179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:31.215179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains/b42a54d7634947f0b32414c4a3022242` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:31.217329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=b42a54d7634947f0b32414c4a3022242)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:31.219142 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:31.219142 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:31.219142 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:31.221441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:31.245168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'b42a54d7634947f0b32414c4a3022242'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.245959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'b42a54d7634947f0b32414c4a3022242'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.313748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'b42a54d7634947f0b32414c4a3022242'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.315364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'b42a54d7634947f0b32414c4a3022242'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.319285 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2451/4888] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:16:31 2022] PATCH /identity/v3/domains/b42a54d7634947f0b32414c4a3022242 => generated 277 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:31.323177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:31.325155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:31.350239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a9cf7d-5c80-44f3-89a2-1b42ba283285 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:31.531145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:31.531909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:31.532296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:31.532722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains/b42a54d7634947f0b32414c4a3022242` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:31.567857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=b42a54d7634947f0b32414c4a3022242)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:31.569919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:31.626537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'b42a54d7634947f0b32414c4a3022242'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.643512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'b42a54d7634947f0b32414c4a3022242'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.805517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b42a54d7634947f0b32414c4a3022242', 'request_id': 'req-629c9aa7-c702-4e2e-9426-4444164060ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.831138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b42a54d7634947f0b32414c4a3022242', 'request_id': 'req-629c9aa7-c702-4e2e-9426-4444164060ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.852618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b42a54d7634947f0b32414c4a3022242', 'request_id': 'req-629c9aa7-c702-4e2e-9426-4444164060ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.893124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] The token cache is being invalidate because project b42a54d7634947f0b32414c4a3022242 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:31.896271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.898603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.947434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'b42a54d7634947f0b32414c4a3022242', 'request_id': 'req-629c9aa7-c702-4e2e-9426-4444164060ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.956789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'b42a54d7634947f0b32414c4a3022242', 'request_id': 'req-629c9aa7-c702-4e2e-9426-4444164060ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.957582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-629c9aa7-c702-4e2e-9426-4444164060ab tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'b42a54d7634947f0b32414c4a3022242', 'request_id': 'req-629c9aa7-c702-4e2e-9426-4444164060ab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:31.972794 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2438/4889] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:16:31 2022] DELETE /identity/v3/domains/b42a54d7634947f0b32414c4a3022242 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:31.974259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:31.994138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fff93-7146-49e2-aa5d-864dbd08966c tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:32.022196 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:32.161462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309d46-d615-42aa-ad5a-1d1858e957a9 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:32.166042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309d46-d615-42aa-ad5a-1d1858e957a9 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:32.166623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309d46-d615-42aa-ad5a-1d1858e957a9 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:32.167177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b309d46-d615-42aa-ad5a-1d1858e957a9 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains/869df48be77b4adc8f64bb8cc9c85570` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:32.184069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b309d46-d615-42aa-ad5a-1d1858e957a9 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-9b309d46-d615-42aa-ad5a-1d1858e957a9 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Could not find domain: 869df48be77b4adc8f64bb8cc9c85570.: keystone.exception.DomainNotFound: Could not find domain: 869df48be77b4adc8f64bb8cc9c85570. Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 869df48be77b4adc8f64bb8cc9c85570. Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:16:32.198215 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 150, in delete Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_domain') Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:16:32.199431 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:16:32.200563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 869df48be77b4adc8f64bb8cc9c85570. Oct 24 09:16:32.201870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.204780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472dbc-c032-42d7-a7f2-42dd2f24ce90 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:32.205316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472dbc-c032-42d7-a7f2-42dd2f24ce90 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:32.206945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2452/4890] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:16:31 2022] DELETE /identity/v3/domains/869df48be77b4adc8f64bb8cc9c85570 => generated 112 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:16:32.214193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309d46-d615-42aa-ad5a-1d1858e957a9 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:32.215068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1472dbc-c032-42d7-a7f2-42dd2f24ce90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:32.216869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9b309d46-d615-42aa-ad5a-1d1858e957a9 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:32.243847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b309d46-d615-42aa-ad5a-1d1858e957a9 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:32.257503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865f48-42db-416a-afb2-700abfe5e820 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:32.258378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865f48-42db-416a-afb2-700abfe5e820 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:32.258724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865f48-42db-416a-afb2-700abfe5e820 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:32.259088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb865f48-42db-416a-afb2-700abfe5e820 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:32.259816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865f48-42db-416a-afb2-700abfe5e820 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:32.264017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb865f48-42db-416a-afb2-700abfe5e820 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:32.268716 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:32.292028 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2453/4891] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:32 2022] POST /identity/v3/domains => generated 253 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:32.298092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865f48-42db-416a-afb2-700abfe5e820 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:32.298326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c1472dbc-c032-42d7-a7f2-42dd2f24ce90 None None] MFA Rules not processed for user `2f12eb63d7194738b3272197d4894871`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:32.306984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1472dbc-c032-42d7-a7f2-42dd2f24ce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:32.412944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb865f48-42db-416a-afb2-700abfe5e820 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:32.419494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:32.420651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:32.421159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:32.421707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:32.422595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:32.424540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:32.461151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1661945934' for key 'project.ixu_project_name_domain_id'") Oct 24 09:16:32.461151 n-d-master-1 devstack@keystone.service[88312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 09:16:32.461151 n-d-master-1 devstack@keystone.service[88312]: [parameters: {'id': '3256fe06a9fa455bbc6e0109c919c582', 'name': 'tempest-domain-dup-1661945934', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 09:16:32.461151 n-d-master-1 devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1661945934.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1661945934. Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 09:16:32.469563 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-tempest-domain-dup-1661945934' for key 'project.ixu_project_name_domain_id'") Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 09:16:32.470870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 24 09:16:32.472391 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 09:16:32.474010 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 09:16:32.475524 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 09:16:32.476796 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-tempest-domain-dup-1661945934' for key 'project.ixu_project_name_domain_id'") Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'id': '3256fe06a9fa455bbc6e0109c919c582', 'name': 'tempest-domain-dup-1661945934', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.478282 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-domain-dup-1661945934. Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:16:32.480647 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: tempest-domain-dup-1661945934. Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:32.484621 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2454/4892] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:32 2022] POST /identity/v3/domains => generated 212 bytes in 183 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 09:16:32.486659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:32.508249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d35f9-fcf9-4d63-b4cb-6cfcc0e8258b tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:32.515188 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2439/4893] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:32 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:32.522642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:32.523384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:32.523770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:32.524240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains/1696f606efc74aa1a33e9717ce729238` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:32.526851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472dbc-c032-42d7-a7f2-42dd2f24ce90 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:32.528527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1472dbc-c032-42d7-a7f2-42dd2f24ce90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:32.544628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=1696f606efc74aa1a33e9717ce729238)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:32.548193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:32.600945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '1696f606efc74aa1a33e9717ce729238'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:32.601835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '1696f606efc74aa1a33e9717ce729238'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:32.632570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1472dbc-c032-42d7-a7f2-42dd2f24ce90 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:32.653593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '1696f606efc74aa1a33e9717ce729238'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:32.654364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '1696f606efc74aa1a33e9717ce729238'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:32.660103 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2455/4894] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:16:32 2022] PATCH /identity/v3/domains/1696f606efc74aa1a33e9717ce729238 => generated 254 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:32.663863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:32.665221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:32.734498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a69e-1fb4-4a9a-b267-7b02641ceb03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:32.734940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a69e-1fb4-4a9a-b267-7b02641ceb03 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:32.735218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a69e-1fb4-4a9a-b267-7b02641ceb03 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:32.735492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9049a69e-1fb4-4a9a-b267-7b02641ceb03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:32.737259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9049a69e-1fb4-4a9a-b267-7b02641ceb03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:32.783891 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:32.837281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049a69e-1fb4-4a9a-b267-7b02641ceb03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:32.840041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e69d7-0753-4aa4-b592-c213a308f665 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:32.842593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9049a69e-1fb4-4a9a-b267-7b02641ceb03 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:32.846305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:32.846946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:32.847228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:32.847498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains/1696f606efc74aa1a33e9717ce729238` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:32.871587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=1696f606efc74aa1a33e9717ce729238)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:32.873186 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:32.873186 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:32.873186 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:32.875162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:32.890805 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2440/4895] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:32.990476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '1696f606efc74aa1a33e9717ce729238'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.023847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '1696f606efc74aa1a33e9717ce729238'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.262015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1696f606efc74aa1a33e9717ce729238', 'request_id': 'req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.275319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1696f606efc74aa1a33e9717ce729238', 'request_id': 'req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.308111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1696f606efc74aa1a33e9717ce729238', 'request_id': 'req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.336044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] The token cache is being invalidate because project 1696f606efc74aa1a33e9717ce729238 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:33.338293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.339256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.386984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '1696f606efc74aa1a33e9717ce729238', 'request_id': 'req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.388038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '1696f606efc74aa1a33e9717ce729238', 'request_id': 'req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.388936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '1696f606efc74aa1a33e9717ce729238', 'request_id': 'req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.401342 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2456/4896] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:16:32 2022] DELETE /identity/v3/domains/1696f606efc74aa1a33e9717ce729238 => generated 0 bytes in 738 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:33.405883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a69e-1fb4-4a9a-b267-7b02641ceb03 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:33.420777 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:33.432547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9049a69e-1fb4-4a9a-b267-7b02641ceb03 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:33.543665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e3e395-de40-4059-accb-69ec37262188 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c67e08d6bc64802bc10da30b376067f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6f8fa16c099f4fcea5c3f90893905dfc', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:33.544626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e395-de40-4059-accb-69ec37262188 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:33.545128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e395-de40-4059-accb-69ec37262188 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:33.545893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e3e395-de40-4059-accb-69ec37262188 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] PATH_INFO: `/v3/domains/b42a54d7634947f0b32414c4a3022242` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:33.560456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e3e395-de40-4059-accb-69ec37262188 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-73e3e395-de40-4059-accb-69ec37262188 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Could not find domain: b42a54d7634947f0b32414c4a3022242.: keystone.exception.DomainNotFound: Could not find domain: b42a54d7634947f0b32414c4a3022242. Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: b42a54d7634947f0b32414c4a3022242. Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:16:33.583007 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:16:33.584505 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:16:33.585799 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: b42a54d7634947f0b32414c4a3022242. Oct 24 09:16:33.587933 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:16:33.592648 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2441/4897] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:16:33 2022] PATCH /identity/v3/domains/b42a54d7634947f0b32414c4a3022242 => generated 112 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:16:33.596885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:33.598369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:33.815839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c77b1e-00a8-4293-b50e-ad5ebff1ba63 tempest-DomainsNegativeTestJSON-391927059 tempest-DomainsNegativeTestJSON-391927059-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:33.834686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:33.835375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:33.835676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:33.835930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] PATH_INFO: `/v3/users/46bad9fee47a43b4a68c9c4e3d34fbb3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:33.837282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bad9fee47a43b4a68c9c4e3d34fbb3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:33.839581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:33.891791 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:33.936797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bad9fee47a43b4a68c9c4e3d34fbb3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.965472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bad9fee47a43b4a68c9c4e3d34fbb3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.969759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bad9fee47a43b4a68c9c4e3d34fbb3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:33.983545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bad9fee47a43b4a68c9c4e3d34fbb3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:34.029161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bad9fee47a43b4a68c9c4e3d34fbb3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:34.051174 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2457/4898] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:33 2022] DELETE /identity/v3/users/46bad9fee47a43b4a68c9c4e3d34fbb3 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:34.057856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f150a4-3ffb-4060-b391-a2c70ad0a5eb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:34.058591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f150a4-3ffb-4060-b391-a2c70ad0a5eb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:34.059001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f150a4-3ffb-4060-b391-a2c70ad0a5eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:34.096264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c1f150a4-3ffb-4060-b391-a2c70ad0a5eb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:34.097761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1f150a4-3ffb-4060-b391-a2c70ad0a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:34.207545 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2442/4899] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:34.213523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:34.215074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:34.407745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a2e93a-9b48-4aa0-9a98-192799a6b65d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:34.413032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533dc90-2002-4ed9-b106-9d12f1d420cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:34.417995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533dc90-2002-4ed9-b106-9d12f1d420cc service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:34.418368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533dc90-2002-4ed9-b106-9d12f1d420cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:34.418715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7533dc90-2002-4ed9-b106-9d12f1d420cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:34.437817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533dc90-2002-4ed9-b106-9d12f1d420cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:34.440519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7533dc90-2002-4ed9-b106-9d12f1d420cc service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:34.465623 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2458/4900] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:35.284638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f150a4-3ffb-4060-b391-a2c70ad0a5eb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:35.286919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c1f150a4-3ffb-4060-b391-a2c70ad0a5eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:35.311008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533dc90-2002-4ed9-b106-9d12f1d420cc service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:35.312976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7533dc90-2002-4ed9-b106-9d12f1d420cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:35.333884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7533dc90-2002-4ed9-b106-9d12f1d420cc service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:35.348585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:35.349522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:35.349994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:35.350429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] PATH_INFO: `/v3/projects/124a526abd874d099ffc568eb0098574` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:35.353596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=124a526abd874d099ffc568eb0098574)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:35.358912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:35.474812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '124a526abd874d099ffc568eb0098574', 'request_id': 'req-6cb91b94-1531-47c5-8b8b-1f46c778f146'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:35.501529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '124a526abd874d099ffc568eb0098574', 'request_id': 'req-6cb91b94-1531-47c5-8b8b-1f46c778f146'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:35.516487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f150a4-3ffb-4060-b391-a2c70ad0a5eb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:35.520292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '124a526abd874d099ffc568eb0098574', 'request_id': 'req-6cb91b94-1531-47c5-8b8b-1f46c778f146'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:35.554481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] The token cache is being invalidate because project 124a526abd874d099ffc568eb0098574 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:35.555159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:35.556405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:35.563258 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2459/4901] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:35 2022] DELETE /identity/v3/projects/124a526abd874d099ffc568eb0098574 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:35.567125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:35.569739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:35.632954 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:35.647984 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:35.685837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f33df42-e232-417d-93a9-f3a3b0ef04d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:35.686481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33df42-e232-417d-93a9-f3a3b0ef04d7 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:35.686780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33df42-e232-417d-93a9-f3a3b0ef04d7 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:35.687630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f33df42-e232-417d-93a9-f3a3b0ef04d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:35.689962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4f33df42-e232-417d-93a9-f3a3b0ef04d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:35.723299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33df42-e232-417d-93a9-f3a3b0ef04d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:35.725031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f33df42-e232-417d-93a9-f3a3b0ef04d7 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:35.748390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2443/4902] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:35.794177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb91b94-1531-47c5-8b8b-1f46c778f146 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:35.807735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:35.807735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:35.807735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:35.810896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] PATH_INFO: `/v3/users/3c67e08d6bc64802bc10da30b376067f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:35.814417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c67e08d6bc64802bc10da30b376067f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:35.817048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:35.978296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c67e08d6bc64802bc10da30b376067f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:36.027051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c67e08d6bc64802bc10da30b376067f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:36.032529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c67e08d6bc64802bc10da30b376067f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:36.063441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c67e08d6bc64802bc10da30b376067f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:36.080105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c67e08d6bc64802bc10da30b376067f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:36.090631 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2460/4903] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:35 2022] DELETE /identity/v3/users/3c67e08d6bc64802bc10da30b376067f => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:36.838144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c71cd-eda8-4e16-8bb7-78c1295a94a4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:36.840356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c71cd-eda8-4e16-8bb7-78c1295a94a4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:36.841006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c71cd-eda8-4e16-8bb7-78c1295a94a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:36.842201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:36.843679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:36.914332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-128c71cd-eda8-4e16-8bb7-78c1295a94a4 None None] MFA Rules not processed for user `b1ae9fcca02548dfa6e29d2787288e49`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:36.922044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-128c71cd-eda8-4e16-8bb7-78c1295a94a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:37.075339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98008eab-9f8f-4346-b106-7c0d8baef7a2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:37.120385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:37.121891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:37.122318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:37.122601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] PATH_INFO: `/v3/projects/6f8fa16c099f4fcea5c3f90893905dfc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:37.124126 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2444/4904] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:36 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:37.130020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f8fa16c099f4fcea5c3f90893905dfc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:37.133982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:37.316429 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:37.318789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f8fa16c099f4fcea5c3f90893905dfc', 'request_id': 'req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:37.355920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f8fa16c099f4fcea5c3f90893905dfc', 'request_id': 'req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:37.365896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f8fa16c099f4fcea5c3f90893905dfc', 'request_id': 'req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:37.390592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] The token cache is being invalidate because project 6f8fa16c099f4fcea5c3f90893905dfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:37.391243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:37.392891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e8fdc2b-c8c8-49f6-8a86-3728360e236b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:37.399434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2461/4905] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:36 2022] DELETE /identity/v3/projects/6f8fa16c099f4fcea5c3f90893905dfc => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:37.403591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa621f61-a835-4827-9997-63197df8c0fc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:37.404104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa621f61-a835-4827-9997-63197df8c0fc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:37.404573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa621f61-a835-4827-9997-63197df8c0fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:37.461620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fa621f61-a835-4827-9997-63197df8c0fc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:37.467995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa621f61-a835-4827-9997-63197df8c0fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:37.695975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c06bd1-dd86-407e-9a12-7508b25e3826 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:37.696254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c06bd1-dd86-407e-9a12-7508b25e3826 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:37.696536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c06bd1-dd86-407e-9a12-7508b25e3826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:37.699344 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2445/4906] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:37.738835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-95c06bd1-dd86-407e-9a12-7508b25e3826 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:37.740336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-95c06bd1-dd86-407e-9a12-7508b25e3826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:37.759573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa621f61-a835-4827-9997-63197df8c0fc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:37.766982 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2462/4907] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:37.771797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa621f61-a835-4827-9997-63197df8c0fc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:37.780139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d3a39-edab-4e3d-bf25-680127dc9687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:37.781061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d3a39-edab-4e3d-bf25-680127dc9687 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:37.781970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d3a39-edab-4e3d-bf25-680127dc9687 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:37.782399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d3a39-edab-4e3d-bf25-680127dc9687 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:37.782975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d3a39-edab-4e3d-bf25-680127dc9687 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:37.783442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d3a39-edab-4e3d-bf25-680127dc9687 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:37.792093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d3a39-edab-4e3d-bf25-680127dc9687 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:37.808078 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2446/4908] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:37.813046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c06bd1-dd86-407e-9a12-7508b25e3826 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:37.823498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c06bd1-dd86-407e-9a12-7508b25e3826 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:37.830185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3e974-fb44-4cdc-b6ca-dbd7ef5ef4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:37.830823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3e974-fb44-4cdc-b6ca-dbd7ef5ef4e7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:37.831164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3e974-fb44-4cdc-b6ca-dbd7ef5ef4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:37.831448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f3e974-fb44-4cdc-b6ca-dbd7ef5ef4e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:37.832249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3e974-fb44-4cdc-b6ca-dbd7ef5ef4e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:37.834373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f3e974-fb44-4cdc-b6ca-dbd7ef5ef4e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:37.895594 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2463/4909] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:37 2022] POST /identity/v3/projects => generated 367 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:37.902552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d3a39-edab-4e3d-bf25-680127dc9687 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:37.917011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d3a39-edab-4e3d-bf25-680127dc9687 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:38.098665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b82c-00db-4a27-ab2a-f32c4f826ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:38.103141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b82c-00db-4a27-ab2a-f32c4f826ded admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:38.104499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b82c-00db-4a27-ab2a-f32c4f826ded admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:38.104809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a087b82c-00db-4a27-ab2a-f32c4f826ded admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:38.105524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087b82c-00db-4a27-ab2a-f32c4f826ded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:38.107504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a087b82c-00db-4a27-ab2a-f32c4f826ded admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:38.120579 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:38.211948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3e974-fb44-4cdc-b6ca-dbd7ef5ef4e7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:38.212159 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2447/4910] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:37 2022] POST /identity/v3/users => generated 284 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:38.260232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f3e974-fb44-4cdc-b6ca-dbd7ef5ef4e7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:38.286827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3f0c-6832-4290-861e-076b5156d837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:38.287458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3f0c-6832-4290-861e-076b5156d837 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:38.287744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3f0c-6832-4290-861e-076b5156d837 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:38.288017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79b3f0c-6832-4290-861e-076b5156d837 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:38.288675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3f0c-6832-4290-861e-076b5156d837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:38.298471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79b3f0c-6832-4290-861e-076b5156d837 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:38.317695 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2464/4911] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:38.319541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b82c-00db-4a27-ab2a-f32c4f826ded admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:38.338350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a087b82c-00db-4a27-ab2a-f32c4f826ded admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:38.369282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dbdb1f-488a-4cba-ad7d-8714a638478a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:38.369980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbdb1f-488a-4cba-ad7d-8714a638478a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:38.370340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbdb1f-488a-4cba-ad7d-8714a638478a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:38.370727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dbdb1f-488a-4cba-ad7d-8714a638478a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:38.373986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbdb1f-488a-4cba-ad7d-8714a638478a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:38.375911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dbdb1f-488a-4cba-ad7d-8714a638478a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:38.397165 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2448/4912] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:38.407662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3f0c-6832-4290-861e-076b5156d837 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:38.418248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79b3f0c-6832-4290-861e-076b5156d837 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:38.424613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1109112-48ed-4a85-81d9-c3d820445866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:38.425319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109112-48ed-4a85-81d9-c3d820445866 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:38.425666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109112-48ed-4a85-81d9-c3d820445866 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:38.425951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1109112-48ed-4a85-81d9-c3d820445866 admin admin] PATH_INFO: `/v3/projects/e04137948c134a029691b16f9621b663/users/7e94eef65ae8437db3df5ad319a76ab2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:38.443630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1109112-48ed-4a85-81d9-c3d820445866 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e04137948c134a029691b16f9621b663, user_id=7e94eef65ae8437db3df5ad319a76ab2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:38.446376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1109112-48ed-4a85-81d9-c3d820445866 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:38.501692 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2465/4913] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:38 2022] PUT /identity/v3/projects/e04137948c134a029691b16f9621b663/users/7e94eef65ae8437db3df5ad319a76ab2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:38.512565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6851-0cb1-4fe5-b4e1-d2b8af142650 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:38.512840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6851-0cb1-4fe5-b4e1-d2b8af142650 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:38.513118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f6851-0cb1-4fe5-b4e1-d2b8af142650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:38.600636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5e8f6851-0cb1-4fe5-b4e1-d2b8af142650 None None] MFA Rules not processed for user `7e94eef65ae8437db3df5ad319a76ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:38.603035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5e8f6851-0cb1-4fe5-b4e1-d2b8af142650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:38.773931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1109112-48ed-4a85-81d9-c3d820445866 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:38.774346 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2449/4914] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:38 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:38.933170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1109112-48ed-4a85-81d9-c3d820445866 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:38.949273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a17a7-0145-44cb-9acb-e2c9598b90fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:38.950516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a17a7-0145-44cb-9acb-e2c9598b90fa admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:38.951042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a17a7-0145-44cb-9acb-e2c9598b90fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:38.951528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a17a7-0145-44cb-9acb-e2c9598b90fa admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:38.953440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a17a7-0145-44cb-9acb-e2c9598b90fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:38.955912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a17a7-0145-44cb-9acb-e2c9598b90fa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:39.022770 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2466/4915] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:38 2022] POST /identity/v3/projects => generated 367 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:39.023982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f6851-0cb1-4fe5-b4e1-d2b8af142650 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:39.038007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f6851-0cb1-4fe5-b4e1-d2b8af142650 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:39.235123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0f502-4c09-4c0b-80e7-75ca9a1f97fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:39.236600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0f502-4c09-4c0b-80e7-75ca9a1f97fc admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:39.244262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0f502-4c09-4c0b-80e7-75ca9a1f97fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:39.264398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c0f502-4c09-4c0b-80e7-75ca9a1f97fc admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:39.266789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0f502-4c09-4c0b-80e7-75ca9a1f97fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:39.274147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c0f502-4c09-4c0b-80e7-75ca9a1f97fc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:39.386809 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2450/4916] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:39 2022] POST /identity/v3/users => generated 290 bytes in 362 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:39.388999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a17a7-0145-44cb-9acb-e2c9598b90fa admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:39.413757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a17a7-0145-44cb-9acb-e2c9598b90fa admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:39.431959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796b483-2d75-4d2f-a27e-2d1279c899eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:39.435030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796b483-2d75-4d2f-a27e-2d1279c899eb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:39.436057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796b483-2d75-4d2f-a27e-2d1279c899eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:39.438150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f796b483-2d75-4d2f-a27e-2d1279c899eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:39.440665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796b483-2d75-4d2f-a27e-2d1279c899eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:39.442563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f796b483-2d75-4d2f-a27e-2d1279c899eb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:39.496683 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2467/4917] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:39.501537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0f502-4c09-4c0b-80e7-75ca9a1f97fc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:39.529941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c0f502-4c09-4c0b-80e7-75ca9a1f97fc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:39.544921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9027ea-0fa6-4d47-bdc8-5d0c476c431a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:39.545797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9027ea-0fa6-4d47-bdc8-5d0c476c431a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:39.546708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9027ea-0fa6-4d47-bdc8-5d0c476c431a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:39.547021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9027ea-0fa6-4d47-bdc8-5d0c476c431a admin admin] PATH_INFO: `/v3/projects/b70fca03bb6f4164880e6deefe8b8a48/users/99d1828759ed4adcb2e4852d05c4ed99/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:39.588997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9027ea-0fa6-4d47-bdc8-5d0c476c431a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70fca03bb6f4164880e6deefe8b8a48, user_id=99d1828759ed4adcb2e4852d05c4ed99, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:39.598248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9027ea-0fa6-4d47-bdc8-5d0c476c431a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:39.667787 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2451/4918] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:39 2022] PUT /identity/v3/projects/b70fca03bb6f4164880e6deefe8b8a48/users/99d1828759ed4adcb2e4852d05c4ed99/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:39.673282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796b483-2d75-4d2f-a27e-2d1279c899eb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:39.698891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f796b483-2d75-4d2f-a27e-2d1279c899eb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:39.833107 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:39.878848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac86951-4c4a-47a8-b20e-a005a22fb048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:39.879944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac86951-4c4a-47a8-b20e-a005a22fb048 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:39.880450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac86951-4c4a-47a8-b20e-a005a22fb048 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:39.881398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac86951-4c4a-47a8-b20e-a005a22fb048 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:39.882267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac86951-4c4a-47a8-b20e-a005a22fb048 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:39.884595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac86951-4c4a-47a8-b20e-a005a22fb048 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:39.921409 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2468/4919] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:39 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:39.926433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9027ea-0fa6-4d47-bdc8-5d0c476c431a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:39.949412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9027ea-0fa6-4d47-bdc8-5d0c476c431a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:39.962385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04424b-402d-4a09-925f-d4752060f616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:39.963113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04424b-402d-4a09-925f-d4752060f616 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:39.963562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04424b-402d-4a09-925f-d4752060f616 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:39.964038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f04424b-402d-4a09-925f-d4752060f616 admin admin] PATH_INFO: `/v3/projects/b70fca03bb6f4164880e6deefe8b8a48/users/99d1828759ed4adcb2e4852d05c4ed99/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:39.966353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04424b-402d-4a09-925f-d4752060f616 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b70fca03bb6f4164880e6deefe8b8a48, user_id=99d1828759ed4adcb2e4852d05c4ed99, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:39.974389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f04424b-402d-4a09-925f-d4752060f616 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:40.023041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37241f-354f-42d4-b4fa-fff149be23bd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:40.023634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37241f-354f-42d4-b4fa-fff149be23bd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:40.023634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa37241f-354f-42d4-b4fa-fff149be23bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:40.050430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2452/4920] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:39 2022] PUT /identity/v3/projects/b70fca03bb6f4164880e6deefe8b8a48/users/99d1828759ed4adcb2e4852d05c4ed99/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:40.102999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aa37241f-354f-42d4-b4fa-fff149be23bd None None] MFA Rules not processed for user `99d1828759ed4adcb2e4852d05c4ed99`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:40.104484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa37241f-354f-42d4-b4fa-fff149be23bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:40.268487 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2469/4921] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:40.273209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04424b-402d-4a09-925f-d4752060f616 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:40.287796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f04424b-402d-4a09-925f-d4752060f616 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:40.293947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eee6d-a048-4bc4-85d6-04b76cc38017 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:40.294998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eee6d-a048-4bc4-85d6-04b76cc38017 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:40.295480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eee6d-a048-4bc4-85d6-04b76cc38017 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:40.295952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eee6d-a048-4bc4-85d6-04b76cc38017 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:40.297436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eee6d-a048-4bc4-85d6-04b76cc38017 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:40.299445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eee6d-a048-4bc4-85d6-04b76cc38017 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:40.337828 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2453/4922] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:40 2022] POST /identity/v3/domains => generated 277 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:40.338386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37241f-354f-42d4-b4fa-fff149be23bd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:40.352478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa37241f-354f-42d4-b4fa-fff149be23bd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:40.444898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eee6d-a048-4bc4-85d6-04b76cc38017 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:40.447551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-027eee6d-a048-4bc4-85d6-04b76cc38017 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:40.463443 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:40.546650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dae7d-3761-4ffe-bb59-7da3e834fa7b tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:40.549937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dae7d-3761-4ffe-bb59-7da3e834fa7b tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:40.551527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dae7d-3761-4ffe-bb59-7da3e834fa7b tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:40.552065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dae7d-3761-4ffe-bb59-7da3e834fa7b tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:40.553738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7dae7d-3761-4ffe-bb59-7da3e834fa7b tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:40.559043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7dae7d-3761-4ffe-bb59-7da3e834fa7b tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:40.639853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eee6d-a048-4bc4-85d6-04b76cc38017 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:40.649592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:40.650297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:40.650628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:40.650947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] PATH_INFO: `/v3/users/49f5ab4fe8b44318930c0bf3051e0b4c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:40.652160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=49f5ab4fe8b44318930c0bf3051e0b4c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:40.654523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:40.658683 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2470/4923] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:40 2022] POST /identity/v3/users => generated 346 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:40.665526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dae7d-3761-4ffe-bb59-7da3e834fa7b tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:40.699256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dae7d-3761-4ffe-bb59-7da3e834fa7b tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:40.714862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4135411-42e9-4c86-a1e6-e60dc5d657c6 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:40.716383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4135411-42e9-4c86-a1e6-e60dc5d657c6 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:40.716523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4135411-42e9-4c86-a1e6-e60dc5d657c6 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:40.718440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4135411-42e9-4c86-a1e6-e60dc5d657c6 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:40.720349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4135411-42e9-4c86-a1e6-e60dc5d657c6 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:40.725261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4135411-42e9-4c86-a1e6-e60dc5d657c6 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:40.784973 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2471/4924] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:40 2022] POST /identity/v3/users => generated 323 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:40.792279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4135411-42e9-4c86-a1e6-e60dc5d657c6 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:40.819415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49f5ab4fe8b44318930c0bf3051e0b4c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:40.820718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4135411-42e9-4c86-a1e6-e60dc5d657c6 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:40.832214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5e730-2a7f-4d84-ba32-da0e6a315e38 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:40.835031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e730-2a7f-4d84-ba32-da0e6a315e38 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:40.835477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e730-2a7f-4d84-ba32-da0e6a315e38 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:40.835763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a5e730-2a7f-4d84-ba32-da0e6a315e38 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/users/3793a7c55c63436498c765150b73e937` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:40.851393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49f5ab4fe8b44318930c0bf3051e0b4c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:40.852175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49f5ab4fe8b44318930c0bf3051e0b4c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:40.863999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49f5ab4fe8b44318930c0bf3051e0b4c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:40.867063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5e730-2a7f-4d84-ba32-da0e6a315e38 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:get_user(user_id=3793a7c55c63436498c765150b73e937)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:40.869491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a5e730-2a7f-4d84-ba32-da0e6a315e38 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:40.871786 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2472/4925] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:16:40 2022] GET /identity/v3/users/3793a7c55c63436498c765150b73e937 => generated 346 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:40.890562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5e730-2a7f-4d84-ba32-da0e6a315e38 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:40.893156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-03a5e730-2a7f-4d84-ba32-da0e6a315e38 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:40.911059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01854a7e-c309-4a48-969f-f9b4289fbfd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49f5ab4fe8b44318930c0bf3051e0b4c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:40.924366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a5e730-2a7f-4d84-ba32-da0e6a315e38 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:40.931205 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2454/4926] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:40 2022] DELETE /identity/v3/users/49f5ab4fe8b44318930c0bf3051e0b4c => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:40.937163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:40.938200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d0b75-c98d-478e-96f5-cc7b84bc2816 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:40.938492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d0b75-c98d-478e-96f5-cc7b84bc2816 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:40.938702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:40.939092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d0b75-c98d-478e-96f5-cc7b84bc2816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:40.939621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:40.941725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:40.945776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Adding query filter params (domain_id=89c4114da72c412db002aa2b149bc54c) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:40.946377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:40.947973 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:40.947973 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:40.947973 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:40.953132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:40.992869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2473/4927] 10.222.0.25 () {58 vars in 1207 bytes} [Mon Oct 24 09:16:40 2022] GET /identity/v3/users?domain_id=89c4114da72c412db002aa2b149bc54c => generated 483 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:40.997878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:41.021926 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:41.022171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1e1d0b75-c98d-478e-96f5-cc7b84bc2816 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:41.023362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e1d0b75-c98d-478e-96f5-cc7b84bc2816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:41.028392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a260bf-d62c-4768-84f2-b469e17fff96 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:41.154087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15324fa5-02ad-4ee2-9f5a-83fa28cd5a3c tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:41.155834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15324fa5-02ad-4ee2-9f5a-83fa28cd5a3c tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:41.156228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15324fa5-02ad-4ee2-9f5a-83fa28cd5a3c tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:41.158502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15324fa5-02ad-4ee2-9f5a-83fa28cd5a3c tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:41.159543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15324fa5-02ad-4ee2-9f5a-83fa28cd5a3c tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:41.162888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15324fa5-02ad-4ee2-9f5a-83fa28cd5a3c tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:41.210988 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2474/4928] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:40 2022] GET /identity/v3/users => generated 8585 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:41.216140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15324fa5-02ad-4ee2-9f5a-83fa28cd5a3c tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:41.237549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15324fa5-02ad-4ee2-9f5a-83fa28cd5a3c tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:41.242066 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2455/4929] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:41.255319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d0b75-c98d-478e-96f5-cc7b84bc2816 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:41.256244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242990a-a78a-4bad-9500-a0e2b3724ec0 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:41.256927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242990a-a78a-4bad-9500-a0e2b3724ec0 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:41.257213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242990a-a78a-4bad-9500-a0e2b3724ec0 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:41.257559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8242990a-a78a-4bad-9500-a0e2b3724ec0 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:41.257703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e1d0b75-c98d-478e-96f5-cc7b84bc2816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:41.258930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242990a-a78a-4bad-9500-a0e2b3724ec0 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Adding query filter params (name=tempest-test_user-974624823) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:41.259248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242990a-a78a-4bad-9500-a0e2b3724ec0 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:41.261986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8242990a-a78a-4bad-9500-a0e2b3724ec0 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:41.342531 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:41.385813 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2475/4930] 10.222.0.25 () {58 vars in 1187 bytes} [Mon Oct 24 09:16:41 2022] GET /identity/v3/users?name=tempest-test_user-974624823 => generated 473 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:41.389141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242990a-a78a-4bad-9500-a0e2b3724ec0 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:41.413909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8242990a-a78a-4bad-9500-a0e2b3724ec0 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:41.424274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f4c07-931f-49f3-a3ba-769ed333536a tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:41.425019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4c07-931f-49f3-a3ba-769ed333536a tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:41.425334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4c07-931f-49f3-a3ba-769ed333536a tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:41.425598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8f4c07-931f-49f3-a3ba-769ed333536a tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:41.426313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f4c07-931f-49f3-a3ba-769ed333536a tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:41.427476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f4c07-931f-49f3-a3ba-769ed333536a tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:41.429372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8f4c07-931f-49f3-a3ba-769ed333536a tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:41.449936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1d0b75-c98d-478e-96f5-cc7b84bc2816 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:41.456232 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2476/4931] 10.222.0.25 () {58 vars in 1149 bytes} [Mon Oct 24 09:16:41 2022] GET /identity/v3/users?enabled=False => generated 431 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:41.460627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f4c07-931f-49f3-a3ba-769ed333536a tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:41.475807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71f86-0be6-4500-97dd-59b03df73489 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:41.476425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8f4c07-931f-49f3-a3ba-769ed333536a tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:41.477355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71f86-0be6-4500-97dd-59b03df73489 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:41.477640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71f86-0be6-4500-97dd-59b03df73489 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:41.477918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce71f86-0be6-4500-97dd-59b03df73489 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:41.483252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:41.485593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:41.486069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:41.486586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/users/d329fb503dcb40c4b48c98c188cfaf11` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:41.496404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71f86-0be6-4500-97dd-59b03df73489 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:41.497852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce71f86-0be6-4500-97dd-59b03df73489 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:41.509215 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2456/4932] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:41.535295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:delete_user(user_id=d329fb503dcb40c4b48c98c188cfaf11)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:41.541807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:41.641015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd329fb503dcb40c4b48c98c188cfaf11'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:41.663594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd329fb503dcb40c4b48c98c188cfaf11'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:41.665721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd329fb503dcb40c4b48c98c188cfaf11'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:41.687473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd329fb503dcb40c4b48c98c188cfaf11'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:41.698589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd329fb503dcb40c4b48c98c188cfaf11'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:41.708670 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2477/4933] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:41 2022] DELETE /identity/v3/users/d329fb503dcb40c4b48c98c188cfaf11 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:41.712222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71f86-0be6-4500-97dd-59b03df73489 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:41.727028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce71f86-0be6-4500-97dd-59b03df73489 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:41.864091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:41.864894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:41.865275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:41.865669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/users/3793a7c55c63436498c765150b73e937` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:41.869431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:delete_user(user_id=3793a7c55c63436498c765150b73e937)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:41.871837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:41.986848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3793a7c55c63436498c765150b73e937'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.020311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3793a7c55c63436498c765150b73e937'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.021732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3793a7c55c63436498c765150b73e937'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.038257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3793a7c55c63436498c765150b73e937'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.054392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3793a7c55c63436498c765150b73e937'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.078554 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2457/4934] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:41 2022] DELETE /identity/v3/users/3793a7c55c63436498c765150b73e937 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:42.082864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:42.084497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:42.132287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c90432-5a0d-4d52-a81a-ae6755596fdc tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:42.144406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:42.150647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:42.247036 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:42.287454 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:42.318320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee33072-62e1-4079-964b-50639e1712c1 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:42.325538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:42.326592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:42.327381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:42.327847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:42.328533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] PATH_INFO: `/v3/projects/ae34f891049644e6b71c17c1551cd34f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:42.328676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:42.328897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:42.329172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/domains/89c4114da72c412db002aa2b149bc54c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:42.330631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] RBAC: Authorizing `identity:delete_project(project_id=ae34f891049644e6b71c17c1551cd34f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:42.332769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:42.336305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=89c4114da72c412db002aa2b149bc54c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:42.352446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:42.392285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '89c4114da72c412db002aa2b149bc54c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.393495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '89c4114da72c412db002aa2b149bc54c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.434857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '89c4114da72c412db002aa2b149bc54c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.436062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '89c4114da72c412db002aa2b149bc54c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.440569 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2478/4935] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:16:42 2022] PATCH /identity/v3/domains/89c4114da72c412db002aa2b149bc54c => generated 278 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:42.444835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:42.447474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ae34f891049644e6b71c17c1551cd34f', 'request_id': 'req-4f214f65-cc66-460d-812f-2afea42b5fae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.447730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:42.459032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ae34f891049644e6b71c17c1551cd34f', 'request_id': 'req-4f214f65-cc66-460d-812f-2afea42b5fae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.470074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ae34f891049644e6b71c17c1551cd34f', 'request_id': 'req-4f214f65-cc66-460d-812f-2afea42b5fae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.496975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] The token cache is being invalidate because project ae34f891049644e6b71c17c1551cd34f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:42.497269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.498042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.505578 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2458/4936] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:42 2022] DELETE /identity/v3/projects/ae34f891049644e6b71c17c1551cd34f => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:42.508857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:42.513681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:42.571096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e6810c-9367-4110-9a8a-07ee3052db08 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:42.644833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f214f65-cc66-460d-812f-2afea42b5fae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:42.659132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:42.659802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:42.660080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:42.660345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] PATH_INFO: `/v3/users/e1ded6da9d9841be9b9592512a004662` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:42.661527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ded6da9d9841be9b9592512a004662)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:42.663497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d1828759ed4adcb2e4852d05c4ed99', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b70fca03bb6f4164880e6deefe8b8a48', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:42.663673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:42.664320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:42.664613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:42.664894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] PATH_INFO: `/v3/domains/89c4114da72c412db002aa2b149bc54c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:42.680608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=89c4114da72c412db002aa2b149bc54c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:42.682429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:42.744119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '89c4114da72c412db002aa2b149bc54c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.758276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '89c4114da72c412db002aa2b149bc54c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.781109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ded6da9d9841be9b9592512a004662'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.803773 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:42.807987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ded6da9d9841be9b9592512a004662'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.809277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ded6da9d9841be9b9592512a004662'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.828077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ded6da9d9841be9b9592512a004662'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.845628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ded6da9d9841be9b9592512a004662'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.857735 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:42.874658 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2459/4937] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:42 2022] DELETE /identity/v3/users/e1ded6da9d9841be9b9592512a004662 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:42.883388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89c4114da72c412db002aa2b149bc54c', 'request_id': 'req-59ce4fae-4ca2-4b51-9c22-314266bd0375'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.900659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89c4114da72c412db002aa2b149bc54c', 'request_id': 'req-59ce4fae-4ca2-4b51-9c22-314266bd0375'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.911602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89c4114da72c412db002aa2b149bc54c', 'request_id': 'req-59ce4fae-4ca2-4b51-9c22-314266bd0375'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.935008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] The token cache is being invalidate because project 89c4114da72c412db002aa2b149bc54c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:42.935307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.937804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.956839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '89c4114da72c412db002aa2b149bc54c', 'request_id': 'req-59ce4fae-4ca2-4b51-9c22-314266bd0375'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.957675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '89c4114da72c412db002aa2b149bc54c', 'request_id': 'req-59ce4fae-4ca2-4b51-9c22-314266bd0375'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.958650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce4fae-4ca2-4b51-9c22-314266bd0375 tempest-UsersV3TestJSON-1045221761 tempest-UsersV3TestJSON-1045221761-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '89c4114da72c412db002aa2b149bc54c', 'request_id': 'req-59ce4fae-4ca2-4b51-9c22-314266bd0375'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:42.999348 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2479/4938] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:16:42 2022] DELETE /identity/v3/domains/89c4114da72c412db002aa2b149bc54c => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:43.003285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:43.005677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:43.182321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a5b9fc-ea2b-4500-919e-0369bb747ee1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:43.201698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:43.203441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:43.205956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:43.206748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] PATH_INFO: `/v3/users/7e94eef65ae8437db3df5ad319a76ab2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:43.208846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e94eef65ae8437db3df5ad319a76ab2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:43.232292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:43.374052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e94eef65ae8437db3df5ad319a76ab2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.402716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e94eef65ae8437db3df5ad319a76ab2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.404104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e94eef65ae8437db3df5ad319a76ab2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.422433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e94eef65ae8437db3df5ad319a76ab2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.433659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e94eef65ae8437db3df5ad319a76ab2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.448225 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2460/4939] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:43 2022] DELETE /identity/v3/users/7e94eef65ae8437db3df5ad319a76ab2 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:43.448894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b6d1b-f0a8-453b-9b52-0ad53f2aa7b3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:43.449465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b6d1b-f0a8-453b-9b52-0ad53f2aa7b3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:43.449465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b6d1b-f0a8-453b-9b52-0ad53f2aa7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:43.466412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:43.478868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:43.510425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-191b6d1b-f0a8-453b-9b52-0ad53f2aa7b3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:43.511775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-191b6d1b-f0a8-453b-9b52-0ad53f2aa7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:43.654173 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2480/4940] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:43.675496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111835e3-cbb2-4652-8b09-64b7e42be417 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:43.686548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:43.691826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:43.692121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:43.692419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] PATH_INFO: `/v3/projects/b4663a546122409a81c03c9f7d6a9cb0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:43.696098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4663a546122409a81c03c9f7d6a9cb0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:43.698474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:43.711657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b6d1b-f0a8-453b-9b52-0ad53f2aa7b3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:43.713626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-191b6d1b-f0a8-453b-9b52-0ad53f2aa7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:43.736307 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:43.809903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4663a546122409a81c03c9f7d6a9cb0', 'request_id': 'req-b1ddc3f9-61eb-423c-9341-7fea62e56136'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.823416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4663a546122409a81c03c9f7d6a9cb0', 'request_id': 'req-b1ddc3f9-61eb-423c-9341-7fea62e56136'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.849903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4663a546122409a81c03c9f7d6a9cb0', 'request_id': 'req-b1ddc3f9-61eb-423c-9341-7fea62e56136'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.871005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] The token cache is being invalidate because project b4663a546122409a81c03c9f7d6a9cb0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:43.871376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.872046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b1ddc3f9-61eb-423c-9341-7fea62e56136 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:43.877787 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2461/4941] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:43 2022] DELETE /identity/v3/projects/b4663a546122409a81c03c9f7d6a9cb0 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:43.879626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868e4f-55cf-4a24-a56c-0ba6fb9ee42c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:43.879919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868e4f-55cf-4a24-a56c-0ba6fb9ee42c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:43.880197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2868e4f-55cf-4a24-a56c-0ba6fb9ee42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:43.898687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b6d1b-f0a8-453b-9b52-0ad53f2aa7b3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:43.915884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e2868e4f-55cf-4a24-a56c-0ba6fb9ee42c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:43.919002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e2868e4f-55cf-4a24-a56c-0ba6fb9ee42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:44.022982 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:44.047642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8736d-864a-4f26-a558-5b4dbddad8cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:44.048299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8736d-864a-4f26-a558-5b4dbddad8cd service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.048587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8736d-864a-4f26-a558-5b4dbddad8cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.048866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a8736d-864a-4f26-a558-5b4dbddad8cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.051718 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2462/4942] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:44.052961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6a8736d-864a-4f26-a558-5b4dbddad8cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:44.065796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9a7d-0d31-4066-b70b-6e00f5c18923 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.066077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9a7d-0d31-4066-b70b-6e00f5c18923 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.066358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485f9a7d-0d31-4066-b70b-6e00f5c18923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.075413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8736d-864a-4f26-a558-5b4dbddad8cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:44.090760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-485f9a7d-0d31-4066-b70b-6e00f5c18923 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:44.092729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a8736d-864a-4f26-a558-5b4dbddad8cd service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:44.094360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-485f9a7d-0d31-4066-b70b-6e00f5c18923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:44.106567 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2463/4943] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:44.107962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9a7d-0d31-4066-b70b-6e00f5c18923 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:44.115250 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2481/4944] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:44.119753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485f9a7d-0d31-4066-b70b-6e00f5c18923 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:44.126958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244510a-48c5-4450-8a58-a63893184aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:44.127878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244510a-48c5-4450-8a58-a63893184aee admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.128662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244510a-48c5-4450-8a58-a63893184aee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.129381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c244510a-48c5-4450-8a58-a63893184aee admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.130201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244510a-48c5-4450-8a58-a63893184aee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:44.131201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244510a-48c5-4450-8a58-a63893184aee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:44.133499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c244510a-48c5-4450-8a58-a63893184aee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:44.152684 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2464/4945] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:44.158196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8736d-864a-4f26-a558-5b4dbddad8cd service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:44.175366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a8736d-864a-4f26-a558-5b4dbddad8cd service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:44.183654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795f0e7-7aae-4f33-b095-cd4012c0f603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:44.184733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795f0e7-7aae-4f33-b095-cd4012c0f603 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.185182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795f0e7-7aae-4f33-b095-cd4012c0f603 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.191012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f795f0e7-7aae-4f33-b095-cd4012c0f603 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.195987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795f0e7-7aae-4f33-b095-cd4012c0f603 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:44.198614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f795f0e7-7aae-4f33-b095-cd4012c0f603 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:44.262591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244510a-48c5-4450-8a58-a63893184aee admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:44.264076 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2482/4946] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:44 2022] POST /identity/v3/projects => generated 385 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:44.275744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c244510a-48c5-4450-8a58-a63893184aee admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:44.364271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f53f95-7a25-4d26-82e0-3ae48c4bfb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:44.364271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f53f95-7a25-4d26-82e0-3ae48c4bfb6f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.364271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f53f95-7a25-4d26-82e0-3ae48c4bfb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.364689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f53f95-7a25-4d26-82e0-3ae48c4bfb6f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.365532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f53f95-7a25-4d26-82e0-3ae48c4bfb6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:44.368187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f53f95-7a25-4d26-82e0-3ae48c4bfb6f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:44.405388 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2465/4947] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:44 2022] POST /identity/v3/users => generated 293 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:44.409630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795f0e7-7aae-4f33-b095-cd4012c0f603 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:44.426400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f795f0e7-7aae-4f33-b095-cd4012c0f603 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:44.438312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10025bd-41d4-4ee9-ba11-ce72f5d8f5ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:44.438995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10025bd-41d4-4ee9-ba11-ce72f5d8f5ed admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.439196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10025bd-41d4-4ee9-ba11-ce72f5d8f5ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.441594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10025bd-41d4-4ee9-ba11-ce72f5d8f5ed admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.442270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10025bd-41d4-4ee9-ba11-ce72f5d8f5ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:44.445877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10025bd-41d4-4ee9-ba11-ce72f5d8f5ed admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:44.468079 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2483/4948] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:44.472059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f53f95-7a25-4d26-82e0-3ae48c4bfb6f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:44.488971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f53f95-7a25-4d26-82e0-3ae48c4bfb6f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:44.505032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5cad-02a0-46ca-bc64-5fb57af81a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:44.505032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5cad-02a0-46ca-bc64-5fb57af81a21 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.505032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5cad-02a0-46ca-bc64-5fb57af81a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.505032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ac5cad-02a0-46ca-bc64-5fb57af81a21 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.505633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5cad-02a0-46ca-bc64-5fb57af81a21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:44.505633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ac5cad-02a0-46ca-bc64-5fb57af81a21 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:44.541807 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2466/4949] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:44.549435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10025bd-41d4-4ee9-ba11-ce72f5d8f5ed admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:44.583230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10025bd-41d4-4ee9-ba11-ce72f5d8f5ed admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:44.588393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5cad-02a0-46ca-bc64-5fb57af81a21 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:44.591198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e6ac5cad-02a0-46ca-bc64-5fb57af81a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:44.617657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c9b88-5794-4ac8-9984-81ce9f352a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:44.618341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c9b88-5794-4ac8-9984-81ce9f352a5d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.618620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c9b88-5794-4ac8-9984-81ce9f352a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.618898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9c9b88-5794-4ac8-9984-81ce9f352a5d admin admin] PATH_INFO: `/v3/projects/7a3492a2482c4924aab1e2de2c4d1ffb/users/fb32611780e54982bf3e3b5f5f5bbd10/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.622675 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:44.680179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c9b88-5794-4ac8-9984-81ce9f352a5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a3492a2482c4924aab1e2de2c4d1ffb, user_id=fb32611780e54982bf3e3b5f5f5bbd10, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:44.686508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9c9b88-5794-4ac8-9984-81ce9f352a5d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:44.712360 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2484/4950] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:44 2022] PUT /identity/v3/projects/7a3492a2482c4924aab1e2de2c4d1ffb/users/fb32611780e54982bf3e3b5f5f5bbd10/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:44.713954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c9b88-5794-4ac8-9984-81ce9f352a5d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:44.718187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff9c9b88-5794-4ac8-9984-81ce9f352a5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:44.753052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ac5cad-02a0-46ca-bc64-5fb57af81a21 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:44.836969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9c9b88-5794-4ac8-9984-81ce9f352a5d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:44.842569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:44.847529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.851292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.851665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] PATH_INFO: `/v3/projects/e04137948c134a029691b16f9621b663` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.853034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=e04137948c134a029691b16f9621b663)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:44.855026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:44.884094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb67cc8-0e54-48fa-9ae9-bbda502340ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:44.884731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67cc8-0e54-48fa-9ae9-bbda502340ef service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.886412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67cc8-0e54-48fa-9ae9-bbda502340ef service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.887679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb67cc8-0e54-48fa-9ae9-bbda502340ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.891710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3eb67cc8-0e54-48fa-9ae9-bbda502340ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:44.911156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67cc8-0e54-48fa-9ae9-bbda502340ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:44.913230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb67cc8-0e54-48fa-9ae9-bbda502340ef service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:44.929456 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2467/4951] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:44.930812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a185b29-1043-4e6f-ade6-c81209a9bbeb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:44.931106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a185b29-1043-4e6f-ade6-c81209a9bbeb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:44.931384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a185b29-1043-4e6f-ade6-c81209a9bbeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:44.932079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e04137948c134a029691b16f9621b663', 'request_id': 'req-4edccd2e-c751-4e8d-8adc-1a07645a76bc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:44.946176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e04137948c134a029691b16f9621b663', 'request_id': 'req-4edccd2e-c751-4e8d-8adc-1a07645a76bc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:44.962666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e04137948c134a029691b16f9621b663', 'request_id': 'req-4edccd2e-c751-4e8d-8adc-1a07645a76bc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:44.993889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6a185b29-1043-4e6f-ade6-c81209a9bbeb None None] MFA Rules not processed for user `fb32611780e54982bf3e3b5f5f5bbd10`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:44.996307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6a185b29-1043-4e6f-ade6-c81209a9bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:44.997744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] The token cache is being invalidate because project e04137948c134a029691b16f9621b663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:44.998020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.002003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.012394 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2485/4952] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:44 2022] DELETE /identity/v3/projects/e04137948c134a029691b16f9621b663 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:45.012394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:45.012394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:45.044279 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:45.105473 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2468/4953] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:45.111495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a185b29-1043-4e6f-ade6-c81209a9bbeb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:45.113243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6a185b29-1043-4e6f-ade6-c81209a9bbeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:45.116716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edccd2e-c751-4e8d-8adc-1a07645a76bc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:45.121725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:45.122367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.122649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.122923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] PATH_INFO: `/v3/users/99d1828759ed4adcb2e4852d05c4ed99` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:45.125022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99d1828759ed4adcb2e4852d05c4ed99)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:45.128732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:45.137834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a185b29-1043-4e6f-ade6-c81209a9bbeb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:45.163053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7fc00-5fdd-453d-9e9a-fac8614702f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:45.163909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7fc00-5fdd-453d-9e9a-fac8614702f6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.164365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7fc00-5fdd-453d-9e9a-fac8614702f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.164810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba7fc00-5fdd-453d-9e9a-fac8614702f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:45.165929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7fc00-5fdd-453d-9e9a-fac8614702f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:45.167904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba7fc00-5fdd-453d-9e9a-fac8614702f6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:45.195184 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:45.203620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99d1828759ed4adcb2e4852d05c4ed99'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.206198 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2469/4954] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:45 2022] POST /identity/v3/projects => generated 385 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:45.209997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7fc00-5fdd-453d-9e9a-fac8614702f6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:45.221937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99d1828759ed4adcb2e4852d05c4ed99'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.222685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99d1828759ed4adcb2e4852d05c4ed99'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.232800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99d1828759ed4adcb2e4852d05c4ed99'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.250089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99d1828759ed4adcb2e4852d05c4ed99'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.261017 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2486/4955] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:45 2022] DELETE /identity/v3/users/99d1828759ed4adcb2e4852d05c4ed99 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:45.304446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba7fc00-5fdd-453d-9e9a-fac8614702f6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:45.379438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b00cb7-ef2b-4a69-97cb-3afa81587c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:45.380092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b00cb7-ef2b-4a69-97cb-3afa81587c8a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.380378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b00cb7-ef2b-4a69-97cb-3afa81587c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.380703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b00cb7-ef2b-4a69-97cb-3afa81587c8a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:45.381808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b00cb7-ef2b-4a69-97cb-3afa81587c8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:45.383839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b00cb7-ef2b-4a69-97cb-3afa81587c8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:45.410294 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2470/4956] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:45 2022] POST /identity/v3/users => generated 299 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:45.414188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:45.415819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:45.435966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738bf6b2-ac2a-4b7f-8c98-ae7e8ba4bb88 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:45.458009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f0b48-8751-446a-8830-d7110959f6c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:45.458654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0b48-8751-446a-8830-d7110959f6c8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.458939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0b48-8751-446a-8830-d7110959f6c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.459221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2f0b48-8751-446a-8830-d7110959f6c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:45.459872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f0b48-8751-446a-8830-d7110959f6c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:45.461523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2f0b48-8751-446a-8830-d7110959f6c8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:45.475112 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2487/4957] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:16:45.479306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b00cb7-ef2b-4a69-97cb-3afa81587c8a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:45.495634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b00cb7-ef2b-4a69-97cb-3afa81587c8a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:45.521092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c352c-ee53-4015-9192-0512a55f1bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:45.521821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c352c-ee53-4015-9192-0512a55f1bcf admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.522098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c352c-ee53-4015-9192-0512a55f1bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.522372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903c352c-ee53-4015-9192-0512a55f1bcf admin admin] PATH_INFO: `/v3/projects/32a8e6860b9143ad8268111239ada71a/users/5fbe59174dc24e8aab8d0e768102b227/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:45.549554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c352c-ee53-4015-9192-0512a55f1bcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a8e6860b9143ad8268111239ada71a, user_id=5fbe59174dc24e8aab8d0e768102b227, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:45.553285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903c352c-ee53-4015-9192-0512a55f1bcf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:45.577686 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2471/4958] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:45 2022] PUT /identity/v3/projects/32a8e6860b9143ad8268111239ada71a/users/5fbe59174dc24e8aab8d0e768102b227/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:45.578935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f0b48-8751-446a-8830-d7110959f6c8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:45.591608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2f0b48-8751-446a-8830-d7110959f6c8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:45.705508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf445ff4-a3d9-4c08-aaed-998cceaa83f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:45.706210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf445ff4-a3d9-4c08-aaed-998cceaa83f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.706597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf445ff4-a3d9-4c08-aaed-998cceaa83f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.707703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf445ff4-a3d9-4c08-aaed-998cceaa83f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:45.708454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf445ff4-a3d9-4c08-aaed-998cceaa83f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:45.710466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf445ff4-a3d9-4c08-aaed-998cceaa83f0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:45.738386 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2488/4959] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:45.739747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c352c-ee53-4015-9192-0512a55f1bcf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:45.757759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf445ff4-a3d9-4c08-aaed-998cceaa83f0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:45.761016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903c352c-ee53-4015-9192-0512a55f1bcf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:45.764473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bf445ff4-a3d9-4c08-aaed-998cceaa83f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:45.779172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9e0d40-d125-486f-ac0a-7ed187d02287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:45.779441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf445ff4-a3d9-4c08-aaed-998cceaa83f0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:45.780180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0d40-d125-486f-ac0a-7ed187d02287 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.781098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0d40-d125-486f-ac0a-7ed187d02287 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.781497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9e0d40-d125-486f-ac0a-7ed187d02287 admin admin] PATH_INFO: `/v3/projects/32a8e6860b9143ad8268111239ada71a/users/5fbe59174dc24e8aab8d0e768102b227/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:45.786270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e0d40-d125-486f-ac0a-7ed187d02287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32a8e6860b9143ad8268111239ada71a, user_id=5fbe59174dc24e8aab8d0e768102b227, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:45.788709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:45.790807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.791771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.793471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] PATH_INFO: `/v3/projects/b70fca03bb6f4164880e6deefe8b8a48` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:45.794624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9e0d40-d125-486f-ac0a-7ed187d02287 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:45.797499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b70fca03bb6f4164880e6deefe8b8a48)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:45.800987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:45.820068 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2472/4960] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:45 2022] PUT /identity/v3/projects/32a8e6860b9143ad8268111239ada71a/users/5fbe59174dc24e8aab8d0e768102b227/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:45.831370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30381d0-0909-476b-bb82-64219fb8461c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.832762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30381d0-0909-476b-bb82-64219fb8461c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.833116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30381d0-0909-476b-bb82-64219fb8461c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:45.848384 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:45.894928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c30381d0-0909-476b-bb82-64219fb8461c None None] MFA Rules not processed for user `5fbe59174dc24e8aab8d0e768102b227`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:45.896488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c30381d0-0909-476b-bb82-64219fb8461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:45.910451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b70fca03bb6f4164880e6deefe8b8a48', 'request_id': 'req-459d92ce-7703-4af2-b777-009b668f02cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.925497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b70fca03bb6f4164880e6deefe8b8a48', 'request_id': 'req-459d92ce-7703-4af2-b777-009b668f02cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.937362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b70fca03bb6f4164880e6deefe8b8a48', 'request_id': 'req-459d92ce-7703-4af2-b777-009b668f02cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.979416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] The token cache is being invalidate because project b70fca03bb6f4164880e6deefe8b8a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:45.985229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.986821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-459d92ce-7703-4af2-b777-009b668f02cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:45.991993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2489/4961] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:45 2022] DELETE /identity/v3/projects/b70fca03bb6f4164880e6deefe8b8a48 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:45.993625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4d1a1-110f-4551-91b5-69e798c9d992 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:45.993907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4d1a1-110f-4551-91b5-69e798c9d992 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:45.994178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d4d1a1-110f-4551-91b5-69e798c9d992 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.011285 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:46.020100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-42d4d1a1-110f-4551-91b5-69e798c9d992 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:46.024353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42d4d1a1-110f-4551-91b5-69e798c9d992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:46.048214 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2473/4962] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:45 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:46.065203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30381d0-0909-476b-bb82-64219fb8461c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:46.069132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c30381d0-0909-476b-bb82-64219fb8461c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:46.160954 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2490/4963] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:46.168509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c45e2-ec3a-4d74-91ca-77e2be825346 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:46.169062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c45e2-ec3a-4d74-91ca-77e2be825346 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:46.169728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347c45e2-ec3a-4d74-91ca-77e2be825346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.191837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30381d0-0909-476b-bb82-64219fb8461c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:46.202931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d05a1-524b-4380-9dd8-35c74db58c91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:46.203661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d05a1-524b-4380-9dd8-35c74db58c91 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:46.204880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d05a1-524b-4380-9dd8-35c74db58c91 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:46.205258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259d05a1-524b-4380-9dd8-35c74db58c91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.218464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-347c45e2-ec3a-4d74-91ca-77e2be825346 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:46.219152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-347c45e2-ec3a-4d74-91ca-77e2be825346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:46.231164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d05a1-524b-4380-9dd8-35c74db58c91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:46.235676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259d05a1-524b-4380-9dd8-35c74db58c91 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:46.238311 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2491/4964] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:46.242791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c45e2-ec3a-4d74-91ca-77e2be825346 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:46.253978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347c45e2-ec3a-4d74-91ca-77e2be825346 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:46.267947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de248c9-d8ca-46de-9414-049438a7913e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:46.268647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de248c9-d8ca-46de-9414-049438a7913e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:46.269019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de248c9-d8ca-46de-9414-049438a7913e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:46.269204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2474/4965] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:46 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:46.269452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de248c9-d8ca-46de-9414-049438a7913e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.270196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de248c9-d8ca-46de-9414-049438a7913e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:46.270557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de248c9-d8ca-46de-9414-049438a7913e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:46.271249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d05a1-524b-4380-9dd8-35c74db58c91 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:46.272449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de248c9-d8ca-46de-9414-049438a7913e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:46.286097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-259d05a1-524b-4380-9dd8-35c74db58c91 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:46.302896 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2492/4966] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:16:46.311094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de248c9-d8ca-46de-9414-049438a7913e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:46.330258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de248c9-d8ca-46de-9414-049438a7913e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:46.349537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a12c-b0b9-4129-ba6d-a43dbddea031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:46.353637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a12c-b0b9-4129-ba6d-a43dbddea031 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:46.355679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a12c-b0b9-4129-ba6d-a43dbddea031 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:46.358803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6a12c-b0b9-4129-ba6d-a43dbddea031 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.359414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6a12c-b0b9-4129-ba6d-a43dbddea031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:46.367754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c6a12c-b0b9-4129-ba6d-a43dbddea031 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:46.403385 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2493/4967] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:46 2022] POST /identity/v3/projects => generated 367 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:46.404577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a12c-b0b9-4129-ba6d-a43dbddea031 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:46.411240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93c6a12c-b0b9-4129-ba6d-a43dbddea031 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:46.513247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259d05a1-524b-4380-9dd8-35c74db58c91 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:46.574917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6a12c-b0b9-4129-ba6d-a43dbddea031 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:46.590391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:46.592486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:46.592820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:46.593108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] PATH_INFO: `/v3/users/fb32611780e54982bf3e3b5f5f5bbd10` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.597830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb32611780e54982bf3e3b5f5f5bbd10)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:46.600009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:46.613159 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:46.634195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338a3f-01bd-402c-9614-fc4c04060ba5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:46.635118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338a3f-01bd-402c-9614-fc4c04060ba5 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:46.639412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338a3f-01bd-402c-9614-fc4c04060ba5 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:46.640584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62338a3f-01bd-402c-9614-fc4c04060ba5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.642886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-62338a3f-01bd-402c-9614-fc4c04060ba5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:46.689910 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:46.725611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb32611780e54982bf3e3b5f5f5bbd10'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:46.742529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338a3f-01bd-402c-9614-fc4c04060ba5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:46.745571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62338a3f-01bd-402c-9614-fc4c04060ba5 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:46.753221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb32611780e54982bf3e3b5f5f5bbd10'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:46.754243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb32611780e54982bf3e3b5f5f5bbd10'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:46.768941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb32611780e54982bf3e3b5f5f5bbd10'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:46.769521 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2475/4968] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:16:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 665 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:16:46.771766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338a3f-01bd-402c-9614-fc4c04060ba5 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:46.784607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62338a3f-01bd-402c-9614-fc4c04060ba5 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:46.791614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ff0e-26a9-4296-853c-9dc0a30e507a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:46.793119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ff0e-26a9-4296-853c-9dc0a30e507a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:46.793119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ff0e-26a9-4296-853c-9dc0a30e507a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:46.793119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177ff0e-26a9-4296-853c-9dc0a30e507a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.794142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2012d3d4-d257-481c-83bf-7cb3686f0218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb32611780e54982bf3e3b5f5f5bbd10'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:46.794258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177ff0e-26a9-4296-853c-9dc0a30e507a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:46.796817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177ff0e-26a9-4296-853c-9dc0a30e507a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:46.810876 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2494/4969] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:46 2022] DELETE /identity/v3/users/fb32611780e54982bf3e3b5f5f5bbd10 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:46.816261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c74513-ef7f-40a0-9ebf-15d6120ac308 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:46.816556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c74513-ef7f-40a0-9ebf-15d6120ac308 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:46.816739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c74513-ef7f-40a0-9ebf-15d6120ac308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.829174 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2476/4970] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:46 2022] POST /identity/v3/users => generated 284 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:46.834756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ff0e-26a9-4296-853c-9dc0a30e507a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:46.836876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9177ff0e-26a9-4296-853c-9dc0a30e507a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:46.855695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177ff0e-26a9-4296-853c-9dc0a30e507a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:46.867849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-19c74513-ef7f-40a0-9ebf-15d6120ac308 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:46.869177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19c74513-ef7f-40a0-9ebf-15d6120ac308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:46.962085 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2495/4971] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:46.975459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c74513-ef7f-40a0-9ebf-15d6120ac308 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:46.977070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19c74513-ef7f-40a0-9ebf-15d6120ac308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:46.978993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecab01-4da7-4dac-a9b1-d924b191368e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:46.979631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecab01-4da7-4dac-a9b1-d924b191368e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:46.979918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecab01-4da7-4dac-a9b1-d924b191368e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:46.980204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ecab01-4da7-4dac-a9b1-d924b191368e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:46.980858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecab01-4da7-4dac-a9b1-d924b191368e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:46.982577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ecab01-4da7-4dac-a9b1-d924b191368e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.012492 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2477/4972] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:47.017872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecab01-4da7-4dac-a9b1-d924b191368e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:47.039411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ecab01-4da7-4dac-a9b1-d924b191368e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:47.044647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38094850-ea28-44e2-9c7a-99ed078e7b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:47.045436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38094850-ea28-44e2-9c7a-99ed078e7b6b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.045727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38094850-ea28-44e2-9c7a-99ed078e7b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.046040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38094850-ea28-44e2-9c7a-99ed078e7b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.046687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38094850-ea28-44e2-9c7a-99ed078e7b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:47.048328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38094850-ea28-44e2-9c7a-99ed078e7b6b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.060923 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2478/4973] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:16:47.064836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38094850-ea28-44e2-9c7a-99ed078e7b6b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:47.068406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c74513-ef7f-40a0-9ebf-15d6120ac308 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:47.073514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745fb9df-9364-4156-b94b-120703a67671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:47.074843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fb9df-9364-4156-b94b-120703a67671 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.075312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fb9df-9364-4156-b94b-120703a67671 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.075921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745fb9df-9364-4156-b94b-120703a67671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.076210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38094850-ea28-44e2-9c7a-99ed078e7b6b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:47.083384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfd2a8-a9c1-4b19-bcbe-a087b0541bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:47.087613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfd2a8-a9c1-4b19-bcbe-a087b0541bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.087906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfd2a8-a9c1-4b19-bcbe-a087b0541bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.088190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbfd2a8-a9c1-4b19-bcbe-a087b0541bd9 admin admin] PATH_INFO: `/v3/projects/2880aa4f885046eb8cc0dac247b24408/users/4289335519d4443d8e3e855e38032c0f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.090498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fb9df-9364-4156-b94b-120703a67671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:47.094638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745fb9df-9364-4156-b94b-120703a67671 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.108147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfd2a8-a9c1-4b19-bcbe-a087b0541bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2880aa4f885046eb8cc0dac247b24408, user_id=4289335519d4443d8e3e855e38032c0f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:47.108536 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2496/4974] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:47.110919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbfd2a8-a9c1-4b19-bcbe-a087b0541bd9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.133339 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2479/4975] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:47 2022] PUT /identity/v3/projects/2880aa4f885046eb8cc0dac247b24408/users/4289335519d4443d8e3e855e38032c0f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:47.142904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb7fa3-1618-433d-a52a-d33ac050bccd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.143154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb7fa3-1618-433d-a52a-d33ac050bccd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.143434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cb7fa3-1618-433d-a52a-d33ac050bccd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.181760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a1cb7fa3-1618-433d-a52a-d33ac050bccd None None] MFA Rules not processed for user `4289335519d4443d8e3e855e38032c0f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:47.183834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a1cb7fa3-1618-433d-a52a-d33ac050bccd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:47.209782 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:47.311115 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2497/4976] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:47.316699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfd2a8-a9c1-4b19-bcbe-a087b0541bd9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:47.424175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbfd2a8-a9c1-4b19-bcbe-a087b0541bd9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:47.429283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d90d-8044-444f-97b0-1d1be1c5f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:47.429946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d90d-8044-444f-97b0-1d1be1c5f69d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.430242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d90d-8044-444f-97b0-1d1be1c5f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.430507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e898d90d-8044-444f-97b0-1d1be1c5f69d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.431295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898d90d-8044-444f-97b0-1d1be1c5f69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:47.433826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e898d90d-8044-444f-97b0-1d1be1c5f69d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.487225 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:47.519539 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2480/4977] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:47 2022] POST /identity/v3/projects => generated 369 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:47.525883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb7fa3-1618-433d-a52a-d33ac050bccd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:47.541779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cb7fa3-1618-433d-a52a-d33ac050bccd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:47.543515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d90d-8044-444f-97b0-1d1be1c5f69d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:47.545225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e898d90d-8044-444f-97b0-1d1be1c5f69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:47.652146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e898d90d-8044-444f-97b0-1d1be1c5f69d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:47.665758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:47.666410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.666696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.666971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] PATH_INFO: `/v3/projects/7a3492a2482c4924aab1e2de2c4d1ffb` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.669444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a3492a2482c4924aab1e2de2c4d1ffb)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:47.672057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba071427-a335-488a-83bc-4df83a06373f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:47.672682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba071427-a335-488a-83bc-4df83a06373f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.672965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba071427-a335-488a-83bc-4df83a06373f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.673241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba071427-a335-488a-83bc-4df83a06373f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.673662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.674228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba071427-a335-488a-83bc-4df83a06373f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:47.676751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba071427-a335-488a-83bc-4df83a06373f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.709568 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2498/4978] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:47 2022] POST /identity/v3/users => generated 291 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:47.713402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba071427-a335-488a-83bc-4df83a06373f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:47.727944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba071427-a335-488a-83bc-4df83a06373f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:47.733937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0f49-5014-4fda-890e-e34acd409c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:47.734955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0f49-5014-4fda-890e-e34acd409c2b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.735281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0f49-5014-4fda-890e-e34acd409c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.735657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6b0f49-5014-4fda-890e-e34acd409c2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.736546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0f49-5014-4fda-890e-e34acd409c2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:47.747396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6b0f49-5014-4fda-890e-e34acd409c2b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.760025 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2499/4979] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:47.782394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0f49-5014-4fda-890e-e34acd409c2b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:47.787318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a3492a2482c4924aab1e2de2c4d1ffb', 'request_id': 'req-4921cfe3-6f93-4565-9538-9102e700cc8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:47.798658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a3492a2482c4924aab1e2de2c4d1ffb', 'request_id': 'req-4921cfe3-6f93-4565-9538-9102e700cc8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:47.801898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6b0f49-5014-4fda-890e-e34acd409c2b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:47.823350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a3492a2482c4924aab1e2de2c4d1ffb', 'request_id': 'req-4921cfe3-6f93-4565-9538-9102e700cc8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:47.854089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] The token cache is being invalidate because project 7a3492a2482c4924aab1e2de2c4d1ffb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:47.854519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:47.855295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:47.857381 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2481/4980] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:47 2022] DELETE /identity/v3/projects/7a3492a2482c4924aab1e2de2c4d1ffb => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:47.861072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:47.862809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:47.919947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462ee02-6b56-40bf-bd93-5cbec894779e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:47.920704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462ee02-6b56-40bf-bd93-5cbec894779e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.921229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462ee02-6b56-40bf-bd93-5cbec894779e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.921870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5462ee02-6b56-40bf-bd93-5cbec894779e admin admin] PATH_INFO: `/v3/projects/1c6c23d0a49c4ceda4aab534501d7d46/users/98ff1b0010ca4236b94afd6f6c56f3ff/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.945002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462ee02-6b56-40bf-bd93-5cbec894779e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6c23d0a49c4ceda4aab534501d7d46, user_id=98ff1b0010ca4236b94afd6f6c56f3ff, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:47.948177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5462ee02-6b56-40bf-bd93-5cbec894779e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.960660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921cfe3-6f93-4565-9538-9102e700cc8a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:47.969009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:47.969684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:47.970249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:47.970535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] PATH_INFO: `/v3/users/5fbe59174dc24e8aab8d0e768102b227` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:47.971999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fbe59174dc24e8aab8d0e768102b227)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:47.975064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:47.975622 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2500/4981] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:47 2022] PUT /identity/v3/projects/1c6c23d0a49c4ceda4aab534501d7d46/users/98ff1b0010ca4236b94afd6f6c56f3ff/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:47.979588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462ee02-6b56-40bf-bd93-5cbec894779e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:47.981740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5462ee02-6b56-40bf-bd93-5cbec894779e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:48.026821 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:48.038214 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:48.052515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fbe59174dc24e8aab8d0e768102b227'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.102428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fbe59174dc24e8aab8d0e768102b227'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.103870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fbe59174dc24e8aab8d0e768102b227'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.104029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5462ee02-6b56-40bf-bd93-5cbec894779e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:48.114470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd6600-cbe3-4363-9319-c507666c4c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:48.118760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6600-cbe3-4363-9319-c507666c4c74 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:48.119140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6600-cbe3-4363-9319-c507666c4c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:48.119399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bd6600-cbe3-4363-9319-c507666c4c74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:48.120590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd6600-cbe3-4363-9319-c507666c4c74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:48.121964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fbe59174dc24e8aab8d0e768102b227'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.127187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bd6600-cbe3-4363-9319-c507666c4c74 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:48.135381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9957a6fe-fa7e-4990-a014-2695a9c9c0e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fbe59174dc24e8aab8d0e768102b227'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.145943 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2501/4982] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:16:48.147660 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2482/4983] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:47 2022] DELETE /identity/v3/users/5fbe59174dc24e8aab8d0e768102b227 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:48.158882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd6600-cbe3-4363-9319-c507666c4c74 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:48.161911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f8bd6600-cbe3-4363-9319-c507666c4c74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:48.178520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bd6600-cbe3-4363-9319-c507666c4c74 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:48.280650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871576a-f386-49af-a25e-56c260a30410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:48.282455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871576a-f386-49af-a25e-56c260a30410 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:48.282870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871576a-f386-49af-a25e-56c260a30410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:48.283156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8871576a-f386-49af-a25e-56c260a30410 admin admin] PATH_INFO: `/v3/projects/1c6c23d0a49c4ceda4aab534501d7d46/users/98ff1b0010ca4236b94afd6f6c56f3ff/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:48.288750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871576a-f386-49af-a25e-56c260a30410 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c6c23d0a49c4ceda4aab534501d7d46, user_id=98ff1b0010ca4236b94afd6f6c56f3ff, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:48.296683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8871576a-f386-49af-a25e-56c260a30410 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:48.329186 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2502/4984] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:48 2022] PUT /identity/v3/projects/1c6c23d0a49c4ceda4aab534501d7d46/users/98ff1b0010ca4236b94afd6f6c56f3ff/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:48.340670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86eba1-4235-42fa-8fd6-14c55df86f4d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:48.340960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86eba1-4235-42fa-8fd6-14c55df86f4d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:48.341238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86eba1-4235-42fa-8fd6-14c55df86f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:48.411234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3a86eba1-4235-42fa-8fd6-14c55df86f4d None None] MFA Rules not processed for user `98ff1b0010ca4236b94afd6f6c56f3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:48.417048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3a86eba1-4235-42fa-8fd6-14c55df86f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:48.538913 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2483/4985] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:48.549447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871576a-f386-49af-a25e-56c260a30410 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:48.574415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8871576a-f386-49af-a25e-56c260a30410 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:48.582726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a90402-2f3e-4499-bb5d-7bbc00fbc112 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:48.583441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90402-2f3e-4499-bb5d-7bbc00fbc112 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:48.584041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90402-2f3e-4499-bb5d-7bbc00fbc112 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:48.584798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a90402-2f3e-4499-bb5d-7bbc00fbc112 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:48.585738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a90402-2f3e-4499-bb5d-7bbc00fbc112 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:48.587088 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-04a90402-2f3e-4499-bb5d-7bbc00fbc112 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:48.587088 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:48.587088 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:48.588349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a90402-2f3e-4499-bb5d-7bbc00fbc112 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:48.595886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86eba1-4235-42fa-8fd6-14c55df86f4d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:48.597823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3a86eba1-4235-42fa-8fd6-14c55df86f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:48.619848 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2503/4986] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:16:48 2022] POST /identity/v3/services => generated 241 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:48.621649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a90402-2f3e-4499-bb5d-7bbc00fbc112 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:48.646955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a90402-2f3e-4499-bb5d-7bbc00fbc112 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:48.653728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db730a-e2bd-44af-8ea0-4753c5ad5844 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:48.654490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db730a-e2bd-44af-8ea0-4753c5ad5844 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:48.654848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db730a-e2bd-44af-8ea0-4753c5ad5844 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:48.655713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38db730a-e2bd-44af-8ea0-4753c5ad5844 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services/93e1943478c04bb1bdc1505596685849` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:48.656639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db730a-e2bd-44af-8ea0-4753c5ad5844 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:delete_service(service_id=93e1943478c04bb1bdc1505596685849)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:48.658211 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-38db730a-e2bd-44af-8ea0-4753c5ad5844 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:48.658211 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:48.658211 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:48.659190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38db730a-e2bd-44af-8ea0-4753c5ad5844 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:48.714706 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2504/4987] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:48 2022] DELETE /identity/v3/services/93e1943478c04bb1bdc1505596685849 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:48.716887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db730a-e2bd-44af-8ea0-4753c5ad5844 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:48.728833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86eba1-4235-42fa-8fd6-14c55df86f4d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:48.754997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38db730a-e2bd-44af-8ea0-4753c5ad5844 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:48.761287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61982d50-d7b5-4a58-9e88-cf3776248d8e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:48.761977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61982d50-d7b5-4a58-9e88-cf3776248d8e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:48.762267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61982d50-d7b5-4a58-9e88-cf3776248d8e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:48.762593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61982d50-d7b5-4a58-9e88-cf3776248d8e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:48.763325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61982d50-d7b5-4a58-9e88-cf3776248d8e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:48.766089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61982d50-d7b5-4a58-9e88-cf3776248d8e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:48.767703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:48.771140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:48.771642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:48.772392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] PATH_INFO: `/v3/projects/32a8e6860b9143ad8268111239ada71a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:48.775079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] RBAC: Authorizing `identity:delete_project(project_id=32a8e6860b9143ad8268111239ada71a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:48.777690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:48.814999 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2505/4988] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:48 2022] POST /identity/v3/services => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:48.818782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61982d50-d7b5-4a58-9e88-cf3776248d8e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:48.840734 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:48.872702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61982d50-d7b5-4a58-9e88-cf3776248d8e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:48.875344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32a8e6860b9143ad8268111239ada71a', 'request_id': 'req-786d2aa9-7efe-47e4-8c55-614867ec680f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.883979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32a8e6860b9143ad8268111239ada71a', 'request_id': 'req-786d2aa9-7efe-47e4-8c55-614867ec680f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.919256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32a8e6860b9143ad8268111239ada71a', 'request_id': 'req-786d2aa9-7efe-47e4-8c55-614867ec680f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.945544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] The token cache is being invalidate because project 32a8e6860b9143ad8268111239ada71a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:48.945845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.948762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-786d2aa9-7efe-47e4-8c55-614867ec680f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:48.956380 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2484/4989] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:48 2022] DELETE /identity/v3/projects/32a8e6860b9143ad8268111239ada71a => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:48.959373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c1f08-cc13-471e-8714-4b568d570c70 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:48.959761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c1f08-cc13-471e-8714-4b568d570c70 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:48.961702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00c1f08-cc13-471e-8714-4b568d570c70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:48.970272 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:48.996081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e00c1f08-cc13-471e-8714-4b568d570c70 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:48.997890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e00c1f08-cc13-471e-8714-4b568d570c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:49.036631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.037287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.037601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.037887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services/ebb8efbb8e0d4b33a10fb41aa60a52fe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.038559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:update_service(service_id=ebb8efbb8e0d4b33a10fb41aa60a52fe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.039916 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:49.039916 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:49.039916 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:49.040477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.071202 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2506/4990] 10.222.0.25 () {60 vars in 1252 bytes} [Mon Oct 24 09:16:48 2022] PATCH /identity/v3/services/ebb8efbb8e0d4b33a10fb41aa60a52fe => generated 281 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:16:49.074887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.076813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:49.107440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed84442d-d3d6-4b33-9303-1c0c21423c9e tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.113217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3336c-c25a-4597-9af3-d56640fb7da4 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.113943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3336c-c25a-4597-9af3-d56640fb7da4 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.114239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3336c-c25a-4597-9af3-d56640fb7da4 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.114513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce3336c-c25a-4597-9af3-d56640fb7da4 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services/ebb8efbb8e0d4b33a10fb41aa60a52fe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.115104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3336c-c25a-4597-9af3-d56640fb7da4 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:get_service(service_id=ebb8efbb8e0d4b33a10fb41aa60a52fe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.116150 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-8ce3336c-c25a-4597-9af3-d56640fb7da4 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_service": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:49.116150 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:49.116150 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:49.117025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce3336c-c25a-4597-9af3-d56640fb7da4 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.123210 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2507/4991] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:16:49 2022] GET /identity/v3/services/ebb8efbb8e0d4b33a10fb41aa60a52fe => generated 281 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:16:49.127536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3336c-c25a-4597-9af3-d56640fb7da4 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.142173 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2485/4992] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:48 2022] POST /identity/v3/auth/tokens => generated 3371 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:49.142559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce3336c-c25a-4597-9af3-d56640fb7da4 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.149817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d239099-18f7-491c-aea9-9cf6a070004a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.150294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d239099-18f7-491c-aea9-9cf6a070004a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.150736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d239099-18f7-491c-aea9-9cf6a070004a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.158947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320819f-5359-483c-9f6f-21411e98f68d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.159902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320819f-5359-483c-9f6f-21411e98f68d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.160035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320819f-5359-483c-9f6f-21411e98f68d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.160472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320819f-5359-483c-9f6f-21411e98f68d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services/ebb8efbb8e0d4b33a10fb41aa60a52fe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.160895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320819f-5359-483c-9f6f-21411e98f68d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:delete_service(service_id=ebb8efbb8e0d4b33a10fb41aa60a52fe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.164251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4320819f-5359-483c-9f6f-21411e98f68d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.176674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0d239099-18f7-491c-aea9-9cf6a070004a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:49.178134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0d239099-18f7-491c-aea9-9cf6a070004a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:49.190557 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2486/4993] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:49 2022] POST /identity/v3/auth/tokens => generated 3371 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:49.194996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d239099-18f7-491c-aea9-9cf6a070004a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.205958 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2508/4994] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:49 2022] DELETE /identity/v3/services/ebb8efbb8e0d4b33a10fb41aa60a52fe => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:49.206453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d239099-18f7-491c-aea9-9cf6a070004a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.209964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320819f-5359-483c-9f6f-21411e98f68d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.230565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b4e50-9ea1-4aa6-88c6-99a4c20a246a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.231549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4e50-9ea1-4aa6-88c6-99a4c20a246a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.231896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4e50-9ea1-4aa6-88c6-99a4c20a246a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.232249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7b4e50-9ea1-4aa6-88c6-99a4c20a246a admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.232974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b4e50-9ea1-4aa6-88c6-99a4c20a246a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:49.233287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b4e50-9ea1-4aa6-88c6-99a4c20a246a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.238078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7b4e50-9ea1-4aa6-88c6-99a4c20a246a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.257274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320819f-5359-483c-9f6f-21411e98f68d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.261259 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2487/4995] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:16:49.261515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b708ee-5edc-4ae6-8d60-8a653e34b529 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.265322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b708ee-5edc-4ae6-8d60-8a653e34b529 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.265322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b708ee-5edc-4ae6-8d60-8a653e34b529 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.265579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b4e50-9ea1-4aa6-88c6-99a4c20a246a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.265685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b708ee-5edc-4ae6-8d60-8a653e34b529 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services/ebb8efbb8e0d4b33a10fb41aa60a52fe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.265685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b708ee-5edc-4ae6-8d60-8a653e34b529 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:get_service(service_id=ebb8efbb8e0d4b33a10fb41aa60a52fe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.266003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b708ee-5edc-4ae6-8d60-8a653e34b529 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-74b708ee-5edc-4ae6-8d60-8a653e34b529 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Could not find service: ebb8efbb8e0d4b33a10fb41aa60a52fe.: keystone.exception.ServiceNotFound: Could not find service: ebb8efbb8e0d4b33a10fb41aa60a52fe. Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: ebb8efbb8e0d4b33a10fb41aa60a52fe. Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:16:49.284482 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:16:49.286064 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: ebb8efbb8e0d4b33a10fb41aa60a52fe. Oct 24 09:16:49.287373 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:16:49.288758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7b4e50-9ea1-4aa6-88c6-99a4c20a246a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.288867 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2509/4996] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:16:49 2022] GET /identity/v3/services/ebb8efbb8e0d4b33a10fb41aa60a52fe => generated 113 bytes in 76 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:16:49.291236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b708ee-5edc-4ae6-8d60-8a653e34b529 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.298938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4a37a-70fe-4ac5-b47d-898d09df2fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.299993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4a37a-70fe-4ac5-b47d-898d09df2fc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.300645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4a37a-70fe-4ac5-b47d-898d09df2fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.301092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff4a37a-70fe-4ac5-b47d-898d09df2fc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.301951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4a37a-70fe-4ac5-b47d-898d09df2fc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.303019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b708ee-5edc-4ae6-8d60-8a653e34b529 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.306289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff4a37a-70fe-4ac5-b47d-898d09df2fc1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.309094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ef5e2-b5e2-492c-8788-40b290a36242 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.309730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ef5e2-b5e2-492c-8788-40b290a36242 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.310009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ef5e2-b5e2-492c-8788-40b290a36242 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.310281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665ef5e2-b5e2-492c-8788-40b290a36242 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.310917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ef5e2-b5e2-492c-8788-40b290a36242 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.312629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665ef5e2-b5e2-492c-8788-40b290a36242 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.344935 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2510/4997] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:49 2022] POST /identity/v3/services => generated 273 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:49.345856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ef5e2-b5e2-492c-8788-40b290a36242 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.363736 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2488/4998] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:49 2022] POST /identity/v3/projects => generated 375 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:49.366929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4a37a-70fe-4ac5-b47d-898d09df2fc1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.379405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665ef5e2-b5e2-492c-8788-40b290a36242 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.473326 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:49.473884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa84341-1944-425f-9e0a-de34855c8c55 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.474831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84341-1944-425f-9e0a-de34855c8c55 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.474980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84341-1944-425f-9e0a-de34855c8c55 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.475316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa84341-1944-425f-9e0a-de34855c8c55 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.476097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa84341-1944-425f-9e0a-de34855c8c55 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.478972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa84341-1944-425f-9e0a-de34855c8c55 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.485755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff4a37a-70fe-4ac5-b47d-898d09df2fc1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.503651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2511/4999] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:49 2022] POST /identity/v3/services => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:49.508069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa84341-1944-425f-9e0a-de34855c8c55 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.512214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c3f24-2366-4f5c-a459-2ed872da39d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.513023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c3f24-2366-4f5c-a459-2ed872da39d7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.513543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c3f24-2366-4f5c-a459-2ed872da39d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.514006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c3f24-2366-4f5c-a459-2ed872da39d7 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.515413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c3f24-2366-4f5c-a459-2ed872da39d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.518752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c3f24-2366-4f5c-a459-2ed872da39d7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.546166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa84341-1944-425f-9e0a-de34855c8c55 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.552299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119d9d-2bce-49eb-b7c9-21d5ee12e62d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.553056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119d9d-2bce-49eb-b7c9-21d5ee12e62d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.553496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119d9d-2bce-49eb-b7c9-21d5ee12e62d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.553874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d119d9d-2bce-49eb-b7c9-21d5ee12e62d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.554680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d119d9d-2bce-49eb-b7c9-21d5ee12e62d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.556895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d119d9d-2bce-49eb-b7c9-21d5ee12e62d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.568018 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2489/5000] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:49 2022] POST /identity/v3/users => generated 288 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:49.575604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c3f24-2366-4f5c-a459-2ed872da39d7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.580612 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2512/5001] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:49 2022] POST /identity/v3/services => generated 274 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:49.581709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119d9d-2bce-49eb-b7c9-21d5ee12e62d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.591358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c3f24-2366-4f5c-a459-2ed872da39d7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.605474 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:UPDATE=1,keystone:DELETE=2,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:49.611606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d119d9d-2bce-49eb-b7c9-21d5ee12e62d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.616864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43e28a-b841-48d0-81f7-b3818c2a93f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.617888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43e28a-b841-48d0-81f7-b3818c2a93f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.618366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43e28a-b841-48d0-81f7-b3818c2a93f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.618799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe43e28a-b841-48d0-81f7-b3818c2a93f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.619442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43e28a-b841-48d0-81f7-b3818c2a93f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.621402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe43e28a-b841-48d0-81f7-b3818c2a93f4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.622443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2d722-669a-46a5-845f-8dc039f27525 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.623747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2d722-669a-46a5-845f-8dc039f27525 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.624672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2d722-669a-46a5-845f-8dc039f27525 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.625345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d2d722-669a-46a5-845f-8dc039f27525 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.626071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2d722-669a-46a5-845f-8dc039f27525 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.627565 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-99d2d722-669a-46a5-845f-8dc039f27525 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_services": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:49.627565 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:49.627565 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:49.629111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d2d722-669a-46a5-845f-8dc039f27525 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.634917 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2490/5002] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:16:49.638543 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2513/5003] 10.222.0.25 () {58 vars in 1131 bytes} [Mon Oct 24 09:16:49 2022] GET /identity/v3/services => generated 2977 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:49.642484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43e28a-b841-48d0-81f7-b3818c2a93f4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.643393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2d722-669a-46a5-845f-8dc039f27525 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.653412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe43e28a-b841-48d0-81f7-b3818c2a93f4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.658166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d2d722-669a-46a5-845f-8dc039f27525 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.658382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637e60f-0333-4a5f-8c99-92f96fd11813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.658995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637e60f-0333-4a5f-8c99-92f96fd11813 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.659274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637e60f-0333-4a5f-8c99-92f96fd11813 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.659556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637e60f-0333-4a5f-8c99-92f96fd11813 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.660189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637e60f-0333-4a5f-8c99-92f96fd11813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.661834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2637e60f-0333-4a5f-8c99-92f96fd11813 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.665970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45bfc8-5b14-4a5d-8b59-d02ac13f8310 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.666795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45bfc8-5b14-4a5d-8b59-d02ac13f8310 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.667719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45bfc8-5b14-4a5d-8b59-d02ac13f8310 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.668166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45bfc8-5b14-4a5d-8b59-d02ac13f8310 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.669090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45bfc8-5b14-4a5d-8b59-d02ac13f8310 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1904625264) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:49.669614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45bfc8-5b14-4a5d-8b59-d02ac13f8310 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.671698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45bfc8-5b14-4a5d-8b59-d02ac13f8310 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.676848 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2491/5004] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:49.680550 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2514/5005] 10.222.0.25 () {58 vars in 1222 bytes} [Mon Oct 24 09:16:49 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1904625264 => generated 416 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:49.680962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637e60f-0333-4a5f-8c99-92f96fd11813 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.682250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45bfc8-5b14-4a5d-8b59-d02ac13f8310 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.693868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45bfc8-5b14-4a5d-8b59-d02ac13f8310 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.695438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2637e60f-0333-4a5f-8c99-92f96fd11813 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.699604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df0f30-9f66-4fc6-a819-9b0714c74b0d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.700534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df0f30-9f66-4fc6-a819-9b0714c74b0d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.700768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939aa656-ba03-4d08-aa76-eaa266a4929f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.701069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df0f30-9f66-4fc6-a819-9b0714c74b0d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.701488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0df0f30-9f66-4fc6-a819-9b0714c74b0d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.701638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa656-ba03-4d08-aa76-eaa266a4929f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.701938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa656-ba03-4d08-aa76-eaa266a4929f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.702801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939aa656-ba03-4d08-aa76-eaa266a4929f admin admin] PATH_INFO: `/v3/projects/31e412c69e7d4edfa83db69e9498c857/users/1b9e2e7e4438463bbbefd0e520142de1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.703387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df0f30-9f66-4fc6-a819-9b0714c74b0d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-1232361526) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:49.703801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df0f30-9f66-4fc6-a819-9b0714c74b0d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.707152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0df0f30-9f66-4fc6-a819-9b0714c74b0d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.712246 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2515/5006] 10.222.0.25 () {58 vars in 1222 bytes} [Mon Oct 24 09:16:49 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-1232361526 => generated 418 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:49.716308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df0f30-9f66-4fc6-a819-9b0714c74b0d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.728874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0df0f30-9f66-4fc6-a819-9b0714c74b0d tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.730946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aa656-ba03-4d08-aa76-eaa266a4929f admin admin] RBAC: Authorizing `identity:create_grant(project_id=31e412c69e7d4edfa83db69e9498c857, user_id=1b9e2e7e4438463bbbefd0e520142de1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.734427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939aa656-ba03-4d08-aa76-eaa266a4929f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.735249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c895-9acb-4f1e-b41c-52e13eb39f5f tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.735862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c895-9acb-4f1e-b41c-52e13eb39f5f tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.736149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c895-9acb-4f1e-b41c-52e13eb39f5f tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.736430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e2c895-9acb-4f1e-b41c-52e13eb39f5f tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.737874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2c895-9acb-4f1e-b41c-52e13eb39f5f tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Adding query filter params (type=tempest-ServicesTestJSON-Type-446148901) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:49.738185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2c895-9acb-4f1e-b41c-52e13eb39f5f tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.741050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e2c895-9acb-4f1e-b41c-52e13eb39f5f tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.750112 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2516/5007] 10.222.0.25 () {58 vars in 1220 bytes} [Mon Oct 24 09:16:49 2022] GET /identity/v3/services?type=tempest-ServicesTestJSON-Type-446148901 => generated 416 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:16:49.754540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c895-9acb-4f1e-b41c-52e13eb39f5f tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.761359 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2492/5008] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:49 2022] PUT /identity/v3/projects/31e412c69e7d4edfa83db69e9498c857/users/1b9e2e7e4438463bbbefd0e520142de1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:49.768985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19624d2e-b164-4034-ac6c-eb4cfa85615d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.769278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19624d2e-b164-4034-ac6c-eb4cfa85615d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.769592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19624d2e-b164-4034-ac6c-eb4cfa85615d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.773785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e2c895-9acb-4f1e-b41c-52e13eb39f5f tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.808281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-19624d2e-b164-4034-ac6c-eb4cfa85615d None None] MFA Rules not processed for user `1b9e2e7e4438463bbbefd0e520142de1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:49.809555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-19624d2e-b164-4034-ac6c-eb4cfa85615d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:49.854032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f404-7d19-4e6c-843c-6a20b1bb6253 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.855251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f404-7d19-4e6c-843c-6a20b1bb6253 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.855251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f404-7d19-4e6c-843c-6a20b1bb6253 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.855728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c74f404-7d19-4e6c-843c-6a20b1bb6253 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services/9b76471ae02d487f9c28c1376a0b5b40` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.855933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74f404-7d19-4e6c-843c-6a20b1bb6253 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:delete_service(service_id=9b76471ae02d487f9c28c1376a0b5b40)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.857853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c74f404-7d19-4e6c-843c-6a20b1bb6253 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.902090 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2517/5009] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:49 2022] DELETE /identity/v3/services/9b76471ae02d487f9c28c1376a0b5b40 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:49.906221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f404-7d19-4e6c-843c-6a20b1bb6253 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.936550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c74f404-7d19-4e6c-843c-6a20b1bb6253 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:49.942149 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2493/5010] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:49 2022] POST /identity/v3/auth/tokens => generated 3586 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:49.946218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19624d2e-b164-4034-ac6c-eb4cfa85615d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:49.947030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edae898-ffae-4e31-9bc7-c8399fef9bc5 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:49.947679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edae898-ffae-4e31-9bc7-c8399fef9bc5 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:49.948125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edae898-ffae-4e31-9bc7-c8399fef9bc5 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:49.948377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edae898-ffae-4e31-9bc7-c8399fef9bc5 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services/6919a7f922b04d65bddf2d08a8228556` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:49.949083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edae898-ffae-4e31-9bc7-c8399fef9bc5 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:delete_service(service_id=6919a7f922b04d65bddf2d08a8228556)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:49.950994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edae898-ffae-4e31-9bc7-c8399fef9bc5 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:49.980157 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2518/5011] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:49 2022] DELETE /identity/v3/services/6919a7f922b04d65bddf2d08a8228556 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:49.984374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edae898-ffae-4e31-9bc7-c8399fef9bc5 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:50.019395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edae898-ffae-4e31-9bc7-c8399fef9bc5 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:50.025142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd9e1-45e5-49e1-8261-2996655d8ca6 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98ff1b0010ca4236b94afd6f6c56f3ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1c6c23d0a49c4ceda4aab534501d7d46', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:50.026156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd9e1-45e5-49e1-8261-2996655d8ca6 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.026630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd9e1-45e5-49e1-8261-2996655d8ca6 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.027093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05cd9e1-45e5-49e1-8261-2996655d8ca6 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] PATH_INFO: `/v3/services/47354935f7814a0b866ac29ecf73e9ab` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.028003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cd9e1-45e5-49e1-8261-2996655d8ca6 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorizing `identity:delete_service(service_id=47354935f7814a0b866ac29ecf73e9ab)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:50.031457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05cd9e1-45e5-49e1-8261-2996655d8ca6 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:50.065681 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2519/5012] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:49 2022] DELETE /identity/v3/services/47354935f7814a0b866ac29ecf73e9ab => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:50.070472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd9e1-45e5-49e1-8261-2996655d8ca6 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:50.072295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a05cd9e1-45e5-49e1-8261-2996655d8ca6 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:50.073942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19624d2e-b164-4034-ac6c-eb4cfa85615d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:50.088616 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:50.099049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f6901-c52f-4e7e-bdba-0f5bdb5c5cdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:50.099734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f6901-c52f-4e7e-bdba-0f5bdb5c5cdd admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.100476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f6901-c52f-4e7e-bdba-0f5bdb5c5cdd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.100924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899f6901-c52f-4e7e-bdba-0f5bdb5c5cdd admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.101959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f6901-c52f-4e7e-bdba-0f5bdb5c5cdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:50.105145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899f6901-c52f-4e7e-bdba-0f5bdb5c5cdd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:50.117600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05cd9e1-45e5-49e1-8261-2996655d8ca6 tempest-ServicesTestJSON-1416337043 tempest-ServicesTestJSON-1416337043-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:50.125900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:50.127437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.127843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.128038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] PATH_INFO: `/v3/users/4289335519d4443d8e3e855e38032c0f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.131704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4289335519d4443d8e3e855e38032c0f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:50.137676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:50.173461 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2494/5013] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:49 2022] POST /identity/v3/projects => generated 373 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:50.177842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f6901-c52f-4e7e-bdba-0f5bdb5c5cdd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:50.242702 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=11 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:50.273261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899f6901-c52f-4e7e-bdba-0f5bdb5c5cdd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:50.273530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4289335519d4443d8e3e855e38032c0f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:50.280373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1fe6d-0b31-45e1-baa3-c74597ada843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:50.281106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1fe6d-0b31-45e1-baa3-c74597ada843 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.281492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1fe6d-0b31-45e1-baa3-c74597ada843 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.281836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c1fe6d-0b31-45e1-baa3-c74597ada843 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.282545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1fe6d-0b31-45e1-baa3-c74597ada843 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:50.285028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c1fe6d-0b31-45e1-baa3-c74597ada843 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:50.302080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4289335519d4443d8e3e855e38032c0f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:50.302931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4289335519d4443d8e3e855e38032c0f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:50.316579 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2495/5014] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:50 2022] POST /identity/v3/users => generated 293 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:50.321559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1fe6d-0b31-45e1-baa3-c74597ada843 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:50.321753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4289335519d4443d8e3e855e38032c0f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:50.323602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-18c1fe6d-0b31-45e1-baa3-c74597ada843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:50.335659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bdfdf507-6eb1-419c-9e13-444c5f37a71d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4289335519d4443d8e3e855e38032c0f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:50.341338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c1fe6d-0b31-45e1-baa3-c74597ada843 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:50.347158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f9d31-24c2-4c2b-a170-acdd84928155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:50.347895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9d31-24c2-4c2b-a170-acdd84928155 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.348456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9d31-24c2-4c2b-a170-acdd84928155 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.348835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f9d31-24c2-4c2b-a170-acdd84928155 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.349620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f9d31-24c2-4c2b-a170-acdd84928155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:50.351608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f9d31-24c2-4c2b-a170-acdd84928155 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:50.360954 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2520/5015] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:50 2022] DELETE /identity/v3/users/4289335519d4443d8e3e855e38032c0f => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:50.363505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3d6a6-3fb8-4081-9ea4-46138b222f4f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.363774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3d6a6-3fb8-4081-9ea4-46138b222f4f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.364052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b3d6a6-3fb8-4081-9ea4-46138b222f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.384016 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2496/5016] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:16:50.392200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f9d31-24c2-4c2b-a170-acdd84928155 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:50.408060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d7b3d6a6-3fb8-4081-9ea4-46138b222f4f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:50.410130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d7b3d6a6-3fb8-4081-9ea4-46138b222f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:50.422255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f9d31-24c2-4c2b-a170-acdd84928155 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:50.563615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0e291-4645-4358-9934-c2ed1ea8a772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:50.564280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0e291-4645-4358-9934-c2ed1ea8a772 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.564554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0e291-4645-4358-9934-c2ed1ea8a772 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.564826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f0e291-4645-4358-9934-c2ed1ea8a772 admin admin] PATH_INFO: `/v3/projects/d14033165b684913b7376fe5387e0cf4/users/968e423dfeeb4b059b60d76804494fb6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.570973 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2521/5017] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:50.580999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3d6a6-3fb8-4081-9ea4-46138b222f4f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:50.584048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d7b3d6a6-3fb8-4081-9ea4-46138b222f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:50.586613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0e291-4645-4358-9934-c2ed1ea8a772 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14033165b684913b7376fe5387e0cf4, user_id=968e423dfeeb4b059b60d76804494fb6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:50.589803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f0e291-4645-4358-9934-c2ed1ea8a772 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:50.622660 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2497/5018] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:50 2022] PUT /identity/v3/projects/d14033165b684913b7376fe5387e0cf4/users/968e423dfeeb4b059b60d76804494fb6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:50.634669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0e291-4645-4358-9934-c2ed1ea8a772 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:50.780197 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:50.815552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b3d6a6-3fb8-4081-9ea4-46138b222f4f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:50.816625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f0e291-4645-4358-9934-c2ed1ea8a772 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:50.822813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15541e97-0a05-4c00-8387-396469e435c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:50.824233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15541e97-0a05-4c00-8387-396469e435c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.824510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15541e97-0a05-4c00-8387-396469e435c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.824788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15541e97-0a05-4c00-8387-396469e435c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.825987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15541e97-0a05-4c00-8387-396469e435c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:50.827796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15541e97-0a05-4c00-8387-396469e435c5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:50.845490 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2498/5019] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:50 2022] GET /identity/v3/roles => generated 1420 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:16:50.849646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15541e97-0a05-4c00-8387-396469e435c5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:50.863870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15541e97-0a05-4c00-8387-396469e435c5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:50.875232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ebae22-abd9-4ae5-a37a-84ce84743981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:50.875232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebae22-abd9-4ae5-a37a-84ce84743981 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.875232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebae22-abd9-4ae5-a37a-84ce84743981 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.875232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ebae22-abd9-4ae5-a37a-84ce84743981 admin admin] PATH_INFO: `/v3/projects/d14033165b684913b7376fe5387e0cf4/users/968e423dfeeb4b059b60d76804494fb6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.876977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebae22-abd9-4ae5-a37a-84ce84743981 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14033165b684913b7376fe5387e0cf4, user_id=968e423dfeeb4b059b60d76804494fb6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:50.879690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ebae22-abd9-4ae5-a37a-84ce84743981 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:50.892813 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2499/5020] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:50 2022] PUT /identity/v3/projects/d14033165b684913b7376fe5387e0cf4/users/968e423dfeeb4b059b60d76804494fb6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:50.903054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b216a-6406-47b5-b952-d2ac117c874f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.903397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b216a-6406-47b5-b952-d2ac117c874f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.903745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b216a-6406-47b5-b952-d2ac117c874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.906532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c0cee-d102-455d-8487-a65b189bb5e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:50.907135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c0cee-d102-455d-8487-a65b189bb5e8 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:50.907411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c0cee-d102-455d-8487-a65b189bb5e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:50.907682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04c0cee-d102-455d-8487-a65b189bb5e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:50.925765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c0cee-d102-455d-8487-a65b189bb5e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:50.927218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04c0cee-d102-455d-8487-a65b189bb5e8 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:50.933666 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:50.940322 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2522/5021] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:16:50.942220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-882b216a-6406-47b5-b952-d2ac117c874f None None] MFA Rules not processed for user `968e423dfeeb4b059b60d76804494fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:50.943695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-882b216a-6406-47b5-b952-d2ac117c874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:51.069415 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2500/5022] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:50 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:16:51.101701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c0cee-d102-455d-8487-a65b189bb5e8 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:51.104630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f04c0cee-d102-455d-8487-a65b189bb5e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:51.264765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04c0cee-d102-455d-8487-a65b189bb5e8 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:51.327430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8010d22-9d49-4fd8-a5b1-7c4a6caaf288 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:51.328615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8010d22-9d49-4fd8-a5b1-7c4a6caaf288 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:51.329180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8010d22-9d49-4fd8-a5b1-7c4a6caaf288 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:51.330046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8010d22-9d49-4fd8-a5b1-7c4a6caaf288 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:51.332628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e8010d22-9d49-4fd8-a5b1-7c4a6caaf288 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:51.365036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b216a-6406-47b5-b952-d2ac117c874f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:51.367094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-882b216a-6406-47b5-b952-d2ac117c874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:51.463797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8010d22-9d49-4fd8-a5b1-7c4a6caaf288 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:51.465807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8010d22-9d49-4fd8-a5b1-7c4a6caaf288 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:51.484468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b216a-6406-47b5-b952-d2ac117c874f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:51.520517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:51.520950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:51.521268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:51.521513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] PATH_INFO: `/v3/projects/2880aa4f885046eb8cc0dac247b24408` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:51.526420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2880aa4f885046eb8cc0dac247b24408)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:51.528384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:51.529178 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2523/5023] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:51 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:51.701148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2880aa4f885046eb8cc0dac247b24408', 'request_id': 'req-e73954bb-98a2-43a6-9d5a-537e564201ae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:51.702430 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:51.723968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2880aa4f885046eb8cc0dac247b24408', 'request_id': 'req-e73954bb-98a2-43a6-9d5a-537e564201ae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:51.743453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2880aa4f885046eb8cc0dac247b24408', 'request_id': 'req-e73954bb-98a2-43a6-9d5a-537e564201ae'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:51.765443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] The token cache is being invalidate because project 2880aa4f885046eb8cc0dac247b24408 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:51.765784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:51.767510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:51.771137 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2501/5024] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:51 2022] DELETE /identity/v3/projects/2880aa4f885046eb8cc0dac247b24408 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:51.775695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8010d22-9d49-4fd8-a5b1-7c4a6caaf288 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:51.789888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8010d22-9d49-4fd8-a5b1-7c4a6caaf288 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:51.887948 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:51.930162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:51.931080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:51.931418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:51.931706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] PATH_INFO: `/v3/users/98ff1b0010ca4236b94afd6f6c56f3ff` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:51.933942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] RBAC: Authorizing `identity:delete_user(user_id=98ff1b0010ca4236b94afd6f6c56f3ff)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:51.952885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:52.015145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98ff1b0010ca4236b94afd6f6c56f3ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.031725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98ff1b0010ca4236b94afd6f6c56f3ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.032657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98ff1b0010ca4236b94afd6f6c56f3ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.044405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98ff1b0010ca4236b94afd6f6c56f3ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.064981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fe37bfc4-2b5b-4cb9-b367-615d832b047a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98ff1b0010ca4236b94afd6f6c56f3ff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.085869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2524/5025] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:51 2022] DELETE /identity/v3/users/98ff1b0010ca4236b94afd6f6c56f3ff => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:52.587198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:52.588929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:52.613840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73954bb-98a2-43a6-9d5a-537e564201ae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:52.771339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:52.772978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:52.773489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:52.774019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] PATH_INFO: `/v3/projects/1c6c23d0a49c4ceda4aab534501d7d46` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:52.775620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c6c23d0a49c4ceda4aab534501d7d46)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:52.778732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:52.856535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c6c23d0a49c4ceda4aab534501d7d46', 'request_id': 'req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.864358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c6c23d0a49c4ceda4aab534501d7d46', 'request_id': 'req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.878213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c6c23d0a49c4ceda4aab534501d7d46', 'request_id': 'req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.914826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] The token cache is being invalidate because project 1c6c23d0a49c4ceda4aab534501d7d46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:52.915392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.916280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad46eca0-dbd1-4966-ae9c-51d9fce7ff7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:52.923104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d6daa-ee1a-4408-938f-04d936541dac None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:52.923584 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2502/5026] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:52 2022] DELETE /identity/v3/projects/1c6c23d0a49c4ceda4aab534501d7d46 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:52.923707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d6daa-ee1a-4408-938f-04d936541dac None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:52.923707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d6daa-ee1a-4408-938f-04d936541dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:52.974237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f29d6daa-ee1a-4408-938f-04d936541dac None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:52.981769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f29d6daa-ee1a-4408-938f-04d936541dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:53.145198 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2525/5027] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:53.147063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f7ba5-965a-457e-b562-a96f48f8cf68 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:53.147488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f7ba5-965a-457e-b562-a96f48f8cf68 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:53.147997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f7ba5-965a-457e-b562-a96f48f8cf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:53.211412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-652f7ba5-965a-457e-b562-a96f48f8cf68 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:53.213281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-652f7ba5-965a-457e-b562-a96f48f8cf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:53.238496 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2503/5028] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:53.242907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d6daa-ee1a-4408-938f-04d936541dac None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:53.259052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d6daa-ee1a-4408-938f-04d936541dac None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:53.279018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00c5b6-aa6a-49d0-867a-ffc94d58b5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:53.279657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00c5b6-aa6a-49d0-867a-ffc94d58b5e3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:53.279929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00c5b6-aa6a-49d0-867a-ffc94d58b5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:53.280238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db00c5b6-aa6a-49d0-867a-ffc94d58b5e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:53.280891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00c5b6-aa6a-49d0-867a-ffc94d58b5e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:16:53.281194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00c5b6-aa6a-49d0-867a-ffc94d58b5e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:53.282864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db00c5b6-aa6a-49d0-867a-ffc94d58b5e3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:53.317285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f7ba5-965a-457e-b562-a96f48f8cf68 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:53.324040 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2526/5029] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:16:53.329228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f7ba5-965a-457e-b562-a96f48f8cf68 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:53.348071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e028-323d-43de-8ca1-55e11b661125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:53.348702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e028-323d-43de-8ca1-55e11b661125 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:53.348983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e028-323d-43de-8ca1-55e11b661125 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:53.349257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5e028-323d-43de-8ca1-55e11b661125 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:53.349943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5e028-323d-43de-8ca1-55e11b661125 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:53.352337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5e028-323d-43de-8ca1-55e11b661125 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:53.402518 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2504/5030] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:53 2022] POST /identity/v3/projects => generated 367 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:53.405193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00c5b6-aa6a-49d0-867a-ffc94d58b5e3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:53.422579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db00c5b6-aa6a-49d0-867a-ffc94d58b5e3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:53.564007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab443c8f-2c91-409c-95ab-8ee9dda4592d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:53.564637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab443c8f-2c91-409c-95ab-8ee9dda4592d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:53.564924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab443c8f-2c91-409c-95ab-8ee9dda4592d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:53.565204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab443c8f-2c91-409c-95ab-8ee9dda4592d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:53.566653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab443c8f-2c91-409c-95ab-8ee9dda4592d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:53.568608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab443c8f-2c91-409c-95ab-8ee9dda4592d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:53.587262 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:53.618753 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2527/5031] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:53 2022] POST /identity/v3/users => generated 284 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:53.619664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e028-323d-43de-8ca1-55e11b661125 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:53.637424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5e028-323d-43de-8ca1-55e11b661125 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:53.642668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405860e3-8117-4c07-924c-962a8cf9884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:53.643297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405860e3-8117-4c07-924c-962a8cf9884c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:53.643580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405860e3-8117-4c07-924c-962a8cf9884c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:53.643857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405860e3-8117-4c07-924c-962a8cf9884c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:53.644513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405860e3-8117-4c07-924c-962a8cf9884c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:53.646657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405860e3-8117-4c07-924c-962a8cf9884c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:53.661378 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2505/5032] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:53.664117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab443c8f-2c91-409c-95ab-8ee9dda4592d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:53.677679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab443c8f-2c91-409c-95ab-8ee9dda4592d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:53.688565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de40ac1f-d5c5-4248-86f7-c01b2b13ef4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:53.690455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ac1f-d5c5-4248-86f7-c01b2b13ef4d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:53.690970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ac1f-d5c5-4248-86f7-c01b2b13ef4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:53.692007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de40ac1f-d5c5-4248-86f7-c01b2b13ef4d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:53.693268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40ac1f-d5c5-4248-86f7-c01b2b13ef4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:53.695732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de40ac1f-d5c5-4248-86f7-c01b2b13ef4d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:53.711808 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2528/5033] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:53.715525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405860e3-8117-4c07-924c-962a8cf9884c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:53.739365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405860e3-8117-4c07-924c-962a8cf9884c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:53.755339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f559b-21be-410e-a76a-d10658220238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:53.756316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f559b-21be-410e-a76a-d10658220238 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:53.756663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f559b-21be-410e-a76a-d10658220238 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:53.757135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6f559b-21be-410e-a76a-d10658220238 admin admin] PATH_INFO: `/v3/projects/6f00ae9fa03a4a9e932747381ade81ac/users/43f4eda3ee31474684a9351aacf85fb6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:53.777648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f559b-21be-410e-a76a-d10658220238 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f00ae9fa03a4a9e932747381ade81ac, user_id=43f4eda3ee31474684a9351aacf85fb6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:53.780297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6f559b-21be-410e-a76a-d10658220238 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:53.801341 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2506/5034] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:53 2022] PUT /identity/v3/projects/6f00ae9fa03a4a9e932747381ade81ac/users/43f4eda3ee31474684a9351aacf85fb6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:53.812605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10073-0a17-422c-bd18-d25f726853f7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:53.813227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10073-0a17-422c-bd18-d25f726853f7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:53.813557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd10073-0a17-422c-bd18-d25f726853f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:53.875568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5bd10073-0a17-422c-bd18-d25f726853f7 None None] MFA Rules not processed for user `43f4eda3ee31474684a9351aacf85fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:53.876981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5bd10073-0a17-422c-bd18-d25f726853f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:54.009166 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2529/5035] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:54.013998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f559b-21be-410e-a76a-d10658220238 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:54.024370 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:54.139384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6f559b-21be-410e-a76a-d10658220238 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:54.145472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932aa1-814d-425c-bdbb-55be202e951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:54.146089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932aa1-814d-425c-bdbb-55be202e951c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:54.146373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932aa1-814d-425c-bdbb-55be202e951c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:54.147253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc932aa1-814d-425c-bdbb-55be202e951c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:54.147253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc932aa1-814d-425c-bdbb-55be202e951c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:54.149369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc932aa1-814d-425c-bdbb-55be202e951c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:54.193910 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2507/5036] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:54 2022] POST /identity/v3/projects => generated 367 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:54.198052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10073-0a17-422c-bd18-d25f726853f7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:54.213667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd10073-0a17-422c-bd18-d25f726853f7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:54.295238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64748-16c7-4ff4-9e89-917fa64e0f0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:54.296544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64748-16c7-4ff4-9e89-917fa64e0f0c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:54.296815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64748-16c7-4ff4-9e89-917fa64e0f0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:54.297086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f64748-16c7-4ff4-9e89-917fa64e0f0c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:54.297763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f64748-16c7-4ff4-9e89-917fa64e0f0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:54.299740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f64748-16c7-4ff4-9e89-917fa64e0f0c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:54.332399 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2530/5037] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:54 2022] POST /identity/v3/users => generated 290 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:54.336527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932aa1-814d-425c-bdbb-55be202e951c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:54.349114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc932aa1-814d-425c-bdbb-55be202e951c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:54.356002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d991a-be07-45ca-b195-53ec4535ed7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:54.356626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d991a-be07-45ca-b195-53ec4535ed7f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:54.356912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d991a-be07-45ca-b195-53ec4535ed7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:54.357489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d991a-be07-45ca-b195-53ec4535ed7f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:54.359052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d991a-be07-45ca-b195-53ec4535ed7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:54.365876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d991a-be07-45ca-b195-53ec4535ed7f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:54.384059 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2508/5038] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:16:54.388167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64748-16c7-4ff4-9e89-917fa64e0f0c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:54.402325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f64748-16c7-4ff4-9e89-917fa64e0f0c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:54.428028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf321f2-e95a-417b-8a49-ce0f0d968d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:54.429140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf321f2-e95a-417b-8a49-ce0f0d968d41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:54.429140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf321f2-e95a-417b-8a49-ce0f0d968d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:54.432822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf321f2-e95a-417b-8a49-ce0f0d968d41 admin admin] PATH_INFO: `/v3/projects/e40fd5a6c21243a38d4e42a354641870/users/7ef5b1816b5a42ff8cc0fe07159c5751/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:54.451642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf321f2-e95a-417b-8a49-ce0f0d968d41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40fd5a6c21243a38d4e42a354641870, user_id=7ef5b1816b5a42ff8cc0fe07159c5751, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:54.455227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf321f2-e95a-417b-8a49-ce0f0d968d41 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:54.495747 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2531/5039] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:54 2022] PUT /identity/v3/projects/e40fd5a6c21243a38d4e42a354641870/users/7ef5b1816b5a42ff8cc0fe07159c5751/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:54.497026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d991a-be07-45ca-b195-53ec4535ed7f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:54.512338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d991a-be07-45ca-b195-53ec4535ed7f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:54.603931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f926eff-8613-4b44-97f1-a6562dafc0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:54.604745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f926eff-8613-4b44-97f1-a6562dafc0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:54.605071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f926eff-8613-4b44-97f1-a6562dafc0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:54.605357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f926eff-8613-4b44-97f1-a6562dafc0f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:54.606401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f926eff-8613-4b44-97f1-a6562dafc0f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:54.610784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f926eff-8613-4b44-97f1-a6562dafc0f5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:54.629024 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2509/5040] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:54.631502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf321f2-e95a-417b-8a49-ce0f0d968d41 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:54.650248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf321f2-e95a-417b-8a49-ce0f0d968d41 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:54.656060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6180b-c285-4e2f-838b-3ebdbfe4596a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:54.656792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6180b-c285-4e2f-838b-3ebdbfe4596a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:54.658389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6180b-c285-4e2f-838b-3ebdbfe4596a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:54.658389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d6180b-c285-4e2f-838b-3ebdbfe4596a admin admin] PATH_INFO: `/v3/projects/e40fd5a6c21243a38d4e42a354641870/users/7ef5b1816b5a42ff8cc0fe07159c5751/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:54.659485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6180b-c285-4e2f-838b-3ebdbfe4596a admin admin] RBAC: Authorizing `identity:create_grant(project_id=e40fd5a6c21243a38d4e42a354641870, user_id=7ef5b1816b5a42ff8cc0fe07159c5751, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:54.663063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d6180b-c285-4e2f-838b-3ebdbfe4596a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:54.677359 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2532/5041] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:54 2022] PUT /identity/v3/projects/e40fd5a6c21243a38d4e42a354641870/users/7ef5b1816b5a42ff8cc0fe07159c5751/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:54.778338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dac80-2e44-4b78-81be-d4b2e2d7230d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:54.778858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dac80-2e44-4b78-81be-d4b2e2d7230d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:54.779109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716dac80-2e44-4b78-81be-d4b2e2d7230d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:54.823400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-716dac80-2e44-4b78-81be-d4b2e2d7230d None None] MFA Rules not processed for user `7ef5b1816b5a42ff8cc0fe07159c5751`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:54.824753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-716dac80-2e44-4b78-81be-d4b2e2d7230d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:54.979321 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:54.992914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6180b-c285-4e2f-838b-3ebdbfe4596a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:54.997866 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2510/5042] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:54 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:55.035142 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:55.156549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d6180b-c285-4e2f-838b-3ebdbfe4596a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:55.162814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520fa41-266f-45a7-8a03-2f169fee2a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:55.163740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520fa41-266f-45a7-8a03-2f169fee2a0e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:55.164203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520fa41-266f-45a7-8a03-2f169fee2a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:55.164661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2520fa41-266f-45a7-8a03-2f169fee2a0e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:55.165503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520fa41-266f-45a7-8a03-2f169fee2a0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:55.167928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2520fa41-266f-45a7-8a03-2f169fee2a0e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:55.210134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dac80-2e44-4b78-81be-d4b2e2d7230d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:55.222687 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2533/5043] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:16:54 2022] POST /identity/v3/projects => generated 365 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:55.225491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716dac80-2e44-4b78-81be-d4b2e2d7230d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:55.340724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3147e-700e-4877-813a-4eeb929dfb04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:55.341372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3147e-700e-4877-813a-4eeb929dfb04 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:55.341658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3147e-700e-4877-813a-4eeb929dfb04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:55.341952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e3147e-700e-4877-813a-4eeb929dfb04 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:55.343136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3147e-700e-4877-813a-4eeb929dfb04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:55.347553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e3147e-700e-4877-813a-4eeb929dfb04 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:55.390494 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2511/5044] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:16:55 2022] POST /identity/v3/users => generated 283 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:55.392131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520fa41-266f-45a7-8a03-2f169fee2a0e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:55.409093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2520fa41-266f-45a7-8a03-2f169fee2a0e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:55.414844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95c443-0513-423a-af0e-8a2bcee51b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:55.415468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95c443-0513-423a-af0e-8a2bcee51b43 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:55.415751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95c443-0513-423a-af0e-8a2bcee51b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:55.416025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95c443-0513-423a-af0e-8a2bcee51b43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:55.417406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95c443-0513-423a-af0e-8a2bcee51b43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:55.420074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c95c443-0513-423a-af0e-8a2bcee51b43 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:55.439442 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2534/5045] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:55.440616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3147e-700e-4877-813a-4eeb929dfb04 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:55.455430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e3147e-700e-4877-813a-4eeb929dfb04 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:55.460838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b7126-a643-44c4-a7c5-8b8097cdd381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:55.461671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b7126-a643-44c4-a7c5-8b8097cdd381 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:55.463473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b7126-a643-44c4-a7c5-8b8097cdd381 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:55.463968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b7126-a643-44c4-a7c5-8b8097cdd381 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:55.464900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b7126-a643-44c4-a7c5-8b8097cdd381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:55.466767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b7126-a643-44c4-a7c5-8b8097cdd381 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:55.485333 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2512/5046] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:55.486730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95c443-0513-423a-af0e-8a2bcee51b43 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:55.499515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95c443-0513-423a-af0e-8a2bcee51b43 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:55.504530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed96a0b-a0d8-4e2a-bfc0-23ecb28c8459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:55.505670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed96a0b-a0d8-4e2a-bfc0-23ecb28c8459 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:55.506292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed96a0b-a0d8-4e2a-bfc0-23ecb28c8459 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:55.506632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed96a0b-a0d8-4e2a-bfc0-23ecb28c8459 admin admin] PATH_INFO: `/v3/projects/68da1941fd03481181ba62fc864e7da6/users/2a02736634bd4137aeeb12fe76b4965f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:55.528610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed96a0b-a0d8-4e2a-bfc0-23ecb28c8459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68da1941fd03481181ba62fc864e7da6, user_id=2a02736634bd4137aeeb12fe76b4965f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:55.531428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed96a0b-a0d8-4e2a-bfc0-23ecb28c8459 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:55.548569 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2535/5047] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:55 2022] PUT /identity/v3/projects/68da1941fd03481181ba62fc864e7da6/users/2a02736634bd4137aeeb12fe76b4965f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:55.562098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f382d-e187-4d4b-8973-d33441af99f7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:55.562395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f382d-e187-4d4b-8973-d33441af99f7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:55.562675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597f382d-e187-4d4b-8973-d33441af99f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:55.635320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-597f382d-e187-4d4b-8973-d33441af99f7 None None] MFA Rules not processed for user `2a02736634bd4137aeeb12fe76b4965f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:55.641634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-597f382d-e187-4d4b-8973-d33441af99f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:55.735110 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2513/5048] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:55 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:55.740513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed96a0b-a0d8-4e2a-bfc0-23ecb28c8459 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:55.834429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed96a0b-a0d8-4e2a-bfc0-23ecb28c8459 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:55.851260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f8559-31f3-4fae-8a04-1d13824fd8b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:55.852067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8559-31f3-4fae-8a04-1d13824fd8b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:55.852459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8559-31f3-4fae-8a04-1d13824fd8b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:55.853345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f8559-31f3-4fae-8a04-1d13824fd8b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:55.854368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f8559-31f3-4fae-8a04-1d13824fd8b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:55.857077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f8559-31f3-4fae-8a04-1d13824fd8b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:55.886722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f382d-e187-4d4b-8973-d33441af99f7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:55.887348 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2536/5049] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:55 2022] POST /identity/v3/domains => generated 277 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:55.913111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597f382d-e187-4d4b-8973-d33441af99f7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:56.127500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b8eae-f2ac-4bf1-bbb3-5987c3d1514c tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:56.128152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b8eae-f2ac-4bf1-bbb3-5987c3d1514c tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:56.128433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b8eae-f2ac-4bf1-bbb3-5987c3d1514c tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:56.128718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6b8eae-f2ac-4bf1-bbb3-5987c3d1514c tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:56.140540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b8eae-f2ac-4bf1-bbb3-5987c3d1514c tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:56.153109 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-3c6b8eae-f2ac-4bf1-bbb3-5987c3d1514c tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:56.153109 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:16:56.153109 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:16:56.154089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6b8eae-f2ac-4bf1-bbb3-5987c3d1514c tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:56.199021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2514/5050] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:16:55 2022] POST /identity/v3/roles => generated 238 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:56.204342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f8559-31f3-4fae-8a04-1d13824fd8b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:56.238118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f8559-31f3-4fae-8a04-1d13824fd8b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:56.259163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8aa9b-25b7-44ca-b189-8dd2740d119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:56.261379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8aa9b-25b7-44ca-b189-8dd2740d119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:56.261676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8aa9b-25b7-44ca-b189-8dd2740d119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:56.261962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac8aa9b-25b7-44ca-b189-8dd2740d119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/13c4ccc485674c229da9ed9dbf185817/users/2a02736634bd4137aeeb12fe76b4965f/roles/2c9680292258453ca0a869de360c0203` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:56.295325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8aa9b-25b7-44ca-b189-8dd2740d119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=13c4ccc485674c229da9ed9dbf185817, user_id=2a02736634bd4137aeeb12fe76b4965f, role_id=2c9680292258453ca0a869de360c0203)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:56.301132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac8aa9b-25b7-44ca-b189-8dd2740d119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:56.389098 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2537/5051] 10.222.0.25 () {60 vars in 1480 bytes} [Mon Oct 24 09:16:56 2022] PUT /identity/v3/domains/13c4ccc485674c229da9ed9dbf185817/users/2a02736634bd4137aeeb12fe76b4965f/roles/2c9680292258453ca0a869de360c0203 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:56.393717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b8eae-f2ac-4bf1-bbb3-5987c3d1514c tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:56.398977 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:56.407587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6b8eae-f2ac-4bf1-bbb3-5987c3d1514c tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:56.655895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f6b98-4e44-4a9a-89f5-61ef6ceb43b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:56.656602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f6b98-4e44-4a9a-89f5-61ef6ceb43b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:56.656882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f6b98-4e44-4a9a-89f5-61ef6ceb43b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:56.657162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f6b98-4e44-4a9a-89f5-61ef6ceb43b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:56.657850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f6b98-4e44-4a9a-89f5-61ef6ceb43b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:56.663743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f6b98-4e44-4a9a-89f5-61ef6ceb43b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:56.719632 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2515/5052] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:56 2022] POST /identity/v3/domains => generated 275 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:56.722976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8aa9b-25b7-44ca-b189-8dd2740d119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:56.738526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac8aa9b-25b7-44ca-b189-8dd2740d119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:56.803909 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:56.823591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59013342-7de2-49fa-a6e1-f5e10e3d4e7f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:56.824237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59013342-7de2-49fa-a6e1-f5e10e3d4e7f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:56.824769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59013342-7de2-49fa-a6e1-f5e10e3d4e7f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:56.825106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59013342-7de2-49fa-a6e1-f5e10e3d4e7f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:56.825817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59013342-7de2-49fa-a6e1-f5e10e3d4e7f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:56.827853 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-59013342-7de2-49fa-a6e1-f5e10e3d4e7f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:56.827853 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:56.827853 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:56.828500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59013342-7de2-49fa-a6e1-f5e10e3d4e7f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:56.849364 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2538/5053] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:16:56 2022] POST /identity/v3/roles => generated 240 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:56.851501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f6b98-4e44-4a9a-89f5-61ef6ceb43b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:56.865910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f6b98-4e44-4a9a-89f5-61ef6ceb43b1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:56.878112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837172c-f0b9-4fd5-98a4-43f16ab60373 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:56.878727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837172c-f0b9-4fd5-98a4-43f16ab60373 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:56.879007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837172c-f0b9-4fd5-98a4-43f16ab60373 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:56.879278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5837172c-f0b9-4fd5-98a4-43f16ab60373 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:56.879919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837172c-f0b9-4fd5-98a4-43f16ab60373 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:56.882153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5837172c-f0b9-4fd5-98a4-43f16ab60373 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:56.934761 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2516/5054] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:16:56 2022] POST /identity/v3/groups => generated 325 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:56.939308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59013342-7de2-49fa-a6e1-f5e10e3d4e7f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:56.951444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59013342-7de2-49fa-a6e1-f5e10e3d4e7f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:56.958100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fca4d-0777-47f4-b15b-5792ab00aed2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:56.959573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fca4d-0777-47f4-b15b-5792ab00aed2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:56.960075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fca4d-0777-47f4-b15b-5792ab00aed2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:56.960585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314fca4d-0777-47f4-b15b-5792ab00aed2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/groups/3c3315d3571247fa9637eab26e265adf/users/2a02736634bd4137aeeb12fe76b4965f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:56.967894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fca4d-0777-47f4-b15b-5792ab00aed2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=3c3315d3571247fa9637eab26e265adf, user_id=2a02736634bd4137aeeb12fe76b4965f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:56.970129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314fca4d-0777-47f4-b15b-5792ab00aed2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:56.997807 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2539/5055] 10.222.0.25 () {60 vars in 1360 bytes} [Mon Oct 24 09:16:56 2022] PUT /identity/v3/groups/3c3315d3571247fa9637eab26e265adf/users/2a02736634bd4137aeeb12fe76b4965f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:57.002530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837172c-f0b9-4fd5-98a4-43f16ab60373 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:57.014361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5837172c-f0b9-4fd5-98a4-43f16ab60373 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:57.156810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b11458-d605-42e5-b8e5-79a2b343444a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:57.157535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b11458-d605-42e5-b8e5-79a2b343444a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:57.157809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b11458-d605-42e5-b8e5-79a2b343444a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:57.158089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b11458-d605-42e5-b8e5-79a2b343444a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/967fd261196a454aaae03825502fe382/groups/3c3315d3571247fa9637eab26e265adf/roles/5bc9073510e54befbb937f173c58cafc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:57.164978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b11458-d605-42e5-b8e5-79a2b343444a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=967fd261196a454aaae03825502fe382, group_id=3c3315d3571247fa9637eab26e265adf, role_id=5bc9073510e54befbb937f173c58cafc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:57.169465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b11458-d605-42e5-b8e5-79a2b343444a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:57.199011 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2517/5056] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:57 2022] PUT /identity/v3/domains/967fd261196a454aaae03825502fe382/groups/3c3315d3571247fa9637eab26e265adf/roles/5bc9073510e54befbb937f173c58cafc => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:57.203725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fca4d-0777-47f4-b15b-5792ab00aed2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:57.218858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314fca4d-0777-47f4-b15b-5792ab00aed2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:57.319546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e6995-1c47-425b-aeec-fc534d22e894 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:57.320131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e6995-1c47-425b-aeec-fc534d22e894 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:57.320419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e6995-1c47-425b-aeec-fc534d22e894 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:57.320695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6e6995-1c47-425b-aeec-fc534d22e894 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:57.321397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e6995-1c47-425b-aeec-fc534d22e894 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:57.323503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6e6995-1c47-425b-aeec-fc534d22e894 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:57.344272 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2540/5057] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:57 2022] POST /identity/v3/domains => generated 275 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:57.348295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b11458-d605-42e5-b8e5-79a2b343444a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:57.368007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b11458-d605-42e5-b8e5-79a2b343444a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:57.460649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af0da7-9e3d-4018-911c-4ad015a09d76 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:57.461287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af0da7-9e3d-4018-911c-4ad015a09d76 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:57.461609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af0da7-9e3d-4018-911c-4ad015a09d76 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:57.461893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97af0da7-9e3d-4018-911c-4ad015a09d76 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:57.462588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af0da7-9e3d-4018-911c-4ad015a09d76 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:57.464474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97af0da7-9e3d-4018-911c-4ad015a09d76 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:57.499992 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2518/5058] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:16:57 2022] POST /identity/v3/roles => generated 239 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:16:57.504080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e6995-1c47-425b-aeec-fc534d22e894 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:57.517031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6e6995-1c47-425b-aeec-fc534d22e894 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:57.523230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67e6f5-2dbd-4d99-b5db-d767d7ac47a7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:57.523973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67e6f5-2dbd-4d99-b5db-d767d7ac47a7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:57.524588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67e6f5-2dbd-4d99-b5db-d767d7ac47a7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:57.524588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee67e6f5-2dbd-4d99-b5db-d767d7ac47a7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/286b512e0722449596e2a9377f814d86/users/2a02736634bd4137aeeb12fe76b4965f/roles/f1a4723ece91409c869882e6e9c37e24` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:57.540954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67e6f5-2dbd-4d99-b5db-d767d7ac47a7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=286b512e0722449596e2a9377f814d86, user_id=2a02736634bd4137aeeb12fe76b4965f, role_id=f1a4723ece91409c869882e6e9c37e24)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:57.544192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee67e6f5-2dbd-4d99-b5db-d767d7ac47a7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:57.564490 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2541/5059] 10.222.0.25 () {60 vars in 1480 bytes} [Mon Oct 24 09:16:57 2022] PUT /identity/v3/domains/286b512e0722449596e2a9377f814d86/users/2a02736634bd4137aeeb12fe76b4965f/roles/f1a4723ece91409c869882e6e9c37e24 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:57.568282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af0da7-9e3d-4018-911c-4ad015a09d76 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:57.574955 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:57.581993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97af0da7-9e3d-4018-911c-4ad015a09d76 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:57.663503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de9925-4230-4844-91b1-35764d9520d7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:57.664260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de9925-4230-4844-91b1-35764d9520d7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:57.664617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de9925-4230-4844-91b1-35764d9520d7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:57.664923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de9925-4230-4844-91b1-35764d9520d7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:57.665777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de9925-4230-4844-91b1-35764d9520d7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:57.667621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de9925-4230-4844-91b1-35764d9520d7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:57.689618 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2519/5060] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:16:57 2022] POST /identity/v3/domains => generated 275 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:57.694029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67e6f5-2dbd-4d99-b5db-d767d7ac47a7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:57.709260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee67e6f5-2dbd-4d99-b5db-d767d7ac47a7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:57.869525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcacd40-20ff-4a01-acbb-e1565d08ee24 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:57.870496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcacd40-20ff-4a01-acbb-e1565d08ee24 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:57.870496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcacd40-20ff-4a01-acbb-e1565d08ee24 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:57.870749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcacd40-20ff-4a01-acbb-e1565d08ee24 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:57.871407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcacd40-20ff-4a01-acbb-e1565d08ee24 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:57.873033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcacd40-20ff-4a01-acbb-e1565d08ee24 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:57.915320 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2542/5061] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:16:57 2022] POST /identity/v3/roles => generated 240 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:57.921433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de9925-4230-4844-91b1-35764d9520d7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:57.955353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de9925-4230-4844-91b1-35764d9520d7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:57.993652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50dd11-b1e7-4e70-ad2f-a4ba97f2c44b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:57.995233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50dd11-b1e7-4e70-ad2f-a4ba97f2c44b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:57.995636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50dd11-b1e7-4e70-ad2f-a4ba97f2c44b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:57.996062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b50dd11-b1e7-4e70-ad2f-a4ba97f2c44b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:58.001783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50dd11-b1e7-4e70-ad2f-a4ba97f2c44b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:58.004008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b50dd11-b1e7-4e70-ad2f-a4ba97f2c44b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:58.021786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcacd40-20ff-4a01-acbb-e1565d08ee24 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:58.023566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0fcacd40-20ff-4a01-acbb-e1565d08ee24 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:58.053345 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2520/5062] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:16:57 2022] POST /identity/v3/groups => generated 326 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:16:58.056904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50dd11-b1e7-4e70-ad2f-a4ba97f2c44b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:58.060185 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:58.081719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b50dd11-b1e7-4e70-ad2f-a4ba97f2c44b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:58.095875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f36de-5849-40a5-9087-c27af5cbeebf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:58.099602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f36de-5849-40a5-9087-c27af5cbeebf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:58.099907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f36de-5849-40a5-9087-c27af5cbeebf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:58.100370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f36de-5849-40a5-9087-c27af5cbeebf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/groups/7b359a0d54374dcfaa6720a6d5ff0990/users/2a02736634bd4137aeeb12fe76b4965f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:58.112900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f36de-5849-40a5-9087-c27af5cbeebf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=7b359a0d54374dcfaa6720a6d5ff0990, user_id=2a02736634bd4137aeeb12fe76b4965f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:58.115867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f36de-5849-40a5-9087-c27af5cbeebf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:58.151376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcacd40-20ff-4a01-acbb-e1565d08ee24 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:58.171083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2521/5063] 10.222.0.25 () {60 vars in 1360 bytes} [Mon Oct 24 09:16:58 2022] PUT /identity/v3/groups/7b359a0d54374dcfaa6720a6d5ff0990/users/2a02736634bd4137aeeb12fe76b4965f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:58.176273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f36de-5849-40a5-9087-c27af5cbeebf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:58.307085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:58.308531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:58.309104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:58.309644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] PATH_INFO: `/v3/users/1b9e2e7e4438463bbbefd0e520142de1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:58.311155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9e2e7e4438463bbbefd0e520142de1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:58.314395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:58.325862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f36de-5849-40a5-9087-c27af5cbeebf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:58.332168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7573a-9f45-45f9-a705-8c5c665affc7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:58.332851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7573a-9f45-45f9-a705-8c5c665affc7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:58.333140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7573a-9f45-45f9-a705-8c5c665affc7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:58.333445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d7573a-9f45-45f9-a705-8c5c665affc7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/03ce353565604da680636273721e46d8/groups/7b359a0d54374dcfaa6720a6d5ff0990/roles/4798f6bb1d324b3e981914b0e8842f90` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:58.336386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7573a-9f45-45f9-a705-8c5c665affc7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=03ce353565604da680636273721e46d8, group_id=7b359a0d54374dcfaa6720a6d5ff0990, role_id=4798f6bb1d324b3e981914b0e8842f90)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:58.339195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d7573a-9f45-45f9-a705-8c5c665affc7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:58.366962 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2522/5064] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:16:58 2022] PUT /identity/v3/domains/03ce353565604da680636273721e46d8/groups/7b359a0d54374dcfaa6720a6d5ff0990/roles/4798f6bb1d324b3e981914b0e8842f90 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:58.372967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7573a-9f45-45f9-a705-8c5c665affc7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:58.412863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9e2e7e4438463bbbefd0e520142de1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:58.444013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9e2e7e4438463bbbefd0e520142de1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:58.446237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9e2e7e4438463bbbefd0e520142de1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:58.450118 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:58.461538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9e2e7e4438463bbbefd0e520142de1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:58.475663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95b05c1a-8ca5-480c-82f8-a1dcfed49daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9e2e7e4438463bbbefd0e520142de1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:58.485034 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2543/5065] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:58 2022] DELETE /identity/v3/users/1b9e2e7e4438463bbbefd0e520142de1 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:58.491047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150775f-b951-4a13-bb22-5d64ac574e36 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:58.491445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150775f-b951-4a13-bb22-5d64ac574e36 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:58.491829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b150775f-b951-4a13-bb22-5d64ac574e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:58.512598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b150775f-b951-4a13-bb22-5d64ac574e36 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:16:58.514438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b150775f-b951-4a13-bb22-5d64ac574e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:58.520039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d7573a-9f45-45f9-a705-8c5c665affc7 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:58.570564 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:58.610643 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2544/5066] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:16:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:16:58.622363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150775f-b951-4a13-bb22-5d64ac574e36 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:58.624734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b150775f-b951-4a13-bb22-5d64ac574e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:58.714396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19c20a-725b-404d-b675-2d5d54351a17 tempest-TokensV3TestJSON-69799234 tempest-TokensV3TestJSON-69799234-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2a02736634bd4137aeeb12fe76b4965f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '68da1941fd03481181ba62fc864e7da6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:58.715147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19c20a-725b-404d-b675-2d5d54351a17 tempest-TokensV3TestJSON-69799234 tempest-TokensV3TestJSON-69799234-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:58.715534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19c20a-725b-404d-b675-2d5d54351a17 tempest-TokensV3TestJSON-69799234 tempest-TokensV3TestJSON-69799234-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:58.715915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a19c20a-725b-404d-b675-2d5d54351a17 tempest-TokensV3TestJSON-69799234 tempest-TokensV3TestJSON-69799234-project] PATH_INFO: `/v3/auth/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:58.716745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19c20a-725b-404d-b675-2d5d54351a17 tempest-TokensV3TestJSON-69799234 tempest-TokensV3TestJSON-69799234-project] RBAC: Authorizing `identity:get_auth_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:58.723857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b150775f-b951-4a13-bb22-5d64ac574e36 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:58.724659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a19c20a-725b-404d-b675-2d5d54351a17 tempest-TokensV3TestJSON-69799234 tempest-TokensV3TestJSON-69799234-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:58.728736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e018b-7f6a-44eb-993d-e2c6cf7fce2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:58.729838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e018b-7f6a-44eb-993d-e2c6cf7fce2e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:58.730287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e018b-7f6a-44eb-993d-e2c6cf7fce2e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:58.731478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e018b-7f6a-44eb-993d-e2c6cf7fce2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:58.749873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e018b-7f6a-44eb-993d-e2c6cf7fce2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:58.751501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e018b-7f6a-44eb-993d-e2c6cf7fce2e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:58.783398 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2545/5067] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:16:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:16:58.869241 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2523/5068] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 09:16:58 2022] GET /identity/v3/auth/domains => generated 1170 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:16:58.873940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e018b-7f6a-44eb-993d-e2c6cf7fce2e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:58.876610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-536e018b-7f6a-44eb-993d-e2c6cf7fce2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:59.005268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e018b-7f6a-44eb-993d-e2c6cf7fce2e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:59.026180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:59.030547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:59.036420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:59.036708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/03ce353565604da680636273721e46d8/groups/7b359a0d54374dcfaa6720a6d5ff0990/roles/4798f6bb1d324b3e981914b0e8842f90` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:59.068407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=03ce353565604da680636273721e46d8, group_id=7b359a0d54374dcfaa6720a6d5ff0990, role_id=4798f6bb1d324b3e981914b0e8842f90)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:59.069886 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:16:59.069886 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:16:59.069886 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:16:59.071504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:59.099452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role 4798f6bb1d324b3e981914b0e8842f90 was removed from group 7b359a0d54374dcfaa6720a6d5ff0990 on domain 03ce353565604da680636273721e46d8. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:59.099752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:59.104642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:59.136155 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2546/5069] 10.222.0.25 () {58 vars in 1467 bytes} [Mon Oct 24 09:16:58 2022] DELETE /identity/v3/domains/03ce353565604da680636273721e46d8/groups/7b359a0d54374dcfaa6720a6d5ff0990/roles/4798f6bb1d324b3e981914b0e8842f90 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:16:59.137559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19c20a-725b-404d-b675-2d5d54351a17 tempest-TokensV3TestJSON-69799234 tempest-TokensV3TestJSON-69799234-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:59.141260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a19c20a-725b-404d-b675-2d5d54351a17 tempest-TokensV3TestJSON-69799234 tempest-TokensV3TestJSON-69799234-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:59.185035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a19c20a-725b-404d-b675-2d5d54351a17 tempest-TokensV3TestJSON-69799234 tempest-TokensV3TestJSON-69799234-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:59.324888 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:59.413522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d82c4-1e56-4366-899d-af2fdd48273a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:59.416479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d82c4-1e56-4366-899d-af2fdd48273a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:59.421557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d82c4-1e56-4366-899d-af2fdd48273a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:59.421557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459d82c4-1e56-4366-899d-af2fdd48273a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/groups/7b359a0d54374dcfaa6720a6d5ff0990/users/2a02736634bd4137aeeb12fe76b4965f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:59.430261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d82c4-1e56-4366-899d-af2fdd48273a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=7b359a0d54374dcfaa6720a6d5ff0990, user_id=2a02736634bd4137aeeb12fe76b4965f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:59.433112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459d82c4-1e56-4366-899d-af2fdd48273a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:59.462009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:59.463641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:59.473408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-459d82c4-1e56-4366-899d-af2fdd48273a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2a02736634bd4137aeeb12fe76b4965f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:59.498138 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2524/5070] 10.222.0.25 () {58 vars in 1344 bytes} [Mon Oct 24 09:16:59 2022] DELETE /identity/v3/groups/7b359a0d54374dcfaa6720a6d5ff0990/users/2a02736634bd4137aeeb12fe76b4965f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:59.502908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d82c4-1e56-4366-899d-af2fdd48273a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:59.638311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f108e073-35b5-4a4c-aa2c-a01c11244bcd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:59.662466 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:16:59.669010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459d82c4-1e56-4366-899d-af2fdd48273a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:59.681789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bedf32-b44a-4da2-824c-28ecc3b29faf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:59.682553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bedf32-b44a-4da2-824c-28ecc3b29faf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:59.682781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bedf32-b44a-4da2-824c-28ecc3b29faf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:59.683090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bedf32-b44a-4da2-824c-28ecc3b29faf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/groups/7b359a0d54374dcfaa6720a6d5ff0990` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:59.686452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bedf32-b44a-4da2-824c-28ecc3b29faf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_group(group_id=7b359a0d54374dcfaa6720a6d5ff0990)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:59.688540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bedf32-b44a-4da2-824c-28ecc3b29faf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:59.749337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:16:59.749337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:16:59.749337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:16:59.749337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] PATH_INFO: `/v3/projects/31e412c69e7d4edfa83db69e9498c857` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:16:59.749888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=31e412c69e7d4edfa83db69e9498c857)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:16:59.754248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:16:59.779698 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2525/5071] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:16:59 2022] DELETE /identity/v3/groups/7b359a0d54374dcfaa6720a6d5ff0990 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:59.796194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bedf32-b44a-4da2-824c-28ecc3b29faf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:59.850457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31e412c69e7d4edfa83db69e9498c857', 'request_id': 'req-278bb88c-5e52-4a22-8bc2-f173c33097ea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:59.861887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31e412c69e7d4edfa83db69e9498c857', 'request_id': 'req-278bb88c-5e52-4a22-8bc2-f173c33097ea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:59.876866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31e412c69e7d4edfa83db69e9498c857', 'request_id': 'req-278bb88c-5e52-4a22-8bc2-f173c33097ea'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:59.892279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] The token cache is being invalidate because project 31e412c69e7d4edfa83db69e9498c857 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:16:59.892493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:59.893513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:16:59.896741 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2547/5072] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:16:59 2022] DELETE /identity/v3/projects/31e412c69e7d4edfa83db69e9498c857 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:16:59.901156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:16:59.902765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:16:59.925690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bedf32-b44a-4da2-824c-28ecc3b29faf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:16:59.981921 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:00.036384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278bb88c-5e52-4a22-8bc2-f173c33097ea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:00.047747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:00.048830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:00.049142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:00.049447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] PATH_INFO: `/v3/users/968e423dfeeb4b059b60d76804494fb6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:00.052757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=968e423dfeeb4b059b60d76804494fb6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:00.063623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:00.074075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:00.074731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:00.075114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:00.075426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles/4798f6bb1d324b3e981914b0e8842f90` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:00.079987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4798f6bb1d324b3e981914b0e8842f90)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:00.084040 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:17:00.084040 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:17:00.084040 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:17:00.084957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:00.163125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '968e423dfeeb4b059b60d76804494fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.176541 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:00.177382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role 4798f6bb1d324b3e981914b0e8842f90 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:00.178172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.180554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.186186 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2526/5073] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:59 2022] DELETE /identity/v3/roles/4798f6bb1d324b3e981914b0e8842f90 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:00.190029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:00.191595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:00.195363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '968e423dfeeb4b059b60d76804494fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.196545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '968e423dfeeb4b059b60d76804494fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.213572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '968e423dfeeb4b059b60d76804494fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.230681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '968e423dfeeb4b059b60d76804494fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.240430 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2548/5074] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:16:59 2022] DELETE /identity/v3/users/968e423dfeeb4b059b60d76804494fb6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:00.424003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dae711e-a5f1-478f-8381-75a7fc0a444b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:00.600803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:00.601507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:00.601797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:00.602076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/03ce353565604da680636273721e46d8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:00.605220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=03ce353565604da680636273721e46d8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:00.614207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:00.699594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '03ce353565604da680636273721e46d8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.700624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '03ce353565604da680636273721e46d8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.757499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '03ce353565604da680636273721e46d8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.758343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '03ce353565604da680636273721e46d8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.766562 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2527/5075] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:17:00 2022] PATCH /identity/v3/domains/03ce353565604da680636273721e46d8 => generated 276 bytes in 577 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:00.767293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:00.768780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:00.808211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdc828b-9848-49f5-8c8b-c69b55d162bb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:00.950667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:00.951323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:00.951774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:00.952712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/03ce353565604da680636273721e46d8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:00.966191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=03ce353565604da680636273721e46d8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:00.967879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:00.991981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '03ce353565604da680636273721e46d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:00.997330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:00.999388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:01.001898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '03ce353565604da680636273721e46d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.011969 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:01.082105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03ce353565604da680636273721e46d8', 'request_id': 'req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.096416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03ce353565604da680636273721e46d8', 'request_id': 'req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.105475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03ce353565604da680636273721e46d8', 'request_id': 'req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.110175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b94783-8ac8-4d4d-937f-0ce0b933c505 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:01.119247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] The token cache is being invalidate because project 03ce353565604da680636273721e46d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:01.119247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.119247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.129519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '03ce353565604da680636273721e46d8', 'request_id': 'req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.130240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '03ce353565604da680636273721e46d8', 'request_id': 'req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.131164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '03ce353565604da680636273721e46d8', 'request_id': 'req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.141058 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2549/5076] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:17:00 2022] DELETE /identity/v3/domains/03ce353565604da680636273721e46d8 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:01.156410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:01.161351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:01.181162 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:01.228480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:01.229524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:01.229963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:01.230371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] PATH_INFO: `/v3/projects/d14033165b684913b7376fe5387e0cf4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:01.231738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14033165b684913b7376fe5387e0cf4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:01.235426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:01.297635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313cc675-1dc3-43c0-81d2-cdbf5da2c4a2 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:01.303477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:01.304250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:01.304596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:01.305010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/286b512e0722449596e2a9377f814d86/users/2a02736634bd4137aeeb12fe76b4965f/roles/f1a4723ece91409c869882e6e9c37e24` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:01.309083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=286b512e0722449596e2a9377f814d86, user_id=2a02736634bd4137aeeb12fe76b4965f, role_id=f1a4723ece91409c869882e6e9c37e24)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:01.313238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:01.321790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role f1a4723ece91409c869882e6e9c37e24 was removed from user 2a02736634bd4137aeeb12fe76b4965f on domain 286b512e0722449596e2a9377f814d86. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:01.321790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.322308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.344140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14033165b684913b7376fe5387e0cf4', 'request_id': 'req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.356479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14033165b684913b7376fe5387e0cf4', 'request_id': 'req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.373004 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2550/5077] 10.222.0.25 () {58 vars in 1464 bytes} [Mon Oct 24 09:17:01 2022] DELETE /identity/v3/domains/286b512e0722449596e2a9377f814d86/users/2a02736634bd4137aeeb12fe76b4965f/roles/f1a4723ece91409c869882e6e9c37e24 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:01.379348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:01.382022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:01.384556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14033165b684913b7376fe5387e0cf4', 'request_id': 'req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.403946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] The token cache is being invalidate because project d14033165b684913b7376fe5387e0cf4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:01.404641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.405414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-846e8ce9-32ef-40e9-a8b0-c5696d8d95de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.407336 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2528/5078] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:00 2022] DELETE /identity/v3/projects/d14033165b684913b7376fe5387e0cf4 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:01.412031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f09a4d-ac1b-4d05-bd70-5c5b9ff53778 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:01.412560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f09a4d-ac1b-4d05-bd70-5c5b9ff53778 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:01.413476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f09a4d-ac1b-4d05-bd70-5c5b9ff53778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:01.438490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-44f09a4d-ac1b-4d05-bd70-5c5b9ff53778 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:01.439774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-44f09a4d-ac1b-4d05-bd70-5c5b9ff53778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:01.494387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2b4453-ce98-42d6-8392-f0059685e88a tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:01.497701 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:01.527128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:01.527788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:01.528072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:01.528349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles/f1a4723ece91409c869882e6e9c37e24` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:01.530245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f1a4723ece91409c869882e6e9c37e24)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:01.531325 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:17:01.531325 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:17:01.531325 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:17:01.532213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:01.533679 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2529/5079] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:17:01.550048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ecc9f-df4d-4c07-a839-6e8962da5ba8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:01.550337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ecc9f-df4d-4c07-a839-6e8962da5ba8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:01.550692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082ecc9f-df4d-4c07-a839-6e8962da5ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:01.586597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-082ecc9f-df4d-4c07-a839-6e8962da5ba8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:01.588150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-082ecc9f-df4d-4c07-a839-6e8962da5ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:01.605032 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2530/5080] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:17:01.611175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ecc9f-df4d-4c07-a839-6e8962da5ba8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:01.612268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role f1a4723ece91409c869882e6e9c37e24 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:01.612606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.616874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.624335 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2551/5081] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:01 2022] DELETE /identity/v3/roles/f1a4723ece91409c869882e6e9c37e24 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:01.625103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:01.626468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:01.626910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082ecc9f-df4d-4c07-a839-6e8962da5ba8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:01.703713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:01.704068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17f5b7e-986e-4208-a025-35a08c3f2337 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:01.705096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:01.705727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:01.706285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:01.707197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:17:01.707995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:01.708912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:01.709563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:01.709978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:01.710271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/286b512e0722449596e2a9377f814d86` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:01.710961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:01.711498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=286b512e0722449596e2a9377f814d86)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:01.713267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:01.723120 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:01.727878 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2531/5082] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:01.734271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:01.736194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:01.746810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '286b512e0722449596e2a9377f814d86'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.748527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '286b512e0722449596e2a9377f814d86'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.750742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e63fe9c-4d83-4a23-b9aa-7cb126612ec9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:01.785024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '286b512e0722449596e2a9377f814d86'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.785820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '286b512e0722449596e2a9377f814d86'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:01.791881 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2552/5083] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:17:01 2022] PATCH /identity/v3/domains/286b512e0722449596e2a9377f814d86 => generated 276 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:01.793445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:01.796018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:01.833692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c7ff-4cc2-438b-9b43-b344605d0c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:01.835417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c7ff-4cc2-438b-9b43-b344605d0c67 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:01.835801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c7ff-4cc2-438b-9b43-b344605d0c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:01.836175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d2c7ff-4cc2-438b-9b43-b344605d0c67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:01.836962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2c7ff-4cc2-438b-9b43-b344605d0c67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:01.840428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d2c7ff-4cc2-438b-9b43-b344605d0c67 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:01.877652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64614744-bf80-42b4-94e2-cd9d40603bb1 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:01.880062 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2532/5084] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:01 2022] POST /identity/v3/projects => generated 377 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:01.885083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c7ff-4cc2-438b-9b43-b344605d0c67 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:01.887225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b5d2c7ff-4cc2-438b-9b43-b344605d0c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:02.007030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:02.009349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:02.009349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:02.009349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/286b512e0722449596e2a9377f814d86` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:02.037417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=286b512e0722449596e2a9377f814d86)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:02.041362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:02.068676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d2c7ff-4cc2-438b-9b43-b344605d0c67 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:02.080698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dfffeb-26cf-4b1d-892f-d628893bb8c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:02.081372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfffeb-26cf-4b1d-892f-d628893bb8c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:02.081661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfffeb-26cf-4b1d-892f-d628893bb8c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:02.081941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dfffeb-26cf-4b1d-892f-d628893bb8c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:02.083283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfffeb-26cf-4b1d-892f-d628893bb8c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:02.085148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dfffeb-26cf-4b1d-892f-d628893bb8c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:02.094771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '286b512e0722449596e2a9377f814d86'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.103000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '286b512e0722449596e2a9377f814d86'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.109856 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:02.147777 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2533/5085] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:01 2022] POST /identity/v3/users => generated 289 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:02.149963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e64431-d1b0-4a6b-b7ab-b4bfd7082c06 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:02.150512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e64431-d1b0-4a6b-b7ab-b4bfd7082c06 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:02.151014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e64431-d1b0-4a6b-b7ab-b4bfd7082c06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:02.207638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '286b512e0722449596e2a9377f814d86', 'request_id': 'req-aab7fc87-a985-41e9-b776-08a20d0b0dbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.210778 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:02.220268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-95e64431-d1b0-4a6b-b7ab-b4bfd7082c06 None None] MFA Rules not processed for user `b1ae9fcca02548dfa6e29d2787288e49`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:02.221659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-95e64431-d1b0-4a6b-b7ab-b4bfd7082c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:02.232455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '286b512e0722449596e2a9377f814d86', 'request_id': 'req-aab7fc87-a985-41e9-b776-08a20d0b0dbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.251662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '286b512e0722449596e2a9377f814d86', 'request_id': 'req-aab7fc87-a985-41e9-b776-08a20d0b0dbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.272285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] The token cache is being invalidate because project 286b512e0722449596e2a9377f814d86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:02.272794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.273727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.284507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '286b512e0722449596e2a9377f814d86', 'request_id': 'req-aab7fc87-a985-41e9-b776-08a20d0b0dbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.286094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '286b512e0722449596e2a9377f814d86', 'request_id': 'req-aab7fc87-a985-41e9-b776-08a20d0b0dbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.286969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '286b512e0722449596e2a9377f814d86', 'request_id': 'req-aab7fc87-a985-41e9-b776-08a20d0b0dbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.304271 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2553/5086] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:17:01 2022] DELETE /identity/v3/domains/286b512e0722449596e2a9377f814d86 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:02.304271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:02.304271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:02.345770 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2534/5087] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:02.346898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e64431-d1b0-4a6b-b7ab-b4bfd7082c06 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:02.350992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-95e64431-d1b0-4a6b-b7ab-b4bfd7082c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:02.440128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab7fc87-a985-41e9-b776-08a20d0b0dbd tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:02.453638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc93128-96af-4e39-8d2f-f982eba21add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:02.455856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc93128-96af-4e39-8d2f-f982eba21add admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:02.457431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc93128-96af-4e39-8d2f-f982eba21add admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:02.457764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc93128-96af-4e39-8d2f-f982eba21add admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:02.460357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc93128-96af-4e39-8d2f-f982eba21add admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:02.463015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc93128-96af-4e39-8d2f-f982eba21add admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:02.483064 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2554/5088] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:02 2022] GET /identity/v3/roles => generated 1880 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:02.488307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc93128-96af-4e39-8d2f-f982eba21add admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:02.503303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e64431-d1b0-4a6b-b7ab-b4bfd7082c06 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:02.507868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc93128-96af-4e39-8d2f-f982eba21add admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:02.512694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:02.513687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:02.513982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:02.514800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/967fd261196a454aaae03825502fe382/groups/3c3315d3571247fa9637eab26e265adf/roles/5bc9073510e54befbb937f173c58cafc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:02.521110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81863c01-071a-45a2-8253-5ccd7f05e24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:02.521413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=967fd261196a454aaae03825502fe382, group_id=3c3315d3571247fa9637eab26e265adf, role_id=5bc9073510e54befbb937f173c58cafc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:02.522215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81863c01-071a-45a2-8253-5ccd7f05e24e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:02.522647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81863c01-071a-45a2-8253-5ccd7f05e24e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:02.522802 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:17:02.522802 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:17:02.522802 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:17:02.523365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81863c01-071a-45a2-8253-5ccd7f05e24e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:02.524127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81863c01-071a-45a2-8253-5ccd7f05e24e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:02.525980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:02.526177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81863c01-071a-45a2-8253-5ccd7f05e24e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:02.540197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role 5bc9073510e54befbb937f173c58cafc was removed from group 3c3315d3571247fa9637eab26e265adf on domain 967fd261196a454aaae03825502fe382. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:02.540498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.541618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.547936 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2555/5089] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:02 2022] GET /identity/v3/roles => generated 1880 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:17:02.550109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81863c01-071a-45a2-8253-5ccd7f05e24e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:02.568170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-81863c01-071a-45a2-8253-5ccd7f05e24e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:02.570210 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2535/5090] 10.222.0.25 () {58 vars in 1467 bytes} [Mon Oct 24 09:17:02 2022] DELETE /identity/v3/domains/967fd261196a454aaae03825502fe382/groups/3c3315d3571247fa9637eab26e265adf/roles/5bc9073510e54befbb937f173c58cafc => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:02.575739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:02.577776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:02.625485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81863c01-071a-45a2-8253-5ccd7f05e24e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:02.749728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58747472-4c34-4c75-926a-ffd1a72e1111 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:02.757754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f01f44-d4fb-494a-a543-5e69e67ceaeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:02.758154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01f44-d4fb-494a-a543-5e69e67ceaeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:02.759723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01f44-d4fb-494a-a543-5e69e67ceaeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:02.759923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f01f44-d4fb-494a-a543-5e69e67ceaeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/groups/3c3315d3571247fa9637eab26e265adf/users/2a02736634bd4137aeeb12fe76b4965f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:02.762953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f01f44-d4fb-494a-a543-5e69e67ceaeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=3c3315d3571247fa9637eab26e265adf, user_id=2a02736634bd4137aeeb12fe76b4965f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:02.767473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f01f44-d4fb-494a-a543-5e69e67ceaeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:02.782525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a279ced-b991-4d19-b199-ce44066b3315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:02.783177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8f01f44-d4fb-494a-a543-5e69e67ceaeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '2a02736634bd4137aeeb12fe76b4965f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:02.783321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a279ced-b991-4d19-b199-ce44066b3315 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:02.783678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a279ced-b991-4d19-b199-ce44066b3315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:02.783967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a279ced-b991-4d19-b199-ce44066b3315 admin admin] PATH_INFO: `/v3/projects/c38fb7a1a68c4a63bc1b5e4d6b65aef9/users/1f3c737be1964a84b23e7202679874e2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:02.806231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a279ced-b991-4d19-b199-ce44066b3315 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38fb7a1a68c4a63bc1b5e4d6b65aef9, user_id=1f3c737be1964a84b23e7202679874e2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:02.807287 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=4,keystone:SELECT=93,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:02.811114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a279ced-b991-4d19-b199-ce44066b3315 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:02.813485 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2536/5091] 10.222.0.25 () {58 vars in 1344 bytes} [Mon Oct 24 09:17:02 2022] DELETE /identity/v3/groups/3c3315d3571247fa9637eab26e265adf/users/2a02736634bd4137aeeb12fe76b4965f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:02.817431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f01f44-d4fb-494a-a543-5e69e67ceaeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:02.843551 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2556/5092] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:02 2022] PUT /identity/v3/projects/c38fb7a1a68c4a63bc1b5e4d6b65aef9/users/1f3c737be1964a84b23e7202679874e2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:02.854017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11af7ad-937a-4609-819b-64b13ebeead1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:02.854729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11af7ad-937a-4609-819b-64b13ebeead1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:02.855410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11af7ad-937a-4609-819b-64b13ebeead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:02.926766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b11af7ad-937a-4609-819b-64b13ebeead1 None None] MFA Rules not processed for user `1f3c737be1964a84b23e7202679874e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:02.930295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b11af7ad-937a-4609-819b-64b13ebeead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:02.959775 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:02.970378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f01f44-d4fb-494a-a543-5e69e67ceaeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:03.050805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e2d29-8359-470a-bc13-793527039c2f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:03.051661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e2d29-8359-470a-bc13-793527039c2f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:03.051661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e2d29-8359-470a-bc13-793527039c2f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:03.052020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28e2d29-8359-470a-bc13-793527039c2f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/groups/3c3315d3571247fa9637eab26e265adf` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:03.053372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e2d29-8359-470a-bc13-793527039c2f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_group(group_id=3c3315d3571247fa9637eab26e265adf)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:03.063546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28e2d29-8359-470a-bc13-793527039c2f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:03.065325 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2557/5093] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:17:03.070595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11af7ad-937a-4609-819b-64b13ebeead1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:03.140430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2537/5094] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:17:02 2022] DELETE /identity/v3/groups/3c3315d3571247fa9637eab26e265adf => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:03.148350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e2d29-8359-470a-bc13-793527039c2f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:03.206095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11af7ad-937a-4609-819b-64b13ebeead1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:03.251773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28e2d29-8359-470a-bc13-793527039c2f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:03.262333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:03.263028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:03.263319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:03.264032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles/5bc9073510e54befbb937f173c58cafc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:03.266605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5bc9073510e54befbb937f173c58cafc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:03.276478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:03.314647 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:03.324026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaad33e-7a2e-4257-a7a8-6b5f9fd125b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:03.325197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaad33e-7a2e-4257-a7a8-6b5f9fd125b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:03.325530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaad33e-7a2e-4257-a7a8-6b5f9fd125b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:03.327711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaad33e-7a2e-4257-a7a8-6b5f9fd125b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:03.328385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaad33e-7a2e-4257-a7a8-6b5f9fd125b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:03.332706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaad33e-7a2e-4257-a7a8-6b5f9fd125b0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:03.380671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role 5bc9073510e54befbb937f173c58cafc has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:03.381476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:03.382152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:03.387016 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2538/5095] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:03 2022] DELETE /identity/v3/roles/5bc9073510e54befbb937f173c58cafc => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:03.390781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:03.396512 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2558/5096] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:03 2022] POST /identity/v3/projects => generated 377 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:17:03.396840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:03.397779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaad33e-7a2e-4257-a7a8-6b5f9fd125b0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:03.402894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fbaad33e-7a2e-4257-a7a8-6b5f9fd125b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:03.514114 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:03.567791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaad33e-7a2e-4257-a7a8-6b5f9fd125b0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:03.576185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de21fb-f1fe-4ddc-88c4-605e9a7f4be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:03.576857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de21fb-f1fe-4ddc-88c4-605e9a7f4be2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:03.577145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de21fb-f1fe-4ddc-88c4-605e9a7f4be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:03.577452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16de21fb-f1fe-4ddc-88c4-605e9a7f4be2 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:03.578106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de21fb-f1fe-4ddc-88c4-605e9a7f4be2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:03.580033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16de21fb-f1fe-4ddc-88c4-605e9a7f4be2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:03.581041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35666020-81df-4a13-a87c-a9401417c343 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:03.627859 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2559/5097] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:03 2022] POST /identity/v3/users => generated 289 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:03.632815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de21fb-f1fe-4ddc-88c4-605e9a7f4be2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:03.646467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16de21fb-f1fe-4ddc-88c4-605e9a7f4be2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:03.652423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea0c08-138f-4219-b981-aa2194975249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:03.653340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea0c08-138f-4219-b981-aa2194975249 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:03.653907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea0c08-138f-4219-b981-aa2194975249 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:03.654531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ea0c08-138f-4219-b981-aa2194975249 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:03.655986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea0c08-138f-4219-b981-aa2194975249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:03.658391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ea0c08-138f-4219-b981-aa2194975249 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:03.671096 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2560/5098] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:03 2022] GET /identity/v3/roles => generated 1649 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:03.675237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea0c08-138f-4219-b981-aa2194975249 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:03.682462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:03.684160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:03.686026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:03.686547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/967fd261196a454aaae03825502fe382` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:03.691117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=967fd261196a454aaae03825502fe382)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:03.698298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:03.699742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ea0c08-138f-4219-b981-aa2194975249 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:03.714048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54aa3-9806-4fda-9ddd-01ae846c1b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:03.714790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54aa3-9806-4fda-9ddd-01ae846c1b2c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:03.715136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54aa3-9806-4fda-9ddd-01ae846c1b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:03.715487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c54aa3-9806-4fda-9ddd-01ae846c1b2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:03.716226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54aa3-9806-4fda-9ddd-01ae846c1b2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:03.718519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c54aa3-9806-4fda-9ddd-01ae846c1b2c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:03.745980 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2561/5099] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:03 2022] GET /identity/v3/roles => generated 1649 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:03.750455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54aa3-9806-4fda-9ddd-01ae846c1b2c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:03.752154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '967fd261196a454aaae03825502fe382'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:03.753687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '967fd261196a454aaae03825502fe382'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:03.767585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c54aa3-9806-4fda-9ddd-01ae846c1b2c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:03.817352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '967fd261196a454aaae03825502fe382'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:03.817940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '967fd261196a454aaae03825502fe382'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:03.820809 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2539/5100] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:17:03 2022] PATCH /identity/v3/domains/967fd261196a454aaae03825502fe382 => generated 276 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:03.825237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:03.828002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:03.864028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c9dd65-671e-4251-bf64-fc410ce3c15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:03.865206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9dd65-671e-4251-bf64-fc410ce3c15b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:03.865679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9dd65-671e-4251-bf64-fc410ce3c15b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:03.865829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c9dd65-671e-4251-bf64-fc410ce3c15b admin admin] PATH_INFO: `/v3/projects/ddd15b86fd154dd7a2c4821c13c17637/users/28c51e0231ef47f38576b18e229fc1b4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:03.891418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9dd65-671e-4251-bf64-fc410ce3c15b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddd15b86fd154dd7a2c4821c13c17637, user_id=28c51e0231ef47f38576b18e229fc1b4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:03.895966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c9dd65-671e-4251-bf64-fc410ce3c15b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:03.914538 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:03.918264 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2562/5101] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:03 2022] PUT /identity/v3/projects/ddd15b86fd154dd7a2c4821c13c17637/users/28c51e0231ef47f38576b18e229fc1b4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:03.931317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ff5cd-a610-4abb-b085-1e115472a691 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:03.933396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ff5cd-a610-4abb-b085-1e115472a691 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:03.933943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9ff5cd-a610-4abb-b085-1e115472a691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:03.953808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791d2d46-2021-4e4a-81f1-5722e1ae790e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:03.989143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ff9ff5cd-a610-4abb-b085-1e115472a691 None None] MFA Rules not processed for user `28c51e0231ef47f38576b18e229fc1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:03.991267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff9ff5cd-a610-4abb-b085-1e115472a691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:04.030250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.030902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.031249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.031467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/967fd261196a454aaae03825502fe382` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.054763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=967fd261196a454aaae03825502fe382)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.054763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.089536 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2563/5102] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:03 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:04.090853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ff5cd-a610-4abb-b085-1e115472a691 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:04.091874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '967fd261196a454aaae03825502fe382'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.093984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff9ff5cd-a610-4abb-b085-1e115472a691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:04.099137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '967fd261196a454aaae03825502fe382'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.154360 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:04.191030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '967fd261196a454aaae03825502fe382', 'request_id': 'req-256e7023-4b6d-4f53-bda5-4f0d8940119f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.203282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '967fd261196a454aaae03825502fe382', 'request_id': 'req-256e7023-4b6d-4f53-bda5-4f0d8940119f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.220178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9ff5cd-a610-4abb-b085-1e115472a691 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:04.221923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '967fd261196a454aaae03825502fe382', 'request_id': 'req-256e7023-4b6d-4f53-bda5-4f0d8940119f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.236829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] The token cache is being invalidate because project 967fd261196a454aaae03825502fe382 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:04.248687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.251680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.271358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '967fd261196a454aaae03825502fe382', 'request_id': 'req-256e7023-4b6d-4f53-bda5-4f0d8940119f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.272191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '967fd261196a454aaae03825502fe382', 'request_id': 'req-256e7023-4b6d-4f53-bda5-4f0d8940119f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.272843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '967fd261196a454aaae03825502fe382', 'request_id': 'req-256e7023-4b6d-4f53-bda5-4f0d8940119f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.289121 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2540/5103] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:17:03 2022] DELETE /identity/v3/domains/967fd261196a454aaae03825502fe382 => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:04.293843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:04.295453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:04.300008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc93a38-41b9-4092-87f5-7345efae1f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.300843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc93a38-41b9-4092-87f5-7345efae1f20 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.301338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc93a38-41b9-4092-87f5-7345efae1f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.301806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc93a38-41b9-4092-87f5-7345efae1f20 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.302745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc93a38-41b9-4092-87f5-7345efae1f20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.304743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc93a38-41b9-4092-87f5-7345efae1f20 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.361345 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2564/5104] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:04 2022] POST /identity/v3/projects => generated 375 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:04.361345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc93a38-41b9-4092-87f5-7345efae1f20 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:04.362826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fcc93a38-41b9-4092-87f5-7345efae1f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:04.364529 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:04.412061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256e7023-4b6d-4f53-bda5-4f0d8940119f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:04.457124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc93a38-41b9-4092-87f5-7345efae1f20 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:04.464558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab7969-3fa9-469b-83d4-5e66244b3a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.465500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab7969-3fa9-469b-83d4-5e66244b3a1f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.466003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab7969-3fa9-469b-83d4-5e66244b3a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.466504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dab7969-3fa9-469b-83d4-5e66244b3a1f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.467550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab7969-3fa9-469b-83d4-5e66244b3a1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.469762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dab7969-3fa9-469b-83d4-5e66244b3a1f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.493671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.494736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.494947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.495332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/13c4ccc485674c229da9ed9dbf185817/users/2a02736634bd4137aeeb12fe76b4965f/roles/2c9680292258453ca0a869de360c0203` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.500143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=13c4ccc485674c229da9ed9dbf185817, user_id=2a02736634bd4137aeeb12fe76b4965f, role_id=2c9680292258453ca0a869de360c0203)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.503614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.505494 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2565/5105] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:04 2022] POST /identity/v3/users => generated 294 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:04.509535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab7969-3fa9-469b-83d4-5e66244b3a1f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:04.513236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role 2c9680292258453ca0a869de360c0203 was removed from user 2a02736634bd4137aeeb12fe76b4965f on domain 13c4ccc485674c229da9ed9dbf185817. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:04.513691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.515210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.525616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dab7969-3fa9-469b-83d4-5e66244b3a1f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:04.536570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff146c2d-bb21-4bbd-bf90-6ac3a832cf2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.537423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff146c2d-bb21-4bbd-bf90-6ac3a832cf2b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.537881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff146c2d-bb21-4bbd-bf90-6ac3a832cf2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.538646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff146c2d-bb21-4bbd-bf90-6ac3a832cf2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.540070 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2541/5106] 10.222.0.25 () {58 vars in 1464 bytes} [Mon Oct 24 09:17:04 2022] DELETE /identity/v3/domains/13c4ccc485674c229da9ed9dbf185817/users/2a02736634bd4137aeeb12fe76b4965f/roles/2c9680292258453ca0a869de360c0203 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:04.541376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff146c2d-bb21-4bbd-bf90-6ac3a832cf2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.543548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff146c2d-bb21-4bbd-bf90-6ac3a832cf2b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.583174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:04.584682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:04.597661 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2566/5107] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:04 2022] GET /identity/v3/roles => generated 1649 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:17:04.613647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff146c2d-bb21-4bbd-bf90-6ac3a832cf2b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:04.622605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff146c2d-bb21-4bbd-bf90-6ac3a832cf2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:04.640281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff146c2d-bb21-4bbd-bf90-6ac3a832cf2b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:04.676361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6867032e-d14d-4f3f-be59-2db1173ed5e5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:04.683411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.684058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.684344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.684621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles/2c9680292258453ca0a869de360c0203` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.686800 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:04.686936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=2c9680292258453ca0a869de360c0203)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.690129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.720826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a653a40-5d02-4593-9a43-8406bec8cb1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.721560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a653a40-5d02-4593-9a43-8406bec8cb1a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.721831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a653a40-5d02-4593-9a43-8406bec8cb1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.722109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a653a40-5d02-4593-9a43-8406bec8cb1a admin admin] PATH_INFO: `/v3/projects/29dfd4debd824d1186b36631eba94bca/users/8757d723c096476fba41f507e97d5de4/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.735081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role 2c9680292258453ca0a869de360c0203 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:04.736305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.738162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.740789 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2542/5108] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:04 2022] DELETE /identity/v3/roles/2c9680292258453ca0a869de360c0203 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:04.745215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:04.747091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:04.761109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a653a40-5d02-4593-9a43-8406bec8cb1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=29dfd4debd824d1186b36631eba94bca, user_id=8757d723c096476fba41f507e97d5de4, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.764873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a653a40-5d02-4593-9a43-8406bec8cb1a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.782410 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2567/5109] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:04 2022] PUT /identity/v3/projects/29dfd4debd824d1186b36631eba94bca/users/8757d723c096476fba41f507e97d5de4/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:04.783596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a653a40-5d02-4593-9a43-8406bec8cb1a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:04.785809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a653a40-5d02-4593-9a43-8406bec8cb1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:04.811741 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:04.859979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcacbe7-39f0-4d89-b5aa-94b516d1392e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:04.877874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a653a40-5d02-4593-9a43-8406bec8cb1a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:04.884104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4db314-144f-4f76-87ac-7f0d12caa585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.884791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4db314-144f-4f76-87ac-7f0d12caa585 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.885081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4db314-144f-4f76-87ac-7f0d12caa585 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.885392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4db314-144f-4f76-87ac-7f0d12caa585 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.886114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4db314-144f-4f76-87ac-7f0d12caa585 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.887873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4db314-144f-4f76-87ac-7f0d12caa585 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.912100 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2568/5110] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:04 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:04.917546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4db314-144f-4f76-87ac-7f0d12caa585 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:04.930603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4db314-144f-4f76-87ac-7f0d12caa585 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:04.937641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de46b161-4fcf-42dd-b29e-6e1fc184cc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.938381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46b161-4fcf-42dd-b29e-6e1fc184cc62 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.938751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46b161-4fcf-42dd-b29e-6e1fc184cc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.939078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de46b161-4fcf-42dd-b29e-6e1fc184cc62 admin admin] PATH_INFO: `/v3/projects/29dfd4debd824d1186b36631eba94bca/users/8757d723c096476fba41f507e97d5de4/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.941257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:04.942535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46b161-4fcf-42dd-b29e-6e1fc184cc62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29dfd4debd824d1186b36631eba94bca, user_id=8757d723c096476fba41f507e97d5de4, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.942890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.943181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.943470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/13c4ccc485674c229da9ed9dbf185817` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:04.944797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=13c4ccc485674c229da9ed9dbf185817)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:04.945188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de46b161-4fcf-42dd-b29e-6e1fc184cc62 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.946463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:04.969759 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2569/5111] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:04 2022] PUT /identity/v3/projects/29dfd4debd824d1186b36631eba94bca/users/8757d723c096476fba41f507e97d5de4/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:04.978852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '13c4ccc485674c229da9ed9dbf185817'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.979117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '13c4ccc485674c229da9ed9dbf185817'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:04.980164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce37f4-2fa1-4080-9fe3-16b6d9523f93 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:04.980412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce37f4-2fa1-4080-9fe3-16b6d9523f93 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:04.980696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fce37f4-2fa1-4080-9fe3-16b6d9523f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:05.021577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '13c4ccc485674c229da9ed9dbf185817'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.022466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '13c4ccc485674c229da9ed9dbf185817'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.025049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2fce37f4-2fa1-4080-9fe3-16b6d9523f93 None None] MFA Rules not processed for user `8757d723c096476fba41f507e97d5de4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:05.028762 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2543/5112] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:17:04 2022] PATCH /identity/v3/domains/13c4ccc485674c229da9ed9dbf185817 => generated 278 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:05.030011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2fce37f4-2fa1-4080-9fe3-16b6d9523f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:05.031071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:05.033826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:05.194160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef989613-380a-430c-bc3f-251e6b7755f8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:05.195508 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2570/5113] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:17:05.200788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:05.202050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:05.202796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:05.203460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/13c4ccc485674c229da9ed9dbf185817` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:05.209736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce37f4-2fa1-4080-9fe3-16b6d9523f93 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:05.211301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2fce37f4-2fa1-4080-9fe3-16b6d9523f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:05.220410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=13c4ccc485674c229da9ed9dbf185817)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:05.222587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:05.278235 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:05.318899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fce37f4-2fa1-4080-9fe3-16b6d9523f93 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:05.324418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '13c4ccc485674c229da9ed9dbf185817'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.327237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9134262-255d-4a77-a754-1e7fdf251a64 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:05.328001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '13c4ccc485674c229da9ed9dbf185817'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.328436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134262-255d-4a77-a754-1e7fdf251a64 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:05.328947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134262-255d-4a77-a754-1e7fdf251a64 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:05.329546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9134262-255d-4a77-a754-1e7fdf251a64 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:05.331877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e9134262-255d-4a77-a754-1e7fdf251a64 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:05.341379 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:05.391727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13c4ccc485674c229da9ed9dbf185817', 'request_id': 'req-d062d661-4c31-401a-a9bc-cf00e2e37a9e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.399419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13c4ccc485674c229da9ed9dbf185817', 'request_id': 'req-d062d661-4c31-401a-a9bc-cf00e2e37a9e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.404551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9134262-255d-4a77-a754-1e7fdf251a64 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:05.406611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9134262-255d-4a77-a754-1e7fdf251a64 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:05.410217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13c4ccc485674c229da9ed9dbf185817', 'request_id': 'req-d062d661-4c31-401a-a9bc-cf00e2e37a9e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.419892 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2571/5114] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:05 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:05.426533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] The token cache is being invalidate because project 13c4ccc485674c229da9ed9dbf185817 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:05.427007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.427444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.436541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '13c4ccc485674c229da9ed9dbf185817', 'request_id': 'req-d062d661-4c31-401a-a9bc-cf00e2e37a9e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.437533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '13c4ccc485674c229da9ed9dbf185817', 'request_id': 'req-d062d661-4c31-401a-a9bc-cf00e2e37a9e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.438230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '13c4ccc485674c229da9ed9dbf185817', 'request_id': 'req-d062d661-4c31-401a-a9bc-cf00e2e37a9e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:05.448248 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2544/5115] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:17:05 2022] DELETE /identity/v3/domains/13c4ccc485674c229da9ed9dbf185817 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:05.458658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9134262-255d-4a77-a754-1e7fdf251a64 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:05.471850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9134262-255d-4a77-a754-1e7fdf251a64 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:05.588825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a53aa3-b6c5-471a-9ae9-b040a409b092 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:05.589508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a53aa3-b6c5-471a-9ae9-b040a409b092 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:05.590571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a53aa3-b6c5-471a-9ae9-b040a409b092 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:05.590861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a53aa3-b6c5-471a-9ae9-b040a409b092 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:05.593710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a53aa3-b6c5-471a-9ae9-b040a409b092 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:05.597860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a53aa3-b6c5-471a-9ae9-b040a409b092 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:05.628493 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2572/5116] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:05 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:05.629219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:05.631090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:05.661705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d062d661-4c31-401a-a9bc-cf00e2e37a9e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:05.699211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f81c4-8d6b-45b3-bc8f-ac05af58e4a4 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:05.700237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f81c4-8d6b-45b3-bc8f-ac05af58e4a4 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:05.700801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f81c4-8d6b-45b3-bc8f-ac05af58e4a4 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:05.701242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f81c4-8d6b-45b3-bc8f-ac05af58e4a4 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/projects/6f00ae9fa03a4a9e932747381ade81ac/users/7ef5b1816b5a42ff8cc0fe07159c5751/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:05.709156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f81c4-8d6b-45b3-bc8f-ac05af58e4a4 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_grant(project_id=6f00ae9fa03a4a9e932747381ade81ac, user_id=7ef5b1816b5a42ff8cc0fe07159c5751, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:05.716785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f81c4-8d6b-45b3-bc8f-ac05af58e4a4 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:05.745009 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2545/5117] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:05 2022] PUT /identity/v3/projects/6f00ae9fa03a4a9e932747381ade81ac/users/7ef5b1816b5a42ff8cc0fe07159c5751/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:05.749673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a53aa3-b6c5-471a-9ae9-b040a409b092 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:05.763394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a53aa3-b6c5-471a-9ae9-b040a409b092 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:05.916378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15623657-1c85-4ac8-89df-e5539ce6b473 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:05.917439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15623657-1c85-4ac8-89df-e5539ce6b473 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:05.917439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15623657-1c85-4ac8-89df-e5539ce6b473 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:05.917439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15623657-1c85-4ac8-89df-e5539ce6b473 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/auth/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:05.918096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15623657-1c85-4ac8-89df-e5539ce6b473 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:get_auth_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:05.919078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15623657-1c85-4ac8-89df-e5539ce6b473 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:05.978106 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:06.052286 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2573/5118] 10.222.0.25 () {58 vars in 1146 bytes} [Mon Oct 24 09:17:05 2022] GET /identity/v3/auth/projects => generated 824 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:06.063290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f81c4-8d6b-45b3-bc8f-ac05af58e4a4 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:06.098488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f81c4-8d6b-45b3-bc8f-ac05af58e4a4 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:06.124799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:06.126106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:06.126641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:06.127311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/projects/6f00ae9fa03a4a9e932747381ade81ac/users/7ef5b1816b5a42ff8cc0fe07159c5751/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:06.135839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=6f00ae9fa03a4a9e932747381ade81ac, user_id=7ef5b1816b5a42ff8cc0fe07159c5751, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:06.142063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:06.202405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role d266f03406d94df8bb9cad19b577978f was removed from user 7ef5b1816b5a42ff8cc0fe07159c5751 on project 6f00ae9fa03a4a9e932747381ade81ac. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:06.202405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:06.202405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:06.259842 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2546/5119] 10.222.0.25 () {58 vars in 1467 bytes} [Mon Oct 24 09:17:06 2022] DELETE /identity/v3/projects/6f00ae9fa03a4a9e932747381ade81ac/users/7ef5b1816b5a42ff8cc0fe07159c5751/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:06.268630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15623657-1c85-4ac8-89df-e5539ce6b473 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:06.271551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-15623657-1c85-4ac8-89df-e5539ce6b473 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:06.316659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15623657-1c85-4ac8-89df-e5539ce6b473 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:06.495414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6e835-0790-478f-9ca5-69d24d744690 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:06.496444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6e835-0790-478f-9ca5-69d24d744690 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:06.497988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6e835-0790-478f-9ca5-69d24d744690 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:06.498333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e6e835-0790-478f-9ca5-69d24d744690 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:06.499829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6e835-0790-478f-9ca5-69d24d744690 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:06.506309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e6e835-0790-478f-9ca5-69d24d744690 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:06.533955 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2574/5120] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:06 2022] POST /identity/v3/users => generated 321 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:06.537805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:06.549752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30af5e76-d858-44f5-81fa-ac266e0f678f tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:06.554701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710e5b2-1233-4f7c-b59f-b9c8cf1a17d3 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:06.555319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710e5b2-1233-4f7c-b59f-b9c8cf1a17d3 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:06.555598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710e5b2-1233-4f7c-b59f-b9c8cf1a17d3 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:06.555872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710e5b2-1233-4f7c-b59f-b9c8cf1a17d3 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:06.556793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710e5b2-1233-4f7c-b59f-b9c8cf1a17d3 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:06.560049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710e5b2-1233-4f7c-b59f-b9c8cf1a17d3 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:06.614652 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2547/5121] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:06 2022] POST /identity/v3/projects => generated 363 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:06.619221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6e835-0790-478f-9ca5-69d24d744690 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:06.642450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e6e835-0790-478f-9ca5-69d24d744690 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:06.721164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f5ca-6458-4a93-b34d-b994ddfd73c5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:06.723570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f5ca-6458-4a93-b34d-b994ddfd73c5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:06.725193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f5ca-6458-4a93-b34d-b994ddfd73c5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:06.725748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a2f5ca-6458-4a93-b34d-b994ddfd73c5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:06.726742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f5ca-6458-4a93-b34d-b994ddfd73c5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:06.730706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a2f5ca-6458-4a93-b34d-b994ddfd73c5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:06.785237 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2575/5122] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:06 2022] POST /identity/v3/projects => generated 364 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:17:06.790079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710e5b2-1233-4f7c-b59f-b9c8cf1a17d3 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:06.804214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710e5b2-1233-4f7c-b59f-b9c8cf1a17d3 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:06.896791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8b884-4dfd-4e1b-9a95-f8ff1ba28aeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:06.898451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8b884-4dfd-4e1b-9a95-f8ff1ba28aeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:06.899111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8b884-4dfd-4e1b-9a95-f8ff1ba28aeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:06.899555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e8b884-4dfd-4e1b-9a95-f8ff1ba28aeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:06.901187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8b884-4dfd-4e1b-9a95-f8ff1ba28aeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:06.903418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e8b884-4dfd-4e1b-9a95-f8ff1ba28aeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:06.939564 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2548/5123] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:17:06 2022] POST /identity/v3/roles => generated 240 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:06.940825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f5ca-6458-4a93-b34d-b994ddfd73c5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:06.955009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a2f5ca-6458-4a93-b34d-b994ddfd73c5 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:06.961540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43622474-3bd4-4794-9f20-e4021bf33ee9 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:06.962621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43622474-3bd4-4794-9f20-e4021bf33ee9 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:06.963109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43622474-3bd4-4794-9f20-e4021bf33ee9 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:06.963557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43622474-3bd4-4794-9f20-e4021bf33ee9 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/projects/9e44d823833148f29e21810df5e40009/users/4f9d3a5fee0b484d9adf2b064c18c250/roles/590e4c26dabd482995a47859894a1b5e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:06.985760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43622474-3bd4-4794-9f20-e4021bf33ee9 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_grant(project_id=9e44d823833148f29e21810df5e40009, user_id=4f9d3a5fee0b484d9adf2b064c18c250, role_id=590e4c26dabd482995a47859894a1b5e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:06.989543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43622474-3bd4-4794-9f20-e4021bf33ee9 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:07.010840 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2576/5124] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:06 2022] PUT /identity/v3/projects/9e44d823833148f29e21810df5e40009/users/4f9d3a5fee0b484d9adf2b064c18c250/roles/590e4c26dabd482995a47859894a1b5e => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:07.011828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8b884-4dfd-4e1b-9a95-f8ff1ba28aeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:07.022875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e8b884-4dfd-4e1b-9a95-f8ff1ba28aeb tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:07.047106 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:07.105041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e52630-96c1-4d0a-8d9a-047e4dde2d73 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:07.105764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e52630-96c1-4d0a-8d9a-047e4dde2d73 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:07.106049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e52630-96c1-4d0a-8d9a-047e4dde2d73 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:07.106332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e52630-96c1-4d0a-8d9a-047e4dde2d73 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/projects/5b40582191d1459294009ed3551df9de/users/4f9d3a5fee0b484d9adf2b064c18c250/roles/590e4c26dabd482995a47859894a1b5e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:07.110616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e52630-96c1-4d0a-8d9a-047e4dde2d73 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:create_grant(project_id=5b40582191d1459294009ed3551df9de, user_id=4f9d3a5fee0b484d9adf2b064c18c250, role_id=590e4c26dabd482995a47859894a1b5e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:07.113275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e52630-96c1-4d0a-8d9a-047e4dde2d73 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:07.167502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382b52-fb65-44b9-8df8-8e640a587da3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:07.168182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382b52-fb65-44b9-8df8-8e640a587da3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:07.168630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42382b52-fb65-44b9-8df8-8e640a587da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:07.172168 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2549/5125] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:07 2022] PUT /identity/v3/projects/5b40582191d1459294009ed3551df9de/users/4f9d3a5fee0b484d9adf2b064c18c250/roles/590e4c26dabd482995a47859894a1b5e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:07.258018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-42382b52-fb65-44b9-8df8-8e640a587da3 None None] MFA Rules not processed for user `4f9d3a5fee0b484d9adf2b064c18c250`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:07.260588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42382b52-fb65-44b9-8df8-8e640a587da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:07.266917 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2577/5126] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:07 2022] POST /identity/v3/auth/tokens => generated 334 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:17:07.271541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1cf8-1a76-4c62-9ef9-6b6f3ea82d02 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:07.271905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1cf8-1a76-4c62-9ef9-6b6f3ea82d02 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:07.272256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88c1cf8-1a76-4c62-9ef9-6b6f3ea82d02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:07.292326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e88c1cf8-1a76-4c62-9ef9-6b6f3ea82d02 None None] MFA Rules not processed for user `4f9d3a5fee0b484d9adf2b064c18c250`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:07.297245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e88c1cf8-1a76-4c62-9ef9-6b6f3ea82d02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:07.456283 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2550/5127] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:07 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 24 09:17:07.460618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42382b52-fb65-44b9-8df8-8e640a587da3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:07.505179 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:07.648534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42382b52-fb65-44b9-8df8-8e640a587da3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:07.660829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52955351-3655-4151-9560-4bbad92182cf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:07.663791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52955351-3655-4151-9560-4bbad92182cf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:07.664257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52955351-3655-4151-9560-4bbad92182cf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:07.664716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52955351-3655-4151-9560-4bbad92182cf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:07.685211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52955351-3655-4151-9560-4bbad92182cf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:revoke_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:07.688000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52955351-3655-4151-9560-4bbad92182cf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:07.713008 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2578/5128] 10.222.0.25 () {56 vars in 1308 bytes} [Mon Oct 24 09:17:07 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:07.715903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519a759-be5f-40f2-8320-ccf8d282a81b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:07.715903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519a759-be5f-40f2-8320-ccf8d282a81b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:07.716590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519a759-be5f-40f2-8320-ccf8d282a81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:07.746112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6519a759-be5f-40f2-8320-ccf8d282a81b None None] MFA Rules not processed for user `4f9d3a5fee0b484d9adf2b064c18c250`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:07.748587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6519a759-be5f-40f2-8320-ccf8d282a81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:07.830411 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2551/5129] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:07 2022] POST /identity/v3/auth/tokens => generated 3225 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 24 09:17:07.831696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52955351-3655-4151-9560-4bbad92182cf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:07.842157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52955351-3655-4151-9560-4bbad92182cf tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:07.857041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:07.857459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:07.857812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:07.858036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/roles/590e4c26dabd482995a47859894a1b5e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:07.861411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_role(role_id=590e4c26dabd482995a47859894a1b5e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:07.863016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:07.930588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invalidating the token cache because role 590e4c26dabd482995a47859894a1b5e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:07.931051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:07.931931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:07.935590 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2579/5130] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:07 2022] DELETE /identity/v3/roles/590e4c26dabd482995a47859894a1b5e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:07.940186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519a759-be5f-40f2-8320-ccf8d282a81b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:07.953923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519a759-be5f-40f2-8320-ccf8d282a81b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:08.114386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:08.115506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:08.116039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:08.117572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/projects/5b40582191d1459294009ed3551df9de` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:08.121211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b40582191d1459294009ed3551df9de)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:08.127540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:08.149359 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:08.242157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b40582191d1459294009ed3551df9de', 'request_id': 'req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.249717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b40582191d1459294009ed3551df9de', 'request_id': 'req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.259684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b40582191d1459294009ed3551df9de', 'request_id': 'req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.274996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] The token cache is being invalidate because project 5b40582191d1459294009ed3551df9de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:08.275543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.276270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.278685 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2552/5131] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:07 2022] DELETE /identity/v3/projects/5b40582191d1459294009ed3551df9de => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:08.283025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:08.284482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:08.302597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b5278e-c3be-42a1-9cf3-daabed030c52 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:08.425684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:08.427281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:08.428242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:08.431095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/projects/5b40582191d1459294009ed3551df9de` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:08.440575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b40582191d1459294009ed3551df9de)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:08.444705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Could not find project: 5b40582191d1459294009ed3551df9de.: keystone.exception.ProjectNotFound: Could not find project: 5b40582191d1459294009ed3551df9de. Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 24 09:17:08.462705 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 5b40582191d1459294009ed3551df9de. Oct 24 09:17:08.463608 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:08.468301 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2580/5132] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:08 2022] DELETE /identity/v3/projects/5b40582191d1459294009ed3551df9de => generated 113 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:17:08.469736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:08.471687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:08.516515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccee970-0a0a-4c92-9c21-24a6ce4e899b tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:08.536309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:08.538007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:08.538439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:08.538855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/projects/9e44d823833148f29e21810df5e40009` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:08.540876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9e44d823833148f29e21810df5e40009)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:08.543402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:08.571462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:08.573814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:08.647816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e44d823833148f29e21810df5e40009', 'request_id': 'req-a8dd3586-1430-47dc-b5a1-715e38ef5148'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.657967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e44d823833148f29e21810df5e40009', 'request_id': 'req-a8dd3586-1430-47dc-b5a1-715e38ef5148'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.673241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e44d823833148f29e21810df5e40009', 'request_id': 'req-a8dd3586-1430-47dc-b5a1-715e38ef5148'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.695578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] The token cache is being invalidate because project 9e44d823833148f29e21810df5e40009 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:08.695877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.700090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:08.710115 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2553/5133] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:08 2022] DELETE /identity/v3/projects/9e44d823833148f29e21810df5e40009 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:08.711050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:08.713377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4bcec-8655-4403-8c85-1581aa2b1782 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:08.714477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:08.732007 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:08.843464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bacbc-6a01-4696-8263-d0b90bebd81b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:08.844103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bacbc-6a01-4696-8263-d0b90bebd81b service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:08.846105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bacbc-6a01-4696-8263-d0b90bebd81b service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:08.846395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255bacbc-6a01-4696-8263-d0b90bebd81b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:08.851826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-255bacbc-6a01-4696-8263-d0b90bebd81b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:08.898279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dd3586-1430-47dc-b5a1-715e38ef5148 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:08.910307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:08.910968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:08.911238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:08.911516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/users/4f9d3a5fee0b484d9adf2b064c18c250` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:08.915636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4f9d3a5fee0b484d9adf2b064c18c250)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:08.917602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:08.955025 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:09.050413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9d3a5fee0b484d9adf2b064c18c250'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:09.094225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bacbc-6a01-4696-8263-d0b90bebd81b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:09.095974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255bacbc-6a01-4696-8263-d0b90bebd81b service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:09.097960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9d3a5fee0b484d9adf2b064c18c250'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:09.098906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9d3a5fee0b484d9adf2b064c18c250'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:09.110431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9d3a5fee0b484d9adf2b064c18c250'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:09.114310 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2581/5134] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:08 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 542 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:09.120692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9d3a5fee0b484d9adf2b064c18c250'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:09.141822 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2554/5135] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:08 2022] DELETE /identity/v3/users/4f9d3a5fee0b484d9adf2b064c18c250 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:09.147421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bacbc-6a01-4696-8263-d0b90bebd81b service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:09.166428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255bacbc-6a01-4696-8263-d0b90bebd81b service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:09.354538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813da63-01c9-4df3-8de2-0a29dc711b0e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:09.356275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813da63-01c9-4df3-8de2-0a29dc711b0e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:09.356810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813da63-01c9-4df3-8de2-0a29dc711b0e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:09.358725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813da63-01c9-4df3-8de2-0a29dc711b0e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/03ce353565604da680636273721e46d8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:09.380032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4813da63-01c9-4df3-8de2-0a29dc711b0e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4813da63-01c9-4df3-8de2-0a29dc711b0e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Could not find domain: 03ce353565604da680636273721e46d8.: keystone.exception.DomainNotFound: Could not find domain: 03ce353565604da680636273721e46d8. Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 03ce353565604da680636273721e46d8. Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:17:09.392583 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:17:09.394694 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 03ce353565604da680636273721e46d8. Oct 24 09:17:09.395649 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:09.402968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:09.403501 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2582/5136] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:17:09 2022] PATCH /identity/v3/domains/03ce353565604da680636273721e46d8 => generated 112 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:17:09.404889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:09.454054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c58b1f2-b0bc-4002-a64c-ed9d1768cdfc tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:09.473490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbf2f2a-8aec-4d2a-a28d-d4eaa1c40cc8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:09.478504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf2f2a-8aec-4d2a-a28d-d4eaa1c40cc8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:09.478802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf2f2a-8aec-4d2a-a28d-d4eaa1c40cc8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:09.479089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbf2f2a-8aec-4d2a-a28d-d4eaa1c40cc8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/286b512e0722449596e2a9377f814d86` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:09.515229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbf2f2a-8aec-4d2a-a28d-d4eaa1c40cc8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0bbf2f2a-8aec-4d2a-a28d-d4eaa1c40cc8 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Could not find domain: 286b512e0722449596e2a9377f814d86.: keystone.exception.DomainNotFound: Could not find domain: 286b512e0722449596e2a9377f814d86. Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 286b512e0722449596e2a9377f814d86. Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:17:09.528091 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:17:09.529246 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 286b512e0722449596e2a9377f814d86. Oct 24 09:17:09.530282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:17:09.531454 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2555/5137] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:17:09 2022] PATCH /identity/v3/domains/286b512e0722449596e2a9377f814d86 => generated 112 bytes in 129 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:17:09.534499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813da63-01c9-4df3-8de2-0a29dc711b0e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:09.561799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1e5ee-0ae5-426a-8418-2ab5fa4b0de4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:09.562088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1e5ee-0ae5-426a-8418-2ab5fa4b0de4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:09.562368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad1e5ee-0ae5-426a-8418-2ab5fa4b0de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:09.571910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813da63-01c9-4df3-8de2-0a29dc711b0e tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:09.589567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703affb-d056-4362-8140-c67aa24a7631 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:09.591107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703affb-d056-4362-8140-c67aa24a7631 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:09.591107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703affb-d056-4362-8140-c67aa24a7631 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:09.591376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703affb-d056-4362-8140-c67aa24a7631 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/967fd261196a454aaae03825502fe382` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:09.631825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e703affb-d056-4362-8140-c67aa24a7631 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-e703affb-d056-4362-8140-c67aa24a7631 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Could not find domain: 967fd261196a454aaae03825502fe382.: keystone.exception.DomainNotFound: Could not find domain: 967fd261196a454aaae03825502fe382. Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 967fd261196a454aaae03825502fe382. Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:17:09.642950 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:17:09.643849 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 967fd261196a454aaae03825502fe382. Oct 24 09:17:09.644612 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:09.648328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0ad1e5ee-0ae5-426a-8418-2ab5fa4b0de4 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:09.650976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ad1e5ee-0ae5-426a-8418-2ab5fa4b0de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:09.659171 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2583/5138] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:17:09 2022] PATCH /identity/v3/domains/967fd261196a454aaae03825502fe382 => generated 112 bytes in 126 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:17:09.663421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703affb-d056-4362-8140-c67aa24a7631 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:09.714641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e703affb-d056-4362-8140-c67aa24a7631 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:09.732363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f5097-edef-4d0e-8b96-d31b64713a63 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7ef5b1816b5a42ff8cc0fe07159c5751', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e40fd5a6c21243a38d4e42a354641870', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:09.734953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f5097-edef-4d0e-8b96-d31b64713a63 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:09.736248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f5097-edef-4d0e-8b96-d31b64713a63 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:09.736529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942f5097-edef-4d0e-8b96-d31b64713a63 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] PATH_INFO: `/v3/domains/13c4ccc485674c229da9ed9dbf185817` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:09.759633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942f5097-edef-4d0e-8b96-d31b64713a63 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-942f5097-edef-4d0e-8b96-d31b64713a63 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Could not find domain: 13c4ccc485674c229da9ed9dbf185817.: keystone.exception.DomainNotFound: Could not find domain: 13c4ccc485674c229da9ed9dbf185817. Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 13c4ccc485674c229da9ed9dbf185817. Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:17:09.794001 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:17:09.794881 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 13c4ccc485674c229da9ed9dbf185817. Oct 24 09:17:09.796187 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:17:09.801780 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2584/5139] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:17:09 2022] PATCH /identity/v3/domains/13c4ccc485674c229da9ed9dbf185817 => generated 112 bytes in 139 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:17:09.802875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f5097-edef-4d0e-8b96-d31b64713a63 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:09.812898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-942f5097-edef-4d0e-8b96-d31b64713a63 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:09.938629 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2556/5140] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:17:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:10.017674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1e5ee-0ae5-426a-8418-2ab5fa4b0de4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:10.024425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ad1e5ee-0ae5-426a-8418-2ab5fa4b0de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:10.106486 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:10.179872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942f5097-edef-4d0e-8b96-d31b64713a63 tempest-TokensV3TestJSON-119797604 tempest-TokensV3TestJSON-119797604-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:10.200032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:10.203607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:10.209404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:10.213604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] PATH_INFO: `/v3/users/43f4eda3ee31474684a9351aacf85fb6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:10.218461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] RBAC: Authorizing `identity:delete_user(user_id=43f4eda3ee31474684a9351aacf85fb6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:10.226020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:10.288185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad1e5ee-0ae5-426a-8418-2ab5fa4b0de4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:10.304810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43f4eda3ee31474684a9351aacf85fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:10.305988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9c3c-0130-498f-80b7-64edf7f64b8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:10.306618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9c3c-0130-498f-80b7-64edf7f64b8e service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:10.306902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9c3c-0130-498f-80b7-64edf7f64b8e service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:10.307179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f9c3c-0130-498f-80b7-64edf7f64b8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:10.324379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43f4eda3ee31474684a9351aacf85fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:10.326239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43f4eda3ee31474684a9351aacf85fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:10.348258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43f4eda3ee31474684a9351aacf85fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:10.353821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f9c3c-0130-498f-80b7-64edf7f64b8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:10.360023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f9c3c-0130-498f-80b7-64edf7f64b8e service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:10.367204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c1136200-8018-4257-8920-cf7780a88080 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43f4eda3ee31474684a9351aacf85fb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:10.382799 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2585/5141] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:09 2022] DELETE /identity/v3/users/43f4eda3ee31474684a9351aacf85fb6 => generated 0 bytes in 580 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:10.385553 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2557/5142] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:10.390577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc202d86-71d4-4505-b8de-db832e16ab92 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:10.391313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc202d86-71d4-4505-b8de-db832e16ab92 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:10.392060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc202d86-71d4-4505-b8de-db832e16ab92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:10.450201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dc202d86-71d4-4505-b8de-db832e16ab92 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:10.454049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc202d86-71d4-4505-b8de-db832e16ab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:10.582600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9c3c-0130-498f-80b7-64edf7f64b8e service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:10.584623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-169f9c3c-0130-498f-80b7-64edf7f64b8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:10.593261 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:10.645945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2586/5143] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:10.774735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f9c3c-0130-498f-80b7-64edf7f64b8e service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:10.838002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc202d86-71d4-4505-b8de-db832e16ab92 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:10.839822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc202d86-71d4-4505-b8de-db832e16ab92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:10.966870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:10.970112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:10.970610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:10.971772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:10.979460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:10.987776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc202d86-71d4-4505-b8de-db832e16ab92 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:10.998903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef111823-1cc6-4f3b-a069-972c900d2a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:10.998903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef111823-1cc6-4f3b-a069-972c900d2a43 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:10.999155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef111823-1cc6-4f3b-a069-972c900d2a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:10.999413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef111823-1cc6-4f3b-a069-972c900d2a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:11.004979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:11.006884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:11.036235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef111823-1cc6-4f3b-a069-972c900d2a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:11.037758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef111823-1cc6-4f3b-a069-972c900d2a43 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:11.051458 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2558/5144] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:11.067474 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2587/5145] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:11.098657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:11.100724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:11.303377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13cbfa-3428-4a45-a9af-ff789ce88d63 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:11.312192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f112e4-2bfa-43ec-8e01-7aa6a20725ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:11.312877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f112e4-2bfa-43ec-8e01-7aa6a20725ea service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:11.313103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f112e4-2bfa-43ec-8e01-7aa6a20725ea service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:11.313413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f112e4-2bfa-43ec-8e01-7aa6a20725ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:11.315292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f3f112e4-2bfa-43ec-8e01-7aa6a20725ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:11.373952 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:11.448443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f112e4-2bfa-43ec-8e01-7aa6a20725ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:11.449967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f112e4-2bfa-43ec-8e01-7aa6a20725ea service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:11.471429 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2559/5146] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:11 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:12.897020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef111823-1cc6-4f3b-a069-972c900d2a43 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:12.899352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef111823-1cc6-4f3b-a069-972c900d2a43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:12.934213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef111823-1cc6-4f3b-a069-972c900d2a43 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:12.964053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:12.964947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:12.965240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:12.965811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] PATH_INFO: `/v3/projects/6f00ae9fa03a4a9e932747381ade81ac` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:12.971719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f00ae9fa03a4a9e932747381ade81ac)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:12.973807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:12.982485 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:13.135265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f00ae9fa03a4a9e932747381ade81ac', 'request_id': 'req-7785b130-f9a2-486e-b3c1-5056aad74e63'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.191809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f00ae9fa03a4a9e932747381ade81ac', 'request_id': 'req-7785b130-f9a2-486e-b3c1-5056aad74e63'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.210531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f00ae9fa03a4a9e932747381ade81ac', 'request_id': 'req-7785b130-f9a2-486e-b3c1-5056aad74e63'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.238083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] The token cache is being invalidate because project 6f00ae9fa03a4a9e932747381ade81ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:13.238732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.239618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.241609 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2588/5147] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:12 2022] DELETE /identity/v3/projects/6f00ae9fa03a4a9e932747381ade81ac => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:13.245550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f112e4-2bfa-43ec-8e01-7aa6a20725ea service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:13.260085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f112e4-2bfa-43ec-8e01-7aa6a20725ea service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:13.370150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:13.371021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:13.371422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:13.371815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] PATH_INFO: `/v3/users/7ef5b1816b5a42ff8cc0fe07159c5751` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:13.379265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef5b1816b5a42ff8cc0fe07159c5751)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:13.381766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:13.477924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef5b1816b5a42ff8cc0fe07159c5751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.497266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef5b1816b5a42ff8cc0fe07159c5751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.500805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef5b1816b5a42ff8cc0fe07159c5751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.554040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef5b1816b5a42ff8cc0fe07159c5751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.595849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef5b1816b5a42ff8cc0fe07159c5751'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:13.634240 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2560/5148] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:13 2022] DELETE /identity/v3/users/7ef5b1816b5a42ff8cc0fe07159c5751 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:15.083364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:15.102645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:15.133877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7785b130-f9a2-486e-b3c1-5056aad74e63 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:15.283479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:15.284250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:15.284538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:15.284883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] PATH_INFO: `/v3/projects/e40fd5a6c21243a38d4e42a354641870` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:15.295490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e40fd5a6c21243a38d4e42a354641870)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:15.316998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:15.439700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e40fd5a6c21243a38d4e42a354641870', 'request_id': 'req-92392d0b-b2cb-47c8-ac03-7a778c4251e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.462374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e40fd5a6c21243a38d4e42a354641870', 'request_id': 'req-92392d0b-b2cb-47c8-ac03-7a778c4251e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.469190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e40fd5a6c21243a38d4e42a354641870', 'request_id': 'req-92392d0b-b2cb-47c8-ac03-7a778c4251e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.494369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] The token cache is being invalidate because project e40fd5a6c21243a38d4e42a354641870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:15.494688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.495537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.501259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2589/5149] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:15 2022] DELETE /identity/v3/projects/e40fd5a6c21243a38d4e42a354641870 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:15.502450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:15.503861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:15.554640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c6b20-4246-45c2-ba58-d9df058f89a0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:15.682871 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:15.720992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:15.721754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:15.722041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:15.722315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] PATH_INFO: `/v3/users/2a02736634bd4137aeeb12fe76b4965f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:15.726354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a02736634bd4137aeeb12fe76b4965f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:15.728463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:15.839678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a02736634bd4137aeeb12fe76b4965f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.853988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a02736634bd4137aeeb12fe76b4965f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.854869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a02736634bd4137aeeb12fe76b4965f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.867069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a02736634bd4137aeeb12fe76b4965f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.881216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4d693d5d-5ee8-407b-ba8b-59288f0969f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a02736634bd4137aeeb12fe76b4965f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:15.890016 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2561/5150] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:15 2022] DELETE /identity/v3/users/2a02736634bd4137aeeb12fe76b4965f => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:17.011058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:17.013411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:17.035078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92392d0b-b2cb-47c8-ac03-7a778c4251e6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:17.099755 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:17.226057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:17.226778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:17.227083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:17.227499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] PATH_INFO: `/v3/projects/68da1941fd03481181ba62fc864e7da6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:17.231224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68da1941fd03481181ba62fc864e7da6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:17.237160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:17.429825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68da1941fd03481181ba62fc864e7da6', 'request_id': 'req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:17.458322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68da1941fd03481181ba62fc864e7da6', 'request_id': 'req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:17.472161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68da1941fd03481181ba62fc864e7da6', 'request_id': 'req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:17.535085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] The token cache is being invalidate because project 68da1941fd03481181ba62fc864e7da6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:17.535341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:17.538538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dfe5d0b2-a699-46ca-b8d3-26cc58fb3fe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:17.551532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50212-bf92-4f69-8d72-42901f9686da None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:17.551977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50212-bf92-4f69-8d72-42901f9686da None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:17.552106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e50212-bf92-4f69-8d72-42901f9686da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:17.555300 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2590/5151] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:17 2022] DELETE /identity/v3/projects/68da1941fd03481181ba62fc864e7da6 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:17.614327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b1e50212-bf92-4f69-8d72-42901f9686da None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:17.615555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b1e50212-bf92-4f69-8d72-42901f9686da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:17.861173 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2562/5152] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:17.871329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6882c4-2272-41fd-b17c-b9c30e204783 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:17.871452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6882c4-2272-41fd-b17c-b9c30e204783 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:17.871663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6882c4-2272-41fd-b17c-b9c30e204783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:17.926426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7b6882c4-2272-41fd-b17c-b9c30e204783 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:17.927686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b6882c4-2272-41fd-b17c-b9c30e204783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:17.953242 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2591/5153] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:17.957668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50212-bf92-4f69-8d72-42901f9686da None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:17.969142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e50212-bf92-4f69-8d72-42901f9686da None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:17.985957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab80d3-6bad-4df2-aafe-d6d954f1154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:17.986586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab80d3-6bad-4df2-aafe-d6d954f1154e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:17.989373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab80d3-6bad-4df2-aafe-d6d954f1154e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:17.989747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcab80d3-6bad-4df2-aafe-d6d954f1154e admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:17.990457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab80d3-6bad-4df2-aafe-d6d954f1154e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:17:17.991025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab80d3-6bad-4df2-aafe-d6d954f1154e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:17.997511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcab80d3-6bad-4df2-aafe-d6d954f1154e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:18.032737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6882c4-2272-41fd-b17c-b9c30e204783 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:18.045537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6882c4-2272-41fd-b17c-b9c30e204783 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:18.046233 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2563/5154] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:18.067153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e916-66e6-4a17-9682-a4ef27b319e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:18.068154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e916-66e6-4a17-9682-a4ef27b319e5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:18.068154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e916-66e6-4a17-9682-a4ef27b319e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:18.068365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d3e916-66e6-4a17-9682-a4ef27b319e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:18.068997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3e916-66e6-4a17-9682-a4ef27b319e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:18.078154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d3e916-66e6-4a17-9682-a4ef27b319e5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:18.163637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab80d3-6bad-4df2-aafe-d6d954f1154e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:18.172012 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2592/5155] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:18 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:18.184067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcab80d3-6bad-4df2-aafe-d6d954f1154e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:18.362280 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:18.429075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a1e88-ac4d-440f-88c9-3cb382756198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:18.433977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a1e88-ac4d-440f-88c9-3cb382756198 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:18.434289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a1e88-ac4d-440f-88c9-3cb382756198 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:18.434549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90a1e88-ac4d-440f-88c9-3cb382756198 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:18.435217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a1e88-ac4d-440f-88c9-3cb382756198 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:18.445944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90a1e88-ac4d-440f-88c9-3cb382756198 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:18.554880 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2564/5156] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:18 2022] POST /identity/v3/users => generated 291 bytes in 391 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:18.559072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e916-66e6-4a17-9682-a4ef27b319e5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:18.574199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d3e916-66e6-4a17-9682-a4ef27b319e5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:18.584661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a773-2776-4055-954b-5458bcc33d2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:18.585316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a773-2776-4055-954b-5458bcc33d2d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:18.585644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a773-2776-4055-954b-5458bcc33d2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:18.585921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7294a773-2776-4055-954b-5458bcc33d2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:18.587203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a773-2776-4055-954b-5458bcc33d2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:18.593522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7294a773-2776-4055-954b-5458bcc33d2d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:18.619910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a1e88-ac4d-440f-88c9-3cb382756198 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:18.621253 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2593/5157] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:18.650786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90a1e88-ac4d-440f-88c9-3cb382756198 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:18.677821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dd4f0-b5e6-4856-a8e9-589988ad8519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:18.678461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dd4f0-b5e6-4856-a8e9-589988ad8519 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:18.678749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dd4f0-b5e6-4856-a8e9-589988ad8519 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:18.679035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dd4f0-b5e6-4856-a8e9-589988ad8519 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:18.679693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dd4f0-b5e6-4856-a8e9-589988ad8519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:18.681450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dd4f0-b5e6-4856-a8e9-589988ad8519 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:18.737324 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2565/5158] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:17:18.738723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a773-2776-4055-954b-5458bcc33d2d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:18.753581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7294a773-2776-4055-954b-5458bcc33d2d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:18.768508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99840e99-cca1-4543-a659-9c7b1b756fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:18.769675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99840e99-cca1-4543-a659-9c7b1b756fcb admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:18.770098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99840e99-cca1-4543-a659-9c7b1b756fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:18.770515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99840e99-cca1-4543-a659-9c7b1b756fcb admin admin] PATH_INFO: `/v3/projects/7336ee0e7c9a45249a2a45a3c0900cd4/users/c78a147a7aab4e14b8e6f53800ba8a2d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:18.803963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99840e99-cca1-4543-a659-9c7b1b756fcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7336ee0e7c9a45249a2a45a3c0900cd4, user_id=c78a147a7aab4e14b8e6f53800ba8a2d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:18.811218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99840e99-cca1-4543-a659-9c7b1b756fcb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:18.849737 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2594/5159] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:18 2022] PUT /identity/v3/projects/7336ee0e7c9a45249a2a45a3c0900cd4/users/c78a147a7aab4e14b8e6f53800ba8a2d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:18.856484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a37a6-5608-4376-8ae1-e259be242fcc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:18.856769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a37a6-5608-4376-8ae1-e259be242fcc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:18.856964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a37a6-5608-4376-8ae1-e259be242fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:18.956213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5e8a37a6-5608-4376-8ae1-e259be242fcc None None] MFA Rules not processed for user `c78a147a7aab4e14b8e6f53800ba8a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:18.967065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5e8a37a6-5608-4376-8ae1-e259be242fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:19.329056 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2566/5160] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:18 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:19.332262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99840e99-cca1-4543-a659-9c7b1b756fcb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:19.499054 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:19.540404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99840e99-cca1-4543-a659-9c7b1b756fcb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:19.579893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a65bb-cb43-47ad-82bb-1a052d591ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:19.582034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a65bb-cb43-47ad-82bb-1a052d591ac3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:19.582444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a65bb-cb43-47ad-82bb-1a052d591ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:19.583998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a65bb-cb43-47ad-82bb-1a052d591ac3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:19.584792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a65bb-cb43-47ad-82bb-1a052d591ac3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:19.589924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a65bb-cb43-47ad-82bb-1a052d591ac3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:19.690103 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2595/5161] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:19 2022] POST /identity/v3/projects => generated 379 bytes in 358 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:19.693950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a37a6-5608-4376-8ae1-e259be242fcc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:19.717683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a37a6-5608-4376-8ae1-e259be242fcc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:19.970387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eca90-c39e-40f1-8fbd-464a94de9bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:19.971391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eca90-c39e-40f1-8fbd-464a94de9bc5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:19.971706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eca90-c39e-40f1-8fbd-464a94de9bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:19.971991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278eca90-c39e-40f1-8fbd-464a94de9bc5 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:19.972856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eca90-c39e-40f1-8fbd-464a94de9bc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:19.975018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278eca90-c39e-40f1-8fbd-464a94de9bc5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:20.027138 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2567/5162] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:19 2022] POST /identity/v3/users => generated 290 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:20.030603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a65bb-cb43-47ad-82bb-1a052d591ac3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:20.050830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a65bb-cb43-47ad-82bb-1a052d591ac3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:20.081730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c55cd4-b083-4103-a6fc-599123e4e7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:20.087432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c55cd4-b083-4103-a6fc-599123e4e7aa admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:20.088617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c55cd4-b083-4103-a6fc-599123e4e7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:20.092316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c55cd4-b083-4103-a6fc-599123e4e7aa admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:20.093199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c55cd4-b083-4103-a6fc-599123e4e7aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:20.096391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c55cd4-b083-4103-a6fc-599123e4e7aa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:20.150581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eca90-c39e-40f1-8fbd-464a94de9bc5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:20.151170 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2596/5163] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:20.169064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278eca90-c39e-40f1-8fbd-464a94de9bc5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:20.187319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b725f49a-4486-4031-b5e5-b97df0804dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:20.187947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725f49a-4486-4031-b5e5-b97df0804dba admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:20.188228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725f49a-4486-4031-b5e5-b97df0804dba admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:20.188501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b725f49a-4486-4031-b5e5-b97df0804dba admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:20.194527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725f49a-4486-4031-b5e5-b97df0804dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:20.202352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b725f49a-4486-4031-b5e5-b97df0804dba admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:20.236701 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2568/5164] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:20 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:17:20.240712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c55cd4-b083-4103-a6fc-599123e4e7aa admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:20.256687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c55cd4-b083-4103-a6fc-599123e4e7aa admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:20.277041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d40f5-8003-4dcc-b536-37a8904717d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:20.280045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d40f5-8003-4dcc-b536-37a8904717d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:20.280346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d40f5-8003-4dcc-b536-37a8904717d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:20.280628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7d40f5-8003-4dcc-b536-37a8904717d3 admin admin] PATH_INFO: `/v3/projects/81061f3816c34a53b91d5d55d6b43e48/users/023e36f8fb3c45fab1c1cfe25c541bb6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:20.326069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d40f5-8003-4dcc-b536-37a8904717d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81061f3816c34a53b91d5d55d6b43e48, user_id=023e36f8fb3c45fab1c1cfe25c541bb6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:20.329219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7d40f5-8003-4dcc-b536-37a8904717d3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:20.386314 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2597/5165] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:20 2022] PUT /identity/v3/projects/81061f3816c34a53b91d5d55d6b43e48/users/023e36f8fb3c45fab1c1cfe25c541bb6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:20.397869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636e05-2653-40e6-a205-506745f91c47 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:20.397869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636e05-2653-40e6-a205-506745f91c47 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:20.398170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89636e05-2653-40e6-a205-506745f91c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:20.534404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-89636e05-2653-40e6-a205-506745f91c47 None None] MFA Rules not processed for user `023e36f8fb3c45fab1c1cfe25c541bb6`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:20.535927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-89636e05-2653-40e6-a205-506745f91c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:20.654396 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:20.792967 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2569/5166] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:20.799225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d40f5-8003-4dcc-b536-37a8904717d3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:21.080195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7d40f5-8003-4dcc-b536-37a8904717d3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:21.107416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6835e8ad-cf4c-40af-b076-6703d8c55815 tempest-IdentityV3ProjectsTest-1149106308 tempest-IdentityV3ProjectsTest-1149106308-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c78a147a7aab4e14b8e6f53800ba8a2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7336ee0e7c9a45249a2a45a3c0900cd4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:21.108347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835e8ad-cf4c-40af-b076-6703d8c55815 tempest-IdentityV3ProjectsTest-1149106308 tempest-IdentityV3ProjectsTest-1149106308-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:21.108854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835e8ad-cf4c-40af-b076-6703d8c55815 tempest-IdentityV3ProjectsTest-1149106308 tempest-IdentityV3ProjectsTest-1149106308-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:21.109792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6835e8ad-cf4c-40af-b076-6703d8c55815 tempest-IdentityV3ProjectsTest-1149106308 tempest-IdentityV3ProjectsTest-1149106308-project] PATH_INFO: `/v3/users/c78a147a7aab4e14b8e6f53800ba8a2d/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:21.113857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835e8ad-cf4c-40af-b076-6703d8c55815 tempest-IdentityV3ProjectsTest-1149106308 tempest-IdentityV3ProjectsTest-1149106308-project] RBAC: Authorizing `identity:list_user_projects(user_id=c78a147a7aab4e14b8e6f53800ba8a2d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:21.115885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6835e8ad-cf4c-40af-b076-6703d8c55815 tempest-IdentityV3ProjectsTest-1149106308 tempest-IdentityV3ProjectsTest-1149106308-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:21.246584 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2598/5167] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:17:20 2022] GET /identity/v3/users/c78a147a7aab4e14b8e6f53800ba8a2d/projects => generated 517 bytes in 448 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:21.252490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4ca62-5bfa-482d-9b54-c4fef6f362d3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:21.252819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4ca62-5bfa-482d-9b54-c4fef6f362d3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:21.253060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4ca62-5bfa-482d-9b54-c4fef6f362d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:21.348884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e3b4ca62-5bfa-482d-9b54-c4fef6f362d3 None None] MFA Rules not processed for user `c78a147a7aab4e14b8e6f53800ba8a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:21.350145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e3b4ca62-5bfa-482d-9b54-c4fef6f362d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:21.390365 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2570/5168] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:21.395044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d7c5-c0bc-4bbd-906a-262a114e919e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:21.395481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d7c5-c0bc-4bbd-906a-262a114e919e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:21.395801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7d7c5-c0bc-4bbd-906a-262a114e919e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:21.467866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-19d7d7c5-c0bc-4bbd-906a-262a114e919e None None] MFA Rules not processed for user `c78a147a7aab4e14b8e6f53800ba8a2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:21.477488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19d7d7c5-c0bc-4bbd-906a-262a114e919e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:21.657809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.models.token_model [None req-19d7d7c5-c0bc-4bbd-906a-262a114e919e None None] User c78a147a7aab4e14b8e6f53800ba8a2d has no access to project 81061f3816c34a53b91d5d55d6b43e48 {{(pid=88312) _validate_project_scope /opt/stack/keystone/keystone/models/token_model.py:539}} Oct 24 09:17:21.663668 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.server.flask.application [None req-19d7d7c5-c0bc-4bbd-906a-262a114e919e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.25: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 24 09:17:21.687087 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2599/5169] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:21 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 293 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 24 09:17:21.692954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4ca62-5bfa-482d-9b54-c4fef6f362d3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:21.852160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4ca62-5bfa-482d-9b54-c4fef6f362d3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:21.858274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:21.859173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:21.859628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:21.859908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] PATH_INFO: `/v3/users/c78a147a7aab4e14b8e6f53800ba8a2d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:21.861210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c78a147a7aab4e14b8e6f53800ba8a2d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:21.864280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:21.986544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c78a147a7aab4e14b8e6f53800ba8a2d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:22.014098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c78a147a7aab4e14b8e6f53800ba8a2d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:22.016962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c78a147a7aab4e14b8e6f53800ba8a2d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:22.034243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c78a147a7aab4e14b8e6f53800ba8a2d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:22.066012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c78a147a7aab4e14b8e6f53800ba8a2d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:22.099623 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2571/5170] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:21 2022] DELETE /identity/v3/users/c78a147a7aab4e14b8e6f53800ba8a2d => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:22.105723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc3cb-9182-42d2-aea7-9e48df68b7fa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:22.106920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc3cb-9182-42d2-aea7-9e48df68b7fa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:22.108005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47bc3cb-9182-42d2-aea7-9e48df68b7fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:22.150296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f47bc3cb-9182-42d2-aea7-9e48df68b7fa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:22.159618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f47bc3cb-9182-42d2-aea7-9e48df68b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:22.200848 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:22.348904 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2600/5171] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:22.385627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:22.392106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:22.525720 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:22.592912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db1a714-53c0-45ec-8418-e80c80185bfd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:22.607742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b455eb-3d49-4ec1-9a45-33e5a0df3c04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:22.609379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b455eb-3d49-4ec1-9a45-33e5a0df3c04 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:22.609489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b455eb-3d49-4ec1-9a45-33e5a0df3c04 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:22.609984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b455eb-3d49-4ec1-9a45-33e5a0df3c04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:22.640023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b455eb-3d49-4ec1-9a45-33e5a0df3c04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:22.641792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b455eb-3d49-4ec1-9a45-33e5a0df3c04 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:22.697068 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2572/5172] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:24.609321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc3cb-9182-42d2-aea7-9e48df68b7fa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:24.610905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f47bc3cb-9182-42d2-aea7-9e48df68b7fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:24.640203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47bc3cb-9182-42d2-aea7-9e48df68b7fa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:24.664529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:24.669091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:24.669629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:24.670283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] PATH_INFO: `/v3/projects/7336ee0e7c9a45249a2a45a3c0900cd4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:24.672208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7336ee0e7c9a45249a2a45a3c0900cd4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:24.674731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:24.803479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7336ee0e7c9a45249a2a45a3c0900cd4', 'request_id': 'req-d653955d-44fc-49d5-8c40-6fca9d283958'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:24.855600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7336ee0e7c9a45249a2a45a3c0900cd4', 'request_id': 'req-d653955d-44fc-49d5-8c40-6fca9d283958'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:24.925022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7336ee0e7c9a45249a2a45a3c0900cd4', 'request_id': 'req-d653955d-44fc-49d5-8c40-6fca9d283958'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:24.978787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] The token cache is being invalidate because project 7336ee0e7c9a45249a2a45a3c0900cd4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:24.979098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:24.982107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d653955d-44fc-49d5-8c40-6fca9d283958 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:24.990670 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2601/5173] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:24 2022] DELETE /identity/v3/projects/7336ee0e7c9a45249a2a45a3c0900cd4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:24.995053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b455eb-3d49-4ec1-9a45-33e5a0df3c04 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:25.014234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b455eb-3d49-4ec1-9a45-33e5a0df3c04 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:25.239679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:25.240839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:25.242695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:25.243210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] PATH_INFO: `/v3/users/023e36f8fb3c45fab1c1cfe25c541bb6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:25.245894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=023e36f8fb3c45fab1c1cfe25c541bb6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:25.248085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:25.407425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '023e36f8fb3c45fab1c1cfe25c541bb6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:25.448242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '023e36f8fb3c45fab1c1cfe25c541bb6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:25.448945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '023e36f8fb3c45fab1c1cfe25c541bb6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:25.477790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '023e36f8fb3c45fab1c1cfe25c541bb6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:25.510207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7043c19d-915a-4a5b-8aa8-d5b96c0502fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '023e36f8fb3c45fab1c1cfe25c541bb6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:25.523392 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2573/5174] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:24 2022] DELETE /identity/v3/users/023e36f8fb3c45fab1c1cfe25c541bb6 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:26.632531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190ced6-75cf-4729-8aec-9203660f7895 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:26.633071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190ced6-75cf-4729-8aec-9203660f7895 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:26.633071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190ced6-75cf-4729-8aec-9203660f7895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:26.716283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c190ced6-75cf-4729-8aec-9203660f7895 None None] MFA Rules not processed for user `e1fd438c83414de8b742cfc444739fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:26.719286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c190ced6-75cf-4729-8aec-9203660f7895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:26.969878 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2602/5175] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:26.983288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348178f-81b2-4c52-8e4f-060e4010527e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:26.983875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348178f-81b2-4c52-8e4f-060e4010527e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:26.983875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c348178f-81b2-4c52-8e4f-060e4010527e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:27.048351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c348178f-81b2-4c52-8e4f-060e4010527e None None] MFA Rules not processed for user `e1fd438c83414de8b742cfc444739fd8`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:27.048351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c348178f-81b2-4c52-8e4f-060e4010527e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:27.067401 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2574/5176] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:27.526044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190ced6-75cf-4729-8aec-9203660f7895 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:27.528045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c190ced6-75cf-4729-8aec-9203660f7895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:27.663822 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:27.708189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190ced6-75cf-4729-8aec-9203660f7895 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:27.713247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:27.713977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:27.714267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:27.714548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] PATH_INFO: `/v3/projects/81061f3816c34a53b91d5d55d6b43e48` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:27.715853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81061f3816c34a53b91d5d55d6b43e48)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:27.718542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:27.812361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81061f3816c34a53b91d5d55d6b43e48', 'request_id': 'req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:27.863108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81061f3816c34a53b91d5d55d6b43e48', 'request_id': 'req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:27.887353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81061f3816c34a53b91d5d55d6b43e48', 'request_id': 'req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:27.965136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] The token cache is being invalidate because project 81061f3816c34a53b91d5d55d6b43e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:27.967291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:27.969861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6988eaf1-57d4-4c5d-bcd8-6d91e57e0365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:27.977823 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2603/5177] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:27 2022] DELETE /identity/v3/projects/81061f3816c34a53b91d5d55d6b43e48 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:27.982784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db71c3-d3c2-4d73-8911-9d26cb6928a0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:27.983077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db71c3-d3c2-4d73-8911-9d26cb6928a0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:27.983359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52db71c3-d3c2-4d73-8911-9d26cb6928a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:28.047105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-52db71c3-d3c2-4d73-8911-9d26cb6928a0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:28.055196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52db71c3-d3c2-4d73-8911-9d26cb6928a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:28.250498 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:28.307158 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2575/5178] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:28.309057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef39d-9296-45eb-9a09-00f44cafa57f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:28.309386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef39d-9296-45eb-9a09-00f44cafa57f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:28.309668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23ef39d-9296-45eb-9a09-00f44cafa57f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:28.371781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a23ef39d-9296-45eb-9a09-00f44cafa57f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:28.379314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a23ef39d-9296-45eb-9a09-00f44cafa57f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:28.413874 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2604/5179] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:28.415708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db71c3-d3c2-4d73-8911-9d26cb6928a0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:28.442332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52db71c3-d3c2-4d73-8911-9d26cb6928a0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:28.465405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed4d6-68dd-4355-aa87-9d359b4b7cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:28.466050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed4d6-68dd-4355-aa87-9d359b4b7cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:28.466334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed4d6-68dd-4355-aa87-9d359b4b7cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:28.466696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2ed4d6-68dd-4355-aa87-9d359b4b7cd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:28.467359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ed4d6-68dd-4355-aa87-9d359b4b7cd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:17:28.467661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ed4d6-68dd-4355-aa87-9d359b4b7cd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:28.469312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2ed4d6-68dd-4355-aa87-9d359b4b7cd9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:28.493662 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2576/5180] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:17:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:28.496184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ef39d-9296-45eb-9a09-00f44cafa57f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:28.521278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23ef39d-9296-45eb-9a09-00f44cafa57f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:28.538856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c0e24-61e2-487b-ad25-a45036b1e653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:28.539949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0e24-61e2-487b-ad25-a45036b1e653 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:28.540535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0e24-61e2-487b-ad25-a45036b1e653 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:28.542289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972c0e24-61e2-487b-ad25-a45036b1e653 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:28.545105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c0e24-61e2-487b-ad25-a45036b1e653 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:28.547305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972c0e24-61e2-487b-ad25-a45036b1e653 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:28.684327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2605/5181] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:28 2022] POST /identity/v3/projects => generated 371 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:28.684987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed4d6-68dd-4355-aa87-9d359b4b7cd9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:28.726043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2ed4d6-68dd-4355-aa87-9d359b4b7cd9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:28.862993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04469dc-81b5-4753-898d-7e02af253d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:28.863353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04469dc-81b5-4753-898d-7e02af253d0d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:28.863656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04469dc-81b5-4753-898d-7e02af253d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:28.863953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04469dc-81b5-4753-898d-7e02af253d0d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:28.864575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04469dc-81b5-4753-898d-7e02af253d0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:28.866551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04469dc-81b5-4753-898d-7e02af253d0d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:28.929278 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2577/5182] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:28 2022] POST /identity/v3/users => generated 286 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:17:28.930588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c0e24-61e2-487b-ad25-a45036b1e653 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:28.949018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972c0e24-61e2-487b-ad25-a45036b1e653 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:28.971444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e82aa0-c195-4f23-9d3e-a14bec4d1e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:28.972516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82aa0-c195-4f23-9d3e-a14bec4d1e00 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:28.974321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82aa0-c195-4f23-9d3e-a14bec4d1e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:28.974783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e82aa0-c195-4f23-9d3e-a14bec4d1e00 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:28.976580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e82aa0-c195-4f23-9d3e-a14bec4d1e00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:28.979884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e82aa0-c195-4f23-9d3e-a14bec4d1e00 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:29.027119 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2606/5183] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:28 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:29.028414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04469dc-81b5-4753-898d-7e02af253d0d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:29.058107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04469dc-81b5-4753-898d-7e02af253d0d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:29.085561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d811e8ba-76b8-4ec0-bb2d-1721a56b1299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:29.092562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811e8ba-76b8-4ec0-bb2d-1721a56b1299 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:29.093000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811e8ba-76b8-4ec0-bb2d-1721a56b1299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:29.093145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d811e8ba-76b8-4ec0-bb2d-1721a56b1299 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:29.094040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811e8ba-76b8-4ec0-bb2d-1721a56b1299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:29.103883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d811e8ba-76b8-4ec0-bb2d-1721a56b1299 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:29.152594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e82aa0-c195-4f23-9d3e-a14bec4d1e00 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:29.153242 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2578/5184] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:29 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:17:29.168053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e82aa0-c195-4f23-9d3e-a14bec4d1e00 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:29.199863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d8e46-6ee1-4bbe-adc8-7ca81eee2f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:29.201008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d8e46-6ee1-4bbe-adc8-7ca81eee2f86 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:29.202004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d8e46-6ee1-4bbe-adc8-7ca81eee2f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:29.202461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97d8e46-6ee1-4bbe-adc8-7ca81eee2f86 admin admin] PATH_INFO: `/v3/projects/2ff5a30f2f5b43c2be93dec19ee36b8d/users/1d344687c9c9494788b75b95d63f8bd4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:29.254473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d8e46-6ee1-4bbe-adc8-7ca81eee2f86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ff5a30f2f5b43c2be93dec19ee36b8d, user_id=1d344687c9c9494788b75b95d63f8bd4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:29.259965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97d8e46-6ee1-4bbe-adc8-7ca81eee2f86 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:29.306168 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2607/5185] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:29 2022] PUT /identity/v3/projects/2ff5a30f2f5b43c2be93dec19ee36b8d/users/1d344687c9c9494788b75b95d63f8bd4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:29.317326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa9176-715a-4a41-a39d-9dfa72a402da None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:29.317861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa9176-715a-4a41-a39d-9dfa72a402da None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:29.318162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aa9176-715a-4a41-a39d-9dfa72a402da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:29.418701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f1aa9176-715a-4a41-a39d-9dfa72a402da None None] MFA Rules not processed for user `1d344687c9c9494788b75b95d63f8bd4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:29.420640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f1aa9176-715a-4a41-a39d-9dfa72a402da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:29.448854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d8e46-6ee1-4bbe-adc8-7ca81eee2f86 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:29.467336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e97d8e46-6ee1-4bbe-adc8-7ca81eee2f86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:29.670221 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2579/5186] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 354 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:29.671251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa9176-715a-4a41-a39d-9dfa72a402da None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:29.674058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f1aa9176-715a-4a41-a39d-9dfa72a402da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:29.819695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97d8e46-6ee1-4bbe-adc8-7ca81eee2f86 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:29.853325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:29.866172 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:29.871485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:29.873833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:29.874193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] PATH_INFO: `/v3/users/1f3c737be1964a84b23e7202679874e2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:29.884719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f3c737be1964a84b23e7202679874e2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:29.900425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:29.952638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aa9176-715a-4a41-a39d-9dfa72a402da None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:29.953340 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:29.963603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626311e8-6792-4aad-bdf4-cccda4a022ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:29.964688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626311e8-6792-4aad-bdf4-cccda4a022ad service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:29.965198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626311e8-6792-4aad-bdf4-cccda4a022ad service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:29.965671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626311e8-6792-4aad-bdf4-cccda4a022ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:29.991968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626311e8-6792-4aad-bdf4-cccda4a022ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:29.993831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626311e8-6792-4aad-bdf4-cccda4a022ad service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:30.029883 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2580/5187] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:30.137594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f3c737be1964a84b23e7202679874e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:30.215742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f3c737be1964a84b23e7202679874e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:30.218758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f3c737be1964a84b23e7202679874e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:30.241521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f3c737be1964a84b23e7202679874e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:30.280740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31bbcc99-860e-4ed1-be32-6b956ef11b86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f3c737be1964a84b23e7202679874e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:30.309450 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2608/5188] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:29 2022] DELETE /identity/v3/users/1f3c737be1964a84b23e7202679874e2 => generated 0 bytes in 861 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:30.314498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7bd12-7555-4daf-a346-d4f290f4dfd8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:30.314834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7bd12-7555-4daf-a346-d4f290f4dfd8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:30.315294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7bd12-7555-4daf-a346-d4f290f4dfd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:30.351467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-53c7bd12-7555-4daf-a346-d4f290f4dfd8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:30.353269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-53c7bd12-7555-4daf-a346-d4f290f4dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:30.408158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c8883-ae04-4508-a3bc-a29c2f92242e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:30.408931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c8883-ae04-4508-a3bc-a29c2f92242e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:30.409865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c8883-ae04-4508-a3bc-a29c2f92242e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:30.440741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-732c8883-ae04-4508-a3bc-a29c2f92242e None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:30.442335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-732c8883-ae04-4508-a3bc-a29c2f92242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:30.491984 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2581/5189] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:30.529512 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2609/5190] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:17:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:30.565995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7bd12-7555-4daf-a346-d4f290f4dfd8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:30.578041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-53c7bd12-7555-4daf-a346-d4f290f4dfd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:30.839356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7bd12-7555-4daf-a346-d4f290f4dfd8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:30.848633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c8883-ae04-4508-a3bc-a29c2f92242e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:30.850247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-732c8883-ae04-4508-a3bc-a29c2f92242e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:30.858061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f9667a-e8ec-4d15-9dae-b12779ce7aaf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:30.858690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9667a-e8ec-4d15-9dae-b12779ce7aaf service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:30.858970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9667a-e8ec-4d15-9dae-b12779ce7aaf service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:30.859242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f9667a-e8ec-4d15-9dae-b12779ce7aaf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:30.900934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9667a-e8ec-4d15-9dae-b12779ce7aaf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:30.905944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f9667a-e8ec-4d15-9dae-b12779ce7aaf service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:30.958251 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2582/5191] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:31.091309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c8883-ae04-4508-a3bc-a29c2f92242e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:31.098448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f77252-e83f-4900-bb14-624a41027765 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:31.099098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f77252-e83f-4900-bb14-624a41027765 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:31.099377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f77252-e83f-4900-bb14-624a41027765 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:31.099656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f77252-e83f-4900-bb14-624a41027765 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:31.123836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f77252-e83f-4900-bb14-624a41027765 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:31.128447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f77252-e83f-4900-bb14-624a41027765 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:31.155053 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2610/5192] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:17:31.514527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30b693-553c-4c0f-9de7-9a6c2388bada None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:31.515418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30b693-553c-4c0f-9de7-9a6c2388bada None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:31.515854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f30b693-553c-4c0f-9de7-9a6c2388bada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:31.558457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0f30b693-553c-4c0f-9de7-9a6c2388bada None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:31.559974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0f30b693-553c-4c0f-9de7-9a6c2388bada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:31.573569 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2583/5193] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:17:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:31.587633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f77252-e83f-4900-bb14-624a41027765 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:31.608246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f77252-e83f-4900-bb14-624a41027765 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:31.627323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9284c64-84c3-478c-929a-b1c350205a1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:31.628216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9284c64-84c3-478c-929a-b1c350205a1b service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:31.628658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9284c64-84c3-478c-929a-b1c350205a1b service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:31.629089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9284c64-84c3-478c-929a-b1c350205a1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:31.647621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9284c64-84c3-478c-929a-b1c350205a1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:31.649545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9284c64-84c3-478c-929a-b1c350205a1b service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:31.678028 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2611/5194] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:32.578576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af81c-9bd3-42e5-b64d-a3d91032992c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:32.579410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af81c-9bd3-42e5-b64d-a3d91032992c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:32.579881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816af81c-9bd3-42e5-b64d-a3d91032992c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:32.647800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-816af81c-9bd3-42e5-b64d-a3d91032992c None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:32.660121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-816af81c-9bd3-42e5-b64d-a3d91032992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:32.686556 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2584/5195] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:17:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:32.704317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9284c64-84c3-478c-929a-b1c350205a1b service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:32.726523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9284c64-84c3-478c-929a-b1c350205a1b service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:32.758203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4627574-30cd-42e3-8011-5277401eec2b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:32.760599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627574-30cd-42e3-8011-5277401eec2b service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:32.762772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627574-30cd-42e3-8011-5277401eec2b service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:32.764478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4627574-30cd-42e3-8011-5277401eec2b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:32.804364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4627574-30cd-42e3-8011-5277401eec2b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:32.813125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4627574-30cd-42e3-8011-5277401eec2b service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:32.836320 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2612/5196] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:33.001440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af81c-9bd3-42e5-b64d-a3d91032992c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:33.003378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-816af81c-9bd3-42e5-b64d-a3d91032992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:33.033339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816af81c-9bd3-42e5-b64d-a3d91032992c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:33.088834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:33.089553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:33.089990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:33.090477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] PATH_INFO: `/v3/projects/c38fb7a1a68c4a63bc1b5e4d6b65aef9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:33.092720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38fb7a1a68c4a63bc1b5e4d6b65aef9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:33.095805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:33.231345 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:33.248685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38fb7a1a68c4a63bc1b5e4d6b65aef9', 'request_id': 'req-2a49f7a2-0ddc-43f6-98e7-610191e78d70'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.258040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38fb7a1a68c4a63bc1b5e4d6b65aef9', 'request_id': 'req-2a49f7a2-0ddc-43f6-98e7-610191e78d70'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.282272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38fb7a1a68c4a63bc1b5e4d6b65aef9', 'request_id': 'req-2a49f7a2-0ddc-43f6-98e7-610191e78d70'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.298804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] The token cache is being invalidate because project c38fb7a1a68c4a63bc1b5e4d6b65aef9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:33.299354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.300979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2a49f7a2-0ddc-43f6-98e7-610191e78d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.303694 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2585/5197] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:33 2022] DELETE /identity/v3/projects/c38fb7a1a68c4a63bc1b5e4d6b65aef9 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:33.307798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4627574-30cd-42e3-8011-5277401eec2b service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:33.326739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4627574-30cd-42e3-8011-5277401eec2b service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:33.335592 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:33.430022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:33.430914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:33.431465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:33.431941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] PATH_INFO: `/v3/users/28c51e0231ef47f38576b18e229fc1b4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:33.433266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28c51e0231ef47f38576b18e229fc1b4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:33.436564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:33.526393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28c51e0231ef47f38576b18e229fc1b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.556507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28c51e0231ef47f38576b18e229fc1b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.558466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28c51e0231ef47f38576b18e229fc1b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.578974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28c51e0231ef47f38576b18e229fc1b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.597751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28c51e0231ef47f38576b18e229fc1b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:33.613182 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2613/5198] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:33 2022] DELETE /identity/v3/users/28c51e0231ef47f38576b18e229fc1b4 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:33.628597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5b0ca-a2e0-472c-8915-c8c89121bcc7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:33.629075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5b0ca-a2e0-472c-8915-c8c89121bcc7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:33.629162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f5b0ca-a2e0-472c-8915-c8c89121bcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:33.665008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-92f5b0ca-a2e0-472c-8915-c8c89121bcc7 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:33.666527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-92f5b0ca-a2e0-472c-8915-c8c89121bcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:33.793552 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2586/5199] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:17:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:33.828806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:33.830818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:34.085010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c5f3-2e38-406d-b4a6-92fde880009f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:34.085638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c5f3-2e38-406d-b4a6-92fde880009f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:34.086112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369c5f3-2e38-406d-b4a6-92fde880009f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:34.099180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321f84c8-60a0-478c-853c-27d6c252b351 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:34.110353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2977d-4e8a-4f15-b0e2-aa802fa8e9c0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:34.112923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2977d-4e8a-4f15-b0e2-aa802fa8e9c0 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:34.113270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2977d-4e8a-4f15-b0e2-aa802fa8e9c0 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:34.114745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2977d-4e8a-4f15-b0e2-aa802fa8e9c0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:34.115933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8369c5f3-2e38-406d-b4a6-92fde880009f None None] MFA Rules not processed for user `b1ae9fcca02548dfa6e29d2787288e49`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:34.117414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8369c5f3-2e38-406d-b4a6-92fde880009f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:34.150266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2977d-4e8a-4f15-b0e2-aa802fa8e9c0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:34.151917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2977d-4e8a-4f15-b0e2-aa802fa8e9c0 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:34.178764 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2614/5200] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:34.281583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2977d-4e8a-4f15-b0e2-aa802fa8e9c0 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:34.286121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f9f2977d-4e8a-4f15-b0e2-aa802fa8e9c0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:34.311830 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2587/5201] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:34.359814 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:34.516394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2977d-4e8a-4f15-b0e2-aa802fa8e9c0 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:34.534808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:34.535471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:34.535753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:34.536029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] PATH_INFO: `/v3/projects/ddd15b86fd154dd7a2c4821c13c17637` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:34.537181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddd15b86fd154dd7a2c4821c13c17637)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:34.539154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:34.641917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddd15b86fd154dd7a2c4821c13c17637', 'request_id': 'req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:34.655224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddd15b86fd154dd7a2c4821c13c17637', 'request_id': 'req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:34.663138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddd15b86fd154dd7a2c4821c13c17637', 'request_id': 'req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:34.714809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] The token cache is being invalidate because project ddd15b86fd154dd7a2c4821c13c17637 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:34.715182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:34.717829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7610d1a9-5e5a-47f7-a70c-97dec4c4bc67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:34.722790 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2615/5202] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:34 2022] DELETE /identity/v3/projects/ddd15b86fd154dd7a2c4821c13c17637 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:34.723917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c5f3-2e38-406d-b4a6-92fde880009f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:34.736191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369c5f3-2e38-406d-b4a6-92fde880009f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:34.807519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fdf0c-4d00-4d76-8937-96993407531e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:34.807901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fdf0c-4d00-4d76-8937-96993407531e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:34.808319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3fdf0c-4d00-4d76-8937-96993407531e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:34.847293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7d3fdf0c-4d00-4d76-8937-96993407531e None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:34.849654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7d3fdf0c-4d00-4d76-8937-96993407531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:34.908407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:34.909309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:34.910253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:34.910683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] PATH_INFO: `/v3/users/8757d723c096476fba41f507e97d5de4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:34.912001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8757d723c096476fba41f507e97d5de4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:34.914188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:34.953345 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:35.027349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8757d723c096476fba41f507e97d5de4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:35.043595 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2616/5203] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:17:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:35.055833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fdf0c-4d00-4d76-8937-96993407531e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:35.057348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7d3fdf0c-4d00-4d76-8937-96993407531e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:35.064182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8757d723c096476fba41f507e97d5de4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:35.067588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8757d723c096476fba41f507e97d5de4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:35.089721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8757d723c096476fba41f507e97d5de4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:35.107538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8757d723c096476fba41f507e97d5de4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:35.127409 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2588/5204] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:34 2022] DELETE /identity/v3/users/8757d723c096476fba41f507e97d5de4 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:35.198339 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:35.244710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3fdf0c-4d00-4d76-8937-96993407531e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:35.458784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710bfe46-946e-4edd-ad3d-8ba21603f973 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:35.459429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bfe46-946e-4edd-ad3d-8ba21603f973 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:35.459756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bfe46-946e-4edd-ad3d-8ba21603f973 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:35.460142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710bfe46-946e-4edd-ad3d-8ba21603f973 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:35.462879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-710bfe46-946e-4edd-ad3d-8ba21603f973 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:35.547097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bfe46-946e-4edd-ad3d-8ba21603f973 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:35.549276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-710bfe46-946e-4edd-ad3d-8ba21603f973 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:35.580750 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2617/5205] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:17:36.175444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:36.176920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:36.380815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a9f2f1-ccfd-44b1-971e-2c06f51d6d9a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:36.398067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:36.400375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:36.402015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:36.402449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:36.412891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:36.583722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64c38-a59a-4ff9-99f3-c14435ca7b3b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:36.584948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64c38-a59a-4ff9-99f3-c14435ca7b3b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:36.585928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f64c38-a59a-4ff9-99f3-c14435ca7b3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:36.648820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:36.652970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:36.673604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-98f64c38-a59a-4ff9-99f3-c14435ca7b3b None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:36.676423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-98f64c38-a59a-4ff9-99f3-c14435ca7b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:36.687439 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2589/5206] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:36.708632 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2618/5207] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:17:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:17:36.721669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:36.723957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:36.751026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1526085d-166a-4fa5-b61a-ea0b19daba43 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:36.759188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ed0e86-7cac-46c4-ad5c-0984e3d0918c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:36.759188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed0e86-7cac-46c4-ad5c-0984e3d0918c service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:36.759188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed0e86-7cac-46c4-ad5c-0984e3d0918c service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:36.759560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ed0e86-7cac-46c4-ad5c-0984e3d0918c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:36.769645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed0e86-7cac-46c4-ad5c-0984e3d0918c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:36.771377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ed0e86-7cac-46c4-ad5c-0984e3d0918c service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:36.784803 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2590/5208] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:37.385686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f64c38-a59a-4ff9-99f3-c14435ca7b3b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:37.387195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-98f64c38-a59a-4ff9-99f3-c14435ca7b3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:37.516952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f358daa-a666-447e-907d-606d5951b38e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:37.517590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f358daa-a666-447e-907d-606d5951b38e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:37.517590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f358daa-a666-447e-907d-606d5951b38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:37.550555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f64c38-a59a-4ff9-99f3-c14435ca7b3b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:37.573877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3f358daa-a666-447e-907d-606d5951b38e None None] MFA Rules not processed for user `de6929c304ff4260b9e7c4d469b71a0d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:37.573877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3f358daa-a666-447e-907d-606d5951b38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:37.590412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:37.591030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:37.591347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:37.591630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] PATH_INFO: `/v3/projects/29dfd4debd824d1186b36631eba94bca` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:37.602275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] RBAC: Authorizing `identity:delete_project(project_id=29dfd4debd824d1186b36631eba94bca)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:37.604431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:37.661812 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:37.741462 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:37.771997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29dfd4debd824d1186b36631eba94bca', 'request_id': 'req-674b6b39-d2e1-4b05-80e8-c2d26b59108c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:37.786687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29dfd4debd824d1186b36631eba94bca', 'request_id': 'req-674b6b39-d2e1-4b05-80e8-c2d26b59108c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:37.799138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29dfd4debd824d1186b36631eba94bca', 'request_id': 'req-674b6b39-d2e1-4b05-80e8-c2d26b59108c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:37.867622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] The token cache is being invalidate because project 29dfd4debd824d1186b36631eba94bca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:37.873658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:37.875663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-674b6b39-d2e1-4b05-80e8-c2d26b59108c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:37.886546 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2619/5209] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:37 2022] DELETE /identity/v3/projects/29dfd4debd824d1186b36631eba94bca => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:37.890362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638e57f-60a1-466c-b768-a1c31cb22a26 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:37.890929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638e57f-60a1-466c-b768-a1c31cb22a26 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:37.891462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7638e57f-60a1-466c-b768-a1c31cb22a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:37.927430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2591/5210] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:17:38.015158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7638e57f-60a1-466c-b768-a1c31cb22a26 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:38.017282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7638e57f-60a1-466c-b768-a1c31cb22a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:38.163968 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2620/5211] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:38.183397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812307e-6bf9-475f-8c99-9a39dab6de83 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:38.183397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812307e-6bf9-475f-8c99-9a39dab6de83 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:38.183397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c812307e-6bf9-475f-8c99-9a39dab6de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:38.196696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c812307e-6bf9-475f-8c99-9a39dab6de83 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:38.198077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c812307e-6bf9-475f-8c99-9a39dab6de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:38.219120 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2592/5212] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:38.223120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638e57f-60a1-466c-b768-a1c31cb22a26 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:38.262786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7638e57f-60a1-466c-b768-a1c31cb22a26 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:38.287616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebf0c6-233d-4a67-9cac-da20154b9d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:38.288464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebf0c6-233d-4a67-9cac-da20154b9d17 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:38.289753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebf0c6-233d-4a67-9cac-da20154b9d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:38.290204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ebf0c6-233d-4a67-9cac-da20154b9d17 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:38.293943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebf0c6-233d-4a67-9cac-da20154b9d17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:17:38.294474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebf0c6-233d-4a67-9cac-da20154b9d17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:38.296257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ebf0c6-233d-4a67-9cac-da20154b9d17 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:38.354829 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2621/5213] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:17:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:38.356109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812307e-6bf9-475f-8c99-9a39dab6de83 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:38.374633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c812307e-6bf9-475f-8c99-9a39dab6de83 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:38.404635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef621-67f5-4af5-9ea8-3b884237b963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:38.405264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef621-67f5-4af5-9ea8-3b884237b963 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:38.405587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef621-67f5-4af5-9ea8-3b884237b963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:38.405862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99ef621-67f5-4af5-9ea8-3b884237b963 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:38.406499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef621-67f5-4af5-9ea8-3b884237b963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:38.409783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99ef621-67f5-4af5-9ea8-3b884237b963 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:38.636209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebf0c6-233d-4a67-9cac-da20154b9d17 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:38.650602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ebf0c6-233d-4a67-9cac-da20154b9d17 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:38.655218 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2593/5214] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:38 2022] POST /identity/v3/projects => generated 365 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:38.919772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456c150-4dcc-4627-9f85-6bfc62f83c3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:38.920741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456c150-4dcc-4627-9f85-6bfc62f83c3e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:38.921810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456c150-4dcc-4627-9f85-6bfc62f83c3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:38.921810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1456c150-4dcc-4627-9f85-6bfc62f83c3e admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:38.922323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456c150-4dcc-4627-9f85-6bfc62f83c3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:38.931206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1456c150-4dcc-4627-9f85-6bfc62f83c3e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:38.994795 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2622/5215] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:38 2022] POST /identity/v3/users => generated 283 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:38.999336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef621-67f5-4af5-9ea8-3b884237b963 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:39.022744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99ef621-67f5-4af5-9ea8-3b884237b963 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:39.043727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f10e92-7056-41d9-aed8-719ccbb58e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:39.044460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f10e92-7056-41d9-aed8-719ccbb58e3d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:39.044810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f10e92-7056-41d9-aed8-719ccbb58e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:39.045151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f10e92-7056-41d9-aed8-719ccbb58e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:39.045895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f10e92-7056-41d9-aed8-719ccbb58e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:39.047586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f10e92-7056-41d9-aed8-719ccbb58e3d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:39.070694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456c150-4dcc-4627-9f85-6bfc62f83c3e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:39.078123 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2594/5216] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:38 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:39.082503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1456c150-4dcc-4627-9f85-6bfc62f83c3e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:39.087937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94924ee5-c5a7-45df-82ee-03d2e04deeef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:39.088683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94924ee5-c5a7-45df-82ee-03d2e04deeef admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:39.089069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94924ee5-c5a7-45df-82ee-03d2e04deeef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:39.089496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94924ee5-c5a7-45df-82ee-03d2e04deeef admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:39.090254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94924ee5-c5a7-45df-82ee-03d2e04deeef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:39.092001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94924ee5-c5a7-45df-82ee-03d2e04deeef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:39.108653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f10e92-7056-41d9-aed8-719ccbb58e3d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:39.115712 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2623/5217] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:39.119740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f10e92-7056-41d9-aed8-719ccbb58e3d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:39.133684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40293cb-4f9b-48a5-99a6-8d79a8001e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:39.136405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40293cb-4f9b-48a5-99a6-8d79a8001e13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:39.136821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40293cb-4f9b-48a5-99a6-8d79a8001e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:39.144891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40293cb-4f9b-48a5-99a6-8d79a8001e13 admin admin] PATH_INFO: `/v3/projects/4065ffd353ca412883065d4c009c1454/users/982fb869b1454ec2868894852b797096/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:39.180037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40293cb-4f9b-48a5-99a6-8d79a8001e13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4065ffd353ca412883065d4c009c1454, user_id=982fb869b1454ec2868894852b797096, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:39.182861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40293cb-4f9b-48a5-99a6-8d79a8001e13 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:39.223695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eba77-f183-4061-b667-8fc8f122779f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:39.224138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eba77-f183-4061-b667-8fc8f122779f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:39.224540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354eba77-f183-4061-b667-8fc8f122779f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:39.227483 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2595/5218] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:39 2022] PUT /identity/v3/projects/4065ffd353ca412883065d4c009c1454/users/982fb869b1454ec2868894852b797096/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:39.312959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-354eba77-f183-4061-b667-8fc8f122779f None None] MFA Rules not processed for user `982fb869b1454ec2868894852b797096`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:39.319407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-354eba77-f183-4061-b667-8fc8f122779f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:39.352616 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:39.509934 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2624/5219] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:39.523342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40293cb-4f9b-48a5-99a6-8d79a8001e13 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:39.525650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c40293cb-4f9b-48a5-99a6-8d79a8001e13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:39.580238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b381-eaf7-427a-8653-443a363f24a3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:39.580671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b381-eaf7-427a-8653-443a363f24a3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:39.581054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d36b381-eaf7-427a-8653-443a363f24a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:39.626460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0d36b381-eaf7-427a-8653-443a363f24a3 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:39.627970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d36b381-eaf7-427a-8653-443a363f24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:39.698917 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2625/5220] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:17:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:39.720289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36b381-eaf7-427a-8653-443a363f24a3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:39.722082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d36b381-eaf7-427a-8653-443a363f24a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:39.733271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40293cb-4f9b-48a5-99a6-8d79a8001e13 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:39.748025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ebbfc0-df0c-4037-b4ee-52ebe5d97b47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:39.748953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebbfc0-df0c-4037-b4ee-52ebe5d97b47 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:39.749436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebbfc0-df0c-4037-b4ee-52ebe5d97b47 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:39.749886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ebbfc0-df0c-4037-b4ee-52ebe5d97b47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:39.772291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebbfc0-df0c-4037-b4ee-52ebe5d97b47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:39.775397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ebbfc0-df0c-4037-b4ee-52ebe5d97b47 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:39.817535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2596/5221] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:39.908383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d36b381-eaf7-427a-8653-443a363f24a3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:39.926424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616f54-3654-4836-bb21-370f7d5957a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:39.927692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616f54-3654-4836-bb21-370f7d5957a1 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:39.927981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616f54-3654-4836-bb21-370f7d5957a1 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:39.928257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08616f54-3654-4836-bb21-370f7d5957a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:39.943310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08616f54-3654-4836-bb21-370f7d5957a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:39.945662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08616f54-3654-4836-bb21-370f7d5957a1 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:39.988236 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2626/5222] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:40.418645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5801cbc-cf8e-4ea9-af85-500462617738 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:40.419067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5801cbc-cf8e-4ea9-af85-500462617738 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:40.419384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5801cbc-cf8e-4ea9-af85-500462617738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:40.474205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a5801cbc-cf8e-4ea9-af85-500462617738 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:40.479705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a5801cbc-cf8e-4ea9-af85-500462617738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:40.517050 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2597/5223] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:17:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:40.544246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616f54-3654-4836-bb21-370f7d5957a1 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:40.573715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08616f54-3654-4836-bb21-370f7d5957a1 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:40.588153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f545ebb-7713-4e71-8257-5e44ce541898 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:40.589134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f545ebb-7713-4e71-8257-5e44ce541898 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:40.589526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f545ebb-7713-4e71-8257-5e44ce541898 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:40.592506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f545ebb-7713-4e71-8257-5e44ce541898 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:40.613185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f545ebb-7713-4e71-8257-5e44ce541898 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:40.616980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f545ebb-7713-4e71-8257-5e44ce541898 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:40.665711 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2627/5224] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:41.083009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaac8f-3d8e-4166-80e6-4ecc8e334238 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:41.083542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaac8f-3d8e-4166-80e6-4ecc8e334238 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:41.083817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbaac8f-3d8e-4166-80e6-4ecc8e334238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:41.141168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4fbaac8f-3d8e-4166-80e6-4ecc8e334238 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:41.150140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4fbaac8f-3d8e-4166-80e6-4ecc8e334238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:41.199416 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2598/5225] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:17:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:41.205404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f545ebb-7713-4e71-8257-5e44ce541898 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:41.229777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f545ebb-7713-4e71-8257-5e44ce541898 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:41.254680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e28ea-5486-4999-aeed-e9d3665dd66f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:41.259192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e28ea-5486-4999-aeed-e9d3665dd66f service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:41.260145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e28ea-5486-4999-aeed-e9d3665dd66f service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:41.261940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765e28ea-5486-4999-aeed-e9d3665dd66f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:41.299120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e28ea-5486-4999-aeed-e9d3665dd66f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:41.300759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765e28ea-5486-4999-aeed-e9d3665dd66f service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:41.346965 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2628/5226] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:41.884787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f6a60-17f2-4506-86b5-33e70b3afa2a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:41.885076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f6a60-17f2-4506-86b5-33e70b3afa2a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:41.885732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f6a60-17f2-4506-86b5-33e70b3afa2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:41.993737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-050f6a60-17f2-4506-86b5-33e70b3afa2a None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:42.002133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-050f6a60-17f2-4506-86b5-33e70b3afa2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:42.048080 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2599/5227] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:17:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:42.070467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e28ea-5486-4999-aeed-e9d3665dd66f service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:42.101971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765e28ea-5486-4999-aeed-e9d3665dd66f service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:42.121451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ff11e-5976-459d-b144-cd6c7bffa353 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:42.123749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ff11e-5976-459d-b144-cd6c7bffa353 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:42.126381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ff11e-5976-459d-b144-cd6c7bffa353 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:42.128698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01ff11e-5976-459d-b144-cd6c7bffa353 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:42.194263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ff11e-5976-459d-b144-cd6c7bffa353 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:42.198272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01ff11e-5976-459d-b144-cd6c7bffa353 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:42.214722 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2629/5228] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:42.574005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e397b46-55b1-4a50-89c4-b973f1f338a5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:42.574725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e397b46-55b1-4a50-89c4-b973f1f338a5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:42.575174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e397b46-55b1-4a50-89c4-b973f1f338a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:42.640849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2e397b46-55b1-4a50-89c4-b973f1f338a5 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:42.642572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2e397b46-55b1-4a50-89c4-b973f1f338a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:42.667639 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2600/5229] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:17:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:42.695443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ff11e-5976-459d-b144-cd6c7bffa353 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:42.726158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01ff11e-5976-459d-b144-cd6c7bffa353 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:42.753029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce663242-fe32-43ab-9699-1a777e1a61de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:42.753680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce663242-fe32-43ab-9699-1a777e1a61de service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:42.754167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce663242-fe32-43ab-9699-1a777e1a61de service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:42.754607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce663242-fe32-43ab-9699-1a777e1a61de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:42.780200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce663242-fe32-43ab-9699-1a777e1a61de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:42.782112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce663242-fe32-43ab-9699-1a777e1a61de service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:42.786828 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:42.810525 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2630/5230] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:43.180531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dad65-ab2f-45d7-8683-b6fe8ebd21d5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:43.181859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dad65-ab2f-45d7-8683-b6fe8ebd21d5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:43.182319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101dad65-ab2f-45d7-8683-b6fe8ebd21d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:43.209264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-101dad65-ab2f-45d7-8683-b6fe8ebd21d5 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:43.211174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-101dad65-ab2f-45d7-8683-b6fe8ebd21d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:43.238483 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2601/5231] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:17:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:43.255289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce663242-fe32-43ab-9699-1a777e1a61de service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:43.273743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce663242-fe32-43ab-9699-1a777e1a61de service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:43.282002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d602f2a-e60f-4ee2-9cd6-7ad2356ff2a3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:43.283140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d602f2a-e60f-4ee2-9cd6-7ad2356ff2a3 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:43.283607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d602f2a-e60f-4ee2-9cd6-7ad2356ff2a3 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:43.284074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d602f2a-e60f-4ee2-9cd6-7ad2356ff2a3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:43.299770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d602f2a-e60f-4ee2-9cd6-7ad2356ff2a3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:43.301494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d602f2a-e60f-4ee2-9cd6-7ad2356ff2a3 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:43.312524 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2631/5232] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:17:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:17:43.473972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dad65-ab2f-45d7-8683-b6fe8ebd21d5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:43.475938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-101dad65-ab2f-45d7-8683-b6fe8ebd21d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:43.523844 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:43.567477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101dad65-ab2f-45d7-8683-b6fe8ebd21d5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:43.572209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:43.572915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:43.573258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:43.573631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] PATH_INFO: `/v3/users/1d344687c9c9494788b75b95d63f8bd4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:43.574839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d344687c9c9494788b75b95d63f8bd4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:43.577711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:43.646520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d344687c9c9494788b75b95d63f8bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:43.661488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d344687c9c9494788b75b95d63f8bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:43.663179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d344687c9c9494788b75b95d63f8bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:43.675316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d344687c9c9494788b75b95d63f8bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:43.687598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d344687c9c9494788b75b95d63f8bd4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:43.694738 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2602/5233] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:43 2022] DELETE /identity/v3/users/1d344687c9c9494788b75b95d63f8bd4 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:43.699734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0f6f9-fdba-4ad9-b08b-61874b36a13b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:43.700290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0f6f9-fdba-4ad9-b08b-61874b36a13b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:43.701404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0f6f9-fdba-4ad9-b08b-61874b36a13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:43.727675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-eda0f6f9-fdba-4ad9-b08b-61874b36a13b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:43.729006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eda0f6f9-fdba-4ad9-b08b-61874b36a13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:43.797453 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2632/5234] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:43.807207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:43.808783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:43.904456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da610869-2891-40a1-ab86-54e2a4d5f22b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:43.910976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cacb822c-635b-4fa5-9d1e-65cd13fcf4fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:43.912096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb822c-635b-4fa5-9d1e-65cd13fcf4fa service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:43.913180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb822c-635b-4fa5-9d1e-65cd13fcf4fa service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:43.913778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacb822c-635b-4fa5-9d1e-65cd13fcf4fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:43.927821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb822c-635b-4fa5-9d1e-65cd13fcf4fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:43.930400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cacb822c-635b-4fa5-9d1e-65cd13fcf4fa service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:43.945141 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2603/5235] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:44.741253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0f6f9-fdba-4ad9-b08b-61874b36a13b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:44.748978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eda0f6f9-fdba-4ad9-b08b-61874b36a13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:44.776740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda0f6f9-fdba-4ad9-b08b-61874b36a13b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:44.784062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:44.785007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:44.785521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:44.786774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] PATH_INFO: `/v3/projects/2ff5a30f2f5b43c2be93dec19ee36b8d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:44.810707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ff5a30f2f5b43c2be93dec19ee36b8d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:44.812843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:44.891197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ff5a30f2f5b43c2be93dec19ee36b8d', 'request_id': 'req-8bca5e57-4a04-42e4-b97b-574f38f12d86'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:44.903365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ff5a30f2f5b43c2be93dec19ee36b8d', 'request_id': 'req-8bca5e57-4a04-42e4-b97b-574f38f12d86'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:44.912774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ff5a30f2f5b43c2be93dec19ee36b8d', 'request_id': 'req-8bca5e57-4a04-42e4-b97b-574f38f12d86'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:44.928177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] The token cache is being invalidate because project 2ff5a30f2f5b43c2be93dec19ee36b8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:44.928474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:44.929141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8bca5e57-4a04-42e4-b97b-574f38f12d86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:44.937546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d9a2-7691-4bda-849d-4ba7a62aa4a8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:44.938028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d9a2-7691-4bda-849d-4ba7a62aa4a8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:44.938116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d9a2-7691-4bda-849d-4ba7a62aa4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:44.947714 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2633/5236] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:44 2022] DELETE /identity/v3/projects/2ff5a30f2f5b43c2be93dec19ee36b8d => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:44.963093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8d78d9a2-7691-4bda-849d-4ba7a62aa4a8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:44.964282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8d78d9a2-7691-4bda-849d-4ba7a62aa4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:45.019883 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:45.038915 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2604/5237] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:45.046582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b1fae-aa9c-407c-84f3-a235154816f1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:45.046873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b1fae-aa9c-407c-84f3-a235154816f1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:45.047142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921b1fae-aa9c-407c-84f3-a235154816f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:45.079521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-921b1fae-aa9c-407c-84f3-a235154816f1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:45.081248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-921b1fae-aa9c-407c-84f3-a235154816f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:45.090951 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2634/5238] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:45.095855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d9a2-7691-4bda-849d-4ba7a62aa4a8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:45.109571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d9a2-7691-4bda-849d-4ba7a62aa4a8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:45.117955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0c5a-6311-41cc-bb51-b611e989aaec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:45.119387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0c5a-6311-41cc-bb51-b611e989aaec admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:45.123013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0c5a-6311-41cc-bb51-b611e989aaec admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:45.123397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7b0c5a-6311-41cc-bb51-b611e989aaec admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:45.124157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b0c5a-6311-41cc-bb51-b611e989aaec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:17:45.124550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b0c5a-6311-41cc-bb51-b611e989aaec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:45.127950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7b0c5a-6311-41cc-bb51-b611e989aaec admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:45.162675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b1fae-aa9c-407c-84f3-a235154816f1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:45.167022 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2605/5239] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:17:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:45.175499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921b1fae-aa9c-407c-84f3-a235154816f1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:45.186586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798a104-0c7c-481d-a38e-5d0715d85bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:45.187311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798a104-0c7c-481d-a38e-5d0715d85bb3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:45.187998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798a104-0c7c-481d-a38e-5d0715d85bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:45.188282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9798a104-0c7c-481d-a38e-5d0715d85bb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:45.188925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798a104-0c7c-481d-a38e-5d0715d85bb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:45.199195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9798a104-0c7c-481d-a38e-5d0715d85bb3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:45.244100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0c5a-6311-41cc-bb51-b611e989aaec admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:45.265659 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2635/5240] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:45 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:45.271212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7b0c5a-6311-41cc-bb51-b611e989aaec admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:45.428170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9da4b2-c3b5-4fce-bef6-b379b0a982ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:45.429277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da4b2-c3b5-4fce-bef6-b379b0a982ae admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:45.429600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da4b2-c3b5-4fce-bef6-b379b0a982ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:45.430059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9da4b2-c3b5-4fce-bef6-b379b0a982ae admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:45.430758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9da4b2-c3b5-4fce-bef6-b379b0a982ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:45.433127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9da4b2-c3b5-4fce-bef6-b379b0a982ae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:45.488523 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2606/5241] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:45 2022] POST /identity/v3/users => generated 292 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:45.492528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798a104-0c7c-481d-a38e-5d0715d85bb3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:45.511728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9798a104-0c7c-481d-a38e-5d0715d85bb3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:45.535316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db148dde-4e6d-4aad-9989-2f96c6d69a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:45.535966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db148dde-4e6d-4aad-9989-2f96c6d69a74 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:45.536249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db148dde-4e6d-4aad-9989-2f96c6d69a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:45.536529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db148dde-4e6d-4aad-9989-2f96c6d69a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:45.537447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db148dde-4e6d-4aad-9989-2f96c6d69a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:45.539110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db148dde-4e6d-4aad-9989-2f96c6d69a74 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:45.558160 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2636/5242] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:45.563884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9da4b2-c3b5-4fce-bef6-b379b0a982ae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:45.580299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9da4b2-c3b5-4fce-bef6-b379b0a982ae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:45.603353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede26205-179b-4442-a5fb-856a673f4eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:45.603993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede26205-179b-4442-a5fb-856a673f4eb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:45.604291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede26205-179b-4442-a5fb-856a673f4eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:45.604570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede26205-179b-4442-a5fb-856a673f4eb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:45.605226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede26205-179b-4442-a5fb-856a673f4eb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:45.607431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede26205-179b-4442-a5fb-856a673f4eb5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:45.633742 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2607/5243] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:45.638257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db148dde-4e6d-4aad-9989-2f96c6d69a74 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:45.655230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db148dde-4e6d-4aad-9989-2f96c6d69a74 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:45.673334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bef5b3-26c4-4a64-80d7-63c60da5b4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:45.674045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bef5b3-26c4-4a64-80d7-63c60da5b4c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:45.674329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bef5b3-26c4-4a64-80d7-63c60da5b4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:45.674606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bef5b3-26c4-4a64-80d7-63c60da5b4c2 admin admin] PATH_INFO: `/v3/projects/4c60bafec7884a8bbbff1b54ff093052/users/3b853638046447d08af9f62c30a3dc85/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:45.699667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bef5b3-26c4-4a64-80d7-63c60da5b4c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c60bafec7884a8bbbff1b54ff093052, user_id=3b853638046447d08af9f62c30a3dc85, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:45.702535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bef5b3-26c4-4a64-80d7-63c60da5b4c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:45.730529 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2637/5244] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:45 2022] PUT /identity/v3/projects/4c60bafec7884a8bbbff1b54ff093052/users/3b853638046447d08af9f62c30a3dc85/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:45.741350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138df77-adea-4c08-8904-d0c6d7dc3d17 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:45.741686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138df77-adea-4c08-8904-d0c6d7dc3d17 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:45.741991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138df77-adea-4c08-8904-d0c6d7dc3d17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:45.813111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8138df77-adea-4c08-8904-d0c6d7dc3d17 None None] MFA Rules not processed for user `3b853638046447d08af9f62c30a3dc85`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:45.813111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8138df77-adea-4c08-8904-d0c6d7dc3d17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:45.941562 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2608/5245] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:45 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:17:45.942403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bef5b3-26c4-4a64-80d7-63c60da5b4c2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:45.948925 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:46.070026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bef5b3-26c4-4a64-80d7-63c60da5b4c2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:46.075921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656739a-57fe-4ada-a7c4-d72804f7b78c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:46.076547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656739a-57fe-4ada-a7c4-d72804f7b78c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:46.076829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656739a-57fe-4ada-a7c4-d72804f7b78c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:46.077105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c656739a-57fe-4ada-a7c4-d72804f7b78c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:46.078009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656739a-57fe-4ada-a7c4-d72804f7b78c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:46.079925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c656739a-57fe-4ada-a7c4-d72804f7b78c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:46.143245 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2638/5246] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:45 2022] POST /identity/v3/projects => generated 381 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:17:46.147096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138df77-adea-4c08-8904-d0c6d7dc3d17 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:46.159533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8138df77-adea-4c08-8904-d0c6d7dc3d17 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:46.224298 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:46.246829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f364-7f80-445e-8223-d9b753dc7e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:46.247836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f364-7f80-445e-8223-d9b753dc7e6f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:46.248316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f364-7f80-445e-8223-d9b753dc7e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:46.248693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac87f364-7f80-445e-8223-d9b753dc7e6f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:46.249669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87f364-7f80-445e-8223-d9b753dc7e6f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:46.252429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac87f364-7f80-445e-8223-d9b753dc7e6f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:46.290757 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2609/5247] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:46 2022] POST /identity/v3/users => generated 291 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:46.294869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656739a-57fe-4ada-a7c4-d72804f7b78c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:46.306354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c656739a-57fe-4ada-a7c4-d72804f7b78c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:46.313035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb1452-ddf2-443a-8b9c-6876888e1511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:46.314469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1452-ddf2-443a-8b9c-6876888e1511 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:46.315049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1452-ddf2-443a-8b9c-6876888e1511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:46.315295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb1452-ddf2-443a-8b9c-6876888e1511 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:46.316056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb1452-ddf2-443a-8b9c-6876888e1511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:46.317925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb1452-ddf2-443a-8b9c-6876888e1511 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:46.332519 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2639/5248] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:17:46.336240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f364-7f80-445e-8223-d9b753dc7e6f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:46.353906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac87f364-7f80-445e-8223-d9b753dc7e6f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:46.370149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff6e261-1b65-4383-ba9a-5f765efeee80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:46.371123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e261-1b65-4383-ba9a-5f765efeee80 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:46.371504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e261-1b65-4383-ba9a-5f765efeee80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:46.371899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff6e261-1b65-4383-ba9a-5f765efeee80 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:46.373407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e261-1b65-4383-ba9a-5f765efeee80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:46.376280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff6e261-1b65-4383-ba9a-5f765efeee80 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:46.394400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb1452-ddf2-443a-8b9c-6876888e1511 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:46.394719 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2610/5249] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:46 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:46.408277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb1452-ddf2-443a-8b9c-6876888e1511 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:46.413782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9964a-dffb-4a63-b250-41a47538d7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:46.415552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9964a-dffb-4a63-b250-41a47538d7d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:46.415908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9964a-dffb-4a63-b250-41a47538d7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:46.416508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad9964a-dffb-4a63-b250-41a47538d7d9 admin admin] PATH_INFO: `/v3/projects/41b414cc3103462f9980eabcba2d6850/users/e8116444b4d0494e9e06f328712e6eee/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:46.451175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9964a-dffb-4a63-b250-41a47538d7d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41b414cc3103462f9980eabcba2d6850, user_id=e8116444b4d0494e9e06f328712e6eee, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:46.455734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad9964a-dffb-4a63-b250-41a47538d7d9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:46.494183 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2640/5250] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:46 2022] PUT /identity/v3/projects/41b414cc3103462f9980eabcba2d6850/users/e8116444b4d0494e9e06f328712e6eee/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:46.505167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3c5df-60e3-426b-80b4-4ec1f85d1c55 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:46.506487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3c5df-60e3-426b-80b4-4ec1f85d1c55 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:46.506828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3c5df-60e3-426b-80b4-4ec1f85d1c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:46.588402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4fb3c5df-60e3-426b-80b4-4ec1f85d1c55 None None] MFA Rules not processed for user `e8116444b4d0494e9e06f328712e6eee`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:46.590069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4fb3c5df-60e3-426b-80b4-4ec1f85d1c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:46.734434 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2611/5251] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:46 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:46.744149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9964a-dffb-4a63-b250-41a47538d7d9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:46.746088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7ad9964a-dffb-4a63-b250-41a47538d7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:46.822011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad9964a-dffb-4a63-b250-41a47538d7d9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:46.825916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a98ad-d3c8-4e48-87f3-9e63441907eb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:46.826593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a98ad-d3c8-4e48-87f3-9e63441907eb service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:46.826944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a98ad-d3c8-4e48-87f3-9e63441907eb service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:46.827303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a98ad-d3c8-4e48-87f3-9e63441907eb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:46.937759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a98ad-d3c8-4e48-87f3-9e63441907eb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:46.939510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a98ad-d3c8-4e48-87f3-9e63441907eb service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:46.975762 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2641/5252] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:47.173927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3c5df-60e3-426b-80b4-4ec1f85d1c55 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:47.186463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3c5df-60e3-426b-80b4-4ec1f85d1c55 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:47.199539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db959cc-d900-4d31-922b-845e1a2a32b0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:47.200437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db959cc-d900-4d31-922b-845e1a2a32b0 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:47.200768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db959cc-d900-4d31-922b-845e1a2a32b0 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:47.201042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db959cc-d900-4d31-922b-845e1a2a32b0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:47.223458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db959cc-d900-4d31-922b-845e1a2a32b0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:47.224937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db959cc-d900-4d31-922b-845e1a2a32b0 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:47.249589 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2612/5253] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:47.913579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a98ad-d3c8-4e48-87f3-9e63441907eb service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:47.928112 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:48.089010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a98ad-d3c8-4e48-87f3-9e63441907eb service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:48.100730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:48.101816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:48.103284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:48.104357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] PATH_INFO: `/v3/users/3b853638046447d08af9f62c30a3dc85` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:48.108594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b853638046447d08af9f62c30a3dc85)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:48.116447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:48.243687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b853638046447d08af9f62c30a3dc85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:48.277740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b853638046447d08af9f62c30a3dc85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:48.278833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b853638046447d08af9f62c30a3dc85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:48.303647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b853638046447d08af9f62c30a3dc85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:48.316092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b853638046447d08af9f62c30a3dc85'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:48.331544 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2642/5254] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:47 2022] DELETE /identity/v3/users/3b853638046447d08af9f62c30a3dc85 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:48.336153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3573012-dc61-4724-9acc-12bd193cf898 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:48.337190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3573012-dc61-4724-9acc-12bd193cf898 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:48.337769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3573012-dc61-4724-9acc-12bd193cf898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:48.367494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e3573012-dc61-4724-9acc-12bd193cf898 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:48.369270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e3573012-dc61-4724-9acc-12bd193cf898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:48.458427 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2613/5255] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:48.469700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:48.471677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:48.615437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773db66d-ed35-4096-90ac-66a4c1c95e6d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:48.624941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75900-d2c1-49c8-9da4-e1056029c590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:48.626113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75900-d2c1-49c8-9da4-e1056029c590 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:48.627431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75900-d2c1-49c8-9da4-e1056029c590 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:48.628411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e75900-d2c1-49c8-9da4-e1056029c590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:48.651511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75900-d2c1-49c8-9da4-e1056029c590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:48.653034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e75900-d2c1-49c8-9da4-e1056029c590 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:48.668059 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2643/5256] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:49.402345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3573012-dc61-4724-9acc-12bd193cf898 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:49.404332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e3573012-dc61-4724-9acc-12bd193cf898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:49.426958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3573012-dc61-4724-9acc-12bd193cf898 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:49.432888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:49.433846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:49.434277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:49.435361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] PATH_INFO: `/v3/projects/4c60bafec7884a8bbbff1b54ff093052` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:49.436913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c60bafec7884a8bbbff1b54ff093052)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:49.439280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:49.532762 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:49.556541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c60bafec7884a8bbbff1b54ff093052', 'request_id': 'req-918555fa-dbc7-4ae9-b61b-6e5cf101730c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:49.565992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c60bafec7884a8bbbff1b54ff093052', 'request_id': 'req-918555fa-dbc7-4ae9-b61b-6e5cf101730c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:49.587095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c60bafec7884a8bbbff1b54ff093052', 'request_id': 'req-918555fa-dbc7-4ae9-b61b-6e5cf101730c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:49.630835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] The token cache is being invalidate because project 4c60bafec7884a8bbbff1b54ff093052 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:49.631650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:49.637603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:49.642001 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2614/5257] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:49 2022] DELETE /identity/v3/projects/4c60bafec7884a8bbbff1b54ff093052 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:49.645790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75900-d2c1-49c8-9da4-e1056029c590 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:49.660863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e75900-d2c1-49c8-9da4-e1056029c590 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:49.782330 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:49.846357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:49.847018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:49.847308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:49.849059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] PATH_INFO: `/v3/users/e8116444b4d0494e9e06f328712e6eee` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:49.850339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8116444b4d0494e9e06f328712e6eee)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:49.852325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:49.989722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8116444b4d0494e9e06f328712e6eee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:50.000992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:50.002624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:50.015895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8116444b4d0494e9e06f328712e6eee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:50.017712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8116444b4d0494e9e06f328712e6eee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:50.042932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8116444b4d0494e9e06f328712e6eee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:50.056233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8116444b4d0494e9e06f328712e6eee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:50.072713 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2644/5258] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:49 2022] DELETE /identity/v3/users/e8116444b4d0494e9e06f328712e6eee => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:50.101197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918555fa-dbc7-4ae9-b61b-6e5cf101730c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:50.175899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:50.176817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:50.177171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:50.177536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:50.179951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:50.329745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:50.331777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:50.350756 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2615/5259] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:17:50.507864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:50.509332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:50.615493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:50.617022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:50.688261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f115f9-3cca-4f8f-92c1-6d24195ad527 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:50.697450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f864c0ae-658b-4bfc-b501-4cd08ade6fe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:50.698232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864c0ae-658b-4bfc-b501-4cd08ade6fe1 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:50.699677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864c0ae-658b-4bfc-b501-4cd08ade6fe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:50.701547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864c0ae-658b-4bfc-b501-4cd08ade6fe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:50.704756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f864c0ae-658b-4bfc-b501-4cd08ade6fe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:50.729240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864c0ae-658b-4bfc-b501-4cd08ade6fe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:50.731242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f864c0ae-658b-4bfc-b501-4cd08ade6fe1 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:50.734150 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:50.744698 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2645/5260] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:50 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:50.892836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edba573-ddb7-4ce1-afe9-aa1b9ff0b4aa service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:50.898161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:50.898984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:50.899419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:50.899848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] PATH_INFO: `/v3/projects/41b414cc3103462f9980eabcba2d6850` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:50.901258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=41b414cc3103462f9980eabcba2d6850)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:50.903561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:50.907327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fcb8-d612-4376-9774-4641799efb02 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:50.907650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fcb8-d612-4376-9774-4641799efb02 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:50.907958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c3fcb8-d612-4376-9774-4641799efb02 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:50.909458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2646/5261] 10.222.0.25 () {54 vars in 921 bytes} [Mon Oct 24 09:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 24 09:17:50.915377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d7fc-668c-47fc-8c0a-6a5ce71ea564 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:50.915676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d7fc-668c-47fc-8c0a-6a5ce71ea564 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:50.915956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43d7fc-668c-47fc-8c0a-6a5ce71ea564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:50.972464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9e43d7fc-668c-47fc-8c0a-6a5ce71ea564 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:50.972733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e43d7fc-668c-47fc-8c0a-6a5ce71ea564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:50.984966 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2647/5262] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:17:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:17:51.003125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d7fc-668c-47fc-8c0a-6a5ce71ea564 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:51.012411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41b414cc3103462f9980eabcba2d6850', 'request_id': 'req-80975cf4-03d1-474f-a6e3-8920fe075cb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:51.018968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43d7fc-668c-47fc-8c0a-6a5ce71ea564 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:51.029731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41b414cc3103462f9980eabcba2d6850', 'request_id': 'req-80975cf4-03d1-474f-a6e3-8920fe075cb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:51.045632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41b414cc3103462f9980eabcba2d6850', 'request_id': 'req-80975cf4-03d1-474f-a6e3-8920fe075cb8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:51.062708 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:51.077560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] The token cache is being invalidate because project 41b414cc3103462f9980eabcba2d6850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:51.078052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:51.078972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-80975cf4-03d1-474f-a6e3-8920fe075cb8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:51.082372 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2616/5263] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:50 2022] DELETE /identity/v3/projects/41b414cc3103462f9980eabcba2d6850 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:51.087679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d1a7e-cbdc-44e1-87ca-43308b776638 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:51.089644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d1a7e-cbdc-44e1-87ca-43308b776638 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:51.090090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d1a7e-cbdc-44e1-87ca-43308b776638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:51.090497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca9591-4938-4041-a446-5a361a6cc723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:51.091115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca9591-4938-4041-a446-5a361a6cc723 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:51.092627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca9591-4938-4041-a446-5a361a6cc723 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:51.093230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca9591-4938-4041-a446-5a361a6cc723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:51.094665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9bca9591-4938-4041-a446-5a361a6cc723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:51.140473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a84d1a7e-cbdc-44e1-87ca-43308b776638 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:51.141977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a84d1a7e-cbdc-44e1-87ca-43308b776638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:51.218517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca9591-4938-4041-a446-5a361a6cc723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:51.219927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca9591-4938-4041-a446-5a361a6cc723 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:51.275923 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2648/5264] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:51.317113 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2617/5265] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:51.325785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4b517-d9f0-4274-9dd0-5617264f01ec None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:51.326080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4b517-d9f0-4274-9dd0-5617264f01ec None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:51.326360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b4b517-d9f0-4274-9dd0-5617264f01ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:51.392835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-44b4b517-d9f0-4274-9dd0-5617264f01ec None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:51.395447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-44b4b517-d9f0-4274-9dd0-5617264f01ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:51.422194 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2649/5266] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:51.425404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d1a7e-cbdc-44e1-87ca-43308b776638 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:51.438618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d1a7e-cbdc-44e1-87ca-43308b776638 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:51.451380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639b6b8-503f-4ce8-840d-ae6a79891016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:51.452014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639b6b8-503f-4ce8-840d-ae6a79891016 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:51.452299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639b6b8-503f-4ce8-840d-ae6a79891016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:51.452578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6639b6b8-503f-4ce8-840d-ae6a79891016 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:51.453238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639b6b8-503f-4ce8-840d-ae6a79891016 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:17:51.453579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639b6b8-503f-4ce8-840d-ae6a79891016 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:51.455201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6639b6b8-503f-4ce8-840d-ae6a79891016 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:51.487801 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2618/5267] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:17:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:17:51.492133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4b517-d9f0-4274-9dd0-5617264f01ec None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:51.513355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b4b517-d9f0-4274-9dd0-5617264f01ec None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:51.533030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adbd6f-05d0-44fa-a1d3-5d01269f4463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:51.533696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adbd6f-05d0-44fa-a1d3-5d01269f4463 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:51.533982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adbd6f-05d0-44fa-a1d3-5d01269f4463 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:51.534259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59adbd6f-05d0-44fa-a1d3-5d01269f4463 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:51.534916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adbd6f-05d0-44fa-a1d3-5d01269f4463 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:51.536837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59adbd6f-05d0-44fa-a1d3-5d01269f4463 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:51.617238 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2650/5268] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:51 2022] POST /identity/v3/projects => generated 381 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:51.617688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639b6b8-503f-4ce8-840d-ae6a79891016 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:51.637518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6639b6b8-503f-4ce8-840d-ae6a79891016 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:51.712508 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:51.758113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac2555-a0b8-42ea-85b8-4862ea4caf9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:51.758928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2555-a0b8-42ea-85b8-4862ea4caf9e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:51.759840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2555-a0b8-42ea-85b8-4862ea4caf9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:51.761532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ac2555-a0b8-42ea-85b8-4862ea4caf9e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:51.764379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac2555-a0b8-42ea-85b8-4862ea4caf9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:51.768354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ac2555-a0b8-42ea-85b8-4862ea4caf9e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:51.822550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adbd6f-05d0-44fa-a1d3-5d01269f4463 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:51.823063 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2619/5269] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:51 2022] POST /identity/v3/users => generated 291 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:51.841798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59adbd6f-05d0-44fa-a1d3-5d01269f4463 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:51.850809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652e5bb-7199-496d-8902-f80d7ccf964f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:51.851727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652e5bb-7199-496d-8902-f80d7ccf964f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:51.852257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652e5bb-7199-496d-8902-f80d7ccf964f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:51.853150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f652e5bb-7199-496d-8902-f80d7ccf964f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:51.853648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652e5bb-7199-496d-8902-f80d7ccf964f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:51.861239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f652e5bb-7199-496d-8902-f80d7ccf964f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:51.883514 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2651/5270] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:17:51.888504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac2555-a0b8-42ea-85b8-4862ea4caf9e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:51.902527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ac2555-a0b8-42ea-85b8-4862ea4caf9e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:51.908148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f98036-0dd5-4245-8337-c7a170e05315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:51.909771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f98036-0dd5-4245-8337-c7a170e05315 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:51.910061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f98036-0dd5-4245-8337-c7a170e05315 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:51.910337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f98036-0dd5-4245-8337-c7a170e05315 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:51.910982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f98036-0dd5-4245-8337-c7a170e05315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:51.912637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f98036-0dd5-4245-8337-c7a170e05315 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:51.929271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652e5bb-7199-496d-8902-f80d7ccf964f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:51.929782 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2620/5271] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:51.942613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f652e5bb-7199-496d-8902-f80d7ccf964f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:51.948008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30d456-13be-4a76-931f-0cd0377436bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:51.948802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30d456-13be-4a76-931f-0cd0377436bf admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:51.949335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30d456-13be-4a76-931f-0cd0377436bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:51.949725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca30d456-13be-4a76-931f-0cd0377436bf admin admin] PATH_INFO: `/v3/projects/fd8c1e75939f42e18367e36bf142e4fe/users/dbd1a6703b1e4eb3a94b48e60320bc23/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:51.971935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30d456-13be-4a76-931f-0cd0377436bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd8c1e75939f42e18367e36bf142e4fe, user_id=dbd1a6703b1e4eb3a94b48e60320bc23, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:51.990882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca30d456-13be-4a76-931f-0cd0377436bf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:52.046079 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2652/5272] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:51 2022] PUT /identity/v3/projects/fd8c1e75939f42e18367e36bf142e4fe/users/dbd1a6703b1e4eb3a94b48e60320bc23/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:52.057491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcada76-4206-45ac-b948-abe1280b661a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:52.058003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcada76-4206-45ac-b948-abe1280b661a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:52.058452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcada76-4206-45ac-b948-abe1280b661a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:52.136347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ebcada76-4206-45ac-b948-abe1280b661a None None] MFA Rules not processed for user `dbd1a6703b1e4eb3a94b48e60320bc23`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:52.138674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ebcada76-4206-45ac-b948-abe1280b661a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:52.294804 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2621/5273] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:52.306199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30d456-13be-4a76-931f-0cd0377436bf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:52.308440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ca30d456-13be-4a76-931f-0cd0377436bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:52.471764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca30d456-13be-4a76-931f-0cd0377436bf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:52.478069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a106bcd-a183-4475-96e2-85b306a40766 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:52.478703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a106bcd-a183-4475-96e2-85b306a40766 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:52.478981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a106bcd-a183-4475-96e2-85b306a40766 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:52.479251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a106bcd-a183-4475-96e2-85b306a40766 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:52.505357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a106bcd-a183-4475-96e2-85b306a40766 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:52.507003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a106bcd-a183-4475-96e2-85b306a40766 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:52.541393 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2653/5274] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:52 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:53.081909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcada76-4206-45ac-b948-abe1280b661a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:53.264503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcada76-4206-45ac-b948-abe1280b661a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:53.269672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:53.270766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:53.271040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:53.271318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] PATH_INFO: `/v3/users/dbd1a6703b1e4eb3a94b48e60320bc23` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:53.274141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbd1a6703b1e4eb3a94b48e60320bc23)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:53.276381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:53.385366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbd1a6703b1e4eb3a94b48e60320bc23'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:53.389883 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:53.414292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbd1a6703b1e4eb3a94b48e60320bc23'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:53.421032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbd1a6703b1e4eb3a94b48e60320bc23'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:53.442713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbd1a6703b1e4eb3a94b48e60320bc23'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:53.461033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbd1a6703b1e4eb3a94b48e60320bc23'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:53.495061 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2622/5275] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:17:53 2022] DELETE /identity/v3/users/dbd1a6703b1e4eb3a94b48e60320bc23 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:53.497140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef3379-4426-4788-9c28-07cd2c2a9da7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:53.498117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef3379-4426-4788-9c28-07cd2c2a9da7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:53.498358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef3379-4426-4788-9c28-07cd2c2a9da7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:53.561879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-acef3379-4426-4788-9c28-07cd2c2a9da7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:53.563833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-acef3379-4426-4788-9c28-07cd2c2a9da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:53.602011 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:53.779926 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2654/5276] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:53.885750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:53.887244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:54.069535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30fa627-c8fe-422f-9308-523255b76a96 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:54.081956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60e44d4-8929-471d-a7e9-3cf4ff043ee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:54.083346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e44d4-8929-471d-a7e9-3cf4ff043ee1 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:54.083765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e44d4-8929-471d-a7e9-3cf4ff043ee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:54.084262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60e44d4-8929-471d-a7e9-3cf4ff043ee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:54.102872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e44d4-8929-471d-a7e9-3cf4ff043ee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:54.105101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60e44d4-8929-471d-a7e9-3cf4ff043ee1 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:54.131170 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2623/5277] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:17:55.019307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef3379-4426-4788-9c28-07cd2c2a9da7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:55.021621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-acef3379-4426-4788-9c28-07cd2c2a9da7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:55.045825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef3379-4426-4788-9c28-07cd2c2a9da7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:55.058254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:55.059290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:55.060342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:55.060824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] PATH_INFO: `/v3/projects/fd8c1e75939f42e18367e36bf142e4fe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:55.062266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd8c1e75939f42e18367e36bf142e4fe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:55.070326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:55.222782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd8c1e75939f42e18367e36bf142e4fe', 'request_id': 'req-b08bb2dc-30ac-4910-9c78-ad61d7a09273'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:55.239308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd8c1e75939f42e18367e36bf142e4fe', 'request_id': 'req-b08bb2dc-30ac-4910-9c78-ad61d7a09273'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:55.250169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd8c1e75939f42e18367e36bf142e4fe', 'request_id': 'req-b08bb2dc-30ac-4910-9c78-ad61d7a09273'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:55.276207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] The token cache is being invalidate because project fd8c1e75939f42e18367e36bf142e4fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:17:55.276514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:55.277694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b08bb2dc-30ac-4910-9c78-ad61d7a09273 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:17:55.299147 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2655/5278] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:17:55 2022] DELETE /identity/v3/projects/fd8c1e75939f42e18367e36bf142e4fe => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:55.304098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b81aec-2ee7-4d94-961e-eebd5884465f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:55.304600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b81aec-2ee7-4d94-961e-eebd5884465f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:55.305077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b81aec-2ee7-4d94-961e-eebd5884465f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:55.370342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b8b81aec-2ee7-4d94-961e-eebd5884465f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:55.371645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b8b81aec-2ee7-4d94-961e-eebd5884465f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:55.610418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3320916-a7a1-4f23-92d7-1107e7b03591 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:55.611004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3320916-a7a1-4f23-92d7-1107e7b03591 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:55.611600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3320916-a7a1-4f23-92d7-1107e7b03591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:55.611769 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2624/5279] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:55.668911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c3320916-a7a1-4f23-92d7-1107e7b03591 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:55.670957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c3320916-a7a1-4f23-92d7-1107e7b03591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:55.687936 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2656/5280] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:17:55.691946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b81aec-2ee7-4d94-961e-eebd5884465f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:55.704526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b81aec-2ee7-4d94-961e-eebd5884465f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:55.710170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0f5cd-2ce2-46e8-a385-bf71b069264b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:55.710430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0f5cd-2ce2-46e8-a385-bf71b069264b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:55.711309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0f5cd-2ce2-46e8-a385-bf71b069264b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:55.711309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da0f5cd-2ce2-46e8-a385-bf71b069264b admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:55.711800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0f5cd-2ce2-46e8-a385-bf71b069264b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:17:55.712108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0f5cd-2ce2-46e8-a385-bf71b069264b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:55.713764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da0f5cd-2ce2-46e8-a385-bf71b069264b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:55.759117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3320916-a7a1-4f23-92d7-1107e7b03591 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:55.761240 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2625/5281] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:17:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:17:55.781788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3320916-a7a1-4f23-92d7-1107e7b03591 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:55.792850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f2c67-0cb6-416c-8624-cebdcff34b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:55.793088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f2c67-0cb6-416c-8624-cebdcff34b62 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:55.794689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f2c67-0cb6-416c-8624-cebdcff34b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:55.795046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9f2c67-0cb6-416c-8624-cebdcff34b62 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:55.796288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f2c67-0cb6-416c-8624-cebdcff34b62 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:55.798441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9f2c67-0cb6-416c-8624-cebdcff34b62 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:55.868447 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2657/5282] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:55 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:55.869442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0f5cd-2ce2-46e8-a385-bf71b069264b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:55.884483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da0f5cd-2ce2-46e8-a385-bf71b069264b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:56.021158 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:56.034915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc967bea-0403-4b20-9540-7ba778968925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:56.039002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967bea-0403-4b20-9540-7ba778968925 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:56.041288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967bea-0403-4b20-9540-7ba778968925 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:56.041630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc967bea-0403-4b20-9540-7ba778968925 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:56.043192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967bea-0403-4b20-9540-7ba778968925 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:56.049014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc967bea-0403-4b20-9540-7ba778968925 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:56.103797 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2626/5283] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:55 2022] POST /identity/v3/users => generated 283 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:56.105088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f2c67-0cb6-416c-8624-cebdcff34b62 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:56.124915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9f2c67-0cb6-416c-8624-cebdcff34b62 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:56.136337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1fe0b-bde8-4092-96a7-552d9e491016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:56.136979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1fe0b-bde8-4092-96a7-552d9e491016 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:56.137262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1fe0b-bde8-4092-96a7-552d9e491016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:56.138257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d1fe0b-bde8-4092-96a7-552d9e491016 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:56.138923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1fe0b-bde8-4092-96a7-552d9e491016 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:56.140611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d1fe0b-bde8-4092-96a7-552d9e491016 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:56.175502 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2658/5284] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:56.176700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc967bea-0403-4b20-9540-7ba778968925 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:56.191836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc967bea-0403-4b20-9540-7ba778968925 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:56.222838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0325e789-d13d-47f1-9f17-e80992ad02c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:56.223518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e789-d13d-47f1-9f17-e80992ad02c4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:56.223809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e789-d13d-47f1-9f17-e80992ad02c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:56.224077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0325e789-d13d-47f1-9f17-e80992ad02c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:56.224721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325e789-d13d-47f1-9f17-e80992ad02c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:56.226614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0325e789-d13d-47f1-9f17-e80992ad02c4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:56.249357 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2627/5285] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:56 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:56.253492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1fe0b-bde8-4092-96a7-552d9e491016 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:56.270564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d1fe0b-bde8-4092-96a7-552d9e491016 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:56.281240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bb4a1-3626-40e6-a039-ae559b551a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:56.282694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb4a1-3626-40e6-a039-ae559b551a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:56.284562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb4a1-3626-40e6-a039-ae559b551a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:56.286383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7bb4a1-3626-40e6-a039-ae559b551a67 admin admin] PATH_INFO: `/v3/projects/fbf74e6f853c424aa6e300e5313f4955/users/b1cebe67f3a64e2ba6c98dd998f15ad9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:56.329550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bb4a1-3626-40e6-a039-ae559b551a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbf74e6f853c424aa6e300e5313f4955, user_id=b1cebe67f3a64e2ba6c98dd998f15ad9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:56.336046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7bb4a1-3626-40e6-a039-ae559b551a67 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:56.364912 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2659/5286] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:56 2022] PUT /identity/v3/projects/fbf74e6f853c424aa6e300e5313f4955/users/b1cebe67f3a64e2ba6c98dd998f15ad9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:17:56.379165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bd5d0-2c7a-4e6d-b95e-02e7013486bf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:56.379654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bd5d0-2c7a-4e6d-b95e-02e7013486bf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:56.379729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bd5d0-2c7a-4e6d-b95e-02e7013486bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:56.439293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8a0bd5d0-2c7a-4e6d-b95e-02e7013486bf None None] MFA Rules not processed for user `b1cebe67f3a64e2ba6c98dd998f15ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:56.440601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8a0bd5d0-2c7a-4e6d-b95e-02e7013486bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:56.609588 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2628/5287] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:56.610796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bb4a1-3626-40e6-a039-ae559b551a67 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:56.689372 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:56.742656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7bb4a1-3626-40e6-a039-ae559b551a67 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:56.748700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67400283-8188-4770-8c93-48851cc5b04c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:56.750540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400283-8188-4770-8c93-48851cc5b04c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:56.750540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400283-8188-4770-8c93-48851cc5b04c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:56.750540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67400283-8188-4770-8c93-48851cc5b04c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:56.750778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67400283-8188-4770-8c93-48851cc5b04c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:56.752604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67400283-8188-4770-8c93-48851cc5b04c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:56.790496 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2660/5288] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:17:56 2022] POST /identity/v3/projects => generated 363 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:56.795142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bd5d0-2c7a-4e6d-b95e-02e7013486bf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:56.810453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bd5d0-2c7a-4e6d-b95e-02e7013486bf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:56.948959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5501-fe01-41c9-87e2-7d2fa30a8993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:56.951566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5501-fe01-41c9-87e2-7d2fa30a8993 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:56.952072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5501-fe01-41c9-87e2-7d2fa30a8993 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:56.952557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5b5501-fe01-41c9-87e2-7d2fa30a8993 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:56.953487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5501-fe01-41c9-87e2-7d2fa30a8993 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:56.960233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5b5501-fe01-41c9-87e2-7d2fa30a8993 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:56.997358 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2629/5289] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:17:56 2022] POST /identity/v3/users => generated 288 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:17:57.001498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67400283-8188-4770-8c93-48851cc5b04c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:57.021116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67400283-8188-4770-8c93-48851cc5b04c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:57.034131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d65de-b68d-4b28-a809-9f4b3907f0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:57.035813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d65de-b68d-4b28-a809-9f4b3907f0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:57.036307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d65de-b68d-4b28-a809-9f4b3907f0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:57.037197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895d65de-b68d-4b28-a809-9f4b3907f0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:57.038136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d65de-b68d-4b28-a809-9f4b3907f0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:57.043304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895d65de-b68d-4b28-a809-9f4b3907f0d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:57.068360 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2661/5290] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:57.068692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5501-fe01-41c9-87e2-7d2fa30a8993 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:57.087033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5b5501-fe01-41c9-87e2-7d2fa30a8993 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:57.095262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761167b6-239d-42a3-9929-25449f388cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:57.096570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761167b6-239d-42a3-9929-25449f388cc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:57.097376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761167b6-239d-42a3-9929-25449f388cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:57.097830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761167b6-239d-42a3-9929-25449f388cc7 admin admin] PATH_INFO: `/v3/projects/7c1493d10da54b12bcbfee895f4cb5c9/users/4405738cb7c7414dafa00f6754a3d948/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:57.124773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761167b6-239d-42a3-9929-25449f388cc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1493d10da54b12bcbfee895f4cb5c9, user_id=4405738cb7c7414dafa00f6754a3d948, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:57.128134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761167b6-239d-42a3-9929-25449f388cc7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:57.185355 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2630/5291] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:57 2022] PUT /identity/v3/projects/7c1493d10da54b12bcbfee895f4cb5c9/users/4405738cb7c7414dafa00f6754a3d948/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:57.186387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d65de-b68d-4b28-a809-9f4b3907f0d7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:57.209068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895d65de-b68d-4b28-a809-9f4b3907f0d7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:57.337513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a51b41c-f336-4457-8272-4138ccbe5475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:57.338403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51b41c-f336-4457-8272-4138ccbe5475 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:57.338842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51b41c-f336-4457-8272-4138ccbe5475 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:57.339297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a51b41c-f336-4457-8272-4138ccbe5475 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:57.340098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51b41c-f336-4457-8272-4138ccbe5475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:57.343339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a51b41c-f336-4457-8272-4138ccbe5475 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:57.370540 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2662/5292] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:17:57 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:17:57.374910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761167b6-239d-42a3-9929-25449f388cc7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:57.389230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761167b6-239d-42a3-9929-25449f388cc7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:57.396937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab7bb-aaa2-4afd-a2d2-df1b6642b2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:57.397996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab7bb-aaa2-4afd-a2d2-df1b6642b2d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:57.398437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab7bb-aaa2-4afd-a2d2-df1b6642b2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:57.398868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feab7bb-aaa2-4afd-a2d2-df1b6642b2d7 admin admin] PATH_INFO: `/v3/projects/7c1493d10da54b12bcbfee895f4cb5c9/users/4405738cb7c7414dafa00f6754a3d948/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:57.400969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feab7bb-aaa2-4afd-a2d2-df1b6642b2d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c1493d10da54b12bcbfee895f4cb5c9, user_id=4405738cb7c7414dafa00f6754a3d948, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:57.404887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5feab7bb-aaa2-4afd-a2d2-df1b6642b2d7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:57.420178 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2631/5293] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:17:57 2022] PUT /identity/v3/projects/7c1493d10da54b12bcbfee895f4cb5c9/users/4405738cb7c7414dafa00f6754a3d948/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:17:57.430582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01188c-cd69-44c8-8311-1d850a969a2f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:57.432028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01188c-cd69-44c8-8311-1d850a969a2f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:57.432477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01188c-cd69-44c8-8311-1d850a969a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:57.502750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dc01188c-cd69-44c8-8311-1d850a969a2f None None] MFA Rules not processed for user `4405738cb7c7414dafa00f6754a3d948`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:17:57.505375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc01188c-cd69-44c8-8311-1d850a969a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:57.640972 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2663/5294] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:17:57 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:17:57.669683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab7bb-aaa2-4afd-a2d2-df1b6642b2d7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:17:57.671419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5feab7bb-aaa2-4afd-a2d2-df1b6642b2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:17:57.714389 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:17:57.793199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feab7bb-aaa2-4afd-a2d2-df1b6642b2d7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:17:57.813470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915f56-698c-486f-b59f-4dee087d6951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:17:57.814178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915f56-698c-486f-b59f-4dee087d6951 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:17:57.814462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915f56-698c-486f-b59f-4dee087d6951 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:17:57.814741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12915f56-698c-486f-b59f-4dee087d6951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:17:57.848744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915f56-698c-486f-b59f-4dee087d6951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:17:57.850657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12915f56-698c-486f-b59f-4dee087d6951 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:17:57.871699 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2632/5295] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:17:57 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:00.964181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01188c-cd69-44c8-8311-1d850a969a2f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:00.977062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01188c-cd69-44c8-8311-1d850a969a2f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:00.981740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c03f16a-b143-4584-9fea-6883737ecf03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:00.983823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03f16a-b143-4584-9fea-6883737ecf03 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:00.984102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03f16a-b143-4584-9fea-6883737ecf03 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:00.985022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c03f16a-b143-4584-9fea-6883737ecf03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:01.051960 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:01.120971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03f16a-b143-4584-9fea-6883737ecf03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:01.122791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c03f16a-b143-4584-9fea-6883737ecf03 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:01.141238 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2664/5296] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:02.714283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915f56-698c-486f-b59f-4dee087d6951 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:02.822469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12915f56-698c-486f-b59f-4dee087d6951 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:02.829855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:02.830768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:02.831205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:02.831662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] PATH_INFO: `/v3/users/b1cebe67f3a64e2ba6c98dd998f15ad9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:02.833068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1cebe67f3a64e2ba6c98dd998f15ad9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:02.835527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:02.932434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1cebe67f3a64e2ba6c98dd998f15ad9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:02.954169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1cebe67f3a64e2ba6c98dd998f15ad9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:02.955168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1cebe67f3a64e2ba6c98dd998f15ad9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:02.967298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1cebe67f3a64e2ba6c98dd998f15ad9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:02.977515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1cebe67f3a64e2ba6c98dd998f15ad9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:02.986028 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2633/5297] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:18:02 2022] DELETE /identity/v3/users/b1cebe67f3a64e2ba6c98dd998f15ad9 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:18:02.990691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468dcc-bee3-4d82-805a-ef353e6c77a6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:02.991844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468dcc-bee3-4d82-805a-ef353e6c77a6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:02.992276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8468dcc-bee3-4d82-805a-ef353e6c77a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:03.020390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f8468dcc-bee3-4d82-805a-ef353e6c77a6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:03.022191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f8468dcc-bee3-4d82-805a-ef353e6c77a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:03.158517 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2665/5298] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:18:03.216240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:03.218179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:03.281689 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:03.306507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed894f-7745-4c64-9cab-9818d28bdaac admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:03.311253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6062c4-ab89-4836-8fd6-385331cd94ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:03.312112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6062c4-ab89-4836-8fd6-385331cd94ee service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:03.312540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6062c4-ab89-4836-8fd6-385331cd94ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:03.313125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6062c4-ab89-4836-8fd6-385331cd94ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:03.342324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6062c4-ab89-4836-8fd6-385331cd94ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:03.344854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6062c4-ab89-4836-8fd6-385331cd94ee service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:03.376988 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2634/5299] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:04.461724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468dcc-bee3-4d82-805a-ef353e6c77a6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:04.463248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f8468dcc-bee3-4d82-805a-ef353e6c77a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:04.481930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8468dcc-bee3-4d82-805a-ef353e6c77a6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:04.493058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:04.494407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:04.495028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:04.533902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] PATH_INFO: `/v3/projects/fbf74e6f853c424aa6e300e5313f4955` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:04.536934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbf74e6f853c424aa6e300e5313f4955)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:04.555197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:04.639922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbf74e6f853c424aa6e300e5313f4955', 'request_id': 'req-e3c63859-7c31-4d26-a366-fc9275d899a9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.650621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbf74e6f853c424aa6e300e5313f4955', 'request_id': 'req-e3c63859-7c31-4d26-a366-fc9275d899a9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.659404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbf74e6f853c424aa6e300e5313f4955', 'request_id': 'req-e3c63859-7c31-4d26-a366-fc9275d899a9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.672802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] The token cache is being invalidate because project fbf74e6f853c424aa6e300e5313f4955 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:18:04.673925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.675098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.682725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6062c4-ab89-4836-8fd6-385331cd94ee service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:04.683530 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2666/5300] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:18:04 2022] DELETE /identity/v3/projects/fbf74e6f853c424aa6e300e5313f4955 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:04.696747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6062c4-ab89-4836-8fd6-385331cd94ee service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:04.770126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:04.770938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:04.771336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:04.771708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] PATH_INFO: `/v3/users/4405738cb7c7414dafa00f6754a3d948` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:04.773682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4405738cb7c7414dafa00f6754a3d948)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:04.776463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:04.864144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4405738cb7c7414dafa00f6754a3d948'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.885642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4405738cb7c7414dafa00f6754a3d948'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.886412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4405738cb7c7414dafa00f6754a3d948'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.902460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4405738cb7c7414dafa00f6754a3d948'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.913927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2e268ca-b1f0-4bee-ae37-324119ddfbf8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4405738cb7c7414dafa00f6754a3d948'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:04.925373 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2635/5301] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:18:04 2022] DELETE /identity/v3/users/4405738cb7c7414dafa00f6754a3d948 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:18:05.453768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:05.456329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:05.475872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c63859-7c31-4d26-a366-fc9275d899a9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:05.546179 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:05.559851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:05.560514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:05.562390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:05.562797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] PATH_INFO: `/v3/projects/7c1493d10da54b12bcbfee895f4cb5c9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:05.564204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c1493d10da54b12bcbfee895f4cb5c9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:05.566211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:05.633725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c1493d10da54b12bcbfee895f4cb5c9', 'request_id': 'req-43626b79-22f5-416b-9d30-4d13ab6de9a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:05.634933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c1493d10da54b12bcbfee895f4cb5c9', 'request_id': 'req-43626b79-22f5-416b-9d30-4d13ab6de9a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:05.644608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c1493d10da54b12bcbfee895f4cb5c9', 'request_id': 'req-43626b79-22f5-416b-9d30-4d13ab6de9a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:05.656578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] The token cache is being invalidate because project 7c1493d10da54b12bcbfee895f4cb5c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:18:05.656926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:05.657634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-43626b79-22f5-416b-9d30-4d13ab6de9a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:05.659157 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2667/5302] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:18:05 2022] DELETE /identity/v3/projects/7c1493d10da54b12bcbfee895f4cb5c9 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:05.664041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e58f-6da7-486a-8069-b1e1f430c01d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:05.664334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e58f-6da7-486a-8069-b1e1f430c01d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:05.664605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e58f-6da7-486a-8069-b1e1f430c01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:05.701980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6ac3e58f-6da7-486a-8069-b1e1f430c01d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:05.703407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6ac3e58f-6da7-486a-8069-b1e1f430c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:05.794028 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2636/5303] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:05.802022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e74d40-c3d2-4b30-98e8-3b2db71b30f4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:05.802556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e74d40-c3d2-4b30-98e8-3b2db71b30f4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:05.802893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e74d40-c3d2-4b30-98e8-3b2db71b30f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:05.827917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-96e74d40-c3d2-4b30-98e8-3b2db71b30f4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:05.830118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-96e74d40-c3d2-4b30-98e8-3b2db71b30f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:05.840373 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2668/5304] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:05.845170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3e58f-6da7-486a-8069-b1e1f430c01d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:05.850419 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:05.858451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3e58f-6da7-486a-8069-b1e1f430c01d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:05.868277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0096d8-e2de-4eb5-afb5-a8b9ca29eb60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:05.869245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0096d8-e2de-4eb5-afb5-a8b9ca29eb60 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:05.869792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0096d8-e2de-4eb5-afb5-a8b9ca29eb60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:05.870283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0096d8-e2de-4eb5-afb5-a8b9ca29eb60 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:05.871121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0096d8-e2de-4eb5-afb5-a8b9ca29eb60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:18:05.871613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0096d8-e2de-4eb5-afb5-a8b9ca29eb60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:05.874373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0096d8-e2de-4eb5-afb5-a8b9ca29eb60 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:05.891515 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2637/5305] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:18:05.893174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e74d40-c3d2-4b30-98e8-3b2db71b30f4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:05.903758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e74d40-c3d2-4b30-98e8-3b2db71b30f4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:05.911074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675134d-e3f3-427c-b826-815e44e9306c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:05.911958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675134d-e3f3-427c-b826-815e44e9306c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:05.912417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675134d-e3f3-427c-b826-815e44e9306c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:05.912865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e675134d-e3f3-427c-b826-815e44e9306c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:05.913726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675134d-e3f3-427c-b826-815e44e9306c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:05.916455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e675134d-e3f3-427c-b826-815e44e9306c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:05.953605 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2669/5306] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:18:05 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:18:05.955374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0096d8-e2de-4eb5-afb5-a8b9ca29eb60 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:05.967004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0096d8-e2de-4eb5-afb5-a8b9ca29eb60 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:06.030124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0968f-b36b-40b9-b449-0b203a5b51ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:06.031105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0968f-b36b-40b9-b449-0b203a5b51ba admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:06.031593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0968f-b36b-40b9-b449-0b203a5b51ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:06.032122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb0968f-b36b-40b9-b449-0b203a5b51ba admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:06.032991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0968f-b36b-40b9-b449-0b203a5b51ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:06.035160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb0968f-b36b-40b9-b449-0b203a5b51ba admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:06.072699 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2638/5307] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:18:05 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:18:06.076610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675134d-e3f3-427c-b826-815e44e9306c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:06.092213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e675134d-e3f3-427c-b826-815e44e9306c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:06.098948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432274e-1b2f-4f9d-a597-6cd5aac88994 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:06.099831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432274e-1b2f-4f9d-a597-6cd5aac88994 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:06.100545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432274e-1b2f-4f9d-a597-6cd5aac88994 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:06.101155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6432274e-1b2f-4f9d-a597-6cd5aac88994 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:06.102106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432274e-1b2f-4f9d-a597-6cd5aac88994 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:06.103934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6432274e-1b2f-4f9d-a597-6cd5aac88994 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:06.122478 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2670/5308] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:06.125681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0968f-b36b-40b9-b449-0b203a5b51ba admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:06.140059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb0968f-b36b-40b9-b449-0b203a5b51ba admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:06.156511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676401dc-74a0-482f-9337-829d4a43765a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:06.157363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676401dc-74a0-482f-9337-829d4a43765a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:06.157795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676401dc-74a0-482f-9337-829d4a43765a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:06.158311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676401dc-74a0-482f-9337-829d4a43765a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:06.159108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676401dc-74a0-482f-9337-829d4a43765a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:06.161128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676401dc-74a0-482f-9337-829d4a43765a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:06.178205 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2639/5309] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:06.180653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432274e-1b2f-4f9d-a597-6cd5aac88994 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:06.191823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6432274e-1b2f-4f9d-a597-6cd5aac88994 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:06.198435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc600f-fd90-4e6a-96e7-63f52b2a42f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:06.199403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc600f-fd90-4e6a-96e7-63f52b2a42f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:06.199865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc600f-fd90-4e6a-96e7-63f52b2a42f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:06.200245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc600f-fd90-4e6a-96e7-63f52b2a42f7 admin admin] PATH_INFO: `/v3/projects/ce24a76f4f424dd4b3353217bcec9179/users/fdf38994494c44fa945b4759f6e2105c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:06.220538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc600f-fd90-4e6a-96e7-63f52b2a42f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce24a76f4f424dd4b3353217bcec9179, user_id=fdf38994494c44fa945b4759f6e2105c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:06.223530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc600f-fd90-4e6a-96e7-63f52b2a42f7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:06.269275 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2671/5310] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:18:06 2022] PUT /identity/v3/projects/ce24a76f4f424dd4b3353217bcec9179/users/fdf38994494c44fa945b4759f6e2105c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:06.274114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591e9f4-098f-4fcb-bf21-65d36a7f8517 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:06.274570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591e9f4-098f-4fcb-bf21-65d36a7f8517 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:06.274964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5591e9f4-098f-4fcb-bf21-65d36a7f8517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:06.319157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5591e9f4-098f-4fcb-bf21-65d36a7f8517 None None] MFA Rules not processed for user `fdf38994494c44fa945b4759f6e2105c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:06.320691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5591e9f4-098f-4fcb-bf21-65d36a7f8517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:06.429277 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2640/5311] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:06.437483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc600f-fd90-4e6a-96e7-63f52b2a42f7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:06.440421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-badc600f-fd90-4e6a-96e7-63f52b2a42f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:06.549761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc600f-fd90-4e6a-96e7-63f52b2a42f7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:06.554235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c302c4d5-625b-49a5-9f7b-3034a0b6bfc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:06.555001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302c4d5-625b-49a5-9f7b-3034a0b6bfc0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:06.555470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302c4d5-625b-49a5-9f7b-3034a0b6bfc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:06.555843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c302c4d5-625b-49a5-9f7b-3034a0b6bfc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:06.568872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302c4d5-625b-49a5-9f7b-3034a0b6bfc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:06.570324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c302c4d5-625b-49a5-9f7b-3034a0b6bfc0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:06.580912 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2672/5312] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:06 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:07.268596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591e9f4-098f-4fcb-bf21-65d36a7f8517 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:07.345153 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:07.349696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5591e9f4-098f-4fcb-bf21-65d36a7f8517 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:07.355351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:07.356154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:07.356508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:07.357381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] PATH_INFO: `/v3/users/fdf38994494c44fa945b4759f6e2105c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:07.360721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fdf38994494c44fa945b4759f6e2105c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:07.361106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:07.414946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fdf38994494c44fa945b4759f6e2105c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:07.429828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fdf38994494c44fa945b4759f6e2105c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:07.430479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fdf38994494c44fa945b4759f6e2105c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:07.439849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fdf38994494c44fa945b4759f6e2105c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:07.448155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fdf38994494c44fa945b4759f6e2105c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:07.455302 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2641/5313] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:18:07 2022] DELETE /identity/v3/users/fdf38994494c44fa945b4759f6e2105c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:07.459831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe449ed7-3025-4239-9a22-a58ba89180ac None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:07.460122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe449ed7-3025-4239-9a22-a58ba89180ac None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:07.460404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe449ed7-3025-4239-9a22-a58ba89180ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:07.480330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fe449ed7-3025-4239-9a22-a58ba89180ac None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:07.481950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fe449ed7-3025-4239-9a22-a58ba89180ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:07.498377 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:07.553939 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2673/5314] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:07.565237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:07.566755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:07.659117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f9cd37-72d4-45cb-8922-f63850299a0d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:07.663919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59d3112-998c-41fa-9eb2-702beea523fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:07.664831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d3112-998c-41fa-9eb2-702beea523fc service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:07.665349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d3112-998c-41fa-9eb2-702beea523fc service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:07.665946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59d3112-998c-41fa-9eb2-702beea523fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:07.681414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d3112-998c-41fa-9eb2-702beea523fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:07.683319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59d3112-998c-41fa-9eb2-702beea523fc service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:07.703343 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2642/5315] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:08.139434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe449ed7-3025-4239-9a22-a58ba89180ac None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:08.141031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fe449ed7-3025-4239-9a22-a58ba89180ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:08.155971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe449ed7-3025-4239-9a22-a58ba89180ac None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:08.162023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:08.163338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.163841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.164334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] PATH_INFO: `/v3/projects/ce24a76f4f424dd4b3353217bcec9179` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.166059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce24a76f4f424dd4b3353217bcec9179)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:08.172092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:08.249221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce24a76f4f424dd4b3353217bcec9179', 'request_id': 'req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:08.260720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce24a76f4f424dd4b3353217bcec9179', 'request_id': 'req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:08.269517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce24a76f4f424dd4b3353217bcec9179', 'request_id': 'req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:08.292253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] The token cache is being invalidate because project ce24a76f4f424dd4b3353217bcec9179 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:18:08.292657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:08.293445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0e78d6a8-a7c9-4311-8a42-6cc05e4dd226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:08.295650 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2674/5316] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:18:08 2022] DELETE /identity/v3/projects/ce24a76f4f424dd4b3353217bcec9179 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:08.300859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0447154-6da3-4fb4-9069-70e162ba98d8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.301393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0447154-6da3-4fb4-9069-70e162ba98d8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.301655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0447154-6da3-4fb4-9069-70e162ba98d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.338811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d0447154-6da3-4fb4-9069-70e162ba98d8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:08.341138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d0447154-6da3-4fb4-9069-70e162ba98d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:08.410462 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2643/5317] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:08.418153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165791c-2469-48f1-b7b5-8dc858d8c997 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.418447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165791c-2469-48f1-b7b5-8dc858d8c997 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.418761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165791c-2469-48f1-b7b5-8dc858d8c997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.440709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a165791c-2469-48f1-b7b5-8dc858d8c997 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:08.442401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a165791c-2469-48f1-b7b5-8dc858d8c997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:08.455412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2675/5318] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:08.456596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0447154-6da3-4fb4-9069-70e162ba98d8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:08.467081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0447154-6da3-4fb4-9069-70e162ba98d8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:08.471930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db7de0-1c74-48de-a6e1-baae14c72faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:08.472535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db7de0-1c74-48de-a6e1-baae14c72faf admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.472814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db7de0-1c74-48de-a6e1-baae14c72faf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.473463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db7de0-1c74-48de-a6e1-baae14c72faf admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.474394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db7de0-1c74-48de-a6e1-baae14c72faf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:18:08.474699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db7de0-1c74-48de-a6e1-baae14c72faf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:08.476414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db7de0-1c74-48de-a6e1-baae14c72faf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:08.493075 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2644/5319] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:18:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:18:08.494241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165791c-2469-48f1-b7b5-8dc858d8c997 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:08.504626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165791c-2469-48f1-b7b5-8dc858d8c997 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:08.509660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be3597-d14c-485b-ad17-31bda9655e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:08.510630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be3597-d14c-485b-ad17-31bda9655e1f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.511078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be3597-d14c-485b-ad17-31bda9655e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.511597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82be3597-d14c-485b-ad17-31bda9655e1f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.512453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be3597-d14c-485b-ad17-31bda9655e1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:08.514655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82be3597-d14c-485b-ad17-31bda9655e1f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:08.547923 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2676/5320] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:18:08 2022] POST /identity/v3/projects => generated 355 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:18:08.552229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db7de0-1c74-48de-a6e1-baae14c72faf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:08.564560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db7de0-1c74-48de-a6e1-baae14c72faf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:08.568647 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:08.635606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0b823-8041-4106-ae2b-e3c22c188e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:08.636219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0b823-8041-4106-ae2b-e3c22c188e99 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.636502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0b823-8041-4106-ae2b-e3c22c188e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.636778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0b823-8041-4106-ae2b-e3c22c188e99 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.637474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0b823-8041-4106-ae2b-e3c22c188e99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:08.639384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0b823-8041-4106-ae2b-e3c22c188e99 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:08.664160 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2645/5321] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:18:08 2022] POST /identity/v3/users => generated 278 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:18:08.665408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be3597-d14c-485b-ad17-31bda9655e1f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:08.676660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82be3597-d14c-485b-ad17-31bda9655e1f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:08.682549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2122ba-0775-4722-86ce-95c6857dde3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:08.683247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2122ba-0775-4722-86ce-95c6857dde3e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.683637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2122ba-0775-4722-86ce-95c6857dde3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.683982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2122ba-0775-4722-86ce-95c6857dde3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.685484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2122ba-0775-4722-86ce-95c6857dde3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:08.687367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2122ba-0775-4722-86ce-95c6857dde3e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:08.699447 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2677/5322] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:08.703847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0b823-8041-4106-ae2b-e3c22c188e99 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:08.714160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0b823-8041-4106-ae2b-e3c22c188e99 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:08.719457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d5259-9807-4673-8327-5c4a18f36453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:08.720071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d5259-9807-4673-8327-5c4a18f36453 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.720489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d5259-9807-4673-8327-5c4a18f36453 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.720770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d5259-9807-4673-8327-5c4a18f36453 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.721445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d5259-9807-4673-8327-5c4a18f36453 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:08.723072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d5259-9807-4673-8327-5c4a18f36453 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:08.739500 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2646/5323] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:08.741076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2122ba-0775-4722-86ce-95c6857dde3e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:08.753058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2122ba-0775-4722-86ce-95c6857dde3e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:08.758368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa32b-056f-4601-9a6b-0399f2efa8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:08.759111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa32b-056f-4601-9a6b-0399f2efa8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.759475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa32b-056f-4601-9a6b-0399f2efa8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.759822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339fa32b-056f-4601-9a6b-0399f2efa8bb admin admin] PATH_INFO: `/v3/projects/43d8819784434244b443fd470cd92a99/users/7c696f48cda74b0289dd451598d3216d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.774827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fa32b-056f-4601-9a6b-0399f2efa8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d8819784434244b443fd470cd92a99, user_id=7c696f48cda74b0289dd451598d3216d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:08.777535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339fa32b-056f-4601-9a6b-0399f2efa8bb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:08.792028 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2678/5324] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:18:08 2022] PUT /identity/v3/projects/43d8819784434244b443fd470cd92a99/users/7c696f48cda74b0289dd451598d3216d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:08.804740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12af0-7d28-48da-98b1-44cc8574e78f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:08.804912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12af0-7d28-48da-98b1-44cc8574e78f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:08.805223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c12af0-7d28-48da-98b1-44cc8574e78f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:08.836845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-25c12af0-7d28-48da-98b1-44cc8574e78f None None] MFA Rules not processed for user `7c696f48cda74b0289dd451598d3216d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:08.838146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-25c12af0-7d28-48da-98b1-44cc8574e78f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:08.920529 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2647/5325] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:08 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:08.927353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa32b-056f-4601-9a6b-0399f2efa8bb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:08.929088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-339fa32b-056f-4601-9a6b-0399f2efa8bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:08.988439 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:09.009088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339fa32b-056f-4601-9a6b-0399f2efa8bb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:09.016081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe6ad2-fd0d-4d9a-9ba9-3302aa118327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:09.017119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe6ad2-fd0d-4d9a-9ba9-3302aa118327 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:09.017542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe6ad2-fd0d-4d9a-9ba9-3302aa118327 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:09.018279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafe6ad2-fd0d-4d9a-9ba9-3302aa118327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:09.029122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe6ad2-fd0d-4d9a-9ba9-3302aa118327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:09.031391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafe6ad2-fd0d-4d9a-9ba9-3302aa118327 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:09.054876 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2679/5326] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:18.917098 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=63,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:19.038044 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:21.933651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae213d2b-90b8-4204-8687-e32d275797f0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:21.936519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae213d2b-90b8-4204-8687-e32d275797f0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:21.936803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae213d2b-90b8-4204-8687-e32d275797f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:21.998364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ae213d2b-90b8-4204-8687-e32d275797f0 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:22.007984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ae213d2b-90b8-4204-8687-e32d275797f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:22.140713 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2648/5327] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:18:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:22.169442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe6ad2-fd0d-4d9a-9ba9-3302aa118327 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:22.171301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aafe6ad2-fd0d-4d9a-9ba9-3302aa118327 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:22.326140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafe6ad2-fd0d-4d9a-9ba9-3302aa118327 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:22.332934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5223bac6-4e01-44e3-a958-95b6a701b519 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:22.333591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223bac6-4e01-44e3-a958-95b6a701b519 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:22.333875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223bac6-4e01-44e3-a958-95b6a701b519 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:22.334149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5223bac6-4e01-44e3-a958-95b6a701b519 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:22.352829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223bac6-4e01-44e3-a958-95b6a701b519 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:22.354785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5223bac6-4e01-44e3-a958-95b6a701b519 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:22.375988 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2680/5328] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:18:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:30.868015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae213d2b-90b8-4204-8687-e32d275797f0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:30.870023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ae213d2b-90b8-4204-8687-e32d275797f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:31.224268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae213d2b-90b8-4204-8687-e32d275797f0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:31.249422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:31.258029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:31.258984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:31.259207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] PATH_INFO: `/v3/users/fbb0eb733f7443399dda4149fffc7042` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:31.267210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbb0eb733f7443399dda4149fffc7042)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:31.277250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:31.533162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbb0eb733f7443399dda4149fffc7042'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:31.602220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbb0eb733f7443399dda4149fffc7042'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:31.602990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbb0eb733f7443399dda4149fffc7042'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:31.634889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbb0eb733f7443399dda4149fffc7042'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:31.682407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbb0eb733f7443399dda4149fffc7042'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:31.708454 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2649/5329] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:18:30 2022] DELETE /identity/v3/users/fbb0eb733f7443399dda4149fffc7042 => generated 0 bytes in 842 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:31.712885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e255a-fa14-4687-b5de-51fb43d48734 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:31.713499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e255a-fa14-4687-b5de-51fb43d48734 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:31.713499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15e255a-fa14-4687-b5de-51fb43d48734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:31.770436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f15e255a-fa14-4687-b5de-51fb43d48734 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:31.774063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f15e255a-fa14-4687-b5de-51fb43d48734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:32.038150 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2681/5330] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:32.095751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:32.098759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:32.140523 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:32.295396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb2ee55-9cc0-49c8-93af-90cd8ba127b0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:32.314717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c352cd-0a28-40f6-b6a8-6b62410ca099 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:32.315350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c352cd-0a28-40f6-b6a8-6b62410ca099 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:32.315622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c352cd-0a28-40f6-b6a8-6b62410ca099 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:32.323046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c352cd-0a28-40f6-b6a8-6b62410ca099 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:32.391204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c352cd-0a28-40f6-b6a8-6b62410ca099 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:32.400509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c352cd-0a28-40f6-b6a8-6b62410ca099 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:32.472106 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2650/5331] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:33.580984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e255a-fa14-4687-b5de-51fb43d48734 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:33.583793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f15e255a-fa14-4687-b5de-51fb43d48734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:33.601353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15e255a-fa14-4687-b5de-51fb43d48734 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:33.629047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:33.629963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:33.630405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:33.631270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] PATH_INFO: `/v3/projects/68d5c998dfc84f7095ffa41bcee90a7c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:33.634042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68d5c998dfc84f7095ffa41bcee90a7c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:33.636209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:33.774249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68d5c998dfc84f7095ffa41bcee90a7c', 'request_id': 'req-af359512-f90b-4187-819f-07b913ab0fd6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:33.810462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68d5c998dfc84f7095ffa41bcee90a7c', 'request_id': 'req-af359512-f90b-4187-819f-07b913ab0fd6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:33.832034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68d5c998dfc84f7095ffa41bcee90a7c', 'request_id': 'req-af359512-f90b-4187-819f-07b913ab0fd6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:33.886093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] The token cache is being invalidate because project 68d5c998dfc84f7095ffa41bcee90a7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:18:33.886482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:33.887949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af359512-f90b-4187-819f-07b913ab0fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:33.901945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2682/5332] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:18:33 2022] DELETE /identity/v3/projects/68d5c998dfc84f7095ffa41bcee90a7c => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:33.904550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a89ed2-92b8-4913-874b-ee5c01c14bc9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:33.906770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a89ed2-92b8-4913-874b-ee5c01c14bc9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:33.906770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a89ed2-92b8-4913-874b-ee5c01c14bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:33.997569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f3a89ed2-92b8-4913-874b-ee5c01c14bc9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:33.998843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f3a89ed2-92b8-4913-874b-ee5c01c14bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:34.369090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc22cb-2952-4db5-9ffe-4ebe5b5f4642 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:34.369399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc22cb-2952-4db5-9ffe-4ebe5b5f4642 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:34.369680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbc22cb-2952-4db5-9ffe-4ebe5b5f4642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:34.376542 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2651/5333] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 473 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:34.435162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ffbc22cb-2952-4db5-9ffe-4ebe5b5f4642 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:34.436411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ffbc22cb-2952-4db5-9ffe-4ebe5b5f4642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:34.479842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a89ed2-92b8-4913-874b-ee5c01c14bc9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:34.482653 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2683/5334] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:18:34.495154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a89ed2-92b8-4913-874b-ee5c01c14bc9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:34.522122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da41a3-9fe8-4def-9bb3-ef4d5e54ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:34.525619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da41a3-9fe8-4def-9bb3-ef4d5e54ad07 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:34.525905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da41a3-9fe8-4def-9bb3-ef4d5e54ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:34.526184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8da41a3-9fe8-4def-9bb3-ef4d5e54ad07 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:34.526877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da41a3-9fe8-4def-9bb3-ef4d5e54ad07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:18:34.530654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da41a3-9fe8-4def-9bb3-ef4d5e54ad07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:34.540072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8da41a3-9fe8-4def-9bb3-ef4d5e54ad07 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:34.647161 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2652/5335] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:18:34.648472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc22cb-2952-4db5-9ffe-4ebe5b5f4642 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:34.659531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbc22cb-2952-4db5-9ffe-4ebe5b5f4642 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:34.702316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3351a-80ab-49e9-be7d-03eb5fb4eef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:34.703041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3351a-80ab-49e9-be7d-03eb5fb4eef6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:34.703368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3351a-80ab-49e9-be7d-03eb5fb4eef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:34.703816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca3351a-80ab-49e9-be7d-03eb5fb4eef6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:34.704738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3351a-80ab-49e9-be7d-03eb5fb4eef6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:34.717038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca3351a-80ab-49e9-be7d-03eb5fb4eef6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:34.747144 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:34.817613 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2684/5336] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:18:34 2022] POST /identity/v3/projects => generated 373 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:18:34.821988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da41a3-9fe8-4def-9bb3-ef4d5e54ad07 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:34.846024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8da41a3-9fe8-4def-9bb3-ef4d5e54ad07 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:35.157208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b64832-c50c-4edd-a0b0-15280a937002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:35.160278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b64832-c50c-4edd-a0b0-15280a937002 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:35.160658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b64832-c50c-4edd-a0b0-15280a937002 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:35.160941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b64832-c50c-4edd-a0b0-15280a937002 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:35.161647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b64832-c50c-4edd-a0b0-15280a937002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:35.166927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b64832-c50c-4edd-a0b0-15280a937002 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:35.228660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3351a-80ab-49e9-be7d-03eb5fb4eef6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:35.232443 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2653/5337] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:18:34 2022] POST /identity/v3/users => generated 287 bytes in 411 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:18:35.261344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca3351a-80ab-49e9-be7d-03eb5fb4eef6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:35.276292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6193-14ae-4f9f-8f07-915af19b15b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:35.276921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6193-14ae-4f9f-8f07-915af19b15b4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:35.277235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6193-14ae-4f9f-8f07-915af19b15b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:35.277539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d6193-14ae-4f9f-8f07-915af19b15b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:35.278207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d6193-14ae-4f9f-8f07-915af19b15b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:35.279817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0d6193-14ae-4f9f-8f07-915af19b15b4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:35.305333 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2685/5338] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:35.309037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b64832-c50c-4edd-a0b0-15280a937002 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:35.336121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b64832-c50c-4edd-a0b0-15280a937002 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:35.358952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54534bbe-89e9-436e-b39f-a2409fb1d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:35.359580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534bbe-89e9-436e-b39f-a2409fb1d0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:35.359862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534bbe-89e9-436e-b39f-a2409fb1d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:35.360146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54534bbe-89e9-436e-b39f-a2409fb1d0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:35.360793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534bbe-89e9-436e-b39f-a2409fb1d0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:35.362408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54534bbe-89e9-436e-b39f-a2409fb1d0f4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:35.419397 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2654/5339] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:35.424174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6193-14ae-4f9f-8f07-915af19b15b4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:35.439596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d6193-14ae-4f9f-8f07-915af19b15b4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:35.458401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d6923-a683-466e-9a87-bcddbc70b323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:35.461438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d6923-a683-466e-9a87-bcddbc70b323 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:35.462114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d6923-a683-466e-9a87-bcddbc70b323 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:35.464436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999d6923-a683-466e-9a87-bcddbc70b323 admin admin] PATH_INFO: `/v3/projects/dae6f622309143418b522083641a3c28/users/c1d351e5c407405290c125ab9dfe61be/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:35.512979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d6923-a683-466e-9a87-bcddbc70b323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dae6f622309143418b522083641a3c28, user_id=c1d351e5c407405290c125ab9dfe61be, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:35.516912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999d6923-a683-466e-9a87-bcddbc70b323 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:35.553582 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2686/5340] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:18:35 2022] PUT /identity/v3/projects/dae6f622309143418b522083641a3c28/users/c1d351e5c407405290c125ab9dfe61be/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:35.569142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42a308-8718-429a-b568-0074a81be47f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:35.569938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42a308-8718-429a-b568-0074a81be47f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:35.570658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b42a308-8718-429a-b568-0074a81be47f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:35.664026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5b42a308-8718-429a-b568-0074a81be47f None None] MFA Rules not processed for user `c1d351e5c407405290c125ab9dfe61be`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:35.665783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5b42a308-8718-429a-b568-0074a81be47f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:35.749472 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:35.901432 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2655/5341] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:35.909909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d6923-a683-466e-9a87-bcddbc70b323 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:35.911648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-999d6923-a683-466e-9a87-bcddbc70b323 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:36.178637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999d6923-a683-466e-9a87-bcddbc70b323 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:36.188656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed95d04f-b2c5-4eec-abf3-e8bd08103cfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:36.190542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d04f-b2c5-4eec-abf3-e8bd08103cfd service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:36.193947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d04f-b2c5-4eec-abf3-e8bd08103cfd service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:36.195748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed95d04f-b2c5-4eec-abf3-e8bd08103cfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:36.219546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d04f-b2c5-4eec-abf3-e8bd08103cfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:36.221564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed95d04f-b2c5-4eec-abf3-e8bd08103cfd service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:36.259301 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2687/5342] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:36.293758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42a308-8718-429a-b568-0074a81be47f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:36.518602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b42a308-8718-429a-b568-0074a81be47f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:36.530106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:36.530763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:36.531047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:36.531387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] PATH_INFO: `/v3/users/c1d351e5c407405290c125ab9dfe61be` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:36.533721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1d351e5c407405290c125ab9dfe61be)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:36.535662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:36.642296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1d351e5c407405290c125ab9dfe61be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:36.670102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1d351e5c407405290c125ab9dfe61be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:36.671006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1d351e5c407405290c125ab9dfe61be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:36.688665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1d351e5c407405290c125ab9dfe61be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:36.697901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1d351e5c407405290c125ab9dfe61be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:36.728748 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2656/5343] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:18:36 2022] DELETE /identity/v3/users/c1d351e5c407405290c125ab9dfe61be => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:36.733713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1d2b0-55fb-49f6-8a91-ce363bd4586b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:36.734077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1d2b0-55fb-49f6-8a91-ce363bd4586b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:36.734358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1d2b0-55fb-49f6-8a91-ce363bd4586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:36.782317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-48b1d2b0-55fb-49f6-8a91-ce363bd4586b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:36.783486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48b1d2b0-55fb-49f6-8a91-ce363bd4586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:36.927653 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2688/5344] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:36.938756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:36.940618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:36.998177 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:37.016638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98356a2-ac34-45f5-ae41-0fd442f71963 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:37.021925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82b1e32-49a5-4275-88e9-a12633964ad0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:37.023348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b1e32-49a5-4275-88e9-a12633964ad0 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:37.023949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b1e32-49a5-4275-88e9-a12633964ad0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:37.024517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82b1e32-49a5-4275-88e9-a12633964ad0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:37.063087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b1e32-49a5-4275-88e9-a12633964ad0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:37.065045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82b1e32-49a5-4275-88e9-a12633964ad0 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:37.100200 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2657/5345] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:37.663911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1d2b0-55fb-49f6-8a91-ce363bd4586b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:37.665731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48b1d2b0-55fb-49f6-8a91-ce363bd4586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:37.704333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1d2b0-55fb-49f6-8a91-ce363bd4586b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:37.713416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:37.715539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:37.717083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:37.717684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] PATH_INFO: `/v3/projects/dae6f622309143418b522083641a3c28` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:37.719832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dae6f622309143418b522083641a3c28)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:37.722084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:37.852577 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:37.886099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dae6f622309143418b522083641a3c28', 'request_id': 'req-9c932a2d-837d-4081-84ef-c8a513300ec4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:37.909890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dae6f622309143418b522083641a3c28', 'request_id': 'req-9c932a2d-837d-4081-84ef-c8a513300ec4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:37.921168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dae6f622309143418b522083641a3c28', 'request_id': 'req-9c932a2d-837d-4081-84ef-c8a513300ec4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:37.950080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] The token cache is being invalidate because project dae6f622309143418b522083641a3c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:18:37.950707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:37.956534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c932a2d-837d-4081-84ef-c8a513300ec4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:37.963629 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2689/5346] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:18:37 2022] DELETE /identity/v3/projects/dae6f622309143418b522083641a3c28 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:37.967151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a884de-eb42-42b3-bbd1-470c78e830bb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:37.967562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a884de-eb42-42b3-bbd1-470c78e830bb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:37.967743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a884de-eb42-42b3-bbd1-470c78e830bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:38.000354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-10a884de-eb42-42b3-bbd1-470c78e830bb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:38.002421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-10a884de-eb42-42b3-bbd1-470c78e830bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:38.154116 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2658/5347] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:38.162445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11b8e-6df8-41bb-aa62-ed12069f094e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:38.162816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11b8e-6df8-41bb-aa62-ed12069f094e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:38.163169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c11b8e-6df8-41bb-aa62-ed12069f094e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:38.198440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a884de-eb42-42b3-bbd1-470c78e830bb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:38.200106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e4c11b8e-6df8-41bb-aa62-ed12069f094e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:38.200454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-10a884de-eb42-42b3-bbd1-470c78e830bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:38.204293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4c11b8e-6df8-41bb-aa62-ed12069f094e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:38.228613 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2690/5348] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:38.232908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11b8e-6df8-41bb-aa62-ed12069f094e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:38.251595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c11b8e-6df8-41bb-aa62-ed12069f094e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:38.285157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:38.286007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:38.286842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:38.286842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:38.287511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:18:38.287954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:38.290881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:38.321324 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2691/5349] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:18:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:18:38.322307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:38.329933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:38.404009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a884de-eb42-42b3-bbd1-470c78e830bb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:38.417999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25a583-66b8-4138-988f-9b732c4d1e36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:38.418620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25a583-66b8-4138-988f-9b732c4d1e36 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:38.418918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25a583-66b8-4138-988f-9b732c4d1e36 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:38.422082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e25a583-66b8-4138-988f-9b732c4d1e36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:38.428527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f41cb-200a-4e0c-9fd1-f7a9a977fa21 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:38.432850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae7bf-5c5f-47ad-bd1c-2f8bd0c5026f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:38.434322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae7bf-5c5f-47ad-bd1c-2f8bd0c5026f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:38.434797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae7bf-5c5f-47ad-bd1c-2f8bd0c5026f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:38.435233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6ae7bf-5c5f-47ad-bd1c-2f8bd0c5026f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:38.437839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d6ae7bf-5c5f-47ad-bd1c-2f8bd0c5026f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:38.441012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8e25a583-66b8-4138-988f-9b732c4d1e36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:38.470041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae7bf-5c5f-47ad-bd1c-2f8bd0c5026f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:38.471554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6ae7bf-5c5f-47ad-bd1c-2f8bd0c5026f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:38.502487 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2692/5350] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:38.503356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae7bf-5c5f-47ad-bd1c-2f8bd0c5026f service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:38.530921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6ae7bf-5c5f-47ad-bd1c-2f8bd0c5026f service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:38.554138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045192f2-939b-4f76-956e-be8a128a04f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:38.555060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045192f2-939b-4f76-956e-be8a128a04f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:38.555534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045192f2-939b-4f76-956e-be8a128a04f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:38.556009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045192f2-939b-4f76-956e-be8a128a04f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:38.556805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045192f2-939b-4f76-956e-be8a128a04f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:38.559551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045192f2-939b-4f76-956e-be8a128a04f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:38.623586 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2693/5351] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:18:38 2022] POST /identity/v3/projects => generated 375 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:18:38.624956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25a583-66b8-4138-988f-9b732c4d1e36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:38.626921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e25a583-66b8-4138-988f-9b732c4d1e36 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:38.628171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045192f2-939b-4f76-956e-be8a128a04f4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:38.641956 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2659/5352] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:38.844207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045192f2-939b-4f76-956e-be8a128a04f4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:38.864839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ecaff-2007-4aab-b1c6-ae0c6308b6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:38.865678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ecaff-2007-4aab-b1c6-ae0c6308b6cd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:38.865965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ecaff-2007-4aab-b1c6-ae0c6308b6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:38.866247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ecaff-2007-4aab-b1c6-ae0c6308b6cd admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:38.866888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ecaff-2007-4aab-b1c6-ae0c6308b6cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:38.873933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689ecaff-2007-4aab-b1c6-ae0c6308b6cd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:38.926298 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2694/5353] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:18:38 2022] POST /identity/v3/users => generated 288 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:18:38.930896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25a583-66b8-4138-988f-9b732c4d1e36 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:38.956354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e25a583-66b8-4138-988f-9b732c4d1e36 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:38.975793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb8604-0967-4b1e-8bfb-8cd506c5e855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:38.976744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb8604-0967-4b1e-8bfb-8cd506c5e855 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:38.981922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb8604-0967-4b1e-8bfb-8cd506c5e855 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:38.983621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fb8604-0967-4b1e-8bfb-8cd506c5e855 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:38.985220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb8604-0967-4b1e-8bfb-8cd506c5e855 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:38.989166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fb8604-0967-4b1e-8bfb-8cd506c5e855 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:39.037063 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2660/5354] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:39.041942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ecaff-2007-4aab-b1c6-ae0c6308b6cd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:39.076241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ecaff-2007-4aab-b1c6-ae0c6308b6cd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:39.094470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea163a-2ec1-4e5a-add9-d4650731defe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:39.096365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea163a-2ec1-4e5a-add9-d4650731defe admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:39.097333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea163a-2ec1-4e5a-add9-d4650731defe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:39.098509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea163a-2ec1-4e5a-add9-d4650731defe admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:39.099344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea163a-2ec1-4e5a-add9-d4650731defe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:39.104923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea163a-2ec1-4e5a-add9-d4650731defe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:39.133898 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2695/5355] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:18:39.138873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb8604-0967-4b1e-8bfb-8cd506c5e855 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:39.166180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fb8604-0967-4b1e-8bfb-8cd506c5e855 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:39.174789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4050-58d8-4625-925c-8c175799b93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:39.177555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4050-58d8-4625-925c-8c175799b93c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:39.177933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4050-58d8-4625-925c-8c175799b93c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:39.178312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ef4050-58d8-4625-925c-8c175799b93c admin admin] PATH_INFO: `/v3/projects/07a3520cf8b34f5e811e447c0c8e0587/users/7bb2b5b606be4005a7fb9146a663c52a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:39.208975 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:39.225609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4050-58d8-4625-925c-8c175799b93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a3520cf8b34f5e811e447c0c8e0587, user_id=7bb2b5b606be4005a7fb9146a663c52a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:39.236590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ef4050-58d8-4625-925c-8c175799b93c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:39.260382 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2661/5356] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:18:39 2022] PUT /identity/v3/projects/07a3520cf8b34f5e811e447c0c8e0587/users/7bb2b5b606be4005a7fb9146a663c52a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:39.285456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7d5ef-c452-4acf-b2b0-b92d4023cd06 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:39.285749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7d5ef-c452-4acf-b2b0-b92d4023cd06 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:39.286032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d7d5ef-c452-4acf-b2b0-b92d4023cd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:39.300949 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:39.379154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a9d7d5ef-c452-4acf-b2b0-b92d4023cd06 None None] MFA Rules not processed for user `7bb2b5b606be4005a7fb9146a663c52a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:39.380338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a9d7d5ef-c452-4acf-b2b0-b92d4023cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:39.521834 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2696/5357] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:39.530496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4050-58d8-4625-925c-8c175799b93c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:39.532238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e4ef4050-58d8-4625-925c-8c175799b93c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:39.617624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ef4050-58d8-4625-925c-8c175799b93c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:39.625857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f788de-6881-40f4-bac2-87899166ad71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:39.627006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f788de-6881-40f4-bac2-87899166ad71 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:39.627582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f788de-6881-40f4-bac2-87899166ad71 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:39.628057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f788de-6881-40f4-bac2-87899166ad71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:39.651496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f788de-6881-40f4-bac2-87899166ad71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:39.654780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f788de-6881-40f4-bac2-87899166ad71 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:39.672258 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2662/5358] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:49.512053 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=30 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:49.667205 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=31,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:52.651818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78db2d-1b1b-4d56-885b-cb90153c079a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:52.652318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78db2d-1b1b-4d56-885b-cb90153c079a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:52.652318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b78db2d-1b1b-4d56-885b-cb90153c079a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:52.737184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7b78db2d-1b1b-4d56-885b-cb90153c079a None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:52.738914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b78db2d-1b1b-4d56-885b-cb90153c079a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:52.980399 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2697/5359] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:18:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:53.003310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f788de-6881-40f4-bac2-87899166ad71 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:53.005679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a6f788de-6881-40f4-bac2-87899166ad71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:53.325932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f788de-6881-40f4-bac2-87899166ad71 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:53.343188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be26369-1525-4e38-8391-0b4b422932c9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:53.345510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be26369-1525-4e38-8391-0b4b422932c9 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:53.346110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be26369-1525-4e38-8391-0b4b422932c9 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:53.346600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be26369-1525-4e38-8391-0b4b422932c9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:53.375056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be26369-1525-4e38-8391-0b4b422932c9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:53.376763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be26369-1525-4e38-8391-0b4b422932c9 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:53.412767 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2663/5360] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:18:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:18:53.984560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78db2d-1b1b-4d56-885b-cb90153c079a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:53.986676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b78db2d-1b1b-4d56-885b-cb90153c079a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:54.250565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b78db2d-1b1b-4d56-885b-cb90153c079a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:54.279575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:54.279991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:54.280344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:54.280693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] PATH_INFO: `/v3/users/a170d67efe094c4e8b9267e33e4e476d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:54.283027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a170d67efe094c4e8b9267e33e4e476d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:54.285055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:54.485224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a170d67efe094c4e8b9267e33e4e476d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:54.547194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a170d67efe094c4e8b9267e33e4e476d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:54.550983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a170d67efe094c4e8b9267e33e4e476d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:54.578247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a170d67efe094c4e8b9267e33e4e476d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:54.600672 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:54.618093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a170d67efe094c4e8b9267e33e4e476d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:54.641691 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2698/5361] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:18:53 2022] DELETE /identity/v3/users/a170d67efe094c4e8b9267e33e4e476d => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:56.326587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be26369-1525-4e38-8391-0b4b422932c9 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:56.350557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be26369-1525-4e38-8391-0b4b422932c9 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:56.648300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:56.664507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:56.667833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:56.668873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] PATH_INFO: `/v3/projects/e4098b77de8d4b07853cf61416c0b870` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:56.674231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4098b77de8d4b07853cf61416c0b870)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:56.676456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:56.789687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:56.793181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:56.810605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4098b77de8d4b07853cf61416c0b870', 'request_id': 'req-0446a056-d47e-4ba3-a99a-b20166f09484'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:56.825794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f162877-a4a8-44c2-8ca6-7d52a1d0ed57 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:56.832254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4098b77de8d4b07853cf61416c0b870', 'request_id': 'req-0446a056-d47e-4ba3-a99a-b20166f09484'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:56.850300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4098b77de8d4b07853cf61416c0b870', 'request_id': 'req-0446a056-d47e-4ba3-a99a-b20166f09484'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:56.853146 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:56.880335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] The token cache is being invalidate because project e4098b77de8d4b07853cf61416c0b870 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:18:56.880554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:56.881705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0446a056-d47e-4ba3-a99a-b20166f09484 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:56.884347 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2664/5362] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:18:56 2022] DELETE /identity/v3/projects/e4098b77de8d4b07853cf61416c0b870 => generated 0 bytes in 558 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:56.889585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2c096-f7bd-40f7-8a57-fa95fac03775 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:56.890227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2c096-f7bd-40f7-8a57-fa95fac03775 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:56.890668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b2c096-f7bd-40f7-8a57-fa95fac03775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:56.939776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b5b2c096-f7bd-40f7-8a57-fa95fac03775 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:56.941327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b5b2c096-f7bd-40f7-8a57-fa95fac03775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:57.015598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:57.018088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:57.019373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:57.020129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] PATH_INFO: `/v3/users/b1ae9fcca02548dfa6e29d2787288e49` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:57.025016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ae9fcca02548dfa6e29d2787288e49)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:57.031879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:57.146231 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2665/5363] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:57.148319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128400c-fed7-4c4c-bda9-6091a51c0f42 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:57.148605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128400c-fed7-4c4c-bda9-6091a51c0f42 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:57.148887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0128400c-fed7-4c4c-bda9-6091a51c0f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:57.191678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ae9fcca02548dfa6e29d2787288e49'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.205840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0128400c-fed7-4c4c-bda9-6091a51c0f42 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:57.207098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0128400c-fed7-4c4c-bda9-6091a51c0f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:57.220933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ae9fcca02548dfa6e29d2787288e49'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.221964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ae9fcca02548dfa6e29d2787288e49'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.235924 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2666/5364] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:57.238267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128400c-fed7-4c4c-bda9-6091a51c0f42 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:57.242672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ae9fcca02548dfa6e29d2787288e49'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.253266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ae9fcca02548dfa6e29d2787288e49'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.256948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0128400c-fed7-4c4c-bda9-6091a51c0f42 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:57.264898 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2699/5365] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:18:56 2022] DELETE /identity/v3/users/b1ae9fcca02548dfa6e29d2787288e49 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:57.266896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2899273-2e4d-456a-9560-139465249bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:57.273616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2899273-2e4d-456a-9560-139465249bf5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:57.273998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2899273-2e4d-456a-9560-139465249bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:57.274487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2899273-2e4d-456a-9560-139465249bf5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:57.275221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2899273-2e4d-456a-9560-139465249bf5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:18:57.277599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2899273-2e4d-456a-9560-139465249bf5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:57.279261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2899273-2e4d-456a-9560-139465249bf5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:57.326154 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2667/5366] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:18:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:18:57.327305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:57.329056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:57.489055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367dc93-7479-4b34-a9b7-4d3042bca751 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:57.504786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952748f6-dad7-431a-8c80-164535ab852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:57.505683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952748f6-dad7-431a-8c80-164535ab852f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:57.506326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952748f6-dad7-431a-8c80-164535ab852f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:57.506705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952748f6-dad7-431a-8c80-164535ab852f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:57.507718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952748f6-dad7-431a-8c80-164535ab852f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:57.510501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952748f6-dad7-431a-8c80-164535ab852f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:57.567246 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:57.593597 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2700/5367] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:18:57 2022] POST /identity/v3/projects => generated 385 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:18:57.597870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2899273-2e4d-456a-9560-139465249bf5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:57.613343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2899273-2e4d-456a-9560-139465249bf5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:57.713017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bbab0-d5e1-49c4-ba5d-409af0f4ac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:57.713674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bbab0-d5e1-49c4-ba5d-409af0f4ac21 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:57.714698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bbab0-d5e1-49c4-ba5d-409af0f4ac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:57.715132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0bbab0-d5e1-49c4-ba5d-409af0f4ac21 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:57.715951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bbab0-d5e1-49c4-ba5d-409af0f4ac21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:57.718470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0bbab0-d5e1-49c4-ba5d-409af0f4ac21 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:57.756513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952748f6-dad7-431a-8c80-164535ab852f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:57.760071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-952748f6-dad7-431a-8c80-164535ab852f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:57.768325 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2668/5368] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:18:57 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:18:57.772831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bbab0-d5e1-49c4-ba5d-409af0f4ac21 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:57.798125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0bbab0-d5e1-49c4-ba5d-409af0f4ac21 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:57.804127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952748f6-dad7-431a-8c80-164535ab852f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:57.811546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410ba58-1e9f-4a72-804a-df874adb0f71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:57.812353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410ba58-1e9f-4a72-804a-df874adb0f71 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:57.812643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410ba58-1e9f-4a72-804a-df874adb0f71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:57.812921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410ba58-1e9f-4a72-804a-df874adb0f71 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:57.813616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410ba58-1e9f-4a72-804a-df874adb0f71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:57.815444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2410ba58-1e9f-4a72-804a-df874adb0f71 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:57.826594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:57.828474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:57.830937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:57.831128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] PATH_INFO: `/v3/projects/2ef8299318ec4b59a75e26867a009a2f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:57.833593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ef8299318ec4b59a75e26867a009a2f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:57.838001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:57.845204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2669/5369] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:57.846139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410ba58-1e9f-4a72-804a-df874adb0f71 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:57.868866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2410ba58-1e9f-4a72-804a-df874adb0f71 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:57.881993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10657f-cd04-4bde-a900-c6c09deb447e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:57.882617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10657f-cd04-4bde-a900-c6c09deb447e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:57.882897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10657f-cd04-4bde-a900-c6c09deb447e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:57.883171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10657f-cd04-4bde-a900-c6c09deb447e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:57.883829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10657f-cd04-4bde-a900-c6c09deb447e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:57.886302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10657f-cd04-4bde-a900-c6c09deb447e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:57.913980 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2670/5370] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:57.918367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10657f-cd04-4bde-a900-c6c09deb447e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:57.926370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ef8299318ec4b59a75e26867a009a2f', 'request_id': 'req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.941401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10657f-cd04-4bde-a900-c6c09deb447e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:57.943754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ef8299318ec4b59a75e26867a009a2f', 'request_id': 'req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.957214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ef8299318ec4b59a75e26867a009a2f', 'request_id': 'req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.972847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] The token cache is being invalidate because project 2ef8299318ec4b59a75e26867a009a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:18:57.974684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.976174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2bdca3a2-8140-4f8a-9507-c1127d38f1b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:57.982671 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2701/5371] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:18:57 2022] DELETE /identity/v3/projects/2ef8299318ec4b59a75e26867a009a2f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:57.987471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df0537-1a96-471c-b0cf-5ed6f90864d9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:57.987760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df0537-1a96-471c-b0cf-5ed6f90864d9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:57.988043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55df0537-1a96-471c-b0cf-5ed6f90864d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:58.025119 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:58.044726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-55df0537-1a96-471c-b0cf-5ed6f90864d9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:58.051443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-55df0537-1a96-471c-b0cf-5ed6f90864d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:58.094188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e93e16-b769-46e8-baed-c98ac4b3feb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:58.094889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e93e16-b769-46e8-baed-c98ac4b3feb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:58.095171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e93e16-b769-46e8-baed-c98ac4b3feb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:58.095448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e93e16-b769-46e8-baed-c98ac4b3feb1 admin admin] PATH_INFO: `/v3/projects/be810f51fba54f4b8583603cb37bdf6d/users/b1ab3881cebd4cce80ea1e4ba540c998/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:58.139813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e93e16-b769-46e8-baed-c98ac4b3feb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be810f51fba54f4b8583603cb37bdf6d, user_id=b1ab3881cebd4cce80ea1e4ba540c998, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:58.145429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e93e16-b769-46e8-baed-c98ac4b3feb1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:58.174045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2671/5372] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:18:57 2022] PUT /identity/v3/projects/be810f51fba54f4b8583603cb37bdf6d/users/b1ab3881cebd4cce80ea1e4ba540c998/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:58.184243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd92f8-cf49-41ae-95f3-e96be7582c02 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:58.184638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd92f8-cf49-41ae-95f3-e96be7582c02 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:58.185020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fd92f8-cf49-41ae-95f3-e96be7582c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:58.213040 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2702/5373] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:58.224645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f904f-dd25-4726-879e-f10ef1479f51 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:58.225229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f904f-dd25-4726-879e-f10ef1479f51 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:58.225545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921f904f-dd25-4726-879e-f10ef1479f51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:58.256357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-32fd92f8-cf49-41ae-95f3-e96be7582c02 None None] MFA Rules not processed for user `b1ab3881cebd4cce80ea1e4ba540c998`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:58.257750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-32fd92f8-cf49-41ae-95f3-e96be7582c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:58.307583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-921f904f-dd25-4726-879e-f10ef1479f51 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:58.314945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-921f904f-dd25-4726-879e-f10ef1479f51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:58.392525 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2672/5374] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:18:58.406957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd92f8-cf49-41ae-95f3-e96be7582c02 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:58.408696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-32fd92f8-cf49-41ae-95f3-e96be7582c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:58.481778 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2703/5375] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:58.482864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f904f-dd25-4726-879e-f10ef1479f51 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:58.512777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921f904f-dd25-4726-879e-f10ef1479f51 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:58.525665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53939ea-c07a-4aef-82fb-43b0ca7b846a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:58.526428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53939ea-c07a-4aef-82fb-43b0ca7b846a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:58.528355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53939ea-c07a-4aef-82fb-43b0ca7b846a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:58.528723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53939ea-c07a-4aef-82fb-43b0ca7b846a admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:58.529507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53939ea-c07a-4aef-82fb-43b0ca7b846a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:18:58.531313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53939ea-c07a-4aef-82fb-43b0ca7b846a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:58.538598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d53939ea-c07a-4aef-82fb-43b0ca7b846a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:58.600997 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2704/5376] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:18:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:18:58.605229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53939ea-c07a-4aef-82fb-43b0ca7b846a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:58.630471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d53939ea-c07a-4aef-82fb-43b0ca7b846a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:58.640695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fd92f8-cf49-41ae-95f3-e96be7582c02 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:58.644760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68392cb-daa2-4f04-b314-da9ad1a99cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:58.645682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68392cb-daa2-4f04-b314-da9ad1a99cd1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:58.645977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68392cb-daa2-4f04-b314-da9ad1a99cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:58.646354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68392cb-daa2-4f04-b314-da9ad1a99cd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:58.647098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68392cb-daa2-4f04-b314-da9ad1a99cd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:58.654188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68392cb-daa2-4f04-b314-da9ad1a99cd1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:58.661616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bede663-0344-417a-83db-9cd537357a0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:58.662697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bede663-0344-417a-83db-9cd537357a0f service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:58.663679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bede663-0344-417a-83db-9cd537357a0f service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:58.665028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bede663-0344-417a-83db-9cd537357a0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:58.682165 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:58.690790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bede663-0344-417a-83db-9cd537357a0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:58.697227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bede663-0344-417a-83db-9cd537357a0f service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:58.731290 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2673/5377] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:18:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:18:58.733541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bede663-0344-417a-83db-9cd537357a0f service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:58.734941 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2705/5378] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:18:58 2022] POST /identity/v3/projects => generated 403 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:18:58.758525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bede663-0344-417a-83db-9cd537357a0f service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:58.833339 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:18:58.938572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50863de3-5bc9-4cc9-ad9b-a226216eb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:58.939217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50863de3-5bc9-4cc9-ad9b-a226216eb106 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:58.939501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50863de3-5bc9-4cc9-ad9b-a226216eb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:58.939780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50863de3-5bc9-4cc9-ad9b-a226216eb106 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:58.947165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50863de3-5bc9-4cc9-ad9b-a226216eb106 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:58.962578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50863de3-5bc9-4cc9-ad9b-a226216eb106 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:59.017969 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2674/5379] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:18:58 2022] POST /identity/v3/users => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:18:59.018878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68392cb-daa2-4f04-b314-da9ad1a99cd1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:59.035225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68392cb-daa2-4f04-b314-da9ad1a99cd1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:59.045224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cda45a-18fe-43d6-8b48-1321b6ec6aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:59.045973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cda45a-18fe-43d6-8b48-1321b6ec6aec admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:59.046625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cda45a-18fe-43d6-8b48-1321b6ec6aec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:59.050051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cda45a-18fe-43d6-8b48-1321b6ec6aec admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:59.050735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cda45a-18fe-43d6-8b48-1321b6ec6aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:59.057360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cda45a-18fe-43d6-8b48-1321b6ec6aec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:59.101478 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2706/5380] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:59.105801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50863de3-5bc9-4cc9-ad9b-a226216eb106 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:59.124119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50863de3-5bc9-4cc9-ad9b-a226216eb106 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:59.135279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0571806-6372-484b-a21a-1f206b1b75fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:59.136470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571806-6372-484b-a21a-1f206b1b75fa admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:59.137070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571806-6372-484b-a21a-1f206b1b75fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:59.137542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0571806-6372-484b-a21a-1f206b1b75fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:59.138210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571806-6372-484b-a21a-1f206b1b75fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:59.139937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0571806-6372-484b-a21a-1f206b1b75fa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:59.180065 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2675/5381] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:18:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:18:59.185082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cda45a-18fe-43d6-8b48-1321b6ec6aec admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:59.201037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cda45a-18fe-43d6-8b48-1321b6ec6aec admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:59.207476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1dfd2-4991-4101-96c8-0bb4e81f5f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:59.208905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1dfd2-4991-4101-96c8-0bb4e81f5f43 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:59.209451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1dfd2-4991-4101-96c8-0bb4e81f5f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:59.210048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b1dfd2-4991-4101-96c8-0bb4e81f5f43 admin admin] PATH_INFO: `/v3/projects/bd4f0bcc948242c1ac6e10ec641e375e/users/998e76b2f34f4451a2076142419ced8e/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:59.234801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1dfd2-4991-4101-96c8-0bb4e81f5f43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd4f0bcc948242c1ac6e10ec641e375e, user_id=998e76b2f34f4451a2076142419ced8e, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:59.241332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b1dfd2-4991-4101-96c8-0bb4e81f5f43 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:59.269403 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2707/5382] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:18:59 2022] PUT /identity/v3/projects/bd4f0bcc948242c1ac6e10ec641e375e/users/998e76b2f34f4451a2076142419ced8e/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:18:59.279533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e3301-c43e-47e1-a972-9d5f1b3bfc1f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:59.279803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e3301-c43e-47e1-a972-9d5f1b3bfc1f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:59.280125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0e3301-c43e-47e1-a972-9d5f1b3bfc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:59.344113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0a0e3301-c43e-47e1-a972-9d5f1b3bfc1f None None] MFA Rules not processed for user `998e76b2f34f4451a2076142419ced8e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:59.345380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0a0e3301-c43e-47e1-a972-9d5f1b3bfc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:18:59.461723 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2676/5383] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:59 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:18:59.472106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1dfd2-4991-4101-96c8-0bb4e81f5f43 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:18:59.652736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b1dfd2-4991-4101-96c8-0bb4e81f5f43 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:18:59.667433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:18:59.668237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:59.668528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:59.668813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] PATH_INFO: `/v3/users/998e76b2f34f4451a2076142419ced8e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:59.674771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] RBAC: Authorizing `identity:delete_user(user_id=998e76b2f34f4451a2076142419ced8e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:18:59.677092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:18:59.785421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998e76b2f34f4451a2076142419ced8e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:59.809206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998e76b2f34f4451a2076142419ced8e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:59.813248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998e76b2f34f4451a2076142419ced8e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:59.837169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998e76b2f34f4451a2076142419ced8e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:59.871960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998e76b2f34f4451a2076142419ced8e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:18:59.891995 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2708/5384] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:18:59 2022] DELETE /identity/v3/users/998e76b2f34f4451a2076142419ced8e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:18:59.893734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6e0f-666c-4096-9886-9aa68e8c1490 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:18:59.894222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6e0f-666c-4096-9886-9aa68e8c1490 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:18:59.894727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1e6e0f-666c-4096-9886-9aa68e8c1490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:18:59.953866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8e1e6e0f-666c-4096-9886-9aa68e8c1490 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:18:59.960138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8e1e6e0f-666c-4096-9886-9aa68e8c1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:00.212966 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2677/5385] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:00.226185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:00.227658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:00.348859 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:00.440518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdee608b-1263-4c7b-a8c1-b7e731ce9400 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:00.453064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75618c7-951e-4840-85dd-319be8252a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:00.453765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75618c7-951e-4840-85dd-319be8252a03 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:00.454047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75618c7-951e-4840-85dd-319be8252a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:00.474765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75618c7-951e-4840-85dd-319be8252a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:00.489609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75618c7-951e-4840-85dd-319be8252a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:00.491168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75618c7-951e-4840-85dd-319be8252a03 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:00.539116 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2709/5386] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:01.158753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e6e0f-666c-4096-9886-9aa68e8c1490 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:01.166350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8e1e6e0f-666c-4096-9886-9aa68e8c1490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:01.234938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1e6e0f-666c-4096-9886-9aa68e8c1490 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:01.251092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:01.252102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:01.252658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:01.253405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] PATH_INFO: `/v3/projects/bd4f0bcc948242c1ac6e10ec641e375e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:01.256977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd4f0bcc948242c1ac6e10ec641e375e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:01.260439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:01.391596 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:01.452629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd4f0bcc948242c1ac6e10ec641e375e', 'request_id': 'req-73213e2c-f8b3-46dd-a4da-97e83064e7c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:01.488648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd4f0bcc948242c1ac6e10ec641e375e', 'request_id': 'req-73213e2c-f8b3-46dd-a4da-97e83064e7c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:01.517077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd4f0bcc948242c1ac6e10ec641e375e', 'request_id': 'req-73213e2c-f8b3-46dd-a4da-97e83064e7c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:01.546451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] The token cache is being invalidate because project bd4f0bcc948242c1ac6e10ec641e375e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:01.546792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:01.548746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-73213e2c-f8b3-46dd-a4da-97e83064e7c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:01.566455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e14aa-2e42-4943-bc2b-bcfbfb4ea7e1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:01.567226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e14aa-2e42-4943-bc2b-bcfbfb4ea7e1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:01.567728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e14aa-2e42-4943-bc2b-bcfbfb4ea7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:01.577386 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2678/5387] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:01 2022] DELETE /identity/v3/projects/bd4f0bcc948242c1ac6e10ec641e375e => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:01.618358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4c2e14aa-2e42-4943-bc2b-bcfbfb4ea7e1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:01.619955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c2e14aa-2e42-4943-bc2b-bcfbfb4ea7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:01.731235 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2710/5388] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:01.731540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92ad9-0412-43b7-bd14-e8bcb4ca6da9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:01.731829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92ad9-0412-43b7-bd14-e8bcb4ca6da9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:01.732133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed92ad9-0412-43b7-bd14-e8bcb4ca6da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:01.789801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3ed92ad9-0412-43b7-bd14-e8bcb4ca6da9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:01.790523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3ed92ad9-0412-43b7-bd14-e8bcb4ca6da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:01.815135 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2679/5389] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:01.819227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e14aa-2e42-4943-bc2b-bcfbfb4ea7e1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:01.832837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e14aa-2e42-4943-bc2b-bcfbfb4ea7e1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:01.844210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ff33-5edc-4187-b641-1ce13d4e3600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:01.846191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ff33-5edc-4187-b641-1ce13d4e3600 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:01.846427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ff33-5edc-4187-b641-1ce13d4e3600 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:01.846703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2668ff33-5edc-4187-b641-1ce13d4e3600 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:01.847361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668ff33-5edc-4187-b641-1ce13d4e3600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:01.850251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668ff33-5edc-4187-b641-1ce13d4e3600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:01.853743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2668ff33-5edc-4187-b641-1ce13d4e3600 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:01.912647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed92ad9-0412-43b7-bd14-e8bcb4ca6da9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:01.914246 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2711/5390] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:01.927002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed92ad9-0412-43b7-bd14-e8bcb4ca6da9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:01.940462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ef4f8-cefc-4cbe-9816-a0fd7c86759f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:01.941397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef4f8-cefc-4cbe-9816-a0fd7c86759f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:01.941850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef4f8-cefc-4cbe-9816-a0fd7c86759f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:01.942940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7ef4f8-cefc-4cbe-9816-a0fd7c86759f admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:01.943874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ef4f8-cefc-4cbe-9816-a0fd7c86759f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:01.948157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7ef4f8-cefc-4cbe-9816-a0fd7c86759f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:02.020789 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2680/5391] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:01 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:02.025121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ff33-5edc-4187-b641-1ce13d4e3600 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:02.037399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2668ff33-5edc-4187-b641-1ce13d4e3600 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:02.316201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4c89-7e88-43f9-93c2-66384ca9a7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:02.316953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4c89-7e88-43f9-93c2-66384ca9a7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:02.317350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4c89-7e88-43f9-93c2-66384ca9a7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:02.317727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39d4c89-7e88-43f9-93c2-66384ca9a7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:02.318465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d4c89-7e88-43f9-93c2-66384ca9a7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:02.320522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a39d4c89-7e88-43f9-93c2-66384ca9a7c0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:02.374221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ef4f8-cefc-4cbe-9816-a0fd7c86759f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:02.374988 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2712/5392] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:02 2022] POST /identity/v3/users => generated 288 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:02.401363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7ef4f8-cefc-4cbe-9816-a0fd7c86759f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:02.412483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be773677-880b-4a72-9853-ee81f6046aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:02.414055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be773677-880b-4a72-9853-ee81f6046aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:02.416459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be773677-880b-4a72-9853-ee81f6046aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:02.417650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be773677-880b-4a72-9853-ee81f6046aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:02.419568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be773677-880b-4a72-9853-ee81f6046aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:02.424237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be773677-880b-4a72-9853-ee81f6046aa5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:02.452240 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2681/5393] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:19:02.456897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4c89-7e88-43f9-93c2-66384ca9a7c0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:02.470094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39d4c89-7e88-43f9-93c2-66384ca9a7c0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:02.493642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1058d67-d697-46c1-8942-ccbd2fa6fcc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:02.499625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058d67-d697-46c1-8942-ccbd2fa6fcc0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:02.500051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058d67-d697-46c1-8942-ccbd2fa6fcc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:02.502110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1058d67-d697-46c1-8942-ccbd2fa6fcc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:02.502809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1058d67-d697-46c1-8942-ccbd2fa6fcc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:02.517476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1058d67-d697-46c1-8942-ccbd2fa6fcc0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:02.578077 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2713/5394] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:02 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:02.579800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be773677-880b-4a72-9853-ee81f6046aa5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:02.612629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be773677-880b-4a72-9853-ee81f6046aa5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:02.628038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84752a2-253b-45e1-bb9a-2cb61edde523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:02.628981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84752a2-253b-45e1-bb9a-2cb61edde523 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:02.629627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84752a2-253b-45e1-bb9a-2cb61edde523 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:02.630114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84752a2-253b-45e1-bb9a-2cb61edde523 admin admin] PATH_INFO: `/v3/projects/2cb56f27bed94936893d2fedd994515e/users/1833f70f45d0412e9f16035e1eea2d24/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:02.655610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84752a2-253b-45e1-bb9a-2cb61edde523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cb56f27bed94936893d2fedd994515e, user_id=1833f70f45d0412e9f16035e1eea2d24, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:02.660969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84752a2-253b-45e1-bb9a-2cb61edde523 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:02.705991 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2682/5395] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:02 2022] PUT /identity/v3/projects/2cb56f27bed94936893d2fedd994515e/users/1833f70f45d0412e9f16035e1eea2d24/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:02.707588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290dc7-b223-4a36-a10a-1ee9fb627df5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:02.708119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290dc7-b223-4a36-a10a-1ee9fb627df5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:02.708488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39290dc7-b223-4a36-a10a-1ee9fb627df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:02.770325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-39290dc7-b223-4a36-a10a-1ee9fb627df5 None None] MFA Rules not processed for user `1833f70f45d0412e9f16035e1eea2d24`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:02.772437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39290dc7-b223-4a36-a10a-1ee9fb627df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:02.821747 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:02.910538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84752a2-253b-45e1-bb9a-2cb61edde523 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:02.910950 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2714/5396] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:03.096026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84752a2-253b-45e1-bb9a-2cb61edde523 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:03.121591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0b5ab-6708-4eff-835d-141c05f55de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:03.122564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0b5ab-6708-4eff-835d-141c05f55de5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:03.122564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0b5ab-6708-4eff-835d-141c05f55de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:03.122786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab0b5ab-6708-4eff-835d-141c05f55de5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:03.123412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0b5ab-6708-4eff-835d-141c05f55de5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:03.125375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab0b5ab-6708-4eff-835d-141c05f55de5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:03.204037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39290dc7-b223-4a36-a10a-1ee9fb627df5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:03.209320 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2683/5397] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:02 2022] POST /identity/v3/projects => generated 375 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:03.224693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39290dc7-b223-4a36-a10a-1ee9fb627df5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:03.439952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e36b2-c4bd-4103-a092-9d308faac9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:03.440587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e36b2-c4bd-4103-a092-9d308faac9ce admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:03.440866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e36b2-c4bd-4103-a092-9d308faac9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:03.441143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16e36b2-c4bd-4103-a092-9d308faac9ce admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:03.441823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e36b2-c4bd-4103-a092-9d308faac9ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:03.443754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16e36b2-c4bd-4103-a092-9d308faac9ce admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:03.509118 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2715/5398] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:03 2022] POST /identity/v3/users => generated 294 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:03.510890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0b5ab-6708-4eff-835d-141c05f55de5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:03.525740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab0b5ab-6708-4eff-835d-141c05f55de5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:03.541815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395a010-6752-4aa6-bd50-6dc59308f208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:03.542954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395a010-6752-4aa6-bd50-6dc59308f208 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:03.543236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395a010-6752-4aa6-bd50-6dc59308f208 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:03.547006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8395a010-6752-4aa6-bd50-6dc59308f208 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:03.547927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395a010-6752-4aa6-bd50-6dc59308f208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:03.569681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8395a010-6752-4aa6-bd50-6dc59308f208 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:03.617428 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2684/5399] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:03.618630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e36b2-c4bd-4103-a092-9d308faac9ce admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:03.636689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16e36b2-c4bd-4103-a092-9d308faac9ce admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:03.655713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4473e78-b085-408d-8c87-7136d277a4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:03.656400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4473e78-b085-408d-8c87-7136d277a4fc admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:03.656688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4473e78-b085-408d-8c87-7136d277a4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:03.656964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4473e78-b085-408d-8c87-7136d277a4fc admin admin] PATH_INFO: `/v3/projects/498855abd77046c18ed5dda41e764124/users/b08476596a094de7a5a5322306335529/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:03.713783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4473e78-b085-408d-8c87-7136d277a4fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=498855abd77046c18ed5dda41e764124, user_id=b08476596a094de7a5a5322306335529, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:03.716407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4473e78-b085-408d-8c87-7136d277a4fc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:03.752361 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2716/5400] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:03 2022] PUT /identity/v3/projects/498855abd77046c18ed5dda41e764124/users/b08476596a094de7a5a5322306335529/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:03.754325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395a010-6752-4aa6-bd50-6dc59308f208 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:03.826712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8395a010-6752-4aa6-bd50-6dc59308f208 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:04.009596 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:04.061475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852097-4476-4977-9c6a-e3f6b658d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:04.062125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852097-4476-4977-9c6a-e3f6b658d51f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:04.062404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852097-4476-4977-9c6a-e3f6b658d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:04.062677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852097-4476-4977-9c6a-e3f6b658d51f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:04.063586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da852097-4476-4977-9c6a-e3f6b658d51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:04.065536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da852097-4476-4977-9c6a-e3f6b658d51f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:04.082003 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2685/5401] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:04.085858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4473e78-b085-408d-8c87-7136d277a4fc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:04.114673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4473e78-b085-408d-8c87-7136d277a4fc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:04.129188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63e390-73dd-4a6b-b050-b26ecae53a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:04.129918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e390-73dd-4a6b-b050-b26ecae53a31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:04.130199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e390-73dd-4a6b-b050-b26ecae53a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:04.130475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a63e390-73dd-4a6b-b050-b26ecae53a31 admin admin] PATH_INFO: `/v3/projects/498855abd77046c18ed5dda41e764124/users/b08476596a094de7a5a5322306335529/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:04.132846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63e390-73dd-4a6b-b050-b26ecae53a31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=498855abd77046c18ed5dda41e764124, user_id=b08476596a094de7a5a5322306335529, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:04.136091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a63e390-73dd-4a6b-b050-b26ecae53a31 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:04.200840 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2717/5402] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:04 2022] PUT /identity/v3/projects/498855abd77046c18ed5dda41e764124/users/b08476596a094de7a5a5322306335529/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:04.202615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a988a-5fb6-43d4-8978-88c4cd2bbd9d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:04.202909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a988a-5fb6-43d4-8978-88c4cd2bbd9d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:04.203188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38a988a-5fb6-43d4-8978-88c4cd2bbd9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:04.312857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f38a988a-5fb6-43d4-8978-88c4cd2bbd9d None None] MFA Rules not processed for user `b08476596a094de7a5a5322306335529`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:04.315295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f38a988a-5fb6-43d4-8978-88c4cd2bbd9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:04.527513 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2686/5403] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:04 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:04.533216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63e390-73dd-4a6b-b050-b26ecae53a31 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:04.550427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a63e390-73dd-4a6b-b050-b26ecae53a31 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:04.575148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2598d-3535-4160-b607-196c5bc489a1 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:04.575884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2598d-3535-4160-b607-196c5bc489a1 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:04.576283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2598d-3535-4160-b607-196c5bc489a1 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:04.576714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b2598d-3535-4160-b607-196c5bc489a1 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:04.577417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2598d-3535-4160-b607-196c5bc489a1 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:04.582645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b2598d-3535-4160-b607-196c5bc489a1 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:04.665119 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2718/5404] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:04 2022] POST /identity/v3/projects => generated 351 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:04.669849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a988a-5fb6-43d4-8978-88c4cd2bbd9d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:04.684665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38a988a-5fb6-43d4-8978-88c4cd2bbd9d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:04.834157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fb9ac-9678-4a96-a81b-af2671e580e4 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:04.835563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fb9ac-9678-4a96-a81b-af2671e580e4 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:04.836546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fb9ac-9678-4a96-a81b-af2671e580e4 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:04.836920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130fb9ac-9678-4a96-a81b-af2671e580e4 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:04.837752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fb9ac-9678-4a96-a81b-af2671e580e4 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:04.840522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130fb9ac-9678-4a96-a81b-af2671e580e4 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:04.919156 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2687/5405] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:04 2022] POST /identity/v3/projects => generated 350 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:04.922849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2598d-3535-4160-b607-196c5bc489a1 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:04.943270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b2598d-3535-4160-b607-196c5bc489a1 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:05.108441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffe9cb-0000-4aba-84ed-1eb3941064c3 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:05.109601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffe9cb-0000-4aba-84ed-1eb3941064c3 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:05.110128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffe9cb-0000-4aba-84ed-1eb3941064c3 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:05.110944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ffe9cb-0000-4aba-84ed-1eb3941064c3 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/users/1833f70f45d0412e9f16035e1eea2d24` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:05.114620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffe9cb-0000-4aba-84ed-1eb3941064c3 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:get_user(user_id=1833f70f45d0412e9f16035e1eea2d24)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.120708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ffe9cb-0000-4aba-84ed-1eb3941064c3 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.125850 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2719/5406] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:19:04 2022] GET /identity/v3/users/1833f70f45d0412e9f16035e1eea2d24 => generated 288 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:05.130484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fb9ac-9678-4a96-a81b-af2671e580e4 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:05.160706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130fb9ac-9678-4a96-a81b-af2671e580e4 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:05.174558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b712489-edba-4880-8b84-1fbbf7f684c7 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:05.175868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b712489-edba-4880-8b84-1fbbf7f684c7 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:05.176316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b712489-edba-4880-8b84-1fbbf7f684c7 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:05.176761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b712489-edba-4880-8b84-1fbbf7f684c7 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:05.177622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b712489-edba-4880-8b84-1fbbf7f684c7 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.180458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b712489-edba-4880-8b84-1fbbf7f684c7 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.218924 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2688/5407] 10.222.0.25 () {60 vars in 1162 bytes} [Mon Oct 24 09:19:05 2022] POST /identity/v3/credentials => generated 431 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:05.222957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffe9cb-0000-4aba-84ed-1eb3941064c3 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:05.232465 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:05.243257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ffe9cb-0000-4aba-84ed-1eb3941064c3 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:05.252549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:05.253515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:05.253971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:05.254416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/credentials/492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:05.259099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.272437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.276154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:update_credential(credential_id=492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.278121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.306169 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2720/5408] 10.222.0.25 () {60 vars in 1358 bytes} [Mon Oct 24 09:19:05 2022] PATCH /identity/v3/credentials/492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956 => generated 436 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:05.310798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b712489-edba-4880-8b84-1fbbf7f684c7 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:05.326363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b712489-edba-4880-8b84-1fbbf7f684c7 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:05.337749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda51aa-d996-4317-80d2-d803a0f7014c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:05.339209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda51aa-d996-4317-80d2-d803a0f7014c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:05.339663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda51aa-d996-4317-80d2-d803a0f7014c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:05.340108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda51aa-d996-4317-80d2-d803a0f7014c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/credentials/492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:05.342801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda51aa-d996-4317-80d2-d803a0f7014c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:get_credential(credential_id=492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.347697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda51aa-d996-4317-80d2-d803a0f7014c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.352910 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2689/5409] 10.222.0.25 () {58 vars in 1335 bytes} [Mon Oct 24 09:19:05 2022] GET /identity/v3/credentials/492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956 => generated 436 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:05.357910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:05.400755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e3e09b-1f9d-4ff5-9c0c-750f4424811d tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:05.406692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eec8a-8b81-46df-90a3-a883b1e17d79 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:05.407155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eec8a-8b81-46df-90a3-a883b1e17d79 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:05.407461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eec8a-8b81-46df-90a3-a883b1e17d79 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:05.407746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784eec8a-8b81-46df-90a3-a883b1e17d79 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/credentials/492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:05.410819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784eec8a-8b81-46df-90a3-a883b1e17d79 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.420307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784eec8a-8b81-46df-90a3-a883b1e17d79 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.464278 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2721/5410] 10.222.0.25 () {58 vars in 1338 bytes} [Mon Oct 24 09:19:05 2022] DELETE /identity/v3/credentials/492da71972d6417c2761290b2b891674cd1988032b16fb87ccb0cf269c05e956 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:05.469545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda51aa-d996-4317-80d2-d803a0f7014c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:05.488006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda51aa-d996-4317-80d2-d803a0f7014c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:05.504981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f233d5-f291-451f-b4ef-3a86170ede3c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:05.505638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f233d5-f291-451f-b4ef-3a86170ede3c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:05.506194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f233d5-f291-451f-b4ef-3a86170ede3c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:05.506775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f233d5-f291-451f-b4ef-3a86170ede3c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:05.507436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f233d5-f291-451f-b4ef-3a86170ede3c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.510340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f233d5-f291-451f-b4ef-3a86170ede3c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.550627 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2690/5411] 10.222.0.25 () {60 vars in 1162 bytes} [Mon Oct 24 09:19:05 2022] POST /identity/v3/credentials => generated 431 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:05.554788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eec8a-8b81-46df-90a3-a883b1e17d79 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:05.571540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784eec8a-8b81-46df-90a3-a883b1e17d79 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:05.596181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dee855-b9d4-417a-87f7-82dd6016a4d2 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:05.597788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dee855-b9d4-417a-87f7-82dd6016a4d2 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:05.597788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dee855-b9d4-417a-87f7-82dd6016a4d2 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:05.597788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87dee855-b9d4-417a-87f7-82dd6016a4d2 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:05.598080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dee855-b9d4-417a-87f7-82dd6016a4d2 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:create_credential()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.602915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87dee855-b9d4-417a-87f7-82dd6016a4d2 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.679174 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2722/5412] 10.222.0.25 () {60 vars in 1162 bytes} [Mon Oct 24 09:19:05 2022] POST /identity/v3/credentials => generated 431 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:05.683542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f233d5-f291-451f-b4ef-3a86170ede3c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:05.692808 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:05.708065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f233d5-f291-451f-b4ef-3a86170ede3c tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:05.739488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:05.749182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:05.758423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:05.765513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:05.767053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:list_credentials()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.770542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.840016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.842141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.852400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:get_credential()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.854254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.864710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dee855-b9d4-417a-87f7-82dd6016a4d2 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:05.883704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87dee855-b9d4-417a-87f7-82dd6016a4d2 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:05.887146 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2691/5413] 10.222.0.25 () {58 vars in 1140 bytes} [Mon Oct 24 09:19:05 2022] GET /identity/v3/credentials => generated 947 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:05.905009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4bca5-9932-4000-80f8-e225c0bd7123 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:05.905743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4bca5-9932-4000-80f8-e225c0bd7123 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:05.906017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4bca5-9932-4000-80f8-e225c0bd7123 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:05.906501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c4bca5-9932-4000-80f8-e225c0bd7123 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/credentials/832f80f96f468c6074cc80b3b7ed17f83b994587afdd7b0078f1298b62ab1a03` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:05.914638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4bca5-9932-4000-80f8-e225c0bd7123 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=832f80f96f468c6074cc80b3b7ed17f83b994587afdd7b0078f1298b62ab1a03)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:05.916874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c4bca5-9932-4000-80f8-e225c0bd7123 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:05.974563 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2723/5414] 10.222.0.25 () {58 vars in 1338 bytes} [Mon Oct 24 09:19:05 2022] DELETE /identity/v3/credentials/832f80f96f468c6074cc80b3b7ed17f83b994587afdd7b0078f1298b62ab1a03 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:05.980507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:05.999065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d612759c-d442-4674-9df2-cc424954397e tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:06.016811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffb14e-f785-4632-9e0c-68a9c28c0e60 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:06.018296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffb14e-f785-4632-9e0c-68a9c28c0e60 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:06.018604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffb14e-f785-4632-9e0c-68a9c28c0e60 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:06.021087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ffb14e-f785-4632-9e0c-68a9c28c0e60 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/credentials/5a79a5f53052997eae3de077b102627e56c157a0bc31eb487734582d99a9f20d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:06.029568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffb14e-f785-4632-9e0c-68a9c28c0e60 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:delete_credential(credential_id=5a79a5f53052997eae3de077b102627e56c157a0bc31eb487734582d99a9f20d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:06.033169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ffb14e-f785-4632-9e0c-68a9c28c0e60 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:06.080551 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2692/5415] 10.222.0.25 () {58 vars in 1338 bytes} [Mon Oct 24 09:19:05 2022] DELETE /identity/v3/credentials/5a79a5f53052997eae3de077b102627e56c157a0bc31eb487734582d99a9f20d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:06.081752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4bca5-9932-4000-80f8-e225c0bd7123 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:06.098570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c4bca5-9932-4000-80f8-e225c0bd7123 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:06.112392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:06.114102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:06.114639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:06.115143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/projects/4312f95025cb4293addc2d1b5ab8907c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:06.120549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4312f95025cb4293addc2d1b5ab8907c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:06.123219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:06.302737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4312f95025cb4293addc2d1b5ab8907c', 'request_id': 'req-aa906abc-b329-452b-a29b-83fa353df5db'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.331205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4312f95025cb4293addc2d1b5ab8907c', 'request_id': 'req-aa906abc-b329-452b-a29b-83fa353df5db'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.356941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4312f95025cb4293addc2d1b5ab8907c', 'request_id': 'req-aa906abc-b329-452b-a29b-83fa353df5db'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.413055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] The token cache is being invalidate because project 4312f95025cb4293addc2d1b5ab8907c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:06.413452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.415188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.418244 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2724/5416] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:06 2022] DELETE /identity/v3/projects/4312f95025cb4293addc2d1b5ab8907c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:06.423982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffb14e-f785-4632-9e0c-68a9c28c0e60 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:06.427037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-59ffb14e-f785-4632-9e0c-68a9c28c0e60 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:06.451735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ffb14e-f785-4632-9e0c-68a9c28c0e60 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:06.556171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b08476596a094de7a5a5322306335529', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '498855abd77046c18ed5dda41e764124', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:06.558411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:06.558961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:06.561631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] PATH_INFO: `/v3/projects/89037eea7b084e7d9a5b59b0d2070c25` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:06.564491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorizing `identity:delete_project(project_id=89037eea7b084e7d9a5b59b0d2070c25)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:06.569253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:06.718019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89037eea7b084e7d9a5b59b0d2070c25', 'request_id': 'req-bf297575-7e56-4d58-bbe6-e7898b021860'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.773048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89037eea7b084e7d9a5b59b0d2070c25', 'request_id': 'req-bf297575-7e56-4d58-bbe6-e7898b021860'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.802491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89037eea7b084e7d9a5b59b0d2070c25', 'request_id': 'req-bf297575-7e56-4d58-bbe6-e7898b021860'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.842045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] The token cache is being invalidate because project 89037eea7b084e7d9a5b59b0d2070c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:06.844055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.846149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bf297575-7e56-4d58-bbe6-e7898b021860 tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:06.852019 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2693/5417] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:06 2022] DELETE /identity/v3/projects/89037eea7b084e7d9a5b59b0d2070c25 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:06.854983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:06.857265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:07.015530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa906abc-b329-452b-a29b-83fa353df5db tempest-CredentialsTestJSON-1539383276 tempest-CredentialsTestJSON-1539383276-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:07.155978 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:UPDATE=1,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:07.199257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:07.200164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:07.201192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:07.201652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] PATH_INFO: `/v3/users/1833f70f45d0412e9f16035e1eea2d24` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:07.204475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1833f70f45d0412e9f16035e1eea2d24)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:07.207021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:07.350087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1833f70f45d0412e9f16035e1eea2d24'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:07.387685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1833f70f45d0412e9f16035e1eea2d24'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:07.389681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1833f70f45d0412e9f16035e1eea2d24'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:07.409859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1833f70f45d0412e9f16035e1eea2d24'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:07.427419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1833f70f45d0412e9f16035e1eea2d24'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:07.452646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2725/5418] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:06 2022] DELETE /identity/v3/users/1833f70f45d0412e9f16035e1eea2d24 => generated 0 bytes in 598 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:07.457241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da12b3-525d-4ec8-b6cd-10082f169521 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:07.458854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da12b3-525d-4ec8-b6cd-10082f169521 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:07.459120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7da12b3-525d-4ec8-b6cd-10082f169521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:07.505083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d7da12b3-525d-4ec8-b6cd-10082f169521 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:07.506698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7da12b3-525d-4ec8-b6cd-10082f169521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:07.698485 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2694/5419] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:07.723303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:07.725123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:07.896666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ced4fa4-c614-42f4-9d26-ffdfb6fd08d7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:07.905882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabc6d5-1e02-4ca5-a625-81589be19a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:07.906647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabc6d5-1e02-4ca5-a625-81589be19a85 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:07.906998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabc6d5-1e02-4ca5-a625-81589be19a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:07.907345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eabc6d5-1e02-4ca5-a625-81589be19a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:07.938469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabc6d5-1e02-4ca5-a625-81589be19a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:07.940042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eabc6d5-1e02-4ca5-a625-81589be19a85 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:07.986183 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2726/5420] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:10.192510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da12b3-525d-4ec8-b6cd-10082f169521 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:10.194093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7da12b3-525d-4ec8-b6cd-10082f169521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:10.216830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7da12b3-525d-4ec8-b6cd-10082f169521 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:10.275773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:10.284985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:10.291080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:10.302340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] PATH_INFO: `/v3/projects/2cb56f27bed94936893d2fedd994515e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:10.318059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cb56f27bed94936893d2fedd994515e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:10.336222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:10.365925 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:10.569826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cb56f27bed94936893d2fedd994515e', 'request_id': 'req-f1b3a26d-4074-4cac-bcae-e585cbe7c486'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:10.594957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cb56f27bed94936893d2fedd994515e', 'request_id': 'req-f1b3a26d-4074-4cac-bcae-e585cbe7c486'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:10.620966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cb56f27bed94936893d2fedd994515e', 'request_id': 'req-f1b3a26d-4074-4cac-bcae-e585cbe7c486'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:10.660172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] The token cache is being invalidate because project 2cb56f27bed94936893d2fedd994515e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:10.660414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:10.664981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:10.670899 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2695/5421] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:10 2022] DELETE /identity/v3/projects/2cb56f27bed94936893d2fedd994515e => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:10.675179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabc6d5-1e02-4ca5-a625-81589be19a85 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:10.696573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eabc6d5-1e02-4ca5-a625-81589be19a85 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:10.800589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:10.801272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:10.801589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:10.801869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] PATH_INFO: `/v3/users/b08476596a094de7a5a5322306335529` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:10.803825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b08476596a094de7a5a5322306335529)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:10.808667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:10.813122 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:10.998876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b08476596a094de7a5a5322306335529'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:11.058884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b08476596a094de7a5a5322306335529'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:11.062441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b08476596a094de7a5a5322306335529'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:11.079975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b08476596a094de7a5a5322306335529'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:11.101955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-519e39e3-4b64-4d08-a17e-e58bd9f68e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b08476596a094de7a5a5322306335529'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:11.142507 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2727/5422] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:10 2022] DELETE /identity/v3/users/b08476596a094de7a5a5322306335529 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:11.707283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:11.709342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:11.733698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3a26d-4074-4cac-bcae-e585cbe7c486 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:11.891869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:11.892730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:11.893118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:11.894242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] PATH_INFO: `/v3/projects/498855abd77046c18ed5dda41e764124` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:11.896354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=498855abd77046c18ed5dda41e764124)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:11.902248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:12.021901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '498855abd77046c18ed5dda41e764124', 'request_id': 'req-247e314f-72fc-4124-ac11-c2a5a99587c4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:12.041335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '498855abd77046c18ed5dda41e764124', 'request_id': 'req-247e314f-72fc-4124-ac11-c2a5a99587c4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:12.070723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '498855abd77046c18ed5dda41e764124', 'request_id': 'req-247e314f-72fc-4124-ac11-c2a5a99587c4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:12.106964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] The token cache is being invalidate because project 498855abd77046c18ed5dda41e764124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:12.108291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:12.111605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-247e314f-72fc-4124-ac11-c2a5a99587c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:12.121595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148426-63a7-4184-afe6-a888cef1343b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:12.122580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148426-63a7-4184-afe6-a888cef1343b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:12.123155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148426-63a7-4184-afe6-a888cef1343b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:12.129812 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2696/5423] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:11 2022] DELETE /identity/v3/projects/498855abd77046c18ed5dda41e764124 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:12.152619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2c148426-63a7-4184-afe6-a888cef1343b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:12.155946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2c148426-63a7-4184-afe6-a888cef1343b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:12.295582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2284308-6733-42a2-8944-a665a84f3d0d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:12.295767 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2728/5424] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:12.296422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2284308-6733-42a2-8944-a665a84f3d0d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:12.296922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2284308-6733-42a2-8944-a665a84f3d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:12.326865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c2284308-6733-42a2-8944-a665a84f3d0d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:12.328622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c2284308-6733-42a2-8944-a665a84f3d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:12.349919 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2697/5425] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:12.354529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148426-63a7-4184-afe6-a888cef1343b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:12.368448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148426-63a7-4184-afe6-a888cef1343b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:12.382928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93116cf-11f2-4601-8a53-eca2b3f80338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:12.383571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93116cf-11f2-4601-8a53-eca2b3f80338 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:12.383848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93116cf-11f2-4601-8a53-eca2b3f80338 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:12.384127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93116cf-11f2-4601-8a53-eca2b3f80338 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:12.384794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93116cf-11f2-4601-8a53-eca2b3f80338 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:12.385428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93116cf-11f2-4601-8a53-eca2b3f80338 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:12.387366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93116cf-11f2-4601-8a53-eca2b3f80338 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:12.423308 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2729/5426] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:12.424461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2284308-6733-42a2-8944-a665a84f3d0d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:12.435642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2284308-6733-42a2-8944-a665a84f3d0d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:12.448049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bfaa1-72d2-4452-99c6-7b5f045c6599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:12.448942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bfaa1-72d2-4452-99c6-7b5f045c6599 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:12.449464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bfaa1-72d2-4452-99c6-7b5f045c6599 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:12.449946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914bfaa1-72d2-4452-99c6-7b5f045c6599 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:12.450751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bfaa1-72d2-4452-99c6-7b5f045c6599 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:12.452980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914bfaa1-72d2-4452-99c6-7b5f045c6599 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:12.479578 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:12.498940 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2698/5427] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:12 2022] POST /identity/v3/projects => generated 389 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:12.503048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93116cf-11f2-4601-8a53-eca2b3f80338 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:12.515260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93116cf-11f2-4601-8a53-eca2b3f80338 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:12.625975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b4aed-cf03-4692-83ed-e1c04fa35b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:12.626604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b4aed-cf03-4692-83ed-e1c04fa35b7e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:12.626885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b4aed-cf03-4692-83ed-e1c04fa35b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:12.627161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204b4aed-cf03-4692-83ed-e1c04fa35b7e admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:12.627959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b4aed-cf03-4692-83ed-e1c04fa35b7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:12.629978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204b4aed-cf03-4692-83ed-e1c04fa35b7e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:12.656139 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:12.669246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bfaa1-72d2-4452-99c6-7b5f045c6599 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:12.671629 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2730/5428] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:12 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:12.684755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914bfaa1-72d2-4452-99c6-7b5f045c6599 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:12.700278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7907-1d52-49aa-93eb-99865c47b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:12.701248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7907-1d52-49aa-93eb-99865c47b747 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:12.701759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7907-1d52-49aa-93eb-99865c47b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:12.702220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383f7907-1d52-49aa-93eb-99865c47b747 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:12.703529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7907-1d52-49aa-93eb-99865c47b747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:12.707334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383f7907-1d52-49aa-93eb-99865c47b747 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:12.735502 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2699/5429] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:12.739913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b4aed-cf03-4692-83ed-e1c04fa35b7e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:12.752468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204b4aed-cf03-4692-83ed-e1c04fa35b7e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:12.770196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04559deb-8edb-43f6-9251-2a34d663aa3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:12.771216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04559deb-8edb-43f6-9251-2a34d663aa3f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:12.774549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04559deb-8edb-43f6-9251-2a34d663aa3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:12.775097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04559deb-8edb-43f6-9251-2a34d663aa3f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:12.775792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04559deb-8edb-43f6-9251-2a34d663aa3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:12.779672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04559deb-8edb-43f6-9251-2a34d663aa3f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:12.810143 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2731/5430] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:12 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:12.813369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7907-1d52-49aa-93eb-99865c47b747 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:12.830658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383f7907-1d52-49aa-93eb-99865c47b747 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:12.846402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c848-95b5-4761-8dab-7bc767c93651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:12.847217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c848-95b5-4761-8dab-7bc767c93651 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:12.847535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c848-95b5-4761-8dab-7bc767c93651 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:12.848425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae8c848-95b5-4761-8dab-7bc767c93651 admin admin] PATH_INFO: `/v3/projects/f9c6906ff37a4ae687e90430238304b1/users/d6bb03c269b84cf5894793fd70706a59/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:12.908293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8c848-95b5-4761-8dab-7bc767c93651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c6906ff37a4ae687e90430238304b1, user_id=d6bb03c269b84cf5894793fd70706a59, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:12.916463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae8c848-95b5-4761-8dab-7bc767c93651 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:12.945698 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2700/5431] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:12 2022] PUT /identity/v3/projects/f9c6906ff37a4ae687e90430238304b1/users/d6bb03c269b84cf5894793fd70706a59/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:12.957542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf016a-ebad-47b1-aded-4274065c97ee None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:12.958057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf016a-ebad-47b1-aded-4274065c97ee None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:12.958511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf016a-ebad-47b1-aded-4274065c97ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:13.043853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-85cf016a-ebad-47b1-aded-4274065c97ee None None] MFA Rules not processed for user `d6bb03c269b84cf5894793fd70706a59`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:13.045132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-85cf016a-ebad-47b1-aded-4274065c97ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:13.229105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c848-95b5-4761-8dab-7bc767c93651 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:13.230963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0ae8c848-95b5-4761-8dab-7bc767c93651 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:13.294507 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2732/5432] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:13.295479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf016a-ebad-47b1-aded-4274065c97ee None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:13.439152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae8c848-95b5-4761-8dab-7bc767c93651 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:13.457109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:13.457524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf016a-ebad-47b1-aded-4274065c97ee None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:13.457801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:13.458088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:13.458365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] PATH_INFO: `/v3/users/7bb2b5b606be4005a7fb9146a663c52a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:13.468137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bb2b5b606be4005a7fb9146a663c52a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:13.468608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcfa27-73d5-48b5-be6f-a42e1f2e0861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:13.469229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcfa27-73d5-48b5-be6f-a42e1f2e0861 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:13.469540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcfa27-73d5-48b5-be6f-a42e1f2e0861 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:13.469815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fcfa27-73d5-48b5-be6f-a42e1f2e0861 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:13.470446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcfa27-73d5-48b5-be6f-a42e1f2e0861 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:13.471479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:13.472769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fcfa27-73d5-48b5-be6f-a42e1f2e0861 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:13.531375 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2733/5433] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:13 2022] POST /identity/v3/projects => generated 389 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:13.535199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcfa27-73d5-48b5-be6f-a42e1f2e0861 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:13.625005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bb2b5b606be4005a7fb9146a663c52a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:13.649184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bb2b5b606be4005a7fb9146a663c52a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:13.650586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bb2b5b606be4005a7fb9146a663c52a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:13.669631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bb2b5b606be4005a7fb9146a663c52a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:13.674831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fcfa27-73d5-48b5-be6f-a42e1f2e0861 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:13.688323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb823e81-9726-4cd5-85d4-645551c66619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:13.690755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-377bc771-d96c-4b0d-bb8d-92fef332d63c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bb2b5b606be4005a7fb9146a663c52a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:13.693167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb823e81-9726-4cd5-85d4-645551c66619 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:13.693480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb823e81-9726-4cd5-85d4-645551c66619 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:13.693757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb823e81-9726-4cd5-85d4-645551c66619 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:13.694409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb823e81-9726-4cd5-85d4-645551c66619 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:13.696584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb823e81-9726-4cd5-85d4-645551c66619 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:13.706328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2701/5434] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:13 2022] DELETE /identity/v3/users/7bb2b5b606be4005a7fb9146a663c52a => generated 0 bytes in 478 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:13.711397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bc932-8cc5-49c1-b852-e8a7e2e34fd2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:13.713075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bc932-8cc5-49c1-b852-e8a7e2e34fd2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:13.714236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181bc932-8cc5-49c1-b852-e8a7e2e34fd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:13.726592 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:13.752086 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2734/5435] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:13 2022] POST /identity/v3/users => generated 301 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:13.753032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb823e81-9726-4cd5-85d4-645551c66619 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:13.761392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bb823e81-9726-4cd5-85d4-645551c66619 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:13.770882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-181bc932-8cc5-49c1-b852-e8a7e2e34fd2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:13.775564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-181bc932-8cc5-49c1-b852-e8a7e2e34fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:13.802946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb823e81-9726-4cd5-85d4-645551c66619 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:13.863129 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:13.930418 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2702/5436] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:13.940705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bc932-8cc5-49c1-b852-e8a7e2e34fd2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:13.943026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-181bc932-8cc5-49c1-b852-e8a7e2e34fd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:13.944364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bb756-5bbf-4c20-94df-eef0dd51fd63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:13.945753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bb756-5bbf-4c20-94df-eef0dd51fd63 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:13.946043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bb756-5bbf-4c20-94df-eef0dd51fd63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:13.946310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904bb756-5bbf-4c20-94df-eef0dd51fd63 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:13.946956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bb756-5bbf-4c20-94df-eef0dd51fd63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:13.958500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904bb756-5bbf-4c20-94df-eef0dd51fd63 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:13.986689 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2735/5437] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:13 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:13.987602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bb756-5bbf-4c20-94df-eef0dd51fd63 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:14.009431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904bb756-5bbf-4c20-94df-eef0dd51fd63 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:14.046141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe5d2-4cd3-430c-90ef-d27b1c7497ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:14.046842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe5d2-4cd3-430c-90ef-d27b1c7497ae admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:14.047124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe5d2-4cd3-430c-90ef-d27b1c7497ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:14.047404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140fe5d2-4cd3-430c-90ef-d27b1c7497ae admin admin] PATH_INFO: `/v3/projects/f698ba6878814fc3a7c7825530f2c9f8/users/0f23b3745f954e04b8257789be53ecd3/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:14.059830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181bc932-8cc5-49c1-b852-e8a7e2e34fd2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:14.065417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e857b2-4b2c-4dfa-a210-172dde6edcb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:14.066289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e857b2-4b2c-4dfa-a210-172dde6edcb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:14.066873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e857b2-4b2c-4dfa-a210-172dde6edcb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:14.067440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e857b2-4b2c-4dfa-a210-172dde6edcb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:14.094572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e857b2-4b2c-4dfa-a210-172dde6edcb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:14.096330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e857b2-4b2c-4dfa-a210-172dde6edcb4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:14.099760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fe5d2-4cd3-430c-90ef-d27b1c7497ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f698ba6878814fc3a7c7825530f2c9f8, user_id=0f23b3745f954e04b8257789be53ecd3, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:14.102479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140fe5d2-4cd3-430c-90ef-d27b1c7497ae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:14.124681 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2736/5438] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:13 2022] PUT /identity/v3/projects/f698ba6878814fc3a7c7825530f2c9f8/users/0f23b3745f954e04b8257789be53ecd3/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:14.138276 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2703/5439] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:14.140091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe5d2-4cd3-430c-90ef-d27b1c7497ae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:14.349529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140fe5d2-4cd3-430c-90ef-d27b1c7497ae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:14.365998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d0d585-cf03-43b7-81e4-ecea2292b9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:14.366632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0d585-cf03-43b7-81e4-ecea2292b9c3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:14.366910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0d585-cf03-43b7-81e4-ecea2292b9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:14.367181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d0d585-cf03-43b7-81e4-ecea2292b9c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:14.367821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0d585-cf03-43b7-81e4-ecea2292b9c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:14.370169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d0d585-cf03-43b7-81e4-ecea2292b9c3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:14.426810 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2737/5440] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:14 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:14.428095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e857b2-4b2c-4dfa-a210-172dde6edcb4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:14.458079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e857b2-4b2c-4dfa-a210-172dde6edcb4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:14.480617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aadfa6-93f5-4ce9-81da-e6c88eac58f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:14.482080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aadfa6-93f5-4ce9-81da-e6c88eac58f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:14.484750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aadfa6-93f5-4ce9-81da-e6c88eac58f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:14.484750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aadfa6-93f5-4ce9-81da-e6c88eac58f1 admin admin] PATH_INFO: `/v3/projects/f698ba6878814fc3a7c7825530f2c9f8/users/0f23b3745f954e04b8257789be53ecd3/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:14.496652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aadfa6-93f5-4ce9-81da-e6c88eac58f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f698ba6878814fc3a7c7825530f2c9f8, user_id=0f23b3745f954e04b8257789be53ecd3, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:14.508871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14aadfa6-93f5-4ce9-81da-e6c88eac58f1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:14.554649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2704/5441] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:14 2022] PUT /identity/v3/projects/f698ba6878814fc3a7c7825530f2c9f8/users/0f23b3745f954e04b8257789be53ecd3/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:14.556441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b313a-baa7-4cf2-b4e0-01dcc4a37f14 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:14.556938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b313a-baa7-4cf2-b4e0-01dcc4a37f14 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:14.557419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386b313a-baa7-4cf2-b4e0-01dcc4a37f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:14.662260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-386b313a-baa7-4cf2-b4e0-01dcc4a37f14 None None] MFA Rules not processed for user `0f23b3745f954e04b8257789be53ecd3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:14.663840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-386b313a-baa7-4cf2-b4e0-01dcc4a37f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:14.816424 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:14.875543 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2738/5442] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:14 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:14.880078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aadfa6-93f5-4ce9-81da-e6c88eac58f1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:14.905173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aadfa6-93f5-4ce9-81da-e6c88eac58f1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:14.919242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43624285-8f01-4044-8a44-d3fd7b07593a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:14.919892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43624285-8f01-4044-8a44-d3fd7b07593a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:14.920166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43624285-8f01-4044-8a44-d3fd7b07593a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:14.920438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43624285-8f01-4044-8a44-d3fd7b07593a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects/f9c6906ff37a4ae687e90430238304b1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:14.921897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43624285-8f01-4044-8a44-d3fd7b07593a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:get_project(project_id=f9c6906ff37a4ae687e90430238304b1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:14.924214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43624285-8f01-4044-8a44-d3fd7b07593a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:14.933113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b313a-baa7-4cf2-b4e0-01dcc4a37f14 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:14.947323 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2705/5443] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:14 2022] GET /identity/v3/projects/f9c6906ff37a4ae687e90430238304b1 => generated 389 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:19:14.954001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386b313a-baa7-4cf2-b4e0-01dcc4a37f14 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:14.968936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66132f-bc27-45e1-ae26-cfe5bb1a05db tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:14.969925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66132f-bc27-45e1-ae26-cfe5bb1a05db tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:14.970360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66132f-bc27-45e1-ae26-cfe5bb1a05db tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:14.970803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66132f-bc27-45e1-ae26-cfe5bb1a05db tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:14.971607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66132f-bc27-45e1-ae26-cfe5bb1a05db tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:14.975257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66132f-bc27-45e1-ae26-cfe5bb1a05db tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:15.053164 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2739/5444] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:19:14 2022] POST /identity/v3/projects => generated 339 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:15.066748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43624285-8f01-4044-8a44-d3fd7b07593a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:15.085455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43624285-8f01-4044-8a44-d3fd7b07593a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:15.227995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd465e-2ea0-4608-906b-75c71f1663f0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:15.228622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd465e-2ea0-4608-906b-75c71f1663f0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:15.229478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd465e-2ea0-4608-906b-75c71f1663f0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:15.229754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcd465e-2ea0-4608-906b-75c71f1663f0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:15.230509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd465e-2ea0-4608-906b-75c71f1663f0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:15.232647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcd465e-2ea0-4608-906b-75c71f1663f0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:15.304412 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2706/5445] 10.222.0.25 () {58 vars in 1131 bytes} [Mon Oct 24 09:19:15 2022] GET /identity/v3/projects => generated 6542 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:15.308830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66132f-bc27-45e1-ae26-cfe5bb1a05db tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:15.341564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66132f-bc27-45e1-ae26-cfe5bb1a05db tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:15.373372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2222-59bb-481b-a15c-069faf66f39a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:15.374060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2222-59bb-481b-a15c-069faf66f39a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:15.374348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2222-59bb-481b-a15c-069faf66f39a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:15.374626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fe2222-59bb-481b-a15c-069faf66f39a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects/f9c6906ff37a4ae687e90430238304b1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:15.383165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe2222-59bb-481b-a15c-069faf66f39a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:get_project(project_id=f9c6906ff37a4ae687e90430238304b1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:15.396098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fe2222-59bb-481b-a15c-069faf66f39a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:15.398044 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2740/5446] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:15 2022] GET /identity/v3/projects/f9c6906ff37a4ae687e90430238304b1 => generated 389 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:15.402625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd465e-2ea0-4608-906b-75c71f1663f0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:15.417523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcd465e-2ea0-4608-906b-75c71f1663f0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:15.429031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316737e8-5a66-4afe-a31f-39cbcbbdf972 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:15.429702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316737e8-5a66-4afe-a31f-39cbcbbdf972 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:15.429982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316737e8-5a66-4afe-a31f-39cbcbbdf972 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:15.430351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316737e8-5a66-4afe-a31f-39cbcbbdf972 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects/dab3b8910f954eb494a373b17d882f0f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:15.432006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316737e8-5a66-4afe-a31f-39cbcbbdf972 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:get_project(project_id=dab3b8910f954eb494a373b17d882f0f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:15.434658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316737e8-5a66-4afe-a31f-39cbcbbdf972 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:15.444903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2222-59bb-481b-a15c-069faf66f39a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:15.460018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fe2222-59bb-481b-a15c-069faf66f39a tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:15.464841 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2707/5447] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:15 2022] GET /identity/v3/projects/dab3b8910f954eb494a373b17d882f0f => generated 339 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:15.476633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c36b9a-953c-43f9-a6f7-76ddd47b95b6 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:15.477276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c36b9a-953c-43f9-a6f7-76ddd47b95b6 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:15.477608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c36b9a-953c-43f9-a6f7-76ddd47b95b6 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:15.477887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c36b9a-953c-43f9-a6f7-76ddd47b95b6 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:15.478541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c36b9a-953c-43f9-a6f7-76ddd47b95b6 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:15.480122 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-54c36b9a-953c-43f9-a6f7-76ddd47b95b6 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:15.480122 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:19:15.480122 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:19:15.481274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c36b9a-953c-43f9-a6f7-76ddd47b95b6 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:15.563155 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2741/5448] 10.222.0.25 () {58 vars in 1131 bytes} [Mon Oct 24 09:19:15 2022] GET /identity/v3/projects => generated 6542 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:19:15.567675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316737e8-5a66-4afe-a31f-39cbcbbdf972 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:15.584564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316737e8-5a66-4afe-a31f-39cbcbbdf972 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:15.603166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:15.603789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:15.604658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:15.604937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:15.612413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:15.612764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:15.622226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:15.704134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c36b9a-953c-43f9-a6f7-76ddd47b95b6 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:15.716495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c36b9a-953c-43f9-a6f7-76ddd47b95b6 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:15.725426 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2708/5449] 10.222.0.25 () {58 vars in 1166 bytes} [Mon Oct 24 09:19:15 2022] GET /identity/v3/projects?domain_id=default => generated 6211 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:15.747161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774f0bd-ad7f-4b04-9949-dcde10591386 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:15.747730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f0bd-ad7f-4b04-9949-dcde10591386 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:15.748013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f0bd-ad7f-4b04-9949-dcde10591386 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:15.748288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774f0bd-ad7f-4b04-9949-dcde10591386 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:15.748935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774f0bd-ad7f-4b04-9949-dcde10591386 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:15.750913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774f0bd-ad7f-4b04-9949-dcde10591386 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:15.787739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:15.790495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:15.817954 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2742/5450] 10.222.0.25 () {58 vars in 1131 bytes} [Mon Oct 24 09:19:15 2022] GET /identity/v3/projects => generated 6542 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:19:15.822470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774f0bd-ad7f-4b04-9949-dcde10591386 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:15.844512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774f0bd-ad7f-4b04-9949-dcde10591386 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:15.863467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbcdc-ce57-4e7f-8bb6-0323c1d22a97 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:15.865180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbcdc-ce57-4e7f-8bb6-0323c1d22a97 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:15.868271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbcdc-ce57-4e7f-8bb6-0323c1d22a97 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:15.868834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804fbcdc-ce57-4e7f-8bb6-0323c1d22a97 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:15.871748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbcdc-ce57-4e7f-8bb6-0323c1d22a97 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:15.872731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbcdc-ce57-4e7f-8bb6-0323c1d22a97 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:15.876839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804fbcdc-ce57-4e7f-8bb6-0323c1d22a97 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:15.953682 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2743/5451] 10.222.0.25 () {58 vars in 1166 bytes} [Mon Oct 24 09:19:15 2022] GET /identity/v3/projects?domain_id=default => generated 6211 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:15.954977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbcdc-ce57-4e7f-8bb6-0323c1d22a97 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:15.991058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804fbcdc-ce57-4e7f-8bb6-0323c1d22a97 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:16.008996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59ea2-26eb-45be-8262-68d5730224b1 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:16.010985 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:16.016012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59ea2-26eb-45be-8262-68d5730224b1 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:16.016386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59ea2-26eb-45be-8262-68d5730224b1 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:16.016765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc59ea2-26eb-45be-8262-68d5730224b1 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:16.019132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc59ea2-26eb-45be-8262-68d5730224b1 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:16.021784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc59ea2-26eb-45be-8262-68d5730224b1 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:16.058282 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2744/5452] 10.222.0.25 () {58 vars in 1131 bytes} [Mon Oct 24 09:19:15 2022] GET /identity/v3/projects => generated 6542 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:19:16.064681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59ea2-26eb-45be-8262-68d5730224b1 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:16.087927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc59ea2-26eb-45be-8262-68d5730224b1 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:16.104398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f98906-f51a-467e-bafc-2e99d55a5cfd tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:16.106344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f98906-f51a-467e-bafc-2e99d55a5cfd tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:16.108636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f98906-f51a-467e-bafc-2e99d55a5cfd tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:16.109260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f98906-f51a-467e-bafc-2e99d55a5cfd tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:16.110500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f98906-f51a-467e-bafc-2e99d55a5cfd tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Adding query filter params (name=tempest-ListProjectsStaticTestJSON-1472662486) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:16.112831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f98906-f51a-467e-bafc-2e99d55a5cfd tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:16.117460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f98906-f51a-467e-bafc-2e99d55a5cfd tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:16.163150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f246f6-d938-435e-9d3a-85160ed3f09f tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:16.165937 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2745/5453] 10.222.0.25 () {58 vars in 1232 bytes} [Mon Oct 24 09:19:16 2022] GET /identity/v3/projects?name=tempest-ListProjectsStaticTestJSON-1472662486 => generated 537 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:16.172495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f98906-f51a-467e-bafc-2e99d55a5cfd tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:16.179619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cf851-6ecd-4f44-a61f-f15d77bd3335 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:16.180950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf851-6ecd-4f44-a61f-f15d77bd3335 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:16.181419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf851-6ecd-4f44-a61f-f15d77bd3335 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:16.181910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cf851-6ecd-4f44-a61f-f15d77bd3335 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:16.186616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fc8cf851-6ecd-4f44-a61f-f15d77bd3335 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:16.207943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f98906-f51a-467e-bafc-2e99d55a5cfd tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:16.221885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cf851-6ecd-4f44-a61f-f15d77bd3335 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:16.222399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0f23b3745f954e04b8257789be53ecd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f698ba6878814fc3a7c7825530f2c9f8', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:16.224072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:16.224491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:16.225753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] PATH_INFO: `/v3/projects/dab3b8910f954eb494a373b17d882f0f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:16.226798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cf851-6ecd-4f44-a61f-f15d77bd3335 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:16.228733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dab3b8910f954eb494a373b17d882f0f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:16.234922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:16.255654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2709/5454] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:19:16.396921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab3b8910f954eb494a373b17d882f0f', 'request_id': 'req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:16.418920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab3b8910f954eb494a373b17d882f0f', 'request_id': 'req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:16.441005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab3b8910f954eb494a373b17d882f0f', 'request_id': 'req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:16.481510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] The token cache is being invalidate because project dab3b8910f954eb494a373b17d882f0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:16.484318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:16.487938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:16.495309 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2746/5455] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:16 2022] DELETE /identity/v3/projects/dab3b8910f954eb494a373b17d882f0f => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:16.500507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cf851-6ecd-4f44-a61f-f15d77bd3335 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:16.676689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cf851-6ecd-4f44-a61f-f15d77bd3335 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:16.783763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:16.785434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:16.818514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:16.819163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:16.819442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:16.819715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] PATH_INFO: `/v3/users/d6bb03c269b84cf5894793fd70706a59` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:16.825920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d6bb03c269b84cf5894793fd70706a59)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:16.827961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:16.939704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd6bb03c269b84cf5894793fd70706a59'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:16.953839 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:16.964123 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:16.967855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd6bb03c269b84cf5894793fd70706a59'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:16.969619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd6bb03c269b84cf5894793fd70706a59'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:16.994045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd6bb03c269b84cf5894793fd70706a59'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:17.004050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-eed8fd92-f8b4-4018-aba6-d7b979b1a7fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd6bb03c269b84cf5894793fd70706a59'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:17.019629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ebf19-5547-4ab8-aa79-be2b28ccd8e0 tempest-ListProjectsStaticTestJSON-1871788979 tempest-ListProjectsStaticTestJSON-1871788979-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:17.026415 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2710/5456] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:16 2022] DELETE /identity/v3/users/d6bb03c269b84cf5894793fd70706a59 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:17.028933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332c656-1727-4e56-a7bb-5de8be645bae None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:17.029411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332c656-1727-4e56-a7bb-5de8be645bae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:17.029850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3332c656-1727-4e56-a7bb-5de8be645bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:17.030905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:17.033861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:17.035586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:17.037455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] PATH_INFO: `/v3/projects/07a3520cf8b34f5e811e447c0c8e0587` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:17.042107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a3520cf8b34f5e811e447c0c8e0587)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:17.053536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:17.074843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3332c656-1727-4e56-a7bb-5de8be645bae None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:17.078210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3332c656-1727-4e56-a7bb-5de8be645bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:17.194639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a3520cf8b34f5e811e447c0c8e0587', 'request_id': 'req-2fb2515d-1b20-4765-9712-4eeee578e807'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:17.207349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a3520cf8b34f5e811e447c0c8e0587', 'request_id': 'req-2fb2515d-1b20-4765-9712-4eeee578e807'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:17.218246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a3520cf8b34f5e811e447c0c8e0587', 'request_id': 'req-2fb2515d-1b20-4765-9712-4eeee578e807'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:17.235640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] The token cache is being invalidate because project 07a3520cf8b34f5e811e447c0c8e0587 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:17.236358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:17.237314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2fb2515d-1b20-4765-9712-4eeee578e807 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:17.239836 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2747/5457] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:16 2022] DELETE /identity/v3/projects/07a3520cf8b34f5e811e447c0c8e0587 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:17.246759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4daaaf-4283-432b-a01a-7157720c80d7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:17.247342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4daaaf-4283-432b-a01a-7157720c80d7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:17.247906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4daaaf-4283-432b-a01a-7157720c80d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:17.266234 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2711/5458] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:17.290471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332c656-1727-4e56-a7bb-5de8be645bae None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:17.292042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3332c656-1727-4e56-a7bb-5de8be645bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:17.299084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4e4daaaf-4283-432b-a01a-7157720c80d7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:17.302092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e4daaaf-4283-432b-a01a-7157720c80d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:17.467252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3332c656-1727-4e56-a7bb-5de8be645bae None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:17.468707 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2748/5459] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:17.486804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65872ff1-5619-4489-94e6-066b4a33bdc9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:17.487086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65872ff1-5619-4489-94e6-066b4a33bdc9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:17.487367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65872ff1-5619-4489-94e6-066b4a33bdc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:17.556222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-65872ff1-5619-4489-94e6-066b4a33bdc9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:17.558900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-65872ff1-5619-4489-94e6-066b4a33bdc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:17.590798 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2749/5460] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:17.595288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65872ff1-5619-4489-94e6-066b4a33bdc9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:17.613435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1993-5649-49d6-bcb0-390f1f02fcbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:17.614065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1993-5649-49d6-bcb0-390f1f02fcbe service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:17.614343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1993-5649-49d6-bcb0-390f1f02fcbe service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:17.614612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6c1993-5649-49d6-bcb0-390f1f02fcbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:17.617623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65872ff1-5619-4489-94e6-066b4a33bdc9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:17.631921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1473b-0424-48d8-a53c-f0037cff3e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:17.633761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1473b-0424-48d8-a53c-f0037cff3e95 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:17.635818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1473b-0424-48d8-a53c-f0037cff3e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:17.636310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1473b-0424-48d8-a53c-f0037cff3e95 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:17.638090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c1993-5649-49d6-bcb0-390f1f02fcbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:17.639558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6c1993-5649-49d6-bcb0-390f1f02fcbe service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:17.639806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1473b-0424-48d8-a53c-f0037cff3e95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:17.641287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1473b-0424-48d8-a53c-f0037cff3e95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:17.646397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1473b-0424-48d8-a53c-f0037cff3e95 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:17.664243 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2712/5461] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:17.687666 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2750/5462] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:17.688777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1993-5649-49d6-bcb0-390f1f02fcbe service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:17.699197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6c1993-5649-49d6-bcb0-390f1f02fcbe service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:17.723339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dabc4-8209-4db8-8758-79075daf4e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:17.724197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dabc4-8209-4db8-8758-79075daf4e44 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:17.724332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dabc4-8209-4db8-8758-79075daf4e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:17.724487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dabc4-8209-4db8-8758-79075daf4e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:17.725155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dabc4-8209-4db8-8758-79075daf4e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:17.727142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dabc4-8209-4db8-8758-79075daf4e44 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:17.783805 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2713/5463] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:17 2022] POST /identity/v3/projects => generated 373 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:17.785319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1473b-0424-48d8-a53c-f0037cff3e95 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:17.796967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1473b-0424-48d8-a53c-f0037cff3e95 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:17.928525 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:17.955666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35e92a-9a4d-452b-84f5-33cd81e9580d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:17.956231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e92a-9a4d-452b-84f5-33cd81e9580d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:17.956510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e92a-9a4d-452b-84f5-33cd81e9580d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:17.956784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f35e92a-9a4d-452b-84f5-33cd81e9580d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:17.962116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35e92a-9a4d-452b-84f5-33cd81e9580d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:17.962116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f35e92a-9a4d-452b-84f5-33cd81e9580d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:18.012747 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2751/5464] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:17 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:18.014278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dabc4-8209-4db8-8758-79075daf4e44 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:18.025259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dabc4-8209-4db8-8758-79075daf4e44 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:18.045387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c0bba-2175-46f6-bbc9-ae3d57183d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:18.046788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c0bba-2175-46f6-bbc9-ae3d57183d13 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:18.047213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c0bba-2175-46f6-bbc9-ae3d57183d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:18.047620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268c0bba-2175-46f6-bbc9-ae3d57183d13 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:18.050494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c0bba-2175-46f6-bbc9-ae3d57183d13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:18.052272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268c0bba-2175-46f6-bbc9-ae3d57183d13 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:18.093876 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2714/5465] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:18.097623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35e92a-9a4d-452b-84f5-33cd81e9580d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:18.114599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f35e92a-9a4d-452b-84f5-33cd81e9580d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:18.128449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c758-5b32-4e42-b364-9926d49f8075 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:18.129321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c758-5b32-4e42-b364-9926d49f8075 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:18.129789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c758-5b32-4e42-b364-9926d49f8075 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:18.130215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d350c758-5b32-4e42-b364-9926d49f8075 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:18.131466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350c758-5b32-4e42-b364-9926d49f8075 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:18.133966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d350c758-5b32-4e42-b364-9926d49f8075 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:18.168406 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2752/5466] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:18 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:18.184527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c0bba-2175-46f6-bbc9-ae3d57183d13 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:18.192626 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:18.202898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268c0bba-2175-46f6-bbc9-ae3d57183d13 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:18.221344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68275715-8891-4835-8d3f-87bdfb937cae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:18.224050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275715-8891-4835-8d3f-87bdfb937cae admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:18.229400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275715-8891-4835-8d3f-87bdfb937cae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:18.230785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68275715-8891-4835-8d3f-87bdfb937cae admin admin] PATH_INFO: `/v3/projects/1104d284053c4625bcb91c06e3fa5848/users/9d0b4f066e344bba84c0369d4c695f8b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:18.295281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c758-5b32-4e42-b364-9926d49f8075 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:18.295523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275715-8891-4835-8d3f-87bdfb937cae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1104d284053c4625bcb91c06e3fa5848, user_id=9d0b4f066e344bba84c0369d4c695f8b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:18.295685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d350c758-5b32-4e42-b364-9926d49f8075 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:18.303603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68275715-8891-4835-8d3f-87bdfb937cae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:18.323924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d350c758-5b32-4e42-b364-9926d49f8075 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:18.333805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:18.334458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:18.334629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:18.335339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] PATH_INFO: `/v3/users/b1ab3881cebd4cce80ea1e4ba540c998` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:18.338474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ab3881cebd4cce80ea1e4ba540c998)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:18.343266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:18.361743 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2715/5467] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:18 2022] PUT /identity/v3/projects/1104d284053c4625bcb91c06e3fa5848/users/9d0b4f066e344bba84c0369d4c695f8b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:18.375616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4aa85-2385-4858-864d-3f3d25fa2d2e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:18.375962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4aa85-2385-4858-864d-3f3d25fa2d2e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:18.376406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde4aa85-2385-4858-864d-3f3d25fa2d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:18.448056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ab3881cebd4cce80ea1e4ba540c998'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.481673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ab3881cebd4cce80ea1e4ba540c998'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.482445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ab3881cebd4cce80ea1e4ba540c998'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.492999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ab3881cebd4cce80ea1e4ba540c998'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.498395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bde4aa85-2385-4858-864d-3f3d25fa2d2e None None] MFA Rules not processed for user `9d0b4f066e344bba84c0369d4c695f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:18.500382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bde4aa85-2385-4858-864d-3f3d25fa2d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:18.508688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6563f9ff-d4b7-4091-b513-66e3d809c781 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ab3881cebd4cce80ea1e4ba540c998'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.518623 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2753/5468] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:18 2022] DELETE /identity/v3/users/b1ab3881cebd4cce80ea1e4ba540c998 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:18.523110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae54fe-b94a-45c3-a075-efff1e955bfe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:18.523651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae54fe-b94a-45c3-a075-efff1e955bfe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:18.524130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae54fe-b94a-45c3-a075-efff1e955bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:18.562307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b1ae54fe-b94a-45c3-a075-efff1e955bfe None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:18.569399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b1ae54fe-b94a-45c3-a075-efff1e955bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:18.615418 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2716/5469] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:18.620348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4aa85-2385-4858-864d-3f3d25fa2d2e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:18.622045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bde4aa85-2385-4858-864d-3f3d25fa2d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:18.677501 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2754/5470] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:18.678599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae54fe-b94a-45c3-a075-efff1e955bfe None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:18.682064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b1ae54fe-b94a-45c3-a075-efff1e955bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:18.696800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae54fe-b94a-45c3-a075-efff1e955bfe None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:18.703597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:18.704561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:18.704849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:18.705179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] PATH_INFO: `/v3/projects/f9c6906ff37a4ae687e90430238304b1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:18.706506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c6906ff37a4ae687e90430238304b1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:18.708949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:18.773883 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:DELETE=12 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:18.810840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c6906ff37a4ae687e90430238304b1', 'request_id': 'req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.820146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde4aa85-2385-4858-864d-3f3d25fa2d2e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:18.824452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c6906ff37a4ae687e90430238304b1', 'request_id': 'req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.834391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c6906ff37a4ae687e90430238304b1', 'request_id': 'req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.872140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] The token cache is being invalidate because project f9c6906ff37a4ae687e90430238304b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:18.874162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.875917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:18.880171 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2755/5471] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:18 2022] DELETE /identity/v3/projects/f9c6906ff37a4ae687e90430238304b1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:18.884886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:18.889811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:18.957931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca219aa2-5717-46a3-80cd-5c4070c6df8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:18.958555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca219aa2-5717-46a3-80cd-5c4070c6df8b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:18.958896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca219aa2-5717-46a3-80cd-5c4070c6df8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:18.959185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca219aa2-5717-46a3-80cd-5c4070c6df8b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:18.959835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca219aa2-5717-46a3-80cd-5c4070c6df8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:18.961822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca219aa2-5717-46a3-80cd-5c4070c6df8b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:19.007458 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2717/5472] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:18 2022] POST /identity/v3/projects => generated 375 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:19.008421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca219aa2-5717-46a3-80cd-5c4070c6df8b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:19.013588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ca219aa2-5717-46a3-80cd-5c4070c6df8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:19.028233 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:19.043298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8072fbce-f1c5-47ca-b2ba-4f408ed4fd21 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:19.172808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca219aa2-5717-46a3-80cd-5c4070c6df8b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:19.180401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:19.181119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:19.181506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:19.181943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:19.185005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:19.185159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:19.185676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:19.185958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:19.186236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] PATH_INFO: `/v3/users/0f23b3745f954e04b8257789be53ecd3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:19.192034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f23b3745f954e04b8257789be53ecd3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:19.201713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:19.216938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:19.219189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:19.245862 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2756/5473] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:19.263709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:19.267252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:19.305826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be9b8a6-167c-4655-964e-f7ca4f0ed34c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:19.312223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f23b3745f954e04b8257789be53ecd3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:19.318043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0aca-7f23-44bf-94d4-152510b6cc9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:19.319349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0aca-7f23-44bf-94d4-152510b6cc9c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:19.319696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0aca-7f23-44bf-94d4-152510b6cc9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:19.320098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ad0aca-7f23-44bf-94d4-152510b6cc9c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:19.321325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0aca-7f23-44bf-94d4-152510b6cc9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:19.327122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ad0aca-7f23-44bf-94d4-152510b6cc9c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:19.339543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f23b3745f954e04b8257789be53ecd3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:19.341781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f23b3745f954e04b8257789be53ecd3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:19.359638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f23b3745f954e04b8257789be53ecd3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:19.376532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f23b3745f954e04b8257789be53ecd3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:19.392984 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2757/5474] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:19 2022] POST /identity/v3/users => generated 294 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:19.394437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0aca-7f23-44bf-94d4-152510b6cc9c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:19.397777 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2718/5475] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:19 2022] DELETE /identity/v3/users/0f23b3745f954e04b8257789be53ecd3 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:19.402997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-62ad0aca-7f23-44bf-94d4-152510b6cc9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:19.437528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ad0aca-7f23-44bf-94d4-152510b6cc9c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:19.571347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030929-b9bb-4f00-8197-dac293a83b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:19.572044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030929-b9bb-4f00-8197-dac293a83b93 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:19.573578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030929-b9bb-4f00-8197-dac293a83b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:19.573578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41030929-b9bb-4f00-8197-dac293a83b93 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:19.574144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41030929-b9bb-4f00-8197-dac293a83b93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:19.576063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41030929-b9bb-4f00-8197-dac293a83b93 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:19.580222 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:19.594812 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2758/5476] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:19.597886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:19.615493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0750be-8037-402b-a0b2-ddd36a447ff9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:19.629496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997d823-c0db-461a-a075-a1e2a4f01f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:19.630203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d823-c0db-461a-a075-a1e2a4f01f2b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:19.630567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d823-c0db-461a-a075-a1e2a4f01f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:19.630851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b997d823-c0db-461a-a075-a1e2a4f01f2b admin admin] PATH_INFO: `/v3/projects/ac83741c2ea74c7b88f80ee7891f137e/users/378cdc708e6c4070ad719ad65f25dfe0/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:19.682712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997d823-c0db-461a-a075-a1e2a4f01f2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac83741c2ea74c7b88f80ee7891f137e, user_id=378cdc708e6c4070ad719ad65f25dfe0, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:19.689397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b997d823-c0db-461a-a075-a1e2a4f01f2b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:19.725990 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2719/5477] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:19 2022] PUT /identity/v3/projects/ac83741c2ea74c7b88f80ee7891f137e/users/378cdc708e6c4070ad719ad65f25dfe0/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:19.730301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030929-b9bb-4f00-8197-dac293a83b93 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:19.748510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41030929-b9bb-4f00-8197-dac293a83b93 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:19.909482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56144af5-5117-4f79-94bc-9a82547eac3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:19.910044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144af5-5117-4f79-94bc-9a82547eac3b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:19.910379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144af5-5117-4f79-94bc-9a82547eac3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:19.910658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144af5-5117-4f79-94bc-9a82547eac3b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:19.911751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56144af5-5117-4f79-94bc-9a82547eac3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:19.916403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56144af5-5117-4f79-94bc-9a82547eac3b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:19.949893 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2759/5478] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:19.951104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997d823-c0db-461a-a075-a1e2a4f01f2b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:19.961772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b997d823-c0db-461a-a075-a1e2a4f01f2b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:19.978055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eee42-cd8a-42a4-a2c7-bb2ce2b6a10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:19.978055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eee42-cd8a-42a4-a2c7-bb2ce2b6a10a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:19.978055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eee42-cd8a-42a4-a2c7-bb2ce2b6a10a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:19.978055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292eee42-cd8a-42a4-a2c7-bb2ce2b6a10a admin admin] PATH_INFO: `/v3/projects/ac83741c2ea74c7b88f80ee7891f137e/users/378cdc708e6c4070ad719ad65f25dfe0/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:19.981270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eee42-cd8a-42a4-a2c7-bb2ce2b6a10a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac83741c2ea74c7b88f80ee7891f137e, user_id=378cdc708e6c4070ad719ad65f25dfe0, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:19.985701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292eee42-cd8a-42a4-a2c7-bb2ce2b6a10a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:20.016720 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2720/5479] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:19 2022] PUT /identity/v3/projects/ac83741c2ea74c7b88f80ee7891f137e/users/378cdc708e6c4070ad719ad65f25dfe0/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:20.020218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e29b-fd96-4157-94c6-6015767ca1ef None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.023040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e29b-fd96-4157-94c6-6015767ca1ef None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.023495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a081e29b-fd96-4157-94c6-6015767ca1ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.098082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a081e29b-fd96-4157-94c6-6015767ca1ef None None] MFA Rules not processed for user `378cdc708e6c4070ad719ad65f25dfe0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:20.099944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a081e29b-fd96-4157-94c6-6015767ca1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:20.206469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eee42-cd8a-42a4-a2c7-bb2ce2b6a10a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:20.209761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-292eee42-cd8a-42a4-a2c7-bb2ce2b6a10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:20.294687 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2760/5480] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:20 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:20.295677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081e29b-fd96-4157-94c6-6015767ca1ef None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:20.305329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a081e29b-fd96-4157-94c6-6015767ca1ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:20.353147 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:20.414064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292eee42-cd8a-42a4-a2c7-bb2ce2b6a10a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:20.418940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:20.419630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.420544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.420544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] PATH_INFO: `/v3/projects/be810f51fba54f4b8583603cb37bdf6d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.421533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be810f51fba54f4b8583603cb37bdf6d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:20.424564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:20.449883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a081e29b-fd96-4157-94c6-6015767ca1ef None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:20.462798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:20.463538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.463814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.464090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] PATH_INFO: `/v3/projects/f698ba6878814fc3a7c7825530f2c9f8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.466196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f698ba6878814fc3a7c7825530f2c9f8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:20.468112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:20.531700 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:20.535308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be810f51fba54f4b8583603cb37bdf6d', 'request_id': 'req-4f54b3e6-7180-4fee-87ca-fab3af737816'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.551496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be810f51fba54f4b8583603cb37bdf6d', 'request_id': 'req-4f54b3e6-7180-4fee-87ca-fab3af737816'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.580942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be810f51fba54f4b8583603cb37bdf6d', 'request_id': 'req-4f54b3e6-7180-4fee-87ca-fab3af737816'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.601092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f698ba6878814fc3a7c7825530f2c9f8', 'request_id': 'req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.608918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] The token cache is being invalidate because project be810f51fba54f4b8583603cb37bdf6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:20.609213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.621768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f698ba6878814fc3a7c7825530f2c9f8', 'request_id': 'req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.622600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.630062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f698ba6878814fc3a7c7825530f2c9f8', 'request_id': 'req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.632961 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2721/5481] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:20 2022] DELETE /identity/v3/projects/be810f51fba54f4b8583603cb37bdf6d => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:20.633950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:20.636298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:20.655267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] The token cache is being invalidate because project f698ba6878814fc3a7c7825530f2c9f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:20.655838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.656690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fd9a53b4-5f78-4f8e-8714-e7b1752780a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:20.658407 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2761/5482] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:20 2022] DELETE /identity/v3/projects/f698ba6878814fc3a7c7825530f2c9f8 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:20.663413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4379f4-bc57-4ed0-abab-d97f4370c368 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.663881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4379f4-bc57-4ed0-abab-d97f4370c368 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.664299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4379f4-bc57-4ed0-abab-d97f4370c368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.689709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3e4379f4-bc57-4ed0-abab-d97f4370c368 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:20.691372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3e4379f4-bc57-4ed0-abab-d97f4370c368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:20.724296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54b3e6-7180-4fee-87ca-fab3af737816 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:20.793181 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2762/5483] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:20.794808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3678-ca61-4e7e-b8a8-48a0d79594f3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.795523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3678-ca61-4e7e-b8a8-48a0d79594f3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.796019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369d3678-ca61-4e7e-b8a8-48a0d79594f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.811102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb820f39-9c4c-4cf3-b8ae-93ffe5cfd15f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:20.812579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb820f39-9c4c-4cf3-b8ae-93ffe5cfd15f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.813043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb820f39-9c4c-4cf3-b8ae-93ffe5cfd15f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.813647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb820f39-9c4c-4cf3-b8ae-93ffe5cfd15f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.821179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-369d3678-ca61-4e7e-b8a8-48a0d79594f3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:20.822340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eb820f39-9c4c-4cf3-b8ae-93ffe5cfd15f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:20.823667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-369d3678-ca61-4e7e-b8a8-48a0d79594f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:20.841344 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2763/5484] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:20.843868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4fb0a-ee21-4efe-95ea-a326db8191fe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.844237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4fb0a-ee21-4efe-95ea-a326db8191fe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.844569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e4fb0a-ee21-4efe-95ea-a326db8191fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.868838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d3e4fb0a-ee21-4efe-95ea-a326db8191fe None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:20.871027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d3e4fb0a-ee21-4efe-95ea-a326db8191fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:20.880563 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2764/5485] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:20.882802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f580cf0-5705-4170-bb76-9bdea31a7f19 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.883195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f580cf0-5705-4170-bb76-9bdea31a7f19 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.883570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f580cf0-5705-4170-bb76-9bdea31a7f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.893024 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:20.913741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9f580cf0-5705-4170-bb76-9bdea31a7f19 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:20.913946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb820f39-9c4c-4cf3-b8ae-93ffe5cfd15f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:20.915411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb820f39-9c4c-4cf3-b8ae-93ffe5cfd15f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:20.915640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9f580cf0-5705-4170-bb76-9bdea31a7f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:20.924613 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2765/5486] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:20.928992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f580cf0-5705-4170-bb76-9bdea31a7f19 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:20.932857 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2722/5487] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:20.933731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb820f39-9c4c-4cf3-b8ae-93ffe5cfd15f service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:20.944556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f580cf0-5705-4170-bb76-9bdea31a7f19 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:20.950947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247afe4b-9514-4795-b2cb-be0e07c9e5e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:20.951761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247afe4b-9514-4795-b2cb-be0e07c9e5e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.952189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247afe4b-9514-4795-b2cb-be0e07c9e5e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.952636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247afe4b-9514-4795-b2cb-be0e07c9e5e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.953480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247afe4b-9514-4795-b2cb-be0e07c9e5e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:20.954274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247afe4b-9514-4795-b2cb-be0e07c9e5e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:20.956740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247afe4b-9514-4795-b2cb-be0e07c9e5e9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:20.960437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb820f39-9c4c-4cf3-b8ae-93ffe5cfd15f service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:20.971899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf38f90-d1a5-40fa-ba10-423a58e09836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:20.976866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf38f90-d1a5-40fa-ba10-423a58e09836 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.976866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf38f90-d1a5-40fa-ba10-423a58e09836 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.976866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf38f90-d1a5-40fa-ba10-423a58e09836 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:20.976866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf38f90-d1a5-40fa-ba10-423a58e09836 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:20.976866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf38f90-d1a5-40fa-ba10-423a58e09836 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:20.977699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf38f90-d1a5-40fa-ba10-423a58e09836 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:20.978212 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2766/5488] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:20.979721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247afe4b-9514-4795-b2cb-be0e07c9e5e9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:20.992363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247afe4b-9514-4795-b2cb-be0e07c9e5e9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:20.998110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeaaf5-a6bc-43a7-a85f-ab64530cb7b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:20.998778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeaaf5-a6bc-43a7-a85f-ab64530cb7b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:20.999061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeaaf5-a6bc-43a7-a85f-ab64530cb7b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:20.999334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaeaaf5-a6bc-43a7-a85f-ab64530cb7b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.000013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaeaaf5-a6bc-43a7-a85f-ab64530cb7b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.002212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaeaaf5-a6bc-43a7-a85f-ab64530cb7b3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.013200 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2723/5489] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:21.017520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf38f90-d1a5-40fa-ba10-423a58e09836 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.036538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf38f90-d1a5-40fa-ba10-423a58e09836 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.043651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2767/5490] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:20 2022] POST /identity/v3/projects => generated 377 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:21.048335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeaaf5-a6bc-43a7-a85f-ab64530cb7b3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.051435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c13202-d227-4a5c-9763-303dd7b3472b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.052066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c13202-d227-4a5c-9763-303dd7b3472b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.052349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c13202-d227-4a5c-9763-303dd7b3472b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.052704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c13202-d227-4a5c-9763-303dd7b3472b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.053374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c13202-d227-4a5c-9763-303dd7b3472b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.055776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c13202-d227-4a5c-9763-303dd7b3472b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.112829 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2724/5491] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:21 2022] POST /identity/v3/projects => generated 377 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:21.117063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c13202-d227-4a5c-9763-303dd7b3472b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.140612 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:21.151332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaeaaf5-a6bc-43a7-a85f-ab64530cb7b3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.251699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afa73e-b2e2-44f3-927c-01564e10bfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.252379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afa73e-b2e2-44f3-927c-01564e10bfb6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.252711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afa73e-b2e2-44f3-927c-01564e10bfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.253030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38afa73e-b2e2-44f3-927c-01564e10bfb6 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.254013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afa73e-b2e2-44f3-927c-01564e10bfb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.256759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38afa73e-b2e2-44f3-927c-01564e10bfb6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.268264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c13202-d227-4a5c-9763-303dd7b3472b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.289513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697200d4-044e-42e0-b264-a38bbeea5cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.290118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697200d4-044e-42e0-b264-a38bbeea5cf0 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.290400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697200d4-044e-42e0-b264-a38bbeea5cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.290674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697200d4-044e-42e0-b264-a38bbeea5cf0 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.291846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697200d4-044e-42e0-b264-a38bbeea5cf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.293942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697200d4-044e-42e0-b264-a38bbeea5cf0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.296091 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2768/5492] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:21 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:21.297372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afa73e-b2e2-44f3-927c-01564e10bfb6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.319265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38afa73e-b2e2-44f3-927c-01564e10bfb6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.328226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e443e-b82b-4527-9137-ef6dcecbd745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.329632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e443e-b82b-4527-9137-ef6dcecbd745 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.329928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e443e-b82b-4527-9137-ef6dcecbd745 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.330202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e443e-b82b-4527-9137-ef6dcecbd745 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.331186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e443e-b82b-4527-9137-ef6dcecbd745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.333160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e443e-b82b-4527-9137-ef6dcecbd745 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.334342 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2725/5493] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:21 2022] POST /identity/v3/users => generated 289 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:21.338871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697200d4-044e-42e0-b264-a38bbeea5cf0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.356006 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2769/5494] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:21.357235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697200d4-044e-42e0-b264-a38bbeea5cf0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.362101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e443e-b82b-4527-9137-ef6dcecbd745 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.372862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee81b74-79ac-47a6-ac63-82c2fc36e60b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.373532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81b74-79ac-47a6-ac63-82c2fc36e60b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.373815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81b74-79ac-47a6-ac63-82c2fc36e60b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.374090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee81b74-79ac-47a6-ac63-82c2fc36e60b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.374737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee81b74-79ac-47a6-ac63-82c2fc36e60b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.375645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e443e-b82b-4527-9137-ef6dcecbd745 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.376362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee81b74-79ac-47a6-ac63-82c2fc36e60b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.382889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa632cd-4d00-4a8b-ad56-b4d422c78ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.383696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa632cd-4d00-4a8b-ad56-b4d422c78ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.383999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa632cd-4d00-4a8b-ad56-b4d422c78ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.384299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa632cd-4d00-4a8b-ad56-b4d422c78ca6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.385160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa632cd-4d00-4a8b-ad56-b4d422c78ca6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.387059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa632cd-4d00-4a8b-ad56-b4d422c78ca6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.402339 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2726/5495] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:19:21.406076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee81b74-79ac-47a6-ac63-82c2fc36e60b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.412568 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2770/5496] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:21.419356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa632cd-4d00-4a8b-ad56-b4d422c78ca6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.420187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee81b74-79ac-47a6-ac63-82c2fc36e60b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.426884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf7a8a-0dff-4d30-b67a-fc15adcda2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.427862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf7a8a-0dff-4d30-b67a-fc15adcda2dd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.428306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf7a8a-0dff-4d30-b67a-fc15adcda2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.428737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adf7a8a-0dff-4d30-b67a-fc15adcda2dd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.429682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf7a8a-0dff-4d30-b67a-fc15adcda2dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.431569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa632cd-4d00-4a8b-ad56-b4d422c78ca6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.433308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adf7a8a-0dff-4d30-b67a-fc15adcda2dd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.443731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6ba5c-5952-4bc6-afc0-c752c061582d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.444494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6ba5c-5952-4bc6-afc0-c752c061582d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.444782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6ba5c-5952-4bc6-afc0-c752c061582d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.445059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6ba5c-5952-4bc6-afc0-c752c061582d admin admin] PATH_INFO: `/v3/projects/86c1c02dbeca4230a1849ab5b8c8f8d4/users/5e5b270ac0b049a2bb5de5052f4be905/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.458507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2727/5497] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:21.462588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf7a8a-0dff-4d30-b67a-fc15adcda2dd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.480677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adf7a8a-0dff-4d30-b67a-fc15adcda2dd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.489826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23f2e29-c4b2-4d1f-8e7a-0bf8d378665c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.490834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f2e29-c4b2-4d1f-8e7a-0bf8d378665c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.491907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f2e29-c4b2-4d1f-8e7a-0bf8d378665c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.492389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23f2e29-c4b2-4d1f-8e7a-0bf8d378665c admin admin] PATH_INFO: `/v3/projects/caff6b6128674f39a4262e7e06069efc/users/87fb4f5fea754f83af08ed7eaea42de8/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.496284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6ba5c-5952-4bc6-afc0-c752c061582d admin admin] RBAC: Authorizing `identity:create_grant(project_id=86c1c02dbeca4230a1849ab5b8c8f8d4, user_id=5e5b270ac0b049a2bb5de5052f4be905, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.516390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6ba5c-5952-4bc6-afc0-c752c061582d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.530028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f2e29-c4b2-4d1f-8e7a-0bf8d378665c admin admin] RBAC: Authorizing `identity:create_grant(project_id=caff6b6128674f39a4262e7e06069efc, user_id=87fb4f5fea754f83af08ed7eaea42de8, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.534318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23f2e29-c4b2-4d1f-8e7a-0bf8d378665c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.554300 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2771/5498] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:21 2022] PUT /identity/v3/projects/86c1c02dbeca4230a1849ab5b8c8f8d4/users/5e5b270ac0b049a2bb5de5052f4be905/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:21.555927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3d575-570d-4d0d-a69f-34aaf9f2cebe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.556220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3d575-570d-4d0d-a69f-34aaf9f2cebe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.556497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa3d575-570d-4d0d-a69f-34aaf9f2cebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.576886 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2728/5499] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:21 2022] PUT /identity/v3/projects/caff6b6128674f39a4262e7e06069efc/users/87fb4f5fea754f83af08ed7eaea42de8/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:21.590091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f735c-f58b-4266-95c7-704e159b71b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.590373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f735c-f58b-4266-95c7-704e159b71b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.590696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f735c-f58b-4266-95c7-704e159b71b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.601443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5fa3d575-570d-4d0d-a69f-34aaf9f2cebe None None] MFA Rules not processed for user `5e5b270ac0b049a2bb5de5052f4be905`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:21.605910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5fa3d575-570d-4d0d-a69f-34aaf9f2cebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:21.634420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-948f735c-f58b-4266-95c7-704e159b71b9 None None] MFA Rules not processed for user `87fb4f5fea754f83af08ed7eaea42de8`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:21.650242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-948f735c-f58b-4266-95c7-704e159b71b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:21.709931 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2772/5500] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:21.714932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3d575-570d-4d0d-a69f-34aaf9f2cebe None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.765724 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:21.821098 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2729/5501] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:21.822193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f735c-f58b-4266-95c7-704e159b71b9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.824861 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:21.864074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa3d575-570d-4d0d-a69f-34aaf9f2cebe None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:21.871769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0384256-5ac6-40a5-8df5-e051fbc24e9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:21.872395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0384256-5ac6-40a5-8df5-e051fbc24e9b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:21.872678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0384256-5ac6-40a5-8df5-e051fbc24e9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:21.872958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0384256-5ac6-40a5-8df5-e051fbc24e9b admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:21.873622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0384256-5ac6-40a5-8df5-e051fbc24e9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:21.875990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0384256-5ac6-40a5-8df5-e051fbc24e9b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:21.920118 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2773/5502] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:21 2022] POST /identity/v3/projects => generated 377 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:21.921895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0384256-5ac6-40a5-8df5-e051fbc24e9b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:21.931651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f735c-f58b-4266-95c7-704e159b71b9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.031877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d246ab-0f43-4b4e-bc43-cd9bb52417c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.032418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d246ab-0f43-4b4e-bc43-cd9bb52417c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.032707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d246ab-0f43-4b4e-bc43-cd9bb52417c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.032982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d246ab-0f43-4b4e-bc43-cd9bb52417c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.033722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d246ab-0f43-4b4e-bc43-cd9bb52417c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.035914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d246ab-0f43-4b4e-bc43-cd9bb52417c3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.039537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0384256-5ac6-40a5-8df5-e051fbc24e9b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.048685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a2a6-c351-4e6c-b014-cc69f8229133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.051057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a2a6-c351-4e6c-b014-cc69f8229133 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.052377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a2a6-c351-4e6c-b014-cc69f8229133 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.053082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a205a2a6-c351-4e6c-b014-cc69f8229133 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.054903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205a2a6-c351-4e6c-b014-cc69f8229133 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.059858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a205a2a6-c351-4e6c-b014-cc69f8229133 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.077144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2730/5503] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:21 2022] POST /identity/v3/projects => generated 375 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:22.081433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d246ab-0f43-4b4e-bc43-cd9bb52417c3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.107672 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2774/5504] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:21 2022] POST /identity/v3/users => generated 295 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:22.108823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a2a6-c351-4e6c-b014-cc69f8229133 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.124574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a205a2a6-c351-4e6c-b014-cc69f8229133 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.190216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d246ab-0f43-4b4e-bc43-cd9bb52417c3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.198061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76136fd-0f6f-4239-8352-05fa65fb80c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.198934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76136fd-0f6f-4239-8352-05fa65fb80c8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.199222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76136fd-0f6f-4239-8352-05fa65fb80c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.199601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76136fd-0f6f-4239-8352-05fa65fb80c8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.200647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76136fd-0f6f-4239-8352-05fa65fb80c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.203667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76136fd-0f6f-4239-8352-05fa65fb80c8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.219833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60b6d2-b843-4fc3-b601-d8af1bb3b4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.220645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60b6d2-b843-4fc3-b601-d8af1bb3b4c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.221021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60b6d2-b843-4fc3-b601-d8af1bb3b4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.221386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f60b6d2-b843-4fc3-b601-d8af1bb3b4c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.222325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60b6d2-b843-4fc3-b601-d8af1bb3b4c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.224371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f60b6d2-b843-4fc3-b601-d8af1bb3b4c7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.236699 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2731/5505] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:22 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:22.239489 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2775/5506] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:22.242341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76136fd-0f6f-4239-8352-05fa65fb80c8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.243191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60b6d2-b843-4fc3-b601-d8af1bb3b4c7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.249903 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:22.256485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76136fd-0f6f-4239-8352-05fa65fb80c8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.257651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f60b6d2-b843-4fc3-b601-d8af1bb3b4c7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.264574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfdaca-cb8d-485a-8b92-02c90a2f771c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.265946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfdaca-cb8d-485a-8b92-02c90a2f771c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.266945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296c9e-7b8e-4c84-b49b-3800d2c66a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.267270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfdaca-cb8d-485a-8b92-02c90a2f771c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.267410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296c9e-7b8e-4c84-b49b-3800d2c66a0a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.267577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296c9e-7b8e-4c84-b49b-3800d2c66a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.267857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef296c9e-7b8e-4c84-b49b-3800d2c66a0a admin admin] PATH_INFO: `/v3/projects/a73432a4c31446059871b879066d310e/users/20a74c21581741c3bae33eea874d28a4/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.269056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cfdaca-cb8d-485a-8b92-02c90a2f771c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.271095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cfdaca-cb8d-485a-8b92-02c90a2f771c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.273026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cfdaca-cb8d-485a-8b92-02c90a2f771c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.290599 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2732/5507] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:22.292171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfdaca-cb8d-485a-8b92-02c90a2f771c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.299403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296c9e-7b8e-4c84-b49b-3800d2c66a0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73432a4c31446059871b879066d310e, user_id=20a74c21581741c3bae33eea874d28a4, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.302509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef296c9e-7b8e-4c84-b49b-3800d2c66a0a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.309774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cfdaca-cb8d-485a-8b92-02c90a2f771c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.317619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c9fb2-6282-4cd6-9b3c-5332757154dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.318480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c9fb2-6282-4cd6-9b3c-5332757154dc admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.318866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c9fb2-6282-4cd6-9b3c-5332757154dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.320362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72c9fb2-6282-4cd6-9b3c-5332757154dc admin admin] PATH_INFO: `/v3/projects/3b425b933afd4c40a394a0872ebcccdf/users/2407ce8120ee43b2b67f8d7f7d1fd3e0/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.324935 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2776/5508] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:22 2022] PUT /identity/v3/projects/a73432a4c31446059871b879066d310e/users/20a74c21581741c3bae33eea874d28a4/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:22.328310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296c9e-7b8e-4c84-b49b-3800d2c66a0a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.350823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c9fb2-6282-4cd6-9b3c-5332757154dc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b425b933afd4c40a394a0872ebcccdf, user_id=2407ce8120ee43b2b67f8d7f7d1fd3e0, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.353670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72c9fb2-6282-4cd6-9b3c-5332757154dc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.372844 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2733/5509] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:22 2022] PUT /identity/v3/projects/3b425b933afd4c40a394a0872ebcccdf/users/2407ce8120ee43b2b67f8d7f7d1fd3e0/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:22.376643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c9fb2-6282-4cd6-9b3c-5332757154dc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.377497 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:22.429119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef296c9e-7b8e-4c84-b49b-3800d2c66a0a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.466571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72c9fb2-6282-4cd6-9b3c-5332757154dc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.473112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba39d-3689-4d61-86dc-0f2c39956495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.473808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba39d-3689-4d61-86dc-0f2c39956495 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.474262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba39d-3689-4d61-86dc-0f2c39956495 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.474593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2ba39d-3689-4d61-86dc-0f2c39956495 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.475572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ba39d-3689-4d61-86dc-0f2c39956495 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.478233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2ba39d-3689-4d61-86dc-0f2c39956495 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.493938 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2734/5510] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:22.498401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba39d-3689-4d61-86dc-0f2c39956495 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.512310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e702811-d86b-42cd-8f27-8e9553c0ddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.512929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702811-d86b-42cd-8f27-8e9553c0ddf8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.513208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702811-d86b-42cd-8f27-8e9553c0ddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.513531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e702811-d86b-42cd-8f27-8e9553c0ddf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.514180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e702811-d86b-42cd-8f27-8e9553c0ddf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.514474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2ba39d-3689-4d61-86dc-0f2c39956495 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.515939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e702811-d86b-42cd-8f27-8e9553c0ddf8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.521977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cf65a-2b72-411b-a8c8-e43a248a48e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.523537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cf65a-2b72-411b-a8c8-e43a248a48e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.524031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cf65a-2b72-411b-a8c8-e43a248a48e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.524549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165cf65a-2b72-411b-a8c8-e43a248a48e5 admin admin] PATH_INFO: `/v3/projects/3b425b933afd4c40a394a0872ebcccdf/users/2407ce8120ee43b2b67f8d7f7d1fd3e0/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.527678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cf65a-2b72-411b-a8c8-e43a248a48e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b425b933afd4c40a394a0872ebcccdf, user_id=2407ce8120ee43b2b67f8d7f7d1fd3e0, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.533595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165cf65a-2b72-411b-a8c8-e43a248a48e5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.548863 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2735/5511] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:22 2022] PUT /identity/v3/projects/3b425b933afd4c40a394a0872ebcccdf/users/2407ce8120ee43b2b67f8d7f7d1fd3e0/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:22.553355 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2777/5512] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:22 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:22.555158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cf65a-2b72-411b-a8c8-e43a248a48e5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.560720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaabe9e-5466-4ed0-9d7d-bb0e5586ec22 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.561219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaabe9e-5466-4ed0-9d7d-bb0e5586ec22 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.562042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaabe9e-5466-4ed0-9d7d-bb0e5586ec22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.627311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3eaabe9e-5466-4ed0-9d7d-bb0e5586ec22 None None] MFA Rules not processed for user `2407ce8120ee43b2b67f8d7f7d1fd3e0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:22.628816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3eaabe9e-5466-4ed0-9d7d-bb0e5586ec22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:22.657016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165cf65a-2b72-411b-a8c8-e43a248a48e5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.663256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c194314-381e-433e-933b-79ae47fbfe41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.664046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c194314-381e-433e-933b-79ae47fbfe41 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.664723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c194314-381e-433e-933b-79ae47fbfe41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.665008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c194314-381e-433e-933b-79ae47fbfe41 admin admin] PATH_INFO: `/v3/projects/a73432a4c31446059871b879066d310e/users/20a74c21581741c3bae33eea874d28a4/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.667865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c194314-381e-433e-933b-79ae47fbfe41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a73432a4c31446059871b879066d310e, user_id=20a74c21581741c3bae33eea874d28a4, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.673423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c194314-381e-433e-933b-79ae47fbfe41 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.693408 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2736/5513] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:22 2022] PUT /identity/v3/projects/a73432a4c31446059871b879066d310e/users/20a74c21581741c3bae33eea874d28a4/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:22.702034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a12360-ad83-4d3d-9119-a476895c08ae None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.702618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a12360-ad83-4d3d-9119-a476895c08ae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.702947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a12360-ad83-4d3d-9119-a476895c08ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.737203 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2778/5514] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:22.739256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaabe9e-5466-4ed0-9d7d-bb0e5586ec22 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.740464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f8a12360-ad83-4d3d-9119-a476895c08ae None None] MFA Rules not processed for user `20a74c21581741c3bae33eea874d28a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:22.743571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f8a12360-ad83-4d3d-9119-a476895c08ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:22.774880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaabe9e-5466-4ed0-9d7d-bb0e5586ec22 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.790197 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:22.853087 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2737/5515] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:22 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:22.858583 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:22.858737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a12360-ad83-4d3d-9119-a476895c08ae None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.869278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a12360-ad83-4d3d-9119-a476895c08ae None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:22.874950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa757-10d9-436d-bd3c-f30d29358309 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20a74c21581741c3bae33eea874d28a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a73432a4c31446059871b879066d310e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.875617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa757-10d9-436d-bd3c-f30d29358309 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.875903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa757-10d9-436d-bd3c-f30d29358309 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.876261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3aa757-10d9-436d-bd3c-f30d29358309 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.876852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa757-10d9-436d-bd3c-f30d29358309 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.878047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a499a5-cc6a-44a9-a586-04b01e579290 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2407ce8120ee43b2b67f8d7f7d1fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b425b933afd4c40a394a0872ebcccdf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:22.878913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3aa757-10d9-436d-bd3c-f30d29358309 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.879908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a499a5-cc6a-44a9-a586-04b01e579290 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:22.880811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a499a5-cc6a-44a9-a586-04b01e579290 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:22.881834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a499a5-cc6a-44a9-a586-04b01e579290 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:22.883437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a499a5-cc6a-44a9-a586-04b01e579290 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:22.887844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a499a5-cc6a-44a9-a586-04b01e579290 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:22.905048 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2738/5516] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:19:22 2022] POST /identity/v3/domains => generated 246 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:22.907870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa757-10d9-436d-bd3c-f30d29358309 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:22.937270 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2779/5517] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:22 2022] POST /identity/v3/projects => generated 334 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:22.938347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a499a5-cc6a-44a9-a586-04b01e579290 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.011293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3aa757-10d9-436d-bd3c-f30d29358309 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.056595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a499a5-cc6a-44a9-a586-04b01e579290 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.072824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9a749-fc0d-45c3-b93e-48bc898f813b tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2407ce8120ee43b2b67f8d7f7d1fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b425b933afd4c40a394a0872ebcccdf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.073832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9a749-fc0d-45c3-b93e-48bc898f813b tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.074697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9a749-fc0d-45c3-b93e-48bc898f813b tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.075248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc9a749-fc0d-45c3-b93e-48bc898f813b tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.076211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9a749-fc0d-45c3-b93e-48bc898f813b tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.080645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc9a749-fc0d-45c3-b93e-48bc898f813b tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.141069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a7d89-39e5-4d35-a239-a8958b15135a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20a74c21581741c3bae33eea874d28a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a73432a4c31446059871b879066d310e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.142135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a7d89-39e5-4d35-a239-a8958b15135a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.142610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a7d89-39e5-4d35-a239-a8958b15135a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.143208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1a7d89-39e5-4d35-a239-a8958b15135a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.144155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a7d89-39e5-4d35-a239-a8958b15135a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.145328 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2780/5518] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:19:22 2022] POST /identity/v3/projects => generated 333 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:23.147426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1a7d89-39e5-4d35-a239-a8958b15135a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.149364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9a749-fc0d-45c3-b93e-48bc898f813b tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.202414 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2739/5519] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:22 2022] POST /identity/v3/projects => generated 409 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:23.205476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a7d89-39e5-4d35-a239-a8958b15135a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.252908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc9a749-fc0d-45c3-b93e-48bc898f813b tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.281313 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:23.320921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1a7d89-39e5-4d35-a239-a8958b15135a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.329043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a18e16-93a1-4890-a0ab-95282bdee4a7 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20a74c21581741c3bae33eea874d28a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a73432a4c31446059871b879066d310e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.330604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a18e16-93a1-4890-a0ab-95282bdee4a7 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.331050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a18e16-93a1-4890-a0ab-95282bdee4a7 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.331923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a18e16-93a1-4890-a0ab-95282bdee4a7 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.332756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a18e16-93a1-4890-a0ab-95282bdee4a7 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.337493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a18e16-93a1-4890-a0ab-95282bdee4a7 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.349121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c9ac0-6dee-45c6-94d5-9d4e5c7aedc2 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2407ce8120ee43b2b67f8d7f7d1fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b425b933afd4c40a394a0872ebcccdf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.350074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c9ac0-6dee-45c6-94d5-9d4e5c7aedc2 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.350458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c9ac0-6dee-45c6-94d5-9d4e5c7aedc2 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.350909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087c9ac0-6dee-45c6-94d5-9d4e5c7aedc2 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.351747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c9ac0-6dee-45c6-94d5-9d4e5c7aedc2 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.356609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087c9ac0-6dee-45c6-94d5-9d4e5c7aedc2 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.378953 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:23.383173 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2740/5520] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:23 2022] POST /identity/v3/users => generated 348 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:23.389117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a18e16-93a1-4890-a0ab-95282bdee4a7 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.405809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a18e16-93a1-4890-a0ab-95282bdee4a7 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.413621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c65b3f-0d72-488e-8912-0080378ac99a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20a74c21581741c3bae33eea874d28a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a73432a4c31446059871b879066d310e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.416124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c65b3f-0d72-488e-8912-0080378ac99a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.416779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c65b3f-0d72-488e-8912-0080378ac99a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.417239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c65b3f-0d72-488e-8912-0080378ac99a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.418530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c65b3f-0d72-488e-8912-0080378ac99a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.420419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c65b3f-0d72-488e-8912-0080378ac99a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.429337 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2781/5521] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:23 2022] POST /identity/v3/projects => generated 358 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:23.432728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c9ac0-6dee-45c6-94d5-9d4e5c7aedc2 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.438448 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2741/5522] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:23.442374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c65b3f-0d72-488e-8912-0080378ac99a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.456475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c65b3f-0d72-488e-8912-0080378ac99a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.544429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087c9ac0-6dee-45c6-94d5-9d4e5c7aedc2 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.548076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf72a314-d1dd-484d-970d-10dc2075ec0a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20a74c21581741c3bae33eea874d28a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a73432a4c31446059871b879066d310e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.549583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72a314-d1dd-484d-970d-10dc2075ec0a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.549944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caa77d-a92a-466c-88ce-de7aa635a602 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2407ce8120ee43b2b67f8d7f7d1fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b425b933afd4c40a394a0872ebcccdf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.550410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72a314-d1dd-484d-970d-10dc2075ec0a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.550620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caa77d-a92a-466c-88ce-de7aa635a602 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.550916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caa77d-a92a-466c-88ce-de7aa635a602 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.551309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34caa77d-a92a-466c-88ce-de7aa635a602 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.551830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf72a314-d1dd-484d-970d-10dc2075ec0a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] PATH_INFO: `/v3/projects/f7897b045f164f80bbe37ce6b1a1f309/users/666a730bae8848108191067c7be0b6cf/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.551951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34caa77d-a92a-466c-88ce-de7aa635a602 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.554661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34caa77d-a92a-466c-88ce-de7aa635a602 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.578904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72a314-d1dd-484d-970d-10dc2075ec0a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorizing `identity:create_grant(project_id=f7897b045f164f80bbe37ce6b1a1f309, user_id=666a730bae8848108191067c7be0b6cf, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.586587 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2782/5523] 10.222.0.25 () {58 vars in 1131 bytes} [Mon Oct 24 09:19:23 2022] GET /identity/v3/projects => generated 8293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:23.587456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf72a314-d1dd-484d-970d-10dc2075ec0a tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.587829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caa77d-a92a-466c-88ce-de7aa635a602 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.607143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34caa77d-a92a-466c-88ce-de7aa635a602 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.612252 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2742/5524] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:23 2022] PUT /identity/v3/projects/f7897b045f164f80bbe37ce6b1a1f309/users/666a730bae8848108191067c7be0b6cf/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:23.620073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c59e-9c18-49a1-af7d-19560a1577ae None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.620585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c59e-9c18-49a1-af7d-19560a1577ae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.621709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2497c59e-9c18-49a1-af7d-19560a1577ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.694678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6760b0-9d7c-4164-bb4b-6eeacde27cfc tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2407ce8120ee43b2b67f8d7f7d1fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b425b933afd4c40a394a0872ebcccdf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.695421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6760b0-9d7c-4164-bb4b-6eeacde27cfc tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.696272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6760b0-9d7c-4164-bb4b-6eeacde27cfc tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.696272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6760b0-9d7c-4164-bb4b-6eeacde27cfc tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.696866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6760b0-9d7c-4164-bb4b-6eeacde27cfc tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Adding query filter params (enabled=False) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:23.697184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6760b0-9d7c-4164-bb4b-6eeacde27cfc tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.699114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6760b0-9d7c-4164-bb4b-6eeacde27cfc tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.822563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2497c59e-9c18-49a1-af7d-19560a1577ae None None] MFA Rules not processed for user `666a730bae8848108191067c7be0b6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:23.828991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2497c59e-9c18-49a1-af7d-19560a1577ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:23.864923 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2743/5525] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:23.866891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ca298-f31a-498c-b8df-d591a56d5981 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.867286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ca298-f31a-498c-b8df-d591a56d5981 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.867666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5ca298-f31a-498c-b8df-d591a56d5981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.885752 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2783/5526] 10.222.0.25 () {58 vars in 1158 bytes} [Mon Oct 24 09:19:23 2022] GET /identity/v3/projects?enabled=False => generated 445 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:23.895988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6760b0-9d7c-4164-bb4b-6eeacde27cfc tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.906585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4d5ca298-f31a-498c-b8df-d591a56d5981 None None] MFA Rules not processed for user `666a730bae8848108191067c7be0b6cf`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:23.907820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6760b0-9d7c-4164-bb4b-6eeacde27cfc tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.908148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4d5ca298-f31a-498c-b8df-d591a56d5981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:23.920196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b7ac-71d8-4ff8-9b24-30f45e64ecd1 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2407ce8120ee43b2b67f8d7f7d1fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b425b933afd4c40a394a0872ebcccdf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.920196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b7ac-71d8-4ff8-9b24-30f45e64ecd1 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.920196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b7ac-71d8-4ff8-9b24-30f45e64ecd1 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.920667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6b7ac-71d8-4ff8-9b24-30f45e64ecd1 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.920667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6b7ac-71d8-4ff8-9b24-30f45e64ecd1 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Adding query filter params (parent_id=3d5c50d78b1346d9909ce8576a3d00bf) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:23.920667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6b7ac-71d8-4ff8-9b24-30f45e64ecd1 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.920667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6b7ac-71d8-4ff8-9b24-30f45e64ecd1 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.940760 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2744/5527] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:23.940982 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2784/5528] 10.222.0.25 () {58 vars in 1216 bytes} [Mon Oct 24 09:19:23 2022] GET /identity/v3/projects?parent_id=3d5c50d78b1346d9909ce8576a3d00bf => generated 498 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:19:23.941105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ca298-f31a-498c-b8df-d591a56d5981 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.946593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b7ac-71d8-4ff8-9b24-30f45e64ecd1 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:23.959207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5ca298-f31a-498c-b8df-d591a56d5981 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.960506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6b7ac-71d8-4ff8-9b24-30f45e64ecd1 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:23.967471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2407ce8120ee43b2b67f8d7f7d1fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b425b933afd4c40a394a0872ebcccdf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.968171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.968509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.968852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] PATH_INFO: `/v3/projects/5ad387e0543a4d06b4764ce27507f9a9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.970243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5ad387e0543a4d06b4764ce27507f9a9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.970381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881ba7d-c58a-4a45-b030-4265095021e1 tempest-test_project-474193475 tempest-user-1194027245] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '666a730bae8848108191067c7be0b6cf', 'user_domain_id': '0e1ca7e473d04cebbb3e930fdefe8e10', 'system_scope': None, 'project_id': 'f7897b045f164f80bbe37ce6b1a1f309', 'project_domain_id': '0e1ca7e473d04cebbb3e930fdefe8e10', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:23.971987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881ba7d-c58a-4a45-b030-4265095021e1 tempest-test_project-474193475 tempest-user-1194027245] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:23.972489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881ba7d-c58a-4a45-b030-4265095021e1 tempest-test_project-474193475 tempest-user-1194027245] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:23.972840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7881ba7d-c58a-4a45-b030-4265095021e1 tempest-test_project-474193475 tempest-user-1194027245] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:23.973218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:23.981757 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:23.986923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881ba7d-c58a-4a45-b030-4265095021e1 tempest-test_project-474193475 tempest-user-1194027245] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:23.991874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7881ba7d-c58a-4a45-b030-4265095021e1 tempest-test_project-474193475 tempest-user-1194027245] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:24.032537 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2745/5529] 10.222.0.25 () {56 vars in 1284 bytes} [Mon Oct 24 09:19:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:24.034934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881ba7d-c58a-4a45-b030-4265095021e1 tempest-test_project-474193475 tempest-user-1194027245] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:24.045706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ad387e0543a4d06b4764ce27507f9a9', 'request_id': 'req-56a80763-0d93-4bb2-b8b5-4bfe4d277036'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.059193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ad387e0543a4d06b4764ce27507f9a9', 'request_id': 'req-56a80763-0d93-4bb2-b8b5-4bfe4d277036'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.062302 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:24.076594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ad387e0543a4d06b4764ce27507f9a9', 'request_id': 'req-56a80763-0d93-4bb2-b8b5-4bfe4d277036'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.096923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] The token cache is being invalidate because project 5ad387e0543a4d06b4764ce27507f9a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:24.097231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.098087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.105091 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2785/5530] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:23 2022] DELETE /identity/v3/projects/5ad387e0543a4d06b4764ce27507f9a9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:24.106897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:24.110331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:24.198171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7881ba7d-c58a-4a45-b030-4265095021e1 tempest-test_project-474193475 tempest-user-1194027245] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:24.218771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a80763-0d93-4bb2-b8b5-4bfe4d277036 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:24.227569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2407ce8120ee43b2b67f8d7f7d1fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b425b933afd4c40a394a0872ebcccdf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:24.228384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:24.229400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:24.229745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] PATH_INFO: `/v3/projects/3d5c50d78b1346d9909ce8576a3d00bf` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:24.231912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorizing `identity:delete_project(project_id=3d5c50d78b1346d9909ce8576a3d00bf)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:24.234906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:24.293496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20a74c21581741c3bae33eea874d28a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a73432a4c31446059871b879066d310e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:24.295257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:24.295572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:24.295963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] PATH_INFO: `/v3/users/666a730bae8848108191067c7be0b6cf` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:24.298917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorizing `identity:delete_user(user_id=666a730bae8848108191067c7be0b6cf)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:24.301334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:24.315554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d5c50d78b1346d9909ce8576a3d00bf', 'request_id': 'req-30d17548-5b58-436a-9cb2-310c9577c080'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.330397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d5c50d78b1346d9909ce8576a3d00bf', 'request_id': 'req-30d17548-5b58-436a-9cb2-310c9577c080'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.341646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d5c50d78b1346d9909ce8576a3d00bf', 'request_id': 'req-30d17548-5b58-436a-9cb2-310c9577c080'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.376572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] The token cache is being invalidate because project 3d5c50d78b1346d9909ce8576a3d00bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:24.377615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666a730bae8848108191067c7be0b6cf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.378958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.383009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.385399 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2786/5531] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:24 2022] DELETE /identity/v3/projects/3d5c50d78b1346d9909ce8576a3d00bf => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:24.389121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:24.394409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:24.396498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666a730bae8848108191067c7be0b6cf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.397314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666a730bae8848108191067c7be0b6cf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.417214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666a730bae8848108191067c7be0b6cf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.432764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666a730bae8848108191067c7be0b6cf'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.442021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2746/5532] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:24 2022] DELETE /identity/v3/users/666a730bae8848108191067c7be0b6cf => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:24.446275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:24.448800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:24.484417 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:24.518384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d17548-5b58-436a-9cb2-310c9577c080 tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:24.543935 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:24.560642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ffe45-14f1-4e55-b3ea-f8bd563b0981 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:24.568721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20a74c21581741c3bae33eea874d28a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a73432a4c31446059871b879066d310e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:24.570660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:24.571805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:24.572430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] PATH_INFO: `/v3/projects/f7897b045f164f80bbe37ce6b1a1f309` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:24.575833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f7897b045f164f80bbe37ce6b1a1f309)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:24.578268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:24.630663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2407ce8120ee43b2b67f8d7f7d1fd3e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3b425b933afd4c40a394a0872ebcccdf', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:24.632422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:24.632685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:24.632973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] PATH_INFO: `/v3/projects/c01d6977c9cd4bbba560987326729cc8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:24.636107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorizing `identity:delete_project(project_id=c01d6977c9cd4bbba560987326729cc8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:24.640199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:24.658268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7897b045f164f80bbe37ce6b1a1f309', 'request_id': 'req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.667887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7897b045f164f80bbe37ce6b1a1f309', 'request_id': 'req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.681265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7897b045f164f80bbe37ce6b1a1f309', 'request_id': 'req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.716158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] The token cache is being invalidate because project f7897b045f164f80bbe37ce6b1a1f309 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:24.716863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.720998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.726349 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2747/5533] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:24 2022] DELETE /identity/v3/projects/f7897b045f164f80bbe37ce6b1a1f309 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:24.731070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:24.735862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:24.794866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01d6977c9cd4bbba560987326729cc8', 'request_id': 'req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.808755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01d6977c9cd4bbba560987326729cc8', 'request_id': 'req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.819286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01d6977c9cd4bbba560987326729cc8', 'request_id': 'req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.836564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] The token cache is being invalidate because project c01d6977c9cd4bbba560987326729cc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:24.837041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.838034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:24.843358 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2787/5534] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:24 2022] DELETE /identity/v3/projects/c01d6977c9cd4bbba560987326729cc8 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:24.844644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:24.846114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:24.914505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c03d6-5021-4a5a-87f4-1f87f9a0ab4f tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:24.990692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41b4c17-c1f2-4b94-8fa1-9c82d93a4c2a tempest-ListProjectsTestJSON-618985341 tempest-ListProjectsTestJSON-618985341-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:25.013343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:25.013343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:25.013343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:25.013343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] PATH_INFO: `/v3/users/87fb4f5fea754f83af08ed7eaea42de8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:25.020233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87fb4f5fea754f83af08ed7eaea42de8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:25.022399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:25.023348 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:25.035654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20a74c21581741c3bae33eea874d28a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a73432a4c31446059871b879066d310e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:25.036760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:25.037335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:25.037931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] PATH_INFO: `/v3/domains/0e1ca7e473d04cebbb3e930fdefe8e10` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:25.039692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0e1ca7e473d04cebbb3e930fdefe8e10)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:25.042804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:25.086055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.087247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.129554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.130481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.135512 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2748/5535] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:19:24 2022] PATCH /identity/v3/domains/0e1ca7e473d04cebbb3e930fdefe8e10 => generated 247 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:25.141021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:25.146864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:25.167428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87fb4f5fea754f83af08ed7eaea42de8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.180568 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:25.193200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87fb4f5fea754f83af08ed7eaea42de8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.194530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87fb4f5fea754f83af08ed7eaea42de8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.211950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87fb4f5fea754f83af08ed7eaea42de8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.227808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddc300af-5bc2-49bf-9524-e669efef2434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87fb4f5fea754f83af08ed7eaea42de8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.238769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2788/5536] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:24 2022] DELETE /identity/v3/users/87fb4f5fea754f83af08ed7eaea42de8 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:25.245945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851dfea-d6af-4c94-85c8-ac4e0dc58a87 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:25.246278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851dfea-d6af-4c94-85c8-ac4e0dc58a87 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:25.246626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851dfea-d6af-4c94-85c8-ac4e0dc58a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:25.264445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001030fc-f37e-4db2-a1f0-1bb0608d21c2 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:25.293083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b851dfea-d6af-4c94-85c8-ac4e0dc58a87 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:25.297213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b851dfea-d6af-4c94-85c8-ac4e0dc58a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:25.339603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '20a74c21581741c3bae33eea874d28a4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a73432a4c31446059871b879066d310e', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:25.340911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:25.341522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:25.342150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] PATH_INFO: `/v3/domains/0e1ca7e473d04cebbb3e930fdefe8e10` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:25.355765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0e1ca7e473d04cebbb3e930fdefe8e10)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:25.358170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:25.395516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.401690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.440979 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2789/5537] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:25.461025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851dfea-d6af-4c94-85c8-ac4e0dc58a87 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:25.462506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b851dfea-d6af-4c94-85c8-ac4e0dc58a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:25.471079 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:25.488093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10', 'request_id': 'req-f8b7aaa7-4de3-4498-a974-a8338b7818d3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.515352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10', 'request_id': 'req-f8b7aaa7-4de3-4498-a974-a8338b7818d3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.528105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10', 'request_id': 'req-f8b7aaa7-4de3-4498-a974-a8338b7818d3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.550016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] The token cache is being invalidate because project 0e1ca7e473d04cebbb3e930fdefe8e10 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:25.550349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.551153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.569339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10', 'request_id': 'req-f8b7aaa7-4de3-4498-a974-a8338b7818d3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.572337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10', 'request_id': 'req-f8b7aaa7-4de3-4498-a974-a8338b7818d3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.574711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0e1ca7e473d04cebbb3e930fdefe8e10', 'request_id': 'req-f8b7aaa7-4de3-4498-a974-a8338b7818d3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:25.593066 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2749/5538] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:25 2022] DELETE /identity/v3/domains/0e1ca7e473d04cebbb3e930fdefe8e10 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:25.603571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:25.611533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:25.618539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851dfea-d6af-4c94-85c8-ac4e0dc58a87 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:25.761284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e3416-b4be-4eef-bf0f-63ef48199280 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:25.762203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3416-b4be-4eef-bf0f-63ef48199280 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:25.762582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3416-b4be-4eef-bf0f-63ef48199280 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:25.762945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e3416-b4be-4eef-bf0f-63ef48199280 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:25.769949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-816e3416-b4be-4eef-bf0f-63ef48199280 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:25.841893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b7aaa7-4de3-4498-a974-a8338b7818d3 tempest-TestDefaultProjectId-1433861138 tempest-TestDefaultProjectId-1433861138-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:25.859748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:25.862263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:25.862778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:25.863160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] PATH_INFO: `/v3/users/5e5b270ac0b049a2bb5de5052f4be905` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:25.865465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e5b270ac0b049a2bb5de5052f4be905)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:25.875164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:25.907525 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:25.957450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e3416-b4be-4eef-bf0f-63ef48199280 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:25.959659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e3416-b4be-4eef-bf0f-63ef48199280 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:25.976751 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2790/5539] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:19:26.002816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e5b270ac0b049a2bb5de5052f4be905'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:26.032192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e5b270ac0b049a2bb5de5052f4be905'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:26.034237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e5b270ac0b049a2bb5de5052f4be905'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:26.046933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e5b270ac0b049a2bb5de5052f4be905'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:26.067609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e5b270ac0b049a2bb5de5052f4be905'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:26.082087 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2750/5540] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:25 2022] DELETE /identity/v3/users/5e5b270ac0b049a2bb5de5052f4be905 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:26.087000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8794-5ea6-432f-95d7-42f251aa11b1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:26.087290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8794-5ea6-432f-95d7-42f251aa11b1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:26.087566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6be8794-5ea6-432f-95d7-42f251aa11b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:26.118031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b6be8794-5ea6-432f-95d7-42f251aa11b1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:26.120506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6be8794-5ea6-432f-95d7-42f251aa11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:26.228109 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2791/5541] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:26.248181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:26.250632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:26.318985 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:26.378675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68dc78e3-9aed-4ee4-9432-0bcbccae9dd2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:26.405021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72a912-d4e2-4b88-a947-48c254648df0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:26.406597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72a912-d4e2-4b88-a947-48c254648df0 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:26.408178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72a912-d4e2-4b88-a947-48c254648df0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:26.408662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f72a912-d4e2-4b88-a947-48c254648df0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:26.432282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72a912-d4e2-4b88-a947-48c254648df0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:26.434668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f72a912-d4e2-4b88-a947-48c254648df0 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:26.451113 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2751/5542] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:26.679921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8794-5ea6-432f-95d7-42f251aa11b1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:26.682734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6be8794-5ea6-432f-95d7-42f251aa11b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:26.702327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6be8794-5ea6-432f-95d7-42f251aa11b1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:26.707076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:26.707783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:26.708135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:26.708570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:26.710838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:26.876689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72a912-d4e2-4b88-a947-48c254648df0 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:26.878140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4f72a912-d4e2-4b88-a947-48c254648df0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:26.913007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f72a912-d4e2-4b88-a947-48c254648df0 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:26.963412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:26.964096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:26.964381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:26.964662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] PATH_INFO: `/v3/projects/caff6b6128674f39a4262e7e06069efc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:26.997264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caff6b6128674f39a4262e7e06069efc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:26.999236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:27.003704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:27.005176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:27.088221 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2792/5543] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:27.223738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:27.225827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:27.248383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caff6b6128674f39a4262e7e06069efc', 'request_id': 'req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.268166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a68cf9-50ee-4129-a4c9-ae75e3be13f3 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:27.276092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caff6b6128674f39a4262e7e06069efc', 'request_id': 'req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.316407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caff6b6128674f39a4262e7e06069efc', 'request_id': 'req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.360840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] The token cache is being invalidate because project caff6b6128674f39a4262e7e06069efc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:27.364046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.370673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.373624 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2752/5544] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:26 2022] DELETE /identity/v3/projects/caff6b6128674f39a4262e7e06069efc => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:27.377956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:27.381558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:27.477549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:27.478296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:27.479616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:27.480077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] PATH_INFO: `/v3/projects/86c1c02dbeca4230a1849ab5b8c8f8d4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:27.483165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86c1c02dbeca4230a1849ab5b8c8f8d4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:27.486260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:27.517565 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:27.547094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09541a-cf6a-4225-bc36-8e4300ebe0f2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:27.565445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:27.567060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:27.567593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:27.568217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] PATH_INFO: `/v3/users/2407ce8120ee43b2b67f8d7f7d1fd3e0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:27.571717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2407ce8120ee43b2b67f8d7f7d1fd3e0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:27.575256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:27.598733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86c1c02dbeca4230a1849ab5b8c8f8d4', 'request_id': 'req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.622530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86c1c02dbeca4230a1849ab5b8c8f8d4', 'request_id': 'req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.634322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86c1c02dbeca4230a1849ab5b8c8f8d4', 'request_id': 'req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.657119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] The token cache is being invalidate because project 86c1c02dbeca4230a1849ab5b8c8f8d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:27.663539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.666014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.686638 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2793/5545] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:27 2022] DELETE /identity/v3/projects/86c1c02dbeca4230a1849ab5b8c8f8d4 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:27.688769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:27.691121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:27.727212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2407ce8120ee43b2b67f8d7f7d1fd3e0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.743149 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:27.785285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2407ce8120ee43b2b67f8d7f7d1fd3e0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.789984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2407ce8120ee43b2b67f8d7f7d1fd3e0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.815608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2407ce8120ee43b2b67f8d7f7d1fd3e0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.839891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2407ce8120ee43b2b67f8d7f7d1fd3e0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:27.861696 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2753/5546] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:27 2022] DELETE /identity/v3/users/2407ce8120ee43b2b67f8d7f7d1fd3e0 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:27.935562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e1b3df-fb5e-49d8-9ee3-30d0deb5bdd0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:28.168337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:28.169362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:28.169942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:28.170599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] PATH_INFO: `/v3/users/20a74c21581741c3bae33eea874d28a4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:28.175100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20a74c21581741c3bae33eea874d28a4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:28.178682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:28.301963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20a74c21581741c3bae33eea874d28a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.315544 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:28.352649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20a74c21581741c3bae33eea874d28a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.353708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20a74c21581741c3bae33eea874d28a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.367730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20a74c21581741c3bae33eea874d28a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.403147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-82f791e5-8b14-4cbf-9264-ce98f8d41cf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20a74c21581741c3bae33eea874d28a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.415301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:28.417452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:28.419135 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2794/5547] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:27 2022] DELETE /identity/v3/users/20a74c21581741c3bae33eea874d28a4 => generated 0 bytes in 732 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:28.458102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea51aed-7125-4e4b-a232-98aebb60960c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:28.581273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:28.582017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:28.582399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:28.582682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] PATH_INFO: `/v3/projects/3b425b933afd4c40a394a0872ebcccdf` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:28.584245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b425b933afd4c40a394a0872ebcccdf)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:28.586553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:28.694764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b425b933afd4c40a394a0872ebcccdf', 'request_id': 'req-1c96d887-cb8a-46ee-8c61-83bfd89abd47'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.707606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b425b933afd4c40a394a0872ebcccdf', 'request_id': 'req-1c96d887-cb8a-46ee-8c61-83bfd89abd47'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.731025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b425b933afd4c40a394a0872ebcccdf', 'request_id': 'req-1c96d887-cb8a-46ee-8c61-83bfd89abd47'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.747460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] The token cache is being invalidate because project 3b425b933afd4c40a394a0872ebcccdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:28.747764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.750468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1c96d887-cb8a-46ee-8c61-83bfd89abd47 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:28.753594 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2754/5548] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:28 2022] DELETE /identity/v3/projects/3b425b933afd4c40a394a0872ebcccdf => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:28.759131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c64369-54e8-4ee6-931c-556dd9208cb0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:28.759434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c64369-54e8-4ee6-931c-556dd9208cb0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:28.760220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c64369-54e8-4ee6-931c-556dd9208cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:28.804168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f7c64369-54e8-4ee6-931c-556dd9208cb0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:28.808015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7c64369-54e8-4ee6-931c-556dd9208cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:28.966888 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2795/5549] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:28.977491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e715c4-c2c4-47d2-b376-3bf2503ed3ac None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:28.977876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e715c4-c2c4-47d2-b376-3bf2503ed3ac None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:28.978163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e715c4-c2c4-47d2-b376-3bf2503ed3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.038057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c64369-54e8-4ee6-931c-556dd9208cb0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.040315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7c64369-54e8-4ee6-931c-556dd9208cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:29.069796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-73e715c4-c2c4-47d2-b376-3bf2503ed3ac None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:29.077592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-73e715c4-c2c4-47d2-b376-3bf2503ed3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:29.091932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c64369-54e8-4ee6-931c-556dd9208cb0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:29.116934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:29.117339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.117638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.124626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] PATH_INFO: `/v3/projects/a73432a4c31446059871b879066d310e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.124626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a73432a4c31446059871b879066d310e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:29.125063 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2755/5550] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:29.125978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e715c4-c2c4-47d2-b376-3bf2503ed3ac None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.133332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:29.171548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e715c4-c2c4-47d2-b376-3bf2503ed3ac None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:29.186225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13d56-2650-41ef-8061-a2dfac92e83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:29.187099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13d56-2650-41ef-8061-a2dfac92e83e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.187523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13d56-2650-41ef-8061-a2dfac92e83e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.187930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f13d56-2650-41ef-8061-a2dfac92e83e admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.188647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13d56-2650-41ef-8061-a2dfac92e83e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:29.189717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13d56-2650-41ef-8061-a2dfac92e83e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:29.205843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f13d56-2650-41ef-8061-a2dfac92e83e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:29.225506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a73432a4c31446059871b879066d310e', 'request_id': 'req-df62b0f1-1854-4dac-abc4-b0872efc4593'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:29.233382 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2756/5551] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:29.237655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a73432a4c31446059871b879066d310e', 'request_id': 'req-df62b0f1-1854-4dac-abc4-b0872efc4593'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:29.238967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13d56-2650-41ef-8061-a2dfac92e83e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.250023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a73432a4c31446059871b879066d310e', 'request_id': 'req-df62b0f1-1854-4dac-abc4-b0872efc4593'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:29.255637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f13d56-2650-41ef-8061-a2dfac92e83e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:29.267626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] The token cache is being invalidate because project a73432a4c31446059871b879066d310e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:29.268001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:29.269199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df62b0f1-1854-4dac-abc4-b0872efc4593 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:29.273338 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2796/5552] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:29 2022] DELETE /identity/v3/projects/a73432a4c31446059871b879066d310e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:29.277216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71890003-a3b1-4528-ab0d-c73f09a0600b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.277216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71890003-a3b1-4528-ab0d-c73f09a0600b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.277711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71890003-a3b1-4528-ab0d-c73f09a0600b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.316172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-71890003-a3b1-4528-ab0d-c73f09a0600b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:29.317758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-71890003-a3b1-4528-ab0d-c73f09a0600b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:29.353945 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:29.395661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6568f1-415a-47f4-a08f-e1f8b1140aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:29.396366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6568f1-415a-47f4-a08f-e1f8b1140aea admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.396651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6568f1-415a-47f4-a08f-e1f8b1140aea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.397324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6568f1-415a-47f4-a08f-e1f8b1140aea admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.397676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6568f1-415a-47f4-a08f-e1f8b1140aea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:29.400910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6568f1-415a-47f4-a08f-e1f8b1140aea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:29.418132 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:29.463807 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2757/5553] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:29 2022] POST /identity/v3/projects => generated 393 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:29.464971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6568f1-415a-47f4-a08f-e1f8b1140aea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.465910 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2797/5554] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:29.466826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bf6568f1-415a-47f4-a08f-e1f8b1140aea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:29.473933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222b97-6f1d-4aad-a61f-a374dd8a3767 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.474224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222b97-6f1d-4aad-a61f-a374dd8a3767 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.484384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e222b97-6f1d-4aad-a61f-a374dd8a3767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.528520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7e222b97-6f1d-4aad-a61f-a374dd8a3767 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:29.535283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7e222b97-6f1d-4aad-a61f-a374dd8a3767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:29.646469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6568f1-415a-47f4-a08f-e1f8b1140aea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:29.677163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3a614-9a82-496c-a684-c6c1e0ec222a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:29.677887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3a614-9a82-496c-a684-c6c1e0ec222a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.678165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3a614-9a82-496c-a684-c6c1e0ec222a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.678438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b3a614-9a82-496c-a684-c6c1e0ec222a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.679082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3a614-9a82-496c-a684-c6c1e0ec222a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:29.682485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b3a614-9a82-496c-a684-c6c1e0ec222a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:29.694495 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2798/5555] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:29.712816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222b97-6f1d-4aad-a61f-a374dd8a3767 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.733985 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2758/5556] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:29 2022] POST /identity/v3/users => generated 297 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:29.737510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3a614-9a82-496c-a684-c6c1e0ec222a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.738788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e222b97-6f1d-4aad-a61f-a374dd8a3767 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:29.755282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44edd8-5954-4124-b382-74c171a2b7ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:29.756204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44edd8-5954-4124-b382-74c171a2b7ce admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.756529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44edd8-5954-4124-b382-74c171a2b7ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.756813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f44edd8-5954-4124-b382-74c171a2b7ce admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.757573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44edd8-5954-4124-b382-74c171a2b7ce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:29.757874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44edd8-5954-4124-b382-74c171a2b7ce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:29.764018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f44edd8-5954-4124-b382-74c171a2b7ce admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:29.802501 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2799/5557] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:29.807349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44edd8-5954-4124-b382-74c171a2b7ce admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.808281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b3a614-9a82-496c-a684-c6c1e0ec222a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:29.827165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f44edd8-5954-4124-b382-74c171a2b7ce admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:29.827741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de06b9-b731-4cf5-aeb2-65295d232673 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:29.828372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de06b9-b731-4cf5-aeb2-65295d232673 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.828650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de06b9-b731-4cf5-aeb2-65295d232673 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.828922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49de06b9-b731-4cf5-aeb2-65295d232673 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.833627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de06b9-b731-4cf5-aeb2-65295d232673 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:29.836474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49de06b9-b731-4cf5-aeb2-65295d232673 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:29.842363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91610-a15d-4f82-a3f4-b394948b4bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:29.843121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91610-a15d-4f82-a3f4-b394948b4bac admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.843753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91610-a15d-4f82-a3f4-b394948b4bac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.843753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a91610-a15d-4f82-a3f4-b394948b4bac admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.844370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a91610-a15d-4f82-a3f4-b394948b4bac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:29.848868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a91610-a15d-4f82-a3f4-b394948b4bac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:29.868426 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2759/5558] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:29.876317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de06b9-b731-4cf5-aeb2-65295d232673 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.901934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49de06b9-b731-4cf5-aeb2-65295d232673 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:29.917280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406dbe-0906-4c03-b235-4a997f4b5cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:29.917280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406dbe-0906-4c03-b235-4a997f4b5cbc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:29.917280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406dbe-0906-4c03-b235-4a997f4b5cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:29.917280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb406dbe-0906-4c03-b235-4a997f4b5cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:29.917903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406dbe-0906-4c03-b235-4a997f4b5cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:29.921236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb406dbe-0906-4c03-b235-4a997f4b5cbc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:29.951404 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2760/5559] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:29.955404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406dbe-0906-4c03-b235-4a997f4b5cbc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.976068 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2800/5560] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:29 2022] POST /identity/v3/projects => generated 391 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:29.978357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91610-a15d-4f82-a3f4-b394948b4bac admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:29.980761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb406dbe-0906-4c03-b235-4a997f4b5cbc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:30.174207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57b688-c7ff-4818-82c7-4deb80d585eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:30.179369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57b688-c7ff-4818-82c7-4deb80d585eb admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:30.179707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57b688-c7ff-4818-82c7-4deb80d585eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:30.179931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a57b688-c7ff-4818-82c7-4deb80d585eb admin admin] PATH_INFO: `/v3/projects/17d0a68c42b84e2eb36d9c8151a057fa/users/dead514c486c4de99f29e78a9a330ccf/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:30.188238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a91610-a15d-4f82-a3f4-b394948b4bac admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:30.204972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5829bdf-bfce-4731-89f4-373c42ffb0b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:30.205648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5829bdf-bfce-4731-89f4-373c42ffb0b9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:30.206210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5829bdf-bfce-4731-89f4-373c42ffb0b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:30.206314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5829bdf-bfce-4731-89f4-373c42ffb0b9 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:30.206945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5829bdf-bfce-4731-89f4-373c42ffb0b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:30.209461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5829bdf-bfce-4731-89f4-373c42ffb0b9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:30.219349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57b688-c7ff-4818-82c7-4deb80d585eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=17d0a68c42b84e2eb36d9c8151a057fa, user_id=dead514c486c4de99f29e78a9a330ccf, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:30.229507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a57b688-c7ff-4818-82c7-4deb80d585eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:30.283615 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2761/5561] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:29 2022] PUT /identity/v3/projects/17d0a68c42b84e2eb36d9c8151a057fa/users/dead514c486c4de99f29e78a9a330ccf/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:30.290564 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2801/5562] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:29 2022] POST /identity/v3/users => generated 296 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:30.295165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57b688-c7ff-4818-82c7-4deb80d585eb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:30.299309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccb2c5-feac-4dae-b691-01687102fbfe None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:30.299612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccb2c5-feac-4dae-b691-01687102fbfe None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:30.299984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ccb2c5-feac-4dae-b691-01687102fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:30.350968 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:30.400890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-28ccb2c5-feac-4dae-b691-01687102fbfe None None] MFA Rules not processed for user `dead514c486c4de99f29e78a9a330ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:30.404234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-28ccb2c5-feac-4dae-b691-01687102fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:30.519313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a57b688-c7ff-4818-82c7-4deb80d585eb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:30.533501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8cd7b-9700-42ea-96f9-bbf98e4e22d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:30.534917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8cd7b-9700-42ea-96f9-bbf98e4e22d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:30.535707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8cd7b-9700-42ea-96f9-bbf98e4e22d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:30.541732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc8cd7b-9700-42ea-96f9-bbf98e4e22d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:30.542623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8cd7b-9700-42ea-96f9-bbf98e4e22d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:30.546578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc8cd7b-9700-42ea-96f9-bbf98e4e22d6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:30.568010 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:30.579219 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2762/5563] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:30.580338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8cd7b-9700-42ea-96f9-bbf98e4e22d6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:30.605161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc8cd7b-9700-42ea-96f9-bbf98e4e22d6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:30.615455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a4f2-6d94-4ddd-9f02-390271fa3d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:30.615863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a4f2-6d94-4ddd-9f02-390271fa3d5c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:30.616143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a4f2-6d94-4ddd-9f02-390271fa3d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:30.616420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3943a4f2-6d94-4ddd-9f02-390271fa3d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:30.618497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943a4f2-6d94-4ddd-9f02-390271fa3d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:30.627309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3943a4f2-6d94-4ddd-9f02-390271fa3d5c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:30.645907 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2802/5564] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 346 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:30.647212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccb2c5-feac-4dae-b691-01687102fbfe None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:30.660615 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2763/5565] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:30 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:30.665911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a4f2-6d94-4ddd-9f02-390271fa3d5c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:30.687678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3943a4f2-6d94-4ddd-9f02-390271fa3d5c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:30.693043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ccb2c5-feac-4dae-b691-01687102fbfe None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:30.714355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef017ee-faab-4467-aa52-ecf4fdd56917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:30.717220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef017ee-faab-4467-aa52-ecf4fdd56917 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:30.720289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30efdd47-606b-488d-a5df-815c33b312a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:30.720851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef017ee-faab-4467-aa52-ecf4fdd56917 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:30.720963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efdd47-606b-488d-a5df-815c33b312a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:30.721234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efdd47-606b-488d-a5df-815c33b312a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:30.721590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30efdd47-606b-488d-a5df-815c33b312a7 admin admin] PATH_INFO: `/v3/projects/2b13a7e5654e44aebf8b369763704233/users/e81e7b04fdeb43c9a2008c54eebf0464/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:30.722740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef017ee-faab-4467-aa52-ecf4fdd56917 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:30.723555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef017ee-faab-4467-aa52-ecf4fdd56917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:30.725973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef017ee-faab-4467-aa52-ecf4fdd56917 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:30.775067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efdd47-606b-488d-a5df-815c33b312a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b13a7e5654e44aebf8b369763704233, user_id=e81e7b04fdeb43c9a2008c54eebf0464, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:30.779521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30efdd47-606b-488d-a5df-815c33b312a7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:30.820614 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2764/5566] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:30 2022] PUT /identity/v3/projects/2b13a7e5654e44aebf8b369763704233/users/e81e7b04fdeb43c9a2008c54eebf0464/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:30.829792 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2803/5567] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:30 2022] POST /identity/v3/projects => generated 395 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:30.830752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef017ee-faab-4467-aa52-ecf4fdd56917 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:30.837511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785168-a362-4e7c-801f-b72a29e3cba8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:30.839310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785168-a362-4e7c-801f-b72a29e3cba8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:30.841032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8785168-a362-4e7c-801f-b72a29e3cba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:30.966167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d8785168-a362-4e7c-801f-b72a29e3cba8 None None] MFA Rules not processed for user `e81e7b04fdeb43c9a2008c54eebf0464`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:30.968643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d8785168-a362-4e7c-801f-b72a29e3cba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:31.021710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef017ee-faab-4467-aa52-ecf4fdd56917 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:31.033663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074923-6d3a-47ba-9cd3-9442359a50f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:31.034370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074923-6d3a-47ba-9cd3-9442359a50f5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.034661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074923-6d3a-47ba-9cd3-9442359a50f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.035126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f074923-6d3a-47ba-9cd3-9442359a50f5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.035664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f074923-6d3a-47ba-9cd3-9442359a50f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:31.037834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f074923-6d3a-47ba-9cd3-9442359a50f5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:31.099488 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2804/5568] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:30 2022] POST /identity/v3/users => generated 304 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:31.113674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074923-6d3a-47ba-9cd3-9442359a50f5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:31.139364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f074923-6d3a-47ba-9cd3-9442359a50f5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:31.155839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c4d9d-039e-47a0-9e11-f1f00964307e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:31.156599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4d9d-039e-47a0-9e11-f1f00964307e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.156871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4d9d-039e-47a0-9e11-f1f00964307e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.158104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c4d9d-039e-47a0-9e11-f1f00964307e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.158677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c4d9d-039e-47a0-9e11-f1f00964307e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:31.160318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c4d9d-039e-47a0-9e11-f1f00964307e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:31.208934 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2805/5569] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:31.222070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c4d9d-039e-47a0-9e11-f1f00964307e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:31.235247 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2765/5570] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:30 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:31.239507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8785168-a362-4e7c-801f-b72a29e3cba8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:31.254029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c4d9d-039e-47a0-9e11-f1f00964307e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:31.269196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8785168-a362-4e7c-801f-b72a29e3cba8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:31.276709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e073fd-5c63-4201-875d-615bb82a90ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:31.277422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e073fd-5c63-4201-875d-615bb82a90ea admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.277710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e073fd-5c63-4201-875d-615bb82a90ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.277993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e073fd-5c63-4201-875d-615bb82a90ea admin admin] PATH_INFO: `/v3/projects/86954f83f2df49c88a85235d9cfdee36/users/6912ba7c990d4e9e95a51482fa3268dc/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.290870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8968840-7274-4da7-aec0-7fc491c69430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:31.291534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8968840-7274-4da7-aec0-7fc491c69430 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.291820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8968840-7274-4da7-aec0-7fc491c69430 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.292147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8968840-7274-4da7-aec0-7fc491c69430 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.292743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8968840-7274-4da7-aec0-7fc491c69430 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:31.302299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8968840-7274-4da7-aec0-7fc491c69430 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:31.326491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e073fd-5c63-4201-875d-615bb82a90ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=86954f83f2df49c88a85235d9cfdee36, user_id=6912ba7c990d4e9e95a51482fa3268dc, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:31.329206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e073fd-5c63-4201-875d-615bb82a90ea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:31.360764 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2806/5571] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:31 2022] PUT /identity/v3/projects/86954f83f2df49c88a85235d9cfdee36/users/6912ba7c990d4e9e95a51482fa3268dc/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:31.364728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e073fd-5c63-4201-875d-615bb82a90ea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:31.374603 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2766/5572] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:31 2022] POST /identity/v3/projects => generated 389 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:31.378742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8968840-7274-4da7-aec0-7fc491c69430 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:31.489965 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:31.531165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8968840-7274-4da7-aec0-7fc491c69430 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:31.538555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e073fd-5c63-4201-875d-615bb82a90ea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:31.547233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f913d6-04ed-4f55-9695-821113f48f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:31.547865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f913d6-04ed-4f55-9695-821113f48f0a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.548149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f913d6-04ed-4f55-9695-821113f48f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.548426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f913d6-04ed-4f55-9695-821113f48f0a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.549074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f913d6-04ed-4f55-9695-821113f48f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:31.552226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f913d6-04ed-4f55-9695-821113f48f0a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:31.554743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca39c-17a3-47ed-87ca-e2867b9c2860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:31.555380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca39c-17a3-47ed-87ca-e2867b9c2860 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.555658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca39c-17a3-47ed-87ca-e2867b9c2860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.555929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588ca39c-17a3-47ed-87ca-e2867b9c2860 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.557103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ca39c-17a3-47ed-87ca-e2867b9c2860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:31.559179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588ca39c-17a3-47ed-87ca-e2867b9c2860 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:31.585785 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2807/5573] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:31.586978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca39c-17a3-47ed-87ca-e2867b9c2860 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:31.600875 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2767/5574] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:31 2022] POST /identity/v3/users => generated 301 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:31.605801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f913d6-04ed-4f55-9695-821113f48f0a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:31.606635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588ca39c-17a3-47ed-87ca-e2867b9c2860 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:31.621891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ceaa147-4a65-4e78-bd19-742da1e9dabe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:31.622887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa147-4a65-4e78-bd19-742da1e9dabe admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.623355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa147-4a65-4e78-bd19-742da1e9dabe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.623821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ceaa147-4a65-4e78-bd19-742da1e9dabe admin admin] PATH_INFO: `/v3/projects/86954f83f2df49c88a85235d9cfdee36/users/6912ba7c990d4e9e95a51482fa3268dc/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.630438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaa147-4a65-4e78-bd19-742da1e9dabe admin admin] RBAC: Authorizing `identity:create_grant(project_id=86954f83f2df49c88a85235d9cfdee36, user_id=6912ba7c990d4e9e95a51482fa3268dc, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:31.634020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ceaa147-4a65-4e78-bd19-742da1e9dabe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:31.636156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f913d6-04ed-4f55-9695-821113f48f0a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:31.639136 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:31.650452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53de0e-f95f-4779-89f6-12dc4422a437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:31.651428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53de0e-f95f-4779-89f6-12dc4422a437 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.651899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53de0e-f95f-4779-89f6-12dc4422a437 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.653653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c53de0e-f95f-4779-89f6-12dc4422a437 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.654357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53de0e-f95f-4779-89f6-12dc4422a437 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:31.655544 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2808/5575] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:31 2022] PUT /identity/v3/projects/86954f83f2df49c88a85235d9cfdee36/users/6912ba7c990d4e9e95a51482fa3268dc/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:31.656968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c53de0e-f95f-4779-89f6-12dc4422a437 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:31.666695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add698a-33f4-47d8-a304-8eaf21f62060 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.667033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add698a-33f4-47d8-a304-8eaf21f62060 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.667275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add698a-33f4-47d8-a304-8eaf21f62060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.703358 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2768/5576] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:31 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:31.708006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53de0e-f95f-4779-89f6-12dc4422a437 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:31.711546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0add698a-33f4-47d8-a304-8eaf21f62060 None None] MFA Rules not processed for user `6912ba7c990d4e9e95a51482fa3268dc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:31.714130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0add698a-33f4-47d8-a304-8eaf21f62060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:31.749320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c53de0e-f95f-4779-89f6-12dc4422a437 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:31.866364 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2809/5577] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:31 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:31.872876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add698a-33f4-47d8-a304-8eaf21f62060 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:31.964465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a69b0-9dad-4b59-b4a7-22d7213c7dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:31.965675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a69b0-9dad-4b59-b4a7-22d7213c7dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:31.966169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a69b0-9dad-4b59-b4a7-22d7213c7dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:31.966677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a69b0-9dad-4b59-b4a7-22d7213c7dfd admin admin] PATH_INFO: `/v3/projects/098a1b5597684d3fb3ea80108aeff23b/users/b1ff36349d934fdc8a003644258af855/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:31.995571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a69b0-9dad-4b59-b4a7-22d7213c7dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=098a1b5597684d3fb3ea80108aeff23b, user_id=b1ff36349d934fdc8a003644258af855, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:31.999478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a69b0-9dad-4b59-b4a7-22d7213c7dfd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:31.999820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add698a-33f4-47d8-a304-8eaf21f62060 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.012322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc15f9f-e366-4a58-b347-15a2365cd6bd tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dead514c486c4de99f29e78a9a330ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d0a68c42b84e2eb36d9c8151a057fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.013130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc15f9f-e366-4a58-b347-15a2365cd6bd tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.014907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc15f9f-e366-4a58-b347-15a2365cd6bd tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.016020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc15f9f-e366-4a58-b347-15a2365cd6bd tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.016754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc15f9f-e366-4a58-b347-15a2365cd6bd tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.024662 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2769/5578] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:31 2022] PUT /identity/v3/projects/098a1b5597684d3fb3ea80108aeff23b/users/b1ff36349d934fdc8a003644258af855/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:32.026418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a69b0-9dad-4b59-b4a7-22d7213c7dfd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-1cc15f9f-e366-4a58-b347-15a2365cd6bd tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] You are not authorized to perform the requested action: identity:create_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 162, in post Oct 24 09:19:32.047478 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 24 09:19:32.048579 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 24 09:19:32.048579 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 24 09:19:32.048579 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 24 09:19:32.048579 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 24 09:19:32.048579 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 09:19:32.048579 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 24 09:19:32.048579 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:create_project. Oct 24 09:19:32.048579 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.056408 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2810/5579] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:19:31 2022] POST /identity/v3/projects => generated 136 bytes in 184 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:19:32.058218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc15f9f-e366-4a58-b347-15a2365cd6bd tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.078037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc15f9f-e366-4a58-b347-15a2365cd6bd tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.156097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a69b0-9dad-4b59-b4a7-22d7213c7dfd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.165784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9fbc0-c082-4781-835d-cb83276c755d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.166564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9fbc0-c082-4781-835d-cb83276c755d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.170733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9fbc0-c082-4781-835d-cb83276c755d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.170733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9fbc0-c082-4781-835d-cb83276c755d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.171357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9fbc0-c082-4781-835d-cb83276c755d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.176897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9fbc0-c082-4781-835d-cb83276c755d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:32.178113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eaa557-b0e4-4990-8165-6cd2ab4128de tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6912ba7c990d4e9e95a51482fa3268dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86954f83f2df49c88a85235d9cfdee36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.178869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaa557-b0e4-4990-8165-6cd2ab4128de tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.179278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaa557-b0e4-4990-8165-6cd2ab4128de tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.179636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eaa557-b0e4-4990-8165-6cd2ab4128de tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.180489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eaa557-b0e4-4990-8165-6cd2ab4128de tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.183236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54eaa557-b0e4-4990-8165-6cd2ab4128de tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:32.200374 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2770/5580] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:32 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-54eaa557-b0e4-4990-8165-6cd2ab4128de tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Invalid input for field 'name': '' is too short Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'minLength' in schema['properties']['name']: Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: On instance['name']: Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: '': keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'minLength' in schema['properties']['name']: Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: On instance['name']: Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: '' Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise error Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: '' is too short Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['name']: Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application '' Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.203801 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 24 09:19:32.205264 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': '' is too short Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'minLength' in schema['properties']['name']: Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['name']: Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application '' Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.206870 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2811/5581] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:19:32 2022] POST /identity/v3/projects => generated 283 bytes in 148 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 24 09:19:32.210081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9fbc0-c082-4781-835d-cb83276c755d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.215391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eaa557-b0e4-4990-8165-6cd2ab4128de tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.225858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9fbc0-c082-4781-835d-cb83276c755d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.230970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28283982-c47f-462b-a54b-e6f714c9b76f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.231695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28283982-c47f-462b-a54b-e6f714c9b76f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.232037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28283982-c47f-462b-a54b-e6f714c9b76f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.232326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28283982-c47f-462b-a54b-e6f714c9b76f admin admin] PATH_INFO: `/v3/projects/098a1b5597684d3fb3ea80108aeff23b/users/b1ff36349d934fdc8a003644258af855/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.234639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28283982-c47f-462b-a54b-e6f714c9b76f admin admin] RBAC: Authorizing `identity:create_grant(project_id=098a1b5597684d3fb3ea80108aeff23b, user_id=b1ff36349d934fdc8a003644258af855, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.237977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28283982-c47f-462b-a54b-e6f714c9b76f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:32.254915 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2771/5582] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:32 2022] PUT /identity/v3/projects/098a1b5597684d3fb3ea80108aeff23b/users/b1ff36349d934fdc8a003644258af855/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:32.255413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eaa557-b0e4-4990-8165-6cd2ab4128de tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.266667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2758d48-6e81-4624-9a24-99231a551170 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.268817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2758d48-6e81-4624-9a24-99231a551170 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.269595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2758d48-6e81-4624-9a24-99231a551170 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.323242 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:32.344371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a2758d48-6e81-4624-9a24-99231a551170 None None] MFA Rules not processed for user `b1ff36349d934fdc8a003644258af855`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:32.346936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a2758d48-6e81-4624-9a24-99231a551170 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:32.374442 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:32.412768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9dd4-9430-4e2b-b7f0-39f96abd39fe tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6912ba7c990d4e9e95a51482fa3268dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86954f83f2df49c88a85235d9cfdee36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.415530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9dd4-9430-4e2b-b7f0-39f96abd39fe tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.416582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9dd4-9430-4e2b-b7f0-39f96abd39fe tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.416910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253c9dd4-9430-4e2b-b7f0-39f96abd39fe tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.417547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c9dd4-9430-4e2b-b7f0-39f96abd39fe tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.422821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253c9dd4-9430-4e2b-b7f0-39f96abd39fe tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-253c9dd4-9430-4e2b-b7f0-39f96abd39fe tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'maxLength' in schema['properties']['name']: Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: On instance['name']: Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa': keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'maxLength' in schema['properties']['name']: Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: On instance['name']: Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise error Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 24 09:19:32.439246 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['name']: Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:32.440586 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 165, in post Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application validation.lazy_validate(schema.project_create, project) Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'name': 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' is too long Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'maxLength' in schema['properties']['name']: Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'maxLength': 64, 'minLength': 1, 'pattern': '[\\S]+', 'type': 'string'} Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['name']: Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application 'aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaa' Oct 24 09:19:32.442438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.445677 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2812/5583] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:19:32 2022] POST /identity/v3/projects => generated 412 bytes in 231 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 24 09:19:32.451630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9dd4-9430-4e2b-b7f0-39f96abd39fe tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.460856 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2772/5584] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:32 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:32.466059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2758d48-6e81-4624-9a24-99231a551170 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.470278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253c9dd4-9430-4e2b-b7f0-39f96abd39fe tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.475878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481b8af-0e58-4b9e-8351-6bcb00bb7b85 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6912ba7c990d4e9e95a51482fa3268dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86954f83f2df49c88a85235d9cfdee36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.476639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481b8af-0e58-4b9e-8351-6bcb00bb7b85 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.476929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481b8af-0e58-4b9e-8351-6bcb00bb7b85 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.477207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481b8af-0e58-4b9e-8351-6bcb00bb7b85 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] PATH_INFO: `/v3/projects/0cd2d96d405c4192900923621b668c3e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.489237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481b8af-0e58-4b9e-8351-6bcb00bb7b85 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0cd2d96d405c4192900923621b668c3e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.492346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d481b8af-0e58-4b9e-8351-6bcb00bb7b85 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d481b8af-0e58-4b9e-8351-6bcb00bb7b85 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Could not find project: 0cd2d96d405c4192900923621b668c3e.: keystone.exception.ProjectNotFound: Could not find project: 0cd2d96d405c4192900923621b668c3e. Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 211, in delete Oct 24 09:19:32.512227 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application PROVIDERS.resource_api.delete_project( Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 478, in delete_project Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(project_id) Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 0cd2d96d405c4192900923621b668c3e. Oct 24 09:19:32.513523 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.514271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2758d48-6e81-4624-9a24-99231a551170 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.520710 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2813/5585] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:32 2022] DELETE /identity/v3/projects/0cd2d96d405c4192900923621b668c3e => generated 113 bytes in 66 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 24 09:19:32.522426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481b8af-0e58-4b9e-8351-6bcb00bb7b85 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.523857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede9316-f463-4e38-bff2-cd9a9e5d25e1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.524644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede9316-f463-4e38-bff2-cd9a9e5d25e1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.524931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede9316-f463-4e38-bff2-cd9a9e5d25e1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.525267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ede9316-f463-4e38-bff2-cd9a9e5d25e1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.526560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede9316-f463-4e38-bff2-cd9a9e5d25e1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.528318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ede9316-f463-4e38-bff2-cd9a9e5d25e1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:32.564449 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2773/5586] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:19:32 2022] POST /identity/v3/domains => generated 277 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:32.568718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede9316-f463-4e38-bff2-cd9a9e5d25e1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.642141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481b8af-0e58-4b9e-8351-6bcb00bb7b85 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.736204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ede9316-f463-4e38-bff2-cd9a9e5d25e1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.749709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131a6ae-bcf6-4736-b316-da817a4522c3 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.750363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131a6ae-bcf6-4736-b316-da817a4522c3 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.751058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131a6ae-bcf6-4736-b316-da817a4522c3 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.751449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7131a6ae-bcf6-4736-b316-da817a4522c3 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5/config` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.752193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131a6ae-bcf6-4736-b316-da817a4522c3 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=d551053428804199b8473b01cd13b0a5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.753262 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-7131a6ae-bcf6-4736-b316-da817a4522c3 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:32.753262 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:19:32.753262 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:19:32.755559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7131a6ae-bcf6-4736-b316-da817a4522c3 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:32.774225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb4c1e-4728-4c6c-bbea-d49fd9b0522a tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dead514c486c4de99f29e78a9a330ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '17d0a68c42b84e2eb36d9c8151a057fa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.775015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb4c1e-4728-4c6c-bbea-d49fd9b0522a tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.775958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb4c1e-4728-4c6c-bbea-d49fd9b0522a tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.777026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bb4c1e-4728-4c6c-bbea-d49fd9b0522a tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.778778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bb4c1e-4728-4c6c-bbea-d49fd9b0522a tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-89bb4c1e-4728-4c6c-bbea-d49fd9b0522a tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] You are not authorized to perform the requested action: identity:list_projects.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 153, in get Oct 24 09:19:32.794483 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._list_projects() Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 120, in _list_projects Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:list_projects', Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:list_projects. Oct 24 09:19:32.795636 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:32.800293 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2814/5587] 10.222.0.25 () {58 vars in 1131 bytes} [Mon Oct 24 09:19:32 2022] GET /identity/v3/projects => generated 135 bytes in 278 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:19:32.803975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb4c1e-4728-4c6c-bbea-d49fd9b0522a tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.878910 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2774/5588] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:32 2022] PUT /identity/v3/domains/d551053428804199b8473b01cd13b0a5/config => generated 138 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:32.882085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131a6ae-bcf6-4736-b316-da817a4522c3 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.903965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7131a6ae-bcf6-4736-b316-da817a4522c3 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:32.918403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb66b7-347c-47e6-b04b-c53b5b4fb11c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:32.920638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb66b7-347c-47e6-b04b-c53b5b4fb11c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:32.921069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb66b7-347c-47e6-b04b-c53b5b4fb11c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:32.924468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cb66b7-347c-47e6-b04b-c53b5b4fb11c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5/config/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:32.926497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb66b7-347c-47e6-b04b-c53b5b4fb11c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d551053428804199b8473b01cd13b0a5, group=identity)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:32.928169 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-b5cb66b7-347c-47e6-b04b-c53b5b4fb11c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:32.928169 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:19:32.928169 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:19:32.932529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cb66b7-347c-47e6-b04b-c53b5b4fb11c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:32.948682 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2775/5589] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:19:32 2022] GET /identity/v3/domains/d551053428804199b8473b01cd13b0a5/config/identity => generated 45 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:32.954585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb66b7-347c-47e6-b04b-c53b5b4fb11c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:32.996792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cb66b7-347c-47e6-b04b-c53b5b4fb11c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.021246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a92064-eca0-4121-aebb-98662ce28f5a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.023172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a92064-eca0-4121-aebb-98662ce28f5a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.024976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a92064-eca0-4121-aebb-98662ce28f5a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.031494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a92064-eca0-4121-aebb-98662ce28f5a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5/config/identity/driver` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.033772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bb4c1e-4728-4c6c-bbea-d49fd9b0522a tempest-ProjectsNegativeStaticTestJSON-70155093 tempest-ProjectsNegativeStaticTestJSON-70155093-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.035412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a92064-eca0-4121-aebb-98662ce28f5a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d551053428804199b8473b01cd13b0a5, group=identity, option=driver)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.039052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a92064-eca0-4121-aebb-98662ce28f5a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.045324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77489b48-c4fe-4edb-9d6d-db377f5ff288 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6912ba7c990d4e9e95a51482fa3268dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86954f83f2df49c88a85235d9cfdee36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.047309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77489b48-c4fe-4edb-9d6d-db377f5ff288 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.049619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77489b48-c4fe-4edb-9d6d-db377f5ff288 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.050045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77489b48-c4fe-4edb-9d6d-db377f5ff288 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.053125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77489b48-c4fe-4edb-9d6d-db377f5ff288 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.058560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77489b48-c4fe-4edb-9d6d-db377f5ff288 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.060829 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2776/5590] 10.222.0.25 () {58 vars in 1296 bytes} [Mon Oct 24 09:19:32 2022] GET /identity/v3/domains/d551053428804199b8473b01cd13b0a5/config/identity/driver => generated 31 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:33.064601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a92064-eca0-4121-aebb-98662ce28f5a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:33.083796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a92064-eca0-4121-aebb-98662ce28f5a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.101086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89274-8d39-47be-8573-30d28969d6c8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.101839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89274-8d39-47be-8573-30d28969d6c8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.102124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89274-8d39-47be-8573-30d28969d6c8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.102393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e89274-8d39-47be-8573-30d28969d6c8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5/config/ldap` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.109932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e89274-8d39-47be-8573-30d28969d6c8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d551053428804199b8473b01cd13b0a5, group=ldap)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.111596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e89274-8d39-47be-8573-30d28969d6c8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.132438 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2815/5591] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:32 2022] POST /identity/v3/projects => generated 357 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:33.133918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77489b48-c4fe-4edb-9d6d-db377f5ff288 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:33.149617 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:33.150944 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2777/5592] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:19:33 2022] GET /identity/v3/domains/d551053428804199b8473b01cd13b0a5/config/ldap => generated 106 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:33.152378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89274-8d39-47be-8573-30d28969d6c8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:33.184103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e89274-8d39-47be-8573-30d28969d6c8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.286245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77489b48-c4fe-4edb-9d6d-db377f5ff288 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.298399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6912ba7c990d4e9e95a51482fa3268dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86954f83f2df49c88a85235d9cfdee36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.299315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.299761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.300230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.301840 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:33.302888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.305185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.328236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044f88-c2bc-490f-9370-f514a56b1ac0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.328920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044f88-c2bc-490f-9370-f514a56b1ac0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.329607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044f88-c2bc-490f-9370-f514a56b1ac0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.329889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5044f88-c2bc-490f-9370-f514a56b1ac0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5/config/ldap/url` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.331106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5044f88-c2bc-490f-9370-f514a56b1ac0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d551053428804199b8473b01cd13b0a5, group=ldap, option=url)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.332722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5044f88-c2bc-490f-9370-f514a56b1ac0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.345344 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2778/5593] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:19:33 2022] GET /identity/v3/domains/d551053428804199b8473b01cd13b0a5/config/ldap/url => generated 46 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:33.349389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044f88-c2bc-490f-9370-f514a56b1ac0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:33.354952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.sql.core [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-925240067' for key 'project.ixu_project_name_domain_id'") Oct 24 09:19:33.354952 n-d-master-1 devstack@keystone.service[88312]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 09:19:33.354952 n-d-master-1 devstack@keystone.service[88312]: [parameters: {'id': 'a7e12bdf0be840d7a414cd8290316830', 'name': 'tempest-project-dup-925240067', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 09:19:33.354952 n-d-master-1 devstack@keystone.service[88312]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88312) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 24 09:19:33.373088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5044f88-c2bc-490f-9370-f514a56b1ac0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-925240067, project id a7e12bdf0be840d7a414cd8290316830.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-925240067, project id a7e12bdf0be840d7a414cd8290316830. Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 09:19:33.377124 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-tempest-project-dup-925240067' for key 'project.ixu_project_name_domain_id'") Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 09:19:33.378037 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application yield resource Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application next(self.gen) Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.rollback() Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.force_reraise() Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise self.value Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 24 09:19:33.379019 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application session.commit() Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._prepare_impl() Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.session.flush() Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._flush(objects) Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application compat.raise_( Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application flush_context.execute() Oct 24 09:19:33.380110 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rec.execute(self) Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 24 09:19:33.382269 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._query(query) Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application conn.query(q) Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result.read() Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 24 09:19:33.384388 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-tempest-project-dup-925240067' for key 'project.ixu_project_name_domain_id'") Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [parameters: {'id': 'a7e12bdf0be840d7a414cd8290316830', 'name': 'tempest-project-dup-925240067', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:33.386653 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name tempest-project-dup-925240067 at domain ID default. Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:33.388213 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is tempest-project-dup-925240067, project id a7e12bdf0be840d7a414cd8290316830. Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:33.391913 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2816/5594] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:19:33 2022] POST /identity/v3/projects => generated 284 bytes in 257 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 24 09:19:33.393669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4201f-f5bc-48b0-882f-80158f295132 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.394843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4201f-f5bc-48b0-882f-80158f295132 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.395176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4201f-f5bc-48b0-882f-80158f295132 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.395460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e4201f-f5bc-48b0-882f-80158f295132 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5/config/ldap/user_tree_dn` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.396863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:33.400415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4201f-f5bc-48b0-882f-80158f295132 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=d551053428804199b8473b01cd13b0a5, group=ldap, option=user_tree_dn)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.403064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e4201f-f5bc-48b0-882f-80158f295132 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.421879 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2779/5595] 10.222.0.25 () {58 vars in 1302 bytes} [Mon Oct 24 09:19:33 2022] GET /identity/v3/domains/d551053428804199b8473b01cd13b0a5/config/ldap/user_tree_dn => generated 63 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:33.422816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4201f-f5bc-48b0-882f-80158f295132 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:33.429897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebbf9d-5ae9-4771-9215-b7475a6383f7 tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.443433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6912ba7c990d4e9e95a51482fa3268dc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '86954f83f2df49c88a85235d9cfdee36', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.444472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.444997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.445526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] PATH_INFO: `/v3/projects/82f2a656440e44a7b58414e99c6447e4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.446964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorizing `identity:delete_project(project_id=82f2a656440e44a7b58414e99c6447e4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.447086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e4201f-f5bc-48b0-882f-80158f295132 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.451255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.457630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03260f-86da-4eb4-a303-d79c0d8dec4d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.458277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03260f-86da-4eb4-a303-d79c0d8dec4d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.458564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03260f-86da-4eb4-a303-d79c0d8dec4d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.458844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03260f-86da-4eb4-a303-d79c0d8dec4d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5/config` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.459432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03260f-86da-4eb4-a303-d79c0d8dec4d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=d551053428804199b8473b01cd13b0a5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.460453 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-ab03260f-86da-4eb4-a303-d79c0d8dec4d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:33.460453 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:19:33.460453 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:19:33.461378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03260f-86da-4eb4-a303-d79c0d8dec4d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.483482 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2780/5596] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:33 2022] DELETE /identity/v3/domains/d551053428804199b8473b01cd13b0a5/config => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:33.488192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03260f-86da-4eb4-a303-d79c0d8dec4d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:33.515368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03260f-86da-4eb4-a303-d79c0d8dec4d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.525708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.527145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.528936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.529937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.533038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d551053428804199b8473b01cd13b0a5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.538428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.568996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82f2a656440e44a7b58414e99c6447e4', 'request_id': 'req-4c9c5694-575e-46ad-b8d0-c24589da30dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.592048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd551053428804199b8473b01cd13b0a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.592828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82f2a656440e44a7b58414e99c6447e4', 'request_id': 'req-4c9c5694-575e-46ad-b8d0-c24589da30dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.598383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd551053428804199b8473b01cd13b0a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.610215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82f2a656440e44a7b58414e99c6447e4', 'request_id': 'req-4c9c5694-575e-46ad-b8d0-c24589da30dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.629104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] The token cache is being invalidate because project 82f2a656440e44a7b58414e99c6447e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:33.629520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.630295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.632960 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2817/5597] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:33 2022] DELETE /identity/v3/projects/82f2a656440e44a7b58414e99c6447e4 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:33.646200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:33.651421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:33.656540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd551053428804199b8473b01cd13b0a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.658095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd551053428804199b8473b01cd13b0a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.669998 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2781/5598] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:19:33 2022] PATCH /identity/v3/domains/d551053428804199b8473b01cd13b0a5 => generated 278 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:33.671089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:33.674721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:33.821647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07361d3-2d9a-459f-bf04-3e51c13fbe29 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:33.840566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:33.841287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:33.843197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:33.843197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:33.873952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d551053428804199b8473b01cd13b0a5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:33.875457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:33.930801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd551053428804199b8473b01cd13b0a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.947591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd551053428804199b8473b01cd13b0a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:33.965822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9c5694-575e-46ad-b8d0-c24589da30dc tempest-ProjectsNegativeStaticTestJSON-629642352 tempest-ProjectsNegativeStaticTestJSON-629642352-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:34.047196 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:34.078913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd551053428804199b8473b01cd13b0a5', 'request_id': 'req-c421c825-7fa7-414b-a6d1-453bfba24552'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.097063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd551053428804199b8473b01cd13b0a5', 'request_id': 'req-c421c825-7fa7-414b-a6d1-453bfba24552'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.099799 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:34.118927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd551053428804199b8473b01cd13b0a5', 'request_id': 'req-c421c825-7fa7-414b-a6d1-453bfba24552'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.134338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] The token cache is being invalidate because project d551053428804199b8473b01cd13b0a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:34.135450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.138375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.159994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd551053428804199b8473b01cd13b0a5', 'request_id': 'req-c421c825-7fa7-414b-a6d1-453bfba24552'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.161003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd551053428804199b8473b01cd13b0a5', 'request_id': 'req-c421c825-7fa7-414b-a6d1-453bfba24552'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.164887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd551053428804199b8473b01cd13b0a5', 'request_id': 'req-c421c825-7fa7-414b-a6d1-453bfba24552'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.192511 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2782/5599] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:33 2022] DELETE /identity/v3/domains/d551053428804199b8473b01cd13b0a5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:34.193077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:34.193886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:34.196120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:34.198356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:34.198526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:34.198989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] PATH_INFO: `/v3/users/dead514c486c4de99f29e78a9a330ccf` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:34.201105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dead514c486c4de99f29e78a9a330ccf)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:34.203361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:34.354393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dead514c486c4de99f29e78a9a330ccf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.377761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dead514c486c4de99f29e78a9a330ccf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.380082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dead514c486c4de99f29e78a9a330ccf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.401741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dead514c486c4de99f29e78a9a330ccf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.432810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-31fbb4cd-3891-47aa-b3b8-44fb76b3d392 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dead514c486c4de99f29e78a9a330ccf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:34.449488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421c825-7fa7-414b-a6d1-453bfba24552 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:34.457967 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2818/5600] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:33 2022] DELETE /identity/v3/users/dead514c486c4de99f29e78a9a330ccf => generated 0 bytes in 817 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:34.459972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb15d-2b3a-49e7-a0af-66e6a0554a45 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:34.460383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb15d-2b3a-49e7-a0af-66e6a0554a45 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:34.460778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8cb15d-2b3a-49e7-a0af-66e6a0554a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:34.513970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9c8cb15d-2b3a-49e7-a0af-66e6a0554a45 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:34.515412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c8cb15d-2b3a-49e7-a0af-66e6a0554a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:34.584784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3076b-4026-48bd-a3c6-75c3f98d15cc tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:34.587057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3076b-4026-48bd-a3c6-75c3f98d15cc tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:34.587366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3076b-4026-48bd-a3c6-75c3f98d15cc tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:34.587647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d3076b-4026-48bd-a3c6-75c3f98d15cc tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:34.588905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3076b-4026-48bd-a3c6-75c3f98d15cc tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:34.594255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d3076b-4026-48bd-a3c6-75c3f98d15cc tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:34.641010 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2783/5601] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:19:34 2022] POST /identity/v3/domains => generated 275 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:34.642819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3076b-4026-48bd-a3c6-75c3f98d15cc tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:34.644810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-25d3076b-4026-48bd-a3c6-75c3f98d15cc tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:34.702262 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2819/5602] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:34.719243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cb15d-2b3a-49e7-a0af-66e6a0554a45 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:34.721284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c8cb15d-2b3a-49e7-a0af-66e6a0554a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:34.829784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d3076b-4026-48bd-a3c6-75c3f98d15cc tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:34.832345 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:34.843358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792535-136b-4045-b411-d05e5527de43 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:34.846981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792535-136b-4045-b411-d05e5527de43 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:34.847491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792535-136b-4045-b411-d05e5527de43 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:34.848078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc792535-136b-4045-b411-d05e5527de43 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/afe97130727d409295a4b597efc669cc/config` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:34.849996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc792535-136b-4045-b411-d05e5527de43 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=afe97130727d409295a4b597efc669cc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:34.853269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc792535-136b-4045-b411-d05e5527de43 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:34.864103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8cb15d-2b3a-49e7-a0af-66e6a0554a45 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:34.869756 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=2,keystone:DELETE=7,keystone:SELECT=91 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:34.938882 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2784/5603] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:34 2022] PUT /identity/v3/domains/afe97130727d409295a4b597efc669cc/config => generated 138 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:34.940021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792535-136b-4045-b411-d05e5527de43 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:34.979575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc792535-136b-4045-b411-d05e5527de43 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:34.994079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab6e00-1157-41cf-a9b5-28d6067251b4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:34.994739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab6e00-1157-41cf-a9b5-28d6067251b4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:34.995025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab6e00-1157-41cf-a9b5-28d6067251b4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:34.995305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab6e00-1157-41cf-a9b5-28d6067251b4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/afe97130727d409295a4b597efc669cc/config` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:34.995998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab6e00-1157-41cf-a9b5-28d6067251b4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=afe97130727d409295a4b597efc669cc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:35.007375 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-06ab6e00-1157-41cf-a9b5-28d6067251b4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:35.007375 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:19:35.007375 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:19:35.011929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab6e00-1157-41cf-a9b5-28d6067251b4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:35.040697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed052e7f-89b4-41db-953e-ecd233ce202f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:35.045458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed052e7f-89b4-41db-953e-ecd233ce202f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:35.045650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed052e7f-89b4-41db-953e-ecd233ce202f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:35.045934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed052e7f-89b4-41db-953e-ecd233ce202f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:35.109254 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2785/5604] 10.222.0.25 () {60 vars in 1271 bytes} [Mon Oct 24 09:19:34 2022] PATCH /identity/v3/domains/afe97130727d409295a4b597efc669cc/config => generated 141 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:35.113113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab6e00-1157-41cf-a9b5-28d6067251b4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:35.134094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab6e00-1157-41cf-a9b5-28d6067251b4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:35.152366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2698e1b-8ea7-4002-9943-7e891fab8a8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:35.153322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698e1b-8ea7-4002-9943-7e891fab8a8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:35.154804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698e1b-8ea7-4002-9943-7e891fab8a8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:35.155299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2698e1b-8ea7-4002-9943-7e891fab8a8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/afe97130727d409295a4b597efc669cc/config` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:35.162337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2698e1b-8ea7-4002-9943-7e891fab8a8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=afe97130727d409295a4b597efc669cc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:35.167097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2698e1b-8ea7-4002-9943-7e891fab8a8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:35.183761 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2786/5605] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:19:35 2022] GET /identity/v3/domains/afe97130727d409295a4b597efc669cc/config => generated 141 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:35.187970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2698e1b-8ea7-4002-9943-7e891fab8a8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:35.213453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2698e1b-8ea7-4002-9943-7e891fab8a8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:35.227209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233597e3-d146-4255-b575-42439bb22c69 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:35.228582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233597e3-d146-4255-b575-42439bb22c69 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:35.229671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233597e3-d146-4255-b575-42439bb22c69 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:35.230361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233597e3-d146-4255-b575-42439bb22c69 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/afe97130727d409295a4b597efc669cc/config` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:35.232079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233597e3-d146-4255-b575-42439bb22c69 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=afe97130727d409295a4b597efc669cc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:35.236825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233597e3-d146-4255-b575-42439bb22c69 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:35.249161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed052e7f-89b4-41db-953e-ecd233ce202f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:35.250926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed052e7f-89b4-41db-953e-ecd233ce202f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:35.261543 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2787/5606] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:35 2022] DELETE /identity/v3/domains/afe97130727d409295a4b597efc669cc/config => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:35.266868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233597e3-d146-4255-b575-42439bb22c69 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:35.286193 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2820/5607] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:35.287178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233597e3-d146-4255-b575-42439bb22c69 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:35.294107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ded93-95d2-4f01-b0e9-08dfccda8139 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:35.294949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ded93-95d2-4f01-b0e9-08dfccda8139 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:35.295409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ded93-95d2-4f01-b0e9-08dfccda8139 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:35.295809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63ded93-95d2-4f01-b0e9-08dfccda8139 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/afe97130727d409295a4b597efc669cc/config` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:35.297771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ded93-95d2-4f01-b0e9-08dfccda8139 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=afe97130727d409295a4b597efc669cc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:35.299586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63ded93-95d2-4f01-b0e9-08dfccda8139 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-e63ded93-95d2-4f01-b0e9-08dfccda8139 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Could not find any options in domain configuration for domain afe97130727d409295a4b597efc669cc.: keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain afe97130727d409295a4b597efc669cc. Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 24 09:19:35.312043 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 24 09:19:35.313157 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 24 09:19:35.313157 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 24 09:19:35.313157 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:35.313157 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:35.313157 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 24 09:19:35.313157 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 24 09:19:35.313157 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find any options in domain configuration for domain afe97130727d409295a4b597efc669cc. Oct 24 09:19:35.313157 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:19:35.318255 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2788/5608] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:19:35 2022] GET /identity/v3/domains/afe97130727d409295a4b597efc669cc/config => generated 151 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:19:35.319725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed052e7f-89b4-41db-953e-ecd233ce202f service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:35.337321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed052e7f-89b4-41db-953e-ecd233ce202f service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:35.345160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:35.346053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:35.346789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:35.347334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/afe97130727d409295a4b597efc669cc/config` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:35.348350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=afe97130727d409295a4b597efc669cc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:35.349836 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_config": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:35.349836 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:19:35.349836 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:19:35.351264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:35.365639 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2821/5609] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:35 2022] DELETE /identity/v3/domains/afe97130727d409295a4b597efc669cc/config => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:35.366923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ded93-95d2-4f01-b0e9-08dfccda8139 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:35.383597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63ded93-95d2-4f01-b0e9-08dfccda8139 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:35.393001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:35.393998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:35.394507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:35.394893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/afe97130727d409295a4b597efc669cc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:35.398525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=afe97130727d409295a4b597efc669cc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:35.401786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:35.436706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'afe97130727d409295a4b597efc669cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:35.437766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'afe97130727d409295a4b597efc669cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:35.484764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'afe97130727d409295a4b597efc669cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:35.485466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'afe97130727d409295a4b597efc669cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:35.491380 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2789/5610] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:19:35 2022] PATCH /identity/v3/domains/afe97130727d409295a4b597efc669cc => generated 276 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:35.492900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:35.495023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:35.517138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdabed06-3e07-495c-ae15-dac0f08af12a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:35.682592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:35.683396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:35.694382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:35.695905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/afe97130727d409295a4b597efc669cc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:35.735544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=afe97130727d409295a4b597efc669cc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:35.740416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:35.836967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'afe97130727d409295a4b597efc669cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:35.847263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'afe97130727d409295a4b597efc669cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:35.856995 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:35.999461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afe97130727d409295a4b597efc669cc', 'request_id': 'req-86e7d241-9570-474f-96eb-25f970129d17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.024123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afe97130727d409295a4b597efc669cc', 'request_id': 'req-86e7d241-9570-474f-96eb-25f970129d17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.035661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afe97130727d409295a4b597efc669cc', 'request_id': 'req-86e7d241-9570-474f-96eb-25f970129d17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.062262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] The token cache is being invalidate because project afe97130727d409295a4b597efc669cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:36.062571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.063276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.086122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'afe97130727d409295a4b597efc669cc', 'request_id': 'req-86e7d241-9570-474f-96eb-25f970129d17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.086919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'afe97130727d409295a4b597efc669cc', 'request_id': 'req-86e7d241-9570-474f-96eb-25f970129d17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.087612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'afe97130727d409295a4b597efc669cc', 'request_id': 'req-86e7d241-9570-474f-96eb-25f970129d17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.109928 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2822/5611] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:35 2022] DELETE /identity/v3/domains/afe97130727d409295a4b597efc669cc => generated 0 bytes in 618 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:36.118610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:36.136960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b79f21-d2b3-484e-b7d2-e892e62de00b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:36.312657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383fe9e-d857-4684-be33-e171bebe07ba tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:36.315112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383fe9e-d857-4684-be33-e171bebe07ba tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:36.315406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383fe9e-d857-4684-be33-e171bebe07ba tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:36.315687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383fe9e-d857-4684-be33-e171bebe07ba tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:36.316398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383fe9e-d857-4684-be33-e171bebe07ba tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:36.322455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:36.324019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:36.325866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383fe9e-d857-4684-be33-e171bebe07ba tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:36.365764 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2790/5612] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:19:36 2022] POST /identity/v3/domains => generated 276 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:36.369891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383fe9e-d857-4684-be33-e171bebe07ba tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:36.374144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7383fe9e-d857-4684-be33-e171bebe07ba tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:36.428934 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=10,keystone:INSERT=5,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:36.485615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7d241-9570-474f-96eb-25f970129d17 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:36.510379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383fe9e-d857-4684-be33-e171bebe07ba tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:36.515778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d47c62-a447-438f-acab-71ee85f5f5e6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:36.516601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d47c62-a447-438f-acab-71ee85f5f5e6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:36.517186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d47c62-a447-438f-acab-71ee85f5f5e6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:36.517899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d47c62-a447-438f-acab-71ee85f5f5e6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:36.518488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d47c62-a447-438f-acab-71ee85f5f5e6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:create_domain_config(domain_id=3b387d002ac24c55b908e4d51bb819f4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:36.524012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d47c62-a447-438f-acab-71ee85f5f5e6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:36.583102 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2791/5613] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:36 2022] PUT /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config => generated 138 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:36.586075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d47c62-a447-438f-acab-71ee85f5f5e6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:36.612174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d47c62-a447-438f-acab-71ee85f5f5e6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:36.626457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890b909-9570-4115-a644-7bceaf6aca8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:36.627424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890b909-9570-4115-a644-7bceaf6aca8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:36.627932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890b909-9570-4115-a644-7bceaf6aca8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:36.628735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9890b909-9570-4115-a644-7bceaf6aca8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:36.630514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890b909-9570-4115-a644-7bceaf6aca8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=3b387d002ac24c55b908e4d51bb819f4, group=identity)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:36.634578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9890b909-9570-4115-a644-7bceaf6aca8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:36.703825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:36.705630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:36.705630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:36.707361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] PATH_INFO: `/v3/projects/17d0a68c42b84e2eb36d9c8151a057fa` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:36.714071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17d0a68c42b84e2eb36d9c8151a057fa)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:36.716773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:36.721036 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2792/5614] 10.222.0.25 () {60 vars in 1297 bytes} [Mon Oct 24 09:19:36 2022] PATCH /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity => generated 176 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:36.730639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890b909-9570-4115-a644-7bceaf6aca8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:36.746087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9890b909-9570-4115-a644-7bceaf6aca8f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:36.772384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7cecf-7f95-41f0-a9f0-ae41a80ac7c9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:36.773460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7cecf-7f95-41f0-a9f0-ae41a80ac7c9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:36.773949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7cecf-7f95-41f0-a9f0-ae41a80ac7c9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:36.774424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7cecf-7f95-41f0-a9f0-ae41a80ac7c9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity/driver` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:36.775337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7cecf-7f95-41f0-a9f0-ae41a80ac7c9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:update_domain_config(domain_id=3b387d002ac24c55b908e4d51bb819f4, group=identity, option=driver)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:36.781246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b7cecf-7f95-41f0-a9f0-ae41a80ac7c9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:36.794056 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:36.833825 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2793/5615] 10.222.0.25 () {60 vars in 1318 bytes} [Mon Oct 24 09:19:36 2022] PATCH /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity/driver => generated 176 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:19:36.843039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7cecf-7f95-41f0-a9f0-ae41a80ac7c9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:36.847825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17d0a68c42b84e2eb36d9c8151a057fa', 'request_id': 'req-e8922488-4f28-485c-93d0-241f2f1ee160'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.868279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17d0a68c42b84e2eb36d9c8151a057fa', 'request_id': 'req-e8922488-4f28-485c-93d0-241f2f1ee160'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.880160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7cecf-7f95-41f0-a9f0-ae41a80ac7c9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:36.888370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17d0a68c42b84e2eb36d9c8151a057fa', 'request_id': 'req-e8922488-4f28-485c-93d0-241f2f1ee160'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.938157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] The token cache is being invalidate because project 17d0a68c42b84e2eb36d9c8151a057fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:36.939764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.941203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:36.961273 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2823/5616] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:36 2022] DELETE /identity/v3/projects/17d0a68c42b84e2eb36d9c8151a057fa => generated 0 bytes in 639 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:36.965397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:36.968560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:37.073145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bbd86-f605-4b62-aa09-b3345d93eaaf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:37.073946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bbd86-f605-4b62-aa09-b3345d93eaaf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:37.074284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bbd86-f605-4b62-aa09-b3345d93eaaf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:37.074537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7bbd86-f605-4b62-aa09-b3345d93eaaf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity/driver` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:37.075152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bbd86-f605-4b62-aa09-b3345d93eaaf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3b387d002ac24c55b908e4d51bb819f4, group=identity, option=driver)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:37.076826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7bbd86-f605-4b62-aa09-b3345d93eaaf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:37.142286 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2794/5617] 10.222.0.25 () {58 vars in 1299 bytes} [Mon Oct 24 09:19:36 2022] DELETE /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity/driver => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:37.154609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bbd86-f605-4b62-aa09-b3345d93eaaf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:37.156460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7a7bbd86-f605-4b62-aa09-b3345d93eaaf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:37.175215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7bbd86-f605-4b62-aa09-b3345d93eaaf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:37.186161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1d115-c4b3-403b-b166-7785a389f39e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:37.187840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1d115-c4b3-403b-b166-7785a389f39e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:37.188302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1d115-c4b3-403b-b166-7785a389f39e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:37.188734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1d115-c4b3-403b-b166-7785a389f39e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity/driver` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:37.191062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1d115-c4b3-403b-b166-7785a389f39e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3b387d002ac24c55b908e4d51bb819f4, group=identity, option=driver)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:37.193801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d1d115-c4b3-403b-b166-7785a389f39e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c4d1d115-c4b3-403b-b166-7785a389f39e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Could not find option driver in group identity in domain configuration for domain 3b387d002ac24c55b908e4d51bb819f4.: keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 3b387d002ac24c55b908e4d51bb819f4. Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:37.211891 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 24 09:19:37.213336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 24 09:19:37.213336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 24 09:19:37.213336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 24 09:19:37.213336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:37.213336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:37.213336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 24 09:19:37.213336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 24 09:19:37.213336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find option driver in group identity in domain configuration for domain 3b387d002ac24c55b908e4d51bb819f4. Oct 24 09:19:37.213336 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:19:37.217362 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2795/5618] 10.222.0.25 () {58 vars in 1296 bytes} [Mon Oct 24 09:19:37 2022] GET /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity/driver => generated 171 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:19:37.218761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1d115-c4b3-403b-b166-7785a389f39e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:37.233440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1d115-c4b3-403b-b166-7785a389f39e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:37.243345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22c965-d0f7-4ad3-9b37-b926310f42fb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:37.244312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22c965-d0f7-4ad3-9b37-b926310f42fb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:37.245412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22c965-d0f7-4ad3-9b37-b926310f42fb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:37.245845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca22c965-d0f7-4ad3-9b37-b926310f42fb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:37.246590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22c965-d0f7-4ad3-9b37-b926310f42fb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3b387d002ac24c55b908e4d51bb819f4, group=identity)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:37.250679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca22c965-d0f7-4ad3-9b37-b926310f42fb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:37.253075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8922488-4f28-485c-93d0-241f2f1ee160 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:37.269578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:37.271259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:37.272607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:37.272935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] PATH_INFO: `/v3/users/6912ba7c990d4e9e95a51482fa3268dc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:37.278580 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:37.282875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6912ba7c990d4e9e95a51482fa3268dc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:37.292363 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2796/5619] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 09:19:37 2022] DELETE /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:37.293283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:37.294299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22c965-d0f7-4ad3-9b37-b926310f42fb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:37.318920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca22c965-d0f7-4ad3-9b37-b926310f42fb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:37.339519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2815ca-e373-4d59-9bcf-330d861ab425 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:37.340305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2815ca-e373-4d59-9bcf-330d861ab425 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:37.340659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2815ca-e373-4d59-9bcf-330d861ab425 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:37.341027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2815ca-e373-4d59-9bcf-330d861ab425 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:37.344003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2815ca-e373-4d59-9bcf-330d861ab425 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config(domain_id=3b387d002ac24c55b908e4d51bb819f4, group=identity)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:37.349758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2815ca-e373-4d59-9bcf-330d861ab425 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-cf2815ca-e373-4d59-9bcf-330d861ab425 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Could not find group identity in domain configuration for domain 3b387d002ac24c55b908e4d51bb819f4.: keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 3b387d002ac24c55b908e4d51bb819f4. Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:37.394886 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 179, in get Oct 24 09:19:37.395725 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application config = self._get_config(domain_id, group, option) Oct 24 09:19:37.395725 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 186, in _get_config Oct 24 09:19:37.395725 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return PROVIDERS.domain_config_api.get_config( Oct 24 09:19:37.395725 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:37.395725 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:37.395725 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 1266, in get_config Oct 24 09:19:37.395725 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainConfigNotFound( Oct 24 09:19:37.395725 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainConfigNotFound: Could not find group identity in domain configuration for domain 3b387d002ac24c55b908e4d51bb819f4. Oct 24 09:19:37.395725 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:19:37.401624 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2797/5620] 10.222.0.25 () {58 vars in 1275 bytes} [Mon Oct 24 09:19:37 2022] GET /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config/identity => generated 154 bytes in 106 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:19:37.408251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2815ca-e373-4d59-9bcf-330d861ab425 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:37.415090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6912ba7c990d4e9e95a51482fa3268dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:37.432866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2815ca-e373-4d59-9bcf-330d861ab425 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:37.445427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6912ba7c990d4e9e95a51482fa3268dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:37.446011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33402b-2a8a-49e9-a264-b4594b5e1d59 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:37.447994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33402b-2a8a-49e9-a264-b4594b5e1d59 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:37.448293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33402b-2a8a-49e9-a264-b4594b5e1d59 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:37.448934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a33402b-2a8a-49e9-a264-b4594b5e1d59 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:37.449565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33402b-2a8a-49e9-a264-b4594b5e1d59 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:delete_domain_config(domain_id=3b387d002ac24c55b908e4d51bb819f4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:37.449841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6912ba7c990d4e9e95a51482fa3268dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:37.456820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a33402b-2a8a-49e9-a264-b4594b5e1d59 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:37.465068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6912ba7c990d4e9e95a51482fa3268dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:37.478695 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2798/5621] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:37 2022] DELETE /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4/config => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:37.480503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33402b-2a8a-49e9-a264-b4594b5e1d59 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:37.482952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a33402b-2a8a-49e9-a264-b4594b5e1d59 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:37.484057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6912ba7c990d4e9e95a51482fa3268dc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:37.507213 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2824/5622] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:36 2022] DELETE /identity/v3/users/6912ba7c990d4e9e95a51482fa3268dc => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:37.511432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a33402b-2a8a-49e9-a264-b4594b5e1d59 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:37.675818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:37.676447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:37.676827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:37.677123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:37.679554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=3b387d002ac24c55b908e4d51bb819f4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:37.682681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:37.787117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:37.789546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:37.922973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:37.926756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:37.942906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2799/5623] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:19:37 2022] PATCH /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4 => generated 277 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:37.945401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:37.967262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04895577-4838-4844-b15c-58e4c5145ee1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:38.082903 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:38.184982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:38.186332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:38.186591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:38.189525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:38.244460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=3b387d002ac24c55b908e4d51bb819f4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:38.247787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:38.326606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.331665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.426679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:38.429470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:38.510596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4', 'request_id': 'req-172da4fc-2324-458d-95e1-46395a9d8601'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.535599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4', 'request_id': 'req-172da4fc-2324-458d-95e1-46395a9d8601'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.553727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4', 'request_id': 'req-172da4fc-2324-458d-95e1-46395a9d8601'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.584116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] The token cache is being invalidate because project 3b387d002ac24c55b908e4d51bb819f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:38.584456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.587271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.607624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4', 'request_id': 'req-172da4fc-2324-458d-95e1-46395a9d8601'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.608889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4', 'request_id': 'req-172da4fc-2324-458d-95e1-46395a9d8601'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.610943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '3b387d002ac24c55b908e4d51bb819f4', 'request_id': 'req-172da4fc-2324-458d-95e1-46395a9d8601'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.636187 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2825/5624] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:37 2022] DELETE /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:38.644417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:38.646196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:38.721844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588232d5-3dee-40b5-a9b1-3caa953fde04 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:38.746487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172da4fc-2324-458d-95e1-46395a9d8601 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:38.752822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d04bd7-d32b-40c7-b3c9-92fdb932eadd tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:38.753583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d04bd7-d32b-40c7-b3c9-92fdb932eadd tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:38.753962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d04bd7-d32b-40c7-b3c9-92fdb932eadd tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:38.754364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d04bd7-d32b-40c7-b3c9-92fdb932eadd tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:38.754981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d04bd7-d32b-40c7-b3c9-92fdb932eadd tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:38.756578 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-07d04bd7-d32b-40c7-b3c9-92fdb932eadd tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:38.756578 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:19:38.756578 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:19:38.757856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d04bd7-d32b-40c7-b3c9-92fdb932eadd tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:38.763582 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2826/5625] 10.222.0.25 () {58 vars in 1173 bytes} [Mon Oct 24 09:19:38 2022] GET /identity/v3/domains/config/default => generated 1527 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:19:38.768532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d04bd7-d32b-40c7-b3c9-92fdb932eadd tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:38.798318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d04bd7-d32b-40c7-b3c9-92fdb932eadd tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:38.812133 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:38.815642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0018ea-91c2-4722-8fac-f65ba8b52bad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:38.817194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0018ea-91c2-4722-8fac-f65ba8b52bad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:38.819811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0018ea-91c2-4722-8fac-f65ba8b52bad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:38.820170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0018ea-91c2-4722-8fac-f65ba8b52bad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/identity/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:38.821376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0018ea-91c2-4722-8fac-f65ba8b52bad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:38.827447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0018ea-91c2-4722-8fac-f65ba8b52bad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:38.831287 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2827/5626] 10.222.0.25 () {58 vars in 1200 bytes} [Mon Oct 24 09:19:38 2022] GET /identity/v3/domains/config/identity/default => generated 64 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:38.835896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0018ea-91c2-4722-8fac-f65ba8b52bad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:38.855403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0018ea-91c2-4722-8fac-f65ba8b52bad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:38.861220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:38.861601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a330f-e7bc-4df0-a2fd-2c7a138975ee tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:38.861902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:38.862191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:38.862360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a330f-e7bc-4df0-a2fd-2c7a138975ee tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:38.862476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] PATH_INFO: `/v3/projects/86954f83f2df49c88a85235d9cfdee36` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:38.862639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a330f-e7bc-4df0-a2fd-2c7a138975ee tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:38.862998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5a330f-e7bc-4df0-a2fd-2c7a138975ee tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/identity/driver/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:38.863660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a330f-e7bc-4df0-a2fd-2c7a138975ee tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=driver)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:38.865939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86954f83f2df49c88a85235d9cfdee36)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:38.866220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5a330f-e7bc-4df0-a2fd-2c7a138975ee tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:38.870852 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2828/5627] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:19:38 2022] GET /identity/v3/domains/config/identity/driver/default => generated 30 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:38.871043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:38.877273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a330f-e7bc-4df0-a2fd-2c7a138975ee tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:38.886764 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:38.908057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5a330f-e7bc-4df0-a2fd-2c7a138975ee tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:38.925988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8c4fb-e9f0-44b7-ab96-4f2fd9adc8ad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:38.926695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8c4fb-e9f0-44b7-ab96-4f2fd9adc8ad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:38.934155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8c4fb-e9f0-44b7-ab96-4f2fd9adc8ad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:38.935509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b8c4fb-e9f0-44b7-ab96-4f2fd9adc8ad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/identity/list_limit/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:38.940166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8c4fb-e9f0-44b7-ab96-4f2fd9adc8ad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=identity, option=list_limit)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:38.947828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b8c4fb-e9f0-44b7-ab96-4f2fd9adc8ad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:38.949765 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2829/5628] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:38 2022] GET /identity/v3/domains/config/identity/list_limit/default => generated 33 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 24 09:19:38.957817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8c4fb-e9f0-44b7-ab96-4f2fd9adc8ad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:38.979947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86954f83f2df49c88a85235d9cfdee36', 'request_id': 'req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:38.989419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86954f83f2df49c88a85235d9cfdee36', 'request_id': 'req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:39.003282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b8c4fb-e9f0-44b7-ab96-4f2fd9adc8ad tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.004058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86954f83f2df49c88a85235d9cfdee36', 'request_id': 'req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:39.032968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] The token cache is being invalidate because project 86954f83f2df49c88a85235d9cfdee36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:39.033399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:39.034101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-81aebbb6-328b-46ba-9d30-8ba8cca4b8d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:39.040443 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2800/5629] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:38 2022] DELETE /identity/v3/projects/86954f83f2df49c88a85235d9cfdee36 => generated 0 bytes in 611 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:39.042669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3703e-6140-4143-9eec-5eaa28e9d5d6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.042968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3703e-6140-4143-9eec-5eaa28e9d5d6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.043255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a3703e-6140-4143-9eec-5eaa28e9d5d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.185331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d0a3703e-6140-4143-9eec-5eaa28e9d5d6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:39.193031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d0a3703e-6140-4143-9eec-5eaa28e9d5d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:39.206169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509668b8-fbb0-49c5-8a20-a95a0c129990 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.207358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509668b8-fbb0-49c5-8a20-a95a0c129990 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.207974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509668b8-fbb0-49c5-8a20-a95a0c129990 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.208698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509668b8-fbb0-49c5-8a20-a95a0c129990 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.209905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509668b8-fbb0-49c5-8a20-a95a0c129990 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.213112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509668b8-fbb0-49c5-8a20-a95a0c129990 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.245686 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2830/5630] 10.222.0.25 () {58 vars in 1188 bytes} [Mon Oct 24 09:19:38 2022] GET /identity/v3/domains/config/ldap/default => generated 1476 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:39.250426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509668b8-fbb0-49c5-8a20-a95a0c129990 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.263523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-509668b8-fbb0-49c5-8a20-a95a0c129990 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:39.294243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509668b8-fbb0-49c5-8a20-a95a0c129990 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.308419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788bdc5-ddf4-45cd-adfc-7bd3c1a86711 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.313774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788bdc5-ddf4-45cd-adfc-7bd3c1a86711 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.314700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788bdc5-ddf4-45cd-adfc-7bd3c1a86711 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.315829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f788bdc5-ddf4-45cd-adfc-7bd3c1a86711 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/url/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.317474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788bdc5-ddf4-45cd-adfc-7bd3c1a86711 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=url)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.322173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f788bdc5-ddf4-45cd-adfc-7bd3c1a86711 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.329828 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2831/5631] 10.222.0.25 () {58 vars in 1200 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/url/default => generated 40 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.331593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788bdc5-ddf4-45cd-adfc-7bd3c1a86711 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.362780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f788bdc5-ddf4-45cd-adfc-7bd3c1a86711 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.378086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a18dfe-446a-4d08-a749-a41f59e461db tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.379116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a18dfe-446a-4d08-a749-a41f59e461db tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.382421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a18dfe-446a-4d08-a749-a41f59e461db tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.383544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a18dfe-446a-4d08-a749-a41f59e461db tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.385918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a18dfe-446a-4d08-a749-a41f59e461db tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.388554 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2801/5632] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:39.396576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c733-157e-44ff-9718-48bc13d6c9ae None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.397167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a18dfe-446a-4d08-a749-a41f59e461db tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.398081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c733-157e-44ff-9718-48bc13d6c9ae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.398554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba04c733-157e-44ff-9718-48bc13d6c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.401444 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2832/5633] 10.222.0.25 () {58 vars in 1203 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/user/default => generated 27 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.406442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a18dfe-446a-4d08-a749-a41f59e461db tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.440044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ba04c733-157e-44ff-9718-48bc13d6c9ae None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:39.441407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a18dfe-446a-4d08-a749-a41f59e461db tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.443564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ba04c733-157e-44ff-9718-48bc13d6c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:39.453669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd045eb2-b574-4a25-8b19-5a8a6113ef67 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.454319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd045eb2-b574-4a25-8b19-5a8a6113ef67 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.454607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd045eb2-b574-4a25-8b19-5a8a6113ef67 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.454883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd045eb2-b574-4a25-8b19-5a8a6113ef67 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/suffix/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.455614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd045eb2-b574-4a25-8b19-5a8a6113ef67 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=suffix)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.457232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd045eb2-b574-4a25-8b19-5a8a6113ef67 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.461562 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2833/5635] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/suffix/default => generated 44 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.461974 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2802/5635] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:39.462522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd045eb2-b574-4a25-8b19-5a8a6113ef67 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.464704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c733-157e-44ff-9718-48bc13d6c9ae None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.483939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba04c733-157e-44ff-9718-48bc13d6c9ae None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.487160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd045eb2-b574-4a25-8b19-5a8a6113ef67 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.496051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49872d93-d98f-41c7-816f-a5fdd852e214 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.497315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49872d93-d98f-41c7-816f-a5fdd852e214 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.498008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49872d93-d98f-41c7-816f-a5fdd852e214 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.498417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49872d93-d98f-41c7-816f-a5fdd852e214 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/query_scope/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.499859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49872d93-d98f-41c7-816f-a5fdd852e214 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=query_scope)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.501143 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-49872d93-d98f-41c7-816f-a5fdd852e214 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_domain_config_default": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:39.501143 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:19:39.501143 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:19:39.501631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cabd9-3799-45bf-92b4-0add21e7d012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.502286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cabd9-3799-45bf-92b4-0add21e7d012 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.502576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cabd9-3799-45bf-92b4-0add21e7d012 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.502862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94cabd9-3799-45bf-92b4-0add21e7d012 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.503085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49872d93-d98f-41c7-816f-a5fdd852e214 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.503518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cabd9-3799-45bf-92b4-0add21e7d012 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:39.503895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cabd9-3799-45bf-92b4-0add21e7d012 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.505675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94cabd9-3799-45bf-92b4-0add21e7d012 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.509059 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2803/5636] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/query_scope/default => generated 35 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.510171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49872d93-d98f-41c7-816f-a5fdd852e214 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.525611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49872d93-d98f-41c7-816f-a5fdd852e214 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.532919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab1afd-2688-48d2-9b62-dd1303b24cf2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.533672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab1afd-2688-48d2-9b62-dd1303b24cf2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.533957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab1afd-2688-48d2-9b62-dd1303b24cf2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.534453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ab1afd-2688-48d2-9b62-dd1303b24cf2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/page_size/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.535547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab1afd-2688-48d2-9b62-dd1303b24cf2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=page_size)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.537494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ab1afd-2688-48d2-9b62-dd1303b24cf2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.542916 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2804/5637] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/page_size/default => generated 29 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.543869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab1afd-2688-48d2-9b62-dd1303b24cf2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.547503 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2834/5638] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:39.552962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cabd9-3799-45bf-92b4-0add21e7d012 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.559791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ab1afd-2688-48d2-9b62-dd1303b24cf2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.566785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c3bbc-742a-4e46-8f24-e0a4cc0a7821 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.567219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3bbc-742a-4e46-8f24-e0a4cc0a7821 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.567878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3bbc-742a-4e46-8f24-e0a4cc0a7821 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.568178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6c3bbc-742a-4e46-8f24-e0a4cc0a7821 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/alias_dereferencing/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.569071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c3bbc-742a-4e46-8f24-e0a4cc0a7821 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=alias_dereferencing)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.571063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6c3bbc-742a-4e46-8f24-e0a4cc0a7821 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.574463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94cabd9-3799-45bf-92b4-0add21e7d012 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.576758 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2805/5639] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/alias_dereferencing/default => generated 47 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.578247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c3bbc-742a-4e46-8f24-e0a4cc0a7821 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.583838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb3280-8d1e-4bb0-88fa-05dc701553b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.584573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb3280-8d1e-4bb0-88fa-05dc701553b5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.584846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb3280-8d1e-4bb0-88fa-05dc701553b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.585125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb3280-8d1e-4bb0-88fa-05dc701553b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.592086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb3280-8d1e-4bb0-88fa-05dc701553b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.596550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6c3bbc-742a-4e46-8f24-e0a4cc0a7821 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.599118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1cb3280-8d1e-4bb0-88fa-05dc701553b5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.604965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26370-b836-4daf-8df3-8df7cf46264b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.605855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26370-b836-4daf-8df3-8df7cf46264b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.606270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26370-b836-4daf-8df3-8df7cf46264b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.606451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb26370-b836-4daf-8df3-8df7cf46264b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/debug_level/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.607695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb26370-b836-4daf-8df3-8df7cf46264b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=debug_level)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.610142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb26370-b836-4daf-8df3-8df7cf46264b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.615860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2806/5640] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/debug_level/default => generated 34 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.618186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26370-b836-4daf-8df3-8df7cf46264b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.645981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb26370-b836-4daf-8df3-8df7cf46264b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.661687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be983a0-e1e5-45fd-b539-e1f349e58223 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.664801 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2835/5641] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:39 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:39.664948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be983a0-e1e5-45fd-b539-e1f349e58223 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.664948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be983a0-e1e5-45fd-b539-e1f349e58223 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.666505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be983a0-e1e5-45fd-b539-e1f349e58223 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/chase_referrals/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.667128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be983a0-e1e5-45fd-b539-e1f349e58223 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=chase_referrals)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.670510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb3280-8d1e-4bb0-88fa-05dc701553b5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.672460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be983a0-e1e5-45fd-b539-e1f349e58223 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.680481 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2807/5642] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/chase_referrals/default => generated 38 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.681564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be983a0-e1e5-45fd-b539-e1f349e58223 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.706536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be983a0-e1e5-45fd-b539-e1f349e58223 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.730630 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:39.843353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57311-cab1-4ac6-89bd-531f718f8fc9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.843932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57311-cab1-4ac6-89bd-531f718f8fc9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.844217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57311-cab1-4ac6-89bd-531f718f8fc9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.844561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb3280-8d1e-4bb0-88fa-05dc701553b5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.844695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef57311-cab1-4ac6-89bd-531f718f8fc9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_tree_dn/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.845167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef57311-cab1-4ac6-89bd-531f718f8fc9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_tree_dn)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.849455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef57311-cab1-4ac6-89bd-531f718f8fc9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.852643 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2808/5643] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/user_tree_dn/default => generated 35 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.855074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db7926-68dd-4e9a-a480-5722364c8976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.855466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57311-cab1-4ac6-89bd-531f718f8fc9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.855726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db7926-68dd-4e9a-a480-5722364c8976 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.856245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db7926-68dd-4e9a-a480-5722364c8976 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.856696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10db7926-68dd-4e9a-a480-5722364c8976 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.857651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db7926-68dd-4e9a-a480-5722364c8976 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.860009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10db7926-68dd-4e9a-a480-5722364c8976 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.883968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef57311-cab1-4ac6-89bd-531f718f8fc9 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.898569 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2836/5644] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:39 2022] POST /identity/v3/users => generated 288 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:39.899870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048a5e-500b-496b-acf5-a0e2b53ec52f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.901844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048a5e-500b-496b-acf5-a0e2b53ec52f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.902165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db7926-68dd-4e9a-a480-5722364c8976 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.902639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048a5e-500b-496b-acf5-a0e2b53ec52f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.903003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7048a5e-500b-496b-acf5-a0e2b53ec52f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_filter/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.903660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7048a5e-500b-496b-acf5-a0e2b53ec52f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_filter)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.909729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7048a5e-500b-496b-acf5-a0e2b53ec52f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.919637 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2809/5645] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/user_filter/default => generated 34 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.920838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048a5e-500b-496b-acf5-a0e2b53ec52f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.924033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10db7926-68dd-4e9a-a480-5722364c8976 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.930591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c487ac3-7602-4390-ac82-286fc0d220e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.931733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487ac3-7602-4390-ac82-286fc0d220e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.932025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487ac3-7602-4390-ac82-286fc0d220e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.932307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c487ac3-7602-4390-ac82-286fc0d220e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.933144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c487ac3-7602-4390-ac82-286fc0d220e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.934895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c487ac3-7602-4390-ac82-286fc0d220e6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.943297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7048a5e-500b-496b-acf5-a0e2b53ec52f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.952836 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2837/5646] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:39.958052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c487ac3-7602-4390-ac82-286fc0d220e6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.967808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdff198-f228-40eb-855a-4bcc0cda69a7 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.968948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdff198-f228-40eb-855a-4bcc0cda69a7 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.969479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdff198-f228-40eb-855a-4bcc0cda69a7 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.969989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdff198-f228-40eb-855a-4bcc0cda69a7 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_objectclass/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.971952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdff198-f228-40eb-855a-4bcc0cda69a7 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_objectclass)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:39.975635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdff198-f228-40eb-855a-4bcc0cda69a7 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:39.980602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c487ac3-7602-4390-ac82-286fc0d220e6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:39.981750 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2810/5647] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/user_objectclass/default => generated 50 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:39.984333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdff198-f228-40eb-855a-4bcc0cda69a7 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:39.993901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749653d-fcf5-4b81-9e7f-07fb78d51a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:39.994876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749653d-fcf5-4b81-9e7f-07fb78d51a82 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:39.995383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749653d-fcf5-4b81-9e7f-07fb78d51a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:39.995869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3749653d-fcf5-4b81-9e7f-07fb78d51a82 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:39.998582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749653d-fcf5-4b81-9e7f-07fb78d51a82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.004611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3749653d-fcf5-4b81-9e7f-07fb78d51a82 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.012421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdff198-f228-40eb-855a-4bcc0cda69a7 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.027597 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2838/5648] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:19:40.029379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1d013-43be-449e-ab2b-de4affbe9515 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.030296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1d013-43be-449e-ab2b-de4affbe9515 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.031034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1d013-43be-449e-ab2b-de4affbe9515 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.031529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1d013-43be-449e-ab2b-de4affbe9515 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_id_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.032352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1d013-43be-449e-ab2b-de4affbe9515 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_id_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.034316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1d013-43be-449e-ab2b-de4affbe9515 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.036789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749653d-fcf5-4b81-9e7f-07fb78d51a82 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.037346 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2811/5649] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:19:39 2022] GET /identity/v3/domains/config/ldap/user_id_attribute/default => generated 40 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.040358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1d013-43be-449e-ab2b-de4affbe9515 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.066686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3749653d-fcf5-4b81-9e7f-07fb78d51a82 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.068334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1d013-43be-449e-ab2b-de4affbe9515 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.078358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cebb71f9-5889-44a7-9dac-d7127fc2fcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.079684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faccefd-6c34-499e-97e2-3192d1f407f1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.080361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb71f9-5889-44a7-9dac-d7127fc2fcba admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.080819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb71f9-5889-44a7-9dac-d7127fc2fcba admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.082022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faccefd-6c34-499e-97e2-3192d1f407f1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.082531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cebb71f9-5889-44a7-9dac-d7127fc2fcba admin admin] PATH_INFO: `/v3/projects/8ef450f8b5c542539afd617a616a84db/users/6f42cd0bc47844a1880f6c3d654c1021/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.085781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faccefd-6c34-499e-97e2-3192d1f407f1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.086329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faccefd-6c34-499e-97e2-3192d1f407f1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_name_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.088461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faccefd-6c34-499e-97e2-3192d1f407f1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_name_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.091741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6faccefd-6c34-499e-97e2-3192d1f407f1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.097246 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2812/5650] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_name_attribute/default => generated 42 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.098460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faccefd-6c34-499e-97e2-3192d1f407f1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.122066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6faccefd-6c34-499e-97e2-3192d1f407f1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.123550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb71f9-5889-44a7-9dac-d7127fc2fcba admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ef450f8b5c542539afd617a616a84db, user_id=6f42cd0bc47844a1880f6c3d654c1021, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.126527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cebb71f9-5889-44a7-9dac-d7127fc2fcba admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.131827 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:40.139862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f52ac2-5e98-4962-a6de-0077bff18442 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.140595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f52ac2-5e98-4962-a6de-0077bff18442 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.140881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f52ac2-5e98-4962-a6de-0077bff18442 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.141151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f52ac2-5e98-4962-a6de-0077bff18442 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_mail_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.142077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f52ac2-5e98-4962-a6de-0077bff18442 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_mail_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.147258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f52ac2-5e98-4962-a6de-0077bff18442 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.153436 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2813/5651] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_mail_attribute/default => generated 44 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.154468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f52ac2-5e98-4962-a6de-0077bff18442 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.159941 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2839/5652] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:40 2022] PUT /identity/v3/projects/8ef450f8b5c542539afd617a616a84db/users/6f42cd0bc47844a1880f6c3d654c1021/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:40.174247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff4a5-b3ac-424e-b1b8-df6797bc398c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.175096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff4a5-b3ac-424e-b1b8-df6797bc398c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.175593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969ff4a5-b3ac-424e-b1b8-df6797bc398c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.182349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f52ac2-5e98-4962-a6de-0077bff18442 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.244814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-969ff4a5-b3ac-424e-b1b8-df6797bc398c None None] MFA Rules not processed for user `6f42cd0bc47844a1880f6c3d654c1021`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:40.246438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-969ff4a5-b3ac-424e-b1b8-df6797bc398c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:40.309612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5ab7b-71f0-4374-972a-cf2e2017559e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.312497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5ab7b-71f0-4374-972a-cf2e2017559e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.312870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5ab7b-71f0-4374-972a-cf2e2017559e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.314258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d5ab7b-71f0-4374-972a-cf2e2017559e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_description_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.315719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5ab7b-71f0-4374-972a-cf2e2017559e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_description_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.320171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d5ab7b-71f0-4374-972a-cf2e2017559e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.329487 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2814/5653] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_description_attribute/default => generated 58 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.330503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5ab7b-71f0-4374-972a-cf2e2017559e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.353541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d5ab7b-71f0-4374-972a-cf2e2017559e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.367243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641518c0-6a1c-4a03-9ab7-bdf01ea7926f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.368506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641518c0-6a1c-4a03-9ab7-bdf01ea7926f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.370287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641518c0-6a1c-4a03-9ab7-bdf01ea7926f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.370655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641518c0-6a1c-4a03-9ab7-bdf01ea7926f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_pass_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.371339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641518c0-6a1c-4a03-9ab7-bdf01ea7926f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_pass_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.375130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641518c0-6a1c-4a03-9ab7-bdf01ea7926f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.383254 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2815/5654] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_pass_attribute/default => generated 52 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.385088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641518c0-6a1c-4a03-9ab7-bdf01ea7926f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.408153 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2840/5655] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:40.410221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641518c0-6a1c-4a03-9ab7-bdf01ea7926f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.414003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff4a5-b3ac-424e-b1b8-df6797bc398c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.426931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969ff4a5-b3ac-424e-b1b8-df6797bc398c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.427834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536526fe-caf8-43ae-9ee7-c691248aa11b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.428595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536526fe-caf8-43ae-9ee7-c691248aa11b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.429065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536526fe-caf8-43ae-9ee7-c691248aa11b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.429483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536526fe-caf8-43ae-9ee7-c691248aa11b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.430257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536526fe-caf8-43ae-9ee7-c691248aa11b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.433735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d18f6a-d9a2-4842-81f9-b4bdb23e16f6 tempest-IdentityCatalogTest-1231137766 tempest-IdentityCatalogTest-1231137766-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f42cd0bc47844a1880f6c3d654c1021', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8ef450f8b5c542539afd617a616a84db', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.436867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536526fe-caf8-43ae-9ee7-c691248aa11b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.437372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18f6a-d9a2-4842-81f9-b4bdb23e16f6 tempest-IdentityCatalogTest-1231137766 tempest-IdentityCatalogTest-1231137766-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.437749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18f6a-d9a2-4842-81f9-b4bdb23e16f6 tempest-IdentityCatalogTest-1231137766 tempest-IdentityCatalogTest-1231137766-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.438386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d18f6a-d9a2-4842-81f9-b4bdb23e16f6 tempest-IdentityCatalogTest-1231137766 tempest-IdentityCatalogTest-1231137766-project] PATH_INFO: `/v3/auth/catalog` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.439803 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2816/5656] 10.222.0.25 () {58 vars in 1257 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_enabled_attribute/default => generated 50 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.440513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d18f6a-d9a2-4842-81f9-b4bdb23e16f6 tempest-IdentityCatalogTest-1231137766 tempest-IdentityCatalogTest-1231137766-project] RBAC: Authorizing `identity:get_auth_catalog()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.441655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d18f6a-d9a2-4842-81f9-b4bdb23e16f6 tempest-IdentityCatalogTest-1231137766 tempest-IdentityCatalogTest-1231137766-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.443823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536526fe-caf8-43ae-9ee7-c691248aa11b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.456068 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2841/5657] 10.222.0.25 () {58 vars in 1143 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/auth/catalog => generated 2658 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:40.459071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d18f6a-d9a2-4842-81f9-b4bdb23e16f6 tempest-IdentityCatalogTest-1231137766 tempest-IdentityCatalogTest-1231137766-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.481093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536526fe-caf8-43ae-9ee7-c691248aa11b tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.495824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b86757-c2f3-498e-b4cd-ee0b26c2d55c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.496570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86757-c2f3-498e-b4cd-ee0b26c2d55c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.496857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86757-c2f3-498e-b4cd-ee0b26c2d55c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.497311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b86757-c2f3-498e-b4cd-ee0b26c2d55c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_invert/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.497982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b86757-c2f3-498e-b4cd-ee0b26c2d55c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_invert)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.500727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b86757-c2f3-498e-b4cd-ee0b26c2d55c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.507447 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2817/5658] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_enabled_invert/default => generated 43 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 24 09:19:40.509016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b86757-c2f3-498e-b4cd-ee0b26c2d55c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.523986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b86757-c2f3-498e-b4cd-ee0b26c2d55c tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.531626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f6f72-7b35-4350-b6cb-54ff6ce952e5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.532581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f6f72-7b35-4350-b6cb-54ff6ce952e5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.532859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f6f72-7b35-4350-b6cb-54ff6ce952e5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.533424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99f6f72-7b35-4350-b6cb-54ff6ce952e5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_mask/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.534526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f6f72-7b35-4350-b6cb-54ff6ce952e5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_mask)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.536376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99f6f72-7b35-4350-b6cb-54ff6ce952e5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.538140 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2818/5659] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_enabled_mask/default => generated 37 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.542843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f6f72-7b35-4350-b6cb-54ff6ce952e5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.555010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99f6f72-7b35-4350-b6cb-54ff6ce952e5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.562161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a18c73-9b6e-4b1d-9d55-044ee0c4fc24 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.562821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a18c73-9b6e-4b1d-9d55-044ee0c4fc24 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.563107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a18c73-9b6e-4b1d-9d55-044ee0c4fc24 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.563389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a18c73-9b6e-4b1d-9d55-044ee0c4fc24 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_default/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.563982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a18c73-9b6e-4b1d-9d55-044ee0c4fc24 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.567135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a18c73-9b6e-4b1d-9d55-044ee0c4fc24 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.573535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2819/5660] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_enabled_default/default => generated 45 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.574437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a18c73-9b6e-4b1d-9d55-044ee0c4fc24 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.583729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d18f6a-d9a2-4842-81f9-b4bdb23e16f6 tempest-IdentityCatalogTest-1231137766 tempest-IdentityCatalogTest-1231137766-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.586525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a18c73-9b6e-4b1d-9d55-044ee0c4fc24 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.590888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.591750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.591870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2b0c-8607-4f8d-9e97-6dfecaf41b96 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.592080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.592337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] PATH_INFO: `/v3/users/6f42cd0bc47844a1880f6c3d654c1021` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.592646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2b0c-8607-4f8d-9e97-6dfecaf41b96 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.592938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2b0c-8607-4f8d-9e97-6dfecaf41b96 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.593566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac2b0c-8607-4f8d-9e97-6dfecaf41b96 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_attribute_ignore/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.593980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f42cd0bc47844a1880f6c3d654c1021)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.594117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac2b0c-8607-4f8d-9e97-6dfecaf41b96 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_attribute_ignore)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.596666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac2b0c-8607-4f8d-9e97-6dfecaf41b96 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.596815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.597032 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2820/5661] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_attribute_ignore/default => generated 62 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.601316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2b0c-8607-4f8d-9e97-6dfecaf41b96 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.615607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac2b0c-8607-4f8d-9e97-6dfecaf41b96 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.628682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0202c0-c3cd-4eab-8d18-84a05d4845f8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.629096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0202c0-c3cd-4eab-8d18-84a05d4845f8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.629517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0202c0-c3cd-4eab-8d18-84a05d4845f8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.630380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0202c0-c3cd-4eab-8d18-84a05d4845f8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_default_project_id_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.631343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0202c0-c3cd-4eab-8d18-84a05d4845f8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_default_project_id_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.633905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0202c0-c3cd-4eab-8d18-84a05d4845f8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.640110 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2821/5662] 10.222.0.25 () {58 vars in 1290 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_default_project_id_attribute/default => generated 56 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.640110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0202c0-c3cd-4eab-8d18-84a05d4845f8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.653668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0202c0-c3cd-4eab-8d18-84a05d4845f8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.659544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702caed-3e1c-4630-b2bc-8ecfcaa3fccb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.660296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702caed-3e1c-4630-b2bc-8ecfcaa3fccb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.660650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702caed-3e1c-4630-b2bc-8ecfcaa3fccb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.661030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702caed-3e1c-4630-b2bc-8ecfcaa3fccb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.661915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702caed-3e1c-4630-b2bc-8ecfcaa3fccb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.664293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8702caed-3e1c-4630-b2bc-8ecfcaa3fccb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.665727 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2822/5663] 10.222.0.25 () {58 vars in 1257 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation/default => generated 46 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.669509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702caed-3e1c-4630-b2bc-8ecfcaa3fccb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.684242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8702caed-3e1c-4630-b2bc-8ecfcaa3fccb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.687390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f42cd0bc47844a1880f6c3d654c1021'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:40.693422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd296d-8e93-4e37-8e33-f7fe2c16c18d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.695727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd296d-8e93-4e37-8e33-f7fe2c16c18d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.696168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd296d-8e93-4e37-8e33-f7fe2c16c18d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.696794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cd296d-8e93-4e37-8e33-f7fe2c16c18d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_dn/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.698568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd296d-8e93-4e37-8e33-f7fe2c16c18d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_dn)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.700750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cd296d-8e93-4e37-8e33-f7fe2c16c18d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.705118 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2823/5664] 10.222.0.25 () {58 vars in 1266 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_dn/default => generated 48 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 24 09:19:40.707158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd296d-8e93-4e37-8e33-f7fe2c16c18d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.707723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f42cd0bc47844a1880f6c3d654c1021'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:40.708634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f42cd0bc47844a1880f6c3d654c1021'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:40.722243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cd296d-8e93-4e37-8e33-f7fe2c16c18d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.722710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f42cd0bc47844a1880f6c3d654c1021'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:40.731920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3be3e18f-0db9-4b2e-8324-58e3631af666 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f42cd0bc47844a1880f6c3d654c1021'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:40.734059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581fdc3-e732-43e4-b4cb-3c3a7a006c1d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.735251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581fdc3-e732-43e4-b4cb-3c3a7a006c1d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.736416 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:40.736858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581fdc3-e732-43e4-b4cb-3c3a7a006c1d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.737289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581fdc3-e732-43e4-b4cb-3c3a7a006c1d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.739393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581fdc3-e732-43e4-b4cb-3c3a7a006c1d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_enabled_emulation_use_group_config)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.741371 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2842/5665] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:40 2022] DELETE /identity/v3/users/6f42cd0bc47844a1880f6c3d654c1021 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:40.745710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577187-98f1-4e14-929c-1a0d330d9a33 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.746419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b581fdc3-e732-43e4-b4cb-3c3a7a006c1d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.746601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577187-98f1-4e14-929c-1a0d330d9a33 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.747032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2577187-98f1-4e14-929c-1a0d330d9a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.751863 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2824/5666] 10.222.0.25 () {58 vars in 1308 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_enabled_emulation_use_group_config/default => generated 63 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 24 09:19:40.753967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581fdc3-e732-43e4-b4cb-3c3a7a006c1d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.758924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b581fdc3-e732-43e4-b4cb-3c3a7a006c1d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:40.783177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a2577187-98f1-4e14-929c-1a0d330d9a33 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:40.784315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a2577187-98f1-4e14-929c-1a0d330d9a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:40.784507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581fdc3-e732-43e4-b4cb-3c3a7a006c1d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.871423 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:40.882103 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2843/5667] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:40.890716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577187-98f1-4e14-929c-1a0d330d9a33 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.892260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a2577187-98f1-4e14-929c-1a0d330d9a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:40.893733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f9dd8-4997-44a6-845e-77350b54d5ac tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.894736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f9dd8-4997-44a6-845e-77350b54d5ac tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.895178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f9dd8-4997-44a6-845e-77350b54d5ac tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.896163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f9dd8-4997-44a6-845e-77350b54d5ac tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/user_additional_attribute_mapping/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.897764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f9dd8-4997-44a6-845e-77350b54d5ac tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=user_additional_attribute_mapping)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.905263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3f9dd8-4997-44a6-845e-77350b54d5ac tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.907446 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2825/5668] 10.222.0.25 () {58 vars in 1290 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/user_additional_attribute_mapping/default => generated 54 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.912190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f9dd8-4997-44a6-845e-77350b54d5ac tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.923831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f9dd8-4997-44a6-845e-77350b54d5ac tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.929347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c25f2-1ed4-4cd7-9811-d272b84854a8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.930000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c25f2-1ed4-4cd7-9811-d272b84854a8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.930289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c25f2-1ed4-4cd7-9811-d272b84854a8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.930756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201c25f2-1ed4-4cd7-9811-d272b84854a8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_tree_dn/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.931713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c25f2-1ed4-4cd7-9811-d272b84854a8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_tree_dn)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.934024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201c25f2-1ed4-4cd7-9811-d272b84854a8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.939243 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2826/5669] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/group_tree_dn/default => generated 36 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.939960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c25f2-1ed4-4cd7-9811-d272b84854a8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.954149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201c25f2-1ed4-4cd7-9811-d272b84854a8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.961491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a436014-3c2c-463f-8742-2dcfd76419c2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.962141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436014-3c2c-463f-8742-2dcfd76419c2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.963162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436014-3c2c-463f-8742-2dcfd76419c2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.963658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a436014-3c2c-463f-8742-2dcfd76419c2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_filter/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.964293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a436014-3c2c-463f-8742-2dcfd76419c2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_filter)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.966006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a436014-3c2c-463f-8742-2dcfd76419c2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:40.967913 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2827/5670] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/group_filter/default => generated 35 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:40.973355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a436014-3c2c-463f-8742-2dcfd76419c2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:40.987925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a436014-3c2c-463f-8742-2dcfd76419c2 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:40.995003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd160af-7ab2-4c2e-95ef-91432ac218d4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:40.995746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd160af-7ab2-4c2e-95ef-91432ac218d4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:40.996033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd160af-7ab2-4c2e-95ef-91432ac218d4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:40.996416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd160af-7ab2-4c2e-95ef-91432ac218d4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_objectclass/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:40.997003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd160af-7ab2-4c2e-95ef-91432ac218d4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_objectclass)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:40.998951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd160af-7ab2-4c2e-95ef-91432ac218d4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.000419 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2828/5671] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/domains/config/ldap/group_objectclass/default => generated 50 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.004204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2577187-98f1-4e14-929c-1a0d330d9a33 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.004775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd160af-7ab2-4c2e-95ef-91432ac218d4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.009110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5105a05-0fe7-41ef-a57c-67d7c12a3115 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.010380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105a05-0fe7-41ef-a57c-67d7c12a3115 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.010660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105a05-0fe7-41ef-a57c-67d7c12a3115 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.011164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5105a05-0fe7-41ef-a57c-67d7c12a3115 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.017812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd160af-7ab2-4c2e-95ef-91432ac218d4 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.023251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d40c4-0416-4108-a8d5-44faee3ec030 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.023655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5105a05-0fe7-41ef-a57c-67d7c12a3115 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.024490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d40c4-0416-4108-a8d5-44faee3ec030 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.024779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d40c4-0416-4108-a8d5-44faee3ec030 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.025112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71d40c4-0416-4108-a8d5-44faee3ec030 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_id_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.025960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5105a05-0fe7-41ef-a57c-67d7c12a3115 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.026247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d40c4-0416-4108-a8d5-44faee3ec030 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_id_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.027991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71d40c4-0416-4108-a8d5-44faee3ec030 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.032535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2829/5672] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/group_id_attribute/default => generated 41 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.033484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d40c4-0416-4108-a8d5-44faee3ec030 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.045216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71d40c4-0416-4108-a8d5-44faee3ec030 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.050672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2aa34-e664-4f11-82c6-d0d708988718 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.051375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2aa34-e664-4f11-82c6-d0d708988718 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.051626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2aa34-e664-4f11-82c6-d0d708988718 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.051904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe2aa34-e664-4f11-82c6-d0d708988718 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_name_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.052490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2aa34-e664-4f11-82c6-d0d708988718 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_name_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.054007 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2844/5673] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:19:41.055185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe2aa34-e664-4f11-82c6-d0d708988718 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.057767 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2830/5674] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/group_name_attribute/default => generated 43 bytes in 25 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.070169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5105a05-0fe7-41ef-a57c-67d7c12a3115 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.084180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5105a05-0fe7-41ef-a57c-67d7c12a3115 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.091387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449702a-459e-428f-97fb-f58a3ee02e83 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.092206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449702a-459e-428f-97fb-f58a3ee02e83 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.092564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449702a-459e-428f-97fb-f58a3ee02e83 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.092943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449702a-459e-428f-97fb-f58a3ee02e83 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_members_are_ids/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.093672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449702a-459e-428f-97fb-f58a3ee02e83 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_members_are_ids)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.095525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449702a-459e-428f-97fb-f58a3ee02e83 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.097956 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2845/5675] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/group_members_are_ids/default => generated 45 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.102944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2aa34-e664-4f11-82c6-d0d708988718 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.116203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe2aa34-e664-4f11-82c6-d0d708988718 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.122506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5166b-efc6-4713-96f5-371b79c26491 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.123162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5166b-efc6-4713-96f5-371b79c26491 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.123444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5166b-efc6-4713-96f5-371b79c26491 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.123787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b5166b-efc6-4713-96f5-371b79c26491 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_member_attribute/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.124382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5166b-efc6-4713-96f5-371b79c26491 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_member_attribute)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.126218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b5166b-efc6-4713-96f5-371b79c26491 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.132792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449702a-459e-428f-97fb-f58a3ee02e83 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.140988 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2831/5676] 10.222.0.25 () {58 vars in 1257 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/group_member_attribute/default => generated 49 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.151136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449702a-459e-428f-97fb-f58a3ee02e83 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.164622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631aa9a-2cd2-49a6-a0b2-596a6bb5162d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.165557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631aa9a-2cd2-49a6-a0b2-596a6bb5162d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.166193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631aa9a-2cd2-49a6-a0b2-596a6bb5162d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.166577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5631aa9a-2cd2-49a6-a0b2-596a6bb5162d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_desc_attribute/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.167281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631aa9a-2cd2-49a6-a0b2-596a6bb5162d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_desc_attribute)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.169509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5631aa9a-2cd2-49a6-a0b2-596a6bb5162d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.176763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5166b-efc6-4713-96f5-371b79c26491 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.182013 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2846/5677] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/group_desc_attribute/default => generated 52 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.195693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b5166b-efc6-4713-96f5-371b79c26491 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.212328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd51c20-bfdc-42a8-b56e-6805eee2e8e8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.213343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd51c20-bfdc-42a8-b56e-6805eee2e8e8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.213801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd51c20-bfdc-42a8-b56e-6805eee2e8e8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.214924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd51c20-bfdc-42a8-b56e-6805eee2e8e8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_attribute_ignore/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.215848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd51c20-bfdc-42a8-b56e-6805eee2e8e8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_attribute_ignore)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.226809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd51c20-bfdc-42a8-b56e-6805eee2e8e8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.234735 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2832/5678] 10.222.0.25 () {58 vars in 1257 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/group_attribute_ignore/default => generated 43 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.238447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631aa9a-2cd2-49a6-a0b2-596a6bb5162d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.277248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5631aa9a-2cd2-49a6-a0b2-596a6bb5162d tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.282799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e4dffd-3ef5-4cd4-bd11-dc56ab242bdf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.283470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4dffd-3ef5-4cd4-bd11-dc56ab242bdf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.283818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4dffd-3ef5-4cd4-bd11-dc56ab242bdf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.284040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e4dffd-3ef5-4cd4-bd11-dc56ab242bdf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/group_additional_attribute_mapping/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.284645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4dffd-3ef5-4cd4-bd11-dc56ab242bdf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=group_additional_attribute_mapping)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.287210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e4dffd-3ef5-4cd4-bd11-dc56ab242bdf tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.289452 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2847/5679] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/group_additional_attribute_mapping/default => generated 55 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.293441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd51c20-bfdc-42a8-b56e-6805eee2e8e8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.310463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd51c20-bfdc-42a8-b56e-6805eee2e8e8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.311509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b18e0-14e7-4f9b-b82d-eb5fc117861a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.312649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b18e0-14e7-4f9b-b82d-eb5fc117861a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.313416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645b18e0-14e7-4f9b-b82d-eb5fc117861a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.316482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979527ce-31a6-4fd4-bfd9-3e5efe0e12b6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.317272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979527ce-31a6-4fd4-bfd9-3e5efe0e12b6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.318089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979527ce-31a6-4fd4-bfd9-3e5efe0e12b6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.318478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979527ce-31a6-4fd4-bfd9-3e5efe0e12b6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertfile/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.319224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979527ce-31a6-4fd4-bfd9-3e5efe0e12b6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertfile)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.321889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979527ce-31a6-4fd4-bfd9-3e5efe0e12b6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.325422 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2833/5680] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/tls_cacertfile/default => generated 37 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.327794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979527ce-31a6-4fd4-bfd9-3e5efe0e12b6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.339635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979527ce-31a6-4fd4-bfd9-3e5efe0e12b6 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.345269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb481f4d-641a-48ea-8c1a-f78e8d1126b8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.346107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481f4d-641a-48ea-8c1a-f78e8d1126b8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.346687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481f4d-641a-48ea-8c1a-f78e8d1126b8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.347056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb481f4d-641a-48ea-8c1a-f78e8d1126b8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_cacertdir/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.348154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb481f4d-641a-48ea-8c1a-f78e8d1126b8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_cacertdir)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.350009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb481f4d-641a-48ea-8c1a-f78e8d1126b8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.351618 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2834/5681] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/tls_cacertdir/default => generated 36 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.355216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb481f4d-641a-48ea-8c1a-f78e8d1126b8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.370956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-645b18e0-14e7-4f9b-b82d-eb5fc117861a None None] MFA Rules not processed for user `9d0b4f066e344bba84c0369d4c695f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:41.377631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-645b18e0-14e7-4f9b-b82d-eb5fc117861a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:41.388014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb481f4d-641a-48ea-8c1a-f78e8d1126b8 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.406791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bc872-ddcc-4ec2-b73d-1931fb7792bb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.406791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bc872-ddcc-4ec2-b73d-1931fb7792bb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.406791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bc872-ddcc-4ec2-b73d-1931fb7792bb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.407305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1bc872-ddcc-4ec2-b73d-1931fb7792bb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_tls/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.408310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bc872-ddcc-4ec2-b73d-1931fb7792bb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_tls)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.411751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1bc872-ddcc-4ec2-b73d-1931fb7792bb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.416783 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2835/5682] 10.222.0.25 () {58 vars in 1212 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/use_tls/default => generated 31 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.418005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bc872-ddcc-4ec2-b73d-1931fb7792bb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.440984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1bc872-ddcc-4ec2-b73d-1931fb7792bb tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.453732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f85d2-0781-4997-8a13-2b9677ccaea0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.456516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f85d2-0781-4997-8a13-2b9677ccaea0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.457070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f85d2-0781-4997-8a13-2b9677ccaea0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.457771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f85d2-0781-4997-8a13-2b9677ccaea0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/tls_req_cert/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.459117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f85d2-0781-4997-8a13-2b9677ccaea0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=tls_req_cert)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.464803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f85d2-0781-4997-8a13-2b9677ccaea0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.467813 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2836/5683] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/tls_req_cert/default => generated 39 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.472003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f85d2-0781-4997-8a13-2b9677ccaea0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.502181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f85d2-0781-4997-8a13-2b9677ccaea0 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.516491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25f782-c810-4ad8-bbbc-ee338d9bc514 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.522852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25f782-c810-4ad8-bbbc-ee338d9bc514 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.523170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25f782-c810-4ad8-bbbc-ee338d9bc514 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.523457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25f782-c810-4ad8-bbbc-ee338d9bc514 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_pool/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.524077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25f782-c810-4ad8-bbbc-ee338d9bc514 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_pool)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.529244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25f782-c810-4ad8-bbbc-ee338d9bc514 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.530745 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2837/5684] 10.222.0.25 () {58 vars in 1215 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/use_pool/default => generated 31 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.537823 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2848/5685] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:41.537987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25f782-c810-4ad8-bbbc-ee338d9bc514 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.566528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25f782-c810-4ad8-bbbc-ee338d9bc514 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.573653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ec78-d140-4688-8806-72f8d60e6615 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.575307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ec78-d140-4688-8806-72f8d60e6615 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.575837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ec78-d140-4688-8806-72f8d60e6615 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.576300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3ec78-d140-4688-8806-72f8d60e6615 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_size/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.592273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3ec78-d140-4688-8806-72f8d60e6615 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_size)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.597466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d3ec78-d140-4688-8806-72f8d60e6615 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.600704 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2838/5686] 10.222.0.25 () {58 vars in 1218 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/pool_size/default => generated 30 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.604652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b18e0-14e7-4f9b-b82d-eb5fc117861a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.652132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645b18e0-14e7-4f9b-b82d-eb5fc117861a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.666129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f864f-de98-41f2-acc4-e7ebc7ea162e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.666816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f864f-de98-41f2-acc4-e7ebc7ea162e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.667099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f864f-de98-41f2-acc4-e7ebc7ea162e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.667385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f864f-de98-41f2-acc4-e7ebc7ea162e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_max/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.667978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f864f-de98-41f2-acc4-e7ebc7ea162e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_max)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.669690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f864f-de98-41f2-acc4-e7ebc7ea162e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.675700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ec78-d140-4688-8806-72f8d60e6615 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.676713 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2849/5687] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/pool_retry_max/default => generated 34 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.708628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3ec78-d140-4688-8806-72f8d60e6615 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.728460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6087482-f0ea-4b35-b1c3-8c6fb8991495 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.728796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6087482-f0ea-4b35-b1c3-8c6fb8991495 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.729441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6087482-f0ea-4b35-b1c3-8c6fb8991495 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.729563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6087482-f0ea-4b35-b1c3-8c6fb8991495 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_retry_delay/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.732316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6087482-f0ea-4b35-b1c3-8c6fb8991495 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_retry_delay)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.733331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6087482-f0ea-4b35-b1c3-8c6fb8991495 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.734791 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2839/5688] 10.222.0.25 () {58 vars in 1239 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/pool_retry_delay/default => generated 38 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 24 09:19:41.739695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f864f-de98-41f2-acc4-e7ebc7ea162e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.754965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6087482-f0ea-4b35-b1c3-8c6fb8991495 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.756498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f864f-de98-41f2-acc4-e7ebc7ea162e tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.757321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f6087482-f0ea-4b35-b1c3-8c6fb8991495 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:41.779223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173707a3-1a42-4bc1-bd43-5e6084226f4a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.779913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173707a3-1a42-4bc1-bd43-5e6084226f4a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.780349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173707a3-1a42-4bc1-bd43-5e6084226f4a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.780642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173707a3-1a42-4bc1-bd43-5e6084226f4a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_timeout/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.781254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173707a3-1a42-4bc1-bd43-5e6084226f4a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_timeout)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.783738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173707a3-1a42-4bc1-bd43-5e6084226f4a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.786071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6087482-f0ea-4b35-b1c3-8c6fb8991495 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.787306 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2850/5689] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/pool_connection_timeout/default => generated 44 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.788324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173707a3-1a42-4bc1-bd43-5e6084226f4a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.802398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.803273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.803656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.804053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] PATH_INFO: `/v3/projects/8ef450f8b5c542539afd617a616a84db` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.806268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ef450f8b5c542539afd617a616a84db)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.811502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.811749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173707a3-1a42-4bc1-bd43-5e6084226f4a tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.826100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893e2a9-727a-4f11-bf0f-f97dfeb18f12 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.827119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893e2a9-727a-4f11-bf0f-f97dfeb18f12 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.827502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893e2a9-727a-4f11-bf0f-f97dfeb18f12 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.827700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893e2a9-727a-4f11-bf0f-f97dfeb18f12 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/pool_connection_lifetime/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.828309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893e2a9-727a-4f11-bf0f-f97dfeb18f12 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=pool_connection_lifetime)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.830044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893e2a9-727a-4f11-bf0f-f97dfeb18f12 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.833641 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2851/5690] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/pool_connection_lifetime/default => generated 46 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.838925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893e2a9-727a-4f11-bf0f-f97dfeb18f12 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.911177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893e2a9-727a-4f11-bf0f-f97dfeb18f12 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:41.934471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032baf53-df12-4551-8608-7d139ea85b10 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:41.935555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032baf53-df12-4551-8608-7d139ea85b10 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:41.943888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032baf53-df12-4551-8608-7d139ea85b10 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:41.944520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032baf53-df12-4551-8608-7d139ea85b10 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/use_auth_pool/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:41.946588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032baf53-df12-4551-8608-7d139ea85b10 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=use_auth_pool)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:41.954650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032baf53-df12-4551-8608-7d139ea85b10 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:41.955526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ef450f8b5c542539afd617a616a84db', 'request_id': 'req-44195924-37f6-42e5-b8b2-69554d752016'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:41.973244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ef450f8b5c542539afd617a616a84db', 'request_id': 'req-44195924-37f6-42e5-b8b2-69554d752016'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:41.976899 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2852/5691] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/use_auth_pool/default => generated 36 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:41.978015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032baf53-df12-4551-8608-7d139ea85b10 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:41.993407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ef450f8b5c542539afd617a616a84db', 'request_id': 'req-44195924-37f6-42e5-b8b2-69554d752016'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:42.028732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032baf53-df12-4551-8608-7d139ea85b10 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.032363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] The token cache is being invalidate because project 8ef450f8b5c542539afd617a616a84db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:42.032980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:42.034502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-44195924-37f6-42e5-b8b2-69554d752016 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:42.043901 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:42.044658 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2840/5692] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:41 2022] DELETE /identity/v3/projects/8ef450f8b5c542539afd617a616a84db => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:42.049454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08734c9-0ceb-4c43-803f-e2f4f19fc9b3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.051256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08734c9-0ceb-4c43-803f-e2f4f19fc9b3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.051652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08734c9-0ceb-4c43-803f-e2f4f19fc9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.106650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c08734c9-0ceb-4c43-803f-e2f4f19fc9b3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:42.109604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c08734c9-0ceb-4c43-803f-e2f4f19fc9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:42.222119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aabb8e-5177-45cb-abb6-6ca4707119ff tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:42.222962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aabb8e-5177-45cb-abb6-6ca4707119ff tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.223349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aabb8e-5177-45cb-abb6-6ca4707119ff tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.223733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81aabb8e-5177-45cb-abb6-6ca4707119ff tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_size/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.224436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aabb8e-5177-45cb-abb6-6ca4707119ff tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_size)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:42.238846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81aabb8e-5177-45cb-abb6-6ca4707119ff tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:42.242471 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2853/5693] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:41 2022] GET /identity/v3/domains/config/ldap/auth_pool_size/default => generated 36 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 176 bytes (2 switches on core 0) Oct 24 09:19:42.249504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aabb8e-5177-45cb-abb6-6ca4707119ff tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:42.253905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-81aabb8e-5177-45cb-abb6-6ca4707119ff tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:42.283000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81aabb8e-5177-45cb-abb6-6ca4707119ff tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.296370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877a5e5-900f-488b-a35f-b137bf4b894f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:42.297313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877a5e5-900f-488b-a35f-b137bf4b894f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.297763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877a5e5-900f-488b-a35f-b137bf4b894f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.298248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4877a5e5-900f-488b-a35f-b137bf4b894f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/config/ldap/auth_pool_connection_lifetime/default` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.299006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877a5e5-900f-488b-a35f-b137bf4b894f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorizing `identity:get_domain_config_default(group=ldap, option=auth_pool_connection_lifetime)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:42.300803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4877a5e5-900f-488b-a35f-b137bf4b894f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:42.301823 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2841/5694] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:42.302429 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2854/5695] 10.222.0.25 () {58 vars in 1278 bytes} [Mon Oct 24 09:19:42 2022] GET /identity/v3/domains/config/ldap/auth_pool_connection_lifetime/default => generated 50 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:19:42.308100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877a5e5-900f-488b-a35f-b137bf4b894f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:42.308258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08734c9-0ceb-4c43-803f-e2f4f19fc9b3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:42.316469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c08734c9-0ceb-4c43-803f-e2f4f19fc9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:42.327200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4877a5e5-900f-488b-a35f-b137bf4b894f tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.337020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708d140-cbd0-4b9a-ac54-b4ffad6f4fb1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:42.341055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708d140-cbd0-4b9a-ac54-b4ffad6f4fb1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.341661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708d140-cbd0-4b9a-ac54-b4ffad6f4fb1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.342125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708d140-cbd0-4b9a-ac54-b4ffad6f4fb1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/3b387d002ac24c55b908e4d51bb819f4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.356040 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:42.358024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708d140-cbd0-4b9a-ac54-b4ffad6f4fb1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4708d140-cbd0-4b9a-ac54-b4ffad6f4fb1 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Could not find domain: 3b387d002ac24c55b908e4d51bb819f4.: keystone.exception.DomainNotFound: Could not find domain: 3b387d002ac24c55b908e4d51bb819f4. Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 3b387d002ac24c55b908e4d51bb819f4. Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:42.365951 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:42.367786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:19:42.368758 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 3b387d002ac24c55b908e4d51bb819f4. Oct 24 09:19:42.369834 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:42.369834 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2855/5696] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:19:42 2022] PATCH /identity/v3/domains/3b387d002ac24c55b908e4d51bb819f4 => generated 112 bytes in 60 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 24 09:19:42.369834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b305-bd1c-4085-bcaf-baeb3a5bb01d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.370856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b305-bd1c-4085-bcaf-baeb3a5bb01d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.371185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1b305-bd1c-4085-bcaf-baeb3a5bb01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.410709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1ae1b305-bd1c-4085-bcaf-baeb3a5bb01d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:42.425607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1ae1b305-bd1c-4085-bcaf-baeb3a5bb01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:42.449502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08734c9-0ceb-4c43-803f-e2f4f19fc9b3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.453122 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2856/5697] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:42.454218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b305-bd1c-4085-bcaf-baeb3a5bb01d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:42.458553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a091688-3634-4457-a530-1b4b6dd6ba43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:42.459194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a091688-3634-4457-a530-1b4b6dd6ba43 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.459477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a091688-3634-4457-a530-1b4b6dd6ba43 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.459756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a091688-3634-4457-a530-1b4b6dd6ba43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.470577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3a091688-3634-4457-a530-1b4b6dd6ba43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:42.471956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae1b305-bd1c-4085-bcaf-baeb3a5bb01d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.486350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a091688-3634-4457-a530-1b4b6dd6ba43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:42.488047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a091688-3634-4457-a530-1b4b6dd6ba43 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:42.491862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6df44-4ab9-448d-b52a-4956839b2839 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:42.492739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6df44-4ab9-448d-b52a-4956839b2839 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.493242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6df44-4ab9-448d-b52a-4956839b2839 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.493893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c6df44-4ab9-448d-b52a-4956839b2839 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/afe97130727d409295a4b597efc669cc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.505539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c6df44-4ab9-448d-b52a-4956839b2839 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:19:42.512742 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2842/5698] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:42.521051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a091688-3634-4457-a530-1b4b6dd6ba43 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-d4c6df44-4ab9-448d-b52a-4956839b2839 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Could not find domain: afe97130727d409295a4b597efc669cc.: keystone.exception.DomainNotFound: Could not find domain: afe97130727d409295a4b597efc669cc. Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: afe97130727d409295a4b597efc669cc. Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:42.532128 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:42.533263 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:19:42.534480 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: afe97130727d409295a4b597efc669cc. Oct 24 09:19:42.535669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:42.546731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a091688-3634-4457-a530-1b4b6dd6ba43 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.546931 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2857/5699] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:19:42 2022] PATCH /identity/v3/domains/afe97130727d409295a4b597efc669cc => generated 112 bytes in 91 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:19:42.548424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6df44-4ab9-448d-b52a-4956839b2839 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:42.553608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1a9a6-6089-409b-98cb-3ece217a45bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:42.561425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1a9a6-6089-409b-98cb-3ece217a45bb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.561727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1a9a6-6089-409b-98cb-3ece217a45bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.562227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1a9a6-6089-409b-98cb-3ece217a45bb admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.563030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1a9a6-6089-409b-98cb-3ece217a45bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:42.563347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1a9a6-6089-409b-98cb-3ece217a45bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:42.565256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1a9a6-6089-409b-98cb-3ece217a45bb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:42.578513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c6df44-4ab9-448d-b52a-4956839b2839 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.596507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2843/5700] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:42.597486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cca16c-6d85-47da-b521-fed52be977a5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1ff36349d934fdc8a003644258af855', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '098a1b5597684d3fb3ea80108aeff23b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:42.598214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cca16c-6d85-47da-b521-fed52be977a5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.598648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cca16c-6d85-47da-b521-fed52be977a5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.598932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cca16c-6d85-47da-b521-fed52be977a5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] PATH_INFO: `/v3/domains/d551053428804199b8473b01cd13b0a5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.600768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1a9a6-6089-409b-98cb-3ece217a45bb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:42.620396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1a9a6-6089-409b-98cb-3ece217a45bb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.626090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cca16c-6d85-47da-b521-fed52be977a5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:19:42.632674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d802-fcf2-4297-a578-e3752fa87750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:42.633329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d802-fcf2-4297-a578-e3752fa87750 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.633611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d802-fcf2-4297-a578-e3752fa87750 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.633890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5231d802-fcf2-4297-a578-e3752fa87750 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.640443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231d802-fcf2-4297-a578-e3752fa87750 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:42.640443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5231d802-fcf2-4297-a578-e3752fa87750 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-72cca16c-6d85-47da-b521-fed52be977a5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Could not find domain: d551053428804199b8473b01cd13b0a5.: keystone.exception.DomainNotFound: Could not find domain: d551053428804199b8473b01cd13b0a5. Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d551053428804199b8473b01cd13b0a5. Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:42.640663 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:42.641587 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:19:42.642492 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d551053428804199b8473b01cd13b0a5. Oct 24 09:19:42.643459 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:19:42.646080 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2858/5701] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:19:42 2022] PATCH /identity/v3/domains/d551053428804199b8473b01cd13b0a5 => generated 112 bytes in 98 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:19:42.649015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cca16c-6d85-47da-b521-fed52be977a5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:42.655381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-72cca16c-6d85-47da-b521-fed52be977a5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:42.693994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cca16c-6d85-47da-b521-fed52be977a5 tempest-DomainConfigurationTestJSON-723710430 tempest-DomainConfigurationTestJSON-723710430-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.718012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:42.718665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.718944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.719224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] PATH_INFO: `/v3/users/e81e7b04fdeb43c9a2008c54eebf0464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.725810 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2844/5702] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:42 2022] POST /identity/v3/projects => generated 373 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:42.728768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e81e7b04fdeb43c9a2008c54eebf0464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:42.730028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d802-fcf2-4297-a578-e3752fa87750 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:42.730793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:42.809165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e81e7b04fdeb43c9a2008c54eebf0464'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:42.834952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e81e7b04fdeb43c9a2008c54eebf0464'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:42.835623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e81e7b04fdeb43c9a2008c54eebf0464'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:42.854203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e81e7b04fdeb43c9a2008c54eebf0464'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:42.874058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e275ba5-faab-4975-a8c7-5904c8c9ce15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e81e7b04fdeb43c9a2008c54eebf0464'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:42.895157 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2859/5703] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:42 2022] DELETE /identity/v3/users/e81e7b04fdeb43c9a2008c54eebf0464 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:42.897977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5231d802-fcf2-4297-a578-e3752fa87750 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:42.901277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6acfb8-0d6b-4b15-83f1-936c89be6f9a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:42.901963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6acfb8-0d6b-4b15-83f1-936c89be6f9a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:42.902427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6acfb8-0d6b-4b15-83f1-936c89be6f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:42.945935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8f6acfb8-0d6b-4b15-83f1-936c89be6f9a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:42.948062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8f6acfb8-0d6b-4b15-83f1-936c89be6f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:43.028543 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:43.036874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4f0de-c64e-4b5b-b06b-9107c481cd3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:43.037528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4f0de-c64e-4b5b-b06b-9107c481cd3b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:43.037811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4f0de-c64e-4b5b-b06b-9107c481cd3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:43.038086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe4f0de-c64e-4b5b-b06b-9107c481cd3b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:43.038724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4f0de-c64e-4b5b-b06b-9107c481cd3b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:43.040696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe4f0de-c64e-4b5b-b06b-9107c481cd3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:43.084018 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2860/5704] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:43.096767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6acfb8-0d6b-4b15-83f1-936c89be6f9a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:43.099226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8f6acfb8-0d6b-4b15-83f1-936c89be6f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:43.106504 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2845/5705] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:42 2022] POST /identity/v3/users => generated 287 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:43.108002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4f0de-c64e-4b5b-b06b-9107c481cd3b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:43.110172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2fe4f0de-c64e-4b5b-b06b-9107c481cd3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:43.139510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe4f0de-c64e-4b5b-b06b-9107c481cd3b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:43.154971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb65618-9ec8-44ae-b6c3-3d6914d01646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:43.156133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb65618-9ec8-44ae-b6c3-3d6914d01646 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:43.156646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb65618-9ec8-44ae-b6c3-3d6914d01646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:43.158203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb65618-9ec8-44ae-b6c3-3d6914d01646 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:43.159178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb65618-9ec8-44ae-b6c3-3d6914d01646 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:43.161176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb65618-9ec8-44ae-b6c3-3d6914d01646 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:43.178052 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2846/5706] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:19:43.182375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb65618-9ec8-44ae-b6c3-3d6914d01646 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:43.201984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb65618-9ec8-44ae-b6c3-3d6914d01646 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:43.206811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6acfb8-0d6b-4b15-83f1-936c89be6f9a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:43.207771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269738f-8797-4023-ae2a-5940a1cd4ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:43.209334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269738f-8797-4023-ae2a-5940a1cd4ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:43.209840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269738f-8797-4023-ae2a-5940a1cd4ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:43.210299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269738f-8797-4023-ae2a-5940a1cd4ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:43.214893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f20076-cefd-4791-8317-dc14e1af8226 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:43.216119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f20076-cefd-4791-8317-dc14e1af8226 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:43.216119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f20076-cefd-4791-8317-dc14e1af8226 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:43.216119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f20076-cefd-4791-8317-dc14e1af8226 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:43.225685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269738f-8797-4023-ae2a-5940a1cd4ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:43.227399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269738f-8797-4023-ae2a-5940a1cd4ef6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:43.230862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f20076-cefd-4791-8317-dc14e1af8226 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:43.232759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f20076-cefd-4791-8317-dc14e1af8226 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:43.233248 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:43.251395 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2847/5707] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:43 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:43.252343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269738f-8797-4023-ae2a-5940a1cd4ef6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:43.263817 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2861/5708] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:19:43.271716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269738f-8797-4023-ae2a-5940a1cd4ef6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:43.286134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c95a79-1fdb-4b75-813b-f8608e515c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:43.286818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c95a79-1fdb-4b75-813b-f8608e515c75 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:43.287099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c95a79-1fdb-4b75-813b-f8608e515c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:43.287378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c95a79-1fdb-4b75-813b-f8608e515c75 admin admin] PATH_INFO: `/v3/projects/222a6b4a58294f44831765e3290a2933/users/9dc7412dc1a54c12b37f74232cc218c1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:43.321190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c95a79-1fdb-4b75-813b-f8608e515c75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=222a6b4a58294f44831765e3290a2933, user_id=9dc7412dc1a54c12b37f74232cc218c1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:43.324537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c95a79-1fdb-4b75-813b-f8608e515c75 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:43.359254 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2848/5709] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:43 2022] PUT /identity/v3/projects/222a6b4a58294f44831765e3290a2933/users/9dc7412dc1a54c12b37f74232cc218c1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:43.462957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a229-64c3-41fc-a2ec-9ab9db839c10 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:43.463592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a229-64c3-41fc-a2ec-9ab9db839c10 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:43.463954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1a229-64c3-41fc-a2ec-9ab9db839c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:43.502790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2cd1a229-64c3-41fc-a2ec-9ab9db839c10 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:43.504864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2cd1a229-64c3-41fc-a2ec-9ab9db839c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:43.642119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c95a79-1fdb-4b75-813b-f8608e515c75 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:43.656628 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2862/5710] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:43 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:43.657964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c95a79-1fdb-4b75-813b-f8608e515c75 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:43.675874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90042726-890e-498f-aed7-7596406039ee tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:43.676543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90042726-890e-498f-aed7-7596406039ee tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:43.676829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90042726-890e-498f-aed7-7596406039ee tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:43.680431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90042726-890e-498f-aed7-7596406039ee tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:43.828497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90042726-890e-498f-aed7-7596406039ee tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:43.858080 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2849/5711] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:43 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:44.001967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a229-64c3-41fc-a2ec-9ab9db839c10 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:44.003398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2cd1a229-64c3-41fc-a2ec-9ab9db839c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:44.108106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd1a229-64c3-41fc-a2ec-9ab9db839c10 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:44.116290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:44.117214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:44.117616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:44.117980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] PATH_INFO: `/v3/projects/2b13a7e5654e44aebf8b369763704233` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:44.119754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b13a7e5654e44aebf8b369763704233)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:44.121990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:44.170413 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:44.222551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b13a7e5654e44aebf8b369763704233', 'request_id': 'req-12c8a98a-6964-4519-9bd8-71b4ee65404f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.240806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b13a7e5654e44aebf8b369763704233', 'request_id': 'req-12c8a98a-6964-4519-9bd8-71b4ee65404f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.249806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b13a7e5654e44aebf8b369763704233', 'request_id': 'req-12c8a98a-6964-4519-9bd8-71b4ee65404f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.265410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] The token cache is being invalidate because project 2b13a7e5654e44aebf8b369763704233 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:44.265973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.266844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12c8a98a-6964-4519-9bd8-71b4ee65404f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.268583 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2863/5712] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:44 2022] DELETE /identity/v3/projects/2b13a7e5654e44aebf8b369763704233 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:44.272872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90042726-890e-498f-aed7-7596406039ee tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:44.274689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-90042726-890e-498f-aed7-7596406039ee tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:44.292275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90042726-890e-498f-aed7-7596406039ee tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:44.381517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:44.382524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:44.383014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:44.383515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] PATH_INFO: `/v3/users/b1ff36349d934fdc8a003644258af855` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:44.386737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1ff36349d934fdc8a003644258af855)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:44.390104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:44.482925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1ff36349d934fdc8a003644258af855'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.510921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1ff36349d934fdc8a003644258af855'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.512571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1ff36349d934fdc8a003644258af855'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.528897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1ff36349d934fdc8a003644258af855'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.558796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbb66550-13fb-4bc2-8a45-85d423e124bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1ff36349d934fdc8a003644258af855'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:44.584029 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2850/5713] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:44 2022] DELETE /identity/v3/users/b1ff36349d934fdc8a003644258af855 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:44.864332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fe827-4b85-4e71-961d-08461a2e98bd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:44.864840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fe827-4b85-4e71-961d-08461a2e98bd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:44.865700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97fe827-4b85-4e71-961d-08461a2e98bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:44.902140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f97fe827-4b85-4e71-961d-08461a2e98bd None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:44.904270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f97fe827-4b85-4e71-961d-08461a2e98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:44.910469 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2864/5714] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:44 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 09:19:44.917018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bf790-7d21-4696-bf87-4a8eaec65064 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:44.917018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bf790-7d21-4696-bf87-4a8eaec65064 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:44.917918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169bf790-7d21-4696-bf87-4a8eaec65064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:44.963284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-169bf790-7d21-4696-bf87-4a8eaec65064 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:44.968340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-169bf790-7d21-4696-bf87-4a8eaec65064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:44.980903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fe827-4b85-4e71-961d-08461a2e98bd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:44.983292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f97fe827-4b85-4e71-961d-08461a2e98bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:45.053434 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:INSERT=4,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:45.218323 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2851/5715] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:19:45.218323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bf790-7d21-4696-bf87-4a8eaec65064 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:45.236144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169bf790-7d21-4696-bf87-4a8eaec65064 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:45.241527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea50ccc-6fee-407f-8367-40a373a7eefb tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:45.242432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea50ccc-6fee-407f-8367-40a373a7eefb tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:45.243523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea50ccc-6fee-407f-8367-40a373a7eefb tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:45.244603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea50ccc-6fee-407f-8367-40a373a7eefb tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:45.296449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97fe827-4b85-4e71-961d-08461a2e98bd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:45.315648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee848-e57f-4570-bf90-142fb3adbd8c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:45.320526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee848-e57f-4570-bf90-142fb3adbd8c service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:45.321194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee848-e57f-4570-bf90-142fb3adbd8c service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:45.321846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33ee848-e57f-4570-bf90-142fb3adbd8c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:45.327121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c33ee848-e57f-4570-bf90-142fb3adbd8c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:45.379188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ee848-e57f-4570-bf90-142fb3adbd8c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:45.381231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33ee848-e57f-4570-bf90-142fb3adbd8c service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-9ea50ccc-6fee-407f-8367-40a373a7eefb tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:45.385544 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 24 09:19:45.386830 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:19:45.393209 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2852/5716] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:45 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 188 bytes in 176 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 24 09:19:45.394752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea50ccc-6fee-407f-8367-40a373a7eefb tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:45.420551 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2865/5717] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:19:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:19:45.425886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea50ccc-6fee-407f-8367-40a373a7eefb tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:45.445584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0f677-cc99-401f-a4ee-f529001ba6f9 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:45.446248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f677-cc99-401f-a4ee-f529001ba6f9 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:45.446537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f677-cc99-401f-a4ee-f529001ba6f9 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:45.447415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f0f677-cc99-401f-a4ee-f529001ba6f9 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c4f0f677-cc99-401f-a4ee-f529001ba6f9 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2.: keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:19:45.587520 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 291, in post Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.identity_api.change_password( Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1468, in change_password Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application driver.change_password(entity_id, new_password) Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 268, in change_password Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._validate_password_history(new_password, user_ref) Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 256, in _validate_password_history Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.PasswordHistoryValidationError( Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.PasswordHistoryValidationError: The new password cannot be identical to a previous password. The total number which includes the new password must be unique is 2. Oct 24 09:19:45.589104 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:19:45.591952 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2853/5718] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:45 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 188 bytes in 198 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 24 09:19:45.596323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee848-e57f-4570-bf90-142fb3adbd8c service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:45.618086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33ee848-e57f-4570-bf90-142fb3adbd8c service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:45.634157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a297329-b895-482d-8e1a-6d90f1b5e6ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:45.635525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a297329-b895-482d-8e1a-6d90f1b5e6ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:45.635946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a297329-b895-482d-8e1a-6d90f1b5e6ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:45.636452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a297329-b895-482d-8e1a-6d90f1b5e6ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:45.688140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0f677-cc99-401f-a4ee-f529001ba6f9 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:45.691188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c4f0f677-cc99-401f-a4ee-f529001ba6f9 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:45.781780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0a297329-b895-482d-8e1a-6d90f1b5e6ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:45.807070 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2866/5719] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:45 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:46.008251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f0f677-cc99-401f-a4ee-f529001ba6f9 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:46.031621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:46.032270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:46.032550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:46.032827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] PATH_INFO: `/v3/projects/098a1b5597684d3fb3ea80108aeff23b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:46.034713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=098a1b5597684d3fb3ea80108aeff23b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:46.036644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:46.145244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '098a1b5597684d3fb3ea80108aeff23b', 'request_id': 'req-2f06f05d-195a-4ee0-bf64-72a3465f61b4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:46.151700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '098a1b5597684d3fb3ea80108aeff23b', 'request_id': 'req-2f06f05d-195a-4ee0-bf64-72a3465f61b4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:46.167138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '098a1b5597684d3fb3ea80108aeff23b', 'request_id': 'req-2f06f05d-195a-4ee0-bf64-72a3465f61b4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:46.203707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] The token cache is being invalidate because project 098a1b5597684d3fb3ea80108aeff23b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:46.204001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:46.205047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2f06f05d-195a-4ee0-bf64-72a3465f61b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:46.207856 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2854/5720] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:45 2022] DELETE /identity/v3/projects/098a1b5597684d3fb3ea80108aeff23b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:46.213289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3d45-2000-4688-bf4c-e62579c6e784 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:46.213982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3d45-2000-4688-bf4c-e62579c6e784 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:46.214421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2e3d45-2000-4688-bf4c-e62579c6e784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:46.263235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6c2e3d45-2000-4688-bf4c-e62579c6e784 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:46.264827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6c2e3d45-2000-4688-bf4c-e62579c6e784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:46.395362 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:46.434638 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2867/5721] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:46.442369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a725c1-b00e-414a-85eb-890a5e1749b1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:46.442934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a725c1-b00e-414a-85eb-890a5e1749b1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:46.443385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a725c1-b00e-414a-85eb-890a5e1749b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:46.517347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-84a725c1-b00e-414a-85eb-890a5e1749b1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:46.518922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-84a725c1-b00e-414a-85eb-890a5e1749b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:46.545858 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2855/5722] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:46.550823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e3d45-2000-4688-bf4c-e62579c6e784 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:46.572748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2e3d45-2000-4688-bf4c-e62579c6e784 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:46.585161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa90ac-592c-4e91-b1a7-ac5f03a993bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:46.586375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa90ac-592c-4e91-b1a7-ac5f03a993bc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:46.587006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa90ac-592c-4e91-b1a7-ac5f03a993bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:46.587728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9aa90ac-592c-4e91-b1a7-ac5f03a993bc admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:46.588709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa90ac-592c-4e91-b1a7-ac5f03a993bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:46.589326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa90ac-592c-4e91-b1a7-ac5f03a993bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:46.591549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9aa90ac-592c-4e91-b1a7-ac5f03a993bc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:46.613347 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2868/5723] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:46.613773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a725c1-b00e-414a-85eb-890a5e1749b1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:46.628450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a725c1-b00e-414a-85eb-890a5e1749b1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:46.660063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c3a6a0-4f05-4057-afd2-51a9a2c53048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:46.661085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a6a0-4f05-4057-afd2-51a9a2c53048 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:46.661554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a6a0-4f05-4057-afd2-51a9a2c53048 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:46.663929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c3a6a0-4f05-4057-afd2-51a9a2c53048 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:46.664983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3a6a0-4f05-4057-afd2-51a9a2c53048 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:46.669917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c3a6a0-4f05-4057-afd2-51a9a2c53048 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:46.684398 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:46.761755 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2856/5724] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:46 2022] POST /identity/v3/projects => generated 373 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:46.770108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa90ac-592c-4e91-b1a7-ac5f03a993bc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:46.783438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9aa90ac-592c-4e91-b1a7-ac5f03a993bc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:46.812807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116c4c2-db05-4c8f-9edd-12b283a73863 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:46.813232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116c4c2-db05-4c8f-9edd-12b283a73863 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:46.813663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a116c4c2-db05-4c8f-9edd-12b283a73863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:46.855933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a116c4c2-db05-4c8f-9edd-12b283a73863 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:46.857264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a116c4c2-db05-4c8f-9edd-12b283a73863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:46.878356 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2857/5725] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:46 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:19:46.887990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c360845-16d0-4958-a9bb-b85246f04f82 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:46.888725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c360845-16d0-4958-a9bb-b85246f04f82 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:46.889921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c360845-16d0-4958-a9bb-b85246f04f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:46.964685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8c360845-16d0-4958-a9bb-b85246f04f82 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:46.969766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c360845-16d0-4958-a9bb-b85246f04f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:46.985093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5d018-bdfb-47bb-83c0-b76ff49874ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:46.985744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5d018-bdfb-47bb-83c0-b76ff49874ce admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:46.986023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5d018-bdfb-47bb-83c0-b76ff49874ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:46.986345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f5d018-bdfb-47bb-83c0-b76ff49874ce admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:46.986934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5d018-bdfb-47bb-83c0-b76ff49874ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:46.988871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f5d018-bdfb-47bb-83c0-b76ff49874ce admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:47.035192 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2869/5726] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:46 2022] POST /identity/v3/users => generated 287 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:47.039236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5d018-bdfb-47bb-83c0-b76ff49874ce admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:47.062118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f5d018-bdfb-47bb-83c0-b76ff49874ce admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:47.075999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59abf0c-b7d6-41f0-a53b-474af1001b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:47.077885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59abf0c-b7d6-41f0-a53b-474af1001b48 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:47.078183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59abf0c-b7d6-41f0-a53b-474af1001b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:47.080353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59abf0c-b7d6-41f0-a53b-474af1001b48 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:47.082990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59abf0c-b7d6-41f0-a53b-474af1001b48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:47.085907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59abf0c-b7d6-41f0-a53b-474af1001b48 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:47.129127 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2858/5727] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:47.135955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c360845-16d0-4958-a9bb-b85246f04f82 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:47.151455 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2870/5728] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:47.152066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59abf0c-b7d6-41f0-a53b-474af1001b48 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:47.159127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c360845-16d0-4958-a9bb-b85246f04f82 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:47.172941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f88960-5f03-41ee-89fb-a81fa11d2742 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:47.176694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f88960-5f03-41ee-89fb-a81fa11d2742 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:47.177176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f88960-5f03-41ee-89fb-a81fa11d2742 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:47.177596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f88960-5f03-41ee-89fb-a81fa11d2742 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:47.182371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59abf0c-b7d6-41f0-a53b-474af1001b48 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:47.209320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a207b-6891-476b-b151-f5c0d4b06725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:47.210253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a207b-6891-476b-b151-f5c0d4b06725 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:47.210253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a207b-6891-476b-b151-f5c0d4b06725 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:47.210511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32a207b-6891-476b-b151-f5c0d4b06725 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:47.211099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a207b-6891-476b-b151-f5c0d4b06725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:47.213255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32a207b-6891-476b-b151-f5c0d4b06725 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:47.236858 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2871/5729] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:47 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:47.241716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a207b-6891-476b-b151-f5c0d4b06725 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:47.262836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32a207b-6891-476b-b151-f5c0d4b06725 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:47.278869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184a7e3-99d4-452c-b4c0-d3b39e4a2de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:47.279923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184a7e3-99d4-452c-b4c0-d3b39e4a2de0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:47.280133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11f88960-5f03-41ee-89fb-a81fa11d2742 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:47.280610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184a7e3-99d4-452c-b4c0-d3b39e4a2de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:47.281163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1184a7e3-99d4-452c-b4c0-d3b39e4a2de0 admin admin] PATH_INFO: `/v3/projects/78063a5562794cc389fa407cac6d7604/users/908a545555aa4ff5b8f0ed8f1e2149cb/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:47.302545 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2859/5730] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:47 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:47.315459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184a7e3-99d4-452c-b4c0-d3b39e4a2de0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78063a5562794cc389fa407cac6d7604, user_id=908a545555aa4ff5b8f0ed8f1e2149cb, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:47.322340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1184a7e3-99d4-452c-b4c0-d3b39e4a2de0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:47.355077 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2872/5731] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:47 2022] PUT /identity/v3/projects/78063a5562794cc389fa407cac6d7604/users/908a545555aa4ff5b8f0ed8f1e2149cb/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:47.369864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c508-81bc-46a3-9566-b81348e9e789 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:47.370166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c508-81bc-46a3-9566-b81348e9e789 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:47.370460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd08c508-81bc-46a3-9566-b81348e9e789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:47.419346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fd08c508-81bc-46a3-9566-b81348e9e789 None None] MFA Rules not processed for user `908a545555aa4ff5b8f0ed8f1e2149cb`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:47.420974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fd08c508-81bc-46a3-9566-b81348e9e789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:47.540860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2860/5732] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:47.545521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184a7e3-99d4-452c-b4c0-d3b39e4a2de0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:47.693394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1184a7e3-99d4-452c-b4c0-d3b39e4a2de0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:47.706468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0971fc-e6db-4189-9b18-740b2ad2ab7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:47.707114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0971fc-e6db-4189-9b18-740b2ad2ab7b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:47.707396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0971fc-e6db-4189-9b18-740b2ad2ab7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:47.707683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0971fc-e6db-4189-9b18-740b2ad2ab7b admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:47.708335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0971fc-e6db-4189-9b18-740b2ad2ab7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:47.710544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0971fc-e6db-4189-9b18-740b2ad2ab7b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:47.779626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c508-81bc-46a3-9566-b81348e9e789 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:47.784382 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2873/5733] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:47 2022] POST /identity/v3/projects => generated 371 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:47.803782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd08c508-81bc-46a3-9566-b81348e9e789 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:47.918069 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:47.974897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648e9f8-71bc-46f5-bd74-eaa29a4e3599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:47.976178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648e9f8-71bc-46f5-bd74-eaa29a4e3599 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:47.976467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648e9f8-71bc-46f5-bd74-eaa29a4e3599 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:47.978425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3648e9f8-71bc-46f5-bd74-eaa29a4e3599 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:47.980389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648e9f8-71bc-46f5-bd74-eaa29a4e3599 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:47.985850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3648e9f8-71bc-46f5-bd74-eaa29a4e3599 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:48.074055 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2861/5734] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:47 2022] POST /identity/v3/users => generated 292 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:48.080295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0971fc-e6db-4189-9b18-740b2ad2ab7b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:48.098436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0971fc-e6db-4189-9b18-740b2ad2ab7b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:48.116311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c09b0-0077-4698-9c93-15dc5874fd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:48.118503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c09b0-0077-4698-9c93-15dc5874fd7d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:48.120923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c09b0-0077-4698-9c93-15dc5874fd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:48.121465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c09b0-0077-4698-9c93-15dc5874fd7d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:48.123762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c09b0-0077-4698-9c93-15dc5874fd7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:48.127503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c09b0-0077-4698-9c93-15dc5874fd7d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:48.170057 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2874/5735] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:19:48.171432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648e9f8-71bc-46f5-bd74-eaa29a4e3599 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:48.187257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3648e9f8-71bc-46f5-bd74-eaa29a4e3599 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:48.195961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a44ad-78a6-403d-84fa-27da02f2ca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:48.197360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a44ad-78a6-403d-84fa-27da02f2ca75 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:48.197857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a44ad-78a6-403d-84fa-27da02f2ca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:48.198950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a44ad-78a6-403d-84fa-27da02f2ca75 admin admin] PATH_INFO: `/v3/projects/5b5609c804374c3882e111c5cb60d93b/users/3c6ced6b9d8044f4b86f6a378c41de1e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:48.251535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a44ad-78a6-403d-84fa-27da02f2ca75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5609c804374c3882e111c5cb60d93b, user_id=3c6ced6b9d8044f4b86f6a378c41de1e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:48.260878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a44ad-78a6-403d-84fa-27da02f2ca75 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:48.293195 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2862/5736] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:48 2022] PUT /identity/v3/projects/5b5609c804374c3882e111c5cb60d93b/users/3c6ced6b9d8044f4b86f6a378c41de1e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:48.297019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c09b0-0077-4698-9c93-15dc5874fd7d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:48.303369 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:48.311144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b50dcd-7944-4dba-8067-14d2115bfe1c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:48.312146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b50dcd-7944-4dba-8067-14d2115bfe1c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:48.312537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b50dcd-7944-4dba-8067-14d2115bfe1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:48.314244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c09b0-0077-4698-9c93-15dc5874fd7d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:48.354246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d8b50dcd-7944-4dba-8067-14d2115bfe1c None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:48.355565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d8b50dcd-7944-4dba-8067-14d2115bfe1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:48.363813 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2863/5737] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:48 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 09:19:48.371044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd77a23-6d86-419e-b5f2-1662ef126673 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:48.371493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd77a23-6d86-419e-b5f2-1662ef126673 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:48.372021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd77a23-6d86-419e-b5f2-1662ef126673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:48.417241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fcd77a23-6d86-419e-b5f2-1662ef126673 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:48.422650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fcd77a23-6d86-419e-b5f2-1662ef126673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:48.480173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a48f5e-504b-4baf-9acd-43b2bf8567bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:48.481497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48f5e-504b-4baf-9acd-43b2bf8567bf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:48.481778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48f5e-504b-4baf-9acd-43b2bf8567bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:48.482956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a48f5e-504b-4baf-9acd-43b2bf8567bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:48.485014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a48f5e-504b-4baf-9acd-43b2bf8567bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:48.489189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a48f5e-504b-4baf-9acd-43b2bf8567bf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:48.543267 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2875/5738] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:19:48 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:19:48.546969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a48f5e-504b-4baf-9acd-43b2bf8567bf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:48.557352 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2864/5739] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:48.561680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd77a23-6d86-419e-b5f2-1662ef126673 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:48.571058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a48f5e-504b-4baf-9acd-43b2bf8567bf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:48.578820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd77a23-6d86-419e-b5f2-1662ef126673 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:48.579947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0eab52-e08a-4d14-b3ee-67aede94720b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:48.580849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eab52-e08a-4d14-b3ee-67aede94720b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:48.581207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eab52-e08a-4d14-b3ee-67aede94720b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:48.581632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0eab52-e08a-4d14-b3ee-67aede94720b admin admin] PATH_INFO: `/v3/projects/5b5609c804374c3882e111c5cb60d93b/users/3c6ced6b9d8044f4b86f6a378c41de1e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:48.583933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0eab52-e08a-4d14-b3ee-67aede94720b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b5609c804374c3882e111c5cb60d93b, user_id=3c6ced6b9d8044f4b86f6a378c41de1e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:48.586437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc5413-9ff3-43f3-97a1-7fc8af59457a tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:48.587847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc5413-9ff3-43f3-97a1-7fc8af59457a tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:48.588175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc5413-9ff3-43f3-97a1-7fc8af59457a tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:48.588530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc5413-9ff3-43f3-97a1-7fc8af59457a tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:48.588960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0eab52-e08a-4d14-b3ee-67aede94720b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:48.628057 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2876/5740] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:19:48 2022] PUT /identity/v3/projects/5b5609c804374c3882e111c5cb60d93b/users/3c6ced6b9d8044f4b86f6a378c41de1e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:48.632070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853fcb4-d791-4b72-ace8-d09b0a3bbda3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:48.632386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853fcb4-d791-4b72-ace8-d09b0a3bbda3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:48.632641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e853fcb4-d791-4b72-ace8-d09b0a3bbda3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:48.697812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-29cc5413-9ff3-43f3-97a1-7fc8af59457a tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:48.711672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e853fcb4-d791-4b72-ace8-d09b0a3bbda3 None None] MFA Rules not processed for user `3c6ced6b9d8044f4b86f6a378c41de1e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:48.714239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e853fcb4-d791-4b72-ace8-d09b0a3bbda3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:48.727814 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2865/5741] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:48 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:48.930006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc5413-9ff3-43f3-97a1-7fc8af59457a tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:48.930544 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2877/5742] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:48 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:49.068831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc5413-9ff3-43f3-97a1-7fc8af59457a tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:49.087589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d274f73-37e6-4d2d-b042-9981f097a0c3 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:49.088229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d274f73-37e6-4d2d-b042-9981f097a0c3 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:49.088517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d274f73-37e6-4d2d-b042-9981f097a0c3 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:49.088796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d274f73-37e6-4d2d-b042-9981f097a0c3 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:49.089499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d274f73-37e6-4d2d-b042-9981f097a0c3 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:49.091175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d274f73-37e6-4d2d-b042-9981f097a0c3 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:49.113609 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=7,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:49.126499 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2866/5743] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:19:48 2022] POST /identity/v3/domains => generated 276 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:49.129559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853fcb4-d791-4b72-ace8-d09b0a3bbda3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:49.163052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e853fcb4-d791-4b72-ace8-d09b0a3bbda3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:49.361436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b12c-4510-4771-90cd-b4d9e9ad5110 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:49.362247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b12c-4510-4771-90cd-b4d9e9ad5110 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:49.362642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b12c-4510-4771-90cd-b4d9e9ad5110 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:49.363148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9995b12c-4510-4771-90cd-b4d9e9ad5110 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:49.364065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995b12c-4510-4771-90cd-b4d9e9ad5110 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:49.367377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9995b12c-4510-4771-90cd-b4d9e9ad5110 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:49.405506 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:49.449392 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2878/5744] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:49 2022] POST /identity/v3/projects => generated 402 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:49.453506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d274f73-37e6-4d2d-b042-9981f097a0c3 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:49.469618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d274f73-37e6-4d2d-b042-9981f097a0c3 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:49.663945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680694d9-4b0c-431a-b75d-189f4e24376a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:49.664686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680694d9-4b0c-431a-b75d-189f4e24376a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:49.664952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680694d9-4b0c-431a-b75d-189f4e24376a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:49.665258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680694d9-4b0c-431a-b75d-189f4e24376a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:49.666755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680694d9-4b0c-431a-b75d-189f4e24376a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:49.671023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680694d9-4b0c-431a-b75d-189f4e24376a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:49.699533 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2867/5745] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:19:49 2022] POST /identity/v3/groups => generated 302 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:49.703796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b12c-4510-4771-90cd-b4d9e9ad5110 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:49.726275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9995b12c-4510-4771-90cd-b4d9e9ad5110 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:49.734391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75af591-4046-427e-b2d8-ea7758f586e5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:49.744548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75af591-4046-427e-b2d8-ea7758f586e5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:49.744548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75af591-4046-427e-b2d8-ea7758f586e5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:49.744548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75af591-4046-427e-b2d8-ea7758f586e5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:49.744548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75af591-4046-427e-b2d8-ea7758f586e5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:49.744548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75af591-4046-427e-b2d8-ea7758f586e5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:49.761925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570de20-e610-4570-b6ca-06d4134923a7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:49.764820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570de20-e610-4570-b6ca-06d4134923a7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:49.765371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0570de20-e610-4570-b6ca-06d4134923a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:49.794788 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2879/5746] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:19:49 2022] POST /identity/v3/users => generated 442 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:49.798626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75af591-4046-427e-b2d8-ea7758f586e5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:49.828500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75af591-4046-427e-b2d8-ea7758f586e5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:49.867976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0570de20-e610-4570-b6ca-06d4134923a7 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:49.871467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0570de20-e610-4570-b6ca-06d4134923a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:49.875438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a05fa-f3c8-4c66-b1ba-ad4fefb9ac2f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:49.876112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a05fa-f3c8-4c66-b1ba-ad4fefb9ac2f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:49.876410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a05fa-f3c8-4c66-b1ba-ad4fefb9ac2f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:49.876694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a05fa-f3c8-4c66-b1ba-ad4fefb9ac2f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:49.877873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a05fa-f3c8-4c66-b1ba-ad4fefb9ac2f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:49.878835 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2868/5747] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:49 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:19:49.883744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a05fa-f3c8-4c66-b1ba-ad4fefb9ac2f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:49.887978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c06d-f7c5-4c08-9bb7-f986d296f0f5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:49.888532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c06d-f7c5-4c08-9bb7-f986d296f0f5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:49.889031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d475c06d-f7c5-4c08-9bb7-f986d296f0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:49.926744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d475c06d-f7c5-4c08-9bb7-f986d296f0f5 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:49.929252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d475c06d-f7c5-4c08-9bb7-f986d296f0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:49.938188 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2880/5748] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:19:49 2022] POST /identity/v3/roles => generated 239 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:49.940895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a05fa-f3c8-4c66-b1ba-ad4fefb9ac2f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:49.972993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a05fa-f3c8-4c66-b1ba-ad4fefb9ac2f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:49.992122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83305-d1e2-49bf-a9dd-84096305f358 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:49.992829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83305-d1e2-49bf-a9dd-84096305f358 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:49.993117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83305-d1e2-49bf-a9dd-84096305f358 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:49.993505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef83305-d1e2-49bf-a9dd-84096305f358 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/cb188714048449b88c814e1008891c21/inherited_to_projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:50.020765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef83305-d1e2-49bf-a9dd-84096305f358 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4b3a6d08187c4453998967afa9721850, group_id=d0d8c8f5bf1b430b9b35d0d1e5ff6e42, role_id=cb188714048449b88c814e1008891c21)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:50.023897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef83305-d1e2-49bf-a9dd-84096305f358 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:50.060554 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2881/5749] 10.222.0.25 () {60 vars in 1585 bytes} [Mon Oct 24 09:19:49 2022] PUT /identity/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/cb188714048449b88c814e1008891c21/inherited_to_projects => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:50.064627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83305-d1e2-49bf-a9dd-84096305f358 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:50.150813 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2869/5750] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:50.155477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475c06d-f7c5-4c08-9bb7-f986d296f0f5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:50.172921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d475c06d-f7c5-4c08-9bb7-f986d296f0f5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:50.254425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11a13e-199c-46b0-939b-7ce281e0d493 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:50.255179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11a13e-199c-46b0-939b-7ce281e0d493 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:50.255791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11a13e-199c-46b0-939b-7ce281e0d493 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:50.256747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb11a13e-199c-46b0-939b-7ce281e0d493 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:50.261812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef83305-d1e2-49bf-a9dd-84096305f358 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:50.279854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0545a5-16db-4615-a971-acfc7d2a5193 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:50.280614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0545a5-16db-4615-a971-acfc7d2a5193 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:50.280905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0545a5-16db-4615-a971-acfc7d2a5193 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:50.281187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0545a5-16db-4615-a971-acfc7d2a5193 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/cb188714048449b88c814e1008891c21/inherited_to_projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:50.287197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0545a5-16db-4615-a971-acfc7d2a5193 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:check_grant(project_id=4b3a6d08187c4453998967afa9721850, group_id=d0d8c8f5bf1b430b9b35d0d1e5ff6e42, role_id=cb188714048449b88c814e1008891c21)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:50.288614 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-6c0545a5-16db-4615-a971-acfc7d2a5193 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:50.288614 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:19:50.288614 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:19:50.296561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0545a5-16db-4615-a971-acfc7d2a5193 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:50.326519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fb11a13e-199c-46b0-939b-7ce281e0d493 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:50.331223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2882/5751] 10.222.0.25 () {58 vars in 1567 bytes} [Mon Oct 24 09:19:50 2022] HEAD /identity/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/cb188714048449b88c814e1008891c21/inherited_to_projects => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:50.335065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0545a5-16db-4615-a971-acfc7d2a5193 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:50.344817 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2870/5752] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:19:50 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:50.359924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0545a5-16db-4615-a971-acfc7d2a5193 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:50.383258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:50.383998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:50.384878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:50.385137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/cb188714048449b88c814e1008891c21/inherited_to_projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:50.390307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4b3a6d08187c4453998967afa9721850, group_id=d0d8c8f5bf1b430b9b35d0d1e5ff6e42, role_id=cb188714048449b88c814e1008891c21)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:50.393456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:50.414204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role cb188714048449b88c814e1008891c21 was removed from group d0d8c8f5bf1b430b9b35d0d1e5ff6e42 on project 4b3a6d08187c4453998967afa9721850. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:50.414514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:50.415272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:50.440057 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2883/5753] 10.222.0.25 () {58 vars in 1569 bytes} [Mon Oct 24 09:19:50 2022] DELETE /identity/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/cb188714048449b88c814e1008891c21/inherited_to_projects => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:50.444132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11a13e-199c-46b0-939b-7ce281e0d493 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:50.446151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb11a13e-199c-46b0-939b-7ce281e0d493 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:50.471797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb11a13e-199c-46b0-939b-7ce281e0d493 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:50.484805 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:50.694548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:50.695202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:50.695497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:50.695778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles/cb188714048449b88c814e1008891c21` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:50.697434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_role(role_id=cb188714048449b88c814e1008891c21)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:50.699276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:50.819092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role cb188714048449b88c814e1008891c21 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:50.819404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:50.820189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:50.822468 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2871/5754] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:50 2022] DELETE /identity/v3/roles/cb188714048449b88c814e1008891c21 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:50.827393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:50.850887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb848daa-7ac0-44ca-bbb6-2e4f1bc84daa tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:51.073154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51b136-1ca9-4032-b87e-698c46fd88ff tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:51.073830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51b136-1ca9-4032-b87e-698c46fd88ff tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:51.074120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51b136-1ca9-4032-b87e-698c46fd88ff tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:51.074403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51b136-1ca9-4032-b87e-698c46fd88ff tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:51.075257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51b136-1ca9-4032-b87e-698c46fd88ff tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:51.076902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea51b136-1ca9-4032-b87e-698c46fd88ff tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:51.119914 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2884/5755] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:19:50 2022] POST /identity/v3/roles => generated 239 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:51.124066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:51.125858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:51.154705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b7132-3dfe-422e-9b88-f14cd874dfb5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:51.172192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00c97e4-03b0-4f6d-9d63-718a1c2d0770 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:51.173351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c97e4-03b0-4f6d-9d63-718a1c2d0770 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:51.173684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c97e4-03b0-4f6d-9d63-718a1c2d0770 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:51.173974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00c97e4-03b0-4f6d-9d63-718a1c2d0770 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/da5d7f3e607b4506ae555a210491f490/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:51.230452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c97e4-03b0-4f6d-9d63-718a1c2d0770 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4b3a6d08187c4453998967afa9721850, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=da5d7f3e607b4506ae555a210491f490)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:51.234889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00c97e4-03b0-4f6d-9d63-718a1c2d0770 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:51.259598 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2872/5756] 10.222.0.25 () {60 vars in 1582 bytes} [Mon Oct 24 09:19:51 2022] PUT /identity/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/da5d7f3e607b4506ae555a210491f490/inherited_to_projects => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:51.263692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51b136-1ca9-4032-b87e-698c46fd88ff tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:51.282846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51b136-1ca9-4032-b87e-698c46fd88ff tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:51.319158 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:51.349959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee16ac-b782-4b8c-bea6-8154a489c4b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:51.350297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee16ac-b782-4b8c-bea6-8154a489c4b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:51.350561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdee16ac-b782-4b8c-bea6-8154a489c4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:51.387753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cdee16ac-b782-4b8c-bea6-8154a489c4b9 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:51.389867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cdee16ac-b782-4b8c-bea6-8154a489c4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:51.397109 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2873/5757] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:51 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 09:19:51.521479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0b798-8420-4759-b06e-36e82cfacf96 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:51.525753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0b798-8420-4759-b06e-36e82cfacf96 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:51.526066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0b798-8420-4759-b06e-36e82cfacf96 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:51.527138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0b798-8420-4759-b06e-36e82cfacf96 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/da5d7f3e607b4506ae555a210491f490/inherited_to_projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:51.533936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0b798-8420-4759-b06e-36e82cfacf96 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:check_grant(project_id=4b3a6d08187c4453998967afa9721850, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=da5d7f3e607b4506ae555a210491f490)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:51.538416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0b798-8420-4759-b06e-36e82cfacf96 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:51.561391 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2885/5758] 10.222.0.25 () {58 vars in 1564 bytes} [Mon Oct 24 09:19:51 2022] HEAD /identity/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/da5d7f3e607b4506ae555a210491f490/inherited_to_projects => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:51.565477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee16ac-b782-4b8c-bea6-8154a489c4b9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:51.585560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdee16ac-b782-4b8c-bea6-8154a489c4b9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:51.596793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:51.597579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:51.597948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:51.598546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/da5d7f3e607b4506ae555a210491f490/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:51.604883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4b3a6d08187c4453998967afa9721850, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=da5d7f3e607b4506ae555a210491f490)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:51.607802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:51.627853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role da5d7f3e607b4506ae555a210491f490 was removed from user e4e148ed1c1549cfa5e091d110d5d8b3 on project 4b3a6d08187c4453998967afa9721850. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:51.628242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:51.629282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:51.660036 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2874/5759] 10.222.0.25 () {58 vars in 1566 bytes} [Mon Oct 24 09:19:51 2022] DELETE /identity/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/da5d7f3e607b4506ae555a210491f490/inherited_to_projects => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:51.665162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0b798-8420-4759-b06e-36e82cfacf96 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:51.682884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cab0b798-8420-4759-b06e-36e82cfacf96 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:51.715364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0b798-8420-4759-b06e-36e82cfacf96 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:51.930070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:51.932001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:51.932448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:51.933201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles/da5d7f3e607b4506ae555a210491f490` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:51.944456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_role(role_id=da5d7f3e607b4506ae555a210491f490)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:51.946419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:52.026682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role da5d7f3e607b4506ae555a210491f490 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:52.027051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:52.027672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:52.033342 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2886/5760] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:51 2022] DELETE /identity/v3/roles/da5d7f3e607b4506ae555a210491f490 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:52.035145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:52.050605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e97d6dc-fddc-4c79-9b7b-9e0bea48a0b7 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:52.156591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032fb22-f08e-48f2-a0b2-a9c4fc96a8ec tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:52.157281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032fb22-f08e-48f2-a0b2-a9c4fc96a8ec tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:52.157623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032fb22-f08e-48f2-a0b2-a9c4fc96a8ec tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:52.157905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5032fb22-f08e-48f2-a0b2-a9c4fc96a8ec tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:52.164978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032fb22-f08e-48f2-a0b2-a9c4fc96a8ec tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:52.169136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5032fb22-f08e-48f2-a0b2-a9c4fc96a8ec tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:52.197009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:52.199977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:52.209726 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2875/5761] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:19:52 2022] POST /identity/v3/roles => generated 240 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:52.219284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8d4cf9-cad9-4056-a181-1112580345d1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:52.225898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d43bfc-dcce-479b-835f-6a8893471b68 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:52.227189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43bfc-dcce-479b-835f-6a8893471b68 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:52.227686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43bfc-dcce-479b-835f-6a8893471b68 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:52.228715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d43bfc-dcce-479b-835f-6a8893471b68 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/4521af3a7eaa4debb67a88b3af6aaf7f/inherited_to_projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:52.235671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d43bfc-dcce-479b-835f-6a8893471b68 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=deb0558de1684a3b8985653e10425ccb, group_id=d0d8c8f5bf1b430b9b35d0d1e5ff6e42, role_id=4521af3a7eaa4debb67a88b3af6aaf7f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:52.240884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d43bfc-dcce-479b-835f-6a8893471b68 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:52.290935 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2887/5762] 10.222.0.25 () {60 vars in 1582 bytes} [Mon Oct 24 09:19:52 2022] PUT /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/4521af3a7eaa4debb67a88b3af6aaf7f/inherited_to_projects => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:52.296461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032fb22-f08e-48f2-a0b2-a9c4fc96a8ec tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:52.312378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5032fb22-f08e-48f2-a0b2-a9c4fc96a8ec tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:52.363125 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:52.402951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77d294-70a9-46d7-8b21-c56b0f57537c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:52.403640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77d294-70a9-46d7-8b21-c56b0f57537c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:52.404207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb77d294-70a9-46d7-8b21-c56b0f57537c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:52.447382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cb77d294-70a9-46d7-8b21-c56b0f57537c None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:52.449213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cb77d294-70a9-46d7-8b21-c56b0f57537c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:52.460760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d573ce5-194b-422b-a3d1-0c39eca780fc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:52.463103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d573ce5-194b-422b-a3d1-0c39eca780fc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:52.464574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d573ce5-194b-422b-a3d1-0c39eca780fc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:52.465073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d573ce5-194b-422b-a3d1-0c39eca780fc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:52.469223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d573ce5-194b-422b-a3d1-0c39eca780fc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=deb0558de1684a3b8985653e10425ccb, group_id=d0d8c8f5bf1b430b9b35d0d1e5ff6e42)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:52.471343 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-4d573ce5-194b-422b-a3d1-0c39eca780fc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:52.471343 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:19:52.471343 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:19:52.479955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d573ce5-194b-422b-a3d1-0c39eca780fc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:52.518398 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2876/5763] 10.222.0.25 () {58 vars in 1464 bytes} [Mon Oct 24 09:19:52 2022] GET /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/inherited_to_projects => generated 448 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:52.522248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d573ce5-194b-422b-a3d1-0c39eca780fc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:52.552429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d573ce5-194b-422b-a3d1-0c39eca780fc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:52.567511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff4d2b-645e-447c-9883-2b9ece53aa9d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:52.569604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff4d2b-645e-447c-9883-2b9ece53aa9d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:52.570764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff4d2b-645e-447c-9883-2b9ece53aa9d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:52.573114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bff4d2b-645e-447c-9883-2b9ece53aa9d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/4521af3a7eaa4debb67a88b3af6aaf7f/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:52.578896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff4d2b-645e-447c-9883-2b9ece53aa9d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=deb0558de1684a3b8985653e10425ccb, group_id=d0d8c8f5bf1b430b9b35d0d1e5ff6e42, role_id=4521af3a7eaa4debb67a88b3af6aaf7f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:52.582958 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-3bff4d2b-645e-447c-9883-2b9ece53aa9d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_grant": "(role:reader and system_scope:all) or ((role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:52.582958 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:19:52.582958 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:19:52.589735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bff4d2b-645e-447c-9883-2b9ece53aa9d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:52.611074 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2877/5764] 10.222.0.25 () {58 vars in 1564 bytes} [Mon Oct 24 09:19:52 2022] HEAD /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/4521af3a7eaa4debb67a88b3af6aaf7f/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:52.612410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff4d2b-645e-447c-9883-2b9ece53aa9d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:52.626584 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2888/5765] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:19:52.630526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375055c2-9f9d-4b6f-86bc-0729af481cd8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:52.631247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375055c2-9f9d-4b6f-86bc-0729af481cd8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:52.632079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375055c2-9f9d-4b6f-86bc-0729af481cd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:52.650812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bff4d2b-645e-447c-9883-2b9ece53aa9d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:52.664359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:52.666297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:52.666914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:52.669049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/4521af3a7eaa4debb67a88b3af6aaf7f/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:52.674900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=deb0558de1684a3b8985653e10425ccb, group_id=d0d8c8f5bf1b430b9b35d0d1e5ff6e42, role_id=4521af3a7eaa4debb67a88b3af6aaf7f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:52.683010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:52.686004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-375055c2-9f9d-4b6f-86bc-0729af481cd8 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:19:52.697492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-375055c2-9f9d-4b6f-86bc-0729af481cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:52.707561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role 4521af3a7eaa4debb67a88b3af6aaf7f was removed from group d0d8c8f5bf1b430b9b35d0d1e5ff6e42 on domain deb0558de1684a3b8985653e10425ccb. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:52.710654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:52.711894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:52.712566 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2889/5766] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:52 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:19:52.721475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25408f-acd5-48b2-91b0-99c86af41543 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:52.721798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25408f-acd5-48b2-91b0-99c86af41543 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:52.722064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa25408f-acd5-48b2-91b0-99c86af41543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:52.755338 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:52.774618 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2878/5767] 10.222.0.25 () {58 vars in 1566 bytes} [Mon Oct 24 09:19:52 2022] DELETE /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42/roles/4521af3a7eaa4debb67a88b3af6aaf7f/inherited_to_projects => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:52.777188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:52.784501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:52.935276 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.server.flask.application [None req-fa25408f-acd5-48b2-91b0-99c86af41543 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.25: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 24 09:19:52.940624 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2890/5768] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:52 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 223 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 24 09:19:52.942844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514444-9273-47e5-9134-55277555a58e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:52.943136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514444-9273-47e5-9134-55277555a58e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:52.944754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9514444-9273-47e5-9134-55277555a58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:53.032065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822356b9-6905-447b-a73b-36aeb973980d tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:53.046467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:53.047129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:53.047417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:53.047696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles/4521af3a7eaa4debb67a88b3af6aaf7f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:53.054704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_role(role_id=4521af3a7eaa4debb67a88b3af6aaf7f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:53.064612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:53.098409 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.server.flask.application [None req-f9514444-9273-47e5-9134-55277555a58e None None] Authorization failed. The request you have made requires authentication. from 10.222.0.25: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 24 09:19:53.106217 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2891/5769] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:52 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 165 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 24 09:19:53.111996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427303d0-5d81-4432-a874-8c4ebc42e88c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:53.112288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427303d0-5d81-4432-a874-8c4ebc42e88c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:53.112569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427303d0-5d81-4432-a874-8c4ebc42e88c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:53.185734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role 4521af3a7eaa4debb67a88b3af6aaf7f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:53.186301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:53.187681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:53.193341 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2879/5770] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:52 2022] DELETE /identity/v3/roles/4521af3a7eaa4debb67a88b3af6aaf7f => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:53.198603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:53.199268 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.server.flask.application [None req-427303d0-5d81-4432-a874-8c4ebc42e88c None None] Authorization failed. The request you have made requires authentication. from 10.222.0.25: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 24 09:19:53.201823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:53.205058 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2892/5771] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:19:53 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 90 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 24 09:19:53.303678 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:53.333151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f90955d-c3d3-45b6-9dd1-a4ca2220cf3c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:53.356832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83047242-92bd-4b63-ac7e-fbaecbb489e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:53.357602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83047242-92bd-4b63-ac7e-fbaecbb489e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:53.357992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83047242-92bd-4b63-ac7e-fbaecbb489e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:53.358400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83047242-92bd-4b63-ac7e-fbaecbb489e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:53.359191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83047242-92bd-4b63-ac7e-fbaecbb489e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:53.361441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83047242-92bd-4b63-ac7e-fbaecbb489e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:53.390776 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2880/5772] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:19:53 2022] POST /identity/v3/roles => generated 240 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:19:53.391972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427303d0-5d81-4432-a874-8c4ebc42e88c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:53.412245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427303d0-5d81-4432-a874-8c4ebc42e88c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:53.421570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fefb6-ab08-44e1-9ac5-bb54688341f4 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:53.422343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fefb6-ab08-44e1-9ac5-bb54688341f4 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:53.422637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fefb6-ab08-44e1-9ac5-bb54688341f4 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:53.422921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13fefb6-ab08-44e1-9ac5-bb54688341f4 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/5332214890e9422b8a587ee0acda883f/inherited_to_projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:53.431914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fefb6-ab08-44e1-9ac5-bb54688341f4 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=deb0558de1684a3b8985653e10425ccb, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=5332214890e9422b8a587ee0acda883f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:53.434859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13fefb6-ab08-44e1-9ac5-bb54688341f4 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:53.459130 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2893/5773] 10.222.0.25 () {60 vars in 1579 bytes} [Mon Oct 24 09:19:53 2022] PUT /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/5332214890e9422b8a587ee0acda883f/inherited_to_projects => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:53.463807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83047242-92bd-4b63-ac7e-fbaecbb489e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:53.486262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83047242-92bd-4b63-ac7e-fbaecbb489e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:53.635358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e0a9-5e02-4309-bb4d-369558603c43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:53.635925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e0a9-5e02-4309-bb4d-369558603c43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:53.636334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e0a9-5e02-4309-bb4d-369558603c43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:53.645071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b08e0a9-5e02-4309-bb4d-369558603c43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:53.650359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08e0a9-5e02-4309-bb4d-369558603c43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=deb0558de1684a3b8985653e10425ccb, user_id=e4e148ed1c1549cfa5e091d110d5d8b3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:53.658364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b08e0a9-5e02-4309-bb4d-369558603c43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:53.710285 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2881/5774] 10.222.0.25 () {58 vars in 1461 bytes} [Mon Oct 24 09:19:53 2022] GET /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/inherited_to_projects => generated 447 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:53.714386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fefb6-ab08-44e1-9ac5-bb54688341f4 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:53.739338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13fefb6-ab08-44e1-9ac5-bb54688341f4 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:53.757848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b2ac-cab3-4c39-9896-6cf9c3fd0257 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:53.759763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b2ac-cab3-4c39-9896-6cf9c3fd0257 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:53.760061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b2ac-cab3-4c39-9896-6cf9c3fd0257 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:53.761671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898b2ac-cab3-4c39-9896-6cf9c3fd0257 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/5332214890e9422b8a587ee0acda883f/inherited_to_projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:53.775614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898b2ac-cab3-4c39-9896-6cf9c3fd0257 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=deb0558de1684a3b8985653e10425ccb, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=5332214890e9422b8a587ee0acda883f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:53.790752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1898b2ac-cab3-4c39-9896-6cf9c3fd0257 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:53.803871 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2894/5775] 10.222.0.25 () {58 vars in 1561 bytes} [Mon Oct 24 09:19:53 2022] HEAD /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/5332214890e9422b8a587ee0acda883f/inherited_to_projects => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:53.808322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e0a9-5e02-4309-bb4d-369558603c43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:53.825289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b08e0a9-5e02-4309-bb4d-369558603c43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:53.841750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:53.848269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:53.850075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:53.851934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/5332214890e9422b8a587ee0acda883f/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:53.855898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=deb0558de1684a3b8985653e10425ccb, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=5332214890e9422b8a587ee0acda883f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:53.859479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:53.866105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role 5332214890e9422b8a587ee0acda883f was removed from user e4e148ed1c1549cfa5e091d110d5d8b3 on domain deb0558de1684a3b8985653e10425ccb. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:53.866801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:53.867776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:53.908005 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2882/5776] 10.222.0.25 () {58 vars in 1563 bytes} [Mon Oct 24 09:19:53 2022] DELETE /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/5332214890e9422b8a587ee0acda883f/inherited_to_projects => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:53.911918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b2ac-cab3-4c39-9896-6cf9c3fd0257 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:53.913754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1898b2ac-cab3-4c39-9896-6cf9c3fd0257 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:53.962517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898b2ac-cab3-4c39-9896-6cf9c3fd0257 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:54.168120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:54.168786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:54.169072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:54.169519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles/5332214890e9422b8a587ee0acda883f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:54.172038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5332214890e9422b8a587ee0acda883f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:54.173746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:54.269035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role 5332214890e9422b8a587ee0acda883f has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:54.269349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:54.270365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:54.277851 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2895/5777] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:53 2022] DELETE /identity/v3/roles/5332214890e9422b8a587ee0acda883f => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:54.279039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:54.303707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203c0ff-ea99-46bf-b6ce-2bfb24b1a00c tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:54.479796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99500af9-0e6a-4668-9bb0-bb378ee5caf6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:54.480687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500af9-0e6a-4668-9bb0-bb378ee5caf6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:54.481133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500af9-0e6a-4668-9bb0-bb378ee5caf6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:54.482015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99500af9-0e6a-4668-9bb0-bb378ee5caf6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:54.483039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99500af9-0e6a-4668-9bb0-bb378ee5caf6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:54.489275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99500af9-0e6a-4668-9bb0-bb378ee5caf6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:54.531955 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2883/5778] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:19:54 2022] POST /identity/v3/roles => generated 238 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:54.535948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:54.537647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:54.585532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c74370-f5a2-4823-84d5-902e18779efc tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:54.598686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ce5d-6bee-49af-821b-02453fa98097 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:54.599849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ce5d-6bee-49af-821b-02453fa98097 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:54.600145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ce5d-6bee-49af-821b-02453fa98097 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:54.600427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506ce5d-6bee-49af-821b-02453fa98097 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:54.601103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506ce5d-6bee-49af-821b-02453fa98097 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:54.607494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506ce5d-6bee-49af-821b-02453fa98097 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:54.732111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99500af9-0e6a-4668-9bb0-bb378ee5caf6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:54.739215 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2896/5779] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:54 2022] POST /identity/v3/projects => generated 409 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:54.743928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99500af9-0e6a-4668-9bb0-bb378ee5caf6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:54.961997 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:54.981902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc301ad-18d4-46c2-aae0-6e7e07cfd61f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:54.983121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc301ad-18d4-46c2-aae0-6e7e07cfd61f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:54.983490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc301ad-18d4-46c2-aae0-6e7e07cfd61f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:54.983884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc301ad-18d4-46c2-aae0-6e7e07cfd61f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/722fc436a7a041ebae7961a99478d639/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:54.988627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc301ad-18d4-46c2-aae0-6e7e07cfd61f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=deb0558de1684a3b8985653e10425ccb, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=722fc436a7a041ebae7961a99478d639)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:54.992791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc301ad-18d4-46c2-aae0-6e7e07cfd61f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:55.017565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ce5d-6bee-49af-821b-02453fa98097 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:55.019161 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2884/5780] 10.222.0.25 () {60 vars in 1579 bytes} [Mon Oct 24 09:19:54 2022] PUT /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/722fc436a7a041ebae7961a99478d639/inherited_to_projects => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:55.033228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506ce5d-6bee-49af-821b-02453fa98097 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:55.082396 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:UPDATE=2,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:55.142269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:55.142985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:55.143278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:55.143561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:55.144997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Adding query filter params (scope.project.id=4b3a6d08187c4453998967afa9721850, user.id=e4e148ed1c1549cfa5e091d110d5d8b3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:55.144997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:55.147559 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:55.147559 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:19:55.147559 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:19:55.148739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:55.277459 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2897/5781] 10.222.0.25 () {58 vars in 1356 bytes} [Mon Oct 24 09:19:55 2022] GET /identity/v3/role_assignments?scope.project.id=4b3a6d08187c4453998967afa9721850&user.id=e4e148ed1c1549cfa5e091d110d5d8b3&effective => generated 648 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:55.281622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc301ad-18d4-46c2-aae0-6e7e07cfd61f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:55.321862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc301ad-18d4-46c2-aae0-6e7e07cfd61f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:55.339464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:55.340127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:55.340417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:55.340701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:55.341478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Adding query filter params (scope.project.id=cc7860e75fff488394225133aa0795e1, user.id=e4e148ed1c1549cfa5e091d110d5d8b3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:55.341793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:55.348810 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_assignments": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:19:55.348810 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:19:55.348810 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:19:55.350217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:55.490346 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2885/5782] 10.222.0.25 () {58 vars in 1356 bytes} [Mon Oct 24 09:19:55 2022] GET /identity/v3/role_assignments?scope.project.id=cc7860e75fff488394225133aa0795e1&user.id=e4e148ed1c1549cfa5e091d110d5d8b3&effective => generated 648 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:19:55.494423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:55.506272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18aac518-e7c6-47d2-958e-af7f52050b4a tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:55.511825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:55.513122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:55.517092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:55.517631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/722fc436a7a041ebae7961a99478d639/inherited_to_projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:55.522137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=deb0558de1684a3b8985653e10425ccb, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=722fc436a7a041ebae7961a99478d639)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:55.526664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:55.536512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role 722fc436a7a041ebae7961a99478d639 was removed from user e4e148ed1c1549cfa5e091d110d5d8b3 on domain deb0558de1684a3b8985653e10425ccb. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:55.538009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:55.539186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:55.561781 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2898/5783] 10.222.0.25 () {58 vars in 1563 bytes} [Mon Oct 24 09:19:55 2022] DELETE /identity/v3/OS-INHERIT/domains/deb0558de1684a3b8985653e10425ccb/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/722fc436a7a041ebae7961a99478d639/inherited_to_projects => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:55.566427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:55.568336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:55.593444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ca662c-6625-4361-9a92-43863ecd07e9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:55.744769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc0ec-1da7-4f67-928e-9a045c7a6500 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:55.746251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc0ec-1da7-4f67-928e-9a045c7a6500 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:55.746744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc0ec-1da7-4f67-928e-9a045c7a6500 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:55.747240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dc0ec-1da7-4f67-928e-9a045c7a6500 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:55.748624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dc0ec-1da7-4f67-928e-9a045c7a6500 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Adding query filter params (scope.project.id=4b3a6d08187c4453998967afa9721850, user.id=e4e148ed1c1549cfa5e091d110d5d8b3) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:55.749527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dc0ec-1da7-4f67-928e-9a045c7a6500 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:55.753044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dc0ec-1da7-4f67-928e-9a045c7a6500 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:55.918137 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2886/5784] 10.222.0.25 () {58 vars in 1356 bytes} [Mon Oct 24 09:19:55 2022] GET /identity/v3/role_assignments?scope.project.id=4b3a6d08187c4453998967afa9721850&user.id=e4e148ed1c1549cfa5e091d110d5d8b3&effective => generated 228 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:55.922703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:55.943298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaef18d-3243-4e32-8a85-0f13b7f48ada tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:55.964465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:55.966023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:55.967801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:55.969538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:55.970559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Adding query filter params (scope.project.id=cc7860e75fff488394225133aa0795e1, user.id=e4e148ed1c1549cfa5e091d110d5d8b3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:55.971233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:55.975950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:56.098662 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2899/5785] 10.222.0.25 () {58 vars in 1356 bytes} [Mon Oct 24 09:19:55 2022] GET /identity/v3/role_assignments?scope.project.id=cc7860e75fff488394225133aa0795e1&user.id=e4e148ed1c1549cfa5e091d110d5d8b3&effective => generated 228 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:56.100289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc0ec-1da7-4f67-928e-9a045c7a6500 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:56.116947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dc0ec-1da7-4f67-928e-9a045c7a6500 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:56.133458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:56.134894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:56.135345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:56.135785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/projects/cc7860e75fff488394225133aa0795e1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:56.150257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cc7860e75fff488394225133aa0795e1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:56.152824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:56.319750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc7860e75fff488394225133aa0795e1', 'request_id': 'req-211c7852-0e8b-4675-a7bf-9f8102b75a43'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:56.321225 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:56.341398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc7860e75fff488394225133aa0795e1', 'request_id': 'req-211c7852-0e8b-4675-a7bf-9f8102b75a43'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:56.364062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc7860e75fff488394225133aa0795e1', 'request_id': 'req-211c7852-0e8b-4675-a7bf-9f8102b75a43'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:56.413221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] The token cache is being invalidate because project cc7860e75fff488394225133aa0795e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:56.413555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:56.416250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:56.423428 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2887/5786] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:56 2022] DELETE /identity/v3/projects/cc7860e75fff488394225133aa0795e1 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:56.425566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:56.427533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:56.464887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bab28f9-fd7e-42a8-a098-a260d117d237 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:56.593635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:56.594649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:56.595169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:56.596001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles/722fc436a7a041ebae7961a99478d639` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:56.597621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_role(role_id=722fc436a7a041ebae7961a99478d639)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:56.599369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:56.615932 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:56.654406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role 722fc436a7a041ebae7961a99478d639 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:56.654833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:56.656698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:56.661794 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2900/5787] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:56 2022] DELETE /identity/v3/roles/722fc436a7a041ebae7961a99478d639 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:56.669030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:56.685385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c7852-0e8b-4675-a7bf-9f8102b75a43 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:56.924041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1d15a-df7b-4866-8e5c-08a0521269f6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:56.924831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1d15a-df7b-4866-8e5c-08a0521269f6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:56.926914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1d15a-df7b-4866-8e5c-08a0521269f6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:56.927151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a1d15a-df7b-4866-8e5c-08a0521269f6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:56.927902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1d15a-df7b-4866-8e5c-08a0521269f6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:56.932412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a1d15a-df7b-4866-8e5c-08a0521269f6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:56.983275 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2888/5788] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:19:56 2022] POST /identity/v3/roles => generated 240 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:56.987186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:56.989225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:57.038749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66322d-4c17-46f9-b320-c1c842b56aac tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:57.062409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a315da-46ec-4172-96af-648c2f59ddba tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:57.063362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a315da-46ec-4172-96af-648c2f59ddba tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:57.064840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a315da-46ec-4172-96af-648c2f59ddba tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:57.066993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a315da-46ec-4172-96af-648c2f59ddba tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:57.067901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a315da-46ec-4172-96af-648c2f59ddba tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:57.070491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a315da-46ec-4172-96af-648c2f59ddba tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:57.129221 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2901/5789] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:19:56 2022] POST /identity/v3/projects => generated 409 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:19:57.130459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1d15a-df7b-4866-8e5c-08a0521269f6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:57.146958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a1d15a-df7b-4866-8e5c-08a0521269f6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:57.294985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62bf2-ec05-465f-9766-f9c08973c2a6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:57.295715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62bf2-ec05-465f-9766-f9c08973c2a6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:57.295969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62bf2-ec05-465f-9766-f9c08973c2a6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:57.297006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd62bf2-ec05-465f-9766-f9c08973c2a6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/09334ee2a43644c4959ffb89d398439e/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:57.299869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62bf2-ec05-465f-9766-f9c08973c2a6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:create_grant(project_id=4b3a6d08187c4453998967afa9721850, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=09334ee2a43644c4959ffb89d398439e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:57.302698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd62bf2-ec05-465f-9766-f9c08973c2a6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:57.330022 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2889/5790] 10.222.0.25 () {60 vars in 1582 bytes} [Mon Oct 24 09:19:57 2022] PUT /identity/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/09334ee2a43644c4959ffb89d398439e/inherited_to_projects => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:57.332201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a315da-46ec-4172-96af-648c2f59ddba tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:57.347061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a315da-46ec-4172-96af-648c2f59ddba tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:57.528769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:57.529571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:57.529879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:57.530163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:57.531057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Adding query filter params (scope.project.id=4f0e5e478a4642238f0cbdfbc9128b99, user.id=e4e148ed1c1549cfa5e091d110d5d8b3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:57.531390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:57.535602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:57.662548 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2902/5791] 10.222.0.25 () {58 vars in 1356 bytes} [Mon Oct 24 09:19:57 2022] GET /identity/v3/role_assignments?scope.project.id=4f0e5e478a4642238f0cbdfbc9128b99&user.id=e4e148ed1c1549cfa5e091d110d5d8b3&effective => generated 649 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:57.666973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62bf2-ec05-465f-9766-f9c08973c2a6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:57.683465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd62bf2-ec05-465f-9766-f9c08973c2a6 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:57.699163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:57.699861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:57.700159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:57.700446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/09334ee2a43644c4959ffb89d398439e/inherited_to_projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:57.708124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=4b3a6d08187c4453998967afa9721850, user_id=e4e148ed1c1549cfa5e091d110d5d8b3, role_id=09334ee2a43644c4959ffb89d398439e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:57.710858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:57.735173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role 09334ee2a43644c4959ffb89d398439e was removed from user e4e148ed1c1549cfa5e091d110d5d8b3 on project 4b3a6d08187c4453998967afa9721850. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:57.735540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:57.737463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:57.754629 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2890/5792] 10.222.0.25 () {58 vars in 1566 bytes} [Mon Oct 24 09:19:57 2022] DELETE /identity/v3/OS-INHERIT/projects/4b3a6d08187c4453998967afa9721850/users/e4e148ed1c1549cfa5e091d110d5d8b3/roles/09334ee2a43644c4959ffb89d398439e/inherited_to_projects => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:57.759161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:57.761872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:57.782018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e7794-b7cc-46d7-8205-ae74e28198a1 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:57.866099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:57.867277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:57.868110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:57.869624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:57.870824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Adding query filter params (scope.project.id=4f0e5e478a4642238f0cbdfbc9128b99, user.id=e4e148ed1c1549cfa5e091d110d5d8b3) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:19:57.871459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:57.873847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:57.911313 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:58.017395 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2903/5793] 10.222.0.25 () {58 vars in 1356 bytes} [Mon Oct 24 09:19:57 2022] GET /identity/v3/role_assignments?scope.project.id=4f0e5e478a4642238f0cbdfbc9128b99&user.id=e4e148ed1c1549cfa5e091d110d5d8b3&effective => generated 228 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:19:58.017993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:58.035054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7d4e39-9501-4a69-9869-185eeed4a3f5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:58.056884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:58.060806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:58.061624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:58.062132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/projects/4f0e5e478a4642238f0cbdfbc9128b99` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:58.063744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4f0e5e478a4642238f0cbdfbc9128b99)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:58.067197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:58.153475 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:58.166932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0e5e478a4642238f0cbdfbc9128b99', 'request_id': 'req-8b9ffe97-f0bf-4f92-ba49-68315ecde831'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.179370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0e5e478a4642238f0cbdfbc9128b99', 'request_id': 'req-8b9ffe97-f0bf-4f92-ba49-68315ecde831'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.203832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0e5e478a4642238f0cbdfbc9128b99', 'request_id': 'req-8b9ffe97-f0bf-4f92-ba49-68315ecde831'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.222756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] The token cache is being invalidate because project 4f0e5e478a4642238f0cbdfbc9128b99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:58.223055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.223768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.237799 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2891/5794] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:58 2022] DELETE /identity/v3/projects/4f0e5e478a4642238f0cbdfbc9128b99 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:58.239390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:58.241283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:58.268810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc5399c-e455-42ec-b546-7a3816c5eec5 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:58.426087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:58.427354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:58.427478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:58.428069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/roles/09334ee2a43644c4959ffb89d398439e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:58.429785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_role(role_id=09334ee2a43644c4959ffb89d398439e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:58.432263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:58.513610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invalidating the token cache because role 09334ee2a43644c4959ffb89d398439e has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:58.513911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.514595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.527734 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2904/5795] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:58 2022] DELETE /identity/v3/roles/09334ee2a43644c4959ffb89d398439e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:58.527969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:58.543730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ffe97-f0bf-4f92-ba49-68315ecde831 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:58.678179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:58.678834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:58.679118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:58.679392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/users/e4e148ed1c1549cfa5e091d110d5d8b3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:58.680534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e4e148ed1c1549cfa5e091d110d5d8b3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:58.683426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:58.767403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4e148ed1c1549cfa5e091d110d5d8b3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.792716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4e148ed1c1549cfa5e091d110d5d8b3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.793603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4e148ed1c1549cfa5e091d110d5d8b3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.809026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4e148ed1c1549cfa5e091d110d5d8b3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.826034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4e148ed1c1549cfa5e091d110d5d8b3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:58.838861 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2892/5796] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:19:58 2022] DELETE /identity/v3/users/e4e148ed1c1549cfa5e091d110d5d8b3 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:58.842926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:58.844433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:58.871018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbdcdf-da68-4e55-bfff-5c2cdd391eb9 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:58.989986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f1ce-8650-4891-8b7f-8937ad997b1f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:58.990935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f1ce-8650-4891-8b7f-8937ad997b1f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:58.991573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f1ce-8650-4891-8b7f-8937ad997b1f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:58.992114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4f1ce-8650-4891-8b7f-8937ad997b1f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:59.006651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4f1ce-8650-4891-8b7f-8937ad997b1f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_group(group_id=d0d8c8f5bf1b430b9b35d0d1e5ff6e42)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:59.013005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4f1ce-8650-4891-8b7f-8937ad997b1f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:59.103160 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:59.150415 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2905/5797] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:19:58 2022] DELETE /identity/v3/groups/d0d8c8f5bf1b430b9b35d0d1e5ff6e42 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:19:59.152102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:59.153737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:59.176394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5084767e-ff10-49dd-ba33-d55d84f2238e tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:59.283751 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:19:59.317719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:59.318566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:59.318799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:59.319162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/projects/4b3a6d08187c4453998967afa9721850` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:59.323379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4b3a6d08187c4453998967afa9721850)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:59.325639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:59.471030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b3a6d08187c4453998967afa9721850', 'request_id': 'req-506c03f4-12dd-4f58-b495-6bf4e6ae2547'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:59.486264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b3a6d08187c4453998967afa9721850', 'request_id': 'req-506c03f4-12dd-4f58-b495-6bf4e6ae2547'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:59.501143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b3a6d08187c4453998967afa9721850', 'request_id': 'req-506c03f4-12dd-4f58-b495-6bf4e6ae2547'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:59.541233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] The token cache is being invalidate because project 4b3a6d08187c4453998967afa9721850 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:19:59.541563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:59.548483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:59.550758 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2893/5798] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:19:59 2022] DELETE /identity/v3/projects/4b3a6d08187c4453998967afa9721850 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:19:59.554943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f1ce-8650-4891-8b7f-8937ad997b1f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:59.559506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-94a4f1ce-8650-4891-8b7f-8937ad997b1f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:19:59.575286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4f1ce-8650-4891-8b7f-8937ad997b1f tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:19:59.754827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:19:59.757207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:19:59.758783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:19:59.762005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/domains/deb0558de1684a3b8985653e10425ccb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:19:59.765452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=deb0558de1684a3b8985653e10425ccb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:19:59.771247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:19:59.849037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'deb0558de1684a3b8985653e10425ccb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:59.850677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'deb0558de1684a3b8985653e10425ccb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:59.911200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'deb0558de1684a3b8985653e10425ccb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:59.912178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'deb0558de1684a3b8985653e10425ccb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:19:59.915870 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2906/5799] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:19:59 2022] PATCH /identity/v3/domains/deb0558de1684a3b8985653e10425ccb => generated 277 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:19:59.919759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:19:59.931324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506c03f4-12dd-4f58-b495-6bf4e6ae2547 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:00.037891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3c6ced6b9d8044f4b86f6a378c41de1e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5b5609c804374c3882e111c5cb60d93b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:00.038598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:00.038894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:00.039176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] PATH_INFO: `/v3/domains/deb0558de1684a3b8985653e10425ccb` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:00.149656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=deb0558de1684a3b8985653e10425ccb)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:00.152219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:00.230959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'deb0558de1684a3b8985653e10425ccb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.245832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'deb0558de1684a3b8985653e10425ccb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.388233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deb0558de1684a3b8985653e10425ccb', 'request_id': 'req-51938575-c860-43e8-8337-a8b2b64a3986'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.393189 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:00.408708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deb0558de1684a3b8985653e10425ccb', 'request_id': 'req-51938575-c860-43e8-8337-a8b2b64a3986'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.440267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deb0558de1684a3b8985653e10425ccb', 'request_id': 'req-51938575-c860-43e8-8337-a8b2b64a3986'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.505479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] The token cache is being invalidate because project deb0558de1684a3b8985653e10425ccb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:00.505680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.509830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.539803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'deb0558de1684a3b8985653e10425ccb', 'request_id': 'req-51938575-c860-43e8-8337-a8b2b64a3986'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.542929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'deb0558de1684a3b8985653e10425ccb', 'request_id': 'req-51938575-c860-43e8-8337-a8b2b64a3986'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.547980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'deb0558de1684a3b8985653e10425ccb', 'request_id': 'req-51938575-c860-43e8-8337-a8b2b64a3986'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:00.574173 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2894/5800] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:19:59 2022] DELETE /identity/v3/domains/deb0558de1684a3b8985653e10425ccb => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:00.578558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:00.582662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:00.742491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214e4561-8f1e-49f1-8315-b6a56d857809 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:00.876442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:00.898533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:00.946394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:00.947601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:00.947893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:00.948174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] PATH_INFO: `/v3/users/908a545555aa4ff5b8f0ed8f1e2149cb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:00.950092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=908a545555aa4ff5b8f0ed8f1e2149cb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:00.957576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:00.967375 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:01.081171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '908a545555aa4ff5b8f0ed8f1e2149cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.119629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '908a545555aa4ff5b8f0ed8f1e2149cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.121167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '908a545555aa4ff5b8f0ed8f1e2149cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.145782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '908a545555aa4ff5b8f0ed8f1e2149cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.159553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51938575-c860-43e8-8337-a8b2b64a3986 tempest-InheritsV3TestJSON-173932502 tempest-InheritsV3TestJSON-173932502-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:01.170744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ce848458-cde6-4b8a-8f10-c1fa6aee2593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '908a545555aa4ff5b8f0ed8f1e2149cb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.176508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:01.180241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:01.180574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:01.181445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] PATH_INFO: `/v3/users/982fb869b1454ec2868894852b797096` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:01.196124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=982fb869b1454ec2868894852b797096)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:01.198768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:01.210953 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2907/5801] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:00 2022] DELETE /identity/v3/users/908a545555aa4ff5b8f0ed8f1e2149cb => generated 0 bytes in 633 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:01.217228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289842b4-9318-4cd7-9f97-2f976eca97c7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:01.219236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289842b4-9318-4cd7-9f97-2f976eca97c7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:01.220380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289842b4-9318-4cd7-9f97-2f976eca97c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:01.323037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-289842b4-9318-4cd7-9f97-2f976eca97c7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:01.326670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982fb869b1454ec2868894852b797096'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.328817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-289842b4-9318-4cd7-9f97-2f976eca97c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:01.358113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982fb869b1454ec2868894852b797096'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.360342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982fb869b1454ec2868894852b797096'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.389641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982fb869b1454ec2868894852b797096'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.421766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7a929d30-f62d-404f-a358-5e9495841d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982fb869b1454ec2868894852b797096'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:01.442654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2895/5802] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:00 2022] DELETE /identity/v3/users/982fb869b1454ec2868894852b797096 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:01.455024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98acac-ff51-4cef-afd8-1e868f351c5f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:01.457970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98acac-ff51-4cef-afd8-1e868f351c5f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:01.458260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f98acac-ff51-4cef-afd8-1e868f351c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:01.540449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7f98acac-ff51-4cef-afd8-1e868f351c5f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:01.546007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7f98acac-ff51-4cef-afd8-1e868f351c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:01.552156 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2908/5803] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:01.594142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289842b4-9318-4cd7-9f97-2f976eca97c7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:01.596019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-289842b4-9318-4cd7-9f97-2f976eca97c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:01.715079 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:INSERT=2,keystone:DELETE=17 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:01.858867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289842b4-9318-4cd7-9f97-2f976eca97c7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:01.862255 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2896/5804] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:01.890718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98acac-ff51-4cef-afd8-1e868f351c5f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:01.939684 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:02.032578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e0fdb-34ca-4f8c-9156-30e7b60c567f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:02.038512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0fdb-34ca-4f8c-9156-30e7b60c567f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:02.039041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0fdb-34ca-4f8c-9156-30e7b60c567f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:02.041144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94e0fdb-34ca-4f8c-9156-30e7b60c567f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:02.087970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e0fdb-34ca-4f8c-9156-30e7b60c567f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:02.093455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94e0fdb-34ca-4f8c-9156-30e7b60c567f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:02.137076 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2909/5805] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:20:02.182614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f98acac-ff51-4cef-afd8-1e868f351c5f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:02.190469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba18e5-0cf6-4764-9af7-4ee9c8623a93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:02.196299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba18e5-0cf6-4764-9af7-4ee9c8623a93 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:02.196848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba18e5-0cf6-4764-9af7-4ee9c8623a93 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:02.197797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cba18e5-0cf6-4764-9af7-4ee9c8623a93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:02.230201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba18e5-0cf6-4764-9af7-4ee9c8623a93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:02.234387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cba18e5-0cf6-4764-9af7-4ee9c8623a93 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:02.264541 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2897/5806] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:20:03.799965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e0fdb-34ca-4f8c-9156-30e7b60c567f service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:03.802127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f94e0fdb-34ca-4f8c-9156-30e7b60c567f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:03.821583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94e0fdb-34ca-4f8c-9156-30e7b60c567f service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:03.836204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:03.837779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:03.838263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:03.838756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] PATH_INFO: `/v3/projects/78063a5562794cc389fa407cac6d7604` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:03.840348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78063a5562794cc389fa407cac6d7604)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:03.843144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:03.949626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba18e5-0cf6-4764-9af7-4ee9c8623a93 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:03.951518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7cba18e5-0cf6-4764-9af7-4ee9c8623a93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:03.961884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78063a5562794cc389fa407cac6d7604', 'request_id': 'req-1975346e-97b2-4456-88d5-9a10e4adfd00'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:03.971820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cba18e5-0cf6-4764-9af7-4ee9c8623a93 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:03.983509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78063a5562794cc389fa407cac6d7604', 'request_id': 'req-1975346e-97b2-4456-88d5-9a10e4adfd00'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:03.998038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78063a5562794cc389fa407cac6d7604', 'request_id': 'req-1975346e-97b2-4456-88d5-9a10e4adfd00'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.016965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] The token cache is being invalidate because project 78063a5562794cc389fa407cac6d7604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:04.018555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.020200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.031667 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2910/5807] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:03 2022] DELETE /identity/v3/projects/78063a5562794cc389fa407cac6d7604 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:04.037154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:04.046439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:04.088664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:04.090364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.090838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.091276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] PATH_INFO: `/v3/projects/4065ffd353ca412883065d4c009c1454` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:04.093663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4065ffd353ca412883065d4c009c1454)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:04.096405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:04.191017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4065ffd353ca412883065d4c009c1454', 'request_id': 'req-ea28fdd6-6a8a-4a63-9a81-807370f5e091'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.194891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975346e-97b2-4456-88d5-9a10e4adfd00 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:04.202551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4065ffd353ca412883065d4c009c1454', 'request_id': 'req-ea28fdd6-6a8a-4a63-9a81-807370f5e091'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.216720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4065ffd353ca412883065d4c009c1454', 'request_id': 'req-ea28fdd6-6a8a-4a63-9a81-807370f5e091'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.236434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] The token cache is being invalidate because project 4065ffd353ca412883065d4c009c1454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:04.236735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.237481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea28fdd6-6a8a-4a63-9a81-807370f5e091 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.239930 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2898/5808] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:03 2022] DELETE /identity/v3/projects/4065ffd353ca412883065d4c009c1454 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:04.244476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688e264-f5b7-42cf-b4b8-6bede4d57fa7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.244807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688e264-f5b7-42cf-b4b8-6bede4d57fa7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.245526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8688e264-f5b7-42cf-b4b8-6bede4d57fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:04.275960 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:04.328246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:04.328810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.329028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8688e264-f5b7-42cf-b4b8-6bede4d57fa7 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:04.329138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.329387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] PATH_INFO: `/v3/users/3c6ced6b9d8044f4b86f6a378c41de1e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:04.330536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c6ced6b9d8044f4b86f6a378c41de1e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:04.330650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8688e264-f5b7-42cf-b4b8-6bede4d57fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:04.332494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:04.334860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2899/5809] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:04 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:20:04.336593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90d9dc-282b-4a44-81fb-575550515066 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.337742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90d9dc-282b-4a44-81fb-575550515066 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.338048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb90d9dc-282b-4a44-81fb-575550515066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:04.359415 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:04.371613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bb90d9dc-282b-4a44-81fb-575550515066 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:04.373264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bb90d9dc-282b-4a44-81fb-575550515066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:04.388256 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2900/5810] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:04.390810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90d9dc-282b-4a44-81fb-575550515066 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:04.398033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bb90d9dc-282b-4a44-81fb-575550515066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:04.442024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c6ced6b9d8044f4b86f6a378c41de1e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.467558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c6ced6b9d8044f4b86f6a378c41de1e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.468342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c6ced6b9d8044f4b86f6a378c41de1e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.485995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c6ced6b9d8044f4b86f6a378c41de1e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.498471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f21a9ea8-1300-43f7-81bf-be149d561ec8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c6ced6b9d8044f4b86f6a378c41de1e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.508690 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2911/5811] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:04 2022] DELETE /identity/v3/users/3c6ced6b9d8044f4b86f6a378c41de1e => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:04.513436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356366e3-1df8-44b7-a53d-7d33f763bae9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.513735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356366e3-1df8-44b7-a53d-7d33f763bae9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.513991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356366e3-1df8-44b7-a53d-7d33f763bae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:04.519096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb90d9dc-282b-4a44-81fb-575550515066 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:04.559588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-356366e3-1df8-44b7-a53d-7d33f763bae9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:04.560844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-356366e3-1df8-44b7-a53d-7d33f763bae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:04.643712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb1f3-f423-4c0d-99e5-7ddfb5af2208 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:04.644537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb1f3-f423-4c0d-99e5-7ddfb5af2208 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.644712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb1f3-f423-4c0d-99e5-7ddfb5af2208 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.655464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106fb1f3-f423-4c0d-99e5-7ddfb5af2208 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:04.692061 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2912/5812] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:04.697115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356366e3-1df8-44b7-a53d-7d33f763bae9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:04.713473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356366e3-1df8-44b7-a53d-7d33f763bae9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:04.725254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0954bd-526c-4e59-a1e2-003cd4d632e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:04.725907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0954bd-526c-4e59-a1e2-003cd4d632e0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.726189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0954bd-526c-4e59-a1e2-003cd4d632e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.726467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0954bd-526c-4e59-a1e2-003cd4d632e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:04.727133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0954bd-526c-4e59-a1e2-003cd4d632e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:04.728019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0954bd-526c-4e59-a1e2-003cd4d632e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:04.729612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0954bd-526c-4e59-a1e2-003cd4d632e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:04.759357 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2913/5813] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:04.763923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0954bd-526c-4e59-a1e2-003cd4d632e0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:04.779051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0954bd-526c-4e59-a1e2-003cd4d632e0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:04.789343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d136ee7-d43c-4b09-9596-7733e1e5ab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:04.790731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d136ee7-d43c-4b09-9596-7733e1e5ab52 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.791071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d136ee7-d43c-4b09-9596-7733e1e5ab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.791448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d136ee7-d43c-4b09-9596-7733e1e5ab52 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:04.792099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d136ee7-d43c-4b09-9596-7733e1e5ab52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:04.794288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d136ee7-d43c-4b09-9596-7733e1e5ab52 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:04.837184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-106fb1f3-f423-4c0d-99e5-7ddfb5af2208 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:04.847065 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2914/5814] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:04 2022] POST /identity/v3/projects => generated 393 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:04.847065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d136ee7-d43c-4b09-9596-7733e1e5ab52 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:04.850339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3d136ee7-d43c-4b09-9596-7733e1e5ab52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:04.878128 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2901/5815] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:20:04 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:04.881309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb1f3-f423-4c0d-99e5-7ddfb5af2208 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:04.899065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106fb1f3-f423-4c0d-99e5-7ddfb5af2208 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:04.945792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d136ee7-d43c-4b09-9596-7733e1e5ab52 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:04.950389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c94e273-2ac7-46d1-8365-59131a943f3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:04.951273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e273-2ac7-46d1-8365-59131a943f3e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.951899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e273-2ac7-46d1-8365-59131a943f3e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.952199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c94e273-2ac7-46d1-8365-59131a943f3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:04.955033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c94e273-2ac7-46d1-8365-59131a943f3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:04.966517 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:04.978217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e273-2ac7-46d1-8365-59131a943f3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:04.978694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c94e273-2ac7-46d1-8365-59131a943f3e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:04.994004 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2915/5816] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:04.995815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25e772-9014-4610-9028-9fc69a0a1336 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:04.996270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25e772-9014-4610-9028-9fc69a0a1336 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:04.996562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25e772-9014-4610-9028-9fc69a0a1336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:05.060089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1d25e772-9014-4610-9028-9fc69a0a1336 None None] MFA Rules not processed for user `b2755c3ea93440999d287890d328ecd6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:05.062315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d25e772-9014-4610-9028-9fc69a0a1336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:05.151534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608902b3-d461-4aa6-b92b-c99bde03e57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:05.152019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608902b3-d461-4aa6-b92b-c99bde03e57b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:05.152371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608902b3-d461-4aa6-b92b-c99bde03e57b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:05.152763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608902b3-d461-4aa6-b92b-c99bde03e57b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:05.153512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608902b3-d461-4aa6-b92b-c99bde03e57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:05.155956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608902b3-d461-4aa6-b92b-c99bde03e57b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:05.198275 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:UPDATE=2,keystone:INSERT=5,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:05.211636 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2902/5817] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:04 2022] POST /identity/v3/users => generated 297 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:05.213619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608902b3-d461-4aa6-b92b-c99bde03e57b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:05.234540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608902b3-d461-4aa6-b92b-c99bde03e57b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:05.255575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6ff1f-99c4-463d-b29b-98267546e293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:05.255575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ff1f-99c4-463d-b29b-98267546e293 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:05.255575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ff1f-99c4-463d-b29b-98267546e293 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:05.255575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6ff1f-99c4-463d-b29b-98267546e293 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:05.255925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6ff1f-99c4-463d-b29b-98267546e293 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:05.255925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6ff1f-99c4-463d-b29b-98267546e293 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:05.256374 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2916/5818] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:05.276538 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2903/5819] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:05.277830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25e772-9014-4610-9028-9fc69a0a1336 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:05.294782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25e772-9014-4610-9028-9fc69a0a1336 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:05.306492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f37f0-2dd3-4757-a548-81309fd6031a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:05.307132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f37f0-2dd3-4757-a548-81309fd6031a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:05.307415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f37f0-2dd3-4757-a548-81309fd6031a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:05.307692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f37f0-2dd3-4757-a548-81309fd6031a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:05.308342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f37f0-2dd3-4757-a548-81309fd6031a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:05.310164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f37f0-2dd3-4757-a548-81309fd6031a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:05.326596 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2917/5820] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:05.330790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6ff1f-99c4-463d-b29b-98267546e293 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:05.377746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6ff1f-99c4-463d-b29b-98267546e293 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:05.406349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ddd55-a49e-483f-abc8-567d7a9f36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:05.407019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ddd55-a49e-483f-abc8-567d7a9f36d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:05.407294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ddd55-a49e-483f-abc8-567d7a9f36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:05.407809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ddd55-a49e-483f-abc8-567d7a9f36d1 admin admin] PATH_INFO: `/v3/projects/d4ea2b64dfd8408292fe8b8d44c39b59/users/b62fde68e8c747bfbea881c71421c5ae/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:05.439268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ddd55-a49e-483f-abc8-567d7a9f36d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d4ea2b64dfd8408292fe8b8d44c39b59, user_id=b62fde68e8c747bfbea881c71421c5ae, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:05.445939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ddd55-a49e-483f-abc8-567d7a9f36d1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:05.482581 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2904/5821] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:05 2022] PUT /identity/v3/projects/d4ea2b64dfd8408292fe8b8d44c39b59/users/b62fde68e8c747bfbea881c71421c5ae/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:05.494038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341909bb-6eb7-48c3-9bc4-bd53a3d20446 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:05.494334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341909bb-6eb7-48c3-9bc4-bd53a3d20446 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:05.494614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341909bb-6eb7-48c3-9bc4-bd53a3d20446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:05.558509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-341909bb-6eb7-48c3-9bc4-bd53a3d20446 None None] MFA Rules not processed for user `b62fde68e8c747bfbea881c71421c5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:05.560711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-341909bb-6eb7-48c3-9bc4-bd53a3d20446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:05.713805 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2918/5822] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:05 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:05.718069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ddd55-a49e-483f-abc8-567d7a9f36d1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:05.760403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341909bb-6eb7-48c3-9bc4-bd53a3d20446 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:05.864902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ddd55-a49e-483f-abc8-567d7a9f36d1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:05.881661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f356ef-92c1-4f42-81fe-5fd34cb4fbef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:05.881661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f356ef-92c1-4f42-81fe-5fd34cb4fbef admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:05.881661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f356ef-92c1-4f42-81fe-5fd34cb4fbef admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:05.881927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f356ef-92c1-4f42-81fe-5fd34cb4fbef admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:05.888769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f356ef-92c1-4f42-81fe-5fd34cb4fbef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:05.891327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f356ef-92c1-4f42-81fe-5fd34cb4fbef admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:05.911517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341909bb-6eb7-48c3-9bc4-bd53a3d20446 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:05.923066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3937e-3323-462e-b448-9e8580ab150e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:05.923857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3937e-3323-462e-b448-9e8580ab150e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:05.924215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3937e-3323-462e-b448-9e8580ab150e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:05.924500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb3937e-3323-462e-b448-9e8580ab150e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:05.929948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bdb3937e-3323-462e-b448-9e8580ab150e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:05.949960 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2905/5823] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:05 2022] POST /identity/v3/projects => generated 391 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:05.956121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3a82b-d36d-4b2d-a4a4-25ca1e7a1b5f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:05.956513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3a82b-d36d-4b2d-a4a4-25ca1e7a1b5f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:05.956884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c3a82b-d36d-4b2d-a4a4-25ca1e7a1b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:05.958745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3937e-3323-462e-b448-9e8580ab150e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:05.960625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb3937e-3323-462e-b448-9e8580ab150e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:05.971708 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2919/5824] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:05.972520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3937e-3323-462e-b448-9e8580ab150e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:05.985177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb3937e-3323-462e-b448-9e8580ab150e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:06.001804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-87c3a82b-d36d-4b2d-a4a4-25ca1e7a1b5f None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:06.003652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-87c3a82b-d36d-4b2d-a4a4-25ca1e7a1b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:06.006296 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:06.020454 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2906/5825] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:05 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:20:06.021512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3a82b-d36d-4b2d-a4a4-25ca1e7a1b5f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:06.024511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-87c3a82b-d36d-4b2d-a4a4-25ca1e7a1b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:06.073092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1228b-5be7-4318-8308-4909dee7fbde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:06.073960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1228b-5be7-4318-8308-4909dee7fbde service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:06.074450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1228b-5be7-4318-8308-4909dee7fbde service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:06.074823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd1228b-5be7-4318-8308-4909dee7fbde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:06.077524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ecd1228b-5be7-4318-8308-4909dee7fbde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:06.091284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1228b-5be7-4318-8308-4909dee7fbde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:06.093346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd1228b-5be7-4318-8308-4909dee7fbde service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:06.105987 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2920/5826] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:06.122331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1228b-5be7-4318-8308-4909dee7fbde service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:06.170944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c3a82b-d36d-4b2d-a4a4-25ca1e7a1b5f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:06.186625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:06.187280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:06.187561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:06.187840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] PATH_INFO: `/v3/projects/5b5609c804374c3882e111c5cb60d93b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:06.189029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b5609c804374c3882e111c5cb60d93b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:06.191000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:06.322329 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:06.333071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b5609c804374c3882e111c5cb60d93b', 'request_id': 'req-1cb9ecf9-7202-4804-bf3c-42d879a7012d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:06.353985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b5609c804374c3882e111c5cb60d93b', 'request_id': 'req-1cb9ecf9-7202-4804-bf3c-42d879a7012d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:06.366809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd1228b-5be7-4318-8308-4909dee7fbde service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:06.371252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b5609c804374c3882e111c5cb60d93b', 'request_id': 'req-1cb9ecf9-7202-4804-bf3c-42d879a7012d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:06.439188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] The token cache is being invalidate because project 5b5609c804374c3882e111c5cb60d93b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:06.439547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:06.441936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1cb9ecf9-7202-4804-bf3c-42d879a7012d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:06.449901 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2907/5827] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:06 2022] DELETE /identity/v3/projects/5b5609c804374c3882e111c5cb60d93b => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:06.451027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4a9e3-ec9f-47a4-90a1-bc75b32aa522 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:06.451321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4a9e3-ec9f-47a4-90a1-bc75b32aa522 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:06.451601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4a9e3-ec9f-47a4-90a1-bc75b32aa522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:06.473371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7fb4a9e3-ec9f-47a4-90a1-bc75b32aa522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:06.511095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989ca1e8-2b15-4d89-87f0-42359e28a3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:06.511732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ca1e8-2b15-4d89-87f0-42359e28a3db admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:06.512022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ca1e8-2b15-4d89-87f0-42359e28a3db admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:06.512300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989ca1e8-2b15-4d89-87f0-42359e28a3db admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:06.513127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ca1e8-2b15-4d89-87f0-42359e28a3db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:06.520557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989ca1e8-2b15-4d89-87f0-42359e28a3db admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:06.571685 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2921/5828] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:06 2022] POST /identity/v3/users => generated 302 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:06.574898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedb30-0110-4b2d-a4f3-60b0196ebbd0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:06.575205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedb30-0110-4b2d-a4f3-60b0196ebbd0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:06.576451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aedb30-0110-4b2d-a4f3-60b0196ebbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:06.609255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-38aedb30-0110-4b2d-a4f3-60b0196ebbd0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:06.610563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-38aedb30-0110-4b2d-a4f3-60b0196ebbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:06.622825 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2922/5829] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:06.623739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aedb30-0110-4b2d-a4f3-60b0196ebbd0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:06.629857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-38aedb30-0110-4b2d-a4f3-60b0196ebbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:06.655140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aedb30-0110-4b2d-a4f3-60b0196ebbd0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:06.668440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e801d22f-9e43-4aef-8245-0a222fc83702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:06.671196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801d22f-9e43-4aef-8245-0a222fc83702 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:06.671433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801d22f-9e43-4aef-8245-0a222fc83702 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:06.671722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e801d22f-9e43-4aef-8245-0a222fc83702 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:06.675299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801d22f-9e43-4aef-8245-0a222fc83702 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:06.676957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e801d22f-9e43-4aef-8245-0a222fc83702 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:06.701822 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2923/5830] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:06.703251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f695b-a3ab-43c3-a5c5-8856dea3c355 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:06.703720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f695b-a3ab-43c3-a5c5-8856dea3c355 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:06.704009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77f695b-a3ab-43c3-a5c5-8856dea3c355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-7fb4a9e3-ec9f-47a4-90a1-bc75b32aa522 None None] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/server/flask/common.py", line 1064, in wrapper Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(*args, **kwargs) Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 315, in post Oct 24 09:20:06.707686 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application token = authentication.authenticate_for_token(auth_data) Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 185, in authenticate_for_token Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application authenticate(auth_info, auth_context) Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/_shared/authentication.py", line 152, in authenticate Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = method.authenticate(auth_info.get_method_data(method_name)) Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 42, in authenticate Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application token = self._get_token_ref(auth_payload) Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/auth/plugins/token.py", line 36, in _get_token_ref Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return PROVIDERS.token_provider_api.validate_token(token_id) Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:06.708766 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 24 09:20:06.709752 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:06.713169 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2908/5831] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:06 2022] POST /identity/v3/auth/tokens => generated 80 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 09:20:06.714295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4a9e3-ec9f-47a4-90a1-bc75b32aa522 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:06.741910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb4a9e3-ec9f-47a4-90a1-bc75b32aa522 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:06.745266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b77f695b-a3ab-43c3-a5c5-8856dea3c355 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:06.750981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b77f695b-a3ab-43c3-a5c5-8856dea3c355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:06.760560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fa72c-510c-4738-9a66-4cc824401ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:06.761239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa72c-510c-4738-9a66-4cc824401ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:06.761547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa72c-510c-4738-9a66-4cc824401ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:06.761913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228fa72c-510c-4738-9a66-4cc824401ec7 admin admin] PATH_INFO: `/v3/projects/7c3aab62168a49b1a803137e7e404d53/users/4f96808120954544b427ca58eea40de5/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:06.780260 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2924/5832] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:06.781592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce72d6-63b6-416a-b4fd-e3b43ca80871 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:06.781879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce72d6-63b6-416a-b4fd-e3b43ca80871 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:06.782161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ce72d6-63b6-416a-b4fd-e3b43ca80871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:06.795483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fa72c-510c-4738-9a66-4cc824401ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3aab62168a49b1a803137e7e404d53, user_id=4f96808120954544b427ca58eea40de5, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:06.798107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228fa72c-510c-4738-9a66-4cc824401ec7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:06.835972 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2909/5833] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:06 2022] PUT /identity/v3/projects/7c3aab62168a49b1a803137e7e404d53/users/4f96808120954544b427ca58eea40de5/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:06.836878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fa72c-510c-4738-9a66-4cc824401ec7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:06.890566 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.server.flask.application [None req-28ce72d6-63b6-416a-b4fd-e3b43ca80871 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.25: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 24 09:20:06.897070 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2925/5834] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:06 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 113 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 24 09:20:06.897070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce72d6-63b6-416a-b4fd-e3b43ca80871 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:06.933896 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:07.020729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228fa72c-510c-4738-9a66-4cc824401ec7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:07.044129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4736ef64-a9c5-4f0a-a55b-26efb4ebc961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:07.044786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ef64-a9c5-4f0a-a55b-26efb4ebc961 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.044965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ef64-a9c5-4f0a-a55b-26efb4ebc961 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.045242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4736ef64-a9c5-4f0a-a55b-26efb4ebc961 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.046004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ef64-a9c5-4f0a-a55b-26efb4ebc961 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:07.046310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ef64-a9c5-4f0a-a55b-26efb4ebc961 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:07.047940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4736ef64-a9c5-4f0a-a55b-26efb4ebc961 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:07.083090 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2910/5835] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:07.087591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f751a-17af-477b-88be-99c5f90b0dbe None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.087890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f751a-17af-477b-88be-99c5f90b0dbe None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.089807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2f751a-17af-477b-88be-99c5f90b0dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.102258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ce72d6-63b6-416a-b4fd-e3b43ca80871 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:07.109175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4bd67-34a5-489a-ade1-fbe08599eb6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:07.109986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4bd67-34a5-489a-ade1-fbe08599eb6f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.110377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4bd67-34a5-489a-ade1-fbe08599eb6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.110880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f4bd67-34a5-489a-ade1-fbe08599eb6f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.111613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4bd67-34a5-489a-ade1-fbe08599eb6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:07.114962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f4bd67-34a5-489a-ade1-fbe08599eb6f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:07.128239 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2926/5836] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:07.129234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4bd67-34a5-489a-ade1-fbe08599eb6f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:07.148901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f4bd67-34a5-489a-ade1-fbe08599eb6f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:07.156362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601761c2-7162-4375-85f8-7beedeb63b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:07.157068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601761c2-7162-4375-85f8-7beedeb63b51 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.157471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601761c2-7162-4375-85f8-7beedeb63b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.157820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601761c2-7162-4375-85f8-7beedeb63b51 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.158530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601761c2-7162-4375-85f8-7beedeb63b51 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:07.160566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601761c2-7162-4375-85f8-7beedeb63b51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:07.172990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ad2f751a-17af-477b-88be-99c5f90b0dbe None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:07.177449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ad2f751a-17af-477b-88be-99c5f90b0dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:07.207869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2927/5837] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:07 2022] POST /identity/v3/projects => generated 369 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:07.209047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601761c2-7162-4375-85f8-7beedeb63b51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:07.271281 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=2,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:07.331016 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2911/5838] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:07.331836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f751a-17af-477b-88be-99c5f90b0dbe None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:07.346278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2f751a-17af-477b-88be-99c5f90b0dbe None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:07.380862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601761c2-7162-4375-85f8-7beedeb63b51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:07.399909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711109e0-a8e8-418f-95f2-521bf3489f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:07.400785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711109e0-a8e8-418f-95f2-521bf3489f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.401139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711109e0-a8e8-418f-95f2-521bf3489f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.401523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711109e0-a8e8-418f-95f2-521bf3489f3d admin admin] PATH_INFO: `/v3/projects/7c3aab62168a49b1a803137e7e404d53/users/4f96808120954544b427ca58eea40de5/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.406922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711109e0-a8e8-418f-95f2-521bf3489f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c3aab62168a49b1a803137e7e404d53, user_id=4f96808120954544b427ca58eea40de5, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:07.410805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711109e0-a8e8-418f-95f2-521bf3489f3d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:07.438991 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2928/5839] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:07 2022] PUT /identity/v3/projects/7c3aab62168a49b1a803137e7e404d53/users/4f96808120954544b427ca58eea40de5/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:07.438991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711109e0-a8e8-418f-95f2-521bf3489f3d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:07.510716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9615c7-6b25-4249-a75e-ead1d7f2dcef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:07.511354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9615c7-6b25-4249-a75e-ead1d7f2dcef admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.511639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9615c7-6b25-4249-a75e-ead1d7f2dcef admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.511917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9615c7-6b25-4249-a75e-ead1d7f2dcef admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.512564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9615c7-6b25-4249-a75e-ead1d7f2dcef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:07.514549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9615c7-6b25-4249-a75e-ead1d7f2dcef admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:07.563630 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2912/5840] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:07 2022] POST /identity/v3/users => generated 285 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:07.565241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc6490-538c-4659-8a54-4e21da5e7e22 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.565716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc6490-538c-4659-8a54-4e21da5e7e22 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.566150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fc6490-538c-4659-8a54-4e21da5e7e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.595364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711109e0-a8e8-418f-95f2-521bf3489f3d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:07.600478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c780e-fda3-4f57-b090-620daeba7876 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:07.601249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c780e-fda3-4f57-b090-620daeba7876 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.603445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c780e-fda3-4f57-b090-620daeba7876 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.603445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c780e-fda3-4f57-b090-620daeba7876 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.625438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f7fc6490-538c-4659-8a54-4e21da5e7e22 None None] MFA Rules not processed for user `4f96808120954544b427ca58eea40de5`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:07.626768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f7fc6490-538c-4659-8a54-4e21da5e7e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:07.667355 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:07.678845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-804c780e-fda3-4f57-b090-620daeba7876 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:07.704542 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2929/5841] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:20:07 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:07.704542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c780e-fda3-4f57-b090-620daeba7876 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:07.829248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c780e-fda3-4f57-b090-620daeba7876 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:07.836550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19770c6-92ff-4a62-be14-8523060a4b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:07.837872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19770c6-92ff-4a62-be14-8523060a4b4b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.838246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19770c6-92ff-4a62-be14-8523060a4b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.838591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19770c6-92ff-4a62-be14-8523060a4b4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.839790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19770c6-92ff-4a62-be14-8523060a4b4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:07.841675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19770c6-92ff-4a62-be14-8523060a4b4b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:07.845667 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2913/5842] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:07 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:07.854779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc6490-538c-4659-8a54-4e21da5e7e22 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:07.856331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f7fc6490-538c-4659-8a54-4e21da5e7e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:07.862095 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2930/5843] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:07.865929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19770c6-92ff-4a62-be14-8523060a4b4b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:07.885447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19770c6-92ff-4a62-be14-8523060a4b4b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:07.898903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d773c-87c5-4e23-b8cc-950e039dee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:07.912940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d773c-87c5-4e23-b8cc-950e039dee31 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:07.913654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d773c-87c5-4e23-b8cc-950e039dee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:07.914090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d773c-87c5-4e23-b8cc-950e039dee31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:07.914956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d773c-87c5-4e23-b8cc-950e039dee31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:07.926156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d773c-87c5-4e23-b8cc-950e039dee31 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:07.973265 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2931/5844] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:07.978721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d773c-87c5-4e23-b8cc-950e039dee31 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:08.016773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d773c-87c5-4e23-b8cc-950e039dee31 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:08.030176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fa08f6-b773-46cc-aa76-d8375e862d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:08.030678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa08f6-b773-46cc-aa76-d8375e862d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:08.030959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa08f6-b773-46cc-aa76-d8375e862d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:08.031309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fa08f6-b773-46cc-aa76-d8375e862d98 admin admin] PATH_INFO: `/v3/projects/3ef5c1e5f44842779c6ca63aba4b3c35/users/902fa3a5a8e0459bb7bf822320c231a4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:08.052271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa08f6-b773-46cc-aa76-d8375e862d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ef5c1e5f44842779c6ca63aba4b3c35, user_id=902fa3a5a8e0459bb7bf822320c231a4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:08.062764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fa08f6-b773-46cc-aa76-d8375e862d98 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:08.074909 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:08.102253 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2932/5845] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:07 2022] PUT /identity/v3/projects/3ef5c1e5f44842779c6ca63aba4b3c35/users/902fa3a5a8e0459bb7bf822320c231a4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:08.165598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fc6490-538c-4659-8a54-4e21da5e7e22 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:08.218155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad609f7-0f17-4ad5-ab71-d1b7600374ce None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:08.218445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad609f7-0f17-4ad5-ab71-d1b7600374ce None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:08.218726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad609f7-0f17-4ad5-ab71-d1b7600374ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:08.255755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cad609f7-0f17-4ad5-ab71-d1b7600374ce None None] MFA Rules not processed for user `902fa3a5a8e0459bb7bf822320c231a4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:08.257273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cad609f7-0f17-4ad5-ab71-d1b7600374ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:08.355841 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2933/5846] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:20:08.357553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad609f7-0f17-4ad5-ab71-d1b7600374ce None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:08.371624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b69dd-ca57-4998-93d3-df0ab7bcadc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:08.373001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b69dd-ca57-4998-93d3-df0ab7bcadc4 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:08.374411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b69dd-ca57-4998-93d3-df0ab7bcadc4 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:08.374844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b69dd-ca57-4998-93d3-df0ab7bcadc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:08.383141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa6b69dd-ca57-4998-93d3-df0ab7bcadc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:08.425164 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:08.473328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad609f7-0f17-4ad5-ab71-d1b7600374ce None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:08.492744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25766a-4dc9-47de-9ae6-b3d5f98f294f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:08.494126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25766a-4dc9-47de-9ae6-b3d5f98f294f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:08.494740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25766a-4dc9-47de-9ae6-b3d5f98f294f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:08.494740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c25766a-4dc9-47de-9ae6-b3d5f98f294f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:08.496086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25766a-4dc9-47de-9ae6-b3d5f98f294f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:08.498154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c25766a-4dc9-47de-9ae6-b3d5f98f294f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:08.534392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b69dd-ca57-4998-93d3-df0ab7bcadc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:08.537802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b69dd-ca57-4998-93d3-df0ab7bcadc4 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:08.574643 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2934/5847] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:08 2022] POST /identity/v3/projects => generated 369 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:08.576925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25766a-4dc9-47de-9ae6-b3d5f98f294f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:08.581101 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2914/5848] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:07 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 727 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:08.708969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077731e-fd25-4940-958f-1f34117da93d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:08.709576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077731e-fd25-4940-958f-1f34117da93d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:08.710000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0077731e-fd25-4940-958f-1f34117da93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:08.755094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0077731e-fd25-4940-958f-1f34117da93d None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:08.756842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0077731e-fd25-4940-958f-1f34117da93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:08.764630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c25766a-4dc9-47de-9ae6-b3d5f98f294f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:08.769033 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2915/5849] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:08 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:20:08.771785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae612f11-62d8-4c4d-a991-99821ec5fde3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:08.773805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae612f11-62d8-4c4d-a991-99821ec5fde3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:08.774338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae612f11-62d8-4c4d-a991-99821ec5fde3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:08.779993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dad652-e751-4782-9ba4-fedfd7d50e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:08.780627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dad652-e751-4782-9ba4-fedfd7d50e55 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:08.780948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dad652-e751-4782-9ba4-fedfd7d50e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:08.781233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dad652-e751-4782-9ba4-fedfd7d50e55 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:08.781917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dad652-e751-4782-9ba4-fedfd7d50e55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:08.784541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dad652-e751-4782-9ba4-fedfd7d50e55 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:08.800373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ae612f11-62d8-4c4d-a991-99821ec5fde3 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:08.802312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ae612f11-62d8-4c4d-a991-99821ec5fde3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:08.829526 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2935/5850] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:08 2022] POST /identity/v3/users => generated 291 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:08.832141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dad652-e751-4782-9ba4-fedfd7d50e55 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:08.862631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dad652-e751-4782-9ba4-fedfd7d50e55 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:08.883321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bd9c8-7fac-4d8d-9d51-4f96a7af26fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:08.884850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bd9c8-7fac-4d8d-9d51-4f96a7af26fc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:08.887178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bd9c8-7fac-4d8d-9d51-4f96a7af26fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:08.890382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bd9c8-7fac-4d8d-9d51-4f96a7af26fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:08.891245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bd9c8-7fac-4d8d-9d51-4f96a7af26fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:08.893755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bd9c8-7fac-4d8d-9d51-4f96a7af26fc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:08.934921 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2936/5851] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:08.937238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bd9c8-7fac-4d8d-9d51-4f96a7af26fc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:08.983604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bd9c8-7fac-4d8d-9d51-4f96a7af26fc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:09.001644 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2916/5852] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:09.005940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472d307-9afb-4132-9e55-dc22d1f38b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:09.010092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472d307-9afb-4132-9e55-dc22d1f38b04 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:09.010513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472d307-9afb-4132-9e55-dc22d1f38b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:09.010908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a472d307-9afb-4132-9e55-dc22d1f38b04 admin admin] PATH_INFO: `/v3/projects/6e2bd65a91f44b159eb320ce5d578a5d/users/c50873b7611e478a80eaec60cd31d6d1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:09.012426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae612f11-62d8-4c4d-a991-99821ec5fde3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:09.041691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae612f11-62d8-4c4d-a991-99821ec5fde3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:09.054534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980d02c-a12a-42dc-9cfd-a13e274029ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:09.055410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980d02c-a12a-42dc-9cfd-a13e274029ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:09.056631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980d02c-a12a-42dc-9cfd-a13e274029ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:09.058161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1980d02c-a12a-42dc-9cfd-a13e274029ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:09.066751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472d307-9afb-4132-9e55-dc22d1f38b04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2bd65a91f44b159eb320ce5d578a5d, user_id=c50873b7611e478a80eaec60cd31d6d1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:09.071881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a472d307-9afb-4132-9e55-dc22d1f38b04 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:09.101269 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2937/5853] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:08 2022] PUT /identity/v3/projects/6e2bd65a91f44b159eb320ce5d578a5d/users/c50873b7611e478a80eaec60cd31d6d1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:09.106763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472d307-9afb-4132-9e55-dc22d1f38b04 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:09.137783 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:09.188076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1980d02c-a12a-42dc-9cfd-a13e274029ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:09.208737 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2917/5854] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:20:09 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:09.263784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a472d307-9afb-4132-9e55-dc22d1f38b04 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:09.277144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8229953-ab86-4721-bee3-8a5c97f9ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:09.281009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229953-ab86-4721-bee3-8a5c97f9ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:09.281656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229953-ab86-4721-bee3-8a5c97f9ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:09.282267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8229953-ab86-4721-bee3-8a5c97f9ec27 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:09.283055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8229953-ab86-4721-bee3-8a5c97f9ec27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:09.284811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8229953-ab86-4721-bee3-8a5c97f9ec27 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:09.313073 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2938/5855] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:09.317410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980d02c-a12a-42dc-9cfd-a13e274029ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:09.340290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1980d02c-a12a-42dc-9cfd-a13e274029ff tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:09.356532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1e5f1-ced0-4247-bfa7-91eb860cdb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:09.357724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1e5f1-ced0-4247-bfa7-91eb860cdb99 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:09.358011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1e5f1-ced0-4247-bfa7-91eb860cdb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:09.358291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f1e5f1-ced0-4247-bfa7-91eb860cdb99 admin admin] PATH_INFO: `/v3/projects/6e2bd65a91f44b159eb320ce5d578a5d/users/c50873b7611e478a80eaec60cd31d6d1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:09.364575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1e5f1-ced0-4247-bfa7-91eb860cdb99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e2bd65a91f44b159eb320ce5d578a5d, user_id=c50873b7611e478a80eaec60cd31d6d1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:09.373339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f1e5f1-ced0-4247-bfa7-91eb860cdb99 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:09.405719 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2918/5856] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:09 2022] PUT /identity/v3/projects/6e2bd65a91f44b159eb320ce5d578a5d/users/c50873b7611e478a80eaec60cd31d6d1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:09.416274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec0235-05b1-4ff4-b6e8-41111c6fdc66 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:09.416927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec0235-05b1-4ff4-b6e8-41111c6fdc66 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:09.417378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebec0235-05b1-4ff4-b6e8-41111c6fdc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:09.479770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ebec0235-05b1-4ff4-b6e8-41111c6fdc66 None None] MFA Rules not processed for user `c50873b7611e478a80eaec60cd31d6d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:09.481346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ebec0235-05b1-4ff4-b6e8-41111c6fdc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:09.500697 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:09.636481 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2939/5857] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:09.641617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1e5f1-ced0-4247-bfa7-91eb860cdb99 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:09.658345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f1e5f1-ced0-4247-bfa7-91eb860cdb99 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:09.674063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:09.674857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:09.675036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:09.675343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:09.676348 n-d-master-1 devstack@keystone.service[88311]: WARNING oslo_log.versionutils [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Deprecated: identity:create_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 24 09:20:09.677992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:09.679271 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:09.679271 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:09.679271 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:09.684527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:09.734311 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2919/5858] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:20:09 2022] POST /identity/v3/policies => generated 230 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:09.735390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec0235-05b1-4ff4-b6e8-41111c6fdc66 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:09.750350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebec0235-05b1-4ff4-b6e8-41111c6fdc66 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:09.760672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:09.761475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:09.763393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:09.763747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies/c522b9f089b7431a9b5759404ce1a577` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:09.766481 n-d-master-1 devstack@keystone.service[88312]: WARNING oslo_log.versionutils [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Deprecated: identity:update_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 24 09:20:09.768946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:update_policy(policy_id=c522b9f089b7431a9b5759404ce1a577)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:09.771273 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:09.771273 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:09.771273 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:09.776105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:09.850906 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2940/5859] 10.222.0.25 () {60 vars in 1252 bytes} [Mon Oct 24 09:20:09 2022] PATCH /identity/v3/policies/c522b9f089b7431a9b5759404ce1a577 => generated 237 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:09.856715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:09.874453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e897a9-3347-401c-a91d-283e29d454b2 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:09.892480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:09.893258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:09.893512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:09.893795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies/c522b9f089b7431a9b5759404ce1a577` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:09.894670 n-d-master-1 devstack@keystone.service[88311]: WARNING oslo_log.versionutils [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Deprecated: identity:get_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 24 09:20:09.895245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:get_policy(policy_id=c522b9f089b7431a9b5759404ce1a577)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:09.898885 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_policy": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:09.898885 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:09.898885 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:09.901762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:09.942785 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2920/5860] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:09 2022] GET /identity/v3/policies/c522b9f089b7431a9b5759404ce1a577 => generated 237 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:09.944829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:09.972682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867c4b41-9931-4eaf-b0b3-69e8a1acf1e9 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:09.999332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f229bbd2-8977-40d4-984e-dfe72f0276aa tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:09.999993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229bbd2-8977-40d4-984e-dfe72f0276aa tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.000287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229bbd2-8977-40d4-984e-dfe72f0276aa tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.000573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f229bbd2-8977-40d4-984e-dfe72f0276aa tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies/c522b9f089b7431a9b5759404ce1a577` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.001403 n-d-master-1 devstack@keystone.service[88312]: WARNING oslo_log.versionutils [None req-f229bbd2-8977-40d4-984e-dfe72f0276aa tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 24 09:20:10.001981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229bbd2-8977-40d4-984e-dfe72f0276aa tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=c522b9f089b7431a9b5759404ce1a577)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:10.019551 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-f229bbd2-8977-40d4-984e-dfe72f0276aa tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:10.019551 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:10.019551 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:10.021881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f229bbd2-8977-40d4-984e-dfe72f0276aa tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:10.091223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2941/5861] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:09 2022] DELETE /identity/v3/policies/c522b9f089b7431a9b5759404ce1a577 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:10.096155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:10.122931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9a25-fde9-427d-b60e-ccd42b53a464 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:10.159998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468f76-9c9e-46ba-b74a-19dc3980be0e tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:10.161985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468f76-9c9e-46ba-b74a-19dc3980be0e tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.162387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468f76-9c9e-46ba-b74a-19dc3980be0e tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.162776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54468f76-9c9e-46ba-b74a-19dc3980be0e tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.166991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54468f76-9c9e-46ba-b74a-19dc3980be0e tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:10.173253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54468f76-9c9e-46ba-b74a-19dc3980be0e tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:10.215670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae240-0d5d-41e3-8312-abfd51407fc3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.215994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae240-0d5d-41e3-8312-abfd51407fc3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.216467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9ae240-0d5d-41e3-8312-abfd51407fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.221923 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2921/5862] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:20:10 2022] POST /identity/v3/policies => generated 228 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:10.223250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468f76-9c9e-46ba-b74a-19dc3980be0e tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:10.249603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54468f76-9c9e-46ba-b74a-19dc3980be0e tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:10.263551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a7c01-8d5d-4dfc-a29b-58c08fd2163c tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:10.264165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a7c01-8d5d-4dfc-a29b-58c08fd2163c tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.264451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a7c01-8d5d-4dfc-a29b-58c08fd2163c tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.264733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a7c01-8d5d-4dfc-a29b-58c08fd2163c tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.265905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a7c01-8d5d-4dfc-a29b-58c08fd2163c tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:10.267751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a7c01-8d5d-4dfc-a29b-58c08fd2163c tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:10.303726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1c9ae240-0d5d-41e3-8312-abfd51407fc3 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:10.305421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c9ae240-0d5d-41e3-8312-abfd51407fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:10.309763 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2922/5863] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:20:10 2022] POST /identity/v3/policies => generated 230 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:10.311203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a7c01-8d5d-4dfc-a29b-58c08fd2163c tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:10.331805 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2942/5864] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:10 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 24 09:20:10.333491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a7c01-8d5d-4dfc-a29b-58c08fd2163c tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:10.339876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224b5bf-2a0e-4149-8eb1-320f1fce699a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.340079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224b5bf-2a0e-4149-8eb1-320f1fce699a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.340362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8224b5bf-2a0e-4149-8eb1-320f1fce699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.348007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c414d4-b950-4a22-a2c2-8ee5dfeb75cd tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:10.350450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c414d4-b950-4a22-a2c2-8ee5dfeb75cd tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.352060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c414d4-b950-4a22-a2c2-8ee5dfeb75cd tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.353527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c414d4-b950-4a22-a2c2-8ee5dfeb75cd tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.357036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c414d4-b950-4a22-a2c2-8ee5dfeb75cd tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:create_policy()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:10.369269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c414d4-b950-4a22-a2c2-8ee5dfeb75cd tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:10.422527 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2923/5865] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:20:10 2022] POST /identity/v3/policies => generated 230 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:10.424242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c414d4-b950-4a22-a2c2-8ee5dfeb75cd tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:10.432179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8224b5bf-2a0e-4149-8eb1-320f1fce699a None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:10.433622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8224b5bf-2a0e-4149-8eb1-320f1fce699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:10.466523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c414d4-b950-4a22-a2c2-8ee5dfeb75cd tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:10.489100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:10.489773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.490059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.490336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.491175 n-d-master-1 devstack@keystone.service[88311]: WARNING oslo_log.versionutils [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Deprecated: identity:list_policies of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 24 09:20:10.491739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:list_policies()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:10.495888 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_policies": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:10.495888 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:10.495888 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:10.496873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:10.518279 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2924/5866] 10.222.0.25 () {58 vars in 1131 bytes} [Mon Oct 24 09:20:10 2022] GET /identity/v3/policies => generated 764 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:10.524380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:10.549538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094e494-aa3e-4792-8849-690ee34e3881 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:10.569816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:10.570488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.570773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.571653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies/667e1ff0c18444bd9e602f41e476b9dc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.572465 n-d-master-1 devstack@keystone.service[88311]: WARNING oslo_log.versionutils [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Deprecated: identity:delete_policy of the v3 Policy APIs is deprecated as of Queens and may be removed in Stein. It will not be superseded. Oct 24 09:20:10.573010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=667e1ff0c18444bd9e602f41e476b9dc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:10.580042 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_policy": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:10.580042 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:10.580042 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:10.583153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:10.635581 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2925/5867] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:10 2022] DELETE /identity/v3/policies/667e1ff0c18444bd9e602f41e476b9dc => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:10.638428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:10.669697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ae70b-d33e-4f83-a985-9809558a6c90 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:10.677476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ea46d-491d-44d1-a46e-1fb4e8954b40 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:10.678617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ea46d-491d-44d1-a46e-1fb4e8954b40 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.680125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ea46d-491d-44d1-a46e-1fb4e8954b40 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.681167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ea46d-491d-44d1-a46e-1fb4e8954b40 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies/1bead9db1e8e4588ba10f09dd817a4a4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.684696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ea46d-491d-44d1-a46e-1fb4e8954b40 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=1bead9db1e8e4588ba10f09dd817a4a4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:10.690639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ea46d-491d-44d1-a46e-1fb4e8954b40 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:10.703461 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2943/5868] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:10.704754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224b5bf-2a0e-4149-8eb1-320f1fce699a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:10.740890 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2926/5869] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:10 2022] DELETE /identity/v3/policies/1bead9db1e8e4588ba10f09dd817a4a4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:10.741102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8224b5bf-2a0e-4149-8eb1-320f1fce699a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:10.743683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ea46d-491d-44d1-a46e-1fb4e8954b40 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:10.763359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ea46d-491d-44d1-a46e-1fb4e8954b40 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:10.775721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d7c508-583e-47e4-969d-b3a5229c9c65 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9dc7412dc1a54c12b37f74232cc218c1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '222a6b4a58294f44831765e3290a2933', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:10.776400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7c508-583e-47e4-969d-b3a5229c9c65 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.779808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7c508-583e-47e4-969d-b3a5229c9c65 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.780102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d7c508-583e-47e4-969d-b3a5229c9c65 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.780800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4ff8d-e2d9-4c02-b09f-a60d2d76d0c5 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c50873b7611e478a80eaec60cd31d6d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '6e2bd65a91f44b159eb320ce5d578a5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:10.781720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4ff8d-e2d9-4c02-b09f-a60d2d76d0c5 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:10.782410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4ff8d-e2d9-4c02-b09f-a60d2d76d0c5 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:10.782410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4ff8d-e2d9-4c02-b09f-a60d2d76d0c5 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] PATH_INFO: `/v3/policies/499bd1fe79fe4eaf97235f785a82332b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:10.783749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4ff8d-e2d9-4c02-b09f-a60d2d76d0c5 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorizing `identity:delete_policy(policy_id=499bd1fe79fe4eaf97235f785a82332b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:10.790807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4ff8d-e2d9-4c02-b09f-a60d2d76d0c5 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:10.825966 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2927/5870] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:10 2022] DELETE /identity/v3/policies/499bd1fe79fe4eaf97235f785a82332b => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:10.829684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4ff8d-e2d9-4c02-b09f-a60d2d76d0c5 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:10.998990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4ff8d-e2d9-4c02-b09f-a60d2d76d0c5 tempest-PoliciesTestJSON-1651449020 tempest-PoliciesTestJSON-1651449020-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:10.999193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-50d7c508-583e-47e4-969d-b3a5229c9c65 tempest-IdentityV3UsersTest-652707521 tempest-IdentityV3UsersTest-652707521-project] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:11.012276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:11.013265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:11.013675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:11.014055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] PATH_INFO: `/v3/users/902fa3a5a8e0459bb7bf822320c231a4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:11.016014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=902fa3a5a8e0459bb7bf822320c231a4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:11.018118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:11.041890 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2944/5871] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:20:10 2022] POST /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1/password => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:11.060355 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:UPDATE=1,keystone:INSERT=7,keystone:DELETE=6,keystone:SELECT=86 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:11.163990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '902fa3a5a8e0459bb7bf822320c231a4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:11.193555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '902fa3a5a8e0459bb7bf822320c231a4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:11.195040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '902fa3a5a8e0459bb7bf822320c231a4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:11.210748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '902fa3a5a8e0459bb7bf822320c231a4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:11.224882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '902fa3a5a8e0459bb7bf822320c231a4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:11.234843 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2928/5872] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:10 2022] DELETE /identity/v3/users/902fa3a5a8e0459bb7bf822320c231a4 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:11.239127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a245be-68a6-4c81-b971-e8e8b01597d1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:11.239417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a245be-68a6-4c81-b971-e8e8b01597d1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:11.239697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a245be-68a6-4c81-b971-e8e8b01597d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:11.301423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d3a245be-68a6-4c81-b971-e8e8b01597d1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:11.303732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d3a245be-68a6-4c81-b971-e8e8b01597d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:11.411149 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:UPDATE=2,keystone:DELETE=3,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:11.520087 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2945/5873] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:11.543267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:11.546736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:11.683450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb03a5d-0278-4dc0-ae99-7fa6d8f26ee7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:11.702360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae805a0-34c1-4820-8572-6c73c81e5173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:11.702994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae805a0-34c1-4820-8572-6c73c81e5173 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:11.703275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae805a0-34c1-4820-8572-6c73c81e5173 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:11.703545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae805a0-34c1-4820-8572-6c73c81e5173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:11.733500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae805a0-34c1-4820-8572-6c73c81e5173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:11.735026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae805a0-34c1-4820-8572-6c73c81e5173 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:11.769802 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2929/5874] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:12.047673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457b5a6-0532-48eb-9629-3cbb75b3785f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:12.051271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457b5a6-0532-48eb-9629-3cbb75b3785f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:12.051834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d457b5a6-0532-48eb-9629-3cbb75b3785f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:12.126303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d457b5a6-0532-48eb-9629-3cbb75b3785f None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:12.133200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d457b5a6-0532-48eb-9629-3cbb75b3785f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:12.142769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2946/5875] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:12 2022] POST /identity/v3/auth/tokens => generated 352 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:20:13.108043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae805a0-34c1-4820-8572-6c73c81e5173 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:13.109578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9ae805a0-34c1-4820-8572-6c73c81e5173 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:13.128751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae805a0-34c1-4820-8572-6c73c81e5173 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:13.148115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9ae2-3542-4565-a96f-3379a4271a25 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:13.149925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9ae2-3542-4565-a96f-3379a4271a25 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:13.150512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8def9ae2-3542-4565-a96f-3379a4271a25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:13.152073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:13.152731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:13.153012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:13.153286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] PATH_INFO: `/v3/projects/3ef5c1e5f44842779c6ca63aba4b3c35` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:13.155423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ef5c1e5f44842779c6ca63aba4b3c35)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:13.158019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:13.203615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8def9ae2-3542-4565-a96f-3379a4271a25 None None] MFA Rules not processed for user `9dc7412dc1a54c12b37f74232cc218c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:13.205427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8def9ae2-3542-4565-a96f-3379a4271a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:13.317945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2947/5876] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:13.324785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9ae2-3542-4565-a96f-3379a4271a25 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:13.333789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8def9ae2-3542-4565-a96f-3379a4271a25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:13.333969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ef5c1e5f44842779c6ca63aba4b3c35', 'request_id': 'req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.354555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ef5c1e5f44842779c6ca63aba4b3c35', 'request_id': 'req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.364944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ef5c1e5f44842779c6ca63aba4b3c35', 'request_id': 'req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.381926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] The token cache is being invalidate because project 3ef5c1e5f44842779c6ca63aba4b3c35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:13.382642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.383792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.392617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8def9ae2-3542-4565-a96f-3379a4271a25 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:13.401361 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2930/5877] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:13 2022] DELETE /identity/v3/projects/3ef5c1e5f44842779c6ca63aba4b3c35 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:13.403254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:13.405176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:13.458974 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:13.520752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:13.521637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:13.522345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:13.523365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] PATH_INFO: `/v3/users/9dc7412dc1a54c12b37f74232cc218c1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:13.527424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dc7412dc1a54c12b37f74232cc218c1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:13.531573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:13.578582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa897b45-ac5d-4baa-9b5a-18587b6a53d7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:13.583603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:13.584247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:13.584533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:13.584811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] PATH_INFO: `/v3/users/c50873b7611e478a80eaec60cd31d6d1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:13.587067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c50873b7611e478a80eaec60cd31d6d1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:13.589039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:13.675779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.697442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.698388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.703192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c50873b7611e478a80eaec60cd31d6d1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.718199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.725317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c50873b7611e478a80eaec60cd31d6d1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.726721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c50873b7611e478a80eaec60cd31d6d1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.728953 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:13.734116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c8625eb1-39aa-4e9b-b67f-086351df1a88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dc7412dc1a54c12b37f74232cc218c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.744096 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2948/5878] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:13 2022] DELETE /identity/v3/users/9dc7412dc1a54c12b37f74232cc218c1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:13.744435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c50873b7611e478a80eaec60cd31d6d1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.752202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa10f3-8962-48b2-9ee1-96a6488e229f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:13.752785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa10f3-8962-48b2-9ee1-96a6488e229f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:13.753251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa10f3-8962-48b2-9ee1-96a6488e229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:13.774990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c50873b7611e478a80eaec60cd31d6d1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:13.797004 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2931/5879] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:13 2022] DELETE /identity/v3/users/c50873b7611e478a80eaec60cd31d6d1 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:13.812540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f7aa10f3-8962-48b2-9ee1-96a6488e229f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:13.813846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7aa10f3-8962-48b2-9ee1-96a6488e229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:13.984704 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2949/5880] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:14.015791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:14.017828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:14.199576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31024779-9b5d-4d84-a67c-cdab2a2a7f92 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:14.219752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f86da07-3a16-464a-ae8e-9fcb81940aae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:14.220727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86da07-3a16-464a-ae8e-9fcb81940aae service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:14.221071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86da07-3a16-464a-ae8e-9fcb81940aae service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:14.221403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f86da07-3a16-464a-ae8e-9fcb81940aae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:14.241858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86da07-3a16-464a-ae8e-9fcb81940aae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:14.244091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f86da07-3a16-464a-ae8e-9fcb81940aae service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:14.259312 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2932/5881] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:14.501656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa10f3-8962-48b2-9ee1-96a6488e229f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:14.504531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7aa10f3-8962-48b2-9ee1-96a6488e229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:14.523746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa10f3-8962-48b2-9ee1-96a6488e229f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:14.529262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:14.529919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:14.531851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:14.532925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] PATH_INFO: `/v3/projects/6e2bd65a91f44b159eb320ce5d578a5d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:14.534434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e2bd65a91f44b159eb320ce5d578a5d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:14.537742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:14.632924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e2bd65a91f44b159eb320ce5d578a5d', 'request_id': 'req-6d413940-74c1-4039-bdea-693c7ca0b193'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:14.663822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e2bd65a91f44b159eb320ce5d578a5d', 'request_id': 'req-6d413940-74c1-4039-bdea-693c7ca0b193'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:14.685239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e2bd65a91f44b159eb320ce5d578a5d', 'request_id': 'req-6d413940-74c1-4039-bdea-693c7ca0b193'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:14.722857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] The token cache is being invalidate because project 6e2bd65a91f44b159eb320ce5d578a5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:14.723616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:14.728363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6d413940-74c1-4039-bdea-693c7ca0b193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:14.733991 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2950/5882] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:14 2022] DELETE /identity/v3/projects/6e2bd65a91f44b159eb320ce5d578a5d => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:14.739514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdbff5-7ce4-4ea4-8cea-0c19dcdc0a21 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:14.740100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdbff5-7ce4-4ea4-8cea-0c19dcdc0a21 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:14.740663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbdbff5-7ce4-4ea4-8cea-0c19dcdc0a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:14.848351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4bbdbff5-7ce4-4ea4-8cea-0c19dcdc0a21 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:14.849632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4bbdbff5-7ce4-4ea4-8cea-0c19dcdc0a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:14.923322 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:14.989865 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2933/5883] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:14.995263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befb464-3803-4066-b5b9-ed9e85453fad None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:14.995563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befb464-3803-4066-b5b9-ed9e85453fad None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:14.995850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befb464-3803-4066-b5b9-ed9e85453fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:15.030433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9befb464-3803-4066-b5b9-ed9e85453fad None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:15.031679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9befb464-3803-4066-b5b9-ed9e85453fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:15.047995 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2951/5884] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:15.049349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdbff5-7ce4-4ea4-8cea-0c19dcdc0a21 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:15.065621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbdbff5-7ce4-4ea4-8cea-0c19dcdc0a21 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:15.078402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb608e6-bc76-4baf-b8c6-6e561ff7a746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:15.079033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb608e6-bc76-4baf-b8c6-6e561ff7a746 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:15.079312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb608e6-bc76-4baf-b8c6-6e561ff7a746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:15.079595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb608e6-bc76-4baf-b8c6-6e561ff7a746 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:15.080254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb608e6-bc76-4baf-b8c6-6e561ff7a746 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:15.080561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb608e6-bc76-4baf-b8c6-6e561ff7a746 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:15.082282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb608e6-bc76-4baf-b8c6-6e561ff7a746 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:15.107554 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2934/5885] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:15.110514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befb464-3803-4066-b5b9-ed9e85453fad None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:15.123174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befb464-3803-4066-b5b9-ed9e85453fad None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:15.131452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81002f8-4e86-45c1-816c-8b3bbaec119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:15.132296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81002f8-4e86-45c1-816c-8b3bbaec119d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:15.132683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81002f8-4e86-45c1-816c-8b3bbaec119d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:15.133062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81002f8-4e86-45c1-816c-8b3bbaec119d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:15.134404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81002f8-4e86-45c1-816c-8b3bbaec119d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:15.136479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81002f8-4e86-45c1-816c-8b3bbaec119d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:15.184215 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2952/5886] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:15 2022] POST /identity/v3/projects => generated 369 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:15.188442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb608e6-bc76-4baf-b8c6-6e561ff7a746 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:15.201528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb608e6-bc76-4baf-b8c6-6e561ff7a746 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:15.341849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112836b3-115b-4041-9f14-e0ce5af3450f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:15.342524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112836b3-115b-4041-9f14-e0ce5af3450f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:15.342809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112836b3-115b-4041-9f14-e0ce5af3450f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:15.343085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112836b3-115b-4041-9f14-e0ce5af3450f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:15.343736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112836b3-115b-4041-9f14-e0ce5af3450f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:15.345664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112836b3-115b-4041-9f14-e0ce5af3450f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:15.406089 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2935/5887] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:15 2022] POST /identity/v3/users => generated 285 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:15.411971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81002f8-4e86-45c1-816c-8b3bbaec119d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:15.425415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81002f8-4e86-45c1-816c-8b3bbaec119d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:15.434773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46a64-95b2-4cc1-ae86-e0d11c55680a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:15.435759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46a64-95b2-4cc1-ae86-e0d11c55680a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:15.436242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46a64-95b2-4cc1-ae86-e0d11c55680a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:15.436710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb46a64-95b2-4cc1-ae86-e0d11c55680a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:15.437708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb46a64-95b2-4cc1-ae86-e0d11c55680a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:15.442720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb46a64-95b2-4cc1-ae86-e0d11c55680a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:15.470569 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2953/5888] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:20:15.474611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112836b3-115b-4041-9f14-e0ce5af3450f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:15.491890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112836b3-115b-4041-9f14-e0ce5af3450f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:15.507079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c5892d-28eb-428e-b24f-0b936fee65b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:15.507713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5892d-28eb-428e-b24f-0b936fee65b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:15.507995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5892d-28eb-428e-b24f-0b936fee65b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:15.508273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c5892d-28eb-428e-b24f-0b936fee65b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:15.508964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5892d-28eb-428e-b24f-0b936fee65b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:15.513492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c5892d-28eb-428e-b24f-0b936fee65b1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:15.545544 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2936/5889] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:15.549563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46a64-95b2-4cc1-ae86-e0d11c55680a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:15.566285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb46a64-95b2-4cc1-ae86-e0d11c55680a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:15.590170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3a060-56f7-4921-af88-06d48a730c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:15.591143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3a060-56f7-4921-af88-06d48a730c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:15.591585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3a060-56f7-4921-af88-06d48a730c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:15.592218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca3a060-56f7-4921-af88-06d48a730c19 admin admin] PATH_INFO: `/v3/projects/5b3d017745684f8c99790939517ad1d1/users/daa5aa15038e413a910da0f1ca4076b7/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:15.624425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3a060-56f7-4921-af88-06d48a730c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b3d017745684f8c99790939517ad1d1, user_id=daa5aa15038e413a910da0f1ca4076b7, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:15.646155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca3a060-56f7-4921-af88-06d48a730c19 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:15.666654 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2954/5890] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:15 2022] PUT /identity/v3/projects/5b3d017745684f8c99790939517ad1d1/users/daa5aa15038e413a910da0f1ca4076b7/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:15.676707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985e08-99f9-44e7-9398-c4bbdfa7651b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:15.677009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985e08-99f9-44e7-9398-c4bbdfa7651b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:15.677524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8985e08-99f9-44e7-9398-c4bbdfa7651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:15.720243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f8985e08-99f9-44e7-9398-c4bbdfa7651b None None] MFA Rules not processed for user `daa5aa15038e413a910da0f1ca4076b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:15.721726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f8985e08-99f9-44e7-9398-c4bbdfa7651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:15.835922 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2937/5891] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:15 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:15.837038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3a060-56f7-4921-af88-06d48a730c19 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:15.860029 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:15.941662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca3a060-56f7-4921-af88-06d48a730c19 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:15.949241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e23baf-0767-47d1-b01f-fac32696d937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:15.950049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e23baf-0767-47d1-b01f-fac32696d937 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:15.950538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e23baf-0767-47d1-b01f-fac32696d937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:15.950889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e23baf-0767-47d1-b01f-fac32696d937 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:15.951655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e23baf-0767-47d1-b01f-fac32696d937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:15.954206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e23baf-0767-47d1-b01f-fac32696d937 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:15.994069 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2955/5892] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:15 2022] POST /identity/v3/projects => generated 369 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:15.997791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8985e08-99f9-44e7-9398-c4bbdfa7651b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:16.022361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8985e08-99f9-44e7-9398-c4bbdfa7651b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:16.097511 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:16.164459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca12f3-6650-41ed-a4d1-7835a0f51bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:16.165829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca12f3-6650-41ed-a4d1-7835a0f51bdf admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:16.166110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca12f3-6650-41ed-a4d1-7835a0f51bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:16.166382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca12f3-6650-41ed-a4d1-7835a0f51bdf admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:16.167020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca12f3-6650-41ed-a4d1-7835a0f51bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:16.173678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca12f3-6650-41ed-a4d1-7835a0f51bdf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:16.228303 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2938/5893] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:15 2022] POST /identity/v3/users => generated 291 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:16.229216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e23baf-0767-47d1-b01f-fac32696d937 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:16.272483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e23baf-0767-47d1-b01f-fac32696d937 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:16.293066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825502b7-4749-4d57-8222-7db8486169bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:16.293897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825502b7-4749-4d57-8222-7db8486169bf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:16.298037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825502b7-4749-4d57-8222-7db8486169bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:16.298857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825502b7-4749-4d57-8222-7db8486169bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:16.300046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825502b7-4749-4d57-8222-7db8486169bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:16.304782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825502b7-4749-4d57-8222-7db8486169bf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:16.369098 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2956/5894] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:16.370535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca12f3-6650-41ed-a4d1-7835a0f51bdf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:16.383376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca12f3-6650-41ed-a4d1-7835a0f51bdf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:16.390267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982eab2e-22bc-496e-a999-d1944c2b9c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:16.391148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eab2e-22bc-496e-a999-d1944c2b9c2a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:16.391527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eab2e-22bc-496e-a999-d1944c2b9c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:16.391911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982eab2e-22bc-496e-a999-d1944c2b9c2a admin admin] PATH_INFO: `/v3/projects/4d9cbf49012e482fa1e8856b9d683714/users/e67fe89511c643ada3c0b32ef7c77377/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:16.454174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982eab2e-22bc-496e-a999-d1944c2b9c2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9cbf49012e482fa1e8856b9d683714, user_id=e67fe89511c643ada3c0b32ef7c77377, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:16.475386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982eab2e-22bc-496e-a999-d1944c2b9c2a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:16.523181 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2939/5895] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:16 2022] PUT /identity/v3/projects/4d9cbf49012e482fa1e8856b9d683714/users/e67fe89511c643ada3c0b32ef7c77377/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:16.524533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825502b7-4749-4d57-8222-7db8486169bf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:16.544750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825502b7-4749-4d57-8222-7db8486169bf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:16.574058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982eab2e-22bc-496e-a999-d1944c2b9c2a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:16.575600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-982eab2e-22bc-496e-a999-d1944c2b9c2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:16.784718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb1ef2-ca5b-4a86-8bef-eed33012ae26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:16.791504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb1ef2-ca5b-4a86-8bef-eed33012ae26 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:16.791847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb1ef2-ca5b-4a86-8bef-eed33012ae26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:16.792130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cb1ef2-ca5b-4a86-8bef-eed33012ae26 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:16.792811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb1ef2-ca5b-4a86-8bef-eed33012ae26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:16.800377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cb1ef2-ca5b-4a86-8bef-eed33012ae26 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:16.807467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982eab2e-22bc-496e-a999-d1944c2b9c2a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:16.837942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:16.838839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:16.839230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:16.839693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] PATH_INFO: `/v3/projects/222a6b4a58294f44831765e3290a2933` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:16.840861 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2957/5896] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:16 2022] GET /identity/v3/roles => generated 1420 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:20:16.844651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=222a6b4a58294f44831765e3290a2933)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:16.844983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb1ef2-ca5b-4a86-8bef-eed33012ae26 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:16.850813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:16.885120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cb1ef2-ca5b-4a86-8bef-eed33012ae26 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:16.909721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f4eed-1bb4-4b88-8252-e0ba6d933a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:16.910514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f4eed-1bb4-4b88-8252-e0ba6d933a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:16.910745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f4eed-1bb4-4b88-8252-e0ba6d933a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:16.912384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f4eed-1bb4-4b88-8252-e0ba6d933a0b admin admin] PATH_INFO: `/v3/projects/4d9cbf49012e482fa1e8856b9d683714/users/e67fe89511c643ada3c0b32ef7c77377/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:16.928198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f4eed-1bb4-4b88-8252-e0ba6d933a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d9cbf49012e482fa1e8856b9d683714, user_id=e67fe89511c643ada3c0b32ef7c77377, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:16.941324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f4eed-1bb4-4b88-8252-e0ba6d933a0b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:16.985062 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2958/5897] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:16 2022] PUT /identity/v3/projects/4d9cbf49012e482fa1e8856b9d683714/users/e67fe89511c643ada3c0b32ef7c77377/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:17.000134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9372f5-4235-4517-91b4-8c65621279b9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.001089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9372f5-4235-4517-91b4-8c65621279b9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.002181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9372f5-4235-4517-91b4-8c65621279b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.018756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '222a6b4a58294f44831765e3290a2933', 'request_id': 'req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:17.048121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '222a6b4a58294f44831765e3290a2933', 'request_id': 'req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:17.071868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '222a6b4a58294f44831765e3290a2933', 'request_id': 'req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:17.073369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6b9372f5-4235-4517-91b4-8c65621279b9 None None] MFA Rules not processed for user `e67fe89511c643ada3c0b32ef7c77377`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:17.074874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6b9372f5-4235-4517-91b4-8c65621279b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:17.094916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] The token cache is being invalidate because project 222a6b4a58294f44831765e3290a2933 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:17.095279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:17.101418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea30e77d-ee69-4bcb-aff8-72e4f3d1cb0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:17.104041 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2940/5898] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:16 2022] DELETE /identity/v3/projects/222a6b4a58294f44831765e3290a2933 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:17.116334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2705d-95fc-47ce-9a65-7cfd9c3fdf2c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.116930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2705d-95fc-47ce-9a65-7cfd9c3fdf2c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.117452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a2705d-95fc-47ce-9a65-7cfd9c3fdf2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.155361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-11a2705d-95fc-47ce-9a65-7cfd9c3fdf2c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:17.158139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11a2705d-95fc-47ce-9a65-7cfd9c3fdf2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:17.230326 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:17.241031 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:17.259478 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2959/5899] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:16 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:17.263893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9372f5-4235-4517-91b4-8c65621279b9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:17.282071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9372f5-4235-4517-91b4-8c65621279b9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:17.289388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939cde-c330-477d-a37c-7645857ea476 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:17.290575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939cde-c330-477d-a37c-7645857ea476 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.290863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939cde-c330-477d-a37c-7645857ea476 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.291146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3939cde-c330-477d-a37c-7645857ea476 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.291779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3939cde-c330-477d-a37c-7645857ea476 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:17.293694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3939cde-c330-477d-a37c-7645857ea476 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:17.295501 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2941/5900] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:20:17.302630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663cb65-f7a0-4489-a7e1-a32f011518bd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.303036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663cb65-f7a0-4489-a7e1-a32f011518bd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.303477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a663cb65-f7a0-4489-a7e1-a32f011518bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.329708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a663cb65-f7a0-4489-a7e1-a32f011518bd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:17.331312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a663cb65-f7a0-4489-a7e1-a32f011518bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:17.352203 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2942/5901] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:17.357150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663cb65-f7a0-4489-a7e1-a32f011518bd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:17.360679 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2960/5902] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:17 2022] POST /identity/v3/projects => generated 359 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:17.365968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939cde-c330-477d-a37c-7645857ea476 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:17.393372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a663cb65-f7a0-4489-a7e1-a32f011518bd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:17.500167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95410ca2-7d2b-4a42-b1c8-0d4e0b6d8415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:17.501209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95410ca2-7d2b-4a42-b1c8-0d4e0b6d8415 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.502636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95410ca2-7d2b-4a42-b1c8-0d4e0b6d8415 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.502852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95410ca2-7d2b-4a42-b1c8-0d4e0b6d8415 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.504429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95410ca2-7d2b-4a42-b1c8-0d4e0b6d8415 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:17.504997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95410ca2-7d2b-4a42-b1c8-0d4e0b6d8415 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:17.507630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95410ca2-7d2b-4a42-b1c8-0d4e0b6d8415 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:17.517847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3939cde-c330-477d-a37c-7645857ea476 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:17.524452 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2943/5903] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:17.528530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95410ca2-7d2b-4a42-b1c8-0d4e0b6d8415 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:17.532763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a697f-7b7b-4409-a0db-4703714f9e58 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:17.533771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a697f-7b7b-4409-a0db-4703714f9e58 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.534064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a697f-7b7b-4409-a0db-4703714f9e58 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.534350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15a697f-7b7b-4409-a0db-4703714f9e58 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.535015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a697f-7b7b-4409-a0db-4703714f9e58 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:17.537122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15a697f-7b7b-4409-a0db-4703714f9e58 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:17.545241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95410ca2-7d2b-4a42-b1c8-0d4e0b6d8415 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:17.555040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4d778-8be8-48da-857f-27349a0bd5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:17.556691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4d778-8be8-48da-857f-27349a0bd5a1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.557253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4d778-8be8-48da-857f-27349a0bd5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.557764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b4d778-8be8-48da-857f-27349a0bd5a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.558631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4d778-8be8-48da-857f-27349a0bd5a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:17.560960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b4d778-8be8-48da-857f-27349a0bd5a1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:17.599967 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2961/5904] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:17 2022] POST /identity/v3/users => generated 416 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:17.604848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a697f-7b7b-4409-a0db-4703714f9e58 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:17.605902 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2944/5905] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:17 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:17.610678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4d778-8be8-48da-857f-27349a0bd5a1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:17.626317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15a697f-7b7b-4409-a0db-4703714f9e58 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:17.701308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b4d778-8be8-48da-857f-27349a0bd5a1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:17.708979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e09b2-67e8-41db-81cc-b7d647fd916f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:17.709972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e09b2-67e8-41db-81cc-b7d647fd916f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.710544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e09b2-67e8-41db-81cc-b7d647fd916f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.711035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e09b2-67e8-41db-81cc-b7d647fd916f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.711908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e09b2-67e8-41db-81cc-b7d647fd916f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:17.715126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e09b2-67e8-41db-81cc-b7d647fd916f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:17.751528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83bfc4-e6ae-49a0-a30c-78ab11d51c3f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:17.753233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83bfc4-e6ae-49a0-a30c-78ab11d51c3f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.753546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83bfc4-e6ae-49a0-a30c-78ab11d51c3f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.754857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83bfc4-e6ae-49a0-a30c-78ab11d51c3f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/users/f8ff97ee2d3a46539e9574001de9a1b8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.768469 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2945/5906] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:17 2022] POST /identity/v3/users => generated 289 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:17.769889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e09b2-67e8-41db-81cc-b7d647fd916f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:17.792703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e09b2-67e8-41db-81cc-b7d647fd916f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:17.793472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83bfc4-e6ae-49a0-a30c-78ab11d51c3f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:get_user(user_id=f8ff97ee2d3a46539e9574001de9a1b8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:17.796434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83bfc4-e6ae-49a0-a30c-78ab11d51c3f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:17.799457 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2962/5907] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:20:17 2022] GET /identity/v3/users/f8ff97ee2d3a46539e9574001de9a1b8 => generated 416 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:17.803516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83bfc4-e6ae-49a0-a30c-78ab11d51c3f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:17.815355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc950a-a53e-4d3c-b1aa-0695a3df8802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:17.815981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc950a-a53e-4d3c-b1aa-0695a3df8802 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.816258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc950a-a53e-4d3c-b1aa-0695a3df8802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.816524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fc950a-a53e-4d3c-b1aa-0695a3df8802 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.822531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc950a-a53e-4d3c-b1aa-0695a3df8802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:17.826324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fc950a-a53e-4d3c-b1aa-0695a3df8802 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:17.834442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83bfc4-e6ae-49a0-a30c-78ab11d51c3f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:17.846566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:17.847226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.854724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.855044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/users/f8ff97ee2d3a46539e9574001de9a1b8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.858660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f8ff97ee2d3a46539e9574001de9a1b8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:17.863086 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2946/5908] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:17.863272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:17.864171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc950a-a53e-4d3c-b1aa-0695a3df8802 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:17.896398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fc950a-a53e-4d3c-b1aa-0695a3df8802 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:17.924921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ba6c-f275-49bc-a416-8d5d637b5e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:17.925593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ba6c-f275-49bc-a416-8d5d637b5e45 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:17.925869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ba6c-f275-49bc-a416-8d5d637b5e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:17.931566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715ba6c-f275-49bc-a416-8d5d637b5e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:17.939025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ba6c-f275-49bc-a416-8d5d637b5e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:17.946688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c715ba6c-f275-49bc-a416-8d5d637b5e45 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:17.998262 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2947/5909] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:17 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:18.001552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ba6c-f275-49bc-a416-8d5d637b5e45 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:18.029777 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:18.047723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8ff97ee2d3a46539e9574001de9a1b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.051581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715ba6c-f275-49bc-a416-8d5d637b5e45 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:18.062935 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:18.066389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47a5c9-bad4-43e9-8e4d-e6225cd08385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:18.069144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47a5c9-bad4-43e9-8e4d-e6225cd08385 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:18.069886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47a5c9-bad4-43e9-8e4d-e6225cd08385 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:18.070415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47a5c9-bad4-43e9-8e4d-e6225cd08385 admin admin] PATH_INFO: `/v3/projects/4dbaa049d85747fa8c8ed3d49cf90133/users/eb31f1a169c14f9d89b6425eee97a133/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:18.083380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8ff97ee2d3a46539e9574001de9a1b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.084895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8ff97ee2d3a46539e9574001de9a1b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.098870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8ff97ee2d3a46539e9574001de9a1b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.108269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47a5c9-bad4-43e9-8e4d-e6225cd08385 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dbaa049d85747fa8c8ed3d49cf90133, user_id=eb31f1a169c14f9d89b6425eee97a133, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:18.112189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47a5c9-bad4-43e9-8e4d-e6225cd08385 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:18.116386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8ff97ee2d3a46539e9574001de9a1b8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.140442 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2963/5910] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:17 2022] DELETE /identity/v3/users/f8ff97ee2d3a46539e9574001de9a1b8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:18.142787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:18.147042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:18.170637 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2948/5911] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:18 2022] PUT /identity/v3/projects/4dbaa049d85747fa8c8ed3d49cf90133/users/eb31f1a169c14f9d89b6425eee97a133/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:18.172636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fbe7-24ae-43ed-b539-32dba6bca60b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:18.174557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fbe7-24ae-43ed-b539-32dba6bca60b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:18.174557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd7fbe7-24ae-43ed-b539-32dba6bca60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:18.292321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1fd7fbe7-24ae-43ed-b539-32dba6bca60b None None] MFA Rules not processed for user `eb31f1a169c14f9d89b6425eee97a133`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:18.293645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1fd7fbe7-24ae-43ed-b539-32dba6bca60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:18.357466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef3227a-8f47-45ff-ac3d-f142dfedbe77 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:18.374066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:18.375145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:18.375688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:18.376200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/6e6487c890084ee58033b069e64e2d06` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:18.377703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6e6487c890084ee58033b069e64e2d06)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:18.379897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:18.396603 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2949/5912] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:18.397575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7fbe7-24ae-43ed-b539-32dba6bca60b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:18.399048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1fd7fbe7-24ae-43ed-b539-32dba6bca60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:18.481286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e6487c890084ee58033b069e64e2d06', 'request_id': 'req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.497269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e6487c890084ee58033b069e64e2d06', 'request_id': 'req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.505667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e6487c890084ee58033b069e64e2d06', 'request_id': 'req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.530218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project 6e6487c890084ee58033b069e64e2d06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:18.530686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.531493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:18.535600 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2964/5913] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:18 2022] DELETE /identity/v3/projects/6e6487c890084ee58033b069e64e2d06 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:18.540775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:18.543991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:18.569962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd7fbe7-24ae-43ed-b539-32dba6bca60b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:18.672150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57eb30a-9d6d-4eb2-a9ba-b5bc305fd667 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:18.697696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058c9d-9742-424b-9100-a4f8d72b624d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:18.698309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058c9d-9742-424b-9100-a4f8d72b624d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:18.698604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058c9d-9742-424b-9100-a4f8d72b624d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:18.698885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f058c9d-9742-424b-9100-a4f8d72b624d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:18.699978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5b78-d20a-496d-ab97-3364f92da117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:18.700768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5b78-d20a-496d-ab97-3364f92da117 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:18.701188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5b78-d20a-496d-ab97-3364f92da117 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:18.701703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c5b78-d20a-496d-ab97-3364f92da117 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:18.702781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c5b78-d20a-496d-ab97-3364f92da117 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:18.704957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c5b78-d20a-496d-ab97-3364f92da117 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:18.708355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f058c9d-9742-424b-9100-a4f8d72b624d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:18.712139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f058c9d-9742-424b-9100-a4f8d72b624d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:18.728832 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:18.751976 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2950/5914] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:18 2022] POST /identity/v3/projects => generated 377 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:18.754360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5b78-d20a-496d-ab97-3364f92da117 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:18.762402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d88c5b78-d20a-496d-ab97-3364f92da117 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:18.770232 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:18.781513 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2965/5915] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:18 2022] POST /identity/v3/projects => generated 348 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:18.786451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058c9d-9742-424b-9100-a4f8d72b624d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:18.919845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c5b78-d20a-496d-ab97-3364f92da117 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:18.938210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f058c9d-9742-424b-9100-a4f8d72b624d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:18.951367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0e76-10f7-40bf-bced-1d4f62ff0a37 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:18.952479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0e76-10f7-40bf-bced-1d4f62ff0a37 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:18.952766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0e76-10f7-40bf-bced-1d4f62ff0a37 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:18.955353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618f0e76-10f7-40bf-bced-1d4f62ff0a37 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:18.956068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0e76-10f7-40bf-bced-1d4f62ff0a37 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Adding query filter params (is_domain=True) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:18.956385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0e76-10f7-40bf-bced-1d4f62ff0a37 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:18.963045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618f0e76-10f7-40bf-bced-1d4f62ff0a37 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:19.007135 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2966/5916] 10.222.0.25 () {58 vars in 1160 bytes} [Mon Oct 24 09:20:18 2022] GET /identity/v3/projects?is_domain=True => generated 1020 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:19.011913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0e76-10f7-40bf-bced-1d4f62ff0a37 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:19.033643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618f0e76-10f7-40bf-bced-1d4f62ff0a37 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:19.041782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd734996-d787-4e1e-b9cf-98df523c5b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:19.043141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd734996-d787-4e1e-b9cf-98df523c5b78 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:19.043141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd734996-d787-4e1e-b9cf-98df523c5b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:19.043141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd734996-d787-4e1e-b9cf-98df523c5b78 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:19.043623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd734996-d787-4e1e-b9cf-98df523c5b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:19.045540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd734996-d787-4e1e-b9cf-98df523c5b78 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:19.047704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6798f94-19fb-48ad-b377-fccc5950f4b4 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:19.048229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798f94-19fb-48ad-b377-fccc5950f4b4 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:19.048518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798f94-19fb-48ad-b377-fccc5950f4b4 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:19.048796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6798f94-19fb-48ad-b377-fccc5950f4b4 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:19.049453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6798f94-19fb-48ad-b377-fccc5950f4b4 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:19.051527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6798f94-19fb-48ad-b377-fccc5950f4b4 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:19.105373 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2967/5917] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 09:20:19 2022] GET /identity/v3/domains => generated 829 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:19.109739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6798f94-19fb-48ad-b377-fccc5950f4b4 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:19.119629 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2951/5918] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:18 2022] POST /identity/v3/users => generated 289 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:19.123261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd734996-d787-4e1e-b9cf-98df523c5b78 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:19.135679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6798f94-19fb-48ad-b377-fccc5950f4b4 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:19.147852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:19.149739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd734996-d787-4e1e-b9cf-98df523c5b78 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:19.150675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:19.150976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:19.151261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/d8e726d7e5f94e2096ee8be177d952a3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:19.156508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:update_project(project_id=d8e726d7e5f94e2096ee8be177d952a3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:19.157607 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:19.157607 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:19.157607 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:19.158622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:19.159859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3735-199a-4c20-90cb-87847c503fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:19.160505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3735-199a-4c20-90cb-87847c503fa1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:19.160782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3735-199a-4c20-90cb-87847c503fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:19.161065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2a3735-199a-4c20-90cb-87847c503fa1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:19.161829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a3735-199a-4c20-90cb-87847c503fa1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:19.163468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2a3735-199a-4c20-90cb-87847c503fa1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:19.193964 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2952/5919] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:20:19.194498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.195280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.198108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3735-199a-4c20-90cb-87847c503fa1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:19.200013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1e2a3735-199a-4c20-90cb-87847c503fa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:19.234660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2a3735-199a-4c20-90cb-87847c503fa1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:19.256709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.257431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.264232 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2968/5920] 10.222.0.25 () {60 vars in 1252 bytes} [Mon Oct 24 09:20:19 2022] PATCH /identity/v3/projects/d8e726d7e5f94e2096ee8be177d952a3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:20:19.268115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:19.270131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:19.468330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c352a99-ccbb-4703-b4ff-87461b2588c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:19.470424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c352a99-ccbb-4703-b4ff-87461b2588c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:19.476135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c352a99-ccbb-4703-b4ff-87461b2588c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:19.478055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c352a99-ccbb-4703-b4ff-87461b2588c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:19.480000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c352a99-ccbb-4703-b4ff-87461b2588c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:19.482888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c352a99-ccbb-4703-b4ff-87461b2588c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:19.514123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ef7085-bd03-4841-b585-be2662659dd7 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:19.523134 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2953/5921] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:19 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:20:19.524368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c352a99-ccbb-4703-b4ff-87461b2588c2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:19.529929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4c352a99-ccbb-4703-b4ff-87461b2588c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:19.533642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:19.534321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:19.534612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:19.534888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/d8e726d7e5f94e2096ee8be177d952a3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:19.554573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d8e726d7e5f94e2096ee8be177d952a3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:19.557032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c352a99-ccbb-4703-b4ff-87461b2588c2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:19.559649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:19.567321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bacc97f-65a5-4439-a142-9a6f85341c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:19.569839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacc97f-65a5-4439-a142-9a6f85341c13 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:19.585060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacc97f-65a5-4439-a142-9a6f85341c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:19.586747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bacc97f-65a5-4439-a142-9a6f85341c13 admin admin] PATH_INFO: `/v3/projects/cd3f8006086e4f09a0db2c7c9b7bb0e8/users/df6532c3efee46bfb4c2613057c4abc2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:19.653479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacc97f-65a5-4439-a142-9a6f85341c13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd3f8006086e4f09a0db2c7c9b7bb0e8, user_id=df6532c3efee46bfb4c2613057c4abc2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:19.665212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bacc97f-65a5-4439-a142-9a6f85341c13 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:19.668992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.683154 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:19.686932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.695383 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2954/5922] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:19 2022] PUT /identity/v3/projects/cd3f8006086e4f09a0db2c7c9b7bb0e8/users/df6532c3efee46bfb4c2613057c4abc2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:19.714612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da401-a5c4-4920-9422-ff9da9a444be None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:19.715435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da401-a5c4-4920-9422-ff9da9a444be None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:19.715554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8da401-a5c4-4920-9422-ff9da9a444be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:19.740733 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=1,keystone:SELECT=98,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:19.839079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ac8da401-a5c4-4920-9422-ff9da9a444be None None] MFA Rules not processed for user `df6532c3efee46bfb4c2613057c4abc2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:19.840779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ac8da401-a5c4-4920-9422-ff9da9a444be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:19.876013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3', 'request_id': 'req-144f39c8-f396-494c-bbad-642f1c3091be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.906101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3', 'request_id': 'req-144f39c8-f396-494c-bbad-642f1c3091be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.926324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3', 'request_id': 'req-144f39c8-f396-494c-bbad-642f1c3091be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.971142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project d8e726d7e5f94e2096ee8be177d952a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:19.971723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:19.973923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:20.010860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3', 'request_id': 'req-144f39c8-f396-494c-bbad-642f1c3091be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:20.011507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3', 'request_id': 'req-144f39c8-f396-494c-bbad-642f1c3091be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:20.012256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd8e726d7e5f94e2096ee8be177d952a3', 'request_id': 'req-144f39c8-f396-494c-bbad-642f1c3091be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:20.044719 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2969/5923] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:19 2022] DELETE /identity/v3/projects/d8e726d7e5f94e2096ee8be177d952a3 => generated 0 bytes in 777 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:20.052267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:20.055678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:20.077450 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2955/5924] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:20.099676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da401-a5c4-4920-9422-ff9da9a444be None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:20.102796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ac8da401-a5c4-4920-9422-ff9da9a444be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:20.237117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144f39c8-f396-494c-bbad-642f1c3091be tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:20.245520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530169-68ff-4029-b1de-c2e23b4ee15c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:20.246611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530169-68ff-4029-b1de-c2e23b4ee15c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:20.247117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530169-68ff-4029-b1de-c2e23b4ee15c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:20.247686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8530169-68ff-4029-b1de-c2e23b4ee15c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:20.248641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8530169-68ff-4029-b1de-c2e23b4ee15c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:20.265162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8530169-68ff-4029-b1de-c2e23b4ee15c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:20.284188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8da401-a5c4-4920-9422-ff9da9a444be None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:20.292302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4d6bf-a277-4785-9459-e8f7d8d91a40 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:20.293028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4d6bf-a277-4785-9459-e8f7d8d91a40 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:20.293711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4d6bf-a277-4785-9459-e8f7d8d91a40 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:20.293711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef4d6bf-a277-4785-9459-e8f7d8d91a40 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:20.300229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1ef4d6bf-a277-4785-9459-e8f7d8d91a40 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:20.338591 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2970/5925] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:20 2022] POST /identity/v3/projects => generated 360 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:20.343017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530169-68ff-4029-b1de-c2e23b4ee15c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:20.397827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4d6bf-a277-4785-9459-e8f7d8d91a40 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:20.400870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef4d6bf-a277-4785-9459-e8f7d8d91a40 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:20.429503 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2956/5926] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:20:20.454978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8530169-68ff-4029-b1de-c2e23b4ee15c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:20.466655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99a84b9-b9a0-453d-8436-e467327678ba tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:20.467326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a84b9-b9a0-453d-8436-e467327678ba tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:20.467748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a84b9-b9a0-453d-8436-e467327678ba tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:20.468048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a84b9-b9a0-453d-8436-e467327678ba tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/0cb94ec9dfed403c8057ea1c11432285` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:20.470411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a84b9-b9a0-453d-8436-e467327678ba tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:get_project(project_id=0cb94ec9dfed403c8057ea1c11432285)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:20.478269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99a84b9-b9a0-453d-8436-e467327678ba tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:20.487775 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2971/5927] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:20 2022] GET /identity/v3/projects/0cb94ec9dfed403c8057ea1c11432285 => generated 360 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:20.488351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4d6bf-a277-4785-9459-e8f7d8d91a40 service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:20.507511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef4d6bf-a277-4785-9459-e8f7d8d91a40 service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:20.520260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:20.521077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:20.521542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:20.521826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/0cb94ec9dfed403c8057ea1c11432285` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:20.525739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0cb94ec9dfed403c8057ea1c11432285)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:20.528027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:20.679829 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:20.698729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cb94ec9dfed403c8057ea1c11432285', 'request_id': 'req-3c7c0072-d5a9-41af-b6fb-2ce064185b72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:20.712236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cb94ec9dfed403c8057ea1c11432285', 'request_id': 'req-3c7c0072-d5a9-41af-b6fb-2ce064185b72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:20.740956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cb94ec9dfed403c8057ea1c11432285', 'request_id': 'req-3c7c0072-d5a9-41af-b6fb-2ce064185b72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:20.769335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09170ca-cc23-4ff1-8ce2-6a829f53bcb6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:20.769605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09170ca-cc23-4ff1-8ce2-6a829f53bcb6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:20.769817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09170ca-cc23-4ff1-8ce2-6a829f53bcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:20.779188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project 0cb94ec9dfed403c8057ea1c11432285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:20.782245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:20.783758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:20.790738 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2957/5928] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:20 2022] DELETE /identity/v3/projects/0cb94ec9dfed403c8057ea1c11432285 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:20.797417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:20.802258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:20.827340 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:20.838940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d09170ca-cc23-4ff1-8ce2-6a829f53bcb6 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:20.843592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d09170ca-cc23-4ff1-8ce2-6a829f53bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:20.896774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c0072-d5a9-41af-b6fb-2ce064185b72 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:20.903963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfd7f9-78d8-4be9-a4b5-84e901861a20 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:20.905155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfd7f9-78d8-4be9-a4b5-84e901861a20 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:20.905697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfd7f9-78d8-4be9-a4b5-84e901861a20 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:20.906191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dfd7f9-78d8-4be9-a4b5-84e901861a20 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:20.907821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfd7f9-78d8-4be9-a4b5-84e901861a20 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:20.911080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dfd7f9-78d8-4be9-a4b5-84e901861a20 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:20.960768 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2958/5929] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:20 2022] POST /identity/v3/projects => generated 359 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:20.964997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfd7f9-78d8-4be9-a4b5-84e901861a20 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:20.971903 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2972/5930] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:20:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:20:21.046835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09170ca-cc23-4ff1-8ce2-6a829f53bcb6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:21.048331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d09170ca-cc23-4ff1-8ce2-6a829f53bcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:21.107701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dfd7f9-78d8-4be9-a4b5-84e901861a20 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:21.123069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152ff58-a961-46ef-80d3-a79543bb804f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:21.125193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152ff58-a961-46ef-80d3-a79543bb804f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:21.125506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152ff58-a961-46ef-80d3-a79543bb804f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:21.128024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152ff58-a961-46ef-80d3-a79543bb804f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/240455575f4d4ab0913db761dec66c20` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:21.132608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152ff58-a961-46ef-80d3-a79543bb804f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:get_project(project_id=240455575f4d4ab0913db761dec66c20)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:21.139814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152ff58-a961-46ef-80d3-a79543bb804f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:21.141493 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2959/5931] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:20 2022] GET /identity/v3/projects/240455575f4d4ab0913db761dec66c20 => generated 359 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:21.155452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152ff58-a961-46ef-80d3-a79543bb804f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:21.195517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152ff58-a961-46ef-80d3-a79543bb804f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:21.228247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:21.228898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:21.239399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:21.239399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/240455575f4d4ab0913db761dec66c20` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:21.241748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=240455575f4d4ab0913db761dec66c20)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:21.245018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:21.269127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09170ca-cc23-4ff1-8ce2-6a829f53bcb6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:21.366955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '240455575f4d4ab0913db761dec66c20', 'request_id': 'req-06494eec-9383-4401-bfa6-3afe1715ba7c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:21.368224 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:21.379302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '240455575f4d4ab0913db761dec66c20', 'request_id': 'req-06494eec-9383-4401-bfa6-3afe1715ba7c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:21.398008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '240455575f4d4ab0913db761dec66c20', 'request_id': 'req-06494eec-9383-4401-bfa6-3afe1715ba7c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:21.418459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project 240455575f4d4ab0913db761dec66c20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:21.418766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:21.421367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:21.422098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:21.424106 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2960/5932] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:21 2022] DELETE /identity/v3/projects/240455575f4d4ab0913db761dec66c20 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:21.427965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:21.428337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:21.428611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:21.429062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:21.432117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:21.438239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:21.555831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06494eec-9383-4401-bfa6-3afe1715ba7c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:21.557493 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:21.562109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:21.563856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:21.564268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec118a4-ee10-4cd4-8de7-4d4dcc3f059f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:21.565586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec118a4-ee10-4cd4-8de7-4d4dcc3f059f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:21.566033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec118a4-ee10-4cd4-8de7-4d4dcc3f059f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:21.566493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec118a4-ee10-4cd4-8de7-4d4dcc3f059f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:21.567297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec118a4-ee10-4cd4-8de7-4d4dcc3f059f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:21.569485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec118a4-ee10-4cd4-8de7-4d4dcc3f059f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:21.593636 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2973/5933] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:20:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 547 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:20:21.648062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:21.650742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:21.654240 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2961/5934] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:20:21 2022] POST /identity/v3/projects => generated 347 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:21.655228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec118a4-ee10-4cd4-8de7-4d4dcc3f059f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:21.828712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a8ed2e-f2c4-42a3-90b9-4d8428755136 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:21.833623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec118a4-ee10-4cd4-8de7-4d4dcc3f059f tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:21.847201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd4fcd-dbf6-4df3-8799-bc6ac6ab135b tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:21.847863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd4fcd-dbf6-4df3-8799-bc6ac6ab135b tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:21.848145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd4fcd-dbf6-4df3-8799-bc6ac6ab135b tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:21.848422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd4fcd-dbf6-4df3-8799-bc6ac6ab135b tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/d443acfc03394e45bd521ce3f2e6d978` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:21.850151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd4fcd-dbf6-4df3-8799-bc6ac6ab135b tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:get_project(project_id=d443acfc03394e45bd521ce3f2e6d978)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:21.853308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd4fcd-dbf6-4df3-8799-bc6ac6ab135b tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:21.860758 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2962/5935] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:21 2022] GET /identity/v3/projects/d443acfc03394e45bd521ce3f2e6d978 => generated 347 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:21.866847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd4fcd-dbf6-4df3-8799-bc6ac6ab135b tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:21.891670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd4fcd-dbf6-4df3-8799-bc6ac6ab135b tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:21.918318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:21.918318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:21.918318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:21.918626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/d443acfc03394e45bd521ce3f2e6d978` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:21.923225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d443acfc03394e45bd521ce3f2e6d978)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:21.933368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:21.940112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:21.940869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:21.941260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:21.941674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:21.943678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:22.081367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd443acfc03394e45bd521ce3f2e6d978', 'request_id': 'req-66b9f7e8-a034-451d-abab-a2770061b94a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:22.094320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:22.097453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:22.099603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd443acfc03394e45bd521ce3f2e6d978', 'request_id': 'req-66b9f7e8-a034-451d-abab-a2770061b94a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:22.118342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd443acfc03394e45bd521ce3f2e6d978', 'request_id': 'req-66b9f7e8-a034-451d-abab-a2770061b94a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:22.121660 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:22.134648 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2974/5936] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:21 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:20:22.139708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:22.145394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:22.161926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project d443acfc03394e45bd521ce3f2e6d978 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:22.163783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:22.166507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:22.177069 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2963/5937] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:21 2022] DELETE /identity/v3/projects/d443acfc03394e45bd521ce3f2e6d978 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:22.178306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:22.185900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:22.303475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286a3092-a130-4d93-b66d-253a285c1d8c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:22.320424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b9f7e8-a034-451d-abab-a2770061b94a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:22.328322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f2563-bdea-4388-ae99-497bf4bb9b41 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:22.329481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f2563-bdea-4388-ae99-497bf4bb9b41 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:22.329920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f2563-bdea-4388-ae99-497bf4bb9b41 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:22.330350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f2563-bdea-4388-ae99-497bf4bb9b41 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:22.331200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f2563-bdea-4388-ae99-497bf4bb9b41 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:22.333836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351f2563-bdea-4388-ae99-497bf4bb9b41 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:22.343075 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:22.391371 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2964/5938] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:20:22 2022] POST /identity/v3/domains => generated 275 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:22.392652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f2563-bdea-4388-ae99-497bf4bb9b41 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:22.465950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28dd8ce-b905-4fd7-a3f1-4305bd02e9b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:22.466888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dd8ce-b905-4fd7-a3f1-4305bd02e9b6 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:22.467347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dd8ce-b905-4fd7-a3f1-4305bd02e9b6 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:22.467792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28dd8ce-b905-4fd7-a3f1-4305bd02e9b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:22.474832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a28dd8ce-b905-4fd7-a3f1-4305bd02e9b6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:22.556286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351f2563-bdea-4388-ae99-497bf4bb9b41 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:22.580885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c38da4-46ca-44f5-a235-a209e81af01a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:22.581542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c38da4-46ca-44f5-a235-a209e81af01a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:22.581829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c38da4-46ca-44f5-a235-a209e81af01a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:22.582106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c38da4-46ca-44f5-a235-a209e81af01a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:22.582757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c38da4-46ca-44f5-a235-a209e81af01a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:22.584697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c38da4-46ca-44f5-a235-a209e81af01a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:22.682343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28dd8ce-b905-4fd7-a3f1-4305bd02e9b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:22.683825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28dd8ce-b905-4fd7-a3f1-4305bd02e9b6 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:22.707858 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2965/5939] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:22 2022] POST /identity/v3/projects => generated 402 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:22.709981 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2975/5940] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:22.711983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c38da4-46ca-44f5-a235-a209e81af01a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:22.834984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c539-b8ed-440d-8cdc-932be6ee8888 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:22.835507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c539-b8ed-440d-8cdc-932be6ee8888 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:22.835985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0679c539-b8ed-440d-8cdc-932be6ee8888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:22.865618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c38da4-46ca-44f5-a235-a209e81af01a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:22.889486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ddd4e-328c-4a4c-b334-7acba20beb2d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:22.890135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ddd4e-328c-4a4c-b334-7acba20beb2d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:22.890426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ddd4e-328c-4a4c-b334-7acba20beb2d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:22.890703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ddd4e-328c-4a4c-b334-7acba20beb2d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/6a269f9a528c4d3383ba37b7ce2a4cae` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:22.891916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ddd4e-328c-4a4c-b334-7acba20beb2d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:get_project(project_id=6a269f9a528c4d3383ba37b7ce2a4cae)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:22.894030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ddd4e-328c-4a4c-b334-7acba20beb2d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:22.895707 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2966/5941] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:22 2022] GET /identity/v3/projects/6a269f9a528c4d3383ba37b7ce2a4cae => generated 402 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:22.906373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ddd4e-328c-4a4c-b334-7acba20beb2d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:22.918942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0679c539-b8ed-440d-8cdc-932be6ee8888 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:22.920185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0679c539-b8ed-440d-8cdc-932be6ee8888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:22.925555 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:22.940784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ddd4e-328c-4a4c-b334-7acba20beb2d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:22.959062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:22.959706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:22.959997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:22.960275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/6a269f9a528c4d3383ba37b7ce2a4cae` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:22.962349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6a269f9a528c4d3383ba37b7ce2a4cae)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:22.964293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:23.159201 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2976/5942] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:20:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:20:23.160901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679c539-b8ed-440d-8cdc-932be6ee8888 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:23.162314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a269f9a528c4d3383ba37b7ce2a4cae', 'request_id': 'req-4c9d2344-b377-4c93-81cb-7bc7a19c874e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.164159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0679c539-b8ed-440d-8cdc-932be6ee8888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:23.183377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a269f9a528c4d3383ba37b7ce2a4cae', 'request_id': 'req-4c9d2344-b377-4c93-81cb-7bc7a19c874e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.203265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a269f9a528c4d3383ba37b7ce2a4cae', 'request_id': 'req-4c9d2344-b377-4c93-81cb-7bc7a19c874e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.226923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project 6a269f9a528c4d3383ba37b7ce2a4cae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:23.227862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.230616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.235075 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2967/5943] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:22 2022] DELETE /identity/v3/projects/6a269f9a528c4d3383ba37b7ce2a4cae => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:23.239032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:23.240609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:23.400367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9d2344-b377-4c93-81cb-7bc7a19c874e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:23.412496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:23.413405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:23.413802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:23.414189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/domains/cf54dd782c9f4543b81aafed9ed2daa4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:23.415691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cf54dd782c9f4543b81aafed9ed2daa4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:23.417498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:23.458722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0679c539-b8ed-440d-8cdc-932be6ee8888 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:23.471492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.472429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.485516 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:23.525589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.527271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.535043 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2968/5944] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:20:23 2022] PATCH /identity/v3/domains/cf54dd782c9f4543b81aafed9ed2daa4 => generated 276 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:20:23.536914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:23.540692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:23.664168 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:23.666256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e14393-af8d-4c95-b715-6a3596cb04c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:23.668754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e14393-af8d-4c95-b715-6a3596cb04c6 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:23.670465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e14393-af8d-4c95-b715-6a3596cb04c6 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:23.670822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e14393-af8d-4c95-b715-6a3596cb04c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:23.674999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b9e14393-af8d-4c95-b715-6a3596cb04c6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:23.690575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc14d650-e7a5-4088-bc54-848ff8963658 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:23.713099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:23.713942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:23.714726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:23.715087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/domains/cf54dd782c9f4543b81aafed9ed2daa4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:23.739050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cf54dd782c9f4543b81aafed9ed2daa4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:23.740878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:23.807066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.826947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.843847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e14393-af8d-4c95-b715-6a3596cb04c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:23.846072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e14393-af8d-4c95-b715-6a3596cb04c6 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:23.891940 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2977/5945] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:20:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:20:23.935640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4', 'request_id': 'req-ce44c71d-3954-438d-8cd3-8fed3346a915'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.955123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4', 'request_id': 'req-ce44c71d-3954-438d-8cd3-8fed3346a915'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.978135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4', 'request_id': 'req-ce44c71d-3954-438d-8cd3-8fed3346a915'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:23.998488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project cf54dd782c9f4543b81aafed9ed2daa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:23.998747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.001915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.015629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4', 'request_id': 'req-ce44c71d-3954-438d-8cd3-8fed3346a915'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.016728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4', 'request_id': 'req-ce44c71d-3954-438d-8cd3-8fed3346a915'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.017999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cf54dd782c9f4543b81aafed9ed2daa4', 'request_id': 'req-ce44c71d-3954-438d-8cd3-8fed3346a915'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.030402 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2969/5946] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:23 2022] DELETE /identity/v3/domains/cf54dd782c9f4543b81aafed9ed2daa4 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:24.035588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e14393-af8d-4c95-b715-6a3596cb04c6 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:24.059887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e14393-af8d-4c95-b715-6a3596cb04c6 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:24.117043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:24.120106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:24.225803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f08e8-2e5a-4abd-ba91-b26da8912525 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:24.226643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f08e8-2e5a-4abd-ba91-b26da8912525 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:24.227966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f08e8-2e5a-4abd-ba91-b26da8912525 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:24.228162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f08e8-2e5a-4abd-ba91-b26da8912525 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:24.228954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f08e8-2e5a-4abd-ba91-b26da8912525 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:24.235318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836f08e8-2e5a-4abd-ba91-b26da8912525 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:24.236403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44c71d-3954-438d-8cd3-8fed3346a915 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:24.252106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:24.253069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:24.253400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:24.253678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:24.259577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:24.281047 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2978/5947] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:20:24 2022] POST /identity/v3/domains => generated 275 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:24.282487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f08e8-2e5a-4abd-ba91-b26da8912525 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:24.290511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-836f08e8-2e5a-4abd-ba91-b26da8912525 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:24.418475 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:24.448092 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:24.472886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:24.474610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:24.489353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f08e8-2e5a-4abd-ba91-b26da8912525 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:24.506729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:24.509172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:24.516013 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2970/5948] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:20:24.517157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:24.517679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:24.518151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] PATH_INFO: `/v3/users/eb31f1a169c14f9d89b6425eee97a133` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:24.520305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:24.521161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb31f1a169c14f9d89b6425eee97a133)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:24.524470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:24.569631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d684361-35d8-41eb-b2dc-7b7e03449c1f service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:24.716001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb31f1a169c14f9d89b6425eee97a133'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.746144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb31f1a169c14f9d89b6425eee97a133'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.749018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb31f1a169c14f9d89b6425eee97a133'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.793914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb31f1a169c14f9d89b6425eee97a133'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.812625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad280a-7656-40e8-8911-4ccb56117018 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:24.814509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad280a-7656-40e8-8911-4ccb56117018 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:24.819368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad280a-7656-40e8-8911-4ccb56117018 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:24.819877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad280a-7656-40e8-8911-4ccb56117018 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:24.822452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad280a-7656-40e8-8911-4ccb56117018 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:24.824521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad280a-7656-40e8-8911-4ccb56117018 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:24.828515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-657cbb8f-59d8-4428-843a-e83ca2d51ace admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb31f1a169c14f9d89b6425eee97a133'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:24.838276 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2979/5949] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:24 2022] DELETE /identity/v3/users/eb31f1a169c14f9d89b6425eee97a133 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:24.849249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c8d2-9b29-4929-920e-4b112db3479e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:24.849840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c8d2-9b29-4929-920e-4b112db3479e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:24.850270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e1c8d2-9b29-4929-920e-4b112db3479e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:24.907358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-90e1c8d2-9b29-4929-920e-4b112db3479e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:24.908834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-90e1c8d2-9b29-4929-920e-4b112db3479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:24.931722 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2971/5950] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:24 2022] POST /identity/v3/projects => generated 408 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:24.937655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad280a-7656-40e8-8911-4ccb56117018 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:24.947566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7cad280a-7656-40e8-8911-4ccb56117018 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:25.103924 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2980/5951] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:25.104141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad280a-7656-40e8-8911-4ccb56117018 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:25.117447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7a02e-a304-47f5-9fd8-db6fd8936fb6 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:25.118681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7a02e-a304-47f5-9fd8-db6fd8936fb6 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:25.118959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7a02e-a304-47f5-9fd8-db6fd8936fb6 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:25.119231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf7a02e-a304-47f5-9fd8-db6fd8936fb6 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:25.119901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7a02e-a304-47f5-9fd8-db6fd8936fb6 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:25.122019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf7a02e-a304-47f5-9fd8-db6fd8936fb6 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:25.190988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1c8d2-9b29-4929-920e-4b112db3479e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:25.192745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-90e1c8d2-9b29-4929-920e-4b112db3479e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:25.207086 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2972/5952] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:24 2022] POST /identity/v3/projects => generated 405 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:25.208093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7a02e-a304-47f5-9fd8-db6fd8936fb6 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:25.271528 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:25.410869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf7a02e-a304-47f5-9fd8-db6fd8936fb6 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:25.413538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e1c8d2-9b29-4929-920e-4b112db3479e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:25.451485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:25.452880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:25.453349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:25.453807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/e020bb9f3cb14c56801057e5ced0b1b6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:25.461926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e020bb9f3cb14c56801057e5ced0b1b6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:25.464500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:25.507509 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:25.606205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e020bb9f3cb14c56801057e5ced0b1b6', 'request_id': 'req-f0b52077-2aae-4e9c-97a5-daa98ac99fee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:25.617109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b51df-9675-4485-b7ff-2478209f09ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:25.618535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b51df-9675-4485-b7ff-2478209f09ff service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:25.618958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b51df-9675-4485-b7ff-2478209f09ff service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:25.619482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b51df-9675-4485-b7ff-2478209f09ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:25.629957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e020bb9f3cb14c56801057e5ced0b1b6', 'request_id': 'req-f0b52077-2aae-4e9c-97a5-daa98ac99fee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:25.650524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e020bb9f3cb14c56801057e5ced0b1b6', 'request_id': 'req-f0b52077-2aae-4e9c-97a5-daa98ac99fee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:25.675477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project e020bb9f3cb14c56801057e5ced0b1b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:25.675778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:25.682021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:25.690095 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2973/5953] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:25 2022] DELETE /identity/v3/projects/e020bb9f3cb14c56801057e5ced0b1b6 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:25.692509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:25.698434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:25.766158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b51df-9675-4485-b7ff-2478209f09ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:25.767798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b51df-9675-4485-b7ff-2478209f09ff service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:25.792488 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2981/5954] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:25.856881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b52077-2aae-4e9c-97a5-daa98ac99fee tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:25.874216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:25.874988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:25.875473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:25.882402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/6993ff4127724c51b82702016586bfe7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:25.887979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=6993ff4127724c51b82702016586bfe7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:25.890000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:26.016143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6993ff4127724c51b82702016586bfe7', 'request_id': 'req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.025609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6993ff4127724c51b82702016586bfe7', 'request_id': 'req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.049183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6993ff4127724c51b82702016586bfe7', 'request_id': 'req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.064300 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:26.065948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project 6993ff4127724c51b82702016586bfe7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:26.066604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.067566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.070100 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2974/5955] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:25 2022] DELETE /identity/v3/projects/6993ff4127724c51b82702016586bfe7 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:26.074662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b51df-9675-4485-b7ff-2478209f09ff service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:26.093409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b51df-9675-4485-b7ff-2478209f09ff service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:26.232092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:26.232914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:26.234574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:26.235551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/domains/d608b18a45e24cb5a096c09c3757e38b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:26.238014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d608b18a45e24cb5a096c09c3757e38b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:26.240848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:26.297922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.299568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.357014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.360988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.366747 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2982/5956] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:20:26 2022] PATCH /identity/v3/domains/d608b18a45e24cb5a096c09c3757e38b => generated 276 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:26.368941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:26.371430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:26.394216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebc8bdd-6fb8-409f-9ae4-c7c22e519546 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:26.553437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:26.554234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:26.554633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:26.555598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/domains/d608b18a45e24cb5a096c09c3757e38b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:26.579941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d608b18a45e24cb5a096c09c3757e38b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:26.581938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:26.638346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.651555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.745762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b', 'request_id': 'req-ea540734-a1c3-4c39-b211-66c532a25bc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.762068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b', 'request_id': 'req-ea540734-a1c3-4c39-b211-66c532a25bc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.778691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b', 'request_id': 'req-ea540734-a1c3-4c39-b211-66c532a25bc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.807191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project d608b18a45e24cb5a096c09c3757e38b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:26.807191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.807915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.830646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b', 'request_id': 'req-ea540734-a1c3-4c39-b211-66c532a25bc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.831968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b', 'request_id': 'req-ea540734-a1c3-4c39-b211-66c532a25bc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.833006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd608b18a45e24cb5a096c09c3757e38b', 'request_id': 'req-ea540734-a1c3-4c39-b211-66c532a25bc0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:26.853707 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2975/5957] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:26 2022] DELETE /identity/v3/domains/d608b18a45e24cb5a096c09c3757e38b => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:26.858740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:26.860510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:26.885209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22179b3-2b21-4886-9a68-2490d1fe9cb3 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:26.963612 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:27.015860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee304-3416-4713-977f-76806daf140a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:27.016785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee304-3416-4713-977f-76806daf140a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:27.017184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee304-3416-4713-977f-76806daf140a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:27.017597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0aee304-3416-4713-977f-76806daf140a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:27.021885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aee304-3416-4713-977f-76806daf140a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:27.024367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0aee304-3416-4713-977f-76806daf140a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:27.149514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:27.153946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:27.163265 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2983/5958] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:26 2022] POST /identity/v3/projects => generated 375 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:27.178121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea540734-a1c3-4c39-b211-66c532a25bc0 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:27.294777 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:27.338766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb4b3e-6b55-4afe-bd49-f3d013db6e43 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:27.339431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb4b3e-6b55-4afe-bd49-f3d013db6e43 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:27.339774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb4b3e-6b55-4afe-bd49-f3d013db6e43 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:27.340634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfb4b3e-6b55-4afe-bd49-f3d013db6e43 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/e5bd322f9e644074b6dddefcd862ee5e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:27.341904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb4b3e-6b55-4afe-bd49-f3d013db6e43 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:get_project(project_id=e5bd322f9e644074b6dddefcd862ee5e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:27.344180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbfb4b3e-6b55-4afe-bd49-f3d013db6e43 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:27.349187 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2976/5959] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:27 2022] GET /identity/v3/projects/e5bd322f9e644074b6dddefcd862ee5e => generated 375 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:27.350658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee304-3416-4713-977f-76806daf140a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:27.369901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0aee304-3416-4713-977f-76806daf140a tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:27.389021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c3fb6-9cb2-4eaa-b9de-0d57367ac7c1 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:27.389948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c3fb6-9cb2-4eaa-b9de-0d57367ac7c1 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:27.390236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c3fb6-9cb2-4eaa-b9de-0d57367ac7c1 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:27.390512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6c3fb6-9cb2-4eaa-b9de-0d57367ac7c1 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:27.391194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c3fb6-9cb2-4eaa-b9de-0d57367ac7c1 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:27.393342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6c3fb6-9cb2-4eaa-b9de-0d57367ac7c1 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:27.429422 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2984/5960] 10.222.0.25 () {58 vars in 1131 bytes} [Mon Oct 24 09:20:27 2022] GET /identity/v3/projects => generated 7663 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:27.433568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb4b3e-6b55-4afe-bd49-f3d013db6e43 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:27.476337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfb4b3e-6b55-4afe-bd49-f3d013db6e43 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:27.486272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:27.487155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:27.487600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:27.488059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/e5bd322f9e644074b6dddefcd862ee5e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:27.496221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=e5bd322f9e644074b6dddefcd862ee5e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:27.510591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:27.649535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5bd322f9e644074b6dddefcd862ee5e', 'request_id': 'req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:27.657110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5bd322f9e644074b6dddefcd862ee5e', 'request_id': 'req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:27.684080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5bd322f9e644074b6dddefcd862ee5e', 'request_id': 'req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:27.702811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project e5bd322f9e644074b6dddefcd862ee5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:27.703114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:27.709870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:27.716156 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2977/5961] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:27 2022] DELETE /identity/v3/projects/e5bd322f9e644074b6dddefcd862ee5e => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:27.717440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c3fb6-9cb2-4eaa-b9de-0d57367ac7c1 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:27.719725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa6c3fb6-9cb2-4eaa-b9de-0d57367ac7c1 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:27.738261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6c3fb6-9cb2-4eaa-b9de-0d57367ac7c1 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:27.850850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea864a5-ac2e-4e9c-ac9b-bff3363fb855 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:27.854962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea864a5-ac2e-4e9c-ac9b-bff3363fb855 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:27.855393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea864a5-ac2e-4e9c-ac9b-bff3363fb855 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:27.855591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea864a5-ac2e-4e9c-ac9b-bff3363fb855 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:27.856261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea864a5-ac2e-4e9c-ac9b-bff3363fb855 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:27.858633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea864a5-ac2e-4e9c-ac9b-bff3363fb855 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:27.897091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:27.898605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:27.921417 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2985/5962] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:20:27 2022] POST /identity/v3/projects => generated 348 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:27.926944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea864a5-ac2e-4e9c-ac9b-bff3363fb855 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:28.022619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea864a5-ac2e-4e9c-ac9b-bff3363fb855 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:28.027799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6de54-5942-403d-8a3e-00cbbdd1b5f8 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:28.028452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6de54-5942-403d-8a3e-00cbbdd1b5f8 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:28.028760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6de54-5942-403d-8a3e-00cbbdd1b5f8 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:28.029018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce6de54-5942-403d-8a3e-00cbbdd1b5f8 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/d653d03932e24199afe82fd8c60e8f28` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:28.030296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6de54-5942-403d-8a3e-00cbbdd1b5f8 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:update_project(project_id=d653d03932e24199afe82fd8c60e8f28)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:28.032425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce6de54-5942-403d-8a3e-00cbbdd1b5f8 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:28.079317 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2986/5963] 10.222.0.25 () {60 vars in 1252 bytes} [Mon Oct 24 09:20:27 2022] PATCH /identity/v3/projects/d653d03932e24199afe82fd8c60e8f28 => generated 360 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:28.084201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6de54-5942-403d-8a3e-00cbbdd1b5f8 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:28.095599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a98281-61cf-46d6-a1bb-3e3df27cbe46 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:28.110047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce6de54-5942-403d-8a3e-00cbbdd1b5f8 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:28.116365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c8a15-fbc3-4f9d-83c8-2866a46b4d8e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:28.118185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c8a15-fbc3-4f9d-83c8-2866a46b4d8e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:28.118773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c8a15-fbc3-4f9d-83c8-2866a46b4d8e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:28.119597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c8a15-fbc3-4f9d-83c8-2866a46b4d8e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/d653d03932e24199afe82fd8c60e8f28` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:28.149368 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:28.171368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c8a15-fbc3-4f9d-83c8-2866a46b4d8e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:get_project(project_id=d653d03932e24199afe82fd8c60e8f28)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:28.176348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c8a15-fbc3-4f9d-83c8-2866a46b4d8e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:28.186065 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2987/5964] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:28 2022] GET /identity/v3/projects/d653d03932e24199afe82fd8c60e8f28 => generated 347 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:28.191201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c8a15-fbc3-4f9d-83c8-2866a46b4d8e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:28.214449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c8a15-fbc3-4f9d-83c8-2866a46b4d8e tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:28.237607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:28.238640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:28.238640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:28.239067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] PATH_INFO: `/v3/projects/4dbaa049d85747fa8c8ed3d49cf90133` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:28.240585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:28.240963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dbaa049d85747fa8c8ed3d49cf90133)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:28.242876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:28.243020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:28.243640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:28.244155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/d653d03932e24199afe82fd8c60e8f28` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:28.247289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d653d03932e24199afe82fd8c60e8f28)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:28.251200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:28.257861 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:28.354924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dbaa049d85747fa8c8ed3d49cf90133', 'request_id': 'req-b614e59b-0822-4675-9a10-6cc04955642d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.368935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd653d03932e24199afe82fd8c60e8f28', 'request_id': 'req-5545d095-4039-4986-8453-4be3d4ba4005'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.371486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dbaa049d85747fa8c8ed3d49cf90133', 'request_id': 'req-b614e59b-0822-4675-9a10-6cc04955642d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.386051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd653d03932e24199afe82fd8c60e8f28', 'request_id': 'req-5545d095-4039-4986-8453-4be3d4ba4005'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.397963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dbaa049d85747fa8c8ed3d49cf90133', 'request_id': 'req-b614e59b-0822-4675-9a10-6cc04955642d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.404250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd653d03932e24199afe82fd8c60e8f28', 'request_id': 'req-5545d095-4039-4986-8453-4be3d4ba4005'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.416620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project d653d03932e24199afe82fd8c60e8f28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:28.417010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.417789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.420686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] The token cache is being invalidate because project 4dbaa049d85747fa8c8ed3d49cf90133 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:28.421256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.423650 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2988/5965] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:28 2022] DELETE /identity/v3/projects/d653d03932e24199afe82fd8c60e8f28 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:28.424419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.424684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:28.426405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:28.430944 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2978/5966] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:27 2022] DELETE /identity/v3/projects/4dbaa049d85747fa8c8ed3d49cf90133 => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:28.435091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:28.437613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:28.561257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614e59b-0822-4675-9a10-6cc04955642d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:28.567296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5545d095-4039-4986-8453-4be3d4ba4005 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:28.578903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d897e-592a-4289-9e54-979f14aaa90c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:28.579631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d897e-592a-4289-9e54-979f14aaa90c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:28.580073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d897e-592a-4289-9e54-979f14aaa90c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:28.580244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264d897e-592a-4289-9e54-979f14aaa90c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:28.581007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d897e-592a-4289-9e54-979f14aaa90c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:28.584964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264d897e-592a-4289-9e54-979f14aaa90c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:28.713526 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2989/5967] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:28 2022] POST /identity/v3/projects => generated 360 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:28.717635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d897e-592a-4289-9e54-979f14aaa90c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:28.723265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-264d897e-592a-4289-9e54-979f14aaa90c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:28.730545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:28.731199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:28.732029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:28.732317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] PATH_INFO: `/v3/users/df6532c3efee46bfb4c2613057c4abc2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:28.737773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6532c3efee46bfb4c2613057c4abc2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:28.739949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:28.848529 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:28.871058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6532c3efee46bfb4c2613057c4abc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.909903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6532c3efee46bfb4c2613057c4abc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.912827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6532c3efee46bfb4c2613057c4abc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.933622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6532c3efee46bfb4c2613057c4abc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.961776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6532c3efee46bfb4c2613057c4abc2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:28.968733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264d897e-592a-4289-9e54-979f14aaa90c tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:28.981113 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2979/5968] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:28 2022] DELETE /identity/v3/users/df6532c3efee46bfb4c2613057c4abc2 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:28.994250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b5a50-cd20-44ee-8456-aa2cef27f860 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:28.995070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5a50-cd20-44ee-8456-aa2cef27f860 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:28.995368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5a50-cd20-44ee-8456-aa2cef27f860 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:28.995651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8b5a50-cd20-44ee-8456-aa2cef27f860 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/9d18db4471154534b91af665cbaf7e60` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:29.010649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b5a50-cd20-44ee-8456-aa2cef27f860 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:update_project(project_id=9d18db4471154534b91af665cbaf7e60)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:29.019083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8b5a50-cd20-44ee-8456-aa2cef27f860 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:29.085114 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:29.215578 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2990/5969] 10.222.0.25 () {60 vars in 1252 bytes} [Mon Oct 24 09:20:28 2022] PATCH /identity/v3/projects/9d18db4471154534b91af665cbaf7e60 => generated 372 bytes in 501 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:29.219772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:29.223096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:29.368449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f1acf0-321c-4060-9899-de72d7eb5b5b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:29.387632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b531ba4-11bd-423a-b815-36ee649d7e47 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:29.388568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b531ba4-11bd-423a-b815-36ee649d7e47 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:29.389011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b531ba4-11bd-423a-b815-36ee649d7e47 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:29.391038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b531ba4-11bd-423a-b815-36ee649d7e47 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/9d18db4471154534b91af665cbaf7e60` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:29.408371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b531ba4-11bd-423a-b815-36ee649d7e47 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:get_project(project_id=9d18db4471154534b91af665cbaf7e60)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:29.411685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b531ba4-11bd-423a-b815-36ee649d7e47 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:29.416625 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2980/5970] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:29 2022] GET /identity/v3/projects/9d18db4471154534b91af665cbaf7e60 => generated 359 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:29.420846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b5a50-cd20-44ee-8456-aa2cef27f860 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:29.436235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8b5a50-cd20-44ee-8456-aa2cef27f860 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:29.455624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:29.457763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:29.458410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:29.458963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/9d18db4471154534b91af665cbaf7e60` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:29.469421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d18db4471154534b91af665cbaf7e60)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:29.476345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:29.571087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d18db4471154534b91af665cbaf7e60', 'request_id': 'req-9de41a67-d129-487c-bbc1-c111c052b4c5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:29.591125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d18db4471154534b91af665cbaf7e60', 'request_id': 'req-9de41a67-d129-487c-bbc1-c111c052b4c5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:29.600118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d18db4471154534b91af665cbaf7e60', 'request_id': 'req-9de41a67-d129-487c-bbc1-c111c052b4c5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:29.622047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project 9d18db4471154534b91af665cbaf7e60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:29.626099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:29.626099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:29.630792 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2991/5971] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:29 2022] DELETE /identity/v3/projects/9d18db4471154534b91af665cbaf7e60 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:29.632170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b531ba4-11bd-423a-b815-36ee649d7e47 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:29.633870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9b531ba4-11bd-423a-b815-36ee649d7e47 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:29.659335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b531ba4-11bd-423a-b815-36ee649d7e47 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:29.786581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4d25-7a75-453b-a779-909d0a2a1bef tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:29.787374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4d25-7a75-453b-a779-909d0a2a1bef tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:29.787733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4d25-7a75-453b-a779-909d0a2a1bef tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:29.788089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd4d25-7a75-453b-a779-909d0a2a1bef tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:29.789780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd4d25-7a75-453b-a779-909d0a2a1bef tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:29.792187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fd4d25-7a75-453b-a779-909d0a2a1bef tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:29.887310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:29.887816 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2981/5972] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:29 2022] POST /identity/v3/projects => generated 355 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:29.900914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de41a67-d129-487c-bbc1-c111c052b4c5 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:30.005595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fc5fd-5f99-4afd-b959-f4b7c060467d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:30.006669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc5fd-5f99-4afd-b959-f4b7c060467d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.006958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc5fd-5f99-4afd-b959-f4b7c060467d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.007464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640fc5fd-5f99-4afd-b959-f4b7c060467d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/707be9aa2e044e45bf5da9c18176492f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.011404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fc5fd-5f99-4afd-b959-f4b7c060467d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:update_project(project_id=707be9aa2e044e45bf5da9c18176492f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:30.017606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640fc5fd-5f99-4afd-b959-f4b7c060467d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:30.092433 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2992/5973] 10.222.0.25 () {60 vars in 1252 bytes} [Mon Oct 24 09:20:29 2022] PATCH /identity/v3/projects/707be9aa2e044e45bf5da9c18176492f => generated 368 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:20:30.094723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4d25-7a75-453b-a779-909d0a2a1bef tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:30.114199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fd4d25-7a75-453b-a779-909d0a2a1bef tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:30.121631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a7631-04ff-46a4-8633-0d983527bf82 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:30.122614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7631-04ff-46a4-8633-0d983527bf82 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.123220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7631-04ff-46a4-8633-0d983527bf82 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.123715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929a7631-04ff-46a4-8633-0d983527bf82 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/707be9aa2e044e45bf5da9c18176492f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.140140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fc5fd-5f99-4afd-b959-f4b7c060467d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:30.142986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-640fc5fd-5f99-4afd-b959-f4b7c060467d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:30.145060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a7631-04ff-46a4-8633-0d983527bf82 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:get_project(project_id=707be9aa2e044e45bf5da9c18176492f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:30.148808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929a7631-04ff-46a4-8633-0d983527bf82 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:30.155996 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2982/5974] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:30 2022] GET /identity/v3/projects/707be9aa2e044e45bf5da9c18176492f => generated 355 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:30.157414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a7631-04ff-46a4-8633-0d983527bf82 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:30.172774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929a7631-04ff-46a4-8633-0d983527bf82 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:30.181595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:30.185517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.186484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.186484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/projects/707be9aa2e044e45bf5da9c18176492f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.188426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorizing `identity:delete_project(project_id=707be9aa2e044e45bf5da9c18176492f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:30.192454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:30.204583 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:UPDATE=2,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:30.224932 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:30.258643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640fc5fd-5f99-4afd-b959-f4b7c060467d tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:30.270620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707be9aa2e044e45bf5da9c18176492f', 'request_id': 'req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.279777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707be9aa2e044e45bf5da9c18176492f', 'request_id': 'req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.292445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707be9aa2e044e45bf5da9c18176492f', 'request_id': 'req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.312401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] The token cache is being invalidate because project 707be9aa2e044e45bf5da9c18176492f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:30.312900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.313788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.315872 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2983/5975] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:30 2022] DELETE /identity/v3/projects/707be9aa2e044e45bf5da9c18176492f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:30.320998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:30.323770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:30.338492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:30.339299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.339682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.340294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] PATH_INFO: `/v3/projects/cd3f8006086e4f09a0db2c7c9b7bb0e8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.342257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd3f8006086e4f09a0db2c7c9b7bb0e8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:30.344360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:30.419295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd3f8006086e4f09a0db2c7c9b7bb0e8', 'request_id': 'req-e2109988-c71c-4984-90f8-c1fe5ebccf5c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.431009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd3f8006086e4f09a0db2c7c9b7bb0e8', 'request_id': 'req-e2109988-c71c-4984-90f8-c1fe5ebccf5c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.433012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c1b473-0f31-4ea0-8f2c-8d4184923d66 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:30.449850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd3f8006086e4f09a0db2c7c9b7bb0e8', 'request_id': 'req-e2109988-c71c-4984-90f8-c1fe5ebccf5c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.475522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] The token cache is being invalidate because project cd3f8006086e4f09a0db2c7c9b7bb0e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:30.477820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.481278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e2109988-c71c-4984-90f8-c1fe5ebccf5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.489397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2993/5976] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:30 2022] DELETE /identity/v3/projects/cd3f8006086e4f09a0db2c7c9b7bb0e8 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:30.496117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3815de2-ceef-4397-9001-3e86db990b2e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.496417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3815de2-ceef-4397-9001-3e86db990b2e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.496699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3815de2-ceef-4397-9001-3e86db990b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.514392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f581d-e0e8-4c21-94b4-16628aa93211 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:30.515032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f581d-e0e8-4c21-94b4-16628aa93211 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.515315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f581d-e0e8-4c21-94b4-16628aa93211 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.515594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92f581d-e0e8-4c21-94b4-16628aa93211 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/domains/d608b18a45e24cb5a096c09c3757e38b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.524535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92f581d-e0e8-4c21-94b4-16628aa93211 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:20:30.528721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c3815de2-ceef-4397-9001-3e86db990b2e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:30.530095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c3815de2-ceef-4397-9001-3e86db990b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c92f581d-e0e8-4c21-94b4-16628aa93211 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Could not find domain: d608b18a45e24cb5a096c09c3757e38b.: keystone.exception.DomainNotFound: Could not find domain: d608b18a45e24cb5a096c09c3757e38b. Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: d608b18a45e24cb5a096c09c3757e38b. Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:30.530225 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:30.531441 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: d608b18a45e24cb5a096c09c3757e38b. Oct 24 09:20:30.532606 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:30.534710 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2984/5977] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:20:30 2022] PATCH /identity/v3/domains/d608b18a45e24cb5a096c09c3757e38b => generated 112 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 24 09:20:30.535531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f581d-e0e8-4c21-94b4-16628aa93211 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:30.537217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c92f581d-e0e8-4c21-94b4-16628aa93211 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:30.552720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92f581d-e0e8-4c21-94b4-16628aa93211 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:30.560077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e52d5-be70-4d02-be16-a746d5a89175 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e67fe89511c643ada3c0b32ef7c77377', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4d9cbf49012e482fa1e8856b9d683714', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:30.562614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e52d5-be70-4d02-be16-a746d5a89175 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.563116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e52d5-be70-4d02-be16-a746d5a89175 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.563559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e52d5-be70-4d02-be16-a746d5a89175 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] PATH_INFO: `/v3/domains/cf54dd782c9f4543b81aafed9ed2daa4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.574323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e52d5-be70-4d02-be16-a746d5a89175 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0c0e52d5-be70-4d02-be16-a746d5a89175 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Could not find domain: cf54dd782c9f4543b81aafed9ed2daa4.: keystone.exception.DomainNotFound: Could not find domain: cf54dd782c9f4543b81aafed9ed2daa4. Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cf54dd782c9f4543b81aafed9ed2daa4. Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:30.580282 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:30.581546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cf54dd782c9f4543b81aafed9ed2daa4. Oct 24 09:20:30.582662 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:30.583845 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2985/5978] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:20:30 2022] PATCH /identity/v3/domains/cf54dd782c9f4543b81aafed9ed2daa4 => generated 112 bytes in 46 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:20:30.588927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e52d5-be70-4d02-be16-a746d5a89175 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:30.591711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0c0e52d5-be70-4d02-be16-a746d5a89175 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:30.645348 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2994/5979] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:30.652435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36def2-5e64-41cc-aba6-8dbbd83e4ad2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.653104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36def2-5e64-41cc-aba6-8dbbd83e4ad2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.653104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f36def2-5e64-41cc-aba6-8dbbd83e4ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.656158 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:30.685369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e52d5-be70-4d02-be16-a746d5a89175 tempest-ProjectsTestJSON-1754146994 tempest-ProjectsTestJSON-1754146994-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:30.690264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6f36def2-5e64-41cc-aba6-8dbbd83e4ad2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:30.692518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6f36def2-5e64-41cc-aba6-8dbbd83e4ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:30.697054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:30.697822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.698171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.698539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] PATH_INFO: `/v3/users/daa5aa15038e413a910da0f1ca4076b7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.699778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa5aa15038e413a910da0f1ca4076b7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:30.701982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:30.731983 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2995/5980] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:20:30.733136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36def2-5e64-41cc-aba6-8dbbd83e4ad2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:30.738612 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:30.753448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f36def2-5e64-41cc-aba6-8dbbd83e4ad2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:30.760770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd978ebd-fdd3-4af4-bd3b-2347d704677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:30.761467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978ebd-fdd3-4af4-bd3b-2347d704677e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.761744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978ebd-fdd3-4af4-bd3b-2347d704677e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.762300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd978ebd-fdd3-4af4-bd3b-2347d704677e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.762797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd978ebd-fdd3-4af4-bd3b-2347d704677e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:30.763565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd978ebd-fdd3-4af4-bd3b-2347d704677e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:30.766346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd978ebd-fdd3-4af4-bd3b-2347d704677e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:30.789253 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2996/5981] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:30.790904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd978ebd-fdd3-4af4-bd3b-2347d704677e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:30.802142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd978ebd-fdd3-4af4-bd3b-2347d704677e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:30.811138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f1d07-eaee-4174-9599-f435c4158843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:30.811138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f1d07-eaee-4174-9599-f435c4158843 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.811138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f1d07-eaee-4174-9599-f435c4158843 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.811980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688f1d07-eaee-4174-9599-f435c4158843 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.813668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f1d07-eaee-4174-9599-f435c4158843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:30.815997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688f1d07-eaee-4174-9599-f435c4158843 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:30.816331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa5aa15038e413a910da0f1ca4076b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.850310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa5aa15038e413a910da0f1ca4076b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.851517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa5aa15038e413a910da0f1ca4076b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.868014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa5aa15038e413a910da0f1ca4076b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.870208 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2997/5982] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:30 2022] POST /identity/v3/projects => generated 357 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:30.872260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f1d07-eaee-4174-9599-f435c4158843 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:30.882267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-688f1d07-eaee-4174-9599-f435c4158843 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:30.893713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-22700bc1-fa0d-4032-acf3-844e0b0689c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa5aa15038e413a910da0f1ca4076b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:30.909095 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2986/5983] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:30 2022] DELETE /identity/v3/users/daa5aa15038e413a910da0f1ca4076b7 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:30.910922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80748c77-5f0d-46be-9ddf-a6e251546ce4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:30.911276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80748c77-5f0d-46be-9ddf-a6e251546ce4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:30.911484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80748c77-5f0d-46be-9ddf-a6e251546ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:30.952146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-80748c77-5f0d-46be-9ddf-a6e251546ce4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:30.953377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-80748c77-5f0d-46be-9ddf-a6e251546ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:31.016593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688f1d07-eaee-4174-9599-f435c4158843 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:31.053115 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2987/5984] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:31.060625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80748c77-5f0d-46be-9ddf-a6e251546ce4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:31.062073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-80748c77-5f0d-46be-9ddf-a6e251546ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:31.129934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad557a-cc0e-4c6f-abe1-85e0efa0a0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:31.132014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad557a-cc0e-4c6f-abe1-85e0efa0a0a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:31.132014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad557a-cc0e-4c6f-abe1-85e0efa0a0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:31.132014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ad557a-cc0e-4c6f-abe1-85e0efa0a0a9 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:31.133781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad557a-cc0e-4c6f-abe1-85e0efa0a0a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:31.136828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ad557a-cc0e-4c6f-abe1-85e0efa0a0a9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:31.174626 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2998/5985] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:30 2022] POST /identity/v3/users => generated 279 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:31.180386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad557a-cc0e-4c6f-abe1-85e0efa0a0a9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:31.195382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ad557a-cc0e-4c6f-abe1-85e0efa0a0a9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:31.201910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc889ac-7d5c-43c5-91c8-c5c4a0f0bdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:31.202683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc889ac-7d5c-43c5-91c8-c5c4a0f0bdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:31.202972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc889ac-7d5c-43c5-91c8-c5c4a0f0bdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:31.203496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc889ac-7d5c-43c5-91c8-c5c4a0f0bdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:31.204448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc889ac-7d5c-43c5-91c8-c5c4a0f0bdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:31.206279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc889ac-7d5c-43c5-91c8-c5c4a0f0bdb8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:31.221968 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 2999/5986] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:20:31.225953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc889ac-7d5c-43c5-91c8-c5c4a0f0bdb8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:31.231123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80748c77-5f0d-46be-9ddf-a6e251546ce4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:31.244625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4c5921-51c0-46ee-9b51-5d12b5b2422c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:31.245254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c5921-51c0-46ee-9b51-5d12b5b2422c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:31.245568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c5921-51c0-46ee-9b51-5d12b5b2422c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:31.245847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4c5921-51c0-46ee-9b51-5d12b5b2422c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:31.256201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc889ac-7d5c-43c5-91c8-c5c4a0f0bdb8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:31.266415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c5921-51c0-46ee-9b51-5d12b5b2422c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:31.267027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977937-6830-4d1c-bcdf-9dde93aefc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:31.267757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977937-6830-4d1c-bcdf-9dde93aefc8c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:31.267874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4c5921-51c0-46ee-9b51-5d12b5b2422c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:31.268137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977937-6830-4d1c-bcdf-9dde93aefc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:31.268487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53977937-6830-4d1c-bcdf-9dde93aefc8c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:31.269198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53977937-6830-4d1c-bcdf-9dde93aefc8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:31.271241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53977937-6830-4d1c-bcdf-9dde93aefc8c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:31.294948 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3000/5987] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:31.295253 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2988/5988] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:31.295603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977937-6830-4d1c-bcdf-9dde93aefc8c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:31.326157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53977937-6830-4d1c-bcdf-9dde93aefc8c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:31.344721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ac4e9-8135-477b-b6cb-2358241dfa26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:31.345482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ac4e9-8135-477b-b6cb-2358241dfa26 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:31.345774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ac4e9-8135-477b-b6cb-2358241dfa26 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:31.346060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9ac4e9-8135-477b-b6cb-2358241dfa26 admin admin] PATH_INFO: `/v3/projects/378fdceaf0174f2eba7ef48d6651b0a3/users/c7b50edb770f4c39a4baf21d39bb065f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:31.367025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ac4e9-8135-477b-b6cb-2358241dfa26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=378fdceaf0174f2eba7ef48d6651b0a3, user_id=c7b50edb770f4c39a4baf21d39bb065f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:31.371541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9ac4e9-8135-477b-b6cb-2358241dfa26 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:31.414373 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3001/5989] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:31 2022] PUT /identity/v3/projects/378fdceaf0174f2eba7ef48d6651b0a3/users/c7b50edb770f4c39a4baf21d39bb065f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:31.414929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774c1c3-c8fb-4fa4-a0ce-63211d26e024 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:31.415360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774c1c3-c8fb-4fa4-a0ce-63211d26e024 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:31.415535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c774c1c3-c8fb-4fa4-a0ce-63211d26e024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:31.440183 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:31.474792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c774c1c3-c8fb-4fa4-a0ce-63211d26e024 None None] MFA Rules not processed for user `c7b50edb770f4c39a4baf21d39bb065f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:31.476053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c774c1c3-c8fb-4fa4-a0ce-63211d26e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:31.600144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2989/5990] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:31 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:31.605051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ac4e9-8135-477b-b6cb-2358241dfa26 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:31.649431 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:31.766481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9ac4e9-8135-477b-b6cb-2358241dfa26 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:31.779370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fad2c8-8056-40c6-a03e-f4f4b708a9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:31.781089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad2c8-8056-40c6-a03e-f4f4b708a9cf admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:31.781432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad2c8-8056-40c6-a03e-f4f4b708a9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:31.782869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad2c8-8056-40c6-a03e-f4f4b708a9cf admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:31.783618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fad2c8-8056-40c6-a03e-f4f4b708a9cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:31.812745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fad2c8-8056-40c6-a03e-f4f4b708a9cf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:31.889793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774c1c3-c8fb-4fa4-a0ce-63211d26e024 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:31.895075 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3002/5991] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:31 2022] POST /identity/v3/projects => generated 357 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:31.906335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c774c1c3-c8fb-4fa4-a0ce-63211d26e024 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:32.140871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97941e84-64b9-4516-a3f7-4aaa66c5ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:32.142139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97941e84-64b9-4516-a3f7-4aaa66c5ca0c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:32.142533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97941e84-64b9-4516-a3f7-4aaa66c5ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:32.142917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97941e84-64b9-4516-a3f7-4aaa66c5ca0c admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:32.143700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97941e84-64b9-4516-a3f7-4aaa66c5ca0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:32.154621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97941e84-64b9-4516-a3f7-4aaa66c5ca0c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:32.207951 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2990/5992] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:31 2022] POST /identity/v3/users => generated 285 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:32.211507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fad2c8-8056-40c6-a03e-f4f4b708a9cf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:32.237608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fad2c8-8056-40c6-a03e-f4f4b708a9cf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:32.252806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf50b0-7039-4028-a153-fb29a84b2f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:32.252806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf50b0-7039-4028-a153-fb29a84b2f18 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:32.252806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf50b0-7039-4028-a153-fb29a84b2f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:32.252806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf50b0-7039-4028-a153-fb29a84b2f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:32.253325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf50b0-7039-4028-a153-fb29a84b2f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:32.253620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf50b0-7039-4028-a153-fb29a84b2f18 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:32.280116 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3003/5993] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:32.280926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97941e84-64b9-4516-a3f7-4aaa66c5ca0c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:32.297282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97941e84-64b9-4516-a3f7-4aaa66c5ca0c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:32.312584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f0c6-5ce7-45a8-a1c1-d0628279acd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:32.315033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f0c6-5ce7-45a8-a1c1-d0628279acd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:32.315335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f0c6-5ce7-45a8-a1c1-d0628279acd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:32.315618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793f0c6-5ce7-45a8-a1c1-d0628279acd3 admin admin] PATH_INFO: `/v3/projects/4bf5f41044d84a6eb6ad1f5c455544dd/users/e861e97ffa1541e28dbbc7ea3cc0a5b6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:32.364236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f0c6-5ce7-45a8-a1c1-d0628279acd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf5f41044d84a6eb6ad1f5c455544dd, user_id=e861e97ffa1541e28dbbc7ea3cc0a5b6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:32.374494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793f0c6-5ce7-45a8-a1c1-d0628279acd3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:32.418822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf50b0-7039-4028-a153-fb29a84b2f18 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:32.420069 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2991/5994] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:32 2022] PUT /identity/v3/projects/4bf5f41044d84a6eb6ad1f5c455544dd/users/e861e97ffa1541e28dbbc7ea3cc0a5b6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:32.435161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf50b0-7039-4028-a153-fb29a84b2f18 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:32.466366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f0c6-5ce7-45a8-a1c1-d0628279acd3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:32.472899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c793f0c6-5ce7-45a8-a1c1-d0628279acd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:32.614766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793f0c6-5ce7-45a8-a1c1-d0628279acd3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:32.616447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e372d-9c02-4a7d-a88b-47fa6e7a910e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:32.618063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e372d-9c02-4a7d-a88b-47fa6e7a910e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:32.618361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e372d-9c02-4a7d-a88b-47fa6e7a910e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:32.619291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95e372d-9c02-4a7d-a88b-47fa6e7a910e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:32.623605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e372d-9c02-4a7d-a88b-47fa6e7a910e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:32.627534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95e372d-9c02-4a7d-a88b-47fa6e7a910e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:32.631629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:32.632375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:32.632901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:32.633187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] PATH_INFO: `/v3/projects/5b3d017745684f8c99790939517ad1d1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:32.635907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b3d017745684f8c99790939517ad1d1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:32.638027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:32.640961 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:32.656131 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3004/5995] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:32.662148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e372d-9c02-4a7d-a88b-47fa6e7a910e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:32.696144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95e372d-9c02-4a7d-a88b-47fa6e7a910e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:32.707183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dabfb2-00dc-49a4-ae8c-96933dc6bb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:32.707884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dabfb2-00dc-49a4-ae8c-96933dc6bb6c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:32.708435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dabfb2-00dc-49a4-ae8c-96933dc6bb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:32.708724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dabfb2-00dc-49a4-ae8c-96933dc6bb6c admin admin] PATH_INFO: `/v3/projects/4bf5f41044d84a6eb6ad1f5c455544dd/users/e861e97ffa1541e28dbbc7ea3cc0a5b6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:32.712901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dabfb2-00dc-49a4-ae8c-96933dc6bb6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bf5f41044d84a6eb6ad1f5c455544dd, user_id=e861e97ffa1541e28dbbc7ea3cc0a5b6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:32.716464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dabfb2-00dc-49a4-ae8c-96933dc6bb6c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:32.742357 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3005/5996] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:32 2022] PUT /identity/v3/projects/4bf5f41044d84a6eb6ad1f5c455544dd/users/e861e97ffa1541e28dbbc7ea3cc0a5b6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:32.744353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeaef6-fea5-4934-875f-9a495d3bf9ca None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:32.744647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeaef6-fea5-4934-875f-9a495d3bf9ca None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:32.744925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfeaef6-fea5-4934-875f-9a495d3bf9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:32.772427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b3d017745684f8c99790939517ad1d1', 'request_id': 'req-0c863fc0-f84e-492b-8238-25bd43c4814a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:32.783273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8bfeaef6-fea5-4934-875f-9a495d3bf9ca None None] MFA Rules not processed for user `e861e97ffa1541e28dbbc7ea3cc0a5b6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:32.784166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b3d017745684f8c99790939517ad1d1', 'request_id': 'req-0c863fc0-f84e-492b-8238-25bd43c4814a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:32.784511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8bfeaef6-fea5-4934-875f-9a495d3bf9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:32.810608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b3d017745684f8c99790939517ad1d1', 'request_id': 'req-0c863fc0-f84e-492b-8238-25bd43c4814a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:32.825972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] The token cache is being invalidate because project 5b3d017745684f8c99790939517ad1d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:32.826290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:32.826981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:32.832657 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2992/5997] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:32 2022] DELETE /identity/v3/projects/5b3d017745684f8c99790939517ad1d1 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:32.833671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:32.835679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:32.917771 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:32.932335 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3006/5998] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:32 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:32.936649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeaef6-fea5-4934-875f-9a495d3bf9ca None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:32.959034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfeaef6-fea5-4934-875f-9a495d3bf9ca None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:32.969513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c863fc0-f84e-492b-8238-25bd43c4814a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:32.976726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:32.978042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:32.978602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:32.979153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] PATH_INFO: `/v3/users/e67fe89511c643ada3c0b32ef7c77377` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:32.980574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e67fe89511c643ada3c0b32ef7c77377)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:32.983232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:32.985922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1a9c9-9f2a-4164-afc6-cdb795b62551 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e861e97ffa1541e28dbbc7ea3cc0a5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf5f41044d84a6eb6ad1f5c455544dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:32.986650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a9c9-9f2a-4164-afc6-cdb795b62551 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:32.987112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a9c9-9f2a-4164-afc6-cdb795b62551 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:32.989325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1a9c9-9f2a-4164-afc6-cdb795b62551 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:32.990162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1a9c9-9f2a-4164-afc6-cdb795b62551 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:32.991864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1a9c9-9f2a-4164-afc6-cdb795b62551 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:32.996252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b1a9c9-9f2a-4164-afc6-cdb795b62551 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:33.026001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3007/5999] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:33.028389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1a9c9-9f2a-4164-afc6-cdb795b62551 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:33.050744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1a9c9-9f2a-4164-afc6-cdb795b62551 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:33.064078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1cda4-b29b-44e5-a02f-7b06f682933f tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e861e97ffa1541e28dbbc7ea3cc0a5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf5f41044d84a6eb6ad1f5c455544dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:33.064703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1cda4-b29b-44e5-a02f-7b06f682933f tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:33.064980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1cda4-b29b-44e5-a02f-7b06f682933f tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:33.065253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf1cda4-b29b-44e5-a02f-7b06f682933f tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:33.068624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1cda4-b29b-44e5-a02f-7b06f682933f tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:33.073827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf1cda4-b29b-44e5-a02f-7b06f682933f tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:33.081261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e67fe89511c643ada3c0b32ef7c77377'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:33.094925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e67fe89511c643ada3c0b32ef7c77377'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:33.095811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e67fe89511c643ada3c0b32ef7c77377'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:33.108331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e67fe89511c643ada3c0b32ef7c77377'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:33.128133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a407cef0-68b8-4ece-9f96-9ef0dfa75cd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e67fe89511c643ada3c0b32ef7c77377'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:33.137463 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3008/6000] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:33 2022] POST /identity/v3/projects => generated 350 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:33.139112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1cda4-b29b-44e5-a02f-7b06f682933f tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:33.150524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8cf1cda4-b29b-44e5-a02f-7b06f682933f tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:33.151785 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2993/6001] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:32 2022] DELETE /identity/v3/users/e67fe89511c643ada3c0b32ef7c77377 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:33.260631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf1cda4-b29b-44e5-a02f-7b06f682933f tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:33.271171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4977d-4ce2-4090-86d2-a78e56a6b8dc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:33.271598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4977d-4ce2-4090-86d2-a78e56a6b8dc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:33.272617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d4977d-4ce2-4090-86d2-a78e56a6b8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:33.310132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-38d4977d-4ce2-4090-86d2-a78e56a6b8dc None None] MFA Rules not processed for user `b62fde68e8c747bfbea881c71421c5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:33.311430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-38d4977d-4ce2-4090-86d2-a78e56a6b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:33.324198 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:33.432207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b458c36-fc5a-49be-81b4-38a72bad43aa tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e861e97ffa1541e28dbbc7ea3cc0a5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf5f41044d84a6eb6ad1f5c455544dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:33.440388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b458c36-fc5a-49be-81b4-38a72bad43aa tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:33.440939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b458c36-fc5a-49be-81b4-38a72bad43aa tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:33.441385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b458c36-fc5a-49be-81b4-38a72bad43aa tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:33.441584 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2994/6002] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Oct 24 09:20:33.442246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b458c36-fc5a-49be-81b4-38a72bad43aa tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:33.443113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b458c36-fc5a-49be-81b4-38a72bad43aa tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:33.444979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b458c36-fc5a-49be-81b4-38a72bad43aa tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:33.467480 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3009/6003] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:33.536573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4977d-4ce2-4090-86d2-a78e56a6b8dc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:33.538035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-38d4977d-4ce2-4090-86d2-a78e56a6b8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:33.674198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d4977d-4ce2-4090-86d2-a78e56a6b8dc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:33.686215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f92acb-a664-4c8f-bdca-c9eb2d61f935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:33.687468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f92acb-a664-4c8f-bdca-c9eb2d61f935 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:33.688032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f92acb-a664-4c8f-bdca-c9eb2d61f935 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:33.688324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f92acb-a664-4c8f-bdca-c9eb2d61f935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:33.708416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f92acb-a664-4c8f-bdca-c9eb2d61f935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:33.710096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7f92acb-a664-4c8f-bdca-c9eb2d61f935 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:33.727835 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2995/6004] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:33 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:34.322637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b458c36-fc5a-49be-81b4-38a72bad43aa tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:34.340557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b458c36-fc5a-49be-81b4-38a72bad43aa tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:34.351937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f92acb-a664-4c8f-bdca-c9eb2d61f935 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:34.353650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f7f92acb-a664-4c8f-bdca-c9eb2d61f935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:34.369255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e861e97ffa1541e28dbbc7ea3cc0a5b6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4bf5f41044d84a6eb6ad1f5c455544dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:34.370299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:34.376070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:34.377239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] PATH_INFO: `/v3/projects/f0ec7b5978244cf391b472bbc6c8d427` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:34.382142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f0ec7b5978244cf391b472bbc6c8d427)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:34.391502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:34.488060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0ec7b5978244cf391b472bbc6c8d427', 'request_id': 'req-c2b4f8be-17e0-46d0-9292-a83f725493d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.507266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0ec7b5978244cf391b472bbc6c8d427', 'request_id': 'req-c2b4f8be-17e0-46d0-9292-a83f725493d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.523080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0ec7b5978244cf391b472bbc6c8d427', 'request_id': 'req-c2b4f8be-17e0-46d0-9292-a83f725493d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.524779 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:34.543510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] The token cache is being invalidate because project f0ec7b5978244cf391b472bbc6c8d427 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:34.543946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.546543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c2b4f8be-17e0-46d0-9292-a83f725493d8 tempest-QuotasTest-1806934546 tempest-QuotasTest-1806934546-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.549347 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3010/6005] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:34 2022] DELETE /identity/v3/projects/f0ec7b5978244cf391b472bbc6c8d427 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:34.557263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f92acb-a664-4c8f-bdca-c9eb2d61f935 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:34.677485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:34.677961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:34.678245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:34.678522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] PATH_INFO: `/v3/projects/4d9cbf49012e482fa1e8856b9d683714` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:34.679819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d9cbf49012e482fa1e8856b9d683714)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:34.682614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:34.695227 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:34.827048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d9cbf49012e482fa1e8856b9d683714', 'request_id': 'req-9e5441ac-3c67-4b3c-a075-2d539db46dad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.846664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d9cbf49012e482fa1e8856b9d683714', 'request_id': 'req-9e5441ac-3c67-4b3c-a075-2d539db46dad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.873119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d9cbf49012e482fa1e8856b9d683714', 'request_id': 'req-9e5441ac-3c67-4b3c-a075-2d539db46dad'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.894330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] The token cache is being invalidate because project 4d9cbf49012e482fa1e8856b9d683714 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:34.894630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.901984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9e5441ac-3c67-4b3c-a075-2d539db46dad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:34.903874 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2996/6006] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:34 2022] DELETE /identity/v3/projects/4d9cbf49012e482fa1e8856b9d683714 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:34.908808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac309aa6-147d-4757-80c1-4e12569e9039 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:34.909450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac309aa6-147d-4757-80c1-4e12569e9039 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:34.909943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac309aa6-147d-4757-80c1-4e12569e9039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:34.976584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ac309aa6-147d-4757-80c1-4e12569e9039 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:34.980159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ac309aa6-147d-4757-80c1-4e12569e9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:35.113708 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3011/6007] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:35.118064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaea82-6b2d-48a6-92b9-2ca0470a8cf7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:35.118444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaea82-6b2d-48a6-92b9-2ca0470a8cf7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:35.118735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beaea82-6b2d-48a6-92b9-2ca0470a8cf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:35.129735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac309aa6-147d-4757-80c1-4e12569e9039 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:35.146227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ac309aa6-147d-4757-80c1-4e12569e9039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:35.178665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3beaea82-6b2d-48a6-92b9-2ca0470a8cf7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:35.180462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3beaea82-6b2d-48a6-92b9-2ca0470a8cf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:35.184065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac309aa6-147d-4757-80c1-4e12569e9039 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:35.198237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:35.198753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:35.199039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:35.199319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] PATH_INFO: `/v3/users/c7b50edb770f4c39a4baf21d39bb065f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:35.204900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7b50edb770f4c39a4baf21d39bb065f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:35.206923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:35.220646 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2997/6008] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:35.224823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaea82-6b2d-48a6-92b9-2ca0470a8cf7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:35.255016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beaea82-6b2d-48a6-92b9-2ca0470a8cf7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:35.274898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a637d84-cb50-454e-8d85-55e3adfda2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:35.275524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a637d84-cb50-454e-8d85-55e3adfda2ad admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:35.275802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a637d84-cb50-454e-8d85-55e3adfda2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:35.276078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a637d84-cb50-454e-8d85-55e3adfda2ad admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:35.276784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a637d84-cb50-454e-8d85-55e3adfda2ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:35.277094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a637d84-cb50-454e-8d85-55e3adfda2ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:35.278791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a637d84-cb50-454e-8d85-55e3adfda2ad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:35.303719 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2998/6009] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:20:35.310660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a637d84-cb50-454e-8d85-55e3adfda2ad admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:35.348097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7b50edb770f4c39a4baf21d39bb065f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:35.352644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a637d84-cb50-454e-8d85-55e3adfda2ad admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:35.375466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e9fef-343e-4725-849c-2abbb78cf703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:35.376002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e9fef-343e-4725-849c-2abbb78cf703 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:35.376287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e9fef-343e-4725-849c-2abbb78cf703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:35.377429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0e9fef-343e-4725-849c-2abbb78cf703 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:35.378096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e9fef-343e-4725-849c-2abbb78cf703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:35.384912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0e9fef-343e-4725-849c-2abbb78cf703 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:35.391090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7b50edb770f4c39a4baf21d39bb065f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:35.392296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7b50edb770f4c39a4baf21d39bb065f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:35.408127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7b50edb770f4c39a4baf21d39bb065f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:35.422731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16f58360-3cf5-4ca8-8222-71ebfa870d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7b50edb770f4c39a4baf21d39bb065f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:35.444938 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3012/6010] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:35 2022] DELETE /identity/v3/users/c7b50edb770f4c39a4baf21d39bb065f => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:35.447762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d499-f37a-45a8-84c9-b801b8942863 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:35.448621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d499-f37a-45a8-84c9-b801b8942863 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:35.448913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295d499-f37a-45a8-84c9-b801b8942863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:35.456132 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 2999/6011] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:35 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:35.457215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e9fef-343e-4725-849c-2abbb78cf703 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:35.462131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4d0e9fef-343e-4725-849c-2abbb78cf703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:35.514384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1295d499-f37a-45a8-84c9-b801b8942863 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:35.518483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1295d499-f37a-45a8-84c9-b801b8942863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:35.673799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0e9fef-343e-4725-849c-2abbb78cf703 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:35.685955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1402193-5207-4c5e-adbc-76db70e027a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:35.687424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1402193-5207-4c5e-adbc-76db70e027a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:35.688044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1402193-5207-4c5e-adbc-76db70e027a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:35.688572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1402193-5207-4c5e-adbc-76db70e027a6 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:35.712237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1402193-5207-4c5e-adbc-76db70e027a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:35.725243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1402193-5207-4c5e-adbc-76db70e027a6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:35.763767 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3013/6012] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:35.820336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d499-f37a-45a8-84c9-b801b8942863 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:35.829819 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3000/6013] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:35 2022] POST /identity/v3/users => generated 283 bytes in 373 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:35.830009 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:35.847143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1402193-5207-4c5e-adbc-76db70e027a6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:35.849352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295d499-f37a-45a8-84c9-b801b8942863 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:35.851124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b1402193-5207-4c5e-adbc-76db70e027a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:35.867627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e380757-6d56-4122-baa2-5298bf6adf6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:35.869028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e380757-6d56-4122-baa2-5298bf6adf6a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:35.870707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e380757-6d56-4122-baa2-5298bf6adf6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:35.871148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e380757-6d56-4122-baa2-5298bf6adf6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:35.871920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e380757-6d56-4122-baa2-5298bf6adf6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:35.876897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e380757-6d56-4122-baa2-5298bf6adf6a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:35.914068 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3014/6014] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:35.915142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e380757-6d56-4122-baa2-5298bf6adf6a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:35.940306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e380757-6d56-4122-baa2-5298bf6adf6a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:35.957344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae6f0-8f25-4700-8c55-33b186129ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:35.958130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae6f0-8f25-4700-8c55-33b186129ec8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:35.958543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae6f0-8f25-4700-8c55-33b186129ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:35.958919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041ae6f0-8f25-4700-8c55-33b186129ec8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:35.959713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ae6f0-8f25-4700-8c55-33b186129ec8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:35.965841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041ae6f0-8f25-4700-8c55-33b186129ec8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:35.978747 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:35.996779 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3015/6015] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:35 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:35.997825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae6f0-8f25-4700-8c55-33b186129ec8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:36.014832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1402193-5207-4c5e-adbc-76db70e027a6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:36.021994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914b7529-c8de-4d65-9fbd-140f1a04c6b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:36.022962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7529-c8de-4d65-9fbd-140f1a04c6b5 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:36.025263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7529-c8de-4d65-9fbd-140f1a04c6b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:36.025696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914b7529-c8de-4d65-9fbd-140f1a04c6b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:36.026709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041ae6f0-8f25-4700-8c55-33b186129ec8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:36.041724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf029c89-eea3-41d0-ba72-6004633894bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:36.042530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf029c89-eea3-41d0-ba72-6004633894bd admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:36.042914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf029c89-eea3-41d0-ba72-6004633894bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:36.043299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf029c89-eea3-41d0-ba72-6004633894bd admin admin] PATH_INFO: `/v3/projects/ab8ce69237384ae39671609620447a36/users/6d1e5f0278274dc1813e66fec8759d61/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:36.047423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b7529-c8de-4d65-9fbd-140f1a04c6b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:36.053675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914b7529-c8de-4d65-9fbd-140f1a04c6b5 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:36.092194 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3001/6016] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:36.099974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf029c89-eea3-41d0-ba72-6004633894bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab8ce69237384ae39671609620447a36, user_id=6d1e5f0278274dc1813e66fec8759d61, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:36.102950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf029c89-eea3-41d0-ba72-6004633894bd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:36.131677 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3016/6017] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:35 2022] PUT /identity/v3/projects/ab8ce69237384ae39671609620447a36/users/6d1e5f0278274dc1813e66fec8759d61/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:36.148030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d3a2a-7197-46de-8f0d-1acd9a41db81 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:36.149445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d3a2a-7197-46de-8f0d-1acd9a41db81 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:36.149859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d3a2a-7197-46de-8f0d-1acd9a41db81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:36.223204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf029c89-eea3-41d0-ba72-6004633894bd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:36.225426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cf029c89-eea3-41d0-ba72-6004633894bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:36.236500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b96d3a2a-7197-46de-8f0d-1acd9a41db81 None None] MFA Rules not processed for user `6d1e5f0278274dc1813e66fec8759d61`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:36.237750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b96d3a2a-7197-46de-8f0d-1acd9a41db81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:36.407079 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3002/6018] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:36.411662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d3a2a-7197-46de-8f0d-1acd9a41db81 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:36.486231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf029c89-eea3-41d0-ba72-6004633894bd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:36.502956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:36.503829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:36.505678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:36.506601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:36.511514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:36.544124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d3a2a-7197-46de-8f0d-1acd9a41db81 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:36.547783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:36.553162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a6678-1742-462f-a42d-ccad27d0ef8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:36.553674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:36.555755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a6678-1742-462f-a42d-ccad27d0ef8a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:36.556203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a6678-1742-462f-a42d-ccad27d0ef8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:36.556884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a6678-1742-462f-a42d-ccad27d0ef8a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:36.557766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a6678-1742-462f-a42d-ccad27d0ef8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:36.574583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a6678-1742-462f-a42d-ccad27d0ef8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:36.589143 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3017/6019] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:36.590169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:36.596862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:36.642462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f16791-ae19-4847-9d2a-ef43e8416a28 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:36.654005 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3003/6020] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:36 2022] POST /identity/v3/projects => generated 367 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:36.657980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a6678-1742-462f-a42d-ccad27d0ef8a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:36.661636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:36.662695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:36.663218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:36.663751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] PATH_INFO: `/v3/users/de6929c304ff4260b9e7c4d469b71a0d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:36.667894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] RBAC: Authorizing `identity:delete_user(user_id=de6929c304ff4260b9e7c4d469b71a0d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:36.672221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:36.803208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de6929c304ff4260b9e7c4d469b71a0d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:36.831718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de6929c304ff4260b9e7c4d469b71a0d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:36.833579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de6929c304ff4260b9e7c4d469b71a0d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:36.852284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de6929c304ff4260b9e7c4d469b71a0d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:36.865868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de6929c304ff4260b9e7c4d469b71a0d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:36.897365 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3018/6021] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:36 2022] DELETE /identity/v3/users/de6929c304ff4260b9e7c4d469b71a0d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:36.946934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a6678-1742-462f-a42d-ccad27d0ef8a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:36.967613 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:37.124273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3612c2f-4487-4a6e-a9a8-c54f9351b398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:37.124908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3612c2f-4487-4a6e-a9a8-c54f9351b398 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:37.125196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3612c2f-4487-4a6e-a9a8-c54f9351b398 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:37.125497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3612c2f-4487-4a6e-a9a8-c54f9351b398 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:37.128915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3612c2f-4487-4a6e-a9a8-c54f9351b398 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:37.130921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3612c2f-4487-4a6e-a9a8-c54f9351b398 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:37.181609 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3004/6022] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:36 2022] POST /identity/v3/users => generated 290 bytes in 524 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:37.183786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:37.186262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:37.218672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6c3a40-2859-4c97-a21f-ab7e389a178f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:37.235680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880971cc-60a9-4394-bdc1-a3e5189190fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:37.236374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880971cc-60a9-4394-bdc1-a3e5189190fc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:37.236631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880971cc-60a9-4394-bdc1-a3e5189190fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:37.237448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880971cc-60a9-4394-bdc1-a3e5189190fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:37.238047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880971cc-60a9-4394-bdc1-a3e5189190fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:37.240174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-880971cc-60a9-4394-bdc1-a3e5189190fc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:37.265696 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3019/6023] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:37.270411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3612c2f-4487-4a6e-a9a8-c54f9351b398 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:37.282660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3612c2f-4487-4a6e-a9a8-c54f9351b398 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:37.288085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe5e77-24cd-449e-988b-4973f452d6b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:37.289110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5e77-24cd-449e-988b-4973f452d6b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:37.289523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5e77-24cd-449e-988b-4973f452d6b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:37.289893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbe5e77-24cd-449e-988b-4973f452d6b2 admin admin] PATH_INFO: `/v3/projects/026916db32034831bba78a7e7216f9c1/users/092f48b0b88c4de6bc9f3f09de4913bb/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:37.310411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe5e77-24cd-449e-988b-4973f452d6b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026916db32034831bba78a7e7216f9c1, user_id=092f48b0b88c4de6bc9f3f09de4913bb, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:37.313364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbe5e77-24cd-449e-988b-4973f452d6b2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:37.348023 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3005/6024] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:37 2022] PUT /identity/v3/projects/026916db32034831bba78a7e7216f9c1/users/092f48b0b88c4de6bc9f3f09de4913bb/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:37.351950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880971cc-60a9-4394-bdc1-a3e5189190fc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:37.365619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880971cc-60a9-4394-bdc1-a3e5189190fc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:37.375408 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:37.478290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74eed49c-e7a4-446a-82c4-ec260297a79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:37.479659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed49c-e7a4-446a-82c4-ec260297a79a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:37.480149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed49c-e7a4-446a-82c4-ec260297a79a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:37.480657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74eed49c-e7a4-446a-82c4-ec260297a79a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:37.481427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed49c-e7a4-446a-82c4-ec260297a79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:37.483150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74eed49c-e7a4-446a-82c4-ec260297a79a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:37.500730 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3020/6025] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:37 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:37.505063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe5e77-24cd-449e-988b-4973f452d6b2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:37.525424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbe5e77-24cd-449e-988b-4973f452d6b2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:37.537733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d208179-1650-4bf6-b69e-632558c96561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:37.538569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d208179-1650-4bf6-b69e-632558c96561 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:37.538954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d208179-1650-4bf6-b69e-632558c96561 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:37.539346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d208179-1650-4bf6-b69e-632558c96561 admin admin] PATH_INFO: `/v3/projects/026916db32034831bba78a7e7216f9c1/users/092f48b0b88c4de6bc9f3f09de4913bb/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:37.542322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d208179-1650-4bf6-b69e-632558c96561 admin admin] RBAC: Authorizing `identity:create_grant(project_id=026916db32034831bba78a7e7216f9c1, user_id=092f48b0b88c4de6bc9f3f09de4913bb, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:37.547831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d208179-1650-4bf6-b69e-632558c96561 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:37.580730 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3006/6026] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:37 2022] PUT /identity/v3/projects/026916db32034831bba78a7e7216f9c1/users/092f48b0b88c4de6bc9f3f09de4913bb/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:37.585520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906fc39-4da3-47a9-a516-ca5bc9438d14 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:37.585985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906fc39-4da3-47a9-a516-ca5bc9438d14 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:37.588503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9906fc39-4da3-47a9-a516-ca5bc9438d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:37.619800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d208179-1650-4bf6-b69e-632558c96561 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:37.623006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1d208179-1650-4bf6-b69e-632558c96561 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:37.670519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9906fc39-4da3-47a9-a516-ca5bc9438d14 None None] MFA Rules not processed for user `092f48b0b88c4de6bc9f3f09de4913bb`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:37.674445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9906fc39-4da3-47a9-a516-ca5bc9438d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:37.836595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d208179-1650-4bf6-b69e-632558c96561 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:37.849109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:37.851028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:37.851313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:37.854248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] PATH_INFO: `/v3/projects/378fdceaf0174f2eba7ef48d6651b0a3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:37.856465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=378fdceaf0174f2eba7ef48d6651b0a3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:37.862312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:37.870265 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3021/6027] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:37 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:37.876147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906fc39-4da3-47a9-a516-ca5bc9438d14 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:37.889467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9906fc39-4da3-47a9-a516-ca5bc9438d14 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:37.896518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383caf47-8acc-4e60-8502-02067fa3a707 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:37.897714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383caf47-8acc-4e60-8502-02067fa3a707 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:37.898371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383caf47-8acc-4e60-8502-02067fa3a707 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:37.899211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383caf47-8acc-4e60-8502-02067fa3a707 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:37.899384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383caf47-8acc-4e60-8502-02067fa3a707 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:37.901376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383caf47-8acc-4e60-8502-02067fa3a707 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:37.929370 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3022/6028] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:37 2022] POST /identity/v3/roles => generated 235 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:37.942686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383caf47-8acc-4e60-8502-02067fa3a707 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:37.960229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383caf47-8acc-4e60-8502-02067fa3a707 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:37.971594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d9a80-b7e6-4c80-a9ea-f96687f7ff1d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:37.972281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d9a80-b7e6-4c80-a9ea-f96687f7ff1d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:37.972590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d9a80-b7e6-4c80-a9ea-f96687f7ff1d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:37.973471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4d9a80-b7e6-4c80-a9ea-f96687f7ff1d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:37.974442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d9a80-b7e6-4c80-a9ea-f96687f7ff1d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:37.980366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4d9a80-b7e6-4c80-a9ea-f96687f7ff1d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:38.013342 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3023/6029] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:37 2022] POST /identity/v3/roles => generated 235 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:38.014639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d9a80-b7e6-4c80-a9ea-f96687f7ff1d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:38.017699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3a4d9a80-b7e6-4c80-a9ea-f96687f7ff1d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:38.035350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4d9a80-b7e6-4c80-a9ea-f96687f7ff1d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:38.047699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '378fdceaf0174f2eba7ef48d6651b0a3', 'request_id': 'req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.059969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '378fdceaf0174f2eba7ef48d6651b0a3', 'request_id': 'req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.076099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '378fdceaf0174f2eba7ef48d6651b0a3', 'request_id': 'req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.080071 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=6,keystone:DELETE=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:38.098158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] The token cache is being invalidate because project 378fdceaf0174f2eba7ef48d6651b0a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:38.098712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.099608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.102876 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3007/6030] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:37 2022] DELETE /identity/v3/projects/378fdceaf0174f2eba7ef48d6651b0a3 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:38.104110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:38.105890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:38.126190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:38.126849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:38.127127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:38.127401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] PATH_INFO: `/v3/projects/7ee7511c75374ba599216666ba191e9e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:38.128830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ee7511c75374ba599216666ba191e9e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:38.131995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:38.134781 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:38.208765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19869335-fd25-4ea0-a07a-5a1e7e1a78fe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:38.209216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ee7511c75374ba599216666ba191e9e', 'request_id': 'req-dc8f7f54-7d05-460a-8937-cc8331acac49'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.220590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ee7511c75374ba599216666ba191e9e', 'request_id': 'req-dc8f7f54-7d05-460a-8937-cc8331acac49'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.231335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ee7511c75374ba599216666ba191e9e', 'request_id': 'req-dc8f7f54-7d05-460a-8937-cc8331acac49'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.246300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] The token cache is being invalidate because project 7ee7511c75374ba599216666ba191e9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:38.246475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.247318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.254589 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3024/6031] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:38 2022] DELETE /identity/v3/projects/7ee7511c75374ba599216666ba191e9e => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:38.254589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:38.254589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:38.321958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671791ef-a4e7-4ed3-b8fe-e273691a7287 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:38.323329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671791ef-a4e7-4ed3-b8fe-e273691a7287 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:38.324447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671791ef-a4e7-4ed3-b8fe-e273691a7287 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:38.325434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671791ef-a4e7-4ed3-b8fe-e273691a7287 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:38.327709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671791ef-a4e7-4ed3-b8fe-e273691a7287 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:38.330259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671791ef-a4e7-4ed3-b8fe-e273691a7287 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:38.358762 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3008/6032] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:38 2022] POST /identity/v3/roles => generated 234 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:38.360734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671791ef-a4e7-4ed3-b8fe-e273691a7287 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:38.370407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-671791ef-a4e7-4ed3-b8fe-e273691a7287 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:38.406104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8f7f54-7d05-460a-8937-cc8331acac49 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:38.412631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff209f0-be57-4c31-b70c-f2ff9bb54db2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:38.413265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff209f0-be57-4c31-b70c-f2ff9bb54db2 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:38.413605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff209f0-be57-4c31-b70c-f2ff9bb54db2 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:38.413913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff209f0-be57-4c31-b70c-f2ff9bb54db2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:38.415762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eff209f0-be57-4c31-b70c-f2ff9bb54db2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:38.444303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff209f0-be57-4c31-b70c-f2ff9bb54db2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:38.449374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff209f0-be57-4c31-b70c-f2ff9bb54db2 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:38.463230 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3025/6033] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:38.464760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c7c2-daa4-4787-a927-60651f3578fa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:38.465597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c7c2-daa4-4787-a927-60651f3578fa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:38.466063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b1c7c2-daa4-4787-a927-60651f3578fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:38.506825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b2b1c7c2-daa4-4787-a927-60651f3578fa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:38.508558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2b1c7c2-daa4-4787-a927-60651f3578fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:38.543279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671791ef-a4e7-4ed3-b8fe-e273691a7287 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:38.554045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:38.555254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:38.558308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:38.558623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] PATH_INFO: `/v3/users/e861e97ffa1541e28dbbc7ea3cc0a5b6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:38.563153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e861e97ffa1541e28dbbc7ea3cc0a5b6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:38.569552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:38.606585 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3026/6034] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:38.608306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c7c2-daa4-4787-a927-60651f3578fa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:38.609746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2b1c7c2-daa4-4787-a927-60651f3578fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:38.628303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b1c7c2-daa4-4787-a927-60651f3578fa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:38.639113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd002d-b1ec-488c-bf1f-82a54dc68e99 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:38.641772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd002d-b1ec-488c-bf1f-82a54dc68e99 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:38.642072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd002d-b1ec-488c-bf1f-82a54dc68e99 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:38.644373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd002d-b1ec-488c-bf1f-82a54dc68e99 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:38.658106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd002d-b1ec-488c-bf1f-82a54dc68e99 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:38.663290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd002d-b1ec-488c-bf1f-82a54dc68e99 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:38.707459 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:38.707754 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3027/6035] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:20:38 2022] POST /identity/v3/domains => generated 277 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:38.709149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502f1e-8b9b-4f03-ae90-47bdb842ea3d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:38.710756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502f1e-8b9b-4f03-ae90-47bdb842ea3d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:38.712183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06502f1e-8b9b-4f03-ae90-47bdb842ea3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:38.731184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e861e97ffa1541e28dbbc7ea3cc0a5b6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.754944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-06502f1e-8b9b-4f03-ae90-47bdb842ea3d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:38.757145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-06502f1e-8b9b-4f03-ae90-47bdb842ea3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:38.766966 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:38.775564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e861e97ffa1541e28dbbc7ea3cc0a5b6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.779066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e861e97ffa1541e28dbbc7ea3cc0a5b6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.803574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e861e97ffa1541e28dbbc7ea3cc0a5b6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.837904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e861e97ffa1541e28dbbc7ea3cc0a5b6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:38.846941 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3009/6036] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:38 2022] DELETE /identity/v3/users/e861e97ffa1541e28dbbc7ea3cc0a5b6 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:38.851725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:38.855544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:38.923923 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3028/6037] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:38.925353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06502f1e-8b9b-4f03-ae90-47bdb842ea3d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:38.938607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06502f1e-8b9b-4f03-ae90-47bdb842ea3d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:38.995684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3adb2ca-a469-4ca6-9e73-f4c7363f072a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.011359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dfadb-07ba-4fd1-9828-6cbb6681e118 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.012039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dfadb-07ba-4fd1-9828-6cbb6681e118 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.012356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dfadb-07ba-4fd1-9828-6cbb6681e118 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.012650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3dfadb-07ba-4fd1-9828-6cbb6681e118 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.014035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dfadb-07ba-4fd1-9828-6cbb6681e118 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.016303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3dfadb-07ba-4fd1-9828-6cbb6681e118 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.039559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf3946-2d39-4120-8e64-e54f2f06ed82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.041109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3946-2d39-4120-8e64-e54f2f06ed82 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.042219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3946-2d39-4120-8e64-e54f2f06ed82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.042666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3946-2d39-4120-8e64-e54f2f06ed82 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.044186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf3946-2d39-4120-8e64-e54f2f06ed82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:39.044680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf3946-2d39-4120-8e64-e54f2f06ed82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.047015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf3946-2d39-4120-8e64-e54f2f06ed82 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.067014 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3029/6038] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:39.068027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf3946-2d39-4120-8e64-e54f2f06ed82 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.073045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3010/6039] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:38 2022] POST /identity/v3/projects => generated 400 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:39.077805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dfadb-07ba-4fd1-9828-6cbb6681e118 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.083960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf3946-2d39-4120-8e64-e54f2f06ed82 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.222773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feebb0-987b-44db-9af3-21809eb0aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.224231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feebb0-987b-44db-9af3-21809eb0aefb admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.226042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feebb0-987b-44db-9af3-21809eb0aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.227517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6feebb0-987b-44db-9af3-21809eb0aefb admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.228807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6feebb0-987b-44db-9af3-21809eb0aefb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.230411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3dfadb-07ba-4fd1-9828-6cbb6681e118 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.232824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6feebb0-987b-44db-9af3-21809eb0aefb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.236345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c80532-a26e-4ce9-8dd9-2ace3eebc2f2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.237009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c80532-a26e-4ce9-8dd9-2ace3eebc2f2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.237315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c80532-a26e-4ce9-8dd9-2ace3eebc2f2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.237593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c80532-a26e-4ce9-8dd9-2ace3eebc2f2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.238646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c80532-a26e-4ce9-8dd9-2ace3eebc2f2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.240851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c80532-a26e-4ce9-8dd9-2ace3eebc2f2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.274774 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3011/6040] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:20:39 2022] POST /identity/v3/groups => generated 301 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:39.276291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c80532-a26e-4ce9-8dd9-2ace3eebc2f2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.289937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c80532-a26e-4ce9-8dd9-2ace3eebc2f2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.296654 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3030/6041] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:39 2022] POST /identity/v3/projects => generated 403 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:39.298331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feebb0-987b-44db-9af3-21809eb0aefb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.320285 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:39.346992 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:39.376140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1537996-e6a3-469f-a7c9-45254dcca518 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.377582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1537996-e6a3-469f-a7c9-45254dcca518 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.378437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1537996-e6a3-469f-a7c9-45254dcca518 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.379023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1537996-e6a3-469f-a7c9-45254dcca518 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.380321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1537996-e6a3-469f-a7c9-45254dcca518 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.383292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1537996-e6a3-469f-a7c9-45254dcca518 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.394516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6feebb0-987b-44db-9af3-21809eb0aefb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.401562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7b8e9-97bb-4518-8aa6-f5432d49fc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.402180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7b8e9-97bb-4518-8aa6-f5432d49fc87 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.402459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7b8e9-97bb-4518-8aa6-f5432d49fc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.402705 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3012/6042] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:39 2022] POST /identity/v3/roles => generated 235 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:39.405547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f7b8e9-97bb-4518-8aa6-f5432d49fc87 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.406356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7b8e9-97bb-4518-8aa6-f5432d49fc87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.407487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1537996-e6a3-469f-a7c9-45254dcca518 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.412208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f7b8e9-97bb-4518-8aa6-f5432d49fc87 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.433144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1537996-e6a3-469f-a7c9-45254dcca518 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.439843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84717a-fafb-4d25-bd6c-e54b852ce7e2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.442191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84717a-fafb-4d25-bd6c-e54b852ce7e2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.442191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84717a-fafb-4d25-bd6c-e54b852ce7e2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.442409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a84717a-fafb-4d25-bd6c-e54b852ce7e2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.443038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84717a-fafb-4d25-bd6c-e54b852ce7e2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.445386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a84717a-fafb-4d25-bd6c-e54b852ce7e2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.475306 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3013/6043] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:39 2022] POST /identity/v3/users => generated 442 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:39.489072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84717a-fafb-4d25-bd6c-e54b852ce7e2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.503405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a84717a-fafb-4d25-bd6c-e54b852ce7e2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.509675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd129-a8da-4315-8bf4-f52837b67113 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.510519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd129-a8da-4315-8bf4-f52837b67113 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.510821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd129-a8da-4315-8bf4-f52837b67113 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.511151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801fd129-a8da-4315-8bf4-f52837b67113 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.511889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fd129-a8da-4315-8bf4-f52837b67113 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.516740 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-801fd129-a8da-4315-8bf4-f52837b67113 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:39.516740 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:39.516740 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:39.517894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801fd129-a8da-4315-8bf4-f52837b67113 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.520613 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3031/6044] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:39 2022] POST /identity/v3/users => generated 302 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:39.528920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7b8e9-97bb-4518-8aa6-f5432d49fc87 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.542816 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3014/6045] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:39 2022] POST /identity/v3/roles => generated 270 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:39.544050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd129-a8da-4315-8bf4-f52837b67113 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.562671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801fd129-a8da-4315-8bf4-f52837b67113 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.569244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f7b8e9-97bb-4518-8aa6-f5432d49fc87 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.569843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2796d3c-3322-4f0d-b184-9ab560a98b50 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.570981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2796d3c-3322-4f0d-b184-9ab560a98b50 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.571436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2796d3c-3322-4f0d-b184-9ab560a98b50 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.571789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2796d3c-3322-4f0d-b184-9ab560a98b50 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/5cbaafe7dc774a96aa88d80d92db6001` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.588990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430b345-65bb-480e-839d-e965cb1b2fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.589648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430b345-65bb-480e-839d-e965cb1b2fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.589937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430b345-65bb-480e-839d-e965cb1b2fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.590216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430b345-65bb-480e-839d-e965cb1b2fc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.590947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430b345-65bb-480e-839d-e965cb1b2fc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.592583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430b345-65bb-480e-839d-e965cb1b2fc9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.593009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2796d3c-3322-4f0d-b184-9ab560a98b50 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=5cbaafe7dc774a96aa88d80d92db6001)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.595811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2796d3c-3322-4f0d-b184-9ab560a98b50 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.628551 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3015/6046] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:39 2022] PUT /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/5cbaafe7dc774a96aa88d80d92db6001 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:39.632804 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3032/6047] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:39 2022] GET /identity/v3/roles => generated 2323 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:39.636817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2796d3c-3322-4f0d-b184-9ab560a98b50 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.640438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430b345-65bb-480e-839d-e965cb1b2fc9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.669811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430b345-65bb-480e-839d-e965cb1b2fc9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.755784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2796d3c-3322-4f0d-b184-9ab560a98b50 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.780814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa62ab-5cf2-4390-8a09-cce6ae1e8cc2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.781660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa62ab-5cf2-4390-8a09-cce6ae1e8cc2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.785285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa62ab-5cf2-4390-8a09-cce6ae1e8cc2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.785756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afa62ab-5cf2-4390-8a09-cce6ae1e8cc2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.786671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa62ab-5cf2-4390-8a09-cce6ae1e8cc2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Adding query filter params (scope.project.id=0dfa5a59a9884edabcf68760aa9b82c1, user.id=7833d6ec0847403d9c4eb7e304ea2ed7) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:39.787239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa62ab-5cf2-4390-8a09-cce6ae1e8cc2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.789899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7afa62ab-5cf2-4390-8a09-cce6ae1e8cc2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.839802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe05e9-e6de-4067-aa81-4eaeb19f986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.840530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe05e9-e6de-4067-aa81-4eaeb19f986f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.840889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe05e9-e6de-4067-aa81-4eaeb19f986f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.841257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fe05e9-e6de-4067-aa81-4eaeb19f986f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.841994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe05e9-e6de-4067-aa81-4eaeb19f986f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.845342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fe05e9-e6de-4067-aa81-4eaeb19f986f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.887349 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3033/6048] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:39 2022] GET /identity/v3/roles => generated 2323 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:39.905272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe05e9-e6de-4067-aa81-4eaeb19f986f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.915139 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3016/6049] 10.222.0.25 () {58 vars in 1356 bytes} [Mon Oct 24 09:20:39 2022] GET /identity/v3/role_assignments?scope.project.id=0dfa5a59a9884edabcf68760aa9b82c1&user.id=7833d6ec0847403d9c4eb7e304ea2ed7&effective => generated 228 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:39.919590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa62ab-5cf2-4390-8a09-cce6ae1e8cc2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:39.922996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fe05e9-e6de-4067-aa81-4eaeb19f986f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.930343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957cfa-a5dc-40ee-af79-279de3996c24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.931339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957cfa-a5dc-40ee-af79-279de3996c24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.931339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957cfa-a5dc-40ee-af79-279de3996c24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.931558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66957cfa-a5dc-40ee-af79-279de3996c24 admin admin] PATH_INFO: `/v3/projects/2c8ce157c4484e0589e60ca576db2420/users/2fce59a2a5dc4c24b1c3eccc77fd77f0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.955992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7afa62ab-5cf2-4390-8a09-cce6ae1e8cc2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:39.965178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66957cfa-a5dc-40ee-af79-279de3996c24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c8ce157c4484e0589e60ca576db2420, user_id=2fce59a2a5dc4c24b1c3eccc77fd77f0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.968062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66957cfa-a5dc-40ee-af79-279de3996c24 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.977347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c21b3-524b-4734-9faf-9a70ad27da9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:39.978054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c21b3-524b-4734-9faf-9a70ad27da9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:39.978663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c21b3-524b-4734-9faf-9a70ad27da9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:39.979115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c21b3-524b-4734-9faf-9a70ad27da9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/5cbaafe7dc774a96aa88d80d92db6001` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:39.985996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c21b3-524b-4734-9faf-9a70ad27da9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=5cbaafe7dc774a96aa88d80d92db6001)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:39.985996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c21b3-524b-4734-9faf-9a70ad27da9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:39.991187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b36c21b3-524b-4734-9faf-9a70ad27da9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role 5cbaafe7dc774a96aa88d80d92db6001 was removed from user 7833d6ec0847403d9c4eb7e304ea2ed7 on project 0dfa5a59a9884edabcf68760aa9b82c1. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:39.991485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b36c21b3-524b-4734-9faf-9a70ad27da9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:39.992828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b36c21b3-524b-4734-9faf-9a70ad27da9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:40.001082 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3034/6050] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:39 2022] PUT /identity/v3/projects/2c8ce157c4484e0589e60ca576db2420/users/2fce59a2a5dc4c24b1c3eccc77fd77f0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:40.002537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957cfa-a5dc-40ee-af79-279de3996c24 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:40.004413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-66957cfa-a5dc-40ee-af79-279de3996c24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:40.017091 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3017/6051] 10.222.0.25 () {58 vars in 1467 bytes} [Mon Oct 24 09:20:39 2022] DELETE /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/5cbaafe7dc774a96aa88d80d92db6001 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:40.023533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ad9a2-5310-4f4e-aa32-bf75bf119bfa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:40.023533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ad9a2-5310-4f4e-aa32-bf75bf119bfa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:40.023916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7ad9a2-5310-4f4e-aa32-bf75bf119bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:40.041882 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:40.086629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7d7ad9a2-5310-4f4e-aa32-bf75bf119bfa None None] MFA Rules not processed for user `2fce59a2a5dc4c24b1c3eccc77fd77f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:40.087868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7d7ad9a2-5310-4f4e-aa32-bf75bf119bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:40.133829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66957cfa-a5dc-40ee-af79-279de3996c24 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:40.185330 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:40.246365 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3018/6052] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:40 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:40.246365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ad9a2-5310-4f4e-aa32-bf75bf119bfa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:40.247754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7d7ad9a2-5310-4f4e-aa32-bf75bf119bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:40.275965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:40.278299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:40.278800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:40.280205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] PATH_INFO: `/v3/projects/4bf5f41044d84a6eb6ad1f5c455544dd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:40.281988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bf5f41044d84a6eb6ad1f5c455544dd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:40.284430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:40.352146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7ad9a2-5310-4f4e-aa32-bf75bf119bfa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:40.359660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:40.359660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:40.359660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:40.360109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/5cbaafe7dc774a96aa88d80d92db6001` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:40.360808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=5cbaafe7dc774a96aa88d80d92db6001)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:40.362123 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:40.362123 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:40.362123 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:40.363948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:40.381462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bf5f41044d84a6eb6ad1f5c455544dd', 'request_id': 'req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:40.407229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bf5f41044d84a6eb6ad1f5c455544dd', 'request_id': 'req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:40.421277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role 5cbaafe7dc774a96aa88d80d92db6001 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:40.421630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:40.422433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:40.423399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bf5f41044d84a6eb6ad1f5c455544dd', 'request_id': 'req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:40.424658 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3019/6053] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:40 2022] DELETE /identity/v3/roles/5cbaafe7dc774a96aa88d80d92db6001 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:40.431640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:40.431640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:40.444667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] The token cache is being invalidate because project 4bf5f41044d84a6eb6ad1f5c455544dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:40.445901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:40.447407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:40.449706 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3035/6054] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:40 2022] DELETE /identity/v3/projects/4bf5f41044d84a6eb6ad1f5c455544dd => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:40.451207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:40.454400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:40.527236 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:40.539172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7706e32-0013-4c38-a9d8-d9b922ded213 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:40.550252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57f3f6c-28c0-4b7c-b251-d309d3d74606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:40.552920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f3f6c-28c0-4b7c-b251-d309d3d74606 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:40.553236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f3f6c-28c0-4b7c-b251-d309d3d74606 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:40.553576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57f3f6c-28c0-4b7c-b251-d309d3d74606 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:40.554237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f3f6c-28c0-4b7c-b251-d309d3d74606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:40.557652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57f3f6c-28c0-4b7c-b251-d309d3d74606 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:40.596193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e6bf63-c971-4eef-b83c-cd17bdac89c5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:40.601864 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3020/6055] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:40 2022] POST /identity/v3/projects => generated 403 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:40.603555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbc537-b11d-45b5-9d82-2c5c3417d9c4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:40.603934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbc537-b11d-45b5-9d82-2c5c3417d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:40.604208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdbc537-b11d-45b5-9d82-2c5c3417d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:40.629579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-dfdbc537-b11d-45b5-9d82-2c5c3417d9c4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:40.631308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dfdbc537-b11d-45b5-9d82-2c5c3417d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:40.674749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568c36b-9d5e-4851-bb1a-8d40d5c71972 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:40.676787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568c36b-9d5e-4851-bb1a-8d40d5c71972 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:40.678278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568c36b-9d5e-4851-bb1a-8d40d5c71972 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:40.678934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568c36b-9d5e-4851-bb1a-8d40d5c71972 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/254839460d35451bb5422643abab1e3c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:40.682793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568c36b-9d5e-4851-bb1a-8d40d5c71972 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=254839460d35451bb5422643abab1e3c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:40.686343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568c36b-9d5e-4851-bb1a-8d40d5c71972 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:40.700543 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:40.720526 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3036/6056] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:40 2022] PUT /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/254839460d35451bb5422643abab1e3c => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:40.721671 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3021/6057] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:40.723273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568c36b-9d5e-4851-bb1a-8d40d5c71972 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:40.725774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a568c36b-9d5e-4851-bb1a-8d40d5c71972 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:40.730307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbc537-b11d-45b5-9d82-2c5c3417d9c4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:40.816288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdbc537-b11d-45b5-9d82-2c5c3417d9c4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:40.874618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568c36b-9d5e-4851-bb1a-8d40d5c71972 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:40.885231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc36807-9053-4e87-ab4b-39870c3fec8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:40.887497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc36807-9053-4e87-ab4b-39870c3fec8a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:40.887734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc36807-9053-4e87-ab4b-39870c3fec8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:40.888011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc36807-9053-4e87-ab4b-39870c3fec8a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:40.888657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc36807-9053-4e87-ab4b-39870c3fec8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:40.913510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc36807-9053-4e87-ab4b-39870c3fec8a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:40.970481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d373330-4318-4fdc-9b7f-c260436020d7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:40.971150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d373330-4318-4fdc-9b7f-c260436020d7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:40.971431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d373330-4318-4fdc-9b7f-c260436020d7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:40.971709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d373330-4318-4fdc-9b7f-c260436020d7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:40.972710 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3037/6058] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:40 2022] POST /identity/v3/users => generated 308 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:40.974058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23391d-8b57-44d3-ac65-6b97ffead661 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:40.974419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23391d-8b57-44d3-ac65-6b97ffead661 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:40.976040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d373330-4318-4fdc-9b7f-c260436020d7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:40.977140 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-7d373330-4318-4fdc-9b7f-c260436020d7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:40.977140 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:40.977140 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:40.978063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d373330-4318-4fdc-9b7f-c260436020d7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:40.979518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe23391d-8b57-44d3-ac65-6b97ffead661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.014659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fe23391d-8b57-44d3-ac65-6b97ffead661 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:41.017418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fe23391d-8b57-44d3-ac65-6b97ffead661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:41.036717 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3022/6059] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:40 2022] PUT /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 521 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:41.037769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d373330-4318-4fdc-9b7f-c260436020d7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.041647 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3038/6060] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:41.042696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23391d-8b57-44d3-ac65-6b97ffead661 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.077584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe23391d-8b57-44d3-ac65-6b97ffead661 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.083517 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:41.199911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d373330-4318-4fdc-9b7f-c260436020d7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.211242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57973f-7353-4314-8fa2-3b5b93b1ff43 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:41.212283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7d685-0cb2-459f-9d6a-36bcc1fe84c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:41.212902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7d685-0cb2-459f-9d6a-36bcc1fe84c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:41.213178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7d685-0cb2-459f-9d6a-36bcc1fe84c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:41.213472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d7d685-0cb2-459f-9d6a-36bcc1fe84c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.213997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57973f-7353-4314-8fa2-3b5b93b1ff43 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:41.214267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57973f-7353-4314-8fa2-3b5b93b1ff43 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:41.214535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b57973f-7353-4314-8fa2-3b5b93b1ff43 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.215259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57973f-7353-4314-8fa2-3b5b93b1ff43 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Adding query filter params (scope.project.id=0dfa5a59a9884edabcf68760aa9b82c1, user.id=7833d6ec0847403d9c4eb7e304ea2ed7) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:41.215560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57973f-7353-4314-8fa2-3b5b93b1ff43 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:41.216248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7d685-0cb2-459f-9d6a-36bcc1fe84c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:41.219581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b57973f-7353-4314-8fa2-3b5b93b1ff43 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:41.221677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d7d685-0cb2-459f-9d6a-36bcc1fe84c7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:41.246209 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3023/6061] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:41 2022] GET /identity/v3/roles => generated 2323 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:41.247132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7d685-0cb2-459f-9d6a-36bcc1fe84c7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.273839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d7d685-0cb2-459f-9d6a-36bcc1fe84c7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.285389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ceed2-3314-46c0-b7fd-13757cd64647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:41.286220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ceed2-3314-46c0-b7fd-13757cd64647 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:41.286520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ceed2-3314-46c0-b7fd-13757cd64647 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:41.288205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9ceed2-3314-46c0-b7fd-13757cd64647 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.288537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ceed2-3314-46c0-b7fd-13757cd64647 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:41.288982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ceed2-3314-46c0-b7fd-13757cd64647 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:41.290688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9ceed2-3314-46c0-b7fd-13757cd64647 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:41.321972 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3024/6062] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:41.322789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ceed2-3314-46c0-b7fd-13757cd64647 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.337341 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3039/6063] 10.222.0.25 () {58 vars in 1356 bytes} [Mon Oct 24 09:20:41 2022] GET /identity/v3/role_assignments?scope.project.id=0dfa5a59a9884edabcf68760aa9b82c1&user.id=7833d6ec0847403d9c4eb7e304ea2ed7&effective => generated 1061 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:41.340824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57973f-7353-4314-8fa2-3b5b93b1ff43 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.361800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9ceed2-3314-46c0-b7fd-13757cd64647 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.370041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b57973f-7353-4314-8fa2-3b5b93b1ff43 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.373460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9290a11-7214-4a2b-97e8-e30e743a6225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:41.374116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9290a11-7214-4a2b-97e8-e30e743a6225 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:41.374732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9290a11-7214-4a2b-97e8-e30e743a6225 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:41.375010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9290a11-7214-4a2b-97e8-e30e743a6225 admin admin] PATH_INFO: `/v3/projects/7eeadb69b1e34bd490fc482cfc229588/users/6be08cc851ba43d192a8e72d3c7298e6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.381985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81a95b-4c7e-48f6-af06-66091b6ff6a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:41.383259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81a95b-4c7e-48f6-af06-66091b6ff6a6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:41.383508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81a95b-4c7e-48f6-af06-66091b6ff6a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:41.383776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f81a95b-4c7e-48f6-af06-66091b6ff6a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.384416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81a95b-4c7e-48f6-af06-66091b6ff6a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:41.392754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f81a95b-4c7e-48f6-af06-66091b6ff6a6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:41.414517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9290a11-7214-4a2b-97e8-e30e743a6225 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eeadb69b1e34bd490fc482cfc229588, user_id=6be08cc851ba43d192a8e72d3c7298e6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:41.417244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9290a11-7214-4a2b-97e8-e30e743a6225 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:41.450925 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3025/6064] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:41 2022] PUT /identity/v3/projects/7eeadb69b1e34bd490fc482cfc229588/users/6be08cc851ba43d192a8e72d3c7298e6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:41.454731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9290a11-7214-4a2b-97e8-e30e743a6225 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.462308 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3040/6065] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:41 2022] POST /identity/v3/projects => generated 367 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:41.463818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81a95b-4c7e-48f6-af06-66091b6ff6a6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.506885 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:41.600039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9290a11-7214-4a2b-97e8-e30e743a6225 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.606139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f81a95b-4c7e-48f6-af06-66091b6ff6a6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.614255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74be1-a39d-49bc-98a4-fd14b37e605a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:41.615321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74be1-a39d-49bc-98a4-fd14b37e605a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:41.615811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74be1-a39d-49bc-98a4-fd14b37e605a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:41.616290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e74be1-a39d-49bc-98a4-fd14b37e605a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.617960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e74be1-a39d-49bc-98a4-fd14b37e605a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:41.620454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e74be1-a39d-49bc-98a4-fd14b37e605a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:41.640050 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3041/6066] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:41 2022] GET /identity/v3/roles => generated 2323 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:41.641244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74be1-a39d-49bc-98a4-fd14b37e605a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.656475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e74be1-a39d-49bc-98a4-fd14b37e605a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.671654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d738-aab0-4e0e-a215-724bc6600505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:41.674305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d738-aab0-4e0e-a215-724bc6600505 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:41.676765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d738-aab0-4e0e-a215-724bc6600505 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:41.677757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2638d738-aab0-4e0e-a215-724bc6600505 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.680556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d738-aab0-4e0e-a215-724bc6600505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:41.689122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2638d738-aab0-4e0e-a215-724bc6600505 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:41.732672 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3042/6067] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:41 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:41.734793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d738-aab0-4e0e-a215-724bc6600505 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.755710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c39ddf-c1c9-4bc8-8c90-01a1140882bc tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:41.758246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c39ddf-c1c9-4bc8-8c90-01a1140882bc tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:41.760598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c39ddf-c1c9-4bc8-8c90-01a1140882bc tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:41.760954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c39ddf-c1c9-4bc8-8c90-01a1140882bc tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.764104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c39ddf-c1c9-4bc8-8c90-01a1140882bc tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:41.764508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2638d738-aab0-4e0e-a215-724bc6600505 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.769611 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-b3c39ddf-c1c9-4bc8-8c90-01a1140882bc tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:41.769611 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:41.769611 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:41.769611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c39ddf-c1c9-4bc8-8c90-01a1140882bc tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:41.778272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751b0fc-3bb2-4a3c-a402-2f77d2ea36d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:41.780240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751b0fc-3bb2-4a3c-a402-2f77d2ea36d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:41.780599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751b0fc-3bb2-4a3c-a402-2f77d2ea36d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:41.781217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751b0fc-3bb2-4a3c-a402-2f77d2ea36d8 admin admin] PATH_INFO: `/v3/projects/7eeadb69b1e34bd490fc482cfc229588/users/6be08cc851ba43d192a8e72d3c7298e6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:41.785741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751b0fc-3bb2-4a3c-a402-2f77d2ea36d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eeadb69b1e34bd490fc482cfc229588, user_id=6be08cc851ba43d192a8e72d3c7298e6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:41.795255 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3026/6068] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:41 2022] DELETE /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:41.795255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c39ddf-c1c9-4bc8-8c90-01a1140882bc tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.799120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751b0fc-3bb2-4a3c-a402-2f77d2ea36d8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:41.825379 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3043/6069] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:41 2022] PUT /identity/v3/projects/7eeadb69b1e34bd490fc482cfc229588/users/6be08cc851ba43d192a8e72d3c7298e6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:41.826784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751b0fc-3bb2-4a3c-a402-2f77d2ea36d8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:41.886044 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:41.988329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c39ddf-c1c9-4bc8-8c90-01a1140882bc tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:41.994657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751b0fc-3bb2-4a3c-a402-2f77d2ea36d8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.009076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982f7ef-9a7a-4654-a07d-51ed50b5a285 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.009652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982f7ef-9a7a-4654-a07d-51ed50b5a285 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.009932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982f7ef-9a7a-4654-a07d-51ed50b5a285 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.010204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982f7ef-9a7a-4654-a07d-51ed50b5a285 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/role_assignments` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.010934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982f7ef-9a7a-4654-a07d-51ed50b5a285 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Adding query filter params (scope.project.id=0dfa5a59a9884edabcf68760aa9b82c1, user.id=7833d6ec0847403d9c4eb7e304ea2ed7) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:42.011246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982f7ef-9a7a-4654-a07d-51ed50b5a285 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.014268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6982f7ef-9a7a-4654-a07d-51ed50b5a285 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.086132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc667f5-1ddd-4504-b0b4-1d84200dc6fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.086753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc667f5-1ddd-4504-b0b4-1d84200dc6fd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.089434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc667f5-1ddd-4504-b0b4-1d84200dc6fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.089982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc667f5-1ddd-4504-b0b4-1d84200dc6fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.091220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc667f5-1ddd-4504-b0b4-1d84200dc6fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.094752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc667f5-1ddd-4504-b0b4-1d84200dc6fd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.120119 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3044/6070] 10.222.0.25 () {58 vars in 1356 bytes} [Mon Oct 24 09:20:41 2022] GET /identity/v3/role_assignments?scope.project.id=0dfa5a59a9884edabcf68760aa9b82c1&user.id=7833d6ec0847403d9c4eb7e304ea2ed7&effective => generated 577 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:42.120119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88626-b118-4b30-b2fe-abba336043de None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.120119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88626-b118-4b30-b2fe-abba336043de None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.120119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c88626-b118-4b30-b2fe-abba336043de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.125610 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3027/6071] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:41 2022] GET /identity/v3/roles => generated 2323 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:42.126807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc667f5-1ddd-4504-b0b4-1d84200dc6fd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.151936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc667f5-1ddd-4504-b0b4-1d84200dc6fd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.159520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29b0d5-8a29-4e31-af9e-a88d2d48b0e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.165163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b0d5-8a29-4e31-af9e-a88d2d48b0e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.165801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b0d5-8a29-4e31-af9e-a88d2d48b0e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.166419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f29b0d5-8a29-4e31-af9e-a88d2d48b0e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.169021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29b0d5-8a29-4e31-af9e-a88d2d48b0e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.170976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f29b0d5-8a29-4e31-af9e-a88d2d48b0e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.173924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-78c88626-b118-4b30-b2fe-abba336043de None None] MFA Rules not processed for user `6be08cc851ba43d192a8e72d3c7298e6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:42.175755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-78c88626-b118-4b30-b2fe-abba336043de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-7f29b0d5-8a29-4e31-af9e-a88d2d48b0e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] 254839460d35451bb5422643abab1e3c does not imply 9e650076b70f4b9a91acc8e605bca3e8.: keystone.exception.ImpliedRoleNotFound: 254839460d35451bb5422643abab1e3c does not imply 9e650076b70f4b9a91acc8e605bca3e8. Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = query.one() Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._iter().one() Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._only_one_row( Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:42.210056 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 24 09:20:42.211592 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 24 09:20:42.212535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 24 09:20:42.212535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 24 09:20:42.212535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 24 09:20:42.212535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 254839460d35451bb5422643abab1e3c does not imply 9e650076b70f4b9a91acc8e605bca3e8. Oct 24 09:20:42.212535 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:42.215236 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3028/6072] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:42 2022] DELETE /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 137 bytes in 89 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:20:42.216381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29b0d5-8a29-4e31-af9e-a88d2d48b0e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.219676 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:42.258579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f29b0d5-8a29-4e31-af9e-a88d2d48b0e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.265553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60015442-793a-42f6-a674-0489c7c74876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.266501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60015442-793a-42f6-a674-0489c7c74876 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.267793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60015442-793a-42f6-a674-0489c7c74876 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.269322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60015442-793a-42f6-a674-0489c7c74876 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.270751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60015442-793a-42f6-a674-0489c7c74876 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.272675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60015442-793a-42f6-a674-0489c7c74876 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.281669 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3045/6073] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:42 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:42.282285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c88626-b118-4b30-b2fe-abba336043de None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.293578 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3029/6074] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:42 2022] GET /identity/v3/roles => generated 2323 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:42.294781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60015442-793a-42f6-a674-0489c7c74876 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.296186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c88626-b118-4b30-b2fe-abba336043de None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.307649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.308343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.308626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.308904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/254839460d35451bb5422643abab1e3c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.311338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=254839460d35451bb5422643abab1e3c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.314246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.315682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60015442-793a-42f6-a674-0489c7c74876 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.321610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role 254839460d35451bb5422643abab1e3c was removed from user 7833d6ec0847403d9c4eb7e304ea2ed7 on project 0dfa5a59a9884edabcf68760aa9b82c1. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:42.321901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:42.322600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:42.324515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda7bfb-45ac-4f95-bdec-817c88594655 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6be08cc851ba43d192a8e72d3c7298e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eeadb69b1e34bd490fc482cfc229588', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.325416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda7bfb-45ac-4f95-bdec-817c88594655 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.326523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda7bfb-45ac-4f95-bdec-817c88594655 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.327688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fda7bfb-45ac-4f95-bdec-817c88594655 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.329134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda7bfb-45ac-4f95-bdec-817c88594655 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.336070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fda7bfb-45ac-4f95-bdec-817c88594655 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.341809 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3046/6075] 10.222.0.25 () {58 vars in 1467 bytes} [Mon Oct 24 09:20:42 2022] DELETE /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/254839460d35451bb5422643abab1e3c => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:42.342701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.345562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:42.365370 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3030/6076] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:42 2022] POST /identity/v3/roles => generated 240 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:42.378113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda7bfb-45ac-4f95-bdec-817c88594655 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.383336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9fda7bfb-45ac-4f95-bdec-817c88594655 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:42.404838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fda7bfb-45ac-4f95-bdec-817c88594655 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.438747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd5d2af-dc97-4ac5-80de-4e89571923d4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.458814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc92ea-af64-4ccf-a3e0-e1a6656dab53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.459517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc92ea-af64-4ccf-a3e0-e1a6656dab53 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.459800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc92ea-af64-4ccf-a3e0-e1a6656dab53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.463082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fc92ea-af64-4ccf-a3e0-e1a6656dab53 admin admin] PATH_INFO: `/v3/projects/8db2e29d48ff402da2a8838e7a1ea354/users/61dee6c659b540b38533e9d3a345c457/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.476084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b760-a19e-4119-80b8-029585d534d2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.477506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b760-a19e-4119-80b8-029585d534d2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.477999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b760-a19e-4119-80b8-029585d534d2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.478342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c99b760-a19e-4119-80b8-029585d534d2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.479088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99b760-a19e-4119-80b8-029585d534d2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.481103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c99b760-a19e-4119-80b8-029585d534d2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.481238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc92ea-af64-4ccf-a3e0-e1a6656dab53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8db2e29d48ff402da2a8838e7a1ea354, user_id=61dee6c659b540b38533e9d3a345c457, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.484115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fc92ea-af64-4ccf-a3e0-e1a6656dab53 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.503588 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3031/6077] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:42 2022] POST /identity/v3/roles => generated 271 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:42.504781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b760-a19e-4119-80b8-029585d534d2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.507352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c99b760-a19e-4119-80b8-029585d534d2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:42.514019 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3047/6078] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:42 2022] PUT /identity/v3/projects/8db2e29d48ff402da2a8838e7a1ea354/users/61dee6c659b540b38533e9d3a345c457/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:42.515946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc92ea-af64-4ccf-a3e0-e1a6656dab53 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.563486 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:42.595764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fc92ea-af64-4ccf-a3e0-e1a6656dab53 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.602163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b677611d-0c51-4dd0-810d-bd85390ffd74 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.602935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677611d-0c51-4dd0-810d-bd85390ffd74 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.603326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677611d-0c51-4dd0-810d-bd85390ffd74 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.603710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b677611d-0c51-4dd0-810d-bd85390ffd74 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.604538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677611d-0c51-4dd0-810d-bd85390ffd74 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Adding query filter params (domain_id=6731c601059646e797f14361fdc8bdf7) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:42.604965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677611d-0c51-4dd0-810d-bd85390ffd74 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.606129 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-b677611d-0c51-4dd0-810d-bd85390ffd74 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domain_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:42.606129 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:42.606129 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:42.607523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b677611d-0c51-4dd0-810d-bd85390ffd74 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.618275 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3048/6079] 10.222.0.25 () {58 vars in 1207 bytes} [Mon Oct 24 09:20:42 2022] GET /identity/v3/roles?domain_id=6731c601059646e797f14361fdc8bdf7 => generated 408 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:42.619904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb1a1-6132-4138-a1c8-8bd41e94fa74 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.620343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb1a1-6132-4138-a1c8-8bd41e94fa74 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.620965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffafb1a1-6132-4138-a1c8-8bd41e94fa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.662972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ffafb1a1-6132-4138-a1c8-8bd41e94fa74 None None] MFA Rules not processed for user `61dee6c659b540b38533e9d3a345c457`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:42.665475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ffafb1a1-6132-4138-a1c8-8bd41e94fa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:42.679229 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:42.686070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c99b760-a19e-4119-80b8-029585d534d2 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.767230 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3049/6080] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:42.769286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafb1a1-6132-4138-a1c8-8bd41e94fa74 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.792168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffafb1a1-6132-4138-a1c8-8bd41e94fa74 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:42.797610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.798634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.799133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.799606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/bde927b58dcc4b718a6375bf7a8076d7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.800984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=bde927b58dcc4b718a6375bf7a8076d7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.802590 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_domain_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:42.802590 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:42.802590 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:42.805045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.833227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc76e8-eb04-45db-b83d-c1832cccfcb6 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6be08cc851ba43d192a8e72d3c7298e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eeadb69b1e34bd490fc482cfc229588', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:42.833940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc76e8-eb04-45db-b83d-c1832cccfcb6 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:42.834222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc76e8-eb04-45db-b83d-c1832cccfcb6 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:42.834499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc76e8-eb04-45db-b83d-c1832cccfcb6 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] PATH_INFO: `/v3/projects/2c8ce157c4484e0589e60ca576db2420/users/2fce59a2a5dc4c24b1c3eccc77fd77f0/roles/802fc734f1ec4e4b9971d56ba4899a8c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:42.838175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc76e8-eb04-45db-b83d-c1832cccfcb6 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] RBAC: Authorizing `identity:create_grant(project_id=2c8ce157c4484e0589e60ca576db2420, user_id=2fce59a2a5dc4c24b1c3eccc77fd77f0, role_id=802fc734f1ec4e4b9971d56ba4899a8c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:42.840841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc76e8-eb04-45db-b83d-c1832cccfcb6 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:42.866366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role bde927b58dcc4b718a6375bf7a8076d7 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:42.866679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:42.868721 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3032/6081] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:42 2022] PUT /identity/v3/projects/2c8ce157c4484e0589e60ca576db2420/users/2fce59a2a5dc4c24b1c3eccc77fd77f0/roles/802fc734f1ec4e4b9971d56ba4899a8c => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:42.869919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc76e8-eb04-45db-b83d-c1832cccfcb6 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.870833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:42.873478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-70cc76e8-eb04-45db-b83d-c1832cccfcb6 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:42.876609 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3050/6082] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:42 2022] DELETE /identity/v3/roles/bde927b58dcc4b718a6375bf7a8076d7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:42.885958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:42.890726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:43.013223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc76e8-eb04-45db-b83d-c1832cccfcb6 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:43.032551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba749eb4-17e5-4e46-aee9-8a5340973a8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:43.040416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8da5c-a9c5-474a-bea7-afbc87ab96ca tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fce59a2a5dc4c24b1c3eccc77fd77f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8ce157c4484e0589e60ca576db2420', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1384457160', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:43.042127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8da5c-a9c5-474a-bea7-afbc87ab96ca tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:43.042718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8da5c-a9c5-474a-bea7-afbc87ab96ca tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:43.043399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f8da5c-a9c5-474a-bea7-afbc87ab96ca tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] PATH_INFO: `/v3/users/2fce59a2a5dc4c24b1c3eccc77fd77f0/application_credentials` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:43.044307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8da5c-a9c5-474a-bea7-afbc87ab96ca tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] RBAC: Authorizing `identity:create_application_credential(user_id=2fce59a2a5dc4c24b1c3eccc77fd77f0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:43.046584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f8da5c-a9c5-474a-bea7-afbc87ab96ca tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:43.156595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731f5461-a2e2-4fab-9eed-c8cbfc1e4f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:43.157322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f5461-a2e2-4fab-9eed-c8cbfc1e4f09 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:43.157598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f5461-a2e2-4fab-9eed-c8cbfc1e4f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:43.157875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731f5461-a2e2-4fab-9eed-c8cbfc1e4f09 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:43.158610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f5461-a2e2-4fab-9eed-c8cbfc1e4f09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:43.160628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731f5461-a2e2-4fab-9eed-c8cbfc1e4f09 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:43.173552 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3051/6083] 10.222.0.25 () {60 vars in 1315 bytes} [Mon Oct 24 09:20:42 2022] POST /identity/v3/users/2fce59a2a5dc4c24b1c3eccc77fd77f0/application_credentials => generated 660 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:43.174889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8da5c-a9c5-474a-bea7-afbc87ab96ca tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:43.177450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-64f8da5c-a9c5-474a-bea7-afbc87ab96ca tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:43.189644 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:43.201241 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:43.223323 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3033/6084] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:42 2022] POST /identity/v3/projects => generated 367 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:43.224691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ab7fd-330f-4e67-b711-325715ce0199 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:43.224811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ab7fd-330f-4e67-b711-325715ce0199 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:43.226593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7ab7fd-330f-4e67-b711-325715ce0199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:43.285084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cf7ab7fd-330f-4e67-b711-325715ce0199 None None] MFA Rules not processed for user `2fce59a2a5dc4c24b1c3eccc77fd77f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:43.288502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cf7ab7fd-330f-4e67-b711-325715ce0199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:43.311312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f8da5c-a9c5-474a-bea7-afbc87ab96ca tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:43.467811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca1177-5b48-401c-bcd0-11671a15fb58 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:43.468634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca1177-5b48-401c-bcd0-11671a15fb58 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:43.468915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca1177-5b48-401c-bcd0-11671a15fb58 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:43.469189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca1177-5b48-401c-bcd0-11671a15fb58 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:43.474104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca1177-5b48-401c-bcd0-11671a15fb58 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Adding query filter params (domain_id=6731c601059646e797f14361fdc8bdf7) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:43.475017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca1177-5b48-401c-bcd0-11671a15fb58 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_domain_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:43.479427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bca1177-5b48-401c-bcd0-11671a15fb58 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:43.494036 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3052/6085] 10.222.0.25 () {58 vars in 1207 bytes} [Mon Oct 24 09:20:43 2022] GET /identity/v3/roles?domain_id=6731c601059646e797f14361fdc8bdf7 => generated 148 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:43.494907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca1177-5b48-401c-bcd0-11671a15fb58 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:43.593524 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3034/6086] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:43 2022] POST /identity/v3/auth/tokens => generated 3397 bytes in 369 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 24 09:20:43.606770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ab7fd-330f-4e67-b711-325715ce0199 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:43.626762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7ab7fd-330f-4e67-b711-325715ce0199 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:43.632052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ed02-5845-4148-a108-9bc1ae832934 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:43.633264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ed02-5845-4148-a108-9bc1ae832934 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:43.633582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ed02-5845-4148-a108-9bc1ae832934 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:43.633863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e1ed02-5845-4148-a108-9bc1ae832934 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/bde927b58dcc4b718a6375bf7a8076d7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:43.647991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca1177-5b48-401c-bcd0-11671a15fb58 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:43.651924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e1ed02-5845-4148-a108-9bc1ae832934 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:20:43.653869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cd045-b74b-4b3b-8d78-10e969dfddd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:43.655943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cd045-b74b-4b3b-8d78-10e969dfddd0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:43.656182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cd045-b74b-4b3b-8d78-10e969dfddd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:43.656507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91cd045-b74b-4b3b-8d78-10e969dfddd0 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:43.657332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cd045-b74b-4b3b-8d78-10e969dfddd0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-40e1ed02-5845-4148-a108-9bc1ae832934 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Could not find role: bde927b58dcc4b718a6375bf7a8076d7.: keystone.exception.RoleNotFound: Could not find role: bde927b58dcc4b718a6375bf7a8076d7. Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 165, in delete Oct 24 09:20:43.658038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_role') Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:20:43.658920 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: bde927b58dcc4b718a6375bf7a8076d7. Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:43.659877 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3035/6087] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:43 2022] DELETE /identity/v3/roles/bde927b58dcc4b718a6375bf7a8076d7 => generated 110 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:20:43.660680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ed02-5845-4148-a108-9bc1ae832934 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:43.663893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91cd045-b74b-4b3b-8d78-10e969dfddd0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:43.700407 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3053/6088] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:43 2022] POST /identity/v3/users => generated 290 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:43.702533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cd045-b74b-4b3b-8d78-10e969dfddd0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:43.728808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91cd045-b74b-4b3b-8d78-10e969dfddd0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:43.738117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74876e4d-d14c-47bd-8053-6f22bb6ff459 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:43.740141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74876e4d-d14c-47bd-8053-6f22bb6ff459 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:43.743450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74876e4d-d14c-47bd-8053-6f22bb6ff459 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:43.743915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74876e4d-d14c-47bd-8053-6f22bb6ff459 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:43.752570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74876e4d-d14c-47bd-8053-6f22bb6ff459 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6731c601059646e797f14361fdc8bdf7, group_id=dbc2e77628f34db6a8cad3feb6ef9373, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:43.755729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74876e4d-d14c-47bd-8053-6f22bb6ff459 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:43.788593 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3054/6089] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:43 2022] PUT /identity/v3/domains/6731c601059646e797f14361fdc8bdf7/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:43.791340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74876e4d-d14c-47bd-8053-6f22bb6ff459 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:43.796123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e1ed02-5845-4148-a108-9bc1ae832934 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:43.853656 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:43.891294 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:43.933271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74876e4d-d14c-47bd-8053-6f22bb6ff459 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:43.939562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc6b1-fc40-43c2-8951-f16c8c8f14de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:43.940584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc6b1-fc40-43c2-8951-f16c8c8f14de admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:43.941130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc6b1-fc40-43c2-8951-f16c8c8f14de admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:43.941593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85bc6b1-fc40-43c2-8951-f16c8c8f14de admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:43.942745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bc6b1-fc40-43c2-8951-f16c8c8f14de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:43.945518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85bc6b1-fc40-43c2-8951-f16c8c8f14de admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:43.949471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051252a5-18e2-44e8-9f84-583b63dc7559 tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2fce59a2a5dc4c24b1c3eccc77fd77f0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c8ce157c4484e0589e60ca576db2420', 'project_domain_id': 'default', 'roles': ['tempest-test_role-1384457160', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:43.950143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051252a5-18e2-44e8-9f84-583b63dc7559 tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:43.950422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051252a5-18e2-44e8-9f84-583b63dc7559 tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:43.950696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051252a5-18e2-44e8-9f84-583b63dc7559 tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] PATH_INFO: `/v3/users/2fce59a2a5dc4c24b1c3eccc77fd77f0/application_credentials/986dc3fdb70042dd9cc04f9a983a53c8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:43.952411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051252a5-18e2-44e8-9f84-583b63dc7559 tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] RBAC: Authorizing `identity:delete_application_credential(user_id=2fce59a2a5dc4c24b1c3eccc77fd77f0, application_credential_id=986dc3fdb70042dd9cc04f9a983a53c8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:43.953962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051252a5-18e2-44e8-9f84-583b63dc7559 tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:43.977168 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3055/6090] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:43 2022] GET /identity/v3/roles => generated 2554 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:43.977168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc6b1-fc40-43c2-8951-f16c8c8f14de admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:43.997262 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3036/6091] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:20:43 2022] DELETE /identity/v3/users/2fce59a2a5dc4c24b1c3eccc77fd77f0/application_credentials/986dc3fdb70042dd9cc04f9a983a53c8 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:43.998173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051252a5-18e2-44e8-9f84-583b63dc7559 tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:44.027677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051252a5-18e2-44e8-9f84-583b63dc7559 tempest-ApplicationCredentialsV3AdminTest-1326908472 tempest-ApplicationCredentialsV3AdminTest-1326908472-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:44.044009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1458-c3dd-4eb3-8fb9-8837fd632ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:44.077856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1458-c3dd-4eb3-8fb9-8837fd632ab5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:44.078479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1458-c3dd-4eb3-8fb9-8837fd632ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:44.080504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c1458-c3dd-4eb3-8fb9-8837fd632ab5 admin admin] PATH_INFO: `/v3/projects/fba565653ae843e38f31a9b7ededfc9f/users/0ae38d5dc821452f98a6e1f8f899e980/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:44.138745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c1458-c3dd-4eb3-8fb9-8837fd632ab5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba565653ae843e38f31a9b7ededfc9f, user_id=0ae38d5dc821452f98a6e1f8f899e980, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:44.146959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c1458-c3dd-4eb3-8fb9-8837fd632ab5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:44.174598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85bc6b1-fc40-43c2-8951-f16c8c8f14de admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:44.185446 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3037/6092] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:43 2022] PUT /identity/v3/projects/fba565653ae843e38f31a9b7ededfc9f/users/0ae38d5dc821452f98a6e1f8f899e980/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:44.187606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1458-c3dd-4eb3-8fb9-8837fd632ab5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:44.193811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5c1c1458-c3dd-4eb3-8fb9-8837fd632ab5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:44.326556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8044a4-4bea-4b61-a482-772425fa4713 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:44.326938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8044a4-4bea-4b61-a482-772425fa4713 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:44.327331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8044a4-4bea-4b61-a482-772425fa4713 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:44.327918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8044a4-4bea-4b61-a482-772425fa4713 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:44.332778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8044a4-4bea-4b61-a482-772425fa4713 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6731c601059646e797f14361fdc8bdf7, group_id=dbc2e77628f34db6a8cad3feb6ef9373)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:44.334567 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-7f8044a4-4bea-4b61-a482-772425fa4713 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_grants": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:reader and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:44.334567 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:44.334567 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:44.337994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f8044a4-4bea-4b61-a482-772425fa4713 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:44.361640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c1458-c3dd-4eb3-8fb9-8837fd632ab5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:44.375895 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3056/6093] 10.222.0.25 () {58 vars in 1365 bytes} [Mon Oct 24 09:20:43 2022] GET /identity/v3/domains/6731c601059646e797f14361fdc8bdf7/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles => generated 410 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:44.375895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8044a4-4bea-4b61-a482-772425fa4713 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:44.376198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6be08cc851ba43d192a8e72d3c7298e6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eeadb69b1e34bd490fc482cfc229588', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:44.376198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:44.376198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:44.377518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] PATH_INFO: `/v3/roles/802fc734f1ec4e4b9971d56ba4899a8c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:44.379368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] RBAC: Authorizing `identity:delete_role(role_id=802fc734f1ec4e4b9971d56ba4899a8c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:44.383432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:44.464252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Invalidating the token cache because role 802fc734f1ec4e4b9971d56ba4899a8c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:44.464686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:44.466034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:44.474045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3038/6094] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:44 2022] DELETE /identity/v3/roles/802fc734f1ec4e4b9971d56ba4899a8c => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:44.476705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:44.479215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:44.546786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8044a4-4bea-4b61-a482-772425fa4713 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:44.561056 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:44.616747 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:44.650093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5e073-fae7-45c9-b37b-3c1ed646f467 tempest-ApplicationCredentialsV3AdminTest-1109268383 tempest-ApplicationCredentialsV3AdminTest-1109268383-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:44.657551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d682acd-64d0-4e93-9d7a-dd0abd05f1ec tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:44.658248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d682acd-64d0-4e93-9d7a-dd0abd05f1ec tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:44.658550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d682acd-64d0-4e93-9d7a-dd0abd05f1ec tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:44.658979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d682acd-64d0-4e93-9d7a-dd0abd05f1ec tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:44.666715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9003-8cfb-4df4-b267-b006bd0ea2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:44.667493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d682acd-64d0-4e93-9d7a-dd0abd05f1ec tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6731c601059646e797f14361fdc8bdf7, group_id=dbc2e77628f34db6a8cad3feb6ef9373, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:44.667653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9003-8cfb-4df4-b267-b006bd0ea2d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:44.667893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9003-8cfb-4df4-b267-b006bd0ea2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:44.668243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790a9003-8cfb-4df4-b267-b006bd0ea2d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:44.669032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9003-8cfb-4df4-b267-b006bd0ea2d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:44.670901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790a9003-8cfb-4df4-b267-b006bd0ea2d9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:44.671284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d682acd-64d0-4e93-9d7a-dd0abd05f1ec tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:44.691945 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3039/6095] 10.222.0.25 () {58 vars in 1465 bytes} [Mon Oct 24 09:20:44 2022] HEAD /identity/v3/domains/6731c601059646e797f14361fdc8bdf7/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:44.691945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d682acd-64d0-4e93-9d7a-dd0abd05f1ec tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:44.692237 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3057/6096] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:44 2022] GET /identity/v3/roles => generated 2323 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:44.692934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9003-8cfb-4df4-b267-b006bd0ea2d9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:44.693078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2d682acd-64d0-4e93-9d7a-dd0abd05f1ec tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:44.696786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-790a9003-8cfb-4df4-b267-b006bd0ea2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:44.714678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790a9003-8cfb-4df4-b267-b006bd0ea2d9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:44.720949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d682acd-64d0-4e93-9d7a-dd0abd05f1ec tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:44.722090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b3bd9-fe45-4e05-97d4-29dc9a190c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:44.723045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b3bd9-fe45-4e05-97d4-29dc9a190c0b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:44.723408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b3bd9-fe45-4e05-97d4-29dc9a190c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:44.723863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b3bd9-fe45-4e05-97d4-29dc9a190c0b admin admin] PATH_INFO: `/v3/projects/fba565653ae843e38f31a9b7ededfc9f/users/0ae38d5dc821452f98a6e1f8f899e980/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:44.727230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b3bd9-fe45-4e05-97d4-29dc9a190c0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=fba565653ae843e38f31a9b7ededfc9f, user_id=0ae38d5dc821452f98a6e1f8f899e980, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:44.731510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b3bd9-fe45-4e05-97d4-29dc9a190c0b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:44.737258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:44.737922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:44.738197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:44.738560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] PATH_INFO: `/v3/users/2fce59a2a5dc4c24b1c3eccc77fd77f0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:44.746222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fce59a2a5dc4c24b1c3eccc77fd77f0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:44.750139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:44.757655 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3058/6097] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:44 2022] PUT /identity/v3/projects/fba565653ae843e38f31a9b7ededfc9f/users/0ae38d5dc821452f98a6e1f8f899e980/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:44.758701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b3bd9-fe45-4e05-97d4-29dc9a190c0b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:44.857867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fce59a2a5dc4c24b1c3eccc77fd77f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:44.906738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fce59a2a5dc4c24b1c3eccc77fd77f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:44.909778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fce59a2a5dc4c24b1c3eccc77fd77f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:44.929861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fce59a2a5dc4c24b1c3eccc77fd77f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:44.937382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b3bd9-fe45-4e05-97d4-29dc9a190c0b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:44.949965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ef74bd91-fadc-4c98-9636-13428912d1e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fce59a2a5dc4c24b1c3eccc77fd77f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:44.952160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a5c47a-cfae-4a42-9d9d-9278d5c2be7a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:44.952852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c47a-cfae-4a42-9d9d-9278d5c2be7a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:44.953137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c47a-cfae-4a42-9d9d-9278d5c2be7a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:44.953459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a5c47a-cfae-4a42-9d9d-9278d5c2be7a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:44.955879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5c47a-cfae-4a42-9d9d-9278d5c2be7a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6731c601059646e797f14361fdc8bdf7, group_id=dbc2e77628f34db6a8cad3feb6ef9373, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:44.958590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a5c47a-cfae-4a42-9d9d-9278d5c2be7a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:44.962534 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3040/6098] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:44 2022] DELETE /identity/v3/users/2fce59a2a5dc4c24b1c3eccc77fd77f0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:44.964033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2de5d-ba1d-4d0b-9e3c-6411f6211c0c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:44.964323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2de5d-ba1d-4d0b-9e3c-6411f6211c0c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:44.967096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f2de5d-ba1d-4d0b-9e3c-6411f6211c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:44.978185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15a5c47a-cfae-4a42-9d9d-9278d5c2be7a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role b2f496a0b4f14d4590607df2dff31464 was removed from group dbc2e77628f34db6a8cad3feb6ef9373 on domain 6731c601059646e797f14361fdc8bdf7. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:44.978485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15a5c47a-cfae-4a42-9d9d-9278d5c2be7a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:44.979253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15a5c47a-cfae-4a42-9d9d-9278d5c2be7a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:45.002491 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3059/6099] 10.222.0.25 () {58 vars in 1467 bytes} [Mon Oct 24 09:20:44 2022] DELETE /identity/v3/domains/6731c601059646e797f14361fdc8bdf7/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:45.003820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a222b7-23a5-4d5d-b2be-2010bf9ebee0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:45.004094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a222b7-23a5-4d5d-b2be-2010bf9ebee0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:45.006545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a222b7-23a5-4d5d-b2be-2010bf9ebee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:45.026530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-19f2de5d-ba1d-4d0b-9e3c-6411f6211c0c None None] MFA Rules not processed for user `0ae38d5dc821452f98a6e1f8f899e980`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:45.027804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-19f2de5d-ba1d-4d0b-9e3c-6411f6211c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:45.045980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-48a222b7-23a5-4d5d-b2be-2010bf9ebee0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:45.047240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48a222b7-23a5-4d5d-b2be-2010bf9ebee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:45.142099 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3060/6100] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:45.142099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a222b7-23a5-4d5d-b2be-2010bf9ebee0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:45.145151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48a222b7-23a5-4d5d-b2be-2010bf9ebee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:45.160029 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3041/6101] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:44 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:45.184916 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:45.236529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a222b7-23a5-4d5d-b2be-2010bf9ebee0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:45.244708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c58fe6-c54e-4214-8f5e-ac035056778d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:45.245464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c58fe6-c54e-4214-8f5e-ac035056778d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:45.245935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c58fe6-c54e-4214-8f5e-ac035056778d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:45.246219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c58fe6-c54e-4214-8f5e-ac035056778d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:45.249481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c58fe6-c54e-4214-8f5e-ac035056778d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, group_id=dbc2e77628f34db6a8cad3feb6ef9373, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:45.255076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c58fe6-c54e-4214-8f5e-ac035056778d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:45.280281 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3061/6102] 10.222.0.25 () {60 vars in 1486 bytes} [Mon Oct 24 09:20:45 2022] PUT /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:45.281541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2de5d-ba1d-4d0b-9e3c-6411f6211c0c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:45.301185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f2de5d-ba1d-4d0b-9e3c-6411f6211c0c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:45.331530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c58fe6-c54e-4214-8f5e-ac035056778d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:45.335320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-53c58fe6-c54e-4214-8f5e-ac035056778d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:45.450968 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:45.483326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40487da-8c4a-4da3-b7c9-74d57ca8a390 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:45.484012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40487da-8c4a-4da3-b7c9-74d57ca8a390 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:45.484489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40487da-8c4a-4da3-b7c9-74d57ca8a390 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:45.484602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40487da-8c4a-4da3-b7c9-74d57ca8a390 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:45.492149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40487da-8c4a-4da3-b7c9-74d57ca8a390 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_grants(project_id=0dfa5a59a9884edabcf68760aa9b82c1, group_id=dbc2e77628f34db6a8cad3feb6ef9373)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:45.494963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40487da-8c4a-4da3-b7c9-74d57ca8a390 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:45.517108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c58fe6-c54e-4214-8f5e-ac035056778d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:45.528218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc98da-0c23-4cc1-8edc-c00ddfc6494e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:45.528896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc98da-0c23-4cc1-8edc-c00ddfc6494e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:45.529180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc98da-0c23-4cc1-8edc-c00ddfc6494e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:45.529479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc98da-0c23-4cc1-8edc-c00ddfc6494e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:45.552793 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3042/6103] 10.222.0.25 () {58 vars in 1368 bytes} [Mon Oct 24 09:20:45 2022] GET /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles => generated 411 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:45.553815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40487da-8c4a-4da3-b7c9-74d57ca8a390 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:45.568966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40487da-8c4a-4da3-b7c9-74d57ca8a390 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:45.573205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5e1d9-ad1f-4011-9702-129fba51ce7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:45.573900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5e1d9-ad1f-4011-9702-129fba51ce7c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:45.574180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5e1d9-ad1f-4011-9702-129fba51ce7c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:45.574467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc5e1d9-ad1f-4011-9702-129fba51ce7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:45.645447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5e1d9-ad1f-4011-9702-129fba51ce7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:45.647575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc5e1d9-ad1f-4011-9702-129fba51ce7c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:45.660482 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3043/6104] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:45 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:45.661410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5e1d9-ad1f-4011-9702-129fba51ce7c service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:45.675897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc5e1d9-ad1f-4011-9702-129fba51ce7c service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:45.682599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542826d3-e445-4ef5-bf54-163afa9a444c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:45.683458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542826d3-e445-4ef5-bf54-163afa9a444c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:45.683741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542826d3-e445-4ef5-bf54-163afa9a444c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:45.684019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542826d3-e445-4ef5-bf54-163afa9a444c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/groups/dbc2e77628f34db6a8cad3feb6ef9373/users/7833d6ec0847403d9c4eb7e304ea2ed7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:45.685925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542826d3-e445-4ef5-bf54-163afa9a444c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:add_user_to_group(group_id=dbc2e77628f34db6a8cad3feb6ef9373, user_id=7833d6ec0847403d9c4eb7e304ea2ed7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:45.692045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542826d3-e445-4ef5-bf54-163afa9a444c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:45.734682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc98da-0c23-4cc1-8edc-c00ddfc6494e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:45.736672 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3044/6105] 10.222.0.25 () {60 vars in 1360 bytes} [Mon Oct 24 09:20:45 2022] PUT /identity/v3/groups/dbc2e77628f34db6a8cad3feb6ef9373/users/7833d6ec0847403d9c4eb7e304ea2ed7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:45.739263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f3ac7-fc88-4cd9-a67f-4b3a85364e09 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:45.739469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc98da-0c23-4cc1-8edc-c00ddfc6494e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:45.740722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f3ac7-fc88-4cd9-a67f-4b3a85364e09 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:45.741037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466f3ac7-fc88-4cd9-a67f-4b3a85364e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:45.768093 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3062/6106] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:45.816391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-466f3ac7-fc88-4cd9-a67f-4b3a85364e09 None None] MFA Rules not processed for user `7833d6ec0847403d9c4eb7e304ea2ed7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:45.817660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-466f3ac7-fc88-4cd9-a67f-4b3a85364e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:46.085355 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3045/6107] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:45 2022] POST /identity/v3/auth/tokens => generated 3267 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:46.089824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc98da-0c23-4cc1-8edc-c00ddfc6494e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:46.106978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc98da-0c23-4cc1-8edc-c00ddfc6494e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:46.254320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba422be-7a98-46c7-b41a-c5a320dc522f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:46.255102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba422be-7a98-46c7-b41a-c5a320dc522f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:46.255484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba422be-7a98-46c7-b41a-c5a320dc522f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:46.255829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba422be-7a98-46c7-b41a-c5a320dc522f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:46.259743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba422be-7a98-46c7-b41a-c5a320dc522f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:check_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, group_id=dbc2e77628f34db6a8cad3feb6ef9373, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:46.262738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba422be-7a98-46c7-b41a-c5a320dc522f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:46.276700 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3063/6108] 10.222.0.25 () {58 vars in 1468 bytes} [Mon Oct 24 09:20:46 2022] HEAD /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:46.281417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f3ac7-fc88-4cd9-a67f-4b3a85364e09 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:46.292502 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:46.306943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466f3ac7-fc88-4cd9-a67f-4b3a85364e09 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:46.324287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:46.325693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:46.325994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:46.326280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:46.332123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, group_id=dbc2e77628f34db6a8cad3feb6ef9373, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:46.341025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:46.351031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role b2f496a0b4f14d4590607df2dff31464 was removed from group dbc2e77628f34db6a8cad3feb6ef9373 on project 0dfa5a59a9884edabcf68760aa9b82c1. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:46.351690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:46.353242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:46.395305 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3046/6109] 10.222.0.25 () {58 vars in 1470 bytes} [Mon Oct 24 09:20:46 2022] DELETE /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:46.399615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba422be-7a98-46c7-b41a-c5a320dc522f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:46.402743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8ba422be-7a98-46c7-b41a-c5a320dc522f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:46.418249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba422be-7a98-46c7-b41a-c5a320dc522f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:46.422798 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:46.573950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:46.574986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:46.575518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:46.576275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/groups/dbc2e77628f34db6a8cad3feb6ef9373/users/7833d6ec0847403d9c4eb7e304ea2ed7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:46.578561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:remove_user_from_group(group_id=dbc2e77628f34db6a8cad3feb6ef9373, user_id=7833d6ec0847403d9c4eb7e304ea2ed7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:46.579875 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:remove_user_from_group": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:46.579875 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:46.579875 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:46.581649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:46.601998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '7833d6ec0847403d9c4eb7e304ea2ed7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:46.631980 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3064/6110] 10.222.0.25 () {58 vars in 1344 bytes} [Mon Oct 24 09:20:46 2022] DELETE /identity/v3/groups/dbc2e77628f34db6a8cad3feb6ef9373/users/7833d6ec0847403d9c4eb7e304ea2ed7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:46.639026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:46.660867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc77e75b-2bb5-4973-8b9a-64717abc9526 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:46.839450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:46.844272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:46.951883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ab9d7-bf68-4f72-a48c-be6b5b5e2389 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:46.956231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ab9d7-bf68-4f72-a48c-be6b5b5e2389 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:46.957381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ab9d7-bf68-4f72-a48c-be6b5b5e2389 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:46.960551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ab9d7-bf68-4f72-a48c-be6b5b5e2389 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/system/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:46.969072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ab9d7-bf68-4f72-a48c-be6b5b5e2389 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_system_grant_for_group(group_id=dbc2e77628f34db6a8cad3feb6ef9373, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:46.979530 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-ce6ab9d7-bf68-4f72-a48c-be6b5b5e2389 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:46.979530 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:46.979530 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:46.983724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6ab9d7-bf68-4f72-a48c-be6b5b5e2389 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:47.031281 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3047/6111] 10.222.0.25 () {60 vars in 1381 bytes} [Mon Oct 24 09:20:46 2022] PUT /identity/v3/system/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:47.034652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ab9d7-bf68-4f72-a48c-be6b5b5e2389 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:47.087819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6ab9d7-bf68-4f72-a48c-be6b5b5e2389 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:47.118597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001f333-0be9-4ad1-bb66-abcb5a0f874f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:47.118597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001f333-0be9-4ad1-bb66-abcb5a0f874f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:47.118857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001f333-0be9-4ad1-bb66-abcb5a0f874f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:47.119087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8001f333-0be9-4ad1-bb66-abcb5a0f874f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/system/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:47.120935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001f333-0be9-4ad1-bb66-abcb5a0f874f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_system_grants_for_group(group_id=dbc2e77628f34db6a8cad3feb6ef9373)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:47.122040 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-8001f333-0be9-4ad1-bb66-abcb5a0f874f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:47.122040 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:47.122040 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:47.125139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8001f333-0be9-4ad1-bb66-abcb5a0f874f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:47.142708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5bee2-04b9-43d8-934d-b4dcaa8ea2a9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:47.148715 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3048/6112] 10.222.0.25 () {58 vars in 1263 bytes} [Mon Oct 24 09:20:47 2022] GET /identity/v3/system/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles => generated 376 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:47.150084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001f333-0be9-4ad1-bb66-abcb5a0f874f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:47.155588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:47.156309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:47.156937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:47.157942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] PATH_INFO: `/v3/projects/2c8ce157c4484e0589e60ca576db2420` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:47.159296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c8ce157c4484e0589e60ca576db2420)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:47.165988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:47.188962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8001f333-0be9-4ad1-bb66-abcb5a0f874f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:47.202317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249911f-2955-4d3c-bbdd-392a63b9fe78 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:47.203004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249911f-2955-4d3c-bbdd-392a63b9fe78 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:47.203359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249911f-2955-4d3c-bbdd-392a63b9fe78 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:47.203644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5249911f-2955-4d3c-bbdd-392a63b9fe78 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/system/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:47.208230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249911f-2955-4d3c-bbdd-392a63b9fe78 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:check_system_grant_for_group(group_id=dbc2e77628f34db6a8cad3feb6ef9373, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:47.210634 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-5249911f-2955-4d3c-bbdd-392a63b9fe78 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:47.210634 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:47.210634 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:47.215225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5249911f-2955-4d3c-bbdd-392a63b9fe78 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:47.236309 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3049/6113] 10.222.0.25 () {58 vars in 1363 bytes} [Mon Oct 24 09:20:47 2022] HEAD /identity/v3/system/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:47.242915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249911f-2955-4d3c-bbdd-392a63b9fe78 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:47.270317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5249911f-2955-4d3c-bbdd-392a63b9fe78 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:47.290447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c8ce157c4484e0589e60ca576db2420', 'request_id': 'req-ff49bf4d-e84b-4139-8bec-5929323c7b6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.306879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c8ce157c4484e0589e60ca576db2420', 'request_id': 'req-ff49bf4d-e84b-4139-8bec-5929323c7b6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.315238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c8ce157c4484e0589e60ca576db2420', 'request_id': 'req-ff49bf4d-e84b-4139-8bec-5929323c7b6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.327601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] The token cache is being invalidate because project 2c8ce157c4484e0589e60ca576db2420 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:47.328072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.328843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.333625 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3065/6114] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:46 2022] DELETE /identity/v3/projects/2c8ce157c4484e0589e60ca576db2420 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:47.335061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:47.337262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:47.426225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df6ff4-5664-4c9c-b319-e6e2ed1a24c4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:47.431569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ff4-5664-4c9c-b319-e6e2ed1a24c4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:47.431729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ff4-5664-4c9c-b319-e6e2ed1a24c4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:47.432668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df6ff4-5664-4c9c-b319-e6e2ed1a24c4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/system/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:47.441024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df6ff4-5664-4c9c-b319-e6e2ed1a24c4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_group(group_id=dbc2e77628f34db6a8cad3feb6ef9373, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:47.442306 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-e3df6ff4-5664-4c9c-b319-e6e2ed1a24c4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:47.442306 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:47.442306 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:47.443472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3df6ff4-5664-4c9c-b319-e6e2ed1a24c4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:47.457472 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:47.465374 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3050/6115] 10.222.0.25 () {58 vars in 1365 bytes} [Mon Oct 24 09:20:47 2022] DELETE /identity/v3/system/groups/dbc2e77628f34db6a8cad3feb6ef9373/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:47.465374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3784d4-14d3-43cd-9bf1-7da106521a4b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:47.465374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3784d4-14d3-43cd-9bf1-7da106521a4b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:47.465374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3784d4-14d3-43cd-9bf1-7da106521a4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:47.495970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ae3784d4-14d3-43cd-9bf1-7da106521a4b None None] MFA Rules not processed for user `9d0b4f066e344bba84c0369d4c695f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:47.497206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ae3784d4-14d3-43cd-9bf1-7da106521a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:47.531491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff49bf4d-e84b-4139-8bec-5929323c7b6c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:47.549942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:47.550918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:47.551352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:47.551791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] PATH_INFO: `/v3/users/6be08cc851ba43d192a8e72d3c7298e6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:47.554915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6be08cc851ba43d192a8e72d3c7298e6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:47.558357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:47.682228 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3051/6116] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:47.682228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3784d4-14d3-43cd-9bf1-7da106521a4b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:47.683741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6be08cc851ba43d192a8e72d3c7298e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.683845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ae3784d4-14d3-43cd-9bf1-7da106521a4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:47.702690 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:47.708710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6be08cc851ba43d192a8e72d3c7298e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.709785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6be08cc851ba43d192a8e72d3c7298e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.717053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3784d4-14d3-43cd-9bf1-7da106521a4b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:47.726253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff863aa1-59e5-43d9-8a6c-0fb34fee2d8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:47.727018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863aa1-59e5-43d9-8a6c-0fb34fee2d8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:47.727366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863aa1-59e5-43d9-8a6c-0fb34fee2d8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:47.728853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6be08cc851ba43d192a8e72d3c7298e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.735032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff863aa1-59e5-43d9-8a6c-0fb34fee2d8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:47.740199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff863aa1-59e5-43d9-8a6c-0fb34fee2d8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_grant(domain_id=6731c601059646e797f14361fdc8bdf7, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:47.744057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6be08cc851ba43d192a8e72d3c7298e6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:47.745477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff863aa1-59e5-43d9-8a6c-0fb34fee2d8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:47.761030 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3066/6117] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:47 2022] DELETE /identity/v3/users/6be08cc851ba43d192a8e72d3c7298e6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:47.779707 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3052/6118] 10.222.0.25 () {60 vars in 1480 bytes} [Mon Oct 24 09:20:47 2022] PUT /identity/v3/domains/6731c601059646e797f14361fdc8bdf7/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:47.783808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:47.785268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:47.962568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98a266-0fe6-4b81-92e0-c6fa9871ef79 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:48.094506 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:48.121745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f417316-7b68-428c-b9c7-ad0dfc92fe35 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:48.122717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f417316-7b68-428c-b9c7-ad0dfc92fe35 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:48.124965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f417316-7b68-428c-b9c7-ad0dfc92fe35 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:48.124965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f417316-7b68-428c-b9c7-ad0dfc92fe35 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:48.127408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f417316-7b68-428c-b9c7-ad0dfc92fe35 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_grants(domain_id=6731c601059646e797f14361fdc8bdf7, user_id=7833d6ec0847403d9c4eb7e304ea2ed7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:48.131554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f417316-7b68-428c-b9c7-ad0dfc92fe35 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:48.169169 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3067/6119] 10.222.0.25 () {58 vars in 1362 bytes} [Mon Oct 24 09:20:47 2022] GET /identity/v3/domains/6731c601059646e797f14361fdc8bdf7/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles => generated 409 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:48.172801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff863aa1-59e5-43d9-8a6c-0fb34fee2d8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:48.194744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff863aa1-59e5-43d9-8a6c-0fb34fee2d8a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:48.202227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13a6d7-dc09-4931-aeb9-c12ea5632cf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:48.203323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13a6d7-dc09-4931-aeb9-c12ea5632cf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:48.203613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13a6d7-dc09-4931-aeb9-c12ea5632cf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:48.203894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a13a6d7-dc09-4931-aeb9-c12ea5632cf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:48.216947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13a6d7-dc09-4931-aeb9-c12ea5632cf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:check_grant(domain_id=6731c601059646e797f14361fdc8bdf7, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:48.220136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a13a6d7-dc09-4931-aeb9-c12ea5632cf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:48.229251 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3053/6120] 10.222.0.25 () {58 vars in 1462 bytes} [Mon Oct 24 09:20:48 2022] HEAD /identity/v3/domains/6731c601059646e797f14361fdc8bdf7/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:48.233341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f417316-7b68-428c-b9c7-ad0dfc92fe35 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:48.255352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f417316-7b68-428c-b9c7-ad0dfc92fe35 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:48.262741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:48.264160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:48.264658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:48.265440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:48.268477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:revoke_grant(domain_id=6731c601059646e797f14361fdc8bdf7, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:48.277217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:48.284633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role b2f496a0b4f14d4590607df2dff31464 was removed from user 7833d6ec0847403d9c4eb7e304ea2ed7 on domain 6731c601059646e797f14361fdc8bdf7. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:48.286030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:48.287369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:48.336767 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3068/6121] 10.222.0.25 () {58 vars in 1464 bytes} [Mon Oct 24 09:20:48 2022] DELETE /identity/v3/domains/6731c601059646e797f14361fdc8bdf7/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:48.338645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13a6d7-dc09-4931-aeb9-c12ea5632cf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:48.340909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a13a6d7-dc09-4931-aeb9-c12ea5632cf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:48.370024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a13a6d7-dc09-4931-aeb9-c12ea5632cf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:48.527296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a23b15-f414-4f1b-b48d-82a3d9772bf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:48.528011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23b15-f414-4f1b-b48d-82a3d9772bf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:48.528300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23b15-f414-4f1b-b48d-82a3d9772bf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:48.528582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a23b15-f414-4f1b-b48d-82a3d9772bf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:48.534286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a23b15-f414-4f1b-b48d-82a3d9772bf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:48.536996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a23b15-f414-4f1b-b48d-82a3d9772bf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:48.576037 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3054/6122] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:48 2022] PUT /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:48.580415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:48.598062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3efd21-2762-431a-84b4-915cf496a114 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:48.727460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29dffe-9391-4e57-b282-7d97a3b29218 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:48.728417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29dffe-9391-4e57-b282-7d97a3b29218 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:48.728883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29dffe-9391-4e57-b282-7d97a3b29218 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:48.729135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db29dffe-9391-4e57-b282-7d97a3b29218 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:48.736120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29dffe-9391-4e57-b282-7d97a3b29218 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_grants(project_id=0dfa5a59a9884edabcf68760aa9b82c1, user_id=7833d6ec0847403d9c4eb7e304ea2ed7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:48.740690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db29dffe-9391-4e57-b282-7d97a3b29218 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:48.761331 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3069/6123] 10.222.0.25 () {58 vars in 1365 bytes} [Mon Oct 24 09:20:48 2022] GET /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles => generated 410 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:48.766269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a23b15-f414-4f1b-b48d-82a3d9772bf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:48.784086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a23b15-f414-4f1b-b48d-82a3d9772bf1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:48.802292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6ed27-f3e7-4e5f-bb94-74f7d7a7b4a0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:48.804410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6ed27-f3e7-4e5f-bb94-74f7d7a7b4a0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:48.804706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6ed27-f3e7-4e5f-bb94-74f7d7a7b4a0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:48.805000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd6ed27-f3e7-4e5f-bb94-74f7d7a7b4a0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:48.807451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6ed27-f3e7-4e5f-bb94-74f7d7a7b4a0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:check_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:48.813546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd6ed27-f3e7-4e5f-bb94-74f7d7a7b4a0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:48.834658 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3055/6124] 10.222.0.25 () {58 vars in 1465 bytes} [Mon Oct 24 09:20:48 2022] HEAD /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:48.836599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29dffe-9391-4e57-b282-7d97a3b29218 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:48.853089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db29dffe-9391-4e57-b282-7d97a3b29218 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:48.859581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:48.860282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:48.860564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:48.860844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:48.863142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:revoke_grant(project_id=0dfa5a59a9884edabcf68760aa9b82c1, user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:48.877910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:48.899910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role b2f496a0b4f14d4590607df2dff31464 was removed from user 7833d6ec0847403d9c4eb7e304ea2ed7 on project 0dfa5a59a9884edabcf68760aa9b82c1. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:48.900224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:48.901156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:48.938882 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3070/6125] 10.222.0.25 () {58 vars in 1467 bytes} [Mon Oct 24 09:20:48 2022] DELETE /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:48.941684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6ed27-f3e7-4e5f-bb94-74f7d7a7b4a0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:48.943515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1dd6ed27-f3e7-4e5f-bb94-74f7d7a7b4a0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:48.968598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd6ed27-f3e7-4e5f-bb94-74f7d7a7b4a0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.140883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.148182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:49.148394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdbbf3-a061-42f5-a8a5-a715454dbe40 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.148394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdbbf3-a061-42f5-a8a5-a715454dbe40 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.148394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdbbf3-a061-42f5-a8a5-a715454dbe40 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.148718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cdbbf3-a061-42f5-a8a5-a715454dbe40 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/system/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.160439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdbbf3-a061-42f5-a8a5-a715454dbe40 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.162520 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-c2cdbbf3-a061-42f5-a8a5-a715454dbe40 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:49.162520 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:49.162520 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:49.164577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cdbbf3-a061-42f5-a8a5-a715454dbe40 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.183728 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3056/6126] 10.222.0.25 () {60 vars in 1378 bytes} [Mon Oct 24 09:20:48 2022] PUT /identity/v3/system/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:49.188084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdbbf3-a061-42f5-a8a5-a715454dbe40 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.209078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cdbbf3-a061-42f5-a8a5-a715454dbe40 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.233142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd065cd6-f11f-43ab-b6f2-1b0cf699cf1b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.236531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd065cd6-f11f-43ab-b6f2-1b0cf699cf1b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.237568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd065cd6-f11f-43ab-b6f2-1b0cf699cf1b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.239239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd065cd6-f11f-43ab-b6f2-1b0cf699cf1b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/system/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.246153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd065cd6-f11f-43ab-b6f2-1b0cf699cf1b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_system_grants_for_user(user_id=7833d6ec0847403d9c4eb7e304ea2ed7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.247291 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-bd065cd6-f11f-43ab-b6f2-1b0cf699cf1b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_system_grants_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:49.247291 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:49.247291 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:49.248436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd065cd6-f11f-43ab-b6f2-1b0cf699cf1b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.262358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e98661-d723-44c3-b87f-86c607ba7591 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.270035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.270994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.271737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.272175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] PATH_INFO: `/v3/projects/7eeadb69b1e34bd490fc482cfc229588` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.274901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eeadb69b1e34bd490fc482cfc229588)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.277246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.306654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3057/6127] 10.222.0.25 () {58 vars in 1260 bytes} [Mon Oct 24 09:20:49 2022] GET /identity/v3/system/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles => generated 375 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:49.308135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd065cd6-f11f-43ab-b6f2-1b0cf699cf1b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.321670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd065cd6-f11f-43ab-b6f2-1b0cf699cf1b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.327009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efc073-af66-488f-9058-4335fda07600 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.327755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc073-af66-488f-9058-4335fda07600 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.328151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc073-af66-488f-9058-4335fda07600 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.328534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57efc073-af66-488f-9058-4335fda07600 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/system/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.331321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efc073-af66-488f-9058-4335fda07600 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:check_system_grant_for_user(user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.332848 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-57efc073-af66-488f-9058-4335fda07600 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_system_grant_for_user": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:49.332848 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:49.332848 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:49.334019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57efc073-af66-488f-9058-4335fda07600 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.340335 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3058/6128] 10.222.0.25 () {58 vars in 1360 bytes} [Mon Oct 24 09:20:49 2022] HEAD /identity/v3/system/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:49.344658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efc073-af66-488f-9058-4335fda07600 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.362182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57efc073-af66-488f-9058-4335fda07600 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.369687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cf493-4ae3-433c-95e0-245bca6b7f23 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.370806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cf493-4ae3-433c-95e0-245bca6b7f23 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.371653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cf493-4ae3-433c-95e0-245bca6b7f23 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.371954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8cf493-4ae3-433c-95e0-245bca6b7f23 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/system/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.373975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cf493-4ae3-433c-95e0-245bca6b7f23 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:revoke_system_grant_for_user(user_id=7833d6ec0847403d9c4eb7e304ea2ed7, role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.376335 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-8b8cf493-4ae3-433c-95e0-245bca6b7f23 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:revoke_system_grant_for_user": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:49.376335 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:49.376335 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:49.377240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8cf493-4ae3-433c-95e0-245bca6b7f23 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.393137 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3059/6129] 10.222.0.25 () {58 vars in 1362 bytes} [Mon Oct 24 09:20:49 2022] DELETE /identity/v3/system/users/7833d6ec0847403d9c4eb7e304ea2ed7/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:49.394738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cf493-4ae3-433c-95e0-245bca6b7f23 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.400097 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:49.413111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8cf493-4ae3-433c-95e0-245bca6b7f23 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.426748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eeadb69b1e34bd490fc482cfc229588', 'request_id': 'req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:49.452372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eeadb69b1e34bd490fc482cfc229588', 'request_id': 'req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:49.463876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eeadb69b1e34bd490fc482cfc229588', 'request_id': 'req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:49.486126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] The token cache is being invalidate because project 7eeadb69b1e34bd490fc482cfc229588 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:49.486274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:49.486868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3279e4af-b033-4ae4-b1e0-2d4d5f86ae8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:49.488419 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3071/6130] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:49 2022] DELETE /identity/v3/projects/7eeadb69b1e34bd490fc482cfc229588 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:49.494230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85878b3-996e-4ee3-8fca-475b96e9360b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.494595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85878b3-996e-4ee3-8fca-475b96e9360b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.494876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85878b3-996e-4ee3-8fca-475b96e9360b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.526664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a85878b3-996e-4ee3-8fca-475b96e9360b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:49.528632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a85878b3-996e-4ee3-8fca-475b96e9360b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:49.556146 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:49.618102 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3072/6131] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:49.624743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa4366-c8ae-4907-83d3-2e017a99ca43 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.624947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa4366-c8ae-4907-83d3-2e017a99ca43 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.625244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfa4366-c8ae-4907-83d3-2e017a99ca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.645059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b0a91-6a90-4227-ae09-a1528736a9ba tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.646078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b0a91-6a90-4227-ae09-a1528736a9ba tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.646668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b0a91-6a90-4227-ae09-a1528736a9ba tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.647498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1b0a91-6a90-4227-ae09-a1528736a9ba tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.649252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b0a91-6a90-4227-ae09-a1528736a9ba tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.655845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1b0a91-6a90-4227-ae09-a1528736a9ba tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.671695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9cfa4366-c8ae-4907-83d3-2e017a99ca43 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:49.675044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9cfa4366-c8ae-4907-83d3-2e017a99ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:49.689524 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3060/6132] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:49 2022] POST /identity/v3/roles => generated 270 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:49.693590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b0a91-6a90-4227-ae09-a1528736a9ba tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.696612 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3073/6133] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:20:49.697363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4d1b0a91-6a90-4227-ae09-a1528736a9ba tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:49.700997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa4366-c8ae-4907-83d3-2e017a99ca43 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.720785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfa4366-c8ae-4907-83d3-2e017a99ca43 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.725455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1b0a91-6a90-4227-ae09-a1528736a9ba tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.736058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9a2e7-965b-4e7a-9ade-173ef5544bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.736550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9a2e7-965b-4e7a-9ade-173ef5544bbe admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.736856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9a2e7-965b-4e7a-9ade-173ef5544bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.738227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba9a2e7-965b-4e7a-9ade-173ef5544bbe admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.738227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9a2e7-965b-4e7a-9ade-173ef5544bbe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:20:49.738227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9a2e7-965b-4e7a-9ade-173ef5544bbe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.739682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba9a2e7-965b-4e7a-9ade-173ef5544bbe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.751924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ada8ad-ec2a-4cfd-bcc2-96c20154ef62 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.755498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada8ad-ec2a-4cfd-bcc2-96c20154ef62 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.756393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada8ad-ec2a-4cfd-bcc2-96c20154ef62 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.756729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ada8ad-ec2a-4cfd-bcc2-96c20154ef62 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.758787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ada8ad-ec2a-4cfd-bcc2-96c20154ef62 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.762241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ada8ad-ec2a-4cfd-bcc2-96c20154ef62 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.767993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3074/6134] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:49.773762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9a2e7-965b-4e7a-9ade-173ef5544bbe admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.793287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba9a2e7-965b-4e7a-9ade-173ef5544bbe admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.798160 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3061/6135] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:49 2022] POST /identity/v3/roles => generated 270 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:49.803250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ada8ad-ec2a-4cfd-bcc2-96c20154ef62 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.807912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814358-9aa0-4794-8c03-7178a824cdc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.809826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814358-9aa0-4794-8c03-7178a824cdc1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.810432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814358-9aa0-4794-8c03-7178a824cdc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.810759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4814358-9aa0-4794-8c03-7178a824cdc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.811575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4814358-9aa0-4794-8c03-7178a824cdc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.815787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4814358-9aa0-4794-8c03-7178a824cdc1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.838791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ada8ad-ec2a-4cfd-bcc2-96c20154ef62 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:49.850661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc31aa-aa87-49ad-9f0c-f95bb6416514 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:49.851941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc31aa-aa87-49ad-9f0c-f95bb6416514 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:49.851941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc31aa-aa87-49ad-9f0c-f95bb6416514 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:49.851941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc31aa-aa87-49ad-9f0c-f95bb6416514 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/c5c834ee18334e4db34b895f9a17ddfa` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:49.859823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc31aa-aa87-49ad-9f0c-f95bb6416514 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8f72e89b5dd4428b8d46e8254f42a252, implied_role_id=c5c834ee18334e4db34b895f9a17ddfa)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:49.862969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc31aa-aa87-49ad-9f0c-f95bb6416514 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:49.894407 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3075/6136] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:49 2022] POST /identity/v3/projects => generated 373 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:49.895646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814358-9aa0-4794-8c03-7178a824cdc1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:49.910102 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3062/6137] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:49 2022] PUT /identity/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/c5c834ee18334e4db34b895f9a17ddfa => generated 531 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:49.912390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc31aa-aa87-49ad-9f0c-f95bb6416514 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.012011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4814358-9aa0-4794-8c03-7178a824cdc1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.029060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc31aa-aa87-49ad-9f0c-f95bb6416514 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.042248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bceb7-b35e-4a52-aca3-9d3a482a0931 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.045326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bceb7-b35e-4a52-aca3-9d3a482a0931 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.045326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bceb7-b35e-4a52-aca3-9d3a482a0931 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.045326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bceb7-b35e-4a52-aca3-9d3a482a0931 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.045749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bceb7-b35e-4a52-aca3-9d3a482a0931 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.048575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bceb7-b35e-4a52-aca3-9d3a482a0931 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:50.091701 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3063/6138] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:20:49 2022] POST /identity/v3/domains => generated 275 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:50.095587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bceb7-b35e-4a52-aca3-9d3a482a0931 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.101131 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:50.160521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60196fa-d6b8-4c92-9ee8-1113c42f0289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.161139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60196fa-d6b8-4c92-9ee8-1113c42f0289 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.161434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60196fa-d6b8-4c92-9ee8-1113c42f0289 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.161709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60196fa-d6b8-4c92-9ee8-1113c42f0289 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.162336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60196fa-d6b8-4c92-9ee8-1113c42f0289 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.164539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60196fa-d6b8-4c92-9ee8-1113c42f0289 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:50.211546 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3076/6139] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:49 2022] POST /identity/v3/users => generated 287 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:50.214513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bceb7-b35e-4a52-aca3-9d3a482a0931 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.215471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60196fa-d6b8-4c92-9ee8-1113c42f0289 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.219833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ab2a0-a62c-49ca-b046-30ebed7677d9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.228720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ab2a0-a62c-49ca-b046-30ebed7677d9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.229085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ab2a0-a62c-49ca-b046-30ebed7677d9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.229440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901ab2a0-a62c-49ca-b046-30ebed7677d9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.230355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ab2a0-a62c-49ca-b046-30ebed7677d9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_domain_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.231842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60196fa-d6b8-4c92-9ee8-1113c42f0289 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.232580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901ab2a0-a62c-49ca-b046-30ebed7677d9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:50.284636 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3064/6140] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:50 2022] POST /identity/v3/roles => generated 270 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:50.286838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ab2a0-a62c-49ca-b046-30ebed7677d9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.312038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901ab2a0-a62c-49ca-b046-30ebed7677d9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.326715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d67217-bae2-4eda-adfc-1789922d5473 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.327469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67217-bae2-4eda-adfc-1789922d5473 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.329433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67217-bae2-4eda-adfc-1789922d5473 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.329981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d67217-bae2-4eda-adfc-1789922d5473 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/ef7ae7cf74c94ffeb4478a3847f19e02` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.335245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d67217-bae2-4eda-adfc-1789922d5473 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8f72e89b5dd4428b8d46e8254f42a252, implied_role_id=ef7ae7cf74c94ffeb4478a3847f19e02)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.340154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d67217-bae2-4eda-adfc-1789922d5473 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:50.359102 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:50.388347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246f4a6-e75b-41c1-ad2c-f37687e9a97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.388953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246f4a6-e75b-41c1-ad2c-f37687e9a97f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.389232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246f4a6-e75b-41c1-ad2c-f37687e9a97f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.390483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5246f4a6-e75b-41c1-ad2c-f37687e9a97f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.391148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246f4a6-e75b-41c1-ad2c-f37687e9a97f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.396511 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3065/6141] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:50 2022] PUT /identity/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/ef7ae7cf74c94ffeb4478a3847f19e02 => generated 531 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:50.402197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d67217-bae2-4eda-adfc-1789922d5473 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.404505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5246f4a6-e75b-41c1-ad2c-f37687e9a97f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:50.435413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3077/6142] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:50 2022] GET /identity/v3/roles => generated 2323 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:20:50.436320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246f4a6-e75b-41c1-ad2c-f37687e9a97f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.469081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5246f4a6-e75b-41c1-ad2c-f37687e9a97f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.544778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d67217-bae2-4eda-adfc-1789922d5473 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.553001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be171a2-ae3e-41ed-8525-1c2d04ad392f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.553953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be171a2-ae3e-41ed-8525-1c2d04ad392f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.555041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be171a2-ae3e-41ed-8525-1c2d04ad392f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.555331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be171a2-ae3e-41ed-8525-1c2d04ad392f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.561411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be171a2-ae3e-41ed-8525-1c2d04ad392f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=8f72e89b5dd4428b8d46e8254f42a252, implied_role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.564288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be171a2-ae3e-41ed-8525-1c2d04ad392f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:50.632465 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3066/6143] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:50 2022] PUT /identity/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/b2f496a0b4f14d4590607df2dff31464 => generated 526 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:50.638311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be171a2-ae3e-41ed-8525-1c2d04ad392f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.712235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a6149-9655-4c20-99b4-207ba3d4c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.713325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a6149-9655-4c20-99b4-207ba3d4c306 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.713716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a6149-9655-4c20-99b4-207ba3d4c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.714090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722a6149-9655-4c20-99b4-207ba3d4c306 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.714905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a6149-9655-4c20-99b4-207ba3d4c306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.736908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722a6149-9655-4c20-99b4-207ba3d4c306 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:50.790504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be171a2-ae3e-41ed-8525-1c2d04ad392f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.793597 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3078/6144] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:50 2022] GET /identity/v3/roles => generated 2323 bytes in 358 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:50.798317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a6149-9655-4c20-99b4-207ba3d4c306 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.803311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31413e92-397f-48c3-b153-710c0be55a8d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.806676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31413e92-397f-48c3-b153-710c0be55a8d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.807156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31413e92-397f-48c3-b153-710c0be55a8d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.807495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31413e92-397f-48c3-b153-710c0be55a8d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/b2f496a0b4f14d4590607df2dff31464/implies/8f72e89b5dd4428b8d46e8254f42a252` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.812969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31413e92-397f-48c3-b153-710c0be55a8d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=b2f496a0b4f14d4590607df2dff31464, implied_role_id=8f72e89b5dd4428b8d46e8254f42a252)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.820304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722a6149-9655-4c20-99b4-207ba3d4c306 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.825374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31413e92-397f-48c3-b153-710c0be55a8d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-31413e92-397f-48c3-b153-710c0be55a8d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] 8f72e89b5dd4428b8d46e8254f42a252 cannot be an implied roles.: keystone.exception.InvalidImpliedRole: 8f72e89b5dd4428b8d46e8254f42a252 cannot be an implied roles. Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 259, in put Oct 24 09:20:50.856674 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.role_api.create_implied_role(prior_role_id, implied_role_id) Oct 24 09:20:50.857965 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:50.857965 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:50.857965 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1361, in create_implied_role Oct 24 09:20:50.857965 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.InvalidImpliedRole(msg, Oct 24 09:20:50.857965 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.InvalidImpliedRole: 8f72e89b5dd4428b8d46e8254f42a252 cannot be an implied roles. Oct 24 09:20:50.857965 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:50.860177 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3067/6145] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:50 2022] PUT /identity/v3/roles/b2f496a0b4f14d4590607df2dff31464/implies/8f72e89b5dd4428b8d46e8254f42a252 => generated 116 bytes in 222 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:20:50.865430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31413e92-397f-48c3-b153-710c0be55a8d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.902554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31413e92-397f-48c3-b153-710c0be55a8d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:50.916921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf6e8-5964-4dfd-80c7-aa5078897b4a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.917908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf6e8-5964-4dfd-80c7-aa5078897b4a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.919484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf6e8-5964-4dfd-80c7-aa5078897b4a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.920787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ddf6e8-5964-4dfd-80c7-aa5078897b4a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.924210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddf6e8-5964-4dfd-80c7-aa5078897b4a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8f72e89b5dd4428b8d46e8254f42a252, implied_role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.924948 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:50.932697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ddf6e8-5964-4dfd-80c7-aa5078897b4a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:50.954571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f622c2-81f5-46d6-936b-d336586acee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:50.955575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f622c2-81f5-46d6-936b-d336586acee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:50.956370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f622c2-81f5-46d6-936b-d336586acee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:50.957078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f622c2-81f5-46d6-936b-d336586acee4 admin admin] PATH_INFO: `/v3/projects/e9a96b75c4514ef1be9b6a88fff7ca49/users/5490e9f7f5a2459082cffb5da161fc46/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:50.965583 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3068/6146] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:50 2022] DELETE /identity/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:50.969960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf6e8-5964-4dfd-80c7-aa5078897b4a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:50.978402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f622c2-81f5-46d6-936b-d336586acee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a96b75c4514ef1be9b6a88fff7ca49, user_id=5490e9f7f5a2459082cffb5da161fc46, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:50.981725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f622c2-81f5-46d6-936b-d336586acee4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:51.012822 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3079/6147] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:50 2022] PUT /identity/v3/projects/e9a96b75c4514ef1be9b6a88fff7ca49/users/5490e9f7f5a2459082cffb5da161fc46/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:51.023652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635ba24-c6c8-494d-ae15-070a99503a6d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:51.024157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635ba24-c6c8-494d-ae15-070a99503a6d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:51.024543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4635ba24-c6c8-494d-ae15-070a99503a6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:51.090869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4635ba24-c6c8-494d-ae15-070a99503a6d None None] MFA Rules not processed for user `5490e9f7f5a2459082cffb5da161fc46`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:51.092727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4635ba24-c6c8-494d-ae15-070a99503a6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:51.098210 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:51.135616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ddf6e8-5964-4dfd-80c7-aa5078897b4a tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:51.294394 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3080/6148] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:51.300029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635ba24-c6c8-494d-ae15-070a99503a6d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:51.302675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b82f6d-71d8-41aa-9ba9-2fc9218a45c8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:51.303365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b82f6d-71d8-41aa-9ba9-2fc9218a45c8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:51.303656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b82f6d-71d8-41aa-9ba9-2fc9218a45c8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:51.303940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b82f6d-71d8-41aa-9ba9-2fc9218a45c8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/ef7ae7cf74c94ffeb4478a3847f19e02` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:51.310445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b82f6d-71d8-41aa-9ba9-2fc9218a45c8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8f72e89b5dd4428b8d46e8254f42a252, implied_role_id=ef7ae7cf74c94ffeb4478a3847f19e02)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:51.312215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b82f6d-71d8-41aa-9ba9-2fc9218a45c8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:51.340402 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3069/6149] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:50 2022] DELETE /identity/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/ef7ae7cf74c94ffeb4478a3847f19e02 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:51.341439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b82f6d-71d8-41aa-9ba9-2fc9218a45c8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:51.485169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b82f6d-71d8-41aa-9ba9-2fc9218a45c8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:51.490861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:51.491666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:51.492070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:51.492498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/ef7ae7cf74c94ffeb4478a3847f19e02` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:51.493880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=ef7ae7cf74c94ffeb4478a3847f19e02)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:51.494713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4635ba24-c6c8-494d-ae15-070a99503a6d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:51.495764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:51.549781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role ef7ae7cf74c94ffeb4478a3847f19e02 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:51.550269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:51.551683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:51.555455 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3070/6150] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:51 2022] DELETE /identity/v3/roles/ef7ae7cf74c94ffeb4478a3847f19e02 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:51.559663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:51.562148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:51.702469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333eaefd-3d9c-47ab-8edd-5d130b1f512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:51.703949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333eaefd-3d9c-47ab-8edd-5d130b1f512c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:51.704441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333eaefd-3d9c-47ab-8edd-5d130b1f512c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:51.705462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333eaefd-3d9c-47ab-8edd-5d130b1f512c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:51.707042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333eaefd-3d9c-47ab-8edd-5d130b1f512c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:51.711155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333eaefd-3d9c-47ab-8edd-5d130b1f512c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:51.743950 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:51.757802 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3081/6151] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:51 2022] POST /identity/v3/projects => generated 373 bytes in 457 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:51.760576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333eaefd-3d9c-47ab-8edd-5d130b1f512c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:51.763988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-333eaefd-3d9c-47ab-8edd-5d130b1f512c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:51.777057 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:51.785859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582f426-40d0-45ca-b680-4871ac4cb41d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:51.961508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:51.964895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:51.964895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:51.964895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/e332319ec9114611b0c5a89edfe6b257` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:51.987871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333eaefd-3d9c-47ab-8edd-5d130b1f512c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:51.998414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=e332319ec9114611b0c5a89edfe6b257)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:52.000280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:52.002668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e2a0-e239-499c-8397-f261dff49e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:52.003313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e2a0-e239-499c-8397-f261dff49e65 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:52.003581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e2a0-e239-499c-8397-f261dff49e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:52.003858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00e2a0-e239-499c-8397-f261dff49e65 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:52.004502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e2a0-e239-499c-8397-f261dff49e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:52.006736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00e2a0-e239-499c-8397-f261dff49e65 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:52.058984 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3082/6152] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:20:51 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:52.062605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.062737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e2a0-e239-499c-8397-f261dff49e65 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:52.066298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.095487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00e2a0-e239-499c-8397-f261dff49e65 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:52.120169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.121065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.125915 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3071/6153] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:20:51 2022] PATCH /identity/v3/domains/e332319ec9114611b0c5a89edfe6b257 => generated 276 bytes in 566 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:20:52.130816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:52.136228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:52.261790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1efe9e-5995-42e8-9c63-1168889767f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:52.262783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1efe9e-5995-42e8-9c63-1168889767f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:52.263245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1efe9e-5995-42e8-9c63-1168889767f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:52.263627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1efe9e-5995-42e8-9c63-1168889767f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:52.264579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1efe9e-5995-42e8-9c63-1168889767f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:52.267371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1efe9e-5995-42e8-9c63-1168889767f0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:52.307110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073fcbac-062a-412c-b148-e6d334ca5f3c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:52.308269 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3083/6154] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:52 2022] GET /identity/v3/roles => generated 2323 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:20:52.312513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1efe9e-5995-42e8-9c63-1168889767f0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:52.316809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b1efe9e-5995-42e8-9c63-1168889767f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:52.322396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:52.324304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:52.324713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:52.326098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/e332319ec9114611b0c5a89edfe6b257` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:52.349546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1efe9e-5995-42e8-9c63-1168889767f0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:52.352204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=e332319ec9114611b0c5a89edfe6b257)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:52.355415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:52.361890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37857c3-7104-4e60-901e-0c50433333b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:52.362962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37857c3-7104-4e60-901e-0c50433333b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:52.362962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37857c3-7104-4e60-901e-0c50433333b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:52.367727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37857c3-7104-4e60-901e-0c50433333b1 admin admin] PATH_INFO: `/v3/projects/5687c27533ef41f685b06e300f24c12c/users/063c5ff946294d71925836618e6e071b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:52.415727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37857c3-7104-4e60-901e-0c50433333b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5687c27533ef41f685b06e300f24c12c, user_id=063c5ff946294d71925836618e6e071b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:52.420615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37857c3-7104-4e60-901e-0c50433333b1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:52.439381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.444135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.464456 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3084/6155] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:52 2022] PUT /identity/v3/projects/5687c27533ef41f685b06e300f24c12c/users/063c5ff946294d71925836618e6e071b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:52.465464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37857c3-7104-4e60-901e-0c50433333b1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:52.499357 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:52.529604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257', 'request_id': 'req-6a484a99-a16f-4eb6-90bc-f7263d00199d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.545725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257', 'request_id': 'req-6a484a99-a16f-4eb6-90bc-f7263d00199d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.566985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257', 'request_id': 'req-6a484a99-a16f-4eb6-90bc-f7263d00199d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.579629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37857c3-7104-4e60-901e-0c50433333b1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:52.586676 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:52.607559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] The token cache is being invalidate because project e332319ec9114611b0c5a89edfe6b257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:52.608435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.608738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.624360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257', 'request_id': 'req-6a484a99-a16f-4eb6-90bc-f7263d00199d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.625559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257', 'request_id': 'req-6a484a99-a16f-4eb6-90bc-f7263d00199d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.627165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'e332319ec9114611b0c5a89edfe6b257', 'request_id': 'req-6a484a99-a16f-4eb6-90bc-f7263d00199d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:52.649091 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3072/6156] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:52 2022] DELETE /identity/v3/domains/e332319ec9114611b0c5a89edfe6b257 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:52.650902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:52.652585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:52.712702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fe6f5-5ed3-48b1-bcbb-23db9b040bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:52.713651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fe6f5-5ed3-48b1-bcbb-23db9b040bcc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:52.714947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fe6f5-5ed3-48b1-bcbb-23db9b040bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:52.715456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0fe6f5-5ed3-48b1-bcbb-23db9b040bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:52.716836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fe6f5-5ed3-48b1-bcbb-23db9b040bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:52.722659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0fe6f5-5ed3-48b1-bcbb-23db9b040bcc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:52.758742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a484a99-a16f-4eb6-90bc-f7263d00199d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:52.763846 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3085/6157] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:52 2022] GET /identity/v3/roles => generated 2323 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:52.767673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fe6f5-5ed3-48b1-bcbb-23db9b040bcc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:52.768994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9037b9-bc15-4e80-afc3-1d3a5cd83b66 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:52.769723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9037b9-bc15-4e80-afc3-1d3a5cd83b66 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:52.770010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9037b9-bc15-4e80-afc3-1d3a5cd83b66 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:52.770294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9037b9-bc15-4e80-afc3-1d3a5cd83b66 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/c5c834ee18334e4db34b895f9a17ddfa` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:52.772815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9037b9-bc15-4e80-afc3-1d3a5cd83b66 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=8f72e89b5dd4428b8d46e8254f42a252, implied_role_id=c5c834ee18334e4db34b895f9a17ddfa)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:52.774555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9037b9-bc15-4e80-afc3-1d3a5cd83b66 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:52.781488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3f0fe6f5-5ed3-48b1-bcbb-23db9b040bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:52.806907 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3073/6158] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:52 2022] DELETE /identity/v3/roles/8f72e89b5dd4428b8d46e8254f42a252/implies/c5c834ee18334e4db34b895f9a17ddfa => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:52.807914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9037b9-bc15-4e80-afc3-1d3a5cd83b66 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:52.822724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0fe6f5-5ed3-48b1-bcbb-23db9b040bcc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:52.968564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a35fb-b7bc-449b-bf23-ce7680b26252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:52.969258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a35fb-b7bc-449b-bf23-ce7680b26252 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:52.969612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a35fb-b7bc-449b-bf23-ce7680b26252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:52.969892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05a35fb-b7bc-449b-bf23-ce7680b26252 admin admin] PATH_INFO: `/v3/projects/5687c27533ef41f685b06e300f24c12c/users/063c5ff946294d71925836618e6e071b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:52.976094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a35fb-b7bc-449b-bf23-ce7680b26252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5687c27533ef41f685b06e300f24c12c, user_id=063c5ff946294d71925836618e6e071b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:52.980412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05a35fb-b7bc-449b-bf23-ce7680b26252 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:52.986285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9037b9-bc15-4e80-afc3-1d3a5cd83b66 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:52.994904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808c7c86-894b-449e-89a7-f1e1d6b1536e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:52.995623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c7c86-894b-449e-89a7-f1e1d6b1536e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:52.995847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c7c86-894b-449e-89a7-f1e1d6b1536e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:52.996128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808c7c86-894b-449e-89a7-f1e1d6b1536e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/c5c834ee18334e4db34b895f9a17ddfa` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:52.997890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c7c86-894b-449e-89a7-f1e1d6b1536e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=c5c834ee18334e4db34b895f9a17ddfa)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:52.999598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808c7c86-894b-449e-89a7-f1e1d6b1536e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.009496 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3086/6159] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:20:52 2022] PUT /identity/v3/projects/5687c27533ef41f685b06e300f24c12c/users/063c5ff946294d71925836618e6e071b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:53.018661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a35fb-b7bc-449b-bf23-ce7680b26252 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.025172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d05a35fb-b7bc-449b-bf23-ce7680b26252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:53.061674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-808c7c86-894b-449e-89a7-f1e1d6b1536e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role c5c834ee18334e4db34b895f9a17ddfa has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:53.062082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-808c7c86-894b-449e-89a7-f1e1d6b1536e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:53.073410 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:53.077067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-808c7c86-894b-449e-89a7-f1e1d6b1536e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:53.080386 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3074/6160] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:52 2022] DELETE /identity/v3/roles/c5c834ee18334e4db34b895f9a17ddfa => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:53.083862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708ba1f-57ec-4a3a-aa6a-8fb08513d81b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.086301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708ba1f-57ec-4a3a-aa6a-8fb08513d81b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.086747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5708ba1f-57ec-4a3a-aa6a-8fb08513d81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.147046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5708ba1f-57ec-4a3a-aa6a-8fb08513d81b None None] MFA Rules not processed for user `063c5ff946294d71925836618e6e071b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:53.149041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5708ba1f-57ec-4a3a-aa6a-8fb08513d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:53.153509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05a35fb-b7bc-449b-bf23-ce7680b26252 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.239088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e16ad-c926-48a9-b990-8c90ed6bb465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.239818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e16ad-c926-48a9-b990-8c90ed6bb465 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.240173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e16ad-c926-48a9-b990-8c90ed6bb465 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.240518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055e16ad-c926-48a9-b990-8c90ed6bb465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.242446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-055e16ad-c926-48a9-b990-8c90ed6bb465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:53.252859 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:53.270413 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3075/6161] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:53 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:53.271018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708ba1f-57ec-4a3a-aa6a-8fb08513d81b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.273337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5708ba1f-57ec-4a3a-aa6a-8fb08513d81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:53.368435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5708ba1f-57ec-4a3a-aa6a-8fb08513d81b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.373844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.374486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.374768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.375046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/8f72e89b5dd4428b8d46e8254f42a252` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.376232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_domain_role(role_id=8f72e89b5dd4428b8d46e8254f42a252)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.377903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.391914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e16ad-c926-48a9-b990-8c90ed6bb465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.394111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055e16ad-c926-48a9-b990-8c90ed6bb465 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.411043 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3087/6162] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:53.412714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e16ad-c926-48a9-b990-8c90ed6bb465 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.423926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055e16ad-c926-48a9-b990-8c90ed6bb465 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.430157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7ad4e-c265-4b0a-a980-30741a5cc621 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.430782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7ad4e-c265-4b0a-a980-30741a5cc621 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.431211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7ad4e-c265-4b0a-a980-30741a5cc621 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.431497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7ad4e-c265-4b0a-a980-30741a5cc621 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.432650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7ad4e-c265-4b0a-a980-30741a5cc621 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.434372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb7ad4e-c265-4b0a-a980-30741a5cc621 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.435692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role 8f72e89b5dd4428b8d46e8254f42a252 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:53.436227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:53.437063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:53.439396 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3076/6163] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:53 2022] DELETE /identity/v3/roles/8f72e89b5dd4428b8d46e8254f42a252 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:53.446342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.450580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:53.454992 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3088/6164] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:53 2022] POST /identity/v3/services => generated 287 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:53.459094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7ad4e-c265-4b0a-a980-30741a5cc621 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.464867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2cb7ad4e-c265-4b0a-a980-30741a5cc621 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:53.502141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7ad4e-c265-4b0a-a980-30741a5cc621 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.535306 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:53.558767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bea0c4f-1661-4931-9792-4868869ede5b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.581279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d7b1d-e447-4101-9e17-d9e20920eaa0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.583057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d7b1d-e447-4101-9e17-d9e20920eaa0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.583539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d7b1d-e447-4101-9e17-d9e20920eaa0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.584048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707d7b1d-e447-4101-9e17-d9e20920eaa0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.586560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d7b1d-e447-4101-9e17-d9e20920eaa0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.589957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707d7b1d-e447-4101-9e17-d9e20920eaa0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.594712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606743b6-3d3f-4a02-8624-18cd8350e538 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.595669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606743b6-3d3f-4a02-8624-18cd8350e538 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.596116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606743b6-3d3f-4a02-8624-18cd8350e538 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.597346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606743b6-3d3f-4a02-8624-18cd8350e538 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.599517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606743b6-3d3f-4a02-8624-18cd8350e538 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.601161 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-606743b6-3d3f-4a02-8624-18cd8350e538 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:53.601161 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:53.601161 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:53.602990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606743b6-3d3f-4a02-8624-18cd8350e538 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.620394 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3089/6165] 10.222.0.25 () {60 vars in 1213 bytes} [Mon Oct 24 09:20:53 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 332 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:53.624563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606743b6-3d3f-4a02-8624-18cd8350e538 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.644588 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3077/6166] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:53 2022] PUT /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 521 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:53.645866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d7b1d-e447-4101-9e17-d9e20920eaa0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.650747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606743b6-3d3f-4a02-8624-18cd8350e538 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.737192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707d7b1d-e447-4101-9e17-d9e20920eaa0 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.744881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.745752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.746150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.746692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.749700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:check_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.749853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28196a1e-29f8-46ef-bf7d-a4a84913b15e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.750546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196a1e-29f8-46ef-bf7d-a4a84913b15e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.750833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196a1e-29f8-46ef-bf7d-a4a84913b15e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.750947 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:check_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:53.750947 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:53.750947 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:53.751157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28196a1e-29f8-46ef-bf7d-a4a84913b15e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.752038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.752245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28196a1e-29f8-46ef-bf7d-a4a84913b15e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.753722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.754184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28196a1e-29f8-46ef-bf7d-a4a84913b15e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.754924 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_implied_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:53.754924 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:53.754924 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:53.755932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.769535 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3078/6167] 10.222.0.25 () {58 vars in 1345 bytes} [Mon Oct 24 09:20:53 2022] HEAD /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:53.775114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.780303 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3090/6168] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:53 2022] POST /identity/v3/services => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:53.785657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28196a1e-29f8-46ef-bf7d-a4a84913b15e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.790045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025b2ccf-d117-441d-8780-5f2858283c9d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.803451 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:53.807213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6d6fc-853a-4db7-910f-a93dcbbf6738 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.807856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6d6fc-853a-4db7-910f-a93dcbbf6738 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.808138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6d6fc-853a-4db7-910f-a93dcbbf6738 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.808416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f6d6fc-853a-4db7-910f-a93dcbbf6738 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.810224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6d6fc-853a-4db7-910f-a93dcbbf6738 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.811855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f6d6fc-853a-4db7-910f-a93dcbbf6738 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.821915 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3079/6169] 10.222.0.25 () {58 vars in 1344 bytes} [Mon Oct 24 09:20:53 2022] GET /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 521 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:53.824660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6d6fc-853a-4db7-910f-a93dcbbf6738 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.826113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28196a1e-29f8-46ef-bf7d-a4a84913b15e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.832204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012124f-2adb-416d-9a46-4b0fa14b2172 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.833178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012124f-2adb-416d-9a46-4b0fa14b2172 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.833647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012124f-2adb-416d-9a46-4b0fa14b2172 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.834088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012124f-2adb-416d-9a46-4b0fa14b2172 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.834928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012124f-2adb-416d-9a46-4b0fa14b2172 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.837094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f6d6fc-853a-4db7-910f-a93dcbbf6738 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.839197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012124f-2adb-416d-9a46-4b0fa14b2172 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.842291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d574f16-ce02-44ff-a444-f2842144828f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.843040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574f16-ce02-44ff-a444-f2842144828f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.843419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574f16-ce02-44ff-a444-f2842144828f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.843792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d574f16-ce02-44ff-a444-f2842144828f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.845747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d574f16-ce02-44ff-a444-f2842144828f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.847594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d574f16-ce02-44ff-a444-f2842144828f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.855118 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3091/6170] 10.222.0.25 () {60 vars in 1213 bytes} [Mon Oct 24 09:20:53 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:53.859679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012124f-2adb-416d-9a46-4b0fa14b2172 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.865328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3080/6171] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:53 2022] DELETE /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:53.867024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d574f16-ce02-44ff-a444-f2842144828f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.886014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012124f-2adb-416d-9a46-4b0fa14b2172 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.959948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d574f16-ce02-44ff-a444-f2842144828f tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:53.965837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac86594-8a52-4188-8545-d0befbfa4020 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.966532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac86594-8a52-4188-8545-d0befbfa4020 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.966818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac86594-8a52-4188-8545-d0befbfa4020 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.967246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac86594-8a52-4188-8545-d0befbfa4020 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.969916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac86594-8a52-4188-8545-d0befbfa4020 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:get_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.970789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac86594-8a52-4188-8545-d0befbfa4020 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.981109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6ccb-8645-4a3e-981e-bfc5b3169c3e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-fac86594-8a52-4188-8545-d0befbfa4020 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] 254839460d35451bb5422643abab1e3c does not imply 9e650076b70f4b9a91acc8e605bca3e8.: keystone.exception.ImpliedRoleNotFound: 254839460d35451bb5422643abab1e3c does not imply 9e650076b70f4b9a91acc8e605bca3e8. Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = query.one() Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._iter().one() Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._only_one_row( Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:53.981992 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 235, in get Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_implied_role(prior_role_id, implied_role_id) Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 239, in _get_implied_role Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.role_api.get_implied_role( Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 149, in get_implied_role Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 24 09:20:53.983146 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 24 09:20:53.984138 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 24 09:20:53.984138 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 254839460d35451bb5422643abab1e3c does not imply 9e650076b70f4b9a91acc8e605bca3e8. Oct 24 09:20:53.984138 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:53.984343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6ccb-8645-4a3e-981e-bfc5b3169c3e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:53.984343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6ccb-8645-4a3e-981e-bfc5b3169c3e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:53.984343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5f6ccb-8645-4a3e-981e-bfc5b3169c3e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:53.984343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f6ccb-8645-4a3e-981e-bfc5b3169c3e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:53.984626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3081/6172] 10.222.0.25 () {58 vars in 1344 bytes} [Mon Oct 24 09:20:53 2022] GET /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 137 bytes in 117 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:20:53.984702 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-4e5f6ccb-8645-4a3e-981e-bfc5b3169c3e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoint_groups": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:53.984702 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:53.984702 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:53.985034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5f6ccb-8645-4a3e-981e-bfc5b3169c3e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:53.989522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac86594-8a52-4188-8545-d0befbfa4020 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:53.999030 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3092/6173] 10.222.0.25 () {58 vars in 1191 bytes} [Mon Oct 24 09:20:53 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 763 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:20:54.000460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6ccb-8645-4a3e-981e-bfc5b3169c3e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.006532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac86594-8a52-4188-8545-d0befbfa4020 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.013191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5f6ccb-8645-4a3e-981e-bfc5b3169c3e tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.014279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8e507-1f7f-4035-9389-657e75e84da9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.015099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8e507-1f7f-4035-9389-657e75e84da9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.015603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8e507-1f7f-4035-9389-657e75e84da9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.016054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f8e507-1f7f-4035-9389-657e75e84da9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.018047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8e507-1f7f-4035-9389-657e75e84da9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.018932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db84cc-a19c-4dfd-9046-c4c7782e89b4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.019572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db84cc-a19c-4dfd-9046-c4c7782e89b4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.019915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db84cc-a19c-4dfd-9046-c4c7782e89b4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.020204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8db84cc-a19c-4dfd-9046-c4c7782e89b4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/b95e7e6475124e9ebf84ac2034a8b3ea` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.020567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f8e507-1f7f-4035-9389-657e75e84da9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.020792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db84cc-a19c-4dfd-9046-c4c7782e89b4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=b95e7e6475124e9ebf84ac2034a8b3ea)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.021892 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-e8db84cc-a19c-4dfd-9046-c4c7782e89b4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint_group": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:54.021892 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:54.021892 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:54.022978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8db84cc-a19c-4dfd-9046-c4c7782e89b4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.032692 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3093/6174] 10.222.0.25 () {58 vars in 1290 bytes} [Mon Oct 24 09:20:53 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups/b95e7e6475124e9ebf84ac2034a8b3ea => generated 333 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:54.033779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db84cc-a19c-4dfd-9046-c4c7782e89b4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-21f8e507-1f7f-4035-9389-657e75e84da9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] 254839460d35451bb5422643abab1e3c does not imply 9e650076b70f4b9a91acc8e605bca3e8.: keystone.exception.ImpliedRoleNotFound: 254839460d35451bb5422643abab1e3c does not imply 9e650076b70f4b9a91acc8e605bca3e8. Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 105, in _get_implied_role Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = query.one() Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._iter().one() Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._only_one_row( Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:54.035419 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 270, in delete Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.role_api.delete_implied_role(prior_role_id, implied_role_id) Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1369, in delete_implied_role Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.driver.delete_implied_role(prior_role_id, implied_role_id) Oct 24 09:20:54.036682 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 129, in delete_implied_role Oct 24 09:20:54.037917 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = self._get_implied_role(session, prior_role_id, Oct 24 09:20:54.037917 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 107, in _get_implied_role Oct 24 09:20:54.037917 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ImpliedRoleNotFound( Oct 24 09:20:54.037917 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ImpliedRoleNotFound: 254839460d35451bb5422643abab1e3c does not imply 9e650076b70f4b9a91acc8e605bca3e8. Oct 24 09:20:54.037917 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:20:54.039898 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3082/6175] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:53 2022] DELETE /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 137 bytes in 51 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:20:54.044937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8e507-1f7f-4035-9389-657e75e84da9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.049027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8db84cc-a19c-4dfd-9046-c4c7782e89b4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.057345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f8e507-1f7f-4035-9389-657e75e84da9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.062827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c63b2-73db-4752-8b81-31a87d6affb4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.063496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c63b2-73db-4752-8b81-31a87d6affb4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.063788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c63b2-73db-4752-8b81-31a87d6affb4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.064078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234c63b2-73db-4752-8b81-31a87d6affb4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/b95e7e6475124e9ebf84ac2034a8b3ea` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.064722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c63b2-73db-4752-8b81-31a87d6affb4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:get_endpoint_group(endpoint_group_id=b95e7e6475124e9ebf84ac2034a8b3ea)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.066565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234c63b2-73db-4752-8b81-31a87d6affb4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.071837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6e47b-c151-4668-8074-7297433c79a8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.075327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3094/6176] 10.222.0.25 () {58 vars in 1291 bytes} [Mon Oct 24 09:20:54 2022] HEAD /identity/v3/OS-EP-FILTER/endpoint_groups/b95e7e6475124e9ebf84ac2034a8b3ea => generated 0 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 24 09:20:54.075469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6e47b-c151-4668-8074-7297433c79a8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.075469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6e47b-c151-4668-8074-7297433c79a8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.075469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6e47b-c151-4668-8074-7297433c79a8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.076274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6e47b-c151-4668-8074-7297433c79a8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.076484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c63b2-73db-4752-8b81-31a87d6affb4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.078057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6e47b-c151-4668-8074-7297433c79a8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.090478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234c63b2-73db-4752-8b81-31a87d6affb4 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.100590 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:54.102770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43df80a-bd4a-41d4-9df3-125ce75b9ea2 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.104425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43df80a-bd4a-41d4-9df3-125ce75b9ea2 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.104840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43df80a-bd4a-41d4-9df3-125ce75b9ea2 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.105225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43df80a-bd4a-41d4-9df3-125ce75b9ea2 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/b95e7e6475124e9ebf84ac2034a8b3ea` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.106008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43df80a-bd4a-41d4-9df3-125ce75b9ea2 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=b95e7e6475124e9ebf84ac2034a8b3ea)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.107192 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-e43df80a-bd4a-41d4-9df3-125ce75b9ea2 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:54.107192 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:54.107192 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:54.108517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43df80a-bd4a-41d4-9df3-125ce75b9ea2 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.120014 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3083/6177] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:54 2022] PUT /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 521 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:54.124225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6e47b-c151-4668-8074-7297433c79a8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.166790 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3095/6178] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 09:20:54 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/b95e7e6475124e9ebf84ac2034a8b3ea => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:54.168831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43df80a-bd4a-41d4-9df3-125ce75b9ea2 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.191814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43df80a-bd4a-41d4-9df3-125ce75b9ea2 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.254201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6e47b-c151-4668-8074-7297433c79a8 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.267681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2408a-0ef5-4124-b60c-c2dc06a99ab3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.271195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2408a-0ef5-4124-b60c-c2dc06a99ab3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.271195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2408a-0ef5-4124-b60c-c2dc06a99ab3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.271428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2408a-0ef5-4124-b60c-c2dc06a99ab3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/0983078836ae4880a884c8d4b0a20b89` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.278608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2408a-0ef5-4124-b60c-c2dc06a99ab3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=0983078836ae4880a884c8d4b0a20b89)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.282379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2408a-0ef5-4124-b60c-c2dc06a99ab3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.326843 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3084/6179] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:54 2022] PUT /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/0983078836ae4880a884c8d4b0a20b89 => generated 520 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:54.332677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2408a-0ef5-4124-b60c-c2dc06a99ab3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.339987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef83213-7bea-47b4-acf3-f9f0ef7a709f tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.341088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef83213-7bea-47b4-acf3-f9f0ef7a709f tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.341599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef83213-7bea-47b4-acf3-f9f0ef7a709f tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.342033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef83213-7bea-47b4-acf3-f9f0ef7a709f tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.342968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef83213-7bea-47b4-acf3-f9f0ef7a709f tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:list_endpoint_groups()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.345857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef83213-7bea-47b4-acf3-f9f0ef7a709f tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.358470 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3096/6180] 10.222.0.25 () {58 vars in 1191 bytes} [Mon Oct 24 09:20:54 2022] GET /identity/v3/OS-EP-FILTER/endpoint_groups => generated 449 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:54.359835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef83213-7bea-47b4-acf3-f9f0ef7a709f tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.372185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef83213-7bea-47b4-acf3-f9f0ef7a709f tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.429652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2408a-0ef5-4124-b60c-c2dc06a99ab3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.440458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9965f-7009-47a1-878c-76d1744b3570 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.442327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9965f-7009-47a1-878c-76d1744b3570 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.442616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9965f-7009-47a1-878c-76d1744b3570 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.442892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9965f-7009-47a1-878c-76d1744b3570 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.447164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9965f-7009-47a1-878c-76d1744b3570 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0983078836ae4880a884c8d4b0a20b89, implied_role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.448735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9965f-7009-47a1-878c-76d1744b3570 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.479319 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:54.491138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb3248-089c-426a-8860-87aa73f87786 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.493155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3248-089c-426a-8860-87aa73f87786 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.493282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3248-089c-426a-8860-87aa73f87786 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.493694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cb3248-089c-426a-8860-87aa73f87786 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/b95e7e6475124e9ebf84ac2034a8b3ea` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.494861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb3248-089c-426a-8860-87aa73f87786 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=b95e7e6475124e9ebf84ac2034a8b3ea)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.497952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cb3248-089c-426a-8860-87aa73f87786 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.515975 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3085/6181] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:54 2022] PUT /identity/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies/b2f496a0b4f14d4590607df2dff31464 => generated 520 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:54.520325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9965f-7009-47a1-878c-76d1744b3570 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-a5cb3248-089c-426a-8860-87aa73f87786 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Could not find Endpoint Group: b95e7e6475124e9ebf84ac2034a8b3ea.: keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: b95e7e6475124e9ebf84ac2034a8b3ea. Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/os_ep_filter.py", line 107, in delete Oct 24 09:20:54.542719 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return (PROVIDERS.catalog_api.delete_endpoint_group(endpoint_group_id), Oct 24 09:20:54.543683 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 519, in delete_endpoint_group Oct 24 09:20:54.543683 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application endpoint_group_ref = self._get_endpoint_group(session, Oct 24 09:20:54.543683 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 495, in _get_endpoint_group Oct 24 09:20:54.543683 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.EndpointGroupNotFound( Oct 24 09:20:54.543683 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.EndpointGroupNotFound: Could not find Endpoint Group: b95e7e6475124e9ebf84ac2034a8b3ea. Oct 24 09:20:54.543683 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:20:54.545472 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3097/6182] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 09:20:54 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/b95e7e6475124e9ebf84ac2034a8b3ea => generated 120 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:20:54.549532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb3248-089c-426a-8860-87aa73f87786 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.572698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cb3248-089c-426a-8860-87aa73f87786 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.700398 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:54.710788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9965f-7009-47a1-878c-76d1744b3570 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.723004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9333-58a8-4a13-8ac4-064397250169 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.725027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9333-58a8-4a13-8ac4-064397250169 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.725340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9333-58a8-4a13-8ac4-064397250169 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.725608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88da9333-58a8-4a13-8ac4-064397250169 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/role_inferences` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.727155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9333-58a8-4a13-8ac4-064397250169 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_role_inference_rules()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.730712 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-88da9333-58a8-4a13-8ac4-064397250169 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_role_inference_rules": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:54.730712 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:54.730712 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:54.732644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88da9333-58a8-4a13-8ac4-064397250169 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.749260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c1657-91c3-4a21-ab53-59639476f193 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.750603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1657-91c3-4a21-ab53-59639476f193 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.750901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1657-91c3-4a21-ab53-59639476f193 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.751179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c1657-91c3-4a21-ab53-59639476f193 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/services/795cb8c9b14846a5a9659a5de11b6e78` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.754750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c1657-91c3-4a21-ab53-59639476f193 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:delete_service(service_id=795cb8c9b14846a5a9659a5de11b6e78)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.760745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751c1657-91c3-4a21-ab53-59639476f193 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.789565 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3086/6183] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:20:54 2022] GET /identity/v3/role_inferences => generated 1606 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:54.795499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9333-58a8-4a13-8ac4-064397250169 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.804027 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3098/6184] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:54 2022] DELETE /identity/v3/services/795cb8c9b14846a5a9659a5de11b6e78 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:54.809767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c1657-91c3-4a21-ab53-59639476f193 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.815327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88da9333-58a8-4a13-8ac4-064397250169 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.848516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2efb12-a4b7-4aa1-8dc4-4a80aab36722 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.849568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2efb12-a4b7-4aa1-8dc4-4a80aab36722 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.850035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2efb12-a4b7-4aa1-8dc4-4a80aab36722 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.850719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2efb12-a4b7-4aa1-8dc4-4a80aab36722 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies/b2f496a0b4f14d4590607df2dff31464` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.853224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2efb12-a4b7-4aa1-8dc4-4a80aab36722 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0983078836ae4880a884c8d4b0a20b89, implied_role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.855397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2efb12-a4b7-4aa1-8dc4-4a80aab36722 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.877853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c1657-91c3-4a21-ab53-59639476f193 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:54.885176 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3087/6185] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:54 2022] DELETE /identity/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:54.890437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2efb12-a4b7-4aa1-8dc4-4a80aab36722 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.901838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d952e50-4faf-4eb5-9e32-e2c91859c68a tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:54.902466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952e50-4faf-4eb5-9e32-e2c91859c68a tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:54.902747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952e50-4faf-4eb5-9e32-e2c91859c68a tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:54.904302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d952e50-4faf-4eb5-9e32-e2c91859c68a tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:54.905282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952e50-4faf-4eb5-9e32-e2c91859c68a tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:54.906937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d952e50-4faf-4eb5-9e32-e2c91859c68a tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:54.964086 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3099/6186] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:54 2022] POST /identity/v3/services => generated 288 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:54.964533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d952e50-4faf-4eb5-9e32-e2c91859c68a tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:54.977515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4d952e50-4faf-4eb5-9e32-e2c91859c68a tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:55.030854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2efb12-a4b7-4aa1-8dc4-4a80aab36722 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.052534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca22caf-52dc-4994-ab65-baae3fcd7867 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.053270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca22caf-52dc-4994-ab65-baae3fcd7867 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.054891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca22caf-52dc-4994-ab65-baae3fcd7867 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.055220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca22caf-52dc-4994-ab65-baae3fcd7867 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/0983078836ae4880a884c8d4b0a20b89` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.057406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca22caf-52dc-4994-ab65-baae3fcd7867 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=0983078836ae4880a884c8d4b0a20b89)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.059410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca22caf-52dc-4994-ab65-baae3fcd7867 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.087205 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3088/6187] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:54 2022] DELETE /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/0983078836ae4880a884c8d4b0a20b89 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:55.088114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca22caf-52dc-4994-ab65-baae3fcd7867 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.091125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d952e50-4faf-4eb5-9e32-e2c91859c68a tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.238697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e3cbb-5473-4c01-a9e3-5f9fbf3d5664 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.243568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e3cbb-5473-4c01-a9e3-5f9fbf3d5664 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.246240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e3cbb-5473-4c01-a9e3-5f9fbf3d5664 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.247094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0e3cbb-5473-4c01-a9e3-5f9fbf3d5664 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.254723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e0e3cbb-5473-4c01-a9e3-5f9fbf3d5664 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:55.271248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca22caf-52dc-4994-ab65-baae3fcd7867 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.290104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a90b9-6eff-44b1-a46e-5ed380619976 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.292451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a90b9-6eff-44b1-a46e-5ed380619976 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.292896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a90b9-6eff-44b1-a46e-5ed380619976 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.293367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135a90b9-6eff-44b1-a46e-5ed380619976 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.295420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a90b9-6eff-44b1-a46e-5ed380619976 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:create_endpoint_group()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.296882 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-135a90b9-6eff-44b1-a46e-5ed380619976 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:55.296882 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:55.296882 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:55.298385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135a90b9-6eff-44b1-a46e-5ed380619976 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.299182 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:55.322891 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3089/6188] 10.222.0.25 () {60 vars in 1213 bytes} [Mon Oct 24 09:20:55 2022] POST /identity/v3/OS-EP-FILTER/endpoint_groups => generated 333 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:55.325221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a90b9-6eff-44b1-a46e-5ed380619976 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.432502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e3cbb-5473-4c01-a9e3-5f9fbf3d5664 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.438726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0e3cbb-5473-4c01-a9e3-5f9fbf3d5664 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.439273 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:55.480594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135a90b9-6eff-44b1-a46e-5ed380619976 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.497980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c424-7574-44cc-a110-d8b5e74366e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.502053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c424-7574-44cc-a110-d8b5e74366e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.502352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c424-7574-44cc-a110-d8b5e74366e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.504512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34c424-7574-44cc-a110-d8b5e74366e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.505749 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3100/6189] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:54 2022] GET /identity/v3/auth/tokens => generated 3637 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:20:55.508778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e3cbb-5473-4c01-a9e3-5f9fbf3d5664 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.511837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c424-7574-44cc-a110-d8b5e74366e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.517457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e34c424-7574-44cc-a110-d8b5e74366e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.543517 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3090/6190] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:55 2022] DELETE /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:55.549254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c424-7574-44cc-a110-d8b5e74366e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.552803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0e3cbb-5473-4c01-a9e3-5f9fbf3d5664 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.716444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9caad0-2c38-46a5-b5a9-2393b1ceec6b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.717195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9caad0-2c38-46a5-b5a9-2393b1ceec6b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.717607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9caad0-2c38-46a5-b5a9-2393b1ceec6b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.717944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9caad0-2c38-46a5-b5a9-2393b1ceec6b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.719249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9caad0-2c38-46a5-b5a9-2393b1ceec6b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.722453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9caad0-2c38-46a5-b5a9-2393b1ceec6b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.727840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34c424-7574-44cc-a110-d8b5e74366e9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.736806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d011d-ec1a-4dfc-9edc-127bb32566c9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.737470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d011d-ec1a-4dfc-9edc-127bb32566c9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.737815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d011d-ec1a-4dfc-9edc-127bb32566c9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.738173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3d011d-ec1a-4dfc-9edc-127bb32566c9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.739124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d011d-ec1a-4dfc-9edc-127bb32566c9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.741194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3d011d-ec1a-4dfc-9edc-127bb32566c9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.754814 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3101/6191] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:20:55 2022] POST /identity/v3/services => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:55.760428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9caad0-2c38-46a5-b5a9-2393b1ceec6b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.787771 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3091/6192] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:55 2022] GET /identity/v3/roles => generated 2323 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:55.796219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d011d-ec1a-4dfc-9edc-127bb32566c9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.816969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3d011d-ec1a-4dfc-9edc-127bb32566c9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.818686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9caad0-2c38-46a5-b5a9-2393b1ceec6b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.828804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de615-c79b-45b8-86de-657488f931ab tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.829494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de615-c79b-45b8-86de-657488f931ab tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.829795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de615-c79b-45b8-86de-657488f931ab tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.830080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702de615-c79b-45b8-86de-657488f931ab tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/907666c37110411bb936ffee390455d7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.831907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702de615-c79b-45b8-86de-657488f931ab tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:update_endpoint_group(endpoint_group_id=907666c37110411bb936ffee390455d7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.833931 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-702de615-c79b-45b8-86de-657488f931ab tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:55.833931 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:55.833931 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:55.834909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702de615-c79b-45b8-86de-657488f931ab tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.852137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a3d8d-fb4e-4608-939c-564cca772af7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.853030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a3d8d-fb4e-4608-939c-564cca772af7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.854279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a3d8d-fb4e-4608-939c-564cca772af7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.854687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0a3d8d-fb4e-4608-939c-564cca772af7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.855440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a3d8d-fb4e-4608-939c-564cca772af7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.863188 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3102/6193] 10.222.0.25 () {60 vars in 1313 bytes} [Mon Oct 24 09:20:55 2022] PATCH /identity/v3/OS-EP-FILTER/endpoint_groups/907666c37110411bb936ffee390455d7 => generated 335 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:55.863883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0a3d8d-fb4e-4608-939c-564cca772af7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.864023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de615-c79b-45b8-86de-657488f931ab tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.881763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702de615-c79b-45b8-86de-657488f931ab tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.890139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea3275-e8f4-4329-967a-abcbe1c1fdd3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.890799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea3275-e8f4-4329-967a-abcbe1c1fdd3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.891091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea3275-e8f4-4329-967a-abcbe1c1fdd3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.891399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ea3275-e8f4-4329-967a-abcbe1c1fdd3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/services/82767b337ced4f9886eca429dcb33c83` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.893340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea3275-e8f4-4329-967a-abcbe1c1fdd3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:delete_service(service_id=82767b337ced4f9886eca429dcb33c83)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.895521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ea3275-e8f4-4329-967a-abcbe1c1fdd3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.897174 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3092/6194] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:20:55 2022] POST /identity/v3/roles => generated 233 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:55.898947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a3d8d-fb4e-4608-939c-564cca772af7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.913225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0a3d8d-fb4e-4608-939c-564cca772af7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:55.923056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641a7c6-5530-4e48-8b1a-85a6944c73d3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:55.923756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641a7c6-5530-4e48-8b1a-85a6944c73d3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:55.924311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641a7c6-5530-4e48-8b1a-85a6944c73d3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:55.924449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8641a7c6-5530-4e48-8b1a-85a6944c73d3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/c12b754a63af466cab1baf59d840d744` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:55.925992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641a7c6-5530-4e48-8b1a-85a6944c73d3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:update_role(role_id=c12b754a63af466cab1baf59d840d744)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:55.927080 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-8641a7c6-5530-4e48-8b1a-85a6944c73d3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:55.927080 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:55.927080 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:55.927968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8641a7c6-5530-4e48-8b1a-85a6944c73d3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:55.940368 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3103/6195] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:55 2022] DELETE /identity/v3/services/82767b337ced4f9886eca429dcb33c83 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:55.944530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea3275-e8f4-4329-967a-abcbe1c1fdd3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.980320 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3093/6196] 10.222.0.25 () {60 vars in 1243 bytes} [Mon Oct 24 09:20:55 2022] PATCH /identity/v3/roles/c12b754a63af466cab1baf59d840d744 => generated 238 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:55.982229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641a7c6-5530-4e48-8b1a-85a6944c73d3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:55.997636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8641a7c6-5530-4e48-8b1a-85a6944c73d3 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.003734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ea3275-e8f4-4329-967a-abcbe1c1fdd3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.019673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54cfae-9be4-4d7d-8ef4-e3d6bfb86ab3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.020322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54cfae-9be4-4d7d-8ef4-e3d6bfb86ab3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.020602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54cfae-9be4-4d7d-8ef4-e3d6bfb86ab3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.020877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a54cfae-9be4-4d7d-8ef4-e3d6bfb86ab3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/907666c37110411bb936ffee390455d7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.021507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54cfae-9be4-4d7d-8ef4-e3d6bfb86ab3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=907666c37110411bb936ffee390455d7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.022619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4792c-b007-45bf-81e1-9896756c4386 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.023187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a54cfae-9be4-4d7d-8ef4-e3d6bfb86ab3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.023329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4792c-b007-45bf-81e1-9896756c4386 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.023671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4792c-b007-45bf-81e1-9896756c4386 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.023947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4792c-b007-45bf-81e1-9896756c4386 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/c12b754a63af466cab1baf59d840d744` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.037474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4792c-b007-45bf-81e1-9896756c4386 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:get_role(role_id=c12b754a63af466cab1baf59d840d744)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.039562 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-d4e4792c-b007-45bf-81e1-9896756c4386 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:56.039562 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:56.039562 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:56.040807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4792c-b007-45bf-81e1-9896756c4386 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.046267 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3104/6198] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 09:20:55 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/907666c37110411bb936ffee390455d7 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:56.046476 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3094/6198] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:20:55 2022] GET /identity/v3/roles/c12b754a63af466cab1baf59d840d744 => generated 238 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:56.047478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4792c-b007-45bf-81e1-9896756c4386 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.047826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54cfae-9be4-4d7d-8ef4-e3d6bfb86ab3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.062254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4792c-b007-45bf-81e1-9896756c4386 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.066476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a54cfae-9be4-4d7d-8ef4-e3d6bfb86ab3 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.068674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cd55b-d3e7-429c-8fea-98d55a8d9e9b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.069436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cd55b-d3e7-429c-8fea-98d55a8d9e9b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.070030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cd55b-d3e7-429c-8fea-98d55a8d9e9b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.070428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cd55b-d3e7-429c-8fea-98d55a8d9e9b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/services/e736395acf704c8d9ef45ea4ccd8f8c8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.071281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cd55b-d3e7-429c-8fea-98d55a8d9e9b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:delete_service(service_id=e736395acf704c8d9ef45ea4ccd8f8c8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.072445 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-0e8cd55b-d3e7-429c-8fea-98d55a8d9e9b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:56.072445 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:56.072445 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:56.073746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cd55b-d3e7-429c-8fea-98d55a8d9e9b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.078038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92129c29-8c3e-4ffe-89c2-10904639bce9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.078662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92129c29-8c3e-4ffe-89c2-10904639bce9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.078944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92129c29-8c3e-4ffe-89c2-10904639bce9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.079213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92129c29-8c3e-4ffe-89c2-10904639bce9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.079872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92129c29-8c3e-4ffe-89c2-10904639bce9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.081617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92129c29-8c3e-4ffe-89c2-10904639bce9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.104721 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3105/6199] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:20:56 2022] GET /identity/v3/roles => generated 2552 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:20:56.109486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92129c29-8c3e-4ffe-89c2-10904639bce9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.123418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92129c29-8c3e-4ffe-89c2-10904639bce9 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.128447 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3095/6200] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:56 2022] DELETE /identity/v3/services/e736395acf704c8d9ef45ea4ccd8f8c8 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:56.133380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cd55b-d3e7-429c-8fea-98d55a8d9e9b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.139021 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:UPDATE=1,keystone:DELETE=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:56.144666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.146262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.146659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.147041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/c12b754a63af466cab1baf59d840d744` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.150092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c12b754a63af466cab1baf59d840d744)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.152213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.186498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cd55b-d3e7-429c-8fea-98d55a8d9e9b tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.195181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.195891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.196174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.196715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/OS-EP-FILTER/endpoint_groups/c0e5bb43f99e42afa36afa8568fc4c3d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.197214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:delete_endpoint_group(endpoint_group_id=c0e5bb43f99e42afa36afa8568fc4c3d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.198300 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint_group": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:56.198300 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:56.198300 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:56.199287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.208387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role c12b754a63af466cab1baf59d840d744 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:56.209033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:56.210078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:56.213929 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3106/6201] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:56 2022] DELETE /identity/v3/roles/c12b754a63af466cab1baf59d840d744 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:56.225496 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3096/6202] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 09:20:56 2022] DELETE /identity/v3/OS-EP-FILTER/endpoint_groups/c0e5bb43f99e42afa36afa8568fc4c3d => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:56.232495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.232705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.234996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:56.236172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:56.255205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a116e-b3a5-4061-9a35-168ae87104de tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.318376 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:56.365092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e067f-a5cf-473f-aaf6-229e3bd0a678 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '063c5ff946294d71925836618e6e071b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5687c27533ef41f685b06e300f24c12c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.365635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e067f-a5cf-473f-aaf6-229e3bd0a678 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.365976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e067f-a5cf-473f-aaf6-229e3bd0a678 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.366162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97be7ac-e5d0-473d-8024-085ab7aa7637 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.367202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e067f-a5cf-473f-aaf6-229e3bd0a678 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] PATH_INFO: `/v3/services/512bf9f8618941f28a8dffd87a93cce7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.367870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e067f-a5cf-473f-aaf6-229e3bd0a678 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorizing `identity:delete_service(service_id=512bf9f8618941f28a8dffd87a93cce7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.370275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e067f-a5cf-473f-aaf6-229e3bd0a678 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.372102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9cb87-b66c-4d31-a155-fc2bd165b709 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.373195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9cb87-b66c-4d31-a155-fc2bd165b709 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.373570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9cb87-b66c-4d31-a155-fc2bd165b709 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.373917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d9cb87-b66c-4d31-a155-fc2bd165b709 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.376240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9cb87-b66c-4d31-a155-fc2bd165b709 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.377833 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-f1d9cb87-b66c-4d31-a155-fc2bd165b709 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:56.377833 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:56.377833 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:56.379279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d9cb87-b66c-4d31-a155-fc2bd165b709 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.412834 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3097/6203] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:56 2022] DELETE /identity/v3/services/512bf9f8618941f28a8dffd87a93cce7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:56.417659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e067f-a5cf-473f-aaf6-229e3bd0a678 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.424068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-808e067f-a5cf-473f-aaf6-229e3bd0a678 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:56.434494 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3107/6204] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:56 2022] PUT /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 521 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:56.440870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9cb87-b66c-4d31-a155-fc2bd165b709 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.586727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d9cb87-b66c-4d31-a155-fc2bd165b709 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.629844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff39ed-ef2c-4185-a854-9df7859dd997 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.633842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff39ed-ef2c-4185-a854-9df7859dd997 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.634146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff39ed-ef2c-4185-a854-9df7859dd997 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.634423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ff39ed-ef2c-4185-a854-9df7859dd997 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/0983078836ae4880a884c8d4b0a20b89` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.638831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff39ed-ef2c-4185-a854-9df7859dd997 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=0983078836ae4880a884c8d4b0a20b89)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.640494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ff39ed-ef2c-4185-a854-9df7859dd997 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.660199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e067f-a5cf-473f-aaf6-229e3bd0a678 tempest-EndPointGroupsTest-1415432031 tempest-EndPointGroupsTest-1415432031-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.698272 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3108/6205] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:56 2022] PUT /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/0983078836ae4880a884c8d4b0a20b89 => generated 520 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:20:56.702132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff39ed-ef2c-4185-a854-9df7859dd997 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.721826 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:56.780953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.781692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.782041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.782322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] PATH_INFO: `/v3/users/5490e9f7f5a2459082cffb5da161fc46` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.784168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] RBAC: Authorizing `identity:delete_user(user_id=5490e9f7f5a2459082cffb5da161fc46)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.787279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.808693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ff39ed-ef2c-4185-a854-9df7859dd997 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:56.815245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20d60f-20e3-4d5d-9c19-629582dfe3e7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:56.816271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20d60f-20e3-4d5d-9c19-629582dfe3e7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.816560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20d60f-20e3-4d5d-9c19-629582dfe3e7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.816983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20d60f-20e3-4d5d-9c19-629582dfe3e7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies/b2f496a0b4f14d4590607df2dff31464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.818749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20d60f-20e3-4d5d-9c19-629582dfe3e7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:create_implied_role(prior_role_id=0983078836ae4880a884c8d4b0a20b89, implied_role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:56.820462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20d60f-20e3-4d5d-9c19-629582dfe3e7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:56.863701 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3109/6206] 10.222.0.25 () {60 vars in 1363 bytes} [Mon Oct 24 09:20:56 2022] PUT /identity/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies/b2f496a0b4f14d4590607df2dff31464 => generated 520 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:20:56.868575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20d60f-20e3-4d5d-9c19-629582dfe3e7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:56.878115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5490e9f7f5a2459082cffb5da161fc46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:56.880289 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:56.906170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5490e9f7f5a2459082cffb5da161fc46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:56.906930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5490e9f7f5a2459082cffb5da161fc46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:56.918736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5490e9f7f5a2459082cffb5da161fc46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:56.929546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-352735fa-daa1-45ea-92d2-1c62e970999b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5490e9f7f5a2459082cffb5da161fc46'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:56.937833 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3098/6207] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:56 2022] DELETE /identity/v3/users/5490e9f7f5a2459082cffb5da161fc46 => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:56.941984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad190f-2f17-4457-869c-a58ab227b4a7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:56.942489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad190f-2f17-4457-869c-a58ab227b4a7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:56.942980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ad190f-2f17-4457-869c-a58ab227b4a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:56.971421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-39ad190f-2f17-4457-869c-a58ab227b4a7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:20:56.973179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-39ad190f-2f17-4457-869c-a58ab227b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:57.013837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20d60f-20e3-4d5d-9c19-629582dfe3e7 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:57.073253 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3099/6208] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:20:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:20:57.131458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ddbb-7281-4c96-b784-68cb6a88dcb4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:57.133988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ddbb-7281-4c96-b784-68cb6a88dcb4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:57.134501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ddbb-7281-4c96-b784-68cb6a88dcb4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:57.134967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb2ddbb-7281-4c96-b784-68cb6a88dcb4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:57.136457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ddbb-7281-4c96-b784-68cb6a88dcb4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=0983078836ae4880a884c8d4b0a20b89)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:57.137910 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-0bb2ddbb-7281-4c96-b784-68cb6a88dcb4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:57.137910 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:57.137910 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:57.139740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb2ddbb-7281-4c96-b784-68cb6a88dcb4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:57.148237 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3110/6209] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:20:56 2022] GET /identity/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies => generated 489 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:57.152473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad190f-2f17-4457-869c-a58ab227b4a7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:57.155521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-39ad190f-2f17-4457-869c-a58ab227b4a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:57.192127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ad190f-2f17-4457-869c-a58ab227b4a7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:57.198565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36262c-41ea-40ab-9723-090df905a3e4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:57.201084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36262c-41ea-40ab-9723-090df905a3e4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:57.203217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36262c-41ea-40ab-9723-090df905a3e4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:57.204015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36262c-41ea-40ab-9723-090df905a3e4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:57.207365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36262c-41ea-40ab-9723-090df905a3e4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:list_implied_roles(prior_role_id=254839460d35451bb5422643abab1e3c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:57.208723 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-3d36262c-41ea-40ab-9723-090df905a3e4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_implied_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:57.208723 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:20:57.208723 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:20:57.210116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36262c-41ea-40ab-9723-090df905a3e4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:57.229665 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3100/6210] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:20:57 2022] GET /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies => generated 660 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:20:57.233990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ddbb-7281-4c96-b784-68cb6a88dcb4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:57.251385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb2ddbb-7281-4c96-b784-68cb6a88dcb4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:57.271303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d9059-1c22-4f38-a371-adcfdd63d452 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:57.272670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d9059-1c22-4f38-a371-adcfdd63d452 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:57.273141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d9059-1c22-4f38-a371-adcfdd63d452 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:57.273617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0d9059-1c22-4f38-a371-adcfdd63d452 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies/b2f496a0b4f14d4590607df2dff31464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:57.276177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d9059-1c22-4f38-a371-adcfdd63d452 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=0983078836ae4880a884c8d4b0a20b89, implied_role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:57.277392 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-df0d9059-1c22-4f38-a371-adcfdd63d452 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_implied_role": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:20:57.277392 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:20:57.277392 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:20:57.278823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0d9059-1c22-4f38-a371-adcfdd63d452 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:57.293936 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3111/6211] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:57 2022] DELETE /identity/v3/roles/0983078836ae4880a884c8d4b0a20b89/implies/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:57.299567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36262c-41ea-40ab-9723-090df905a3e4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:57.316081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36262c-41ea-40ab-9723-090df905a3e4 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:57.406730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97203841-0d87-4260-9145-3a33652a7f0c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:57.407791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97203841-0d87-4260-9145-3a33652a7f0c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:57.408251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97203841-0d87-4260-9145-3a33652a7f0c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:57.408696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97203841-0d87-4260-9145-3a33652a7f0c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/0983078836ae4880a884c8d4b0a20b89` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:57.410767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97203841-0d87-4260-9145-3a33652a7f0c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=0983078836ae4880a884c8d4b0a20b89)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:57.412911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97203841-0d87-4260-9145-3a33652a7f0c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:57.425542 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3101/6212] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:57 2022] DELETE /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/0983078836ae4880a884c8d4b0a20b89 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:57.430201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d9059-1c22-4f38-a371-adcfdd63d452 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:57.441739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0d9059-1c22-4f38-a371-adcfdd63d452 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:57.481537 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:57.506674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97203841-0d87-4260-9145-3a33652a7f0c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:57.509700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-97203841-0d87-4260-9145-3a33652a7f0c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:57.527638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0af7e1-0b29-469e-8b0d-6af68bb1efd1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:57.529033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0af7e1-0b29-469e-8b0d-6af68bb1efd1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:57.529243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0af7e1-0b29-469e-8b0d-6af68bb1efd1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:57.529652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0af7e1-0b29-469e-8b0d-6af68bb1efd1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:57.532757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0af7e1-0b29-469e-8b0d-6af68bb1efd1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_implied_role(prior_role_id=254839460d35451bb5422643abab1e3c, implied_role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:57.535174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0af7e1-0b29-469e-8b0d-6af68bb1efd1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:57.553546 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3112/6213] 10.222.0.25 () {58 vars in 1347 bytes} [Mon Oct 24 09:20:57 2022] DELETE /identity/v3/roles/254839460d35451bb5422643abab1e3c/implies/9e650076b70f4b9a91acc8e605bca3e8 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:57.560886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0af7e1-0b29-469e-8b0d-6af68bb1efd1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:57.650666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0af7e1-0b29-469e-8b0d-6af68bb1efd1 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:57.657771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac129bb-5ac4-4511-9d14-0b8001ca3fdd tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:57.658514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac129bb-5ac4-4511-9d14-0b8001ca3fdd tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:57.659605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac129bb-5ac4-4511-9d14-0b8001ca3fdd tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:57.659925 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:57.660485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac129bb-5ac4-4511-9d14-0b8001ca3fdd tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/e332319ec9114611b0c5a89edfe6b257` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:57.665845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97203841-0d87-4260-9145-3a33652a7f0c tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:57.675974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac129bb-5ac4-4511-9d14-0b8001ca3fdd tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-1ac129bb-5ac4-4511-9d14-0b8001ca3fdd tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Could not find domain: e332319ec9114611b0c5a89edfe6b257.: keystone.exception.DomainNotFound: Could not find domain: e332319ec9114611b0c5a89edfe6b257. Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: e332319ec9114611b0c5a89edfe6b257. Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:20:57.684317 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:20:57.685962 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: e332319ec9114611b0c5a89edfe6b257. Oct 24 09:20:57.686975 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:20:57.688088 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3113/6214] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:20:57 2022] PATCH /identity/v3/domains/e332319ec9114611b0c5a89edfe6b257 => generated 112 bytes in 127 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 24 09:20:57.689804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac129bb-5ac4-4511-9d14-0b8001ca3fdd tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:57.704992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac129bb-5ac4-4511-9d14-0b8001ca3fdd tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:57.711375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:57.712063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:57.712264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:57.712720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/users/7833d6ec0847403d9c4eb7e304ea2ed7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:57.713801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_user(user_id=7833d6ec0847403d9c4eb7e304ea2ed7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:57.715878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:57.803787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b66404-9dac-470f-ab8d-826c733ff74f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:57.804623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b66404-9dac-470f-ab8d-826c733ff74f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:57.804910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b66404-9dac-470f-ab8d-826c733ff74f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:57.805451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b66404-9dac-470f-ab8d-826c733ff74f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:57.828256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7833d6ec0847403d9c4eb7e304ea2ed7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:57.855336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7833d6ec0847403d9c4eb7e304ea2ed7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:57.859375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7833d6ec0847403d9c4eb7e304ea2ed7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:57.871970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7833d6ec0847403d9c4eb7e304ea2ed7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:57.883915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7833d6ec0847403d9c4eb7e304ea2ed7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:57.896264 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3114/6215] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:57 2022] DELETE /identity/v3/users/7833d6ec0847403d9c4eb7e304ea2ed7 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:57.898245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:57.899829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:57.915816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b66404-9dac-470f-ab8d-826c733ff74f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:57.917445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b66404-9dac-470f-ab8d-826c733ff74f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:57.931243 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3102/6216] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:20:57.955717 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:58.006802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f2586a-64bd-40af-9785-69c8ecacc457 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:58.013267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:58.014841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:58.015142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:58.015549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/b2f496a0b4f14d4590607df2dff31464` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:58.017001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b2f496a0b4f14d4590607df2dff31464)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:58.018804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:58.078987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role b2f496a0b4f14d4590607df2dff31464 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:58.078987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.078987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.080423 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3115/6217] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:57 2022] DELETE /identity/v3/roles/b2f496a0b4f14d4590607df2dff31464 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:58.088880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b66404-9dac-470f-ab8d-826c733ff74f service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:58.103445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b66404-9dac-470f-ab8d-826c733ff74f service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:58.219613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27588a7-92f8-4c7c-9d81-cb269482843b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:58.220551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27588a7-92f8-4c7c-9d81-cb269482843b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:58.221040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27588a7-92f8-4c7c-9d81-cb269482843b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:58.221701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27588a7-92f8-4c7c-9d81-cb269482843b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/groups/dbc2e77628f34db6a8cad3feb6ef9373` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:58.223175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27588a7-92f8-4c7c-9d81-cb269482843b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_group(group_id=dbc2e77628f34db6a8cad3feb6ef9373)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:58.225184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27588a7-92f8-4c7c-9d81-cb269482843b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:58.284118 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3103/6218] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:20:58 2022] DELETE /identity/v3/groups/dbc2e77628f34db6a8cad3feb6ef9373 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:58.289223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:58.290983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:58.308969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2eea06-796e-4886-8923-8610cfcdfb0e tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:58.390735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:58.391389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:58.391677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:58.391960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:58.393125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_project(project_id=0dfa5a59a9884edabcf68760aa9b82c1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:58.396294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:58.462030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dfa5a59a9884edabcf68760aa9b82c1', 'request_id': 'req-ea5132be-656e-4f19-b9c2-411836cbadd6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.475346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dfa5a59a9884edabcf68760aa9b82c1', 'request_id': 'req-ea5132be-656e-4f19-b9c2-411836cbadd6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.489845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dfa5a59a9884edabcf68760aa9b82c1', 'request_id': 'req-ea5132be-656e-4f19-b9c2-411836cbadd6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.519833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] The token cache is being invalidate because project 0dfa5a59a9884edabcf68760aa9b82c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:58.520907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.521864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.524762 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3116/6219] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:58 2022] DELETE /identity/v3/projects/0dfa5a59a9884edabcf68760aa9b82c1 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:58.528897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27588a7-92f8-4c7c-9d81-cb269482843b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:58.530699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f27588a7-92f8-4c7c-9d81-cb269482843b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:58.549214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27588a7-92f8-4c7c-9d81-cb269482843b tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:58.559459 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:58.647514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:58.648589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:58.649114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:58.650203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:58.651899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=6731c601059646e797f14361fdc8bdf7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:58.655482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:58.702977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '6731c601059646e797f14361fdc8bdf7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.704088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '6731c601059646e797f14361fdc8bdf7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.755536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '6731c601059646e797f14361fdc8bdf7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.757424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '6731c601059646e797f14361fdc8bdf7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:58.765254 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3104/6220] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:20:58 2022] PATCH /identity/v3/domains/6731c601059646e797f14361fdc8bdf7 => generated 278 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:20:58.770543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:58.799330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5132be-656e-4f19-b9c2-411836cbadd6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:58.848374 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:58.935011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:58.935902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:58.937059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:58.937059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/domains/6731c601059646e797f14361fdc8bdf7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:58.963414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=6731c601059646e797f14361fdc8bdf7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:58.968754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:59.033814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '6731c601059646e797f14361fdc8bdf7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.047308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '6731c601059646e797f14361fdc8bdf7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.126537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6731c601059646e797f14361fdc8bdf7', 'request_id': 'req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.138027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6731c601059646e797f14361fdc8bdf7', 'request_id': 'req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.148147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6731c601059646e797f14361fdc8bdf7', 'request_id': 'req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.161166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:59.162831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:59.164616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] The token cache is being invalidate because project 6731c601059646e797f14361fdc8bdf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:59.165025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.166876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.184520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '6731c601059646e797f14361fdc8bdf7', 'request_id': 'req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.186264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '6731c601059646e797f14361fdc8bdf7', 'request_id': 'req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.187918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '6731c601059646e797f14361fdc8bdf7', 'request_id': 'req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.214480 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3117/6221] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:20:58 2022] DELETE /identity/v3/domains/6731c601059646e797f14361fdc8bdf7 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:59.215745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:59.217522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:59.318411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a47b47-5417-4c5a-96aa-00906db3f770 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:59.344527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fabce7c-1e94-41e4-9cd9-a552dd78f73d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:59.359234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:59.360805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:59.363462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:59.364305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/0983078836ae4880a884c8d4b0a20b89` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:59.368164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_role(role_id=0983078836ae4880a884c8d4b0a20b89)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:59.373467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:59.398895 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:59.464227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role 0983078836ae4880a884c8d4b0a20b89 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:59.464539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.465402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.467703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:59.468010 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3118/6222] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:59 2022] DELETE /identity/v3/roles/0983078836ae4880a884c8d4b0a20b89 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:20:59.472214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:59.472460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:59.473289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:59.473289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] PATH_INFO: `/v3/projects/e9a96b75c4514ef1be9b6a88fff7ca49` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:59.476332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a96b75c4514ef1be9b6a88fff7ca49)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:59.477936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:59.478356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:59.529876 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:UPDATE=1,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:20:59.591498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a96b75c4514ef1be9b6a88fff7ca49', 'request_id': 'req-a47260c6-ba36-48a4-87b9-d9ceceebc27e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.617428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a96b75c4514ef1be9b6a88fff7ca49', 'request_id': 'req-a47260c6-ba36-48a4-87b9-d9ceceebc27e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.648219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a96b75c4514ef1be9b6a88fff7ca49', 'request_id': 'req-a47260c6-ba36-48a4-87b9-d9ceceebc27e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.672941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] The token cache is being invalidate because project e9a96b75c4514ef1be9b6a88fff7ca49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:59.673239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.676378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c426a08-8d78-42bf-85d1-58f2ae55d9b6 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:59.676936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.679528 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3105/6223] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:20:59 2022] DELETE /identity/v3/projects/e9a96b75c4514ef1be9b6a88fff7ca49 => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:59.685568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:59.687193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:59.805221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47260c6-ba36-48a4-87b9-d9ceceebc27e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:20:59.811751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:59.812408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:59.812801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:59.813085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] PATH_INFO: `/v3/users/063c5ff946294d71925836618e6e071b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:59.814291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063c5ff946294d71925836618e6e071b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:59.816788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:59.885503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:20:59.885503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:20:59.885503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:20:59.886234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/9e650076b70f4b9a91acc8e605bca3e8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:20:59.888942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_role(role_id=9e650076b70f4b9a91acc8e605bca3e8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:20:59.890693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:20:59.935024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063c5ff946294d71925836618e6e071b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.956599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role 9e650076b70f4b9a91acc8e605bca3e8 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:20:59.960561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063c5ff946294d71925836618e6e071b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.961513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063c5ff946294d71925836618e6e071b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.962763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.966321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.970823 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3119/6224] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:59 2022] DELETE /identity/v3/roles/9e650076b70f4b9a91acc8e605bca3e8 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:20:59.976471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063c5ff946294d71925836618e6e071b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.977054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:20:59.979551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:20:59.985226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063c5ff946294d71925836618e6e071b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:20:59.996803 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3106/6225] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:59 2022] DELETE /identity/v3/users/063c5ff946294d71925836618e6e071b => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:00.036603 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:00.056226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde498b7-adfc-4f21-948b-56389617c613 tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:00.137222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '092f48b0b88c4de6bc9f3f09de4913bb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '026916db32034831bba78a7e7216f9c1', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:00.138082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:00.138354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:00.138836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] PATH_INFO: `/v3/roles/254839460d35451bb5422643abab1e3c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:00.140924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorizing `identity:delete_role(role_id=254839460d35451bb5422643abab1e3c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:00.142660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:00.191560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invalidating the token cache because role 254839460d35451bb5422643abab1e3c has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:00.191882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:00.192753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:00.199614 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3120/6226] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:20:59 2022] DELETE /identity/v3/roles/254839460d35451bb5422643abab1e3c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:00.204851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:00.208667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:00.252329 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:00.293729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e91df4-125b-4ede-a16b-3ba2c2e51015 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:00.347075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:00.348101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:00.425347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:00.426010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:00.426288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:00.427211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] PATH_INFO: `/v3/users/6d1e5f0278274dc1813e66fec8759d61` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:00.430948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1e5f0278274dc1813e66fec8759d61)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:00.432922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:00.515848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496fb381-93d3-4efd-b5c4-9832c20e0c0d tempest-RolesV3TestJSON-1285448315 tempest-RolesV3TestJSON-1285448315-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:00.521158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5c9e9-06b6-492c-b81d-5e67b261c826 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ae38d5dc821452f98a6e1f8f899e980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba565653ae843e38f31a9b7ededfc9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:00.521872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5c9e9-06b6-492c-b81d-5e67b261c826 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:00.522164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5c9e9-06b6-492c-b81d-5e67b261c826 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:00.522445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc5c9e9-06b6-492c-b81d-5e67b261c826 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:00.523691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5c9e9-06b6-492c-b81d-5e67b261c826 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:00.524399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5c9e9-06b6-492c-b81d-5e67b261c826 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:00.527004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc5c9e9-06b6-492c-b81d-5e67b261c826 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:00.544159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1e5f0278274dc1813e66fec8759d61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:00.547668 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3121/6227] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:21:00.548867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5c9e9-06b6-492c-b81d-5e67b261c826 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:00.568266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1e5f0278274dc1813e66fec8759d61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:00.572869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1e5f0278274dc1813e66fec8759d61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:00.579353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc5c9e9-06b6-492c-b81d-5e67b261c826 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:00.586847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0f7c1-721f-4139-887f-a1780d8e7390 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ae38d5dc821452f98a6e1f8f899e980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba565653ae843e38f31a9b7ededfc9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:00.587123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1e5f0278274dc1813e66fec8759d61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:00.587907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0f7c1-721f-4139-887f-a1780d8e7390 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:00.588341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0f7c1-721f-4139-887f-a1780d8e7390 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:00.589006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c0f7c1-721f-4139-887f-a1780d8e7390 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:00.590536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0f7c1-721f-4139-887f-a1780d8e7390 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:00.593593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c0f7c1-721f-4139-887f-a1780d8e7390 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:00.603362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1ac0b40e-bbf9-4841-ba33-1d4c16c119bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1e5f0278274dc1813e66fec8759d61'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:00.610371 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3107/6228] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:00 2022] DELETE /identity/v3/users/6d1e5f0278274dc1813e66fec8759d61 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:00.615401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5564-a57f-48fc-85fa-9b4bf88e8e5e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:00.615686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5564-a57f-48fc-85fa-9b4bf88e8e5e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:00.615962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bf5564-a57f-48fc-85fa-9b4bf88e8e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:00.643028 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3122/6229] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:00 2022] POST /identity/v3/projects => generated 347 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:00.644606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0f7c1-721f-4139-887f-a1780d8e7390 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:00.646547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-55c0f7c1-721f-4139-887f-a1780d8e7390 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:00.658615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d3bf5564-a57f-48fc-85fa-9b4bf88e8e5e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:00.659831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d3bf5564-a57f-48fc-85fa-9b4bf88e8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:00.684844 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:00.743850 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:00.761701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c0f7c1-721f-4139-887f-a1780d8e7390 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:00.767860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3108/6230] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:00.770133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ae38d5dc821452f98a6e1f8f899e980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba565653ae843e38f31a9b7ededfc9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:00.770761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:00.771108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:00.771421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:00.772074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:00.772552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:00.774547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:00.793808 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3123/6231] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:00.847862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5564-a57f-48fc-85fa-9b4bf88e8e5e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:00.849885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d3bf5564-a57f-48fc-85fa-9b4bf88e8e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:00.930118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bf5564-a57f-48fc-85fa-9b4bf88e8e5e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:00.933938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7ee286-1189-4165-9945-b9719252bfaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:00.934543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ee286-1189-4165-9945-b9719252bfaf service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:00.934832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ee286-1189-4165-9945-b9719252bfaf service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:00.935099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7ee286-1189-4165-9945-b9719252bfaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:00.945944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ee286-1189-4165-9945-b9719252bfaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:00.947404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7ee286-1189-4165-9945-b9719252bfaf service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:00.958891 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3109/6232] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:01.642926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:01.644942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:01.666788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb4033c-31d4-4775-a23d-e2881dcf0ab6 tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:01.676706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:01.680828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:01.681199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:01.681566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] PATH_INFO: `/v3/projects/5687c27533ef41f685b06e300f24c12c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:01.683368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5687c27533ef41f685b06e300f24c12c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:01.684995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:01.749349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5687c27533ef41f685b06e300f24c12c', 'request_id': 'req-224c8d34-6d03-442d-946e-cfc174659e8d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:01.764510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5687c27533ef41f685b06e300f24c12c', 'request_id': 'req-224c8d34-6d03-442d-946e-cfc174659e8d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:01.777264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5687c27533ef41f685b06e300f24c12c', 'request_id': 'req-224c8d34-6d03-442d-946e-cfc174659e8d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:01.793541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] The token cache is being invalidate because project 5687c27533ef41f685b06e300f24c12c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:01.793987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:01.794990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:01.805177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcf992-3fed-488e-b61a-905f5cfd9b93 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:01.805694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcf992-3fed-488e-b61a-905f5cfd9b93 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:01.806393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bcf992-3fed-488e-b61a-905f5cfd9b93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:01.810256 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3124/6233] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:01 2022] DELETE /identity/v3/projects/5687c27533ef41f685b06e300f24c12c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:01.831742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-47bcf992-3fed-488e-b61a-905f5cfd9b93 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:01.833272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-47bcf992-3fed-488e-b61a-905f5cfd9b93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:01.908293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:01.910157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:01.920410 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3110/6234] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:01.926727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d1803-868e-44d0-937a-078a23bab5e3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:01.927008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d1803-868e-44d0-937a-078a23bab5e3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:01.927284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d1803-868e-44d0-937a-078a23bab5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:01.981674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c04d1803-868e-44d0-937a-078a23bab5e3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:01.982910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c04d1803-868e-44d0-937a-078a23bab5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:02.008703 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3111/6235] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:02.015070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d1803-868e-44d0-937a-078a23bab5e3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:02.034410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04d1803-868e-44d0-937a-078a23bab5e3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.049430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f89ea-72f2-4806-9cac-7cc4c96e5e3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.049430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f89ea-72f2-4806-9cac-7cc4c96e5e3f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.049430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f89ea-72f2-4806-9cac-7cc4c96e5e3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.049430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2f89ea-72f2-4806-9cac-7cc4c96e5e3f admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.049764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f89ea-72f2-4806-9cac-7cc4c96e5e3f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:02.049764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f89ea-72f2-4806-9cac-7cc4c96e5e3f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.052883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2f89ea-72f2-4806-9cac-7cc4c96e5e3f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:02.073058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224c8d34-6d03-442d-946e-cfc174659e8d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.077867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ae38d5dc821452f98a6e1f8f899e980', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fba565653ae843e38f31a9b7ededfc9f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.079035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.079330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.079616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] PATH_INFO: `/v3/projects/996b83817f39454d8439f40eb23b0de9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.080796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Authorizing `identity:delete_project(project_id=996b83817f39454d8439f40eb23b0de9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.083354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:02.103534 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3112/6236] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:02.107935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f89ea-72f2-4806-9cac-7cc4c96e5e3f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:02.133001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2f89ea-72f2-4806-9cac-7cc4c96e5e3f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.157484 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:02.170678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996b83817f39454d8439f40eb23b0de9', 'request_id': 'req-610d78bc-123f-4484-96e7-0b1ba157265c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:02.193326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996b83817f39454d8439f40eb23b0de9', 'request_id': 'req-610d78bc-123f-4484-96e7-0b1ba157265c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:02.207689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996b83817f39454d8439f40eb23b0de9', 'request_id': 'req-610d78bc-123f-4484-96e7-0b1ba157265c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:02.241031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] The token cache is being invalidate because project 996b83817f39454d8439f40eb23b0de9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:02.241382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:02.245768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:02.255189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983e626-8917-4ffb-8686-74e58f5fa19b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.255554 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3125/6237] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:01 2022] DELETE /identity/v3/projects/996b83817f39454d8439f40eb23b0de9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:02.260023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e626-8917-4ffb-8686-74e58f5fa19b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.260023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e626-8917-4ffb-8686-74e58f5fa19b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.260023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983e626-8917-4ffb-8686-74e58f5fa19b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.260023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983e626-8917-4ffb-8686-74e58f5fa19b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.260023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983e626-8917-4ffb-8686-74e58f5fa19b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:02.284485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:02.286069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:02.335952 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3113/6238] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:02 2022] POST /identity/v3/projects => generated 385 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:02.336869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983e626-8917-4ffb-8686-74e58f5fa19b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:02.353348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b983e626-8917-4ffb-8686-74e58f5fa19b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:02.367024 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:02.440148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d78bc-123f-4484-96e7-0b1ba157265c tempest-RoutersAdminTest-893297742 tempest-RoutersAdminTest-893297742-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.449697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983e626-8917-4ffb-8686-74e58f5fa19b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.457432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7303d8-fb0a-481b-9d80-5706575e79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.458342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7303d8-fb0a-481b-9d80-5706575e79c0 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.458782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7303d8-fb0a-481b-9d80-5706575e79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.459215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7303d8-fb0a-481b-9d80-5706575e79c0 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.460083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7303d8-fb0a-481b-9d80-5706575e79c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.462313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7303d8-fb0a-481b-9d80-5706575e79c0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:02.498539 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3114/6239] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:02 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:02.502248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7303d8-fb0a-481b-9d80-5706575e79c0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:02.520405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7303d8-fb0a-481b-9d80-5706575e79c0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.527443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178b8b8-73d4-4bc2-99fb-c2e04bd0294a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.528438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b8b8-73d4-4bc2-99fb-c2e04bd0294a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.528798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b8b8-73d4-4bc2-99fb-c2e04bd0294a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.529878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2178b8b8-73d4-4bc2-99fb-c2e04bd0294a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.530611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178b8b8-73d4-4bc2-99fb-c2e04bd0294a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.532404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2178b8b8-73d4-4bc2-99fb-c2e04bd0294a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:02.533090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7feab7-5d04-4251-ab27-1adff28b6461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.534071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7feab7-5d04-4251-ab27-1adff28b6461 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.534551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7feab7-5d04-4251-ab27-1adff28b6461 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.534988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7feab7-5d04-4251-ab27-1adff28b6461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.537025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d7feab7-5d04-4251-ab27-1adff28b6461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:02.550059 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3115/6240] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:02.551437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178b8b8-73d4-4bc2-99fb-c2e04bd0294a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:02.564746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2178b8b8-73d4-4bc2-99fb-c2e04bd0294a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.570332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b893e-3963-4699-a855-a76b307407f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.571039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b893e-3963-4699-a855-a76b307407f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.571396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b893e-3963-4699-a855-a76b307407f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.571674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b893e-3963-4699-a855-a76b307407f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.572316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b893e-3963-4699-a855-a76b307407f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.573974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b893e-3963-4699-a855-a76b307407f0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:02.588328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3116/6241] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:02.592997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b893e-3963-4699-a855-a76b307407f0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:02.611323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b893e-3963-4699-a855-a76b307407f0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.623235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4d11-6dbd-4dce-83fc-85b248cb0812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.624186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4d11-6dbd-4dce-83fc-85b248cb0812 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.624592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4d11-6dbd-4dce-83fc-85b248cb0812 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.624973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ca4d11-6dbd-4dce-83fc-85b248cb0812 admin admin] PATH_INFO: `/v3/projects/4f051fe8e0634888bcb431d36b77d6ac/users/cd251402e1c043548036ba86537beea1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.632686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7feab7-5d04-4251-ab27-1adff28b6461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.634529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7feab7-5d04-4251-ab27-1adff28b6461 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:02.643692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4d11-6dbd-4dce-83fc-85b248cb0812 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f051fe8e0634888bcb431d36b77d6ac, user_id=cd251402e1c043548036ba86537beea1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.646647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ca4d11-6dbd-4dce-83fc-85b248cb0812 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:02.666867 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3126/6243] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:02.669549 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3117/6243] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:02 2022] PUT /identity/v3/projects/4f051fe8e0634888bcb431d36b77d6ac/users/cd251402e1c043548036ba86537beea1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:02.695174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c6fa4-4202-4fd7-8364-853364f7eea8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.695901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c6fa4-4202-4fd7-8364-853364f7eea8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.701010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300c6fa4-4202-4fd7-8364-853364f7eea8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.747919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-300c6fa4-4202-4fd7-8364-853364f7eea8 None None] MFA Rules not processed for user `cd251402e1c043548036ba86537beea1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:02.750101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-300c6fa4-4202-4fd7-8364-853364f7eea8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:02.764063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4d11-6dbd-4dce-83fc-85b248cb0812 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:02.766773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a9ca4d11-6dbd-4dce-83fc-85b248cb0812 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:02.799413 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:02.894505 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3127/6244] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:02.895907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c6fa4-4202-4fd7-8364-853364f7eea8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:02.896778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ca4d11-6dbd-4dce-83fc-85b248cb0812 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.910105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300c6fa4-4202-4fd7-8364-853364f7eea8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:02.913086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.913439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.913558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.913832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] PATH_INFO: `/v3/projects/ab8ce69237384ae39671609620447a36` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.916869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab8ce69237384ae39671609620447a36)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.920472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:02.934151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aebfbe-d346-4727-8b1b-f03a1b67c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:02.934712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aebfbe-d346-4727-8b1b-f03a1b67c065 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:02.936312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aebfbe-d346-4727-8b1b-f03a1b67c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:02.936607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aebfbe-d346-4727-8b1b-f03a1b67c065 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:02.937266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aebfbe-d346-4727-8b1b-f03a1b67c065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:02.943870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aebfbe-d346-4727-8b1b-f03a1b67c065 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.004371 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3128/6245] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:02 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:03.009884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aebfbe-d346-4727-8b1b-f03a1b67c065 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.018844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab8ce69237384ae39671609620447a36', 'request_id': 'req-02aec7d5-f44e-4ea0-830c-4876ac5d929e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.027269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab8ce69237384ae39671609620447a36', 'request_id': 'req-02aec7d5-f44e-4ea0-830c-4876ac5d929e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.029508 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:03.041931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab8ce69237384ae39671609620447a36', 'request_id': 'req-02aec7d5-f44e-4ea0-830c-4876ac5d929e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.064780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] The token cache is being invalidate because project ab8ce69237384ae39671609620447a36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:03.065488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.066350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.071052 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3118/6246] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:02 2022] DELETE /identity/v3/projects/ab8ce69237384ae39671609620447a36 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:03.075618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.077426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:03.114589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aebfbe-d346-4727-8b1b-f03a1b67c065 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.122770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531892e1-85f2-4472-8aff-8542f5d317ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.123802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531892e1-85f2-4472-8aff-8542f5d317ab admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.124761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531892e1-85f2-4472-8aff-8542f5d317ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.125460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531892e1-85f2-4472-8aff-8542f5d317ab admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.126879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531892e1-85f2-4472-8aff-8542f5d317ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:03.129547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531892e1-85f2-4472-8aff-8542f5d317ab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.162928 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3129/6247] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:03 2022] POST /identity/v3/users => generated 300 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:03.168052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531892e1-85f2-4472-8aff-8542f5d317ab admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.173033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-531892e1-85f2-4472-8aff-8542f5d317ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:03.190374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531892e1-85f2-4472-8aff-8542f5d317ab admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.196698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38d68f-64b8-4841-91b8-7e85be0e0e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.197700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38d68f-64b8-4841-91b8-7e85be0e0e0e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.198091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aec7d5-f44e-4ea0-830c-4876ac5d929e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.198338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38d68f-64b8-4841-91b8-7e85be0e0e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.198881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38d68f-64b8-4841-91b8-7e85be0e0e0e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.199852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38d68f-64b8-4841-91b8-7e85be0e0e0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:03.202765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38d68f-64b8-4841-91b8-7e85be0e0e0e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.209194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.210229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.211423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.211858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] PATH_INFO: `/v3/users/092f48b0b88c4de6bc9f3f09de4913bb` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.215092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=092f48b0b88c4de6bc9f3f09de4913bb)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:03.218032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.219537 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3130/6248] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:03.220514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38d68f-64b8-4841-91b8-7e85be0e0e0e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.240790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38d68f-64b8-4841-91b8-7e85be0e0e0e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.252855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda3709-ccc8-4d1c-8ba6-0df30f3ba2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.253738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda3709-ccc8-4d1c-8ba6-0df30f3ba2f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.254133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda3709-ccc8-4d1c-8ba6-0df30f3ba2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.254510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda3709-ccc8-4d1c-8ba6-0df30f3ba2f3 admin admin] PATH_INFO: `/v3/projects/3a84ff32b7464e0899ba93a668ccdf15/users/6f82069385ba44c48d70137a7d24880f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.277831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda3709-ccc8-4d1c-8ba6-0df30f3ba2f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a84ff32b7464e0899ba93a668ccdf15, user_id=6f82069385ba44c48d70137a7d24880f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:03.283339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda3709-ccc8-4d1c-8ba6-0df30f3ba2f3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.300683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '092f48b0b88c4de6bc9f3f09de4913bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.306321 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3131/6249] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:03 2022] PUT /identity/v3/projects/3a84ff32b7464e0899ba93a668ccdf15/users/6f82069385ba44c48d70137a7d24880f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:03.312213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda3709-ccc8-4d1c-8ba6-0df30f3ba2f3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.332098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '092f48b0b88c4de6bc9f3f09de4913bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.334383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '092f48b0b88c4de6bc9f3f09de4913bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.350474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '092f48b0b88c4de6bc9f3f09de4913bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.367714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '092f48b0b88c4de6bc9f3f09de4913bb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:03.377797 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3119/6250] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:03 2022] DELETE /identity/v3/users/092f48b0b88c4de6bc9f3f09de4913bb => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:03.407136 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:03.423354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda3709-ccc8-4d1c-8ba6-0df30f3ba2f3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.528859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e391673b-f4c2-4cda-9478-4d821e3dafc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.529880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391673b-f4c2-4cda-9478-4d821e3dafc8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.531252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391673b-f4c2-4cda-9478-4d821e3dafc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.531610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e391673b-f4c2-4cda-9478-4d821e3dafc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.532265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391673b-f4c2-4cda-9478-4d821e3dafc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:03.534103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e391673b-f4c2-4cda-9478-4d821e3dafc8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.551754 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3132/6251] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:03 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:03.555439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.556951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:03.579673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7f1d6a-b8a0-453d-a165-c9aad24eba02 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.586485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6af96-7118-431a-9293-87f08b2dd686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.587499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6af96-7118-431a-9293-87f08b2dd686 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.587800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6af96-7118-431a-9293-87f08b2dd686 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.590009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6af96-7118-431a-9293-87f08b2dd686 admin admin] PATH_INFO: `/v3/projects/3a84ff32b7464e0899ba93a668ccdf15/users/6f82069385ba44c48d70137a7d24880f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.592480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6af96-7118-431a-9293-87f08b2dd686 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a84ff32b7464e0899ba93a668ccdf15, user_id=6f82069385ba44c48d70137a7d24880f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:03.595223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6af96-7118-431a-9293-87f08b2dd686 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.611351 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3120/6252] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:03 2022] PUT /identity/v3/projects/3a84ff32b7464e0899ba93a668ccdf15/users/6f82069385ba44c48d70137a7d24880f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:03.623789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64984b-f858-4fa5-ba6e-5f695fd56f56 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.624116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64984b-f858-4fa5-ba6e-5f695fd56f56 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.624510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e64984b-f858-4fa5-ba6e-5f695fd56f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.662468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1e64984b-f858-4fa5-ba6e-5f695fd56f56 None None] MFA Rules not processed for user `6f82069385ba44c48d70137a7d24880f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:03.664446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1e64984b-f858-4fa5-ba6e-5f695fd56f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:03.794083 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3133/6253] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:03.795436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6af96-7118-431a-9293-87f08b2dd686 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.811907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6af96-7118-431a-9293-87f08b2dd686 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.818020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4da69-89bf-418d-84fd-1474f0cc083e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.819133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4da69-89bf-418d-84fd-1474f0cc083e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.820331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4da69-89bf-418d-84fd-1474f0cc083e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.821526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b4da69-89bf-418d-84fd-1474f0cc083e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.822429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4da69-89bf-418d-84fd-1474f0cc083e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:03.823499 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-17b4da69-89bf-418d-84fd-1474f0cc083e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_service": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:21:03.823499 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:21:03.823499 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:21:03.824782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b4da69-89bf-418d-84fd-1474f0cc083e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.856430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64984b-f858-4fa5-ba6e-5f695fd56f56 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.863579 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3121/6254] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:03 2022] POST /identity/v3/services => generated 289 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:03.869136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e64984b-f858-4fa5-ba6e-5f695fd56f56 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.894668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.895797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.896331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.897004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.898304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:03.899840 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:21:03.899840 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:21:03.899840 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:21:03.901024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: On instance['enabled']: Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: On instance['enabled']: Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: 'False' Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise error Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['enabled']: Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application 'False' Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:03.917605 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 24 09:21:03.919733 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['enabled']: Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application 'False' Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:03.921138 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3134/6255] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:21:03 2022] POST /identity/v3/endpoints => generated 283 bytes in 64 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 24 09:21:03.925216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4da69-89bf-418d-84fd-1474f0cc083e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.940639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b4da69-89bf-418d-84fd-1474f0cc083e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.947609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.948425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.948726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:03.949455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:03.950265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:03.952137 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:21:03.952137 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:21:03.952137 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:21:03.953156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: On instance['enabled']: Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: On instance['enabled']: Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: 'True' Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise error Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application On instance['enabled']: Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application 'True' Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:03.962418 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 94, in post Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_create, endpoint) Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 24 09:21:03.963905 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application On instance['enabled']: Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application 'True' Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:03.965649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3122/6256] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:21:03 2022] POST /identity/v3/endpoints => generated 281 bytes in 39 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 24 09:21:03.970585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:03.986842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81eba6c-8174-4fbe-8768-4e2ca02c49ac tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:03.998403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0211aa-d8c6-4b89-a850-186b4abdd2b9 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:03.999477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0211aa-d8c6-4b89-a850-186b4abdd2b9 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:03.999788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0211aa-d8c6-4b89-a850-186b4abdd2b9 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.000115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0211aa-d8c6-4b89-a850-186b4abdd2b9 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.001215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0211aa-d8c6-4b89-a850-186b4abdd2b9 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.003184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0211aa-d8c6-4b89-a850-186b4abdd2b9 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.039659 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-bf0211aa-d8c6-4b89-a850-186b4abdd2b9 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-81216173. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:21:04.039659 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:21:04.039659 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:21:04.091689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.091792 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3135/6257] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:21:03 2022] POST /identity/v3/endpoints => generated 357 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:04.114251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77b6d52-c4b2-48f5-af26-746da520dfc1 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.135312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb22ae-7234-4799-8e88-129a95fa2733 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.136670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb22ae-7234-4799-8e88-129a95fa2733 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.136670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb22ae-7234-4799-8e88-129a95fa2733 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.136670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bb22ae-7234-4799-8e88-129a95fa2733 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/regions/tempest-region-81216173` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.137264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb22ae-7234-4799-8e88-129a95fa2733 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-81216173)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.138394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bb22ae-7234-4799-8e88-129a95fa2733 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.145699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0211aa-d8c6-4b89-a850-186b4abdd2b9 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.147030 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3123/6258] 10.222.0.25 () {58 vars in 1200 bytes} [Mon Oct 24 09:21:04 2022] GET /identity/v3/regions/tempest-region-81216173 => generated 176 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:04.166536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0211aa-d8c6-4b89-a850-186b4abdd2b9 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.175240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.175980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.176269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.176550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/endpoints/ef51d834f8944f24b94f2294af99e1f6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.186389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=ef51d834f8944f24b94f2294af99e1f6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.188673 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:21:04.188673 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:21:04.188673 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:21:04.189647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: On instance['enabled']: Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: 'False': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: On instance['enabled']: Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: 'False' Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise error Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'False' is not of type 'boolean' Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['enabled']: Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application 'False' Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:04.202802 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 24 09:21:04.204265 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 24 09:21:04.205822 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 24 09:21:04.205822 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'False' is not of type 'boolean' Oct 24 09:21:04.205822 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:04.205822 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:04.205822 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:04.205822 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:04.205822 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application On instance['enabled']: Oct 24 09:21:04.205822 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application 'False' Oct 24 09:21:04.205822 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:04.208940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb22ae-7234-4799-8e88-129a95fa2733 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.218923 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3136/6259] 10.222.0.25 () {60 vars in 1255 bytes} [Mon Oct 24 09:21:04 2022] PATCH /identity/v3/endpoints/ef51d834f8944f24b94f2294af99e1f6 => generated 283 bytes in 62 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 24 09:21:04.222049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bb22ae-7234-4799-8e88-129a95fa2733 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.230293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.230932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.231219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.231498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/endpoints/ef51d834f8944f24b94f2294af99e1f6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.232680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=ef51d834f8944f24b94f2294af99e1f6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.233841 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:21:04.233841 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:21:04.233841 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:21:04.234894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.247806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'ef51d834f8944f24b94f2294af99e1f6', 'request_id': 'req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.252701 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=4,keystone:DELETE=15,keystone:SELECT=81 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:04.269703 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3124/6260] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:04 2022] DELETE /identity/v3/endpoints/ef51d834f8944f24b94f2294af99e1f6 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:04.271256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.284047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bb9334-0c6b-49e5-a027-7a88bbeccade tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.300867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11579bcc-51f9-4348-98f6-a4b22f1a6ebe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.301165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11579bcc-51f9-4348-98f6-a4b22f1a6ebe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.301442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11579bcc-51f9-4348-98f6-a4b22f1a6ebe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.301727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11579bcc-51f9-4348-98f6-a4b22f1a6ebe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/regions/tempest-region-81216173` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.302373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11579bcc-51f9-4348-98f6-a4b22f1a6ebe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-81216173)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.303633 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-11579bcc-51f9-4348-98f6-a4b22f1a6ebe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:21:04.303633 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:21:04.303633 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:21:04.305006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11579bcc-51f9-4348-98f6-a4b22f1a6ebe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.310619 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:04.339758 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3137/6261] 10.222.0.25 () {58 vars in 1203 bytes} [Mon Oct 24 09:21:04 2022] DELETE /identity/v3/regions/tempest-region-81216173 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:04.344883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.359453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c66d2-f8ac-425d-bc97-aec2575fb5fe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.385587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d363a3-b6a8-4fe4-9343-9279245f4fff tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.386325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d363a3-b6a8-4fe4-9343-9279245f4fff tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.386700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d363a3-b6a8-4fe4-9343-9279245f4fff tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.387213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d363a3-b6a8-4fe4-9343-9279245f4fff tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.387895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d363a3-b6a8-4fe4-9343-9279245f4fff tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.389629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d363a3-b6a8-4fe4-9343-9279245f4fff tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.424890 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-89d363a3-b6a8-4fe4-9343-9279245f4fff tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1050235913. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:21:04.424890 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:21:04.424890 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:21:04.472847 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3125/6262] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:21:04 2022] POST /identity/v3/endpoints => generated 361 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:04.477441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11579bcc-51f9-4348-98f6-a4b22f1a6ebe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.491087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11579bcc-51f9-4348-98f6-a4b22f1a6ebe tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.510275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d126c-5923-47b9-8118-e99250f56329 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.510275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d126c-5923-47b9-8118-e99250f56329 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.510275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d126c-5923-47b9-8118-e99250f56329 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.510594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6d126c-5923-47b9-8118-e99250f56329 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/regions/tempest-region-1050235913` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.511312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d126c-5923-47b9-8118-e99250f56329 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1050235913)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.516029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6d126c-5923-47b9-8118-e99250f56329 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.518545 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3138/6263] 10.222.0.25 () {58 vars in 1206 bytes} [Mon Oct 24 09:21:04 2022] GET /identity/v3/regions/tempest-region-1050235913 => generated 180 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:04.523510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d363a3-b6a8-4fe4-9343-9279245f4fff tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.536070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d363a3-b6a8-4fe4-9343-9279245f4fff tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.541286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.541963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.542293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.542536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/endpoints/48f069bcb0ad440a9ca440eed8c965af` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.548701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=48f069bcb0ad440a9ca440eed8c965af)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.549914 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:21:04.549914 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:21:04.549914 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:21:04.550806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: On instance['enabled']: Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: 'True': keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: On instance['enabled']: Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: 'True' Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 71, in validate Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.validator.validate(*args, **kwargs) Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise error Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application jsonschema.exceptions.ValidationError: 'True' is not of type 'boolean' Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application On instance['enabled']: Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application 'True' Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:04.564852 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 105, in patch Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application validation.lazy_validate(schema.endpoint_update, endpoint) Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/__init__.py", line 30, in lazy_validate Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application schema_validator.validate(resource_to_validate) Oct 24 09:21:04.566390 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/validation/validators.py", line 89, in validate Oct 24 09:21:04.567428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.SchemaValidationError(detail=detail) Oct 24 09:21:04.567428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.SchemaValidationError: Invalid input for field 'enabled': 'True' is not of type 'boolean' Oct 24 09:21:04.567428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:04.567428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Failed validating 'type' in schema['properties']['enabled']: Oct 24 09:21:04.567428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application {'enum': [True, False, None], 'type': 'boolean'} Oct 24 09:21:04.567428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:04.567428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application On instance['enabled']: Oct 24 09:21:04.567428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application 'True' Oct 24 09:21:04.567428 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:04.570747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d126c-5923-47b9-8118-e99250f56329 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.576586 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3126/6264] 10.222.0.25 () {60 vars in 1255 bytes} [Mon Oct 24 09:21:04 2022] PATCH /identity/v3/endpoints/48f069bcb0ad440a9ca440eed8c965af => generated 281 bytes in 49 msecs (HTTP/1.1 400) 5 headers in 186 bytes (2 switches on core 0) Oct 24 09:21:04.582958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6d126c-5923-47b9-8118-e99250f56329 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.592710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.595536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.596251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.596532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/endpoints/48f069bcb0ad440a9ca440eed8c965af` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.597987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=48f069bcb0ad440a9ca440eed8c965af)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.599170 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_endpoint": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:21:04.599170 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:21:04.599170 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:21:04.600044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.614193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '48f069bcb0ad440a9ca440eed8c965af', 'request_id': 'req-8b01f477-46bc-4d91-baf2-4b0363708fcc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.632836 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3139/6265] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:21:04 2022] DELETE /identity/v3/endpoints/48f069bcb0ad440a9ca440eed8c965af => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:04.636977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.647308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf188725-e6d1-4ff7-b1bb-c6bcf7960b1e tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.677234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3242-7fda-449a-a491-83c3bf3ce936 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.678150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3242-7fda-449a-a491-83c3bf3ce936 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.678519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3242-7fda-449a-a491-83c3bf3ce936 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.678906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ba3242-7fda-449a-a491-83c3bf3ce936 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/regions/tempest-region-1050235913` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.679594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba3242-7fda-449a-a491-83c3bf3ce936 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1050235913)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.680705 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-63ba3242-7fda-449a-a491-83c3bf3ce936 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:21:04.680705 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:21:04.680705 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:21:04.682616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ba3242-7fda-449a-a491-83c3bf3ce936 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.696390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.698733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:04.715405 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3127/6266] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 09:21:04 2022] DELETE /identity/v3/regions/tempest-region-1050235913 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:04.720202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3242-7fda-449a-a491-83c3bf3ce936 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.746830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ba3242-7fda-449a-a491-83c3bf3ce936 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.752633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc1453-3e1b-44c1-8f62-b186190230f5 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f82069385ba44c48d70137a7d24880f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '3a84ff32b7464e0899ba93a668ccdf15', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.753857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc1453-3e1b-44c1-8f62-b186190230f5 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.754134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc1453-3e1b-44c1-8f62-b186190230f5 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.754411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fc1453-3e1b-44c1-8f62-b186190230f5 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] PATH_INFO: `/v3/services/1e29bcea4725407f9595dd4e36523359` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.754995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc1453-3e1b-44c1-8f62-b186190230f5 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorizing `identity:delete_service(service_id=1e29bcea4725407f9595dd4e36523359)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.757648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fc1453-3e1b-44c1-8f62-b186190230f5 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.812578 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3128/6267] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:04 2022] DELETE /identity/v3/services/1e29bcea4725407f9595dd4e36523359 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:04.813823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc1453-3e1b-44c1-8f62-b186190230f5 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.816538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82fc1453-3e1b-44c1-8f62-b186190230f5 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:04.825783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b01f477-46bc-4d91-baf2-4b0363708fcc tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.853136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.853844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.854128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.854406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] PATH_INFO: `/v3/users/7c696f48cda74b0289dd451598d3216d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.855587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c696f48cda74b0289dd451598d3216d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.857778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.858502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fc1453-3e1b-44c1-8f62-b186190230f5 tempest-EndpointsNegativeTestJSON-2147374789 tempest-EndpointsNegativeTestJSON-2147374789-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:04.865167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:04.865379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.865655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.865931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] PATH_INFO: `/v3/projects/026916db32034831bba78a7e7216f9c1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:04.867336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026916db32034831bba78a7e7216f9c1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:04.870282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:04.935187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c696f48cda74b0289dd451598d3216d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.941134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026916db32034831bba78a7e7216f9c1', 'request_id': 'req-1367f898-908a-47e2-923d-a7dc33864788'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.952316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026916db32034831bba78a7e7216f9c1', 'request_id': 'req-1367f898-908a-47e2-923d-a7dc33864788'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.953183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c696f48cda74b0289dd451598d3216d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.954470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c696f48cda74b0289dd451598d3216d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.966911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026916db32034831bba78a7e7216f9c1', 'request_id': 'req-1367f898-908a-47e2-923d-a7dc33864788'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.969125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c696f48cda74b0289dd451598d3216d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.978028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c696f48cda74b0289dd451598d3216d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.982950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] The token cache is being invalidate because project 026916db32034831bba78a7e7216f9c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:04.983250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.984029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1367f898-908a-47e2-923d-a7dc33864788 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:04.986029 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3140/6269] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:04 2022] DELETE /identity/v3/users/7c696f48cda74b0289dd451598d3216d => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:04.989336 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3129/6269] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:04 2022] DELETE /identity/v3/projects/026916db32034831bba78a7e7216f9c1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:04.990206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:04.991527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a935-e508-43d1-b2fe-31cadc1806f5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:04.991644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:04.991827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a935-e508-43d1-b2fe-31cadc1806f5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:04.992104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be2a935-e508-43d1-b2fe-31cadc1806f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.012779 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:05.018804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5be2a935-e508-43d1-b2fe-31cadc1806f5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:05.020101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5be2a935-e508-43d1-b2fe-31cadc1806f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:05.045690 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:05.088702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b5434-11a4-405b-b0db-3a8eb1a2d09f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.095250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.096879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.097481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.098533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] PATH_INFO: `/v3/users/cd251402e1c043548036ba86537beea1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.099967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd251402e1c043548036ba86537beea1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.103215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.111452 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3130/6270] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:05.112392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc167f-e75e-4f50-8086-9a64555f7bec None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.113092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc167f-e75e-4f50-8086-9a64555f7bec None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.113092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bc167f-e75e-4f50-8086-9a64555f7bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.144639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-70bc167f-e75e-4f50-8086-9a64555f7bec None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:05.146056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-70bc167f-e75e-4f50-8086-9a64555f7bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:05.157007 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3131/6271] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:05.158477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8907a2-c81b-42bb-82cc-13eb3a2c28de None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.158962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8907a2-c81b-42bb-82cc-13eb3a2c28de None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.159418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8907a2-c81b-42bb-82cc-13eb3a2c28de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.179303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd251402e1c043548036ba86537beea1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:05.188682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6d8907a2-c81b-42bb-82cc-13eb3a2c28de None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:05.190281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6d8907a2-c81b-42bb-82cc-13eb3a2c28de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:05.200020 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3132/6272] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:05.200870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8907a2-c81b-42bb-82cc-13eb3a2c28de None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:05.202161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6d8907a2-c81b-42bb-82cc-13eb3a2c28de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:05.210246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd251402e1c043548036ba86537beea1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:05.211304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd251402e1c043548036ba86537beea1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:05.222491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd251402e1c043548036ba86537beea1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:05.232677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd251402e1c043548036ba86537beea1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:05.241989 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3141/6273] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:04 2022] DELETE /identity/v3/users/cd251402e1c043548036ba86537beea1 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:05.242785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:05.244275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:05.307549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8907a2-c81b-42bb-82cc-13eb3a2c28de None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.334172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68257ab9-03a7-4585-9168-437275726f53 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.341927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7912dd3-91c6-41e3-b2b5-2ddfabaf581a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.342504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912dd3-91c6-41e3-b2b5-2ddfabaf581a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.342907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912dd3-91c6-41e3-b2b5-2ddfabaf581a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.343934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7912dd3-91c6-41e3-b2b5-2ddfabaf581a admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.344856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912dd3-91c6-41e3-b2b5-2ddfabaf581a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:05.345163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912dd3-91c6-41e3-b2b5-2ddfabaf581a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.347782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7912dd3-91c6-41e3-b2b5-2ddfabaf581a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.369172 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3142/6274] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:05.370052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaff214-6888-434d-a3a1-96b17c9b98d7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.370052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaff214-6888-434d-a3a1-96b17c9b98d7 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.370052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaff214-6888-434d-a3a1-96b17c9b98d7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.370052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaff214-6888-434d-a3a1-96b17c9b98d7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.370460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1027d-66dc-40f5-89ab-36a210bead54 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.370460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1027d-66dc-40f5-89ab-36a210bead54 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.370460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d1027d-66dc-40f5-89ab-36a210bead54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.376041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-baaff214-6888-434d-a3a1-96b17c9b98d7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:05.392056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaff214-6888-434d-a3a1-96b17c9b98d7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.393852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaff214-6888-434d-a3a1-96b17c9b98d7 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.399414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b2d1027d-66dc-40f5-89ab-36a210bead54 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:05.401226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2d1027d-66dc-40f5-89ab-36a210bead54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:05.406654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3133/6275] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:05.407342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaff214-6888-434d-a3a1-96b17c9b98d7 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:05.414400 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3143/6276] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:05.421711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaff214-6888-434d-a3a1-96b17c9b98d7 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.427152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1027d-66dc-40f5-89ab-36a210bead54 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:05.429788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2d1027d-66dc-40f5-89ab-36a210bead54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:05.440133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc815d38-ea4d-4ce9-adce-39f35034afe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.442278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc815d38-ea4d-4ce9-adce-39f35034afe8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.442687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc815d38-ea4d-4ce9-adce-39f35034afe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.443022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc815d38-ea4d-4ce9-adce-39f35034afe8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.444994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc815d38-ea4d-4ce9-adce-39f35034afe8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.448007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc815d38-ea4d-4ce9-adce-39f35034afe8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.455517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d1027d-66dc-40f5-89ab-36a210bead54 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.462926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057d808-89b4-40d2-a7ab-acb652996c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.463983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057d808-89b4-40d2-a7ab-acb652996c92 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.465344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057d808-89b4-40d2-a7ab-acb652996c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.466179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057d808-89b4-40d2-a7ab-acb652996c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.487314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057d808-89b4-40d2-a7ab-acb652996c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.490633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057d808-89b4-40d2-a7ab-acb652996c92 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.501463 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3134/6277] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:05 2022] POST /identity/v3/projects => generated 379 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:05.502786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc815d38-ea4d-4ce9-adce-39f35034afe8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:05.518877 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3144/6278] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:21:05.575193 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:05.614853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc815d38-ea4d-4ce9-adce-39f35034afe8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.623896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefcf68-3f03-4f6b-90e7-68a4a8761cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.624747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefcf68-3f03-4f6b-90e7-68a4a8761cdf admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.625264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefcf68-3f03-4f6b-90e7-68a4a8761cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.625939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefcf68-3f03-4f6b-90e7-68a4a8761cdf admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.627805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefcf68-3f03-4f6b-90e7-68a4a8761cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.630302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdefcf68-3f03-4f6b-90e7-68a4a8761cdf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.669359 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3135/6279] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:05 2022] POST /identity/v3/users => generated 290 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:05.674205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057d808-89b4-40d2-a7ab-acb652996c92 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:05.693083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057d808-89b4-40d2-a7ab-acb652996c92 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.700519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085ed87-8432-4199-8d8d-287cb1352f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.701264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ed87-8432-4199-8d8d-287cb1352f61 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.702012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ed87-8432-4199-8d8d-287cb1352f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.702161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6085ed87-8432-4199-8d8d-287cb1352f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.702971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085ed87-8432-4199-8d8d-287cb1352f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.707137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6085ed87-8432-4199-8d8d-287cb1352f61 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.715796 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:05.722626 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3145/6280] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:05.727853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefcf68-3f03-4f6b-90e7-68a4a8761cdf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:05.740297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085ed87-8432-4199-8d8d-287cb1352f61 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:05.747015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdefcf68-3f03-4f6b-90e7-68a4a8761cdf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.749940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6085ed87-8432-4199-8d8d-287cb1352f61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:05.787787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8a953-166d-48f4-9930-6e0ca0b93afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.792276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8a953-166d-48f4-9930-6e0ca0b93afe admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.793175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8a953-166d-48f4-9930-6e0ca0b93afe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.795451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff8a953-166d-48f4-9930-6e0ca0b93afe admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.795838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8a953-166d-48f4-9930-6e0ca0b93afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.798712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6085ed87-8432-4199-8d8d-287cb1352f61 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.800635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff8a953-166d-48f4-9930-6e0ca0b93afe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.808654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.810234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.813699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.814574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] PATH_INFO: `/v3/projects/43d8819784434244b443fd470cd92a99` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.816812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d8819784434244b443fd470cd92a99)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.819886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.836652 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3136/6281] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:05.838538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8a953-166d-48f4-9930-6e0ca0b93afe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:05.856481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff8a953-166d-48f4-9930-6e0ca0b93afe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:05.867181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d0c382-5c0c-48e6-b98c-e6047dd4cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:05.870346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c382-5c0c-48e6-b98c-e6047dd4cbf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.870862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c382-5c0c-48e6-b98c-e6047dd4cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.871326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d0c382-5c0c-48e6-b98c-e6047dd4cbf9 admin admin] PATH_INFO: `/v3/projects/cd6de491062548ee97f94993541e8518/users/28eae21e05cb42b28fae2f506c357943/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.899287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0c382-5c0c-48e6-b98c-e6047dd4cbf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6de491062548ee97f94993541e8518, user_id=28eae21e05cb42b28fae2f506c357943, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:05.902345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d0c382-5c0c-48e6-b98c-e6047dd4cbf9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:05.928041 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3137/6282] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:05 2022] PUT /identity/v3/projects/cd6de491062548ee97f94993541e8518/users/28eae21e05cb42b28fae2f506c357943/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:05.945487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a38f-8a31-4088-96b6-41b80fd7326d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:05.946096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a38f-8a31-4088-96b6-41b80fd7326d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:05.946096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a94a38f-8a31-4088-96b6-41b80fd7326d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:05.955623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d8819784434244b443fd470cd92a99', 'request_id': 'req-0dfcbfae-047b-467d-ae59-e00089086500'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:05.979331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1a94a38f-8a31-4088-96b6-41b80fd7326d None None] MFA Rules not processed for user `28eae21e05cb42b28fae2f506c357943`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:05.981191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a94a38f-8a31-4088-96b6-41b80fd7326d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.011301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d8819784434244b443fd470cd92a99', 'request_id': 'req-0dfcbfae-047b-467d-ae59-e00089086500'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.022677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d8819784434244b443fd470cd92a99', 'request_id': 'req-0dfcbfae-047b-467d-ae59-e00089086500'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.041938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] The token cache is being invalidate because project 43d8819784434244b443fd470cd92a99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:06.042237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.042924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.048244 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3146/6283] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:05 2022] DELETE /identity/v3/projects/43d8819784434244b443fd470cd92a99 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:06.049158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:06.050831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.093452 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3138/6284] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:05 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:06.093452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5c783-2599-4e30-8558-2e354639949b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.093452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5c783-2599-4e30-8558-2e354639949b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.093452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce5c783-2599-4e30-8558-2e354639949b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.120323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2ce5c783-2599-4e30-8558-2e354639949b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:06.122723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2ce5c783-2599-4e30-8558-2e354639949b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.149264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfcbfae-047b-467d-ae59-e00089086500 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:06.218052 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3139/6285] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:06.218736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5c783-2599-4e30-8558-2e354639949b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:06.249007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce5c783-2599-4e30-8558-2e354639949b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:06.255881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4deecb6-3a6f-43aa-acb8-20fc9fdf76ed tempest-DefaultDomainTestJSON-1221309966 tempest-DefaultDomainTestJSON-1221309966-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '28eae21e05cb42b28fae2f506c357943', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'cd6de491062548ee97f94993541e8518', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:06.257820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deecb6-3a6f-43aa-acb8-20fc9fdf76ed tempest-DefaultDomainTestJSON-1221309966 tempest-DefaultDomainTestJSON-1221309966-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.259135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deecb6-3a6f-43aa-acb8-20fc9fdf76ed tempest-DefaultDomainTestJSON-1221309966 tempest-DefaultDomainTestJSON-1221309966-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.259748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4deecb6-3a6f-43aa-acb8-20fc9fdf76ed tempest-DefaultDomainTestJSON-1221309966 tempest-DefaultDomainTestJSON-1221309966-project] PATH_INFO: `/v3/domains/default` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.261913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deecb6-3a6f-43aa-acb8-20fc9fdf76ed tempest-DefaultDomainTestJSON-1221309966 tempest-DefaultDomainTestJSON-1221309966-project] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:06.263620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4deecb6-3a6f-43aa-acb8-20fc9fdf76ed tempest-DefaultDomainTestJSON-1221309966 tempest-DefaultDomainTestJSON-1221309966-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:06.272054 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3140/6286] 10.222.0.25 () {58 vars in 1152 bytes} [Mon Oct 24 09:21:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:06.273516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049846-8c14-4e95-bf0e-fe0a61d31742 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.273804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049846-8c14-4e95-bf0e-fe0a61d31742 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.274082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96049846-8c14-4e95-bf0e-fe0a61d31742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.281388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:06.282373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.282373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.282583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] PATH_INFO: `/v3/projects/4f051fe8e0634888bcb431d36b77d6ac` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.291197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f051fe8e0634888bcb431d36b77d6ac)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:06.293236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:06.306710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-96049846-8c14-4e95-bf0e-fe0a61d31742 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:06.308845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-96049846-8c14-4e95-bf0e-fe0a61d31742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.322391 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3141/6287] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:06.323461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96049846-8c14-4e95-bf0e-fe0a61d31742 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:06.325938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-96049846-8c14-4e95-bf0e-fe0a61d31742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.344858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96049846-8c14-4e95-bf0e-fe0a61d31742 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:06.353592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:06.354339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.354745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.355107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] PATH_INFO: `/v3/users/28eae21e05cb42b28fae2f506c357943` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.356982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=28eae21e05cb42b28fae2f506c357943)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:06.359477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:06.361604 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:06.369345 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:06.389948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f051fe8e0634888bcb431d36b77d6ac', 'request_id': 'req-12051b6a-89d6-4266-b336-9bbb523d653f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.400250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f051fe8e0634888bcb431d36b77d6ac', 'request_id': 'req-12051b6a-89d6-4266-b336-9bbb523d653f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.408401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f051fe8e0634888bcb431d36b77d6ac', 'request_id': 'req-12051b6a-89d6-4266-b336-9bbb523d653f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.422511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] The token cache is being invalidate because project 4f051fe8e0634888bcb431d36b77d6ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:06.422811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.423547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.426494 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3147/6288] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:06 2022] DELETE /identity/v3/projects/4f051fe8e0634888bcb431d36b77d6ac => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:06.427319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:06.431055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.449025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28eae21e05cb42b28fae2f506c357943'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.467234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28eae21e05cb42b28fae2f506c357943'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.468663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28eae21e05cb42b28fae2f506c357943'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.480430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28eae21e05cb42b28fae2f506c357943'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.493254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28eae21e05cb42b28fae2f506c357943'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.509148 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3142/6289] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:06 2022] DELETE /identity/v3/users/28eae21e05cb42b28fae2f506c357943 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:06.516467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:06.519182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.544950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12051b6a-89d6-4266-b336-9bbb523d653f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:06.601604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f681bd-bf34-4724-98ba-049dbf7698ae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:06.608385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:06.609602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.610202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.610766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] PATH_INFO: `/v3/users/6f82069385ba44c48d70137a7d24880f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.611950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f82069385ba44c48d70137a7d24880f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:06.614408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:06.633917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1b7d27-c220-4d5d-82fc-331569c65918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:06.634841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b7d27-c220-4d5d-82fc-331569c65918 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.635517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b7d27-c220-4d5d-82fc-331569c65918 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.635816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1b7d27-c220-4d5d-82fc-331569c65918 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.636638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b7d27-c220-4d5d-82fc-331569c65918 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:06.637538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b7d27-c220-4d5d-82fc-331569c65918 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:06.639537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1b7d27-c220-4d5d-82fc-331569c65918 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:06.654828 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3148/6290] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:06.656675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a22620-9322-428d-b1d4-abceee20ddb1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.656996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a22620-9322-428d-b1d4-abceee20ddb1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.657343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a22620-9322-428d-b1d4-abceee20ddb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.679394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f7a22620-9322-428d-b1d4-abceee20ddb1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:06.680634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7a22620-9322-428d-b1d4-abceee20ddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.689841 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3149/6291] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:06.690654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a22620-9322-428d-b1d4-abceee20ddb1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:06.692285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7a22620-9322-428d-b1d4-abceee20ddb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.696790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f82069385ba44c48d70137a7d24880f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.705094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a22620-9322-428d-b1d4-abceee20ddb1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:06.711597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f56c2-d4ce-45b4-9ccc-089cff503343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:06.712220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f56c2-d4ce-45b4-9ccc-089cff503343 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.712504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f56c2-d4ce-45b4-9ccc-089cff503343 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.712784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381f56c2-d4ce-45b4-9ccc-089cff503343 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.713436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f56c2-d4ce-45b4-9ccc-089cff503343 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:06.715355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381f56c2-d4ce-45b4-9ccc-089cff503343 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:06.718467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f82069385ba44c48d70137a7d24880f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.720049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f82069385ba44c48d70137a7d24880f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.734342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f82069385ba44c48d70137a7d24880f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.746387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f82069385ba44c48d70137a7d24880f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:06.762728 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3150/6292] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:06 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:06.762728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f56c2-d4ce-45b4-9ccc-089cff503343 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:06.762728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-381f56c2-d4ce-45b4-9ccc-089cff503343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.769275 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3143/6293] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:06 2022] DELETE /identity/v3/users/6f82069385ba44c48d70137a7d24880f => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:06.773146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:06.779539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.791524 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:06.831351 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:06.871253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381f56c2-d4ce-45b4-9ccc-089cff503343 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:06.884380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0366151d-eab4-446b-b58e-e0fc288920ac admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:06.891459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b34b-72a6-4aa4-96d5-9a60b0bea50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:06.892305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b34b-72a6-4aa4-96d5-9a60b0bea50d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.892713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b34b-72a6-4aa4-96d5-9a60b0bea50d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.893042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a2b34b-72a6-4aa4-96d5-9a60b0bea50d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.894084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b34b-72a6-4aa4-96d5-9a60b0bea50d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:06.896528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a2b34b-72a6-4aa4-96d5-9a60b0bea50d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:06.930843 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3144/6294] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:06 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:06.936619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b34b-72a6-4aa4-96d5-9a60b0bea50d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:06.953614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a2b34b-72a6-4aa4-96d5-9a60b0bea50d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:06.962982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe5568-cb67-4e20-8e0f-f77ed533b7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:06.964482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe5568-cb67-4e20-8e0f-f77ed533b7c5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.964931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe5568-cb67-4e20-8e0f-f77ed533b7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.965079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccf5d-0cec-4f08-aa08-a1577eda597f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:06.965648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afe5568-cb67-4e20-8e0f-f77ed533b7c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.965750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccf5d-0cec-4f08-aa08-a1577eda597f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:06.965867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccf5d-0cec-4f08-aa08-a1577eda597f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:06.966280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ccf5d-0cec-4f08-aa08-a1577eda597f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:06.966650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe5568-cb67-4e20-8e0f-f77ed533b7c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:06.968190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c57ccf5d-0cec-4f08-aa08-a1577eda597f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:06.968768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afe5568-cb67-4e20-8e0f-f77ed533b7c5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:06.985585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ccf5d-0cec-4f08-aa08-a1577eda597f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:06.987348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ccf5d-0cec-4f08-aa08-a1577eda597f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:06.990886 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3145/6295] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:06.992703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe5568-cb67-4e20-8e0f-f77ed533b7c5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:07.002220 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3151/6296] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:07.007975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afe5568-cb67-4e20-8e0f-f77ed533b7c5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:07.013584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8664c6-f83d-4170-8d4a-4765809554a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:07.014421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8664c6-f83d-4170-8d4a-4765809554a8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:07.014904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8664c6-f83d-4170-8d4a-4765809554a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:07.015283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8664c6-f83d-4170-8d4a-4765809554a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:07.016092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8664c6-f83d-4170-8d4a-4765809554a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:07.017915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8664c6-f83d-4170-8d4a-4765809554a8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:07.033393 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3146/6297] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:07.035661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccf5d-0cec-4f08-aa08-a1577eda597f service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:07.056794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ccf5d-0cec-4f08-aa08-a1577eda597f service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:07.063959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d20c9-b30c-4e66-9254-5bf73373c093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:07.065436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d20c9-b30c-4e66-9254-5bf73373c093 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:07.066003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d20c9-b30c-4e66-9254-5bf73373c093 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:07.066531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657d20c9-b30c-4e66-9254-5bf73373c093 admin admin] PATH_INFO: `/v3/projects/0950fe2c8c6c48f3b920c3a7e2f5d31a/users/3a46fbe5ff7247cc9221553deca02d26/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:07.085191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d20c9-b30c-4e66-9254-5bf73373c093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0950fe2c8c6c48f3b920c3a7e2f5d31a, user_id=3a46fbe5ff7247cc9221553deca02d26, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:07.090895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657d20c9-b30c-4e66-9254-5bf73373c093 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:07.109865 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3152/6298] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:07 2022] PUT /identity/v3/projects/0950fe2c8c6c48f3b920c3a7e2f5d31a/users/3a46fbe5ff7247cc9221553deca02d26/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:07.119894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15c90d-1956-4f4a-9325-c35e5fd66aa2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:07.120230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15c90d-1956-4f4a-9325-c35e5fd66aa2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:07.120450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c15c90d-1956-4f4a-9325-c35e5fd66aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:07.179652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8c15c90d-1956-4f4a-9325-c35e5fd66aa2 None None] MFA Rules not processed for user `3a46fbe5ff7247cc9221553deca02d26`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:07.182225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c15c90d-1956-4f4a-9325-c35e5fd66aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:07.277772 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3147/6299] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:07 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:07.296849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d20c9-b30c-4e66-9254-5bf73373c093 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:07.388231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657d20c9-b30c-4e66-9254-5bf73373c093 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:07.392502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b763a-b2c5-4070-b331-7eb0fd737d9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:07.393266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b763a-b2c5-4070-b331-7eb0fd737d9e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:07.393669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b763a-b2c5-4070-b331-7eb0fd737d9e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:07.394552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857b763a-b2c5-4070-b331-7eb0fd737d9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:07.405048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b763a-b2c5-4070-b331-7eb0fd737d9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:07.406763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857b763a-b2c5-4070-b331-7eb0fd737d9e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:07.433079 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3153/6300] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:07 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:08.109073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15c90d-1956-4f4a-9325-c35e5fd66aa2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:08.110710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c15c90d-1956-4f4a-9325-c35e5fd66aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:08.214569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c15c90d-1956-4f4a-9325-c35e5fd66aa2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:08.220916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:08.222516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:08.222900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:08.223249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] PATH_INFO: `/v3/projects/3a84ff32b7464e0899ba93a668ccdf15` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:08.224687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a84ff32b7464e0899ba93a668ccdf15)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:08.226770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:08.229812 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:08.246763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b763a-b2c5-4070-b331-7eb0fd737d9e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:08.249553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-857b763a-b2c5-4070-b331-7eb0fd737d9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:08.294830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a84ff32b7464e0899ba93a668ccdf15', 'request_id': 'req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.303278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a84ff32b7464e0899ba93a668ccdf15', 'request_id': 'req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.316647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a84ff32b7464e0899ba93a668ccdf15', 'request_id': 'req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.339326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] The token cache is being invalidate because project 3a84ff32b7464e0899ba93a668ccdf15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:08.339326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.340315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857b763a-b2c5-4070-b331-7eb0fd737d9e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:08.341621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0e45150-04cc-44d7-acc7-da8bb17bdf8a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.351300 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3148/6301] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:08 2022] DELETE /identity/v3/projects/3a84ff32b7464e0899ba93a668ccdf15 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:08.353314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8b47d-2428-4cce-a368-819f6159f972 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:08.353735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8b47d-2428-4cce-a368-819f6159f972 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:08.354110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8b47d-2428-4cce-a368-819f6159f972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:08.410270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-63b8b47d-2428-4cce-a368-819f6159f972 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:08.411890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-63b8b47d-2428-4cce-a368-819f6159f972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:08.503469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:08.504301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:08.504591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:08.504883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] PATH_INFO: `/v3/projects/cd6de491062548ee97f94993541e8518` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:08.506371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6de491062548ee97f94993541e8518)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:08.512073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:08.543929 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:08.557644 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3149/6302] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:08.565191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004ec44-10b2-4d42-8206-dcd10102b474 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:08.565660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004ec44-10b2-4d42-8206-dcd10102b474 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:08.566628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004ec44-10b2-4d42-8206-dcd10102b474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:08.607743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5004ec44-10b2-4d42-8206-dcd10102b474 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:08.613071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5004ec44-10b2-4d42-8206-dcd10102b474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:08.613490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6de491062548ee97f94993541e8518', 'request_id': 'req-1997e1c6-c308-40f8-a3e3-a33465e3eec6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.630618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6de491062548ee97f94993541e8518', 'request_id': 'req-1997e1c6-c308-40f8-a3e3-a33465e3eec6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.645719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6de491062548ee97f94993541e8518', 'request_id': 'req-1997e1c6-c308-40f8-a3e3-a33465e3eec6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.678281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] The token cache is being invalidate because project cd6de491062548ee97f94993541e8518 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:08.680025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.683720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1997e1c6-c308-40f8-a3e3-a33465e3eec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:08.687959 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3154/6303] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:08 2022] DELETE /identity/v3/projects/cd6de491062548ee97f94993541e8518 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:08.698396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0da70-1ae9-478a-8db6-efff5bc4270c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:08.698791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0da70-1ae9-478a-8db6-efff5bc4270c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:08.699709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0da70-1ae9-478a-8db6-efff5bc4270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:08.743690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-30c0da70-1ae9-478a-8db6-efff5bc4270c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:08.748292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-30c0da70-1ae9-478a-8db6-efff5bc4270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:08.790342 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3150/6304] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:08.796075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004ec44-10b2-4d42-8206-dcd10102b474 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:08.813046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004ec44-10b2-4d42-8206-dcd10102b474 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:08.834136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c92049-3647-4444-9e04-91efe021b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:08.835480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c92049-3647-4444-9e04-91efe021b87f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:08.836386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c92049-3647-4444-9e04-91efe021b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:08.836679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c92049-3647-4444-9e04-91efe021b87f admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:08.837591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c92049-3647-4444-9e04-91efe021b87f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:08.837739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c92049-3647-4444-9e04-91efe021b87f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:08.839459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c92049-3647-4444-9e04-91efe021b87f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:08.856616 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3151/6305] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:08.857946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c92049-3647-4444-9e04-91efe021b87f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:08.868925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c92049-3647-4444-9e04-91efe021b87f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:08.874109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfa10f-dbca-49af-a74f-e172d773b113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:08.874873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa10f-dbca-49af-a74f-e172d773b113 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:08.875249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa10f-dbca-49af-a74f-e172d773b113 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:08.875630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adfa10f-dbca-49af-a74f-e172d773b113 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:08.876378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfa10f-dbca-49af-a74f-e172d773b113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:08.877960 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3155/6306] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:08.878697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adfa10f-dbca-49af-a74f-e172d773b113 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:08.887535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb76cfb-d20d-46eb-bb6c-76062663f262 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:08.888077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb76cfb-d20d-46eb-bb6c-76062663f262 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:08.889117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb76cfb-d20d-46eb-bb6c-76062663f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:08.908531 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:08.920579 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3152/6307] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:08 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:08.921802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfa10f-dbca-49af-a74f-e172d773b113 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:08.931137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6bb76cfb-d20d-46eb-bb6c-76062663f262 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:08.932581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6bb76cfb-d20d-46eb-bb6c-76062663f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:09.030658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adfa10f-dbca-49af-a74f-e172d773b113 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.042132 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3156/6308] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:09.044353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ac3cb-f0e3-44bf-a8d3-8a13ea91b3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.044827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ac3cb-f0e3-44bf-a8d3-8a13ea91b3af admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.045217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ac3cb-f0e3-44bf-a8d3-8a13ea91b3af admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.045761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132ac3cb-f0e3-44bf-a8d3-8a13ea91b3af admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.046407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ac3cb-f0e3-44bf-a8d3-8a13ea91b3af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.047735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb76cfb-d20d-46eb-bb6c-76062663f262 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.048622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132ac3cb-f0e3-44bf-a8d3-8a13ea91b3af admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.063114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb76cfb-d20d-46eb-bb6c-76062663f262 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.070509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1786163-1e2f-4574-b7bb-17f883c10419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.071142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786163-1e2f-4574-b7bb-17f883c10419 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.071422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786163-1e2f-4574-b7bb-17f883c10419 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.071700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1786163-1e2f-4574-b7bb-17f883c10419 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.072353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1786163-1e2f-4574-b7bb-17f883c10419 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:09.072845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1786163-1e2f-4574-b7bb-17f883c10419 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.074506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1786163-1e2f-4574-b7bb-17f883c10419 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.106158 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3157/6309] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:21:09.111672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1786163-1e2f-4574-b7bb-17f883c10419 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.123678 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3153/6310] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:08 2022] POST /identity/v3/users => generated 294 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:09.124928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ac3cb-f0e3-44bf-a8d3-8a13ea91b3af admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.132493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1786163-1e2f-4574-b7bb-17f883c10419 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.140415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68460f4-6c1b-4c23-9e29-938c8fe561a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.141557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68460f4-6c1b-4c23-9e29-938c8fe561a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.141998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68460f4-6c1b-4c23-9e29-938c8fe561a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.142468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68460f4-6c1b-4c23-9e29-938c8fe561a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.143396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68460f4-6c1b-4c23-9e29-938c8fe561a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.146220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68460f4-6c1b-4c23-9e29-938c8fe561a9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.151415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132ac3cb-f0e3-44bf-a8d3-8a13ea91b3af admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.164876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6e6e-0db2-4af8-85d8-d21a1ac420d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.165190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6e6e-0db2-4af8-85d8-d21a1ac420d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.165326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6e6e-0db2-4af8-85d8-d21a1ac420d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.165565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fe6e6e-0db2-4af8-85d8-d21a1ac420d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.168800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe6e6e-0db2-4af8-85d8-d21a1ac420d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.171776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fe6e6e-0db2-4af8-85d8-d21a1ac420d8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.184616 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3154/6311] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:09.188750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6e6e-0db2-4af8-85d8-d21a1ac420d8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.195923 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3158/6312] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:09 2022] POST /identity/v3/projects => generated 359 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:09.203450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68460f4-6c1b-4c23-9e29-938c8fe561a9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.206735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fe6e6e-0db2-4af8-85d8-d21a1ac420d8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.227557 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:09.306754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868535f-2f6d-4ec1-a1a3-fd71ac5b1706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.307376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868535f-2f6d-4ec1-a1a3-fd71ac5b1706 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.307658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868535f-2f6d-4ec1-a1a3-fd71ac5b1706 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.308303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3868535f-2f6d-4ec1-a1a3-fd71ac5b1706 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.308958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868535f-2f6d-4ec1-a1a3-fd71ac5b1706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.312345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3868535f-2f6d-4ec1-a1a3-fd71ac5b1706 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.339860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3155/6313] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:09.340073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68460f4-6c1b-4c23-9e29-938c8fe561a9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.341722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868535f-2f6d-4ec1-a1a3-fd71ac5b1706 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.353898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3868535f-2f6d-4ec1-a1a3-fd71ac5b1706 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.357984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f81606-59b0-41d5-a002-1de0b7688c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.358616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f81606-59b0-41d5-a002-1de0b7688c92 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.358917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f81606-59b0-41d5-a002-1de0b7688c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.359196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f81606-59b0-41d5-a002-1de0b7688c92 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.359740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c693b94-ead3-403d-b3c8-c16419780209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.359889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f81606-59b0-41d5-a002-1de0b7688c92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.360536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c693b94-ead3-403d-b3c8-c16419780209 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.360886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c693b94-ead3-403d-b3c8-c16419780209 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.361288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c693b94-ead3-403d-b3c8-c16419780209 admin admin] PATH_INFO: `/v3/projects/270e29c04e354a1387631d7a181170d4/users/e32fda1717854cd3be8ae11e6b6a4a42/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.362478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f81606-59b0-41d5-a002-1de0b7688c92 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.385023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c693b94-ead3-403d-b3c8-c16419780209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270e29c04e354a1387631d7a181170d4, user_id=e32fda1717854cd3be8ae11e6b6a4a42, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.394361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c693b94-ead3-403d-b3c8-c16419780209 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.401844 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3159/6314] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:09 2022] POST /identity/v3/users => generated 280 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:09.406046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f81606-59b0-41d5-a002-1de0b7688c92 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.413480 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3156/6315] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:09 2022] PUT /identity/v3/projects/270e29c04e354a1387631d7a181170d4/users/e32fda1717854cd3be8ae11e6b6a4a42/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:09.422169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f81606-59b0-41d5-a002-1de0b7688c92 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.426885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913cb8b-6c65-4a65-8f1c-13e9bf9a15c8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.427184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913cb8b-6c65-4a65-8f1c-13e9bf9a15c8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.427468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5913cb8b-6c65-4a65-8f1c-13e9bf9a15c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.465372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5913cb8b-6c65-4a65-8f1c-13e9bf9a15c8 None None] MFA Rules not processed for user `e32fda1717854cd3be8ae11e6b6a4a42`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:09.466508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5913cb8b-6c65-4a65-8f1c-13e9bf9a15c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:09.524158 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:09.582867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b3856-3aa0-4df1-ae13-1003d3a9152b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.583488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b3856-3aa0-4df1-ae13-1003d3a9152b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.583772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b3856-3aa0-4df1-ae13-1003d3a9152b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.584045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6b3856-3aa0-4df1-ae13-1003d3a9152b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.584699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b3856-3aa0-4df1-ae13-1003d3a9152b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.588372 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3157/6316] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:09 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:09.593687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913cb8b-6c65-4a65-8f1c-13e9bf9a15c8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.594985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6b3856-3aa0-4df1-ae13-1003d3a9152b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.611995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5913cb8b-6c65-4a65-8f1c-13e9bf9a15c8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.620745 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3160/6317] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:09.623834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f1ef-4163-47bc-bb8d-3562cfb86f35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.624361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b3856-3aa0-4df1-ae13-1003d3a9152b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.624902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f1ef-4163-47bc-bb8d-3562cfb86f35 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.625392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f1ef-4163-47bc-bb8d-3562cfb86f35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.625822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f7f1ef-4163-47bc-bb8d-3562cfb86f35 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.627550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f1ef-4163-47bc-bb8d-3562cfb86f35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.630535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f7f1ef-4163-47bc-bb8d-3562cfb86f35 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.644996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6b3856-3aa0-4df1-ae13-1003d3a9152b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.659699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62557e-6580-411d-9a32-8c0d455562a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.660325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62557e-6580-411d-9a32-8c0d455562a5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.660605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62557e-6580-411d-9a32-8c0d455562a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.660880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62557e-6580-411d-9a32-8c0d455562a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.661771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62557e-6580-411d-9a32-8c0d455562a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.666559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62557e-6580-411d-9a32-8c0d455562a5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.690472 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3161/6318] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:09.691919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62557e-6580-411d-9a32-8c0d455562a5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.692865 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3158/6319] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:09 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:09.698043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f1ef-4163-47bc-bb8d-3562cfb86f35 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.711399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62557e-6580-411d-9a32-8c0d455562a5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.814625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f7f1ef-4163-47bc-bb8d-3562cfb86f35 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.824115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43486-3079-41d5-b261-e2f80dd44f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.827281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43486-3079-41d5-b261-e2f80dd44f8a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.827554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43486-3079-41d5-b261-e2f80dd44f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.827836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d43486-3079-41d5-b261-e2f80dd44f8a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.828488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d43486-3079-41d5-b261-e2f80dd44f8a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.836445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d43486-3079-41d5-b261-e2f80dd44f8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.867499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c625cf5c-c4b7-4e3e-aa5c-a60f75a20500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:09.868464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625cf5c-c4b7-4e3e-aa5c-a60f75a20500 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.868905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625cf5c-c4b7-4e3e-aa5c-a60f75a20500 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.869363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c625cf5c-c4b7-4e3e-aa5c-a60f75a20500 admin admin] PATH_INFO: `/v3/projects/d7d74ea7258f4859ab06cce22cb3416f/users/c03580d3a0694f94b290e1a63571e165/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.891486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625cf5c-c4b7-4e3e-aa5c-a60f75a20500 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7d74ea7258f4859ab06cce22cb3416f, user_id=c03580d3a0694f94b290e1a63571e165, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:09.896253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c625cf5c-c4b7-4e3e-aa5c-a60f75a20500 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:09.899751 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3159/6320] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:09 2022] POST /identity/v3/users => generated 299 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:09.904223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43486-3079-41d5-b261-e2f80dd44f8a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:09.925264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d43486-3079-41d5-b261-e2f80dd44f8a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:09.925502 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3162/6321] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:09 2022] PUT /identity/v3/projects/d7d74ea7258f4859ab06cce22cb3416f/users/c03580d3a0694f94b290e1a63571e165/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:09.927035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf0d3-baee-4051-a047-b83c7c9dfba7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:09.929792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf0d3-baee-4051-a047-b83c7c9dfba7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:09.930754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65edf0d3-baee-4051-a047-b83c7c9dfba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:09.941971 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:09.976224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-65edf0d3-baee-4051-a047-b83c7c9dfba7 None None] MFA Rules not processed for user `c03580d3a0694f94b290e1a63571e165`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:09.977775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-65edf0d3-baee-4051-a047-b83c7c9dfba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:10.005126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a4d3f-6c04-4124-b944-64b622da880d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:10.005791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a4d3f-6c04-4124-b944-64b622da880d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.006401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a4d3f-6c04-4124-b944-64b622da880d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.006712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327a4d3f-6c04-4124-b944-64b622da880d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.008181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a4d3f-6c04-4124-b944-64b622da880d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:10.010500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327a4d3f-6c04-4124-b944-64b622da880d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:10.028610 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3160/6322] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:09 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:10.029739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a4d3f-6c04-4124-b944-64b622da880d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.044402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327a4d3f-6c04-4124-b944-64b622da880d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:10.072547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ebd38-0838-4b9e-bd84-fb0b7ca7a936 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:10.076240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ebd38-0838-4b9e-bd84-fb0b7ca7a936 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.078214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ebd38-0838-4b9e-bd84-fb0b7ca7a936 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.078496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ebd38-0838-4b9e-bd84-fb0b7ca7a936 admin admin] PATH_INFO: `/v3/projects/689cfd5dff8d45348a30aae61734c5fe/users/ea2b6bb189e54cbaa1515a939c08f0fb/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.135148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ebd38-0838-4b9e-bd84-fb0b7ca7a936 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689cfd5dff8d45348a30aae61734c5fe, user_id=ea2b6bb189e54cbaa1515a939c08f0fb, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:10.135919 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3163/6323] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:09 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:10.139125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43353-a461-42be-9b3a-86f7a15d7e34 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.139417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43353-a461-42be-9b3a-86f7a15d7e34 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.139686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf43353-a461-42be-9b3a-86f7a15d7e34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.143105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986ebd38-0838-4b9e-bd84-fb0b7ca7a936 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:10.177356 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3161/6324] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:10 2022] PUT /identity/v3/projects/689cfd5dff8d45348a30aae61734c5fe/users/ea2b6bb189e54cbaa1515a939c08f0fb/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:10.183333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ebd38-0838-4b9e-bd84-fb0b7ca7a936 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.201691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aaf43353-a461-42be-9b3a-86f7a15d7e34 None None] MFA Rules not processed for user `c03580d3a0694f94b290e1a63571e165`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:10.207672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aaf43353-a461-42be-9b3a-86f7a15d7e34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:10.220115 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3164/6325] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:10 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:21:10.228166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234b65d-fd72-4355-bdb6-e5eaf71386a5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.228451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234b65d-fd72-4355-bdb6-e5eaf71386a5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.228730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234b65d-fd72-4355-bdb6-e5eaf71386a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.232755 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:10.280794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c234b65d-fd72-4355-bdb6-e5eaf71386a5 None None] MFA Rules not processed for user `c03580d3a0694f94b290e1a63571e165`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:10.283392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c234b65d-fd72-4355-bdb6-e5eaf71386a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:10.291445 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3165/6326] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:10 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:21:10.295531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234b65d-fd72-4355-bdb6-e5eaf71386a5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.329249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ebd38-0838-4b9e-bd84-fb0b7ca7a936 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:10.336885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d768291-5c4f-43ce-b50a-869fd196a745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:10.338383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d768291-5c4f-43ce-b50a-869fd196a745 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.338723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d768291-5c4f-43ce-b50a-869fd196a745 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.339127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d768291-5c4f-43ce-b50a-869fd196a745 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.339969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d768291-5c4f-43ce-b50a-869fd196a745 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:10.341837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d768291-5c4f-43ce-b50a-869fd196a745 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:10.356539 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3162/6327] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:10 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:10.357580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d768291-5c4f-43ce-b50a-869fd196a745 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.359896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1d768291-5c4f-43ce-b50a-869fd196a745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:10.449575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c234b65d-fd72-4355-bdb6-e5eaf71386a5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:10.459746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31379789-732b-4f06-bc52-05e1b9e62f22 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c03580d3a0694f94b290e1a63571e165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7d74ea7258f4859ab06cce22cb3416f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:10.461530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d768291-5c4f-43ce-b50a-869fd196a745 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:10.462779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31379789-732b-4f06-bc52-05e1b9e62f22 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.463089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31379789-732b-4f06-bc52-05e1b9e62f22 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.463371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31379789-732b-4f06-bc52-05e1b9e62f22 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.466245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a153e-7914-4494-9641-892d51b91a36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:10.466853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a153e-7914-4494-9641-892d51b91a36 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.467137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a153e-7914-4494-9641-892d51b91a36 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.467415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9a153e-7914-4494-9641-892d51b91a36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.469234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5c9a153e-7914-4494-9641-892d51b91a36 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:10.482459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31379789-732b-4f06-bc52-05e1b9e62f22 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorizing `identity:check_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:10.484143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31379789-732b-4f06-bc52-05e1b9e62f22 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:10.485687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a153e-7914-4494-9641-892d51b91a36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:10.488523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9a153e-7914-4494-9641-892d51b91a36 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:10.498382 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3166/6328] 10.222.0.25 () {56 vars in 1264 bytes} [Mon Oct 24 09:21:10 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 358 bytes (0 switches on core 0) Oct 24 09:21:10.502731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31379789-732b-4f06-bc52-05e1b9e62f22 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.509000 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3163/6329] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:10.513815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a153e-7914-4494-9641-892d51b91a36 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.517520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31379789-732b-4f06-bc52-05e1b9e62f22 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:10.522632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642574bf-25e9-40fe-9ca6-f017be8834f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:10.523302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642574bf-25e9-40fe-9ca6-f017be8834f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.523585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642574bf-25e9-40fe-9ca6-f017be8834f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.523861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642574bf-25e9-40fe-9ca6-f017be8834f9 admin admin] PATH_INFO: `/v3/projects/689cfd5dff8d45348a30aae61734c5fe/users/ea2b6bb189e54cbaa1515a939c08f0fb/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.527239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642574bf-25e9-40fe-9ca6-f017be8834f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=689cfd5dff8d45348a30aae61734c5fe, user_id=ea2b6bb189e54cbaa1515a939c08f0fb, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:10.529959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642574bf-25e9-40fe-9ca6-f017be8834f9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:10.544161 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3167/6330] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:10 2022] PUT /identity/v3/projects/689cfd5dff8d45348a30aae61734c5fe/users/ea2b6bb189e54cbaa1515a939c08f0fb/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:10.555306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39dd4a-8865-4b4a-a333-06f96b853f33 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.555513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9a153e-7914-4494-9641-892d51b91a36 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:10.556030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39dd4a-8865-4b4a-a333-06f96b853f33 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.556271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf39dd4a-8865-4b4a-a333-06f96b853f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.632657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cf39dd4a-8865-4b4a-a333-06f96b853f33 None None] MFA Rules not processed for user `ea2b6bb189e54cbaa1515a939c08f0fb`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:10.634211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cf39dd4a-8865-4b4a-a333-06f96b853f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:10.673677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919bb7f-e81c-4dea-b2f7-c735e2073231 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c03580d3a0694f94b290e1a63571e165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7d74ea7258f4859ab06cce22cb3416f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:10.674323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919bb7f-e81c-4dea-b2f7-c735e2073231 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.674605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919bb7f-e81c-4dea-b2f7-c735e2073231 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.674863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6919bb7f-e81c-4dea-b2f7-c735e2073231 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.698755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919bb7f-e81c-4dea-b2f7-c735e2073231 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:10.702823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6919bb7f-e81c-4dea-b2f7-c735e2073231 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:10.710652 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:10.726747 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3164/6331] 10.222.0.25 () {56 vars in 1263 bytes} [Mon Oct 24 09:21:10 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:10.731206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919bb7f-e81c-4dea-b2f7-c735e2073231 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.740612 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3168/6332] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:10 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:10.743057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39dd4a-8865-4b4a-a333-06f96b853f33 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.750092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6919bb7f-e81c-4dea-b2f7-c735e2073231 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:10.762098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf39dd4a-8865-4b4a-a333-06f96b853f33 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:10.764302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd41d6-3261-4da2-bd74-356aafdc3818 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c03580d3a0694f94b290e1a63571e165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7d74ea7258f4859ab06cce22cb3416f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:10.764930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd41d6-3261-4da2-bd74-356aafdc3818 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.765213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd41d6-3261-4da2-bd74-356aafdc3818 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.765520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dd41d6-3261-4da2-bd74-356aafdc3818 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.784045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481bc5-ab75-4d0f-bde4-701cb52feb2f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:10.784276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd41d6-3261-4da2-bd74-356aafdc3818 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:10.784990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481bc5-ab75-4d0f-bde4-701cb52feb2f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:10.785282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481bc5-ab75-4d0f-bde4-701cb52feb2f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:10.785588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b481bc5-ab75-4d0f-bde4-701cb52feb2f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:10.786279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b481bc5-ab75-4d0f-bde4-701cb52feb2f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:10.786420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dd41d6-3261-4da2-bd74-356aafdc3818 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:10.790828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b481bc5-ab75-4d0f-bde4-701cb52feb2f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:10.861429 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3165/6333] 10.222.0.25 () {56 vars in 1266 bytes} [Mon Oct 24 09:21:10 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:10.865038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd41d6-3261-4da2-bd74-356aafdc3818 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.898020 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3169/6334] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:10 2022] POST /identity/v3/projects => generated 359 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:10.900253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481bc5-ab75-4d0f-bde4-701cb52feb2f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:10.910790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dd41d6-3261-4da2-bd74-356aafdc3818 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.029497 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:11.046814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b481bc5-ab75-4d0f-bde4-701cb52feb2f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.062103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223f322-00de-4008-8b2d-c42659f3216f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.063362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223f322-00de-4008-8b2d-c42659f3216f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.064056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223f322-00de-4008-8b2d-c42659f3216f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.064637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d223f322-00de-4008-8b2d-c42659f3216f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects/79618a5105924caf8701c2f9a469f825/tags/tempest-tag-577035581` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.070376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223f322-00de-4008-8b2d-c42659f3216f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:create_project_tag(project_id=79618a5105924caf8701c2f9a469f825, value=tempest-tag-577035581)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:11.076377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d223f322-00de-4008-8b2d-c42659f3216f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:11.119525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df3d807-11b8-488c-b9b8-a66fa760e886 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c03580d3a0694f94b290e1a63571e165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7d74ea7258f4859ab06cce22cb3416f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.122286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3d807-11b8-488c-b9b8-a66fa760e886 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] REQUEST_METHOD: `HEAD` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.122573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3d807-11b8-488c-b9b8-a66fa760e886 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.122858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df3d807-11b8-488c-b9b8-a66fa760e886 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.138382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5df3d807-11b8-488c-b9b8-a66fa760e886 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-5df3d807-11b8-488c-b9b8-a66fa760e886 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 283, in get Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:check_token') Oct 24 09:21:11.179909 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 24 09:21:11.181382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 24 09:21:11.182937 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:21:11.182937 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:21:11.182937 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 24 09:21:11.182937 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 24 09:21:11.182937 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 24 09:21:11.182937 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:11.190440 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3166/6335] 10.222.0.25 () {56 vars in 1264 bytes} [Mon Oct 24 09:21:10 2022] HEAD /identity/v3/auth/tokens => generated 0 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (0 switches on core 0) Oct 24 09:21:11.192077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789a086-d628-4295-af1e-06b154e8f4a2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.192372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789a086-d628-4295-af1e-06b154e8f4a2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.192680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5789a086-d628-4295-af1e-06b154e8f4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.238721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5789a086-d628-4295-af1e-06b154e8f4a2 None None] MFA Rules not processed for user `c03580d3a0694f94b290e1a63571e165`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:11.240136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5789a086-d628-4295-af1e-06b154e8f4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:11.247940 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3167/6336] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:11 2022] POST /identity/v3/auth/tokens => generated 345 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:21:11.249139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789a086-d628-4295-af1e-06b154e8f4a2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.266477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5789a086-d628-4295-af1e-06b154e8f4a2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.276689 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-d223f322-00de-4008-8b2d-c42659f3216f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-577035581. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:21:11.276689 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:21:11.276689 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:21:11.277656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b13b-32bc-459c-996b-16d65661d892 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c03580d3a0694f94b290e1a63571e165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7d74ea7258f4859ab06cce22cb3416f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.278482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b13b-32bc-459c-996b-16d65661d892 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.281472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b13b-32bc-459c-996b-16d65661d892 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.282260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7054b13b-32bc-459c-996b-16d65661d892 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.293486 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3170/6337] 10.222.0.25 () {60 vars in 1330 bytes} [Mon Oct 24 09:21:10 2022] PUT /identity/v3/projects/79618a5105924caf8701c2f9a469f825/tags/tempest-tag-577035581 => generated 0 bytes in 394 msecs (HTTP/1.1 201) 6 headers in 290 bytes (2 switches on core 0) Oct 24 09:21:11.294791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b13b-32bc-459c-996b-16d65661d892 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:11.296855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7054b13b-32bc-459c-996b-16d65661d892 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:11.302962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223f322-00de-4008-8b2d-c42659f3216f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.308948 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3168/6338] 10.222.0.25 () {56 vars in 1263 bytes} [Mon Oct 24 09:21:11 2022] GET /identity/v3/auth/tokens => generated 345 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 09:21:11.310138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b13b-32bc-459c-996b-16d65661d892 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.321873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d223f322-00de-4008-8b2d-c42659f3216f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.332398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7054b13b-32bc-459c-996b-16d65661d892 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.333475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7843b-b01a-453e-83d4-5bde7cbe53e5 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.338138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7843b-b01a-453e-83d4-5bde7cbe53e5 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.338944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7843b-b01a-453e-83d4-5bde7cbe53e5 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.340896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb7843b-b01a-453e-83d4-5bde7cbe53e5 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects/79618a5105924caf8701c2f9a469f825/tags/tempest-tag-577035581` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.345703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba6df1-64d3-49d2-89cc-b4fe603b5b62 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c03580d3a0694f94b290e1a63571e165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7d74ea7258f4859ab06cce22cb3416f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.347459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba6df1-64d3-49d2-89cc-b4fe603b5b62 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.348592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba6df1-64d3-49d2-89cc-b4fe603b5b62 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.350273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ba6df1-64d3-49d2-89cc-b4fe603b5b62 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.368392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba6df1-64d3-49d2-89cc-b4fe603b5b62 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorizing `identity:revoke_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:11.370133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ba6df1-64d3-49d2-89cc-b4fe603b5b62 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:11.374786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7843b-b01a-453e-83d4-5bde7cbe53e5 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=79618a5105924caf8701c2f9a469f825, value=tempest-tag-577035581)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:11.379451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb7843b-b01a-453e-83d4-5bde7cbe53e5 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:11.404036 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3171/6339] 10.222.0.25 () {58 vars in 1311 bytes} [Mon Oct 24 09:21:11 2022] GET /identity/v3/projects/79618a5105924caf8701c2f9a469f825/tags/tempest-tag-577035581 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:11.408760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7843b-b01a-453e-83d4-5bde7cbe53e5 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.412253 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3169/6340] 10.222.0.25 () {56 vars in 1266 bytes} [Mon Oct 24 09:21:11 2022] DELETE /identity/v3/auth/tokens => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:11.420633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba6df1-64d3-49d2-89cc-b4fe603b5b62 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.441999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ba6df1-64d3-49d2-89cc-b4fe603b5b62 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.444821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb7843b-b01a-453e-83d4-5bde7cbe53e5 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.458194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa25cd5-c518-45e4-b721-e9ffb6e4d06f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.458848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa25cd5-c518-45e4-b721-e9ffb6e4d06f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.458971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa25cd5-c518-45e4-b721-e9ffb6e4d06f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.459326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa25cd5-c518-45e4-b721-e9ffb6e4d06f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects/79618a5105924caf8701c2f9a469f825/tags` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.461170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa25cd5-c518-45e4-b721-e9ffb6e4d06f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:update_project_tags(project_id=79618a5105924caf8701c2f9a469f825)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:11.462788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d9691-f3d8-42c3-97e3-f7233f12aba4 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c03580d3a0694f94b290e1a63571e165', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd7d74ea7258f4859ab06cce22cb3416f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.463549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9691-f3d8-42c3-97e3-f7233f12aba4 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.464638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9691-f3d8-42c3-97e3-f7233f12aba4 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.465431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898d9691-f3d8-42c3-97e3-f7233f12aba4 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.466328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa25cd5-c518-45e4-b721-e9ffb6e4d06f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:11.470777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-898d9691-f3d8-42c3-97e3-f7233f12aba4 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-898d9691-f3d8-42c3-97e3-f7233f12aba4 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Failed to validate token: keystone.exception.TokenNotFound: Failed to validate token Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/auth.py", line 285, in get Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:validate_token') Oct 24 09:21:11.506429 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 422, in enforce_call Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application subj_token_target_data = cls._extract_subject_token_target_data() Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 261, in _extract_subject_token_target_data Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application token = PROVIDER_APIS.token_provider_api.validate_token( Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 146, in validate_token Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._is_valid_token(token, window_seconds=window_seconds) Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 199, in _is_valid_token Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self.check_revocation(token) Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 137, in check_revocation Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.check_revocation_v3(token) Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/token/provider.py", line 134, in check_revocation_v3 Oct 24 09:21:11.508202 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.revoke_api.check_token(token_values) Oct 24 09:21:11.509540 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:21:11.509540 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:21:11.509540 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/revoke/core.py", line 137, in check_token Oct 24 09:21:11.509540 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.TokenNotFound(_('Failed to validate token')) Oct 24 09:21:11.509540 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.TokenNotFound: Failed to validate token Oct 24 09:21:11.509540 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:21:11.511744 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3170/6341] 10.222.0.25 () {56 vars in 1263 bytes} [Mon Oct 24 09:21:11 2022] GET /identity/v3/auth/tokens => generated 80 bytes in 92 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 24 09:21:11.516753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d9691-f3d8-42c3-97e3-f7233f12aba4 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.594241 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3172/6342] 10.222.0.25 () {60 vars in 1265 bytes} [Mon Oct 24 09:21:11 2022] PUT /identity/v3/projects/79618a5105924caf8701c2f9a469f825/tags => generated 141 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:11.599090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa25cd5-c518-45e4-b721-e9ffb6e4d06f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.612101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa25cd5-c518-45e4-b721-e9ffb6e4d06f tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.623629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818aae3-d88e-4249-ab16-45f9d7f9b40d tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.624645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818aae3-d88e-4249-ab16-45f9d7f9b40d tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.624908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818aae3-d88e-4249-ab16-45f9d7f9b40d tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.625270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0818aae3-d88e-4249-ab16-45f9d7f9b40d tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects/79618a5105924caf8701c2f9a469f825/tags` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.644697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818aae3-d88e-4249-ab16-45f9d7f9b40d tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=79618a5105924caf8701c2f9a469f825)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:11.649202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0818aae3-d88e-4249-ab16-45f9d7f9b40d tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:11.668120 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3173/6343] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:21:11 2022] GET /identity/v3/projects/79618a5105924caf8701c2f9a469f825/tags => generated 141 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:11.670353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818aae3-d88e-4249-ab16-45f9d7f9b40d tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.695464 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:11.724655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0818aae3-d88e-4249-ab16-45f9d7f9b40d tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.730550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f4644-9249-4210-b6fb-f925e6e40ee4 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.731217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f4644-9249-4210-b6fb-f925e6e40ee4 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.731497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f4644-9249-4210-b6fb-f925e6e40ee4 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.731842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9f4644-9249-4210-b6fb-f925e6e40ee4 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects/79618a5105924caf8701c2f9a469f825/tags/tempest-tag-794466028` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.737047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898d9691-f3d8-42c3-97e3-f7233f12aba4 tempest-TokensV3Test-554025867 tempest-TokensV3Test-554025867-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.738168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f4644-9249-4210-b6fb-f925e6e40ee4 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:delete_project_tag(project_id=79618a5105924caf8701c2f9a469f825, value=tempest-tag-794466028)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:11.740346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9f4644-9249-4210-b6fb-f925e6e40ee4 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:11.758999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.759904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.760278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.760632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] PATH_INFO: `/v3/users/c03580d3a0694f94b290e1a63571e165` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.762609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c03580d3a0694f94b290e1a63571e165)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:11.767955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:11.878727 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-fd9f4644-9249-4210-b6fb-f925e6e40ee4 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-tag-794466028. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:21:11.878727 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:21:11.878727 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:21:11.880780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c03580d3a0694f94b290e1a63571e165'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:11.890791 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3174/6344] 10.222.0.25 () {58 vars in 1314 bytes} [Mon Oct 24 09:21:11 2022] DELETE /identity/v3/projects/79618a5105924caf8701c2f9a469f825/tags/tempest-tag-794466028 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:11.891929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f4644-9249-4210-b6fb-f925e6e40ee4 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.911858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c03580d3a0694f94b290e1a63571e165'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:11.913073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c03580d3a0694f94b290e1a63571e165'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:11.920139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9f4644-9249-4210-b6fb-f925e6e40ee4 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:11.930986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c03580d3a0694f94b290e1a63571e165'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:11.932832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:11.934332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.934857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.935641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects/79618a5105924caf8701c2f9a469f825/tags/tempest-tag-794466028` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.941859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0797b77f-0801-4a88-af54-b3e7affc472d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c03580d3a0694f94b290e1a63571e165'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:11.955720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:get_project_tag(project_id=79618a5105924caf8701c2f9a469f825, value=tempest-tag-794466028)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:11.957783 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3171/6345] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:11 2022] DELETE /identity/v3/users/c03580d3a0694f94b290e1a63571e165 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:11.959180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:11.965437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f91b9f-84b4-4aff-b4b7-c551e73bbd54 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:11.966061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f91b9f-84b4-4aff-b4b7-c551e73bbd54 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:11.966558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f91b9f-84b4-4aff-b4b7-c551e73bbd54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Could not find project tag: tempest-tag-794466028.: keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-794466028. Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 284, in get Oct 24 09:21:11.979689 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_project_tag(project_id, value) Oct 24 09:21:11.980756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:21:11.980756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:21:11.980756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 960, in get_project_tag Oct 24 09:21:11.980756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectTagNotFound(project_tag=tag_name) Oct 24 09:21:11.980756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectTagNotFound: Could not find project tag: tempest-tag-794466028. Oct 24 09:21:11.980756 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:21:11.980756 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3175/6346] 10.222.0.25 () {58 vars in 1311 bytes} [Mon Oct 24 09:21:11 2022] GET /identity/v3/projects/79618a5105924caf8701c2f9a469f825/tags/tempest-tag-794466028 => generated 106 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:21:11.984019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:11.992934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:12.008859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-46f91b9f-84b4-4aff-b4b7-c551e73bbd54 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:12.010295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46f91b9f-84b4-4aff-b4b7-c551e73bbd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:12.012942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee75a4b8-3c1f-4ffd-b869-de98a6f67e8e tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:12.016557 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:12.140972 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3172/6347] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:12.141764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55b45d-e7b7-4980-8505-8bdd1b1878c8 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:12.149780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55b45d-e7b7-4980-8505-8bdd1b1878c8 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:12.150402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55b45d-e7b7-4980-8505-8bdd1b1878c8 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:12.152096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be55b45d-e7b7-4980-8505-8bdd1b1878c8 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects/79618a5105924caf8701c2f9a469f825/tags` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:12.154131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55b45d-e7b7-4980-8505-8bdd1b1878c8 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:delete_project_tags(project_id=79618a5105924caf8701c2f9a469f825)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:12.161368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f91b9f-84b4-4aff-b4b7-c551e73bbd54 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:12.162648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be55b45d-e7b7-4980-8505-8bdd1b1878c8 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:12.166615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46f91b9f-84b4-4aff-b4b7-c551e73bbd54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:12.288426 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3176/6348] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:21:11 2022] DELETE /identity/v3/projects/79618a5105924caf8701c2f9a469f825/tags => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:12.289516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55b45d-e7b7-4980-8505-8bdd1b1878c8 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:12.295437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f91b9f-84b4-4aff-b4b7-c551e73bbd54 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:12.308019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be55b45d-e7b7-4980-8505-8bdd1b1878c8 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:12.313671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1043b-17d6-4b55-886d-e4e131fd13d1 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:12.314713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1043b-17d6-4b55-886d-e4e131fd13d1 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:12.315056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1043b-17d6-4b55-886d-e4e131fd13d1 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:12.315343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c1043b-17d6-4b55-886d-e4e131fd13d1 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects/79618a5105924caf8701c2f9a469f825/tags` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:12.315681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbcc49-7798-4d29-9a53-96f45f32b3c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:12.316559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbcc49-7798-4d29-9a53-96f45f32b3c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:12.317054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbcc49-7798-4d29-9a53-96f45f32b3c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:12.317579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbcc49-7798-4d29-9a53-96f45f32b3c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:12.330108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1043b-17d6-4b55-886d-e4e131fd13d1 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:list_project_tags(project_id=79618a5105924caf8701c2f9a469f825)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:12.335195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c1043b-17d6-4b55-886d-e4e131fd13d1 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:12.335401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbcc49-7798-4d29-9a53-96f45f32b3c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:12.336810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbcc49-7798-4d29-9a53-96f45f32b3c4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:12.355944 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3177/6349] 10.222.0.25 () {58 vars in 1245 bytes} [Mon Oct 24 09:21:12 2022] GET /identity/v3/projects/79618a5105924caf8701c2f9a469f825/tags => generated 66 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 176 bytes (1 switches on core 0) Oct 24 09:21:12.360590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1043b-17d6-4b55-886d-e4e131fd13d1 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:12.368412 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3173/6350] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:12.376354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c1043b-17d6-4b55-886d-e4e131fd13d1 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:12.388918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ea2b6bb189e54cbaa1515a939c08f0fb', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '689cfd5dff8d45348a30aae61734c5fe', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:12.390198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:12.390730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:12.391247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] PATH_INFO: `/v3/projects/79618a5105924caf8701c2f9a469f825` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:12.392636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorizing `identity:delete_project(project_id=79618a5105924caf8701c2f9a469f825)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:12.395260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:12.486651 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:12.501749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79618a5105924caf8701c2f9a469f825', 'request_id': 'req-bc2b9a22-06e2-4944-ac84-8735819b7036'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.514903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79618a5105924caf8701c2f9a469f825', 'request_id': 'req-bc2b9a22-06e2-4944-ac84-8735819b7036'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.528082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79618a5105924caf8701c2f9a469f825', 'request_id': 'req-bc2b9a22-06e2-4944-ac84-8735819b7036'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.551673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] The token cache is being invalidate because project 79618a5105924caf8701c2f9a469f825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:12.552020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.552810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bc2b9a22-06e2-4944-ac84-8735819b7036 tempest-IdentityV3ProjectTagsTest-174080839 tempest-IdentityV3ProjectTagsTest-174080839-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.563125 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3178/6351] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:12 2022] DELETE /identity/v3/projects/79618a5105924caf8701c2f9a469f825 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:12.563241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbcc49-7798-4d29-9a53-96f45f32b3c4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:12.563761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42cbcc49-7798-4d29-9a53-96f45f32b3c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:12.579061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbcc49-7798-4d29-9a53-96f45f32b3c4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:12.663445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:12.664558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:12.664847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:12.665125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] PATH_INFO: `/v3/users/e32fda1717854cd3be8ae11e6b6a4a42` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:12.666572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32fda1717854cd3be8ae11e6b6a4a42)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:12.668841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:12.731616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32fda1717854cd3be8ae11e6b6a4a42'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.737975 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:12.751050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32fda1717854cd3be8ae11e6b6a4a42'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.751920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32fda1717854cd3be8ae11e6b6a4a42'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.766303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32fda1717854cd3be8ae11e6b6a4a42'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.775192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32fda1717854cd3be8ae11e6b6a4a42'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:12.784519 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3174/6352] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:12 2022] DELETE /identity/v3/users/e32fda1717854cd3be8ae11e6b6a4a42 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:12.789099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626495f-b48a-45b8-82cd-63899554c9ba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:12.789429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626495f-b48a-45b8-82cd-63899554c9ba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:12.789706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3626495f-b48a-45b8-82cd-63899554c9ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:12.812565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3626495f-b48a-45b8-82cd-63899554c9ba None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:12.814159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3626495f-b48a-45b8-82cd-63899554c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:12.931748 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3179/6353] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:12.951951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:12.954481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:13.018139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626495f-b48a-45b8-82cd-63899554c9ba None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:13.019864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3626495f-b48a-45b8-82cd-63899554c9ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:13.045384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3626495f-b48a-45b8-82cd-63899554c9ba None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:13.057367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:13.057367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:13.057670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:13.061817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] PATH_INFO: `/v3/projects/d7d74ea7258f4859ab06cce22cb3416f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:13.062567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7d74ea7258f4859ab06cce22cb3416f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:13.067080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:13.129895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412ac088-d09a-4807-85d2-454718834e48 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:13.135226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f3dc74-d719-40af-9bae-443b50b94771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:13.136777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3dc74-d719-40af-9bae-443b50b94771 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:13.137023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3dc74-d719-40af-9bae-443b50b94771 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:13.137320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f3dc74-d719-40af-9bae-443b50b94771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:13.155127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3dc74-d719-40af-9bae-443b50b94771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:13.156617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f3dc74-d719-40af-9bae-443b50b94771 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:13.186124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3175/6354] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:13.243126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7d74ea7258f4859ab06cce22cb3416f', 'request_id': 'req-3811afc0-3738-49bb-a1eb-0548f1c7f789'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:13.260907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7d74ea7258f4859ab06cce22cb3416f', 'request_id': 'req-3811afc0-3738-49bb-a1eb-0548f1c7f789'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:13.286408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7d74ea7258f4859ab06cce22cb3416f', 'request_id': 'req-3811afc0-3738-49bb-a1eb-0548f1c7f789'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:13.317075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] The token cache is being invalidate because project d7d74ea7258f4859ab06cce22cb3416f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:13.317520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:13.318426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3811afc0-3738-49bb-a1eb-0548f1c7f789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:13.320192 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3180/6355] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:13 2022] DELETE /identity/v3/projects/d7d74ea7258f4859ab06cce22cb3416f => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:13.325482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e10ada-9712-4ac9-bc82-6169b2b56d57 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:13.325773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e10ada-9712-4ac9-bc82-6169b2b56d57 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:13.326241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e10ada-9712-4ac9-bc82-6169b2b56d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:13.366950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e2e10ada-9712-4ac9-bc82-6169b2b56d57 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:13.373325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e2e10ada-9712-4ac9-bc82-6169b2b56d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:13.543338 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3176/6356] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:13.551558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba628-b37c-490a-8d59-38919da9d643 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:13.552098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba628-b37c-490a-8d59-38919da9d643 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:13.552098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ba628-b37c-490a-8d59-38919da9d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:13.587399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d20ba628-b37c-490a-8d59-38919da9d643 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:13.589274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d20ba628-b37c-490a-8d59-38919da9d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:13.603135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e10ada-9712-4ac9-bc82-6169b2b56d57 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:13.603830 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3181/6357] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:13.613850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e10ada-9712-4ac9-bc82-6169b2b56d57 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:13.620960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b15e24-28cc-412b-914c-224832c71466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:13.621756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b15e24-28cc-412b-914c-224832c71466 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:13.622115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b15e24-28cc-412b-914c-224832c71466 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:13.622454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b15e24-28cc-412b-914c-224832c71466 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:13.623264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b15e24-28cc-412b-914c-224832c71466 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:13.623661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b15e24-28cc-412b-914c-224832c71466 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:13.626259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b15e24-28cc-412b-914c-224832c71466 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:13.646144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ba628-b37c-490a-8d59-38919da9d643 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:13.653865 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3177/6358] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:13.658651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ba628-b37c-490a-8d59-38919da9d643 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:13.666802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5bf03-540a-41bc-bcf4-c4ca3a0bcd8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:13.667749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5bf03-540a-41bc-bcf4-c4ca3a0bcd8c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:13.668314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5bf03-540a-41bc-bcf4-c4ca3a0bcd8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:13.668666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af5bf03-540a-41bc-bcf4-c4ca3a0bcd8c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:13.669712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5bf03-540a-41bc-bcf4-c4ca3a0bcd8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:13.672091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af5bf03-540a-41bc-bcf4-c4ca3a0bcd8c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:13.723184 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3182/6359] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:13 2022] POST /identity/v3/projects => generated 387 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:13.724619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b15e24-28cc-412b-914c-224832c71466 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:13.740911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b15e24-28cc-412b-914c-224832c71466 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:13.851589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5bf03-540a-41bc-bcf4-c4ca3a0bcd8c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:13.853825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9af5bf03-540a-41bc-bcf4-c4ca3a0bcd8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:13.889594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6bf59-137a-4924-a1b5-a20de695ffa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:13.890223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6bf59-137a-4924-a1b5-a20de695ffa5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:13.894750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6bf59-137a-4924-a1b5-a20de695ffa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:13.895033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb6bf59-137a-4924-a1b5-a20de695ffa5 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:13.895770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6bf59-137a-4924-a1b5-a20de695ffa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:13.902878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb6bf59-137a-4924-a1b5-a20de695ffa5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:13.928104 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:13.929264 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:13.962625 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3178/6360] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:13 2022] POST /identity/v3/users => generated 300 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:13.963686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6bf59-137a-4924-a1b5-a20de695ffa5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:13.980255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb6bf59-137a-4924-a1b5-a20de695ffa5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:13.989455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3f52e-5ce5-45b7-9530-85e140c9a46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:13.990085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3f52e-5ce5-45b7-9530-85e140c9a46c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:13.990373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3f52e-5ce5-45b7-9530-85e140c9a46c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:13.990646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3f52e-5ce5-45b7-9530-85e140c9a46c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:13.991331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3f52e-5ce5-45b7-9530-85e140c9a46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:13.994302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3f52e-5ce5-45b7-9530-85e140c9a46c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:14.015507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3179/6361] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:14.020937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3f52e-5ce5-45b7-9530-85e140c9a46c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:14.035472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3f52e-5ce5-45b7-9530-85e140c9a46c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:14.039250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af5bf03-540a-41bc-bcf4-c4ca3a0bcd8c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:14.042375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6de09b-cf86-4d67-a992-7753af3fe94c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:14.043055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6de09b-cf86-4d67-a992-7753af3fe94c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:14.043351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6de09b-cf86-4d67-a992-7753af3fe94c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:14.044237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6de09b-cf86-4d67-a992-7753af3fe94c admin admin] PATH_INFO: `/v3/projects/4905aaa2c2984e788695ca34667fe0ec/users/f86a3192fe414e32ba26a87088256a2f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:14.058676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:14.061488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:14.061488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:14.061488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] PATH_INFO: `/v3/projects/270e29c04e354a1387631d7a181170d4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:14.063416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6de09b-cf86-4d67-a992-7753af3fe94c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4905aaa2c2984e788695ca34667fe0ec, user_id=f86a3192fe414e32ba26a87088256a2f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:14.066954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6de09b-cf86-4d67-a992-7753af3fe94c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:14.068353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] RBAC: Authorizing `identity:delete_project(project_id=270e29c04e354a1387631d7a181170d4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:14.070872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:14.093791 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3180/6362] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:14 2022] PUT /identity/v3/projects/4905aaa2c2984e788695ca34667fe0ec/users/f86a3192fe414e32ba26a87088256a2f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:14.095346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6de09b-cf86-4d67-a992-7753af3fe94c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:14.169606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270e29c04e354a1387631d7a181170d4', 'request_id': 'req-69b45c99-0439-4612-b449-f7d8c99b543b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.181990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270e29c04e354a1387631d7a181170d4', 'request_id': 'req-69b45c99-0439-4612-b449-f7d8c99b543b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.195565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270e29c04e354a1387631d7a181170d4', 'request_id': 'req-69b45c99-0439-4612-b449-f7d8c99b543b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.210763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] The token cache is being invalidate because project 270e29c04e354a1387631d7a181170d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:14.212134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.213622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.219318 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3183/6363] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:13 2022] DELETE /identity/v3/projects/270e29c04e354a1387631d7a181170d4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:14.220241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:14.224924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:14.236731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6de09b-cf86-4d67-a992-7753af3fe94c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:14.326897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b45c99-0439-4612-b449-f7d8c99b543b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:14.332065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:14.332757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:14.333167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:14.333496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] PATH_INFO: `/v3/users/ea2b6bb189e54cbaa1515a939c08f0fb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:14.335231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2b6bb189e54cbaa1515a939c08f0fb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:14.337174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:14.341060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47906f-7986-44c5-b4b3-f2505a28bc31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:14.341820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47906f-7986-44c5-b4b3-f2505a28bc31 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:14.342258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47906f-7986-44c5-b4b3-f2505a28bc31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:14.342657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa47906f-7986-44c5-b4b3-f2505a28bc31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:14.343410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47906f-7986-44c5-b4b3-f2505a28bc31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:14.345109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa47906f-7986-44c5-b4b3-f2505a28bc31 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:14.357285 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3181/6364] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:14 2022] GET /identity/v3/roles => generated 1420 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:14.360990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47906f-7986-44c5-b4b3-f2505a28bc31 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:14.363176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa47906f-7986-44c5-b4b3-f2505a28bc31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:14.378805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa47906f-7986-44c5-b4b3-f2505a28bc31 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:14.385728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f9fcc-7fa2-46c0-801c-7166fc35c03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:14.386689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f9fcc-7fa2-46c0-801c-7166fc35c03d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:14.387585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f9fcc-7fa2-46c0-801c-7166fc35c03d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:14.387964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f9fcc-7fa2-46c0-801c-7166fc35c03d admin admin] PATH_INFO: `/v3/projects/4905aaa2c2984e788695ca34667fe0ec/users/f86a3192fe414e32ba26a87088256a2f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:14.391001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f9fcc-7fa2-46c0-801c-7166fc35c03d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4905aaa2c2984e788695ca34667fe0ec, user_id=f86a3192fe414e32ba26a87088256a2f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:14.394215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f9fcc-7fa2-46c0-801c-7166fc35c03d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:14.398783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2b6bb189e54cbaa1515a939c08f0fb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.417372 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3182/6365] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:14 2022] PUT /identity/v3/projects/4905aaa2c2984e788695ca34667fe0ec/users/f86a3192fe414e32ba26a87088256a2f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:14.417740 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:14.421316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89646c00-d4a5-4425-b8c9-0ff7bb1eb5a3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:14.421598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89646c00-d4a5-4425-b8c9-0ff7bb1eb5a3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:14.422464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89646c00-d4a5-4425-b8c9-0ff7bb1eb5a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:14.427215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2b6bb189e54cbaa1515a939c08f0fb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.429150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2b6bb189e54cbaa1515a939c08f0fb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.442138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2b6bb189e54cbaa1515a939c08f0fb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.455593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2b6bb189e54cbaa1515a939c08f0fb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:14.466375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-89646c00-d4a5-4425-b8c9-0ff7bb1eb5a3 None None] MFA Rules not processed for user `f86a3192fe414e32ba26a87088256a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:14.466790 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3184/6366] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:14 2022] DELETE /identity/v3/users/ea2b6bb189e54cbaa1515a939c08f0fb => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:14.467658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-89646c00-d4a5-4425-b8c9-0ff7bb1eb5a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:14.523993 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:14.582026 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3183/6367] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:14 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:14.586294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:14.588684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:14.707628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af77edd2-c2bd-4267-8358-57bae502f149 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:14.713420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab61f88-6431-4fb6-9163-f50b5d493cbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:14.714144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab61f88-6431-4fb6-9163-f50b5d493cbe admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:14.714436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab61f88-6431-4fb6-9163-f50b5d493cbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:14.714714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab61f88-6431-4fb6-9163-f50b5d493cbe admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:14.715731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab61f88-6431-4fb6-9163-f50b5d493cbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:14.718989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab61f88-6431-4fb6-9163-f50b5d493cbe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:14.780861 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3185/6368] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:14 2022] POST /identity/v3/projects => generated 385 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:14.784864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89646c00-d4a5-4425-b8c9-0ff7bb1eb5a3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:14.819099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89646c00-d4a5-4425-b8c9-0ff7bb1eb5a3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:14.957059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c2c6-143d-4a2b-81ea-d7806943df36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:14.957606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c2c6-143d-4a2b-81ea-d7806943df36 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:14.957830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c2c6-143d-4a2b-81ea-d7806943df36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:14.958108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986c2c6-143d-4a2b-81ea-d7806943df36 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:14.958750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c2c6-143d-4a2b-81ea-d7806943df36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:14.964198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986c2c6-143d-4a2b-81ea-d7806943df36 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.030914 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3184/6369] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:14 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:15.034642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab61f88-6431-4fb6-9163-f50b5d493cbe admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.051786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab61f88-6431-4fb6-9163-f50b5d493cbe admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.071615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47c007-247a-4074-ad46-011b3285637e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.072781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47c007-247a-4074-ad46-011b3285637e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.073222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47c007-247a-4074-ad46-011b3285637e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.073678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47c007-247a-4074-ad46-011b3285637e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.074333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47c007-247a-4074-ad46-011b3285637e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.075963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d47c007-247a-4074-ad46-011b3285637e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.087872 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3186/6370] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:15.092097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c2c6-143d-4a2b-81ea-d7806943df36 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.106216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47c007-247a-4074-ad46-011b3285637e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.109379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2d47c007-247a-4074-ad46-011b3285637e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:15.113632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986c2c6-143d-4a2b-81ea-d7806943df36 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.126263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66850f1a-bf4d-42b2-8182-6e3248730946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.128040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66850f1a-bf4d-42b2-8182-6e3248730946 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.128486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66850f1a-bf4d-42b2-8182-6e3248730946 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.128921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66850f1a-bf4d-42b2-8182-6e3248730946 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.130023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66850f1a-bf4d-42b2-8182-6e3248730946 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.132330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66850f1a-bf4d-42b2-8182-6e3248730946 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.133133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d47c007-247a-4074-ad46-011b3285637e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.142254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.143055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.143445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.143813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] PATH_INFO: `/v3/projects/689cfd5dff8d45348a30aae61734c5fe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.145470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] RBAC: Authorizing `identity:delete_project(project_id=689cfd5dff8d45348a30aae61734c5fe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.148355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.152421 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3185/6371] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:15.156723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66850f1a-bf4d-42b2-8182-6e3248730946 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.168020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66850f1a-bf4d-42b2-8182-6e3248730946 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.173727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423e6b-21b5-4c5c-8269-f0e2bab276c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.174611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423e6b-21b5-4c5c-8269-f0e2bab276c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.175169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423e6b-21b5-4c5c-8269-f0e2bab276c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.175598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423e6b-21b5-4c5c-8269-f0e2bab276c6 admin admin] PATH_INFO: `/v3/projects/accebba556f741fdbdd172738f48496b/users/7465da729de645e59878e0dc2b1d5a62/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.195867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423e6b-21b5-4c5c-8269-f0e2bab276c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=accebba556f741fdbdd172738f48496b, user_id=7465da729de645e59878e0dc2b1d5a62, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.199298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423e6b-21b5-4c5c-8269-f0e2bab276c6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.220929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '689cfd5dff8d45348a30aae61734c5fe', 'request_id': 'req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:15.231180 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3186/6372] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:15 2022] PUT /identity/v3/projects/accebba556f741fdbdd172738f48496b/users/7465da729de645e59878e0dc2b1d5a62/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:15.233813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ca30e-dc20-4f84-a576-94f10d30c42a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.234398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ca30e-dc20-4f84-a576-94f10d30c42a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.234861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7ca30e-dc20-4f84-a576-94f10d30c42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.243552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '689cfd5dff8d45348a30aae61734c5fe', 'request_id': 'req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:15.258551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '689cfd5dff8d45348a30aae61734c5fe', 'request_id': 'req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:15.270422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2f7ca30e-dc20-4f84-a576-94f10d30c42a None None] MFA Rules not processed for user `7465da729de645e59878e0dc2b1d5a62`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:15.272953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f7ca30e-dc20-4f84-a576-94f10d30c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:15.278910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] The token cache is being invalidate because project 689cfd5dff8d45348a30aae61734c5fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:15.279491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:15.280521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a7c680d-7e32-4909-a5e5-e47bf8f6e532 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:15.284410 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3187/6373] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:15 2022] DELETE /identity/v3/projects/689cfd5dff8d45348a30aae61734c5fe => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:15.292148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050404d-6e13-40d2-a0c7-f136db464a87 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.292536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050404d-6e13-40d2-a0c7-f136db464a87 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.293006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d050404d-6e13-40d2-a0c7-f136db464a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.328853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d050404d-6e13-40d2-a0c7-f136db464a87 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:15.331465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d050404d-6e13-40d2-a0c7-f136db464a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:15.369125 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3187/6374] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:15.382691 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:15.393140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ca30e-dc20-4f84-a576-94f10d30c42a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.394928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2f7ca30e-dc20-4f84-a576-94f10d30c42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:15.414961 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:15.431213 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3188/6375] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:15.442763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d6e2-23bd-4486-a203-294e6cf22cd6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.444299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d6e2-23bd-4486-a203-294e6cf22cd6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.444299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83d6e2-23bd-4486-a203-294e6cf22cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.472755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fd83d6e2-23bd-4486-a203-294e6cf22cd6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:15.474208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fd83d6e2-23bd-4486-a203-294e6cf22cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:15.496416 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3189/6376] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:15.502066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d6e2-23bd-4486-a203-294e6cf22cd6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.513155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7ca30e-dc20-4f84-a576-94f10d30c42a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.519578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83d6e2-23bd-4486-a203-294e6cf22cd6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.523898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84facf61-541d-47f2-8c0b-ad617cebc05d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.527669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84facf61-541d-47f2-8c0b-ad617cebc05d service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.528140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84facf61-541d-47f2-8c0b-ad617cebc05d service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.528523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84facf61-541d-47f2-8c0b-ad617cebc05d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.531092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771403ee-a8e1-4f09-b0b3-eb1e99c1a8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.532255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771403ee-a8e1-4f09-b0b3-eb1e99c1a8d6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.532715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771403ee-a8e1-4f09-b0b3-eb1e99c1a8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.533171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771403ee-a8e1-4f09-b0b3-eb1e99c1a8d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.533370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-84facf61-541d-47f2-8c0b-ad617cebc05d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:15.534533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771403ee-a8e1-4f09-b0b3-eb1e99c1a8d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:15.535194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771403ee-a8e1-4f09-b0b3-eb1e99c1a8d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.539053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771403ee-a8e1-4f09-b0b3-eb1e99c1a8d6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.564575 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3190/6377] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:15.566523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771403ee-a8e1-4f09-b0b3-eb1e99c1a8d6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.579321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771403ee-a8e1-4f09-b0b3-eb1e99c1a8d6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.586191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117798a-0a1c-4b42-b237-1eda0c10dfe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.587169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117798a-0a1c-4b42-b237-1eda0c10dfe0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.588047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117798a-0a1c-4b42-b237-1eda0c10dfe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.588513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117798a-0a1c-4b42-b237-1eda0c10dfe0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.589614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117798a-0a1c-4b42-b237-1eda0c10dfe0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.591757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7117798a-0a1c-4b42-b237-1eda0c10dfe0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.643947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3191/6378] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:15 2022] POST /identity/v3/projects => generated 393 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:15.645499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117798a-0a1c-4b42-b237-1eda0c10dfe0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.699869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84facf61-541d-47f2-8c0b-ad617cebc05d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.701383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84facf61-541d-47f2-8c0b-ad617cebc05d service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.724587 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3188/6379] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:15.761187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117798a-0a1c-4b42-b237-1eda0c10dfe0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.775397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59e421-6ebf-4add-ad21-55ac6fcea07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.776086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59e421-6ebf-4add-ad21-55ac6fcea07f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.776371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59e421-6ebf-4add-ad21-55ac6fcea07f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.776696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe59e421-6ebf-4add-ad21-55ac6fcea07f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.777397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59e421-6ebf-4add-ad21-55ac6fcea07f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.779908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe59e421-6ebf-4add-ad21-55ac6fcea07f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.842378 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3192/6380] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:15 2022] POST /identity/v3/users => generated 303 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:15.844042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84facf61-541d-47f2-8c0b-ad617cebc05d service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.847494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59e421-6ebf-4add-ad21-55ac6fcea07f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.851076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fe59e421-6ebf-4add-ad21-55ac6fcea07f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:15.867177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84facf61-541d-47f2-8c0b-ad617cebc05d service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.887968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3401872-500e-40dd-88db-458f6d226e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.888808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3401872-500e-40dd-88db-458f6d226e14 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.888808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3401872-500e-40dd-88db-458f6d226e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.889077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3401872-500e-40dd-88db-458f6d226e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.889730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3401872-500e-40dd-88db-458f6d226e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.891734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3401872-500e-40dd-88db-458f6d226e14 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.917376 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3189/6381] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:15.918396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3401872-500e-40dd-88db-458f6d226e14 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:15.934314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3401872-500e-40dd-88db-458f6d226e14 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:15.939640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1c7f9-8355-4bc3-abe6-6e4e8a0c5b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:15.940429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1c7f9-8355-4bc3-abe6-6e4e8a0c5b55 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:15.940857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1c7f9-8355-4bc3-abe6-6e4e8a0c5b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:15.941181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1c7f9-8355-4bc3-abe6-6e4e8a0c5b55 admin admin] PATH_INFO: `/v3/projects/9f11b49221e9488d8e36b842273aed48/users/32c6d5e411524eb89529198803735e72/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:15.960554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1c7f9-8355-4bc3-abe6-6e4e8a0c5b55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f11b49221e9488d8e36b842273aed48, user_id=32c6d5e411524eb89529198803735e72, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:15.964643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e1c7f9-8355-4bc3-abe6-6e4e8a0c5b55 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:15.997527 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3190/6382] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:15 2022] PUT /identity/v3/projects/9f11b49221e9488d8e36b842273aed48/users/32c6d5e411524eb89529198803735e72/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:16.001426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1c7f9-8355-4bc3-abe6-6e4e8a0c5b55 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:16.018623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe59e421-6ebf-4add-ad21-55ac6fcea07f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:16.023845 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:16.111353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1c7f9-8355-4bc3-abe6-6e4e8a0c5b55 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:16.128230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb9fd3-8738-45dc-adb8-28de1efbd87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:16.128850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9fd3-8738-45dc-adb8-28de1efbd87b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:16.129129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9fd3-8738-45dc-adb8-28de1efbd87b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:16.129724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb9fd3-8738-45dc-adb8-28de1efbd87b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:16.130936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb9fd3-8738-45dc-adb8-28de1efbd87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:16.132902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb9fd3-8738-45dc-adb8-28de1efbd87b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:16.141535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e586d4-05a7-49a6-b35f-17ebe76129b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:16.142047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e586d4-05a7-49a6-b35f-17ebe76129b3 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:16.142333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e586d4-05a7-49a6-b35f-17ebe76129b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:16.142609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e586d4-05a7-49a6-b35f-17ebe76129b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:16.152493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f2e586d4-05a7-49a6-b35f-17ebe76129b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:16.162366 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3191/6383] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:16.166906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb9fd3-8738-45dc-adb8-28de1efbd87b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:16.184479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb9fd3-8738-45dc-adb8-28de1efbd87b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:16.190736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18dfd3c-ec8b-43cc-9116-f173309f06b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:16.191696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfd3c-ec8b-43cc-9116-f173309f06b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:16.192133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfd3c-ec8b-43cc-9116-f173309f06b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:16.192585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18dfd3c-ec8b-43cc-9116-f173309f06b0 admin admin] PATH_INFO: `/v3/projects/9f11b49221e9488d8e36b842273aed48/users/32c6d5e411524eb89529198803735e72/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:16.196525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dfd3c-ec8b-43cc-9116-f173309f06b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f11b49221e9488d8e36b842273aed48, user_id=32c6d5e411524eb89529198803735e72, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:16.200322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18dfd3c-ec8b-43cc-9116-f173309f06b0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:16.215406 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3192/6384] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:16 2022] PUT /identity/v3/projects/9f11b49221e9488d8e36b842273aed48/users/32c6d5e411524eb89529198803735e72/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:16.227527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6262-d454-46b5-b727-0f4edb22085d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:16.228285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6262-d454-46b5-b727-0f4edb22085d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:16.228968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518b6262-d454-46b5-b727-0f4edb22085d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:16.260193 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:16.280106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e586d4-05a7-49a6-b35f-17ebe76129b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:16.282026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e586d4-05a7-49a6-b35f-17ebe76129b3 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:16.306202 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3193/6385] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:15 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:21:16.307986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-518b6262-d454-46b5-b727-0f4edb22085d None None] MFA Rules not processed for user `32c6d5e411524eb89529198803735e72`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:16.309589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-518b6262-d454-46b5-b727-0f4edb22085d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:16.502125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e586d4-05a7-49a6-b35f-17ebe76129b3 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:16.502637 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3193/6386] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:16 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:16.516289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e586d4-05a7-49a6-b35f-17ebe76129b3 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:16.637621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507860-10c1-4e0b-8d4a-a4c8d3626f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:16.638594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507860-10c1-4e0b-8d4a-a4c8d3626f60 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:16.639027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507860-10c1-4e0b-8d4a-a4c8d3626f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:16.639397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3507860-10c1-4e0b-8d4a-a4c8d3626f60 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:16.640153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507860-10c1-4e0b-8d4a-a4c8d3626f60 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:16.642243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3507860-10c1-4e0b-8d4a-a4c8d3626f60 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:16.683645 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3194/6387] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:16 2022] POST /identity/v3/projects => generated 387 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:16.685122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6262-d454-46b5-b727-0f4edb22085d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:16.708268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518b6262-d454-46b5-b727-0f4edb22085d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:16.814541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6feb0-1dbd-4fcd-9348-29e2c93ebaa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:16.815578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6feb0-1dbd-4fcd-9348-29e2c93ebaa1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:16.816060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6feb0-1dbd-4fcd-9348-29e2c93ebaa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:16.817078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe6feb0-1dbd-4fcd-9348-29e2c93ebaa1 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:16.817636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6feb0-1dbd-4fcd-9348-29e2c93ebaa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:16.819870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe6feb0-1dbd-4fcd-9348-29e2c93ebaa1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:16.848473 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3194/6388] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:16 2022] POST /identity/v3/users => generated 294 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:16.853164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507860-10c1-4e0b-8d4a-a4c8d3626f60 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:16.872578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3507860-10c1-4e0b-8d4a-a4c8d3626f60 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:16.885995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef4857-84a0-4d8d-9bab-aea2be9e9b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:16.886635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef4857-84a0-4d8d-9bab-aea2be9e9b9b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:16.886912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef4857-84a0-4d8d-9bab-aea2be9e9b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:16.890784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ef4857-84a0-4d8d-9bab-aea2be9e9b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:16.891482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef4857-84a0-4d8d-9bab-aea2be9e9b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:16.893146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ef4857-84a0-4d8d-9bab-aea2be9e9b9b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:16.935357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6feb0-1dbd-4fcd-9348-29e2c93ebaa1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:16.937488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cfe6feb0-1dbd-4fcd-9348-29e2c93ebaa1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:16.945734 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3195/6389] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:16.947446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef4857-84a0-4d8d-9bab-aea2be9e9b9b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:16.973472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe6feb0-1dbd-4fcd-9348-29e2c93ebaa1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:16.976510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ef4857-84a0-4d8d-9bab-aea2be9e9b9b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:16.981966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14106005-0ff2-41ef-9f6f-35c40bf50754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:16.982367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14106005-0ff2-41ef-9f6f-35c40bf50754 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:16.982649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14106005-0ff2-41ef-9f6f-35c40bf50754 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:16.983023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14106005-0ff2-41ef-9f6f-35c40bf50754 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:16.983815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14106005-0ff2-41ef-9f6f-35c40bf50754 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:16.984576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:16.985388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:16.985626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14106005-0ff2-41ef-9f6f-35c40bf50754 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:16.985835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:16.986528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] PATH_INFO: `/v3/users/3a46fbe5ff7247cc9221553deca02d26` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:16.992327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a46fbe5ff7247cc9221553deca02d26)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:16.992533 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:16.994792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:17.002149 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3196/6390] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:16 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:17.003905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14106005-0ff2-41ef-9f6f-35c40bf50754 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:17.030016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14106005-0ff2-41ef-9f6f-35c40bf50754 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:17.035110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f6b54-cda4-4a37-a0d7-a427072d2e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:17.036168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f6b54-cda4-4a37-a0d7-a427072d2e7a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:17.036608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f6b54-cda4-4a37-a0d7-a427072d2e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:17.037054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1f6b54-cda4-4a37-a0d7-a427072d2e7a admin admin] PATH_INFO: `/v3/projects/fd179e90fd3a4e20bab6af610354666e/users/bba423154c6747e2a059a49c80eab7f4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:17.065869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f6b54-cda4-4a37-a0d7-a427072d2e7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd179e90fd3a4e20bab6af610354666e, user_id=bba423154c6747e2a059a49c80eab7f4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:17.071035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1f6b54-cda4-4a37-a0d7-a427072d2e7a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:17.088970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a46fbe5ff7247cc9221553deca02d26'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.100050 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3197/6391] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:17 2022] PUT /identity/v3/projects/fd179e90fd3a4e20bab6af610354666e/users/bba423154c6747e2a059a49c80eab7f4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:17.101487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f6b54-cda4-4a37-a0d7-a427072d2e7a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:17.103302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc1f6b54-cda4-4a37-a0d7-a427072d2e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:17.110676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a46fbe5ff7247cc9221553deca02d26'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.111490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a46fbe5ff7247cc9221553deca02d26'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.120087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a46fbe5ff7247cc9221553deca02d26'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.123166 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:17.135068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-34cc0d6c-3ed3-42a9-8126-7d525dbd20b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a46fbe5ff7247cc9221553deca02d26'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.143622 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3195/6392] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:16 2022] DELETE /identity/v3/users/3a46fbe5ff7247cc9221553deca02d26 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:17.147461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931150b4-21f4-4090-8de2-c5c4efbd1ff9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:17.147763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931150b4-21f4-4090-8de2-c5c4efbd1ff9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:17.148188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931150b4-21f4-4090-8de2-c5c4efbd1ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:17.189094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-931150b4-21f4-4090-8de2-c5c4efbd1ff9 None None] MFA Rules not processed for user `bba423154c6747e2a059a49c80eab7f4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:17.191209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-931150b4-21f4-4090-8de2-c5c4efbd1ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:17.195554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1f6b54-cda4-4a37-a0d7-a427072d2e7a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:17.286936 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3196/6393] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:17.288171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcebff-3b2e-404b-b6ac-fe665ba6b109 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:17.288487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcebff-3b2e-404b-b6ac-fe665ba6b109 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:17.289119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcebff-3b2e-404b-b6ac-fe665ba6b109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:17.294025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:17.294725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:17.295057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:17.295330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] PATH_INFO: `/v3/users/f86a3192fe414e32ba26a87088256a2f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:17.296485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f86a3192fe414e32ba26a87088256a2f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:17.298449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:17.310849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b5fcebff-3b2e-404b-b6ac-fe665ba6b109 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:17.312630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b5fcebff-3b2e-404b-b6ac-fe665ba6b109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:17.329866 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3197/6394] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:17.330738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcebff-3b2e-404b-b6ac-fe665ba6b109 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:17.333923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b5fcebff-3b2e-404b-b6ac-fe665ba6b109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:17.372158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f86a3192fe414e32ba26a87088256a2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.389781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f86a3192fe414e32ba26a87088256a2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.390453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f86a3192fe414e32ba26a87088256a2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.406207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f86a3192fe414e32ba26a87088256a2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.416421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f86a3192fe414e32ba26a87088256a2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:17.422799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fcebff-3b2e-404b-b6ac-fe665ba6b109 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:17.423576 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3198/6395] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:17 2022] DELETE /identity/v3/users/f86a3192fe414e32ba26a87088256a2f => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:17.424563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:17.426600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:17.434080 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:17.510459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da0f65-baa0-468b-8813-6829b279e4b3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:17.514384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:17.515069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:17.515361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:17.515648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:17.517650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:17.527347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf5266c-ca67-47b2-a0da-db825fcaa0f5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:17.528199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5266c-ca67-47b2-a0da-db825fcaa0f5 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:17.528543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5266c-ca67-47b2-a0da-db825fcaa0f5 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:17.528828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf5266c-ca67-47b2-a0da-db825fcaa0f5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:17.531273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bdf5266c-ca67-47b2-a0da-db825fcaa0f5 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:17.591603 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:17.618426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5266c-ca67-47b2-a0da-db825fcaa0f5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:17.620369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf5266c-ca67-47b2-a0da-db825fcaa0f5 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:17.652810 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3198/6396] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:17 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:17.654889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09892706-3228-46e3-a217-02137844e365 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:17.655181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09892706-3228-46e3-a217-02137844e365 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:17.655769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09892706-3228-46e3-a217-02137844e365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:17.697704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-09892706-3228-46e3-a217-02137844e365 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:17.699137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-09892706-3228-46e3-a217-02137844e365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:17.712184 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3199/6397] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:17.723252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09892706-3228-46e3-a217-02137844e365 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:17.731936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:17.733456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:17.738141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09892706-3228-46e3-a217-02137844e365 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:17.745601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f04ee18-2dbb-4f30-88b1-134d9ae3a35b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:17.748424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04ee18-2dbb-4f30-88b1-134d9ae3a35b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:17.748921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04ee18-2dbb-4f30-88b1-134d9ae3a35b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:17.749480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f04ee18-2dbb-4f30-88b1-134d9ae3a35b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:17.761697 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3199/6398] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:17.782854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04ee18-2dbb-4f30-88b1-134d9ae3a35b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:17.785597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f04ee18-2dbb-4f30-88b1-134d9ae3a35b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:17.824541 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3200/6399] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:18.245575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:18.250957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:18.269477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00679809-ec6d-44f8-9c32-681643ae6771 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:18.281538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:18.282256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.282544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.282815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] PATH_INFO: `/v3/projects/0950fe2c8c6c48f3b920c3a7e2f5d31a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.283971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0950fe2c8c6c48f3b920c3a7e2f5d31a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:18.286636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:18.372624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0950fe2c8c6c48f3b920c3a7e2f5d31a', 'request_id': 'req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:18.384075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0950fe2c8c6c48f3b920c3a7e2f5d31a', 'request_id': 'req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:18.393125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0950fe2c8c6c48f3b920c3a7e2f5d31a', 'request_id': 'req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:18.419522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] The token cache is being invalidate because project 0950fe2c8c6c48f3b920c3a7e2f5d31a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:18.420256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:18.421288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-87bdf38d-8b75-42e2-a6c1-3f5ef3ba46bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:18.424747 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3200/6400] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:18 2022] DELETE /identity/v3/projects/0950fe2c8c6c48f3b920c3a7e2f5d31a => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:18.429923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb937e87-34ac-439e-8801-f6514efbb81b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.430714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb937e87-34ac-439e-8801-f6514efbb81b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.430714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb937e87-34ac-439e-8801-f6514efbb81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.457223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fb937e87-34ac-439e-8801-f6514efbb81b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:18.458780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb937e87-34ac-439e-8801-f6514efbb81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:18.546645 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3201/6401] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:18.555573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e9696-1b82-4ff7-94a0-bc3b5332c9d1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.556534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e9696-1b82-4ff7-94a0-bc3b5332c9d1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.557043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9e9696-1b82-4ff7-94a0-bc3b5332c9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.581785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fe9e9696-1b82-4ff7-94a0-bc3b5332c9d1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:18.583120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fe9e9696-1b82-4ff7-94a0-bc3b5332c9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:18.597546 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3201/6402] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:18.600326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb937e87-34ac-439e-8801-f6514efbb81b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:18.612504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb937e87-34ac-439e-8801-f6514efbb81b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:18.619058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31d4de-5b66-4ee5-87a6-a93402521b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:18.622602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d4de-5b66-4ee5-87a6-a93402521b6b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.622602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d4de-5b66-4ee5-87a6-a93402521b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.622602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf31d4de-5b66-4ee5-87a6-a93402521b6b admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.622602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d4de-5b66-4ee5-87a6-a93402521b6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:18.622602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d4de-5b66-4ee5-87a6-a93402521b6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:18.624142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf31d4de-5b66-4ee5-87a6-a93402521b6b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:18.645339 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3202/6403] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:18.648003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e9696-1b82-4ff7-94a0-bc3b5332c9d1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:18.657974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9e9696-1b82-4ff7-94a0-bc3b5332c9d1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:18.663345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144d4d1-f0f2-456e-81fe-6625c0bdb514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:18.663979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144d4d1-f0f2-456e-81fe-6625c0bdb514 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.664271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144d4d1-f0f2-456e-81fe-6625c0bdb514 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.664575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144d4d1-f0f2-456e-81fe-6625c0bdb514 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.665220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144d4d1-f0f2-456e-81fe-6625c0bdb514 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:18.667307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144d4d1-f0f2-456e-81fe-6625c0bdb514 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:18.701334 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3202/6404] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:18 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:18.704358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31d4de-5b66-4ee5-87a6-a93402521b6b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:18.715546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf31d4de-5b66-4ee5-87a6-a93402521b6b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:18.785933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddb11c-69f0-4c4d-bd05-c5a50e93fe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:18.786777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddb11c-69f0-4c4d-bd05-c5a50e93fe30 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.787197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddb11c-69f0-4c4d-bd05-c5a50e93fe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.787590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ddb11c-69f0-4c4d-bd05-c5a50e93fe30 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.788443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddb11c-69f0-4c4d-bd05-c5a50e93fe30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:18.790914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ddb11c-69f0-4c4d-bd05-c5a50e93fe30 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:18.821784 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3203/6405] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:18 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:18.825841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144d4d1-f0f2-456e-81fe-6625c0bdb514 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:18.836913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144d4d1-f0f2-456e-81fe-6625c0bdb514 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:18.845729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7729-53d0-4e3c-b783-eec5fe2cdcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:18.846367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7729-53d0-4e3c-b783-eec5fe2cdcae admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.846652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7729-53d0-4e3c-b783-eec5fe2cdcae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.846928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c7729-53d0-4e3c-b783-eec5fe2cdcae admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.847596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c7729-53d0-4e3c-b783-eec5fe2cdcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:18.849182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c7729-53d0-4e3c-b783-eec5fe2cdcae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:18.850740 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:18.865441 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3203/6406] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:18.867642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddb11c-69f0-4c4d-bd05-c5a50e93fe30 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:18.880935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ddb11c-69f0-4c4d-bd05-c5a50e93fe30 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:18.889275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ce057-3f0e-45b1-89b9-ff3cf63db493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:18.890537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce057-3f0e-45b1-89b9-ff3cf63db493 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.891601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce057-3f0e-45b1-89b9-ff3cf63db493 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.891998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693ce057-3f0e-45b1-89b9-ff3cf63db493 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.893233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ce057-3f0e-45b1-89b9-ff3cf63db493 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:18.898821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693ce057-3f0e-45b1-89b9-ff3cf63db493 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:18.922096 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3204/6407] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:18.927420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7729-53d0-4e3c-b783-eec5fe2cdcae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:18.940055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c7729-53d0-4e3c-b783-eec5fe2cdcae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:18.941233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ce057-3f0e-45b1-89b9-ff3cf63db493 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:18.944998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-693ce057-3f0e-45b1-89b9-ff3cf63db493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:18.951129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc70f4-b436-4abe-99e5-6d3b6d57dd03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:18.962546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc70f4-b436-4abe-99e5-6d3b6d57dd03 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.962840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc70f4-b436-4abe-99e5-6d3b6d57dd03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.963184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dc70f4-b436-4abe-99e5-6d3b6d57dd03 admin admin] PATH_INFO: `/v3/projects/0ddb2836cd3e4130814e27f0324d8e1a/users/8718f7c704a0445fb1d65ccf25ef207c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.982612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc70f4-b436-4abe-99e5-6d3b6d57dd03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ddb2836cd3e4130814e27f0324d8e1a, user_id=8718f7c704a0445fb1d65ccf25ef207c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:18.982978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693ce057-3f0e-45b1-89b9-ff3cf63db493 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:18.985736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dc70f4-b436-4abe-99e5-6d3b6d57dd03 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:18.990467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:18.992540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:18.992835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:18.993111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] PATH_INFO: `/v3/projects/4905aaa2c2984e788695ca34667fe0ec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:18.994865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4905aaa2c2984e788695ca34667fe0ec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:18.997871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:19.018622 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3204/6408] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:18 2022] PUT /identity/v3/projects/0ddb2836cd3e4130814e27f0324d8e1a/users/8718f7c704a0445fb1d65ccf25ef207c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:19.020458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc70f4-b436-4abe-99e5-6d3b6d57dd03 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:19.024127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-21dc70f4-b436-4abe-99e5-6d3b6d57dd03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:19.077009 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:19.110300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4905aaa2c2984e788695ca34667fe0ec', 'request_id': 'req-f050a828-a034-4f8f-842a-c4dfb53836c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.118280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dc70f4-b436-4abe-99e5-6d3b6d57dd03 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:19.120303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4905aaa2c2984e788695ca34667fe0ec', 'request_id': 'req-f050a828-a034-4f8f-842a-c4dfb53836c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.129157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4905aaa2c2984e788695ca34667fe0ec', 'request_id': 'req-f050a828-a034-4f8f-842a-c4dfb53836c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.142270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] The token cache is being invalidate because project 4905aaa2c2984e788695ca34667fe0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:19.142498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.145912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f050a828-a034-4f8f-842a-c4dfb53836c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.148529 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3205/6409] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:18 2022] DELETE /identity/v3/projects/4905aaa2c2984e788695ca34667fe0ec => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:19.151664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82675a9-3b29-4ebc-8eda-1aa68a373633 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.151664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82675a9-3b29-4ebc-8eda-1aa68a373633 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.151664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82675a9-3b29-4ebc-8eda-1aa68a373633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.185416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f82675a9-3b29-4ebc-8eda-1aa68a373633 None None] MFA Rules not processed for user `8718f7c704a0445fb1d65ccf25ef207c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:19.186719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f82675a9-3b29-4ebc-8eda-1aa68a373633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:19.191254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:19.192104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.192457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.192807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] PATH_INFO: `/v3/users/32c6d5e411524eb89529198803735e72` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.194699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c6d5e411524eb89529198803735e72)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:19.197640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:19.267970 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3206/6410] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:19.268614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82675a9-3b29-4ebc-8eda-1aa68a373633 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:19.268758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c6d5e411524eb89529198803735e72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.269921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f82675a9-3b29-4ebc-8eda-1aa68a373633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:19.284935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82675a9-3b29-4ebc-8eda-1aa68a373633 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:19.288710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c6d5e411524eb89529198803735e72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.289492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c6d5e411524eb89529198803735e72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.294895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:19.295776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.296313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.296720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] PATH_INFO: `/v3/users/7465da729de645e59878e0dc2b1d5a62` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.298648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c6d5e411524eb89529198803735e72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.298783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7465da729de645e59878e0dc2b1d5a62)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:19.301934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:19.306910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c6d5e411524eb89529198803735e72'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.309202 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:19.313854 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3205/6411] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:19 2022] DELETE /identity/v3/users/32c6d5e411524eb89529198803735e72 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:19.315851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:19.317965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:19.364219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7465da729de645e59878e0dc2b1d5a62'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.377489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7465da729de645e59878e0dc2b1d5a62'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.378286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7465da729de645e59878e0dc2b1d5a62'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.387321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7465da729de645e59878e0dc2b1d5a62'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.395028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aaa18d33-a642-40bf-bd50-c9cec8912e29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7465da729de645e59878e0dc2b1d5a62'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:19.396831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023752f-69c7-46d5-9180-0e374e6193c3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:19.403001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04491-d936-4329-9277-efee97e76495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:19.403637 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3207/6412] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:19 2022] DELETE /identity/v3/users/7465da729de645e59878e0dc2b1d5a62 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:19.403783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04491-d936-4329-9277-efee97e76495 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.404170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04491-d936-4329-9277-efee97e76495 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.404406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a04491-d936-4329-9277-efee97e76495 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.405273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4319eb-f0ca-4d56-b63b-afb5cc8f8805 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.405655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04491-d936-4329-9277-efee97e76495 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:19.405818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4319eb-f0ca-4d56-b63b-afb5cc8f8805 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.405912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4319eb-f0ca-4d56-b63b-afb5cc8f8805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.408260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a04491-d936-4329-9277-efee97e76495 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:19.431719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5d4319eb-f0ca-4d56-b63b-afb5cc8f8805 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:19.433087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d4319eb-f0ca-4d56-b63b-afb5cc8f8805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:19.451068 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:19.455652 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3206/6413] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:19 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:19.459501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04491-d936-4329-9277-efee97e76495 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:19.462099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0a04491-d936-4329-9277-efee97e76495 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:19.537242 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3208/6414] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:19.552564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4319eb-f0ca-4d56-b63b-afb5cc8f8805 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:19.554553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d4319eb-f0ca-4d56-b63b-afb5cc8f8805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:19.571398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a04491-d936-4329-9277-efee97e76495 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:19.585400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da32e17-d7dd-44a2-9a43-21f13a5f0c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:19.586318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da32e17-d7dd-44a2-9a43-21f13a5f0c78 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.586599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da32e17-d7dd-44a2-9a43-21f13a5f0c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.586881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da32e17-d7dd-44a2-9a43-21f13a5f0c78 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.587512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da32e17-d7dd-44a2-9a43-21f13a5f0c78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:19.589472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da32e17-d7dd-44a2-9a43-21f13a5f0c78 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:19.633444 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3207/6415] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:19 2022] POST /identity/v3/users => generated 299 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:19.635272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da32e17-d7dd-44a2-9a43-21f13a5f0c78 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:19.649947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da32e17-d7dd-44a2-9a43-21f13a5f0c78 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:19.664210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb6951-335d-43b6-9451-c25ac735ce73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:19.664830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb6951-335d-43b6-9451-c25ac735ce73 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.665112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb6951-335d-43b6-9451-c25ac735ce73 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.665414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abb6951-335d-43b6-9451-c25ac735ce73 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.666063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb6951-335d-43b6-9451-c25ac735ce73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:19.667656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abb6951-335d-43b6-9451-c25ac735ce73 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:19.692647 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3208/6416] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:19.696632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb6951-335d-43b6-9451-c25ac735ce73 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:19.711282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abb6951-335d-43b6-9451-c25ac735ce73 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:19.715001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4319eb-f0ca-4d56-b63b-afb5cc8f8805 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:19.723120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8552e-fba7-4108-9817-f1e366d9483b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:19.723960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8552e-fba7-4108-9817-f1e366d9483b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.726231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8552e-fba7-4108-9817-f1e366d9483b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.726663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b8552e-fba7-4108-9817-f1e366d9483b admin admin] PATH_INFO: `/v3/projects/440b11035587431eb6251aecad18b5b7/users/f54880d541f5427e9fd2af290dd29420/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.764798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8552e-fba7-4108-9817-f1e366d9483b admin admin] RBAC: Authorizing `identity:create_grant(project_id=440b11035587431eb6251aecad18b5b7, user_id=f54880d541f5427e9fd2af290dd29420, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:19.768211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b8552e-fba7-4108-9817-f1e366d9483b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:19.795537 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3209/6417] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:19 2022] PUT /identity/v3/projects/440b11035587431eb6251aecad18b5b7/users/f54880d541f5427e9fd2af290dd29420/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:19.799723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8552e-fba7-4108-9817-f1e366d9483b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:19.816373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a266-02e1-4cfa-bcff-e33820279fd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:19.817099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a266-02e1-4cfa-bcff-e33820279fd7 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.818060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a266-02e1-4cfa-bcff-e33820279fd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.818421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd32a266-02e1-4cfa-bcff-e33820279fd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.832050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a266-02e1-4cfa-bcff-e33820279fd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:19.833848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd32a266-02e1-4cfa-bcff-e33820279fd7 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:19.864840 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3209/6418] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:19.867801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a266-02e1-4cfa-bcff-e33820279fd7 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:19.871646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dd32a266-02e1-4cfa-bcff-e33820279fd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:19.889442 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:19.904792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd32a266-02e1-4cfa-bcff-e33820279fd7 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:19.934080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b8552e-fba7-4108-9817-f1e366d9483b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:19.956644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49103b-c8b7-4877-9470-b3d27491d07f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:19.957346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49103b-c8b7-4877-9470-b3d27491d07f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:19.958288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49103b-c8b7-4877-9470-b3d27491d07f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:19.958615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab49103b-c8b7-4877-9470-b3d27491d07f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:19.959469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49103b-c8b7-4877-9470-b3d27491d07f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:19.964650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab49103b-c8b7-4877-9470-b3d27491d07f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:19.979560 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3210/6419] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:19.983957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49103b-c8b7-4877-9470-b3d27491d07f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:20.009396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab49103b-c8b7-4877-9470-b3d27491d07f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:20.020880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea023f8-8106-44dd-9a76-a3a70b2fd7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:20.022727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea023f8-8106-44dd-9a76-a3a70b2fd7aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.023159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea023f8-8106-44dd-9a76-a3a70b2fd7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.023499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea023f8-8106-44dd-9a76-a3a70b2fd7aa admin admin] PATH_INFO: `/v3/projects/440b11035587431eb6251aecad18b5b7/users/f54880d541f5427e9fd2af290dd29420/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.026087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea023f8-8106-44dd-9a76-a3a70b2fd7aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=440b11035587431eb6251aecad18b5b7, user_id=f54880d541f5427e9fd2af290dd29420, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:20.029096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea023f8-8106-44dd-9a76-a3a70b2fd7aa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:20.034921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:20.036909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.037279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.037670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] PATH_INFO: `/v3/projects/accebba556f741fdbdd172738f48496b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.038973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=accebba556f741fdbdd172738f48496b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:20.041114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:20.041813 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3211/6420] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:19 2022] PUT /identity/v3/projects/440b11035587431eb6251aecad18b5b7/users/f54880d541f5427e9fd2af290dd29420/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:20.053981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ba64c-fb0a-4b7d-9fe2-7668d527ab87 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.054421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ba64c-fb0a-4b7d-9fe2-7668d527ab87 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.054799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ba64c-fb0a-4b7d-9fe2-7668d527ab87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.069552 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:20.113842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-637ba64c-fb0a-4b7d-9fe2-7668d527ab87 None None] MFA Rules not processed for user `f54880d541f5427e9fd2af290dd29420`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:20.115428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-637ba64c-fb0a-4b7d-9fe2-7668d527ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:20.155778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'accebba556f741fdbdd172738f48496b', 'request_id': 'req-a9647706-6989-41b5-ab89-2f0cb4576d29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.162688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'accebba556f741fdbdd172738f48496b', 'request_id': 'req-a9647706-6989-41b5-ab89-2f0cb4576d29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.172880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'accebba556f741fdbdd172738f48496b', 'request_id': 'req-a9647706-6989-41b5-ab89-2f0cb4576d29'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.185802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] The token cache is being invalidate because project accebba556f741fdbdd172738f48496b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:20.186214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.187141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a9647706-6989-41b5-ab89-2f0cb4576d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.189477 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3210/6421] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:19 2022] DELETE /identity/v3/projects/accebba556f741fdbdd172738f48496b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:20.194565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85849-8337-4c08-92cf-858af3c1bc97 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.195124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85849-8337-4c08-92cf-858af3c1bc97 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.195585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85849-8337-4c08-92cf-858af3c1bc97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.219908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4fb85849-8337-4c08-92cf-858af3c1bc97 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:20.221474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4fb85849-8337-4c08-92cf-858af3c1bc97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:20.236907 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3212/6422] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:20 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:20.250868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ba64c-fb0a-4b7d-9fe2-7668d527ab87 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:20.252852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-637ba64c-fb0a-4b7d-9fe2-7668d527ab87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:20.311707 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3211/6423] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:20.323536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f54971-2c5b-446b-8977-c78c0db41d11 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.324656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f54971-2c5b-446b-8977-c78c0db41d11 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.325265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f54971-2c5b-446b-8977-c78c0db41d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.362579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ba64c-fb0a-4b7d-9fe2-7668d527ab87 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:20.367926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174527ef-c85f-4f60-8cd7-60453ef5c49e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:20.368766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174527ef-c85f-4f60-8cd7-60453ef5c49e service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.369197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174527ef-c85f-4f60-8cd7-60453ef5c49e service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.369575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174527ef-c85f-4f60-8cd7-60453ef5c49e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.371833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-174527ef-c85f-4f60-8cd7-60453ef5c49e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:20.383842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d7f54971-2c5b-446b-8977-c78c0db41d11 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:20.387382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7f54971-2c5b-446b-8977-c78c0db41d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:20.409327 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3212/6424] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:20.410289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f54971-2c5b-446b-8977-c78c0db41d11 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:20.415123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7f54971-2c5b-446b-8977-c78c0db41d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:20.444682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f54971-2c5b-446b-8977-c78c0db41d11 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:20.449110 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:20.460396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:20.461149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.462241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.462729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] PATH_INFO: `/v3/projects/9f11b49221e9488d8e36b842273aed48` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.465894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f11b49221e9488d8e36b842273aed48)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:20.468143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:20.470409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174527ef-c85f-4f60-8cd7-60453ef5c49e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:20.471751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174527ef-c85f-4f60-8cd7-60453ef5c49e service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:20.483268 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3213/6425] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:20 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:20.484260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174527ef-c85f-4f60-8cd7-60453ef5c49e service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:20.511444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174527ef-c85f-4f60-8cd7-60453ef5c49e service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:20.540927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f11b49221e9488d8e36b842273aed48', 'request_id': 'req-396e9401-fd42-4ccf-8b36-b9c358d638ff'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.548643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f11b49221e9488d8e36b842273aed48', 'request_id': 'req-396e9401-fd42-4ccf-8b36-b9c358d638ff'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.560852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f11b49221e9488d8e36b842273aed48', 'request_id': 'req-396e9401-fd42-4ccf-8b36-b9c358d638ff'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.574081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] The token cache is being invalidate because project 9f11b49221e9488d8e36b842273aed48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:20.574382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.575327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.577070 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3213/6426] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:20 2022] DELETE /identity/v3/projects/9f11b49221e9488d8e36b842273aed48 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:20.581578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:20.583683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:20.600983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:20.601652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.601933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.602204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.603136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:20.603460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:20.614371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:20.638548 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3214/6427] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:20.639622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:20.642513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:20.644837 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:20.659245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc001482-5979-42a6-ad62-0d0207f0bf66 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:20.668246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb431c7-339f-4c8e-8633-79dfc9f6169e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:20.670191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb431c7-339f-4c8e-8633-79dfc9f6169e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.670560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb431c7-339f-4c8e-8633-79dfc9f6169e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.670914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb431c7-339f-4c8e-8633-79dfc9f6169e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.672156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb431c7-339f-4c8e-8633-79dfc9f6169e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:20.674906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb431c7-339f-4c8e-8633-79dfc9f6169e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:20.725665 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3215/6428] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:20 2022] POST /identity/v3/projects => generated 391 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:20.727979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb431c7-339f-4c8e-8633-79dfc9f6169e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:20.745609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e9401-fd42-4ccf-8b36-b9c358d638ff admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:20.861574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb431c7-339f-4c8e-8633-79dfc9f6169e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:20.867795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fe85-3b2f-4469-a637-506b2e941928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:20.868582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fe85-3b2f-4469-a637-506b2e941928 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.868942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fe85-3b2f-4469-a637-506b2e941928 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.869187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b710fe85-3b2f-4469-a637-506b2e941928 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.869852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fe85-3b2f-4469-a637-506b2e941928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:20.871908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b710fe85-3b2f-4469-a637-506b2e941928 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:20.874701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:20.875456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.875838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.876222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] PATH_INFO: `/v3/users/bba423154c6747e2a059a49c80eab7f4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.877823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bba423154c6747e2a059a49c80eab7f4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:20.879981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:20.905531 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3216/6429] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:20 2022] POST /identity/v3/users => generated 296 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:20.908715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fe85-3b2f-4469-a637-506b2e941928 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:20.929198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b710fe85-3b2f-4469-a637-506b2e941928 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:20.938302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22438d-630a-45bd-8329-6e0187d4e42d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:20.939648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22438d-630a-45bd-8329-6e0187d4e42d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:20.940198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22438d-630a-45bd-8329-6e0187d4e42d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:20.940781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad22438d-630a-45bd-8329-6e0187d4e42d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:20.941724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22438d-630a-45bd-8329-6e0187d4e42d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:20.945926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bba423154c6747e2a059a49c80eab7f4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.946410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad22438d-630a-45bd-8329-6e0187d4e42d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:20.969705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bba423154c6747e2a059a49c80eab7f4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.970796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bba423154c6747e2a059a49c80eab7f4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:20.971625 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3217/6430] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:20.980464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22438d-630a-45bd-8329-6e0187d4e42d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:20.983363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ad22438d-630a-45bd-8329-6e0187d4e42d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:20.983909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bba423154c6747e2a059a49c80eab7f4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.002063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bba423154c6747e2a059a49c80eab7f4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.008787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad22438d-630a-45bd-8329-6e0187d4e42d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:21.023302 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3214/6431] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:20 2022] DELETE /identity/v3/users/bba423154c6747e2a059a49c80eab7f4 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:21.023503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa266ca-c974-4c0d-bbdd-d490708e4d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:21.024135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa266ca-c974-4c0d-bbdd-d490708e4d87 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:21.024885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa266ca-c974-4c0d-bbdd-d490708e4d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:21.025361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa266ca-c974-4c0d-bbdd-d490708e4d87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:21.026089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa266ca-c974-4c0d-bbdd-d490708e4d87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:21.028477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa266ca-c974-4c0d-bbdd-d490708e4d87 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:21.046709 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3218/6432] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:20 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:21.065577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:21.130211 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:21.166587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2eb7d-ae71-427c-807e-6408635aee69 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:21.173358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e4a07-40b9-43ba-8b94-c8257c9ebf1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:21.174570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e4a07-40b9-43ba-8b94-c8257c9ebf1c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:21.175030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e4a07-40b9-43ba-8b94-c8257c9ebf1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:21.175804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40e4a07-40b9-43ba-8b94-c8257c9ebf1c admin admin] PATH_INFO: `/v3/projects/11579a796efd463587d00881e479333f/users/dffd2ff693c04102bc5116f2b8c2192e/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:21.201474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e4a07-40b9-43ba-8b94-c8257c9ebf1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=11579a796efd463587d00881e479333f, user_id=dffd2ff693c04102bc5116f2b8c2192e, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:21.205539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40e4a07-40b9-43ba-8b94-c8257c9ebf1c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:21.261870 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3215/6433] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:21 2022] PUT /identity/v3/projects/11579a796efd463587d00881e479333f/users/dffd2ff693c04102bc5116f2b8c2192e/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:21.262988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c5d5b-fcc3-4440-85a4-74c6cd419bfb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:21.263685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c5d5b-fcc3-4440-85a4-74c6cd419bfb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:21.264455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354c5d5b-fcc3-4440-85a4-74c6cd419bfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:21.311554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-354c5d5b-fcc3-4440-85a4-74c6cd419bfb None None] MFA Rules not processed for user `dffd2ff693c04102bc5116f2b8c2192e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:21.312953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-354c5d5b-fcc3-4440-85a4-74c6cd419bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:21.338513 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:21.407138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e4a07-40b9-43ba-8b94-c8257c9ebf1c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:21.408928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a40e4a07-40b9-43ba-8b94-c8257c9ebf1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:21.456572 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3219/6434] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:21.477523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c5d5b-fcc3-4440-85a4-74c6cd419bfb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:21.482396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-354c5d5b-fcc3-4440-85a4-74c6cd419bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:21.541051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40e4a07-40b9-43ba-8b94-c8257c9ebf1c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:21.552601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:21.553869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:21.554161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:21.554440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] PATH_INFO: `/v3/projects/fd179e90fd3a4e20bab6af610354666e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:21.558011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd179e90fd3a4e20bab6af610354666e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:21.560107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:21.611454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354c5d5b-fcc3-4440-85a4-74c6cd419bfb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:21.616590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f13f6-5cc1-46ff-92d7-cf74431695ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:21.617142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f13f6-5cc1-46ff-92d7-cf74431695ec service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:21.617469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f13f6-5cc1-46ff-92d7-cf74431695ec service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:21.617748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223f13f6-5cc1-46ff-92d7-cf74431695ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:21.627571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f13f6-5cc1-46ff-92d7-cf74431695ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:21.629026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223f13f6-5cc1-46ff-92d7-cf74431695ec service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:21.637876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd179e90fd3a4e20bab6af610354666e', 'request_id': 'req-8aa5d8f3-a729-4c5b-9ddc-899caa299022'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.640483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3220/6435] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:21.646068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd179e90fd3a4e20bab6af610354666e', 'request_id': 'req-8aa5d8f3-a729-4c5b-9ddc-899caa299022'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.657109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd179e90fd3a4e20bab6af610354666e', 'request_id': 'req-8aa5d8f3-a729-4c5b-9ddc-899caa299022'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.670595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] The token cache is being invalidate because project fd179e90fd3a4e20bab6af610354666e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:21.670800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.671645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8aa5d8f3-a729-4c5b-9ddc-899caa299022 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.676667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f13f6-5cc1-46ff-92d7-cf74431695ec service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:21.685064 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3216/6436] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:21 2022] DELETE /identity/v3/projects/fd179e90fd3a4e20bab6af610354666e => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:21.691111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab73f14-6e3a-468b-89a6-1b1045207857 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:21.691512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab73f14-6e3a-468b-89a6-1b1045207857 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:21.691887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab73f14-6e3a-468b-89a6-1b1045207857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:21.692407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223f13f6-5cc1-46ff-92d7-cf74431695ec service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:21.727705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cab73f14-6e3a-468b-89a6-1b1045207857 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:21.729887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cab73f14-6e3a-468b-89a6-1b1045207857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:21.818820 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:21.839922 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3217/6437] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:21.842035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a858-6fc7-404f-97e8-54b9fcb42e75 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:21.842993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:21.843938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:21.844499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:21.844987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] PATH_INFO: `/v3/users/dffd2ff693c04102bc5116f2b8c2192e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:21.845721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a858-6fc7-404f-97e8-54b9fcb42e75 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:21.845997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d80a858-6fc7-404f-97e8-54b9fcb42e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:21.847342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dffd2ff693c04102bc5116f2b8c2192e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:21.851132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:21.916250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9d80a858-6fc7-404f-97e8-54b9fcb42e75 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:21.917558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9d80a858-6fc7-404f-97e8-54b9fcb42e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:21.933486 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3218/6438] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:21.934394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a858-6fc7-404f-97e8-54b9fcb42e75 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:21.942060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dffd2ff693c04102bc5116f2b8c2192e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.945163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d80a858-6fc7-404f-97e8-54b9fcb42e75 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:21.950257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:21.950900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:21.951182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:21.951452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:21.952109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:21.952414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:21.954420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:21.960113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dffd2ff693c04102bc5116f2b8c2192e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.960992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dffd2ff693c04102bc5116f2b8c2192e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.963211 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:21.976083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3219/6439] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:21.980755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dffd2ff693c04102bc5116f2b8c2192e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:21.980977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:21.986528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:21.995657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6b221327-4bcd-49a9-b8de-2761ccc935c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dffd2ff693c04102bc5116f2b8c2192e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:22.003801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf0a9e2-200f-4ae7-83de-4168ce701c14 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:22.009228 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3221/6440] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:21 2022] DELETE /identity/v3/users/dffd2ff693c04102bc5116f2b8c2192e => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:22.014710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed9712-027e-4115-9776-88f80e1ba19e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:22.014868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02e86d-6760-4de7-9dc3-356037e74f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:22.015316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed9712-027e-4115-9776-88f80e1ba19e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:22.015665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02e86d-6760-4de7-9dc3-356037e74f4c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:22.015924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ed9712-027e-4115-9776-88f80e1ba19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:22.016120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02e86d-6760-4de7-9dc3-356037e74f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:22.016485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f02e86d-6760-4de7-9dc3-356037e74f4c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:22.017212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02e86d-6760-4de7-9dc3-356037e74f4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:22.019463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f02e86d-6760-4de7-9dc3-356037e74f4c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:22.042514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-78ed9712-027e-4115-9776-88f80e1ba19e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:22.044206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-78ed9712-027e-4115-9776-88f80e1ba19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:22.054145 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3220/6441] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:21 2022] POST /identity/v3/projects => generated 371 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:22.058878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02e86d-6760-4de7-9dc3-356037e74f4c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:22.159410 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3222/6442] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:22.166304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f02e86d-6760-4de7-9dc3-356037e74f4c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:22.170955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed9712-027e-4115-9776-88f80e1ba19e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:22.171480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a2d2a-5985-4cdb-ba87-aa5d1d8733c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:22.172158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a2d2a-5985-4cdb-ba87-aa5d1d8733c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:22.172647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a2d2a-5985-4cdb-ba87-aa5d1d8733c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:22.172756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-78ed9712-027e-4115-9776-88f80e1ba19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:22.173055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1a2d2a-5985-4cdb-ba87-aa5d1d8733c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:22.173787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a2d2a-5985-4cdb-ba87-aa5d1d8733c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:22.175805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1a2d2a-5985-4cdb-ba87-aa5d1d8733c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:22.209067 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3221/6443] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:22 2022] POST /identity/v3/users => generated 286 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:22.211169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a2d2a-5985-4cdb-ba87-aa5d1d8733c2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:22.228464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1a2d2a-5985-4cdb-ba87-aa5d1d8733c2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:22.234927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92cd5e-28f9-4e53-bce5-52b4ab2e7a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:22.237998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92cd5e-28f9-4e53-bce5-52b4ab2e7a7a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:22.238279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92cd5e-28f9-4e53-bce5-52b4ab2e7a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:22.238551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e92cd5e-28f9-4e53-bce5-52b4ab2e7a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:22.239716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92cd5e-28f9-4e53-bce5-52b4ab2e7a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:22.241613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e92cd5e-28f9-4e53-bce5-52b4ab2e7a7a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:22.250318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ed9712-027e-4115-9776-88f80e1ba19e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:22.257076 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3222/6444] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:22.258314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92cd5e-28f9-4e53-bce5-52b4ab2e7a7a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:22.276160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e92cd5e-28f9-4e53-bce5-52b4ab2e7a7a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:22.282386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa445-019e-4a71-a6df-b84900ccb8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:22.283135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa445-019e-4a71-a6df-b84900ccb8c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:22.283479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa445-019e-4a71-a6df-b84900ccb8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:22.284713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076fa445-019e-4a71-a6df-b84900ccb8c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:22.285451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fa445-019e-4a71-a6df-b84900ccb8c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:22.287937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076fa445-019e-4a71-a6df-b84900ccb8c1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:22.306452 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3223/6445] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:22.311009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89eb4455-11ad-4ea2-b05c-4578c596b12d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:22.311407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa445-019e-4a71-a6df-b84900ccb8c1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:22.311624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4455-11ad-4ea2-b05c-4578c596b12d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:22.311931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4455-11ad-4ea2-b05c-4578c596b12d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:22.312204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89eb4455-11ad-4ea2-b05c-4578c596b12d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:22.323286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb4455-11ad-4ea2-b05c-4578c596b12d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:22.324732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89eb4455-11ad-4ea2-b05c-4578c596b12d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:22.327738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076fa445-019e-4a71-a6df-b84900ccb8c1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:22.334289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf0e4-6cde-43c1-becb-481f6b375f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:22.335919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf0e4-6cde-43c1-becb-481f6b375f44 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:22.336422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf0e4-6cde-43c1-becb-481f6b375f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:22.336801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073bf0e4-6cde-43c1-becb-481f6b375f44 admin admin] PATH_INFO: `/v3/projects/22313200df7646d083d621b8b242221e/users/94643140f3524aa297da35caf026c070/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:22.337899 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3223/6446] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:22.364033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bf0e4-6cde-43c1-becb-481f6b375f44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22313200df7646d083d621b8b242221e, user_id=94643140f3524aa297da35caf026c070, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:22.369441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073bf0e4-6cde-43c1-becb-481f6b375f44 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:22.402207 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3224/6447] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:22 2022] PUT /identity/v3/projects/22313200df7646d083d621b8b242221e/users/94643140f3524aa297da35caf026c070/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:22.404058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5b574-7541-4763-9eda-9686c726a25d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:22.404461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5b574-7541-4763-9eda-9686c726a25d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:22.404860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5b574-7541-4763-9eda-9686c726a25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:22.451578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7be5b574-7541-4763-9eda-9686c726a25d None None] MFA Rules not processed for user `94643140f3524aa297da35caf026c070`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:22.453687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7be5b574-7541-4763-9eda-9686c726a25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:22.493628 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:22.552887 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3224/6448] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:22.566167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf0e4-6cde-43c1-becb-481f6b375f44 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:22.568466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-073bf0e4-6cde-43c1-becb-481f6b375f44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:22.668308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073bf0e4-6cde-43c1-becb-481f6b375f44 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:22.675630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acffd44-ac65-4b74-8f5e-0f4833cd80e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:22.676547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acffd44-ac65-4b74-8f5e-0f4833cd80e0 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:22.676882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acffd44-ac65-4b74-8f5e-0f4833cd80e0 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:22.677170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acffd44-ac65-4b74-8f5e-0f4833cd80e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:22.691080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acffd44-ac65-4b74-8f5e-0f4833cd80e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:22.692601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acffd44-ac65-4b74-8f5e-0f4833cd80e0 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:22.707603 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3225/6449] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:23.151139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5b574-7541-4763-9eda-9686c726a25d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:23.152630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7be5b574-7541-4763-9eda-9686c726a25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:23.268018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5b574-7541-4763-9eda-9686c726a25d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:23.273830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:23.274578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:23.274956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:23.275564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] PATH_INFO: `/v3/projects/11579a796efd463587d00881e479333f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:23.277772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11579a796efd463587d00881e479333f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:23.280371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:23.374275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11579a796efd463587d00881e479333f', 'request_id': 'req-656356dd-83ab-4c37-8ed5-4488bd86f479'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:23.386305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11579a796efd463587d00881e479333f', 'request_id': 'req-656356dd-83ab-4c37-8ed5-4488bd86f479'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:23.400478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11579a796efd463587d00881e479333f', 'request_id': 'req-656356dd-83ab-4c37-8ed5-4488bd86f479'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:23.416419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] The token cache is being invalidate because project 11579a796efd463587d00881e479333f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:23.416848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:23.418164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-656356dd-83ab-4c37-8ed5-4488bd86f479 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:23.420775 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3225/6450] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:23 2022] DELETE /identity/v3/projects/11579a796efd463587d00881e479333f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:23.425901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f354f7-2652-4141-a2d1-fded933e229a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:23.426194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f354f7-2652-4141-a2d1-fded933e229a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:23.426532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f354f7-2652-4141-a2d1-fded933e229a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:23.436147 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:23.458892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-63f354f7-2652-4141-a2d1-fded933e229a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:23.470983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-63f354f7-2652-4141-a2d1-fded933e229a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:23.582825 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3226/6451] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:23.592193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162f2d-bac4-474f-88cf-4b86eaa4c943 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:23.592466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162f2d-bac4-474f-88cf-4b86eaa4c943 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:23.592742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44162f2d-bac4-474f-88cf-4b86eaa4c943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:23.617906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-44162f2d-bac4-474f-88cf-4b86eaa4c943 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:23.620640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-44162f2d-bac4-474f-88cf-4b86eaa4c943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:23.633243 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3226/6452] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:23.636561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f354f7-2652-4141-a2d1-fded933e229a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:23.652778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f354f7-2652-4141-a2d1-fded933e229a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:23.662347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882606-d60d-4cf8-81db-74b8dea4fec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:23.662347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882606-d60d-4cf8-81db-74b8dea4fec0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:23.662347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882606-d60d-4cf8-81db-74b8dea4fec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:23.662837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71882606-d60d-4cf8-81db-74b8dea4fec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:23.663343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71882606-d60d-4cf8-81db-74b8dea4fec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:23.663631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71882606-d60d-4cf8-81db-74b8dea4fec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:23.665640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71882606-d60d-4cf8-81db-74b8dea4fec0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:23.693159 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3227/6453] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:23.697696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44162f2d-bac4-474f-88cf-4b86eaa4c943 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:23.714683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44162f2d-bac4-474f-88cf-4b86eaa4c943 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:23.722900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4efba-351e-4434-8e05-d492abd0b194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:23.723756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4efba-351e-4434-8e05-d492abd0b194 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:23.724462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4efba-351e-4434-8e05-d492abd0b194 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:23.725369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a4efba-351e-4434-8e05-d492abd0b194 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:23.726372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4efba-351e-4434-8e05-d492abd0b194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:23.729534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a4efba-351e-4434-8e05-d492abd0b194 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:23.767935 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3227/6454] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:23 2022] POST /identity/v3/projects => generated 389 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:23.769075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882606-d60d-4cf8-81db-74b8dea4fec0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:23.781616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71882606-d60d-4cf8-81db-74b8dea4fec0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:23.803856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4efba-351e-4434-8e05-d492abd0b194 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:23.806041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42a4efba-351e-4434-8e05-d492abd0b194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:23.843979 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:23.850909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02a71a-2a65-4efd-bf77-1a5ff8b05a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:23.851516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02a71a-2a65-4efd-bf77-1a5ff8b05a20 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:23.851797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02a71a-2a65-4efd-bf77-1a5ff8b05a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:23.852202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b02a71a-2a65-4efd-bf77-1a5ff8b05a20 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:23.852837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02a71a-2a65-4efd-bf77-1a5ff8b05a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:23.855475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b02a71a-2a65-4efd-bf77-1a5ff8b05a20 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:23.884306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a4efba-351e-4434-8e05-d492abd0b194 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:23.889369 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3228/6455] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:23 2022] POST /identity/v3/users => generated 295 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:23.890953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02a71a-2a65-4efd-bf77-1a5ff8b05a20 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:23.893533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:23.894284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:23.894633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:23.894992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] PATH_INFO: `/v3/users/94643140f3524aa297da35caf026c070` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:23.896284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] RBAC: Authorizing `identity:delete_user(user_id=94643140f3524aa297da35caf026c070)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:23.899228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:23.909010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b02a71a-2a65-4efd-bf77-1a5ff8b05a20 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:23.923485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cc952-b899-4a83-b829-d7e57cfafa2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:23.924109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cc952-b899-4a83-b829-d7e57cfafa2f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:23.924394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cc952-b899-4a83-b829-d7e57cfafa2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:23.924673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41cc952-b899-4a83-b829-d7e57cfafa2f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:23.925344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cc952-b899-4a83-b829-d7e57cfafa2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:23.926987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41cc952-b899-4a83-b829-d7e57cfafa2f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:23.941848 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3229/6456] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:23.946462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cc952-b899-4a83-b829-d7e57cfafa2f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:23.957672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41cc952-b899-4a83-b829-d7e57cfafa2f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:23.962448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f70b2b-2a9e-475c-a10b-85d26d8a8a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:23.963050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f70b2b-2a9e-475c-a10b-85d26d8a8a3a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:23.963328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f70b2b-2a9e-475c-a10b-85d26d8a8a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:23.964505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f70b2b-2a9e-475c-a10b-85d26d8a8a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:23.964505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f70b2b-2a9e-475c-a10b-85d26d8a8a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:23.965875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f70b2b-2a9e-475c-a10b-85d26d8a8a3a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:23.970411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94643140f3524aa297da35caf026c070'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:23.979825 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3230/6457] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:23.980892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f70b2b-2a9e-475c-a10b-85d26d8a8a3a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:23.989412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94643140f3524aa297da35caf026c070'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:23.990207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94643140f3524aa297da35caf026c070'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:23.991273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f70b2b-2a9e-475c-a10b-85d26d8a8a3a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:23.998782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b787f1e3-192c-422c-aafb-50281fedd17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:23.999981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787f1e3-192c-422c-aafb-50281fedd17a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:24.000479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94643140f3524aa297da35caf026c070'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:24.001756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787f1e3-192c-422c-aafb-50281fedd17a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:24.002039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b787f1e3-192c-422c-aafb-50281fedd17a admin admin] PATH_INFO: `/v3/projects/4e3c6f9c68f247f6b17b9f3052adbab3/users/80d02eb476574560ae3a9d4d44aee129/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:24.011190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f620ec4e-557d-444f-8829-65d0059f832d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94643140f3524aa297da35caf026c070'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:24.019414 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3228/6458] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:23 2022] DELETE /identity/v3/users/94643140f3524aa297da35caf026c070 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:24.024083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544223-545d-466c-8926-6385dde3957a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:24.024374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544223-545d-466c-8926-6385dde3957a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:24.024655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544223-545d-466c-8926-6385dde3957a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:24.026756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787f1e3-192c-422c-aafb-50281fedd17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3c6f9c68f247f6b17b9f3052adbab3, user_id=80d02eb476574560ae3a9d4d44aee129, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:24.029632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b787f1e3-192c-422c-aafb-50281fedd17a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:24.044784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9c544223-545d-466c-8926-6385dde3957a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:24.046026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c544223-545d-466c-8926-6385dde3957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:24.046816 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3231/6459] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:23 2022] PUT /identity/v3/projects/4e3c6f9c68f247f6b17b9f3052adbab3/users/80d02eb476574560ae3a9d4d44aee129/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:24.058876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7fbc8-8af1-4e2d-a48c-37f2e2a184af None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:24.059269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7fbc8-8af1-4e2d-a48c-37f2e2a184af None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:24.059650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b7fbc8-8af1-4e2d-a48c-37f2e2a184af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:24.093745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-44b7fbc8-8af1-4e2d-a48c-37f2e2a184af None None] MFA Rules not processed for user `80d02eb476574560ae3a9d4d44aee129`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:24.095309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-44b7fbc8-8af1-4e2d-a48c-37f2e2a184af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:24.122645 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:24.129527 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3229/6460] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:24.140894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544223-545d-466c-8926-6385dde3957a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:24.143027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c544223-545d-466c-8926-6385dde3957a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:24.205485 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3232/6461] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:24 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:24.216974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544223-545d-466c-8926-6385dde3957a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:24.219159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7fbc8-8af1-4e2d-a48c-37f2e2a184af None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:24.219494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149003f-8d79-4a3f-8d53-0c9551e87466 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:24.220225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149003f-8d79-4a3f-8d53-0c9551e87466 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:24.220507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149003f-8d79-4a3f-8d53-0c9551e87466 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:24.220784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149003f-8d79-4a3f-8d53-0c9551e87466 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:24.232178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b7fbc8-8af1-4e2d-a48c-37f2e2a184af None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:24.234181 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:24.237159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149003f-8d79-4a3f-8d53-0c9551e87466 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:24.237347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d444f6-26ba-4ae8-80d0-bdfe28376eb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:24.237896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d444f6-26ba-4ae8-80d0-bdfe28376eb7 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:24.238507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d444f6-26ba-4ae8-80d0-bdfe28376eb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:24.238797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d444f6-26ba-4ae8-80d0-bdfe28376eb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:24.239237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149003f-8d79-4a3f-8d53-0c9551e87466 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:24.249933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d444f6-26ba-4ae8-80d0-bdfe28376eb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:24.251534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d444f6-26ba-4ae8-80d0-bdfe28376eb7 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:24.253633 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3230/6462] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:24.262017 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3233/6463] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:24 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:21:24.854382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149003f-8d79-4a3f-8d53-0c9551e87466 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:24.862205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3149003f-8d79-4a3f-8d53-0c9551e87466 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:24.889615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149003f-8d79-4a3f-8d53-0c9551e87466 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:24.903442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:24.906058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:24.906455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:24.908548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] PATH_INFO: `/v3/projects/22313200df7646d083d621b8b242221e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:24.911300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22313200df7646d083d621b8b242221e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:24.917121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:25.001053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22313200df7646d083d621b8b242221e', 'request_id': 'req-a9672037-2be3-4790-9d98-9bec92e87cb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:25.013382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22313200df7646d083d621b8b242221e', 'request_id': 'req-a9672037-2be3-4790-9d98-9bec92e87cb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:25.022479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22313200df7646d083d621b8b242221e', 'request_id': 'req-a9672037-2be3-4790-9d98-9bec92e87cb6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:25.056155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] The token cache is being invalidate because project 22313200df7646d083d621b8b242221e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:25.056752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:25.057819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a9672037-2be3-4790-9d98-9bec92e87cb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:25.060159 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3231/6464] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:24 2022] DELETE /identity/v3/projects/22313200df7646d083d621b8b242221e => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:25.065094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d49d-f111-48cd-848d-5e0d33584421 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:25.065659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d49d-f111-48cd-848d-5e0d33584421 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:25.065902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5d49d-f111-48cd-848d-5e0d33584421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:25.088160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-98c5d49d-f111-48cd-848d-5e0d33584421 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:25.089544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-98c5d49d-f111-48cd-848d-5e0d33584421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:25.176519 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3234/6465] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:25.185891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e673-0658-448f-a6fc-d23461247c12 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:25.186189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e673-0658-448f-a6fc-d23461247c12 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:25.186474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd4e673-0658-448f-a6fc-d23461247c12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:25.243152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bcd4e673-0658-448f-a6fc-d23461247c12 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:25.246359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bcd4e673-0658-448f-a6fc-d23461247c12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:25.260797 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3232/6466] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:25.265602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d49d-f111-48cd-848d-5e0d33584421 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:25.277345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5d49d-f111-48cd-848d-5e0d33584421 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:25.302877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb7ff-ed0c-4d80-8650-c84db2fa86b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:25.303684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb7ff-ed0c-4d80-8650-c84db2fa86b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:25.304077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb7ff-ed0c-4d80-8650-c84db2fa86b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:25.304457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fdb7ff-ed0c-4d80-8650-c84db2fa86b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:25.305219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdb7ff-ed0c-4d80-8650-c84db2fa86b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:25.305647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdb7ff-ed0c-4d80-8650-c84db2fa86b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:25.312783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9fdb7ff-ed0c-4d80-8650-c84db2fa86b7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:25.339155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e673-0658-448f-a6fc-d23461247c12 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:25.345213 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3235/6467] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:25.349666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd4e673-0658-448f-a6fc-d23461247c12 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:25.356075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf07ae-214a-4ae2-88d8-9ec039ddeecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:25.356817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf07ae-214a-4ae2-88d8-9ec039ddeecc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:25.357198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf07ae-214a-4ae2-88d8-9ec039ddeecc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:25.357606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcf07ae-214a-4ae2-88d8-9ec039ddeecc admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:25.358342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf07ae-214a-4ae2-88d8-9ec039ddeecc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:25.360346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcf07ae-214a-4ae2-88d8-9ec039ddeecc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:25.396887 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3233/6468] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:25 2022] POST /identity/v3/projects => generated 411 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:25.400744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb7ff-ed0c-4d80-8650-c84db2fa86b7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:25.417889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9fdb7ff-ed0c-4d80-8650-c84db2fa86b7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:25.503449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b39f1-47a6-496d-ab81-6c4ec24f3cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:25.504065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b39f1-47a6-496d-ab81-6c4ec24f3cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:25.504348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b39f1-47a6-496d-ab81-6c4ec24f3cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:25.504622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b39f1-47a6-496d-ab81-6c4ec24f3cf1 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:25.505277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b39f1-47a6-496d-ab81-6c4ec24f3cf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:25.508886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b39f1-47a6-496d-ab81-6c4ec24f3cf1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:25.537571 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3236/6469] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:25 2022] POST /identity/v3/users => generated 306 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:25.538937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf07ae-214a-4ae2-88d8-9ec039ddeecc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:25.551220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcf07ae-214a-4ae2-88d8-9ec039ddeecc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:25.556662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d543e2e-22f5-4a78-944b-9548b447013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:25.557274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543e2e-22f5-4a78-944b-9548b447013a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:25.557596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543e2e-22f5-4a78-944b-9548b447013a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:25.557873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d543e2e-22f5-4a78-944b-9548b447013a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:25.558516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d543e2e-22f5-4a78-944b-9548b447013a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:25.560129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d543e2e-22f5-4a78-944b-9548b447013a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:25.572247 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3234/6470] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:25.577895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b39f1-47a6-496d-ab81-6c4ec24f3cf1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:25.592273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b39f1-47a6-496d-ab81-6c4ec24f3cf1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:25.599013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82933b-c729-4df1-8a9a-29e36367ca2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:25.600772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82933b-c729-4df1-8a9a-29e36367ca2c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:25.601254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82933b-c729-4df1-8a9a-29e36367ca2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:25.601773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82933b-c729-4df1-8a9a-29e36367ca2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:25.602778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82933b-c729-4df1-8a9a-29e36367ca2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:25.605210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82933b-c729-4df1-8a9a-29e36367ca2c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:25.622316 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3237/6471] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:25 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:25.626266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d543e2e-22f5-4a78-944b-9548b447013a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:25.641082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d543e2e-22f5-4a78-944b-9548b447013a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:25.647809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5540b-46aa-47d3-a16d-ec3d7029e952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:25.649003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5540b-46aa-47d3-a16d-ec3d7029e952 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:25.649604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5540b-46aa-47d3-a16d-ec3d7029e952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:25.650061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5540b-46aa-47d3-a16d-ec3d7029e952 admin admin] PATH_INFO: `/v3/projects/f79d86556cf348aca2b4e18551742375/users/539fb65b343a4c3a98a3ad069b0e783f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:25.672825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5540b-46aa-47d3-a16d-ec3d7029e952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f79d86556cf348aca2b4e18551742375, user_id=539fb65b343a4c3a98a3ad069b0e783f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:25.675937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5540b-46aa-47d3-a16d-ec3d7029e952 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:25.693356 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3235/6472] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:25 2022] PUT /identity/v3/projects/f79d86556cf348aca2b4e18551742375/users/539fb65b343a4c3a98a3ad069b0e783f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:25.705193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45429824-3d13-4bc3-a6f8-98925fc10a76 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:25.705888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45429824-3d13-4bc3-a6f8-98925fc10a76 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:25.706383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45429824-3d13-4bc3-a6f8-98925fc10a76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:25.748838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-45429824-3d13-4bc3-a6f8-98925fc10a76 None None] MFA Rules not processed for user `539fb65b343a4c3a98a3ad069b0e783f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:25.750518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-45429824-3d13-4bc3-a6f8-98925fc10a76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:25.757434 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:25.861384 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3238/6473] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:25 2022] POST /identity/v3/auth/tokens => generated 3288 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:25.863093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5540b-46aa-47d3-a16d-ec3d7029e952 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:25.989678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5540b-46aa-47d3-a16d-ec3d7029e952 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:26.004669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b7890-257e-4ce9-bbc6-2daed0711e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:26.005437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b7890-257e-4ce9-bbc6-2daed0711e5a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:26.005712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b7890-257e-4ce9-bbc6-2daed0711e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:26.006480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5b7890-257e-4ce9-bbc6-2daed0711e5a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:26.007412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b7890-257e-4ce9-bbc6-2daed0711e5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:26.011083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5b7890-257e-4ce9-bbc6-2daed0711e5a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:26.065177 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:26.077663 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3236/6474] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:25 2022] POST /identity/v3/projects => generated 411 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:26.082342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45429824-3d13-4bc3-a6f8-98925fc10a76 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:26.133882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45429824-3d13-4bc3-a6f8-98925fc10a76 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:26.262840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bfeb3-f222-4135-a52e-bf7d5b59e392 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:26.263541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bfeb3-f222-4135-a52e-bf7d5b59e392 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:26.263732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bfeb3-f222-4135-a52e-bf7d5b59e392 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:26.264006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579bfeb3-f222-4135-a52e-bf7d5b59e392 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:26.264651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bfeb3-f222-4135-a52e-bf7d5b59e392 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:26.266620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579bfeb3-f222-4135-a52e-bf7d5b59e392 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:26.303169 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3239/6475] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:26 2022] POST /identity/v3/users => generated 312 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:26.309349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b7890-257e-4ce9-bbc6-2daed0711e5a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:26.324345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5b7890-257e-4ce9-bbc6-2daed0711e5a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:26.345357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29952f37-e779-4998-9be5-0026c80b2464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:26.345997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29952f37-e779-4998-9be5-0026c80b2464 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:26.346278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29952f37-e779-4998-9be5-0026c80b2464 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:26.346552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29952f37-e779-4998-9be5-0026c80b2464 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:26.347445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29952f37-e779-4998-9be5-0026c80b2464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:26.349128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29952f37-e779-4998-9be5-0026c80b2464 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:26.365206 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3237/6476] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:26.369356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bfeb3-f222-4135-a52e-bf7d5b59e392 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:26.381661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579bfeb3-f222-4135-a52e-bf7d5b59e392 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:26.388416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2b388-8b90-419b-9232-d4c95cea66c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:26.389816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2b388-8b90-419b-9232-d4c95cea66c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:26.390356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2b388-8b90-419b-9232-d4c95cea66c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:26.390719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2b388-8b90-419b-9232-d4c95cea66c8 admin admin] PATH_INFO: `/v3/projects/e3769a6c4df74274b100a3a633733333/users/53fa974c5d364a9e98af446948d49352/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:26.414171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2b388-8b90-419b-9232-d4c95cea66c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3769a6c4df74274b100a3a633733333, user_id=53fa974c5d364a9e98af446948d49352, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:26.417421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2b388-8b90-419b-9232-d4c95cea66c8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:26.436399 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3240/6477] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:26 2022] PUT /identity/v3/projects/e3769a6c4df74274b100a3a633733333/users/53fa974c5d364a9e98af446948d49352/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:21:26.440518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29952f37-e779-4998-9be5-0026c80b2464 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:26.455546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29952f37-e779-4998-9be5-0026c80b2464 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:26.565075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc61a9f-12bd-47ef-a6b8-05411b455487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:26.566545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61a9f-12bd-47ef-a6b8-05411b455487 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:26.566698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61a9f-12bd-47ef-a6b8-05411b455487 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:26.566994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc61a9f-12bd-47ef-a6b8-05411b455487 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:26.567744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc61a9f-12bd-47ef-a6b8-05411b455487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:26.570134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc61a9f-12bd-47ef-a6b8-05411b455487 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:26.584050 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3238/6478] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:26 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:26.588008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2b388-8b90-419b-9232-d4c95cea66c8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:26.603854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2b388-8b90-419b-9232-d4c95cea66c8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:26.616468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5f1b5-1c53-4b2d-805f-68cc1cab9ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:26.617143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f1b5-1c53-4b2d-805f-68cc1cab9ec5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:26.619485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f1b5-1c53-4b2d-805f-68cc1cab9ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:26.619847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f1b5-1c53-4b2d-805f-68cc1cab9ec5 admin admin] PATH_INFO: `/v3/projects/e3769a6c4df74274b100a3a633733333/users/53fa974c5d364a9e98af446948d49352/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:26.624734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5f1b5-1c53-4b2d-805f-68cc1cab9ec5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3769a6c4df74274b100a3a633733333, user_id=53fa974c5d364a9e98af446948d49352, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:26.630907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5f1b5-1c53-4b2d-805f-68cc1cab9ec5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:26.646404 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3241/6479] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:26 2022] PUT /identity/v3/projects/e3769a6c4df74274b100a3a633733333/users/53fa974c5d364a9e98af446948d49352/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:26.656736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46efe5-4859-46a6-a787-a9704ae9173c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:26.657050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46efe5-4859-46a6-a787-a9704ae9173c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:26.657333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b46efe5-4859-46a6-a787-a9704ae9173c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:26.690753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7b46efe5-4859-46a6-a787-a9704ae9173c None None] MFA Rules not processed for user `53fa974c5d364a9e98af446948d49352`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:26.692004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b46efe5-4859-46a6-a787-a9704ae9173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:26.772999 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3239/6480] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:26 2022] POST /identity/v3/auth/tokens => generated 3355 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:26.801714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5f1b5-1c53-4b2d-805f-68cc1cab9ec5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:26.804095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1dd5f1b5-1c53-4b2d-805f-68cc1cab9ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:26.884327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46efe5-4859-46a6-a787-a9704ae9173c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:26.890120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b46efe5-4859-46a6-a787-a9704ae9173c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:26.932315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5f1b5-1c53-4b2d-805f-68cc1cab9ec5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:26.950364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d9056-a17e-4b79-b1a7-09a379e42061 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:26.952854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d9056-a17e-4b79-b1a7-09a379e42061 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:26.953713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d9056-a17e-4b79-b1a7-09a379e42061 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:26.953713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073d9056-a17e-4b79-b1a7-09a379e42061 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:26.974297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d9056-a17e-4b79-b1a7-09a379e42061 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:26.986253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073d9056-a17e-4b79-b1a7-09a379e42061 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:27.001363 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:27.013926 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3242/6481] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:26 2022] GET /identity/v3/auth/tokens => generated 3355 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:27.026295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b46efe5-4859-46a6-a787-a9704ae9173c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:27.030723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:27.031701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:27.032146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:27.032576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:27.035330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:27.050711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:27.052677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:27.068221 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3240/6482] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:21:27.511699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d9056-a17e-4b79-b1a7-09a379e42061 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:27.513761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-073d9056-a17e-4b79-b1a7-09a379e42061 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:27.590801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073d9056-a17e-4b79-b1a7-09a379e42061 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:27.595197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f34a-d2e4-4617-b94f-3ade5afbe47a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:27.595985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f34a-d2e4-4617-b94f-3ade5afbe47a service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:27.596176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f34a-d2e4-4617-b94f-3ade5afbe47a service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:27.599218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105f34a-d2e4-4617-b94f-3ade5afbe47a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:27.602009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f105f34a-d2e4-4617-b94f-3ade5afbe47a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:27.706660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105f34a-d2e4-4617-b94f-3ade5afbe47a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:27.708450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105f34a-d2e4-4617-b94f-3ade5afbe47a service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:27.720620 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3243/6483] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:27 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:28.972718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:28.975031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:29.005083 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:29.274791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fd487f-5c92-4ee9-bf33-70c699c5a436 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:29.289198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acdd09-01fc-453e-9658-58c173579e9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:29.290020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acdd09-01fc-453e-9658-58c173579e9f service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:29.290382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acdd09-01fc-453e-9658-58c173579e9f service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:29.290728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04acdd09-01fc-453e-9658-58c173579e9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:29.294146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-04acdd09-01fc-453e-9658-58c173579e9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:29.320246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acdd09-01fc-453e-9658-58c173579e9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:29.326959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04acdd09-01fc-453e-9658-58c173579e9f service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:29.358008 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3241/6484] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:29.878905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f34a-d2e4-4617-b94f-3ade5afbe47a service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:29.895478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105f34a-d2e4-4617-b94f-3ade5afbe47a service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:29.900241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e6357-17e3-44c2-b525-d9a54e99eaf8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:29.900872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e6357-17e3-44c2-b525-d9a54e99eaf8 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:29.901155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e6357-17e3-44c2-b525-d9a54e99eaf8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:29.901469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83e6357-17e3-44c2-b525-d9a54e99eaf8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:29.903276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d83e6357-17e3-44c2-b525-d9a54e99eaf8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:29.915869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e6357-17e3-44c2-b525-d9a54e99eaf8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:29.917671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83e6357-17e3-44c2-b525-d9a54e99eaf8 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:29.931411 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3244/6485] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:30.194670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acdd09-01fc-453e-9658-58c173579e9f service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:30.234947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04acdd09-01fc-453e-9658-58c173579e9f service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:30.272491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d350-48a6-4c77-bcb9-3bba4e66df8f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:30.276516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d350-48a6-4c77-bcb9-3bba4e66df8f service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:30.277060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d350-48a6-4c77-bcb9-3bba4e66df8f service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:30.277785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e022d350-48a6-4c77-bcb9-3bba4e66df8f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:30.284113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e022d350-48a6-4c77-bcb9-3bba4e66df8f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:30.304842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022d350-48a6-4c77-bcb9-3bba4e66df8f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:30.306859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e022d350-48a6-4c77-bcb9-3bba4e66df8f service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:30.322010 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3242/6486] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:30.721356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e6357-17e3-44c2-b525-d9a54e99eaf8 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:30.751726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83e6357-17e3-44c2-b525-d9a54e99eaf8 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:30.766147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd695b-fdbf-4ec0-b051-523dc85ba649 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:30.768324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd695b-fdbf-4ec0-b051-523dc85ba649 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:30.768650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd695b-fdbf-4ec0-b051-523dc85ba649 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:30.769017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd695b-fdbf-4ec0-b051-523dc85ba649 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:30.773420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6edd695b-fdbf-4ec0-b051-523dc85ba649 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:30.799801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd695b-fdbf-4ec0-b051-523dc85ba649 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:30.805951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd695b-fdbf-4ec0-b051-523dc85ba649 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:30.842324 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3245/6487] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:32.656618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d350-48a6-4c77-bcb9-3bba4e66df8f service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:32.842839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e022d350-48a6-4c77-bcb9-3bba4e66df8f service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:32.852396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:32.853685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:32.854072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:32.854448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] PATH_INFO: `/v3/users/539fb65b343a4c3a98a3ad069b0e783f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:32.856520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=539fb65b343a4c3a98a3ad069b0e783f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:32.859623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:32.983231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539fb65b343a4c3a98a3ad069b0e783f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:33.004638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539fb65b343a4c3a98a3ad069b0e783f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:33.006881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539fb65b343a4c3a98a3ad069b0e783f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:33.036416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539fb65b343a4c3a98a3ad069b0e783f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:33.047943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539fb65b343a4c3a98a3ad069b0e783f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:33.053795 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:33.062669 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3243/6488] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:32 2022] DELETE /identity/v3/users/539fb65b343a4c3a98a3ad069b0e783f => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:33.067300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c87ab9-3e6f-4246-bb31-60ae4dd233b4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:33.067762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c87ab9-3e6f-4246-bb31-60ae4dd233b4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:33.068362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c87ab9-3e6f-4246-bb31-60ae4dd233b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:33.128189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-69c87ab9-3e6f-4246-bb31-60ae4dd233b4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:33.137653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-69c87ab9-3e6f-4246-bb31-60ae4dd233b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:33.294009 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3246/6489] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:33.320593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:33.323550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:33.493507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7914d8-256a-46cd-a602-66ae6c4f70dc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:33.498877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26e3ec-3b32-4e17-9259-68d3ebcf56fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:33.499581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26e3ec-3b32-4e17-9259-68d3ebcf56fd service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:33.499866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26e3ec-3b32-4e17-9259-68d3ebcf56fd service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:33.500143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf26e3ec-3b32-4e17-9259-68d3ebcf56fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:33.512712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26e3ec-3b32-4e17-9259-68d3ebcf56fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:33.514213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf26e3ec-3b32-4e17-9259-68d3ebcf56fd service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:33.539095 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3244/6490] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:34.855345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c87ab9-3e6f-4246-bb31-60ae4dd233b4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:34.856806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-69c87ab9-3e6f-4246-bb31-60ae4dd233b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:34.909693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c87ab9-3e6f-4246-bb31-60ae4dd233b4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:34.920971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:34.921599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:34.921880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:34.922163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] PATH_INFO: `/v3/projects/f79d86556cf348aca2b4e18551742375` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:34.930285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f79d86556cf348aca2b4e18551742375)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:34.932218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:35.006910 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:35.090440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f79d86556cf348aca2b4e18551742375', 'request_id': 'req-8dc62c60-4fd1-47e7-b828-5329fc4b2159'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.114017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f79d86556cf348aca2b4e18551742375', 'request_id': 'req-8dc62c60-4fd1-47e7-b828-5329fc4b2159'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.139018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f79d86556cf348aca2b4e18551742375', 'request_id': 'req-8dc62c60-4fd1-47e7-b828-5329fc4b2159'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.165884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] The token cache is being invalidate because project f79d86556cf348aca2b4e18551742375 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:35.166175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.169814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.181866 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3247/6491] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:34 2022] DELETE /identity/v3/projects/f79d86556cf348aca2b4e18551742375 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:35.182053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26e3ec-3b32-4e17-9259-68d3ebcf56fd service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:35.193873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf26e3ec-3b32-4e17-9259-68d3ebcf56fd service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:35.392116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:35.395568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:35.399635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:35.399946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] PATH_INFO: `/v3/users/53fa974c5d364a9e98af446948d49352` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:35.403013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53fa974c5d364a9e98af446948d49352)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:35.404996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:35.583738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53fa974c5d364a9e98af446948d49352'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.656472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53fa974c5d364a9e98af446948d49352'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.659238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53fa974c5d364a9e98af446948d49352'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.694325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53fa974c5d364a9e98af446948d49352'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.734045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c131c81d-56bd-484d-bf35-140cb7ae5e99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53fa974c5d364a9e98af446948d49352'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:35.757804 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3245/6492] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:35 2022] DELETE /identity/v3/users/53fa974c5d364a9e98af446948d49352 => generated 0 bytes in 578 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:36.612825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:36.612825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:36.655669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc62c60-4fd1-47e7-b828-5329fc4b2159 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:36.799936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:36.800902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:36.801652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:36.802100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] PATH_INFO: `/v3/projects/e3769a6c4df74274b100a3a633733333` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:36.803995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3769a6c4df74274b100a3a633733333)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:36.806118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:36.875925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3769a6c4df74274b100a3a633733333', 'request_id': 'req-2be60b6d-9ce3-4be3-81bd-bdae85f58415'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:36.886057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3769a6c4df74274b100a3a633733333', 'request_id': 'req-2be60b6d-9ce3-4be3-81bd-bdae85f58415'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:36.899019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3769a6c4df74274b100a3a633733333', 'request_id': 'req-2be60b6d-9ce3-4be3-81bd-bdae85f58415'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:36.917270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] The token cache is being invalidate because project e3769a6c4df74274b100a3a633733333 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:36.917836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:36.919329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2be60b6d-9ce3-4be3-81bd-bdae85f58415 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:36.922839 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3248/6493] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:36 2022] DELETE /identity/v3/projects/e3769a6c4df74274b100a3a633733333 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:36.927515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282dc8-b955-4443-9bc7-27fc25ecce4c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:36.928580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282dc8-b955-4443-9bc7-27fc25ecce4c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:36.928818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282dc8-b955-4443-9bc7-27fc25ecce4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:36.977144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ca282dc8-b955-4443-9bc7-27fc25ecce4c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:36.978626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ca282dc8-b955-4443-9bc7-27fc25ecce4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:37.018963 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:37.143301 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3246/6494] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:37.150772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849799-2d32-496d-8ff8-fe2478e06cbd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:37.151295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849799-2d32-496d-8ff8-fe2478e06cbd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:37.151573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1849799-2d32-496d-8ff8-fe2478e06cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:37.188571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b1849799-2d32-496d-8ff8-fe2478e06cbd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:37.190144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b1849799-2d32-496d-8ff8-fe2478e06cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:37.220497 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3249/6495] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:37.224951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282dc8-b955-4443-9bc7-27fc25ecce4c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:37.241437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282dc8-b955-4443-9bc7-27fc25ecce4c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:37.251696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61e12e-3063-4ee2-95d0-e4629ac472bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:37.252325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e12e-3063-4ee2-95d0-e4629ac472bb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:37.252608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e12e-3063-4ee2-95d0-e4629ac472bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:37.252897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a61e12e-3063-4ee2-95d0-e4629ac472bb admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:37.253712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61e12e-3063-4ee2-95d0-e4629ac472bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:37.253875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61e12e-3063-4ee2-95d0-e4629ac472bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:37.255533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a61e12e-3063-4ee2-95d0-e4629ac472bb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:37.297406 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3247/6496] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:37.301808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1849799-2d32-496d-8ff8-fe2478e06cbd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:37.321093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1849799-2d32-496d-8ff8-fe2478e06cbd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:37.331218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56ef79-12ee-4036-93b6-5f60fe954698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:37.332480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56ef79-12ee-4036-93b6-5f60fe954698 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:37.333110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56ef79-12ee-4036-93b6-5f60fe954698 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:37.333759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de56ef79-12ee-4036-93b6-5f60fe954698 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:37.335673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56ef79-12ee-4036-93b6-5f60fe954698 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:37.340624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de56ef79-12ee-4036-93b6-5f60fe954698 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:37.394293 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:37.410586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61e12e-3063-4ee2-95d0-e4629ac472bb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:37.419858 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3250/6497] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:37 2022] POST /identity/v3/projects => generated 397 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:37.426320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a61e12e-3063-4ee2-95d0-e4629ac472bb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:37.573398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e466-2942-4524-ab75-6dbe449a8a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:37.574188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e466-2942-4524-ab75-6dbe449a8a30 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:37.575203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e466-2942-4524-ab75-6dbe449a8a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:37.576176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4e466-2942-4524-ab75-6dbe449a8a30 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:37.577150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e466-2942-4524-ab75-6dbe449a8a30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:37.584526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4e466-2942-4524-ab75-6dbe449a8a30 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:37.618878 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3248/6498] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:37 2022] POST /identity/v3/users => generated 299 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:37.623786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56ef79-12ee-4036-93b6-5f60fe954698 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:37.644413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de56ef79-12ee-4036-93b6-5f60fe954698 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:37.657170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce36ae7-8613-4784-8c28-3cc416e25b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:37.658212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce36ae7-8613-4784-8c28-3cc416e25b3e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:37.658664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce36ae7-8613-4784-8c28-3cc416e25b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:37.659099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce36ae7-8613-4784-8c28-3cc416e25b3e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:37.660487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce36ae7-8613-4784-8c28-3cc416e25b3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:37.663487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce36ae7-8613-4784-8c28-3cc416e25b3e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:37.684539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e466-2942-4524-ab75-6dbe449a8a30 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:37.713285 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3251/6499] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:37.719288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4e466-2942-4524-ab75-6dbe449a8a30 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:37.743555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ca4f4-9712-4f87-aac8-4e0c8f7c342e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:37.744726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca4f4-9712-4f87-aac8-4e0c8f7c342e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:37.745183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca4f4-9712-4f87-aac8-4e0c8f7c342e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:37.745738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ca4f4-9712-4f87-aac8-4e0c8f7c342e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:37.746771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ca4f4-9712-4f87-aac8-4e0c8f7c342e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:37.749660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ca4f4-9712-4f87-aac8-4e0c8f7c342e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:37.770572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce36ae7-8613-4784-8c28-3cc416e25b3e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:37.778911 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3249/6500] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:37.793993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce36ae7-8613-4784-8c28-3cc416e25b3e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:37.805868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaaed6-319f-405e-9723-ab60b04d6450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:37.822757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaaed6-319f-405e-9723-ab60b04d6450 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:37.823075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaaed6-319f-405e-9723-ab60b04d6450 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:37.823364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcaaed6-319f-405e-9723-ab60b04d6450 admin admin] PATH_INFO: `/v3/projects/2412de64d0944bbcbc8455674ce705ff/users/7aa1e59762bf447f80fe5d5059b66c24/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:37.868339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaaed6-319f-405e-9723-ab60b04d6450 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2412de64d0944bbcbc8455674ce705ff, user_id=7aa1e59762bf447f80fe5d5059b66c24, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:37.871154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcaaed6-319f-405e-9723-ab60b04d6450 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:37.906249 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3252/6501] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:37 2022] PUT /identity/v3/projects/2412de64d0944bbcbc8455674ce705ff/users/7aa1e59762bf447f80fe5d5059b66c24/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:37.917419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ffef8-9585-4ca0-bab1-d897820794cb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:37.917719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ffef8-9585-4ca0-bab1-d897820794cb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:37.918000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ffef8-9585-4ca0-bab1-d897820794cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:37.968981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d32ffef8-9585-4ca0-bab1-d897820794cb None None] MFA Rules not processed for user `7aa1e59762bf447f80fe5d5059b66c24`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:37.970658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d32ffef8-9585-4ca0-bab1-d897820794cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:38.134165 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3250/6502] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:37 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:38.139906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaaed6-319f-405e-9723-ab60b04d6450 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:38.361074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcaaed6-319f-405e-9723-ab60b04d6450 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:38.379006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8366e-bc1a-4f35-a03f-53aa881fa567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:38.381444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8366e-bc1a-4f35-a03f-53aa881fa567 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:38.382859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8366e-bc1a-4f35-a03f-53aa881fa567 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:38.385034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8366e-bc1a-4f35-a03f-53aa881fa567 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:38.387109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8366e-bc1a-4f35-a03f-53aa881fa567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:38.390330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8366e-bc1a-4f35-a03f-53aa881fa567 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:38.483674 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3253/6503] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:38 2022] POST /identity/v3/projects => generated 399 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:38.487933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ffef8-9585-4ca0-bab1-d897820794cb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:38.511093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ffef8-9585-4ca0-bab1-d897820794cb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:38.543271 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:38.642694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a2ec0-4d1c-4189-8a9b-546e27ef3956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:38.647755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a2ec0-4d1c-4189-8a9b-546e27ef3956 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:38.648049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a2ec0-4d1c-4189-8a9b-546e27ef3956 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:38.648415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a2ec0-4d1c-4189-8a9b-546e27ef3956 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:38.649148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a2ec0-4d1c-4189-8a9b-546e27ef3956 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:38.651196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a2ec0-4d1c-4189-8a9b-546e27ef3956 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:38.703594 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3251/6504] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:38 2022] POST /identity/v3/users => generated 306 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:38.705854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8366e-bc1a-4f35-a03f-53aa881fa567 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:38.722072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8366e-bc1a-4f35-a03f-53aa881fa567 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:38.735054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb86ca6-dd1a-4488-81c8-6ceb29ede969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:38.735995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb86ca6-dd1a-4488-81c8-6ceb29ede969 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:38.736461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb86ca6-dd1a-4488-81c8-6ceb29ede969 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:38.736911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb86ca6-dd1a-4488-81c8-6ceb29ede969 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:38.737986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb86ca6-dd1a-4488-81c8-6ceb29ede969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:38.739800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb86ca6-dd1a-4488-81c8-6ceb29ede969 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:38.755887 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3254/6505] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:38.759978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a2ec0-4d1c-4189-8a9b-546e27ef3956 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:38.772213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a2ec0-4d1c-4189-8a9b-546e27ef3956 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:38.778819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cd78e-6a85-415b-b359-c9c77675f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:38.779520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd78e-6a85-415b-b359-c9c77675f7ba admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:38.779804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd78e-6a85-415b-b359-c9c77675f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:38.780087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737cd78e-6a85-415b-b359-c9c77675f7ba admin admin] PATH_INFO: `/v3/projects/a13c37ff731040e984856b3d0c002ba8/users/208a9d773a364c0cafcefc500e1d1dda/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:38.800307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cd78e-6a85-415b-b359-c9c77675f7ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13c37ff731040e984856b3d0c002ba8, user_id=208a9d773a364c0cafcefc500e1d1dda, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:38.804243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737cd78e-6a85-415b-b359-c9c77675f7ba admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:38.825319 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3252/6506] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:38 2022] PUT /identity/v3/projects/a13c37ff731040e984856b3d0c002ba8/users/208a9d773a364c0cafcefc500e1d1dda/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:38.829698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb86ca6-dd1a-4488-81c8-6ceb29ede969 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:38.845218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb86ca6-dd1a-4488-81c8-6ceb29ede969 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:39.054037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd11a9f0-9173-4c6f-8593-4053834f5711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:39.054682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11a9f0-9173-4c6f-8593-4053834f5711 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:39.054975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11a9f0-9173-4c6f-8593-4053834f5711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:39.055316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd11a9f0-9173-4c6f-8593-4053834f5711 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:39.056120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11a9f0-9173-4c6f-8593-4053834f5711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:39.061932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd11a9f0-9173-4c6f-8593-4053834f5711 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:39.094230 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3255/6507] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:39.107253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cd78e-6a85-415b-b359-c9c77675f7ba admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:39.125515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737cd78e-6a85-415b-b359-c9c77675f7ba admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:39.132818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c24e9e3-3c35-40c3-993b-a3f6fa4c8a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:39.134885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24e9e3-3c35-40c3-993b-a3f6fa4c8a42 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:39.135444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24e9e3-3c35-40c3-993b-a3f6fa4c8a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:39.136060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c24e9e3-3c35-40c3-993b-a3f6fa4c8a42 admin admin] PATH_INFO: `/v3/projects/a13c37ff731040e984856b3d0c002ba8/users/208a9d773a364c0cafcefc500e1d1dda/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:39.140896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24e9e3-3c35-40c3-993b-a3f6fa4c8a42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a13c37ff731040e984856b3d0c002ba8, user_id=208a9d773a364c0cafcefc500e1d1dda, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:39.147040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c24e9e3-3c35-40c3-993b-a3f6fa4c8a42 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:39.171584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed701eff-8d25-41e5-a08c-b72a0b702560 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:39.171877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed701eff-8d25-41e5-a08c-b72a0b702560 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:39.172142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed701eff-8d25-41e5-a08c-b72a0b702560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:39.193912 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3253/6508] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:39 2022] PUT /identity/v3/projects/a13c37ff731040e984856b3d0c002ba8/users/208a9d773a364c0cafcefc500e1d1dda/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:39.203957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94356923-dfc1-42b2-bde9-695502928398 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:39.204321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94356923-dfc1-42b2-bde9-695502928398 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:39.204779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94356923-dfc1-42b2-bde9-695502928398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:39.281193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-94356923-dfc1-42b2-bde9-695502928398 None None] MFA Rules not processed for user `208a9d773a364c0cafcefc500e1d1dda`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:39.283004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-94356923-dfc1-42b2-bde9-695502928398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:39.298720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ed701eff-8d25-41e5-a08c-b72a0b702560 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:39.300258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ed701eff-8d25-41e5-a08c-b72a0b702560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:39.321676 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:39.430953 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3254/6509] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:39 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:39.442006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94356923-dfc1-42b2-bde9-695502928398 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:39.444261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-94356923-dfc1-42b2-bde9-695502928398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:39.477851 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3256/6510] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:21:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:21:39.557881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed701eff-8d25-41e5-a08c-b72a0b702560 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:39.559039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ed701eff-8d25-41e5-a08c-b72a0b702560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:39.662566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94356923-dfc1-42b2-bde9-695502928398 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:39.671103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4203-e297-4c4d-9371-1e9067b2bc4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:39.671733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4203-e297-4c4d-9371-1e9067b2bc4e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:39.672017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4203-e297-4c4d-9371-1e9067b2bc4e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:39.672284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e4203-e297-4c4d-9371-1e9067b2bc4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:39.686441 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:39.808650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4203-e297-4c4d-9371-1e9067b2bc4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:39.817097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e4203-e297-4c4d-9371-1e9067b2bc4e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:39.836196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed701eff-8d25-41e5-a08c-b72a0b702560 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:39.855578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0f8d-1524-468c-88c9-0ee1e52e6f87 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:39.856507 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3255/6511] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:39 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:39.857494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0f8d-1524-468c-88c9-0ee1e52e6f87 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:39.857783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0f8d-1524-468c-88c9-0ee1e52e6f87 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:39.859168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d0f8d-1524-468c-88c9-0ee1e52e6f87 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:39.888588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d0f8d-1524-468c-88c9-0ee1e52e6f87 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:39.890863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813d0f8d-1524-468c-88c9-0ee1e52e6f87 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:39.909751 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3257/6512] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:21:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:21:41.530408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4203-e297-4c4d-9371-1e9067b2bc4e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:41.534210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dd7e4203-e297-4c4d-9371-1e9067b2bc4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:41.719276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e4203-e297-4c4d-9371-1e9067b2bc4e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:41.728341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c1fbf1-3fef-4274-b3b4-98c39448ba41 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:41.729635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1fbf1-3fef-4274-b3b4-98c39448ba41 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:41.730037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1fbf1-3fef-4274-b3b4-98c39448ba41 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:41.730425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c1fbf1-3fef-4274-b3b4-98c39448ba41 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:41.740806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1fbf1-3fef-4274-b3b4-98c39448ba41 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:41.744068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c1fbf1-3fef-4274-b3b4-98c39448ba41 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:41.764411 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3256/6513] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:41 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:43.437082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0f8d-1524-468c-88c9-0ee1e52e6f87 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:43.440958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-813d0f8d-1524-468c-88c9-0ee1e52e6f87 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:43.598685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d0f8d-1524-468c-88c9-0ee1e52e6f87 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:43.614650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:43.615850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:43.616132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:43.616409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] PATH_INFO: `/v3/users/8718f7c704a0445fb1d65ccf25ef207c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:43.625832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=8718f7c704a0445fb1d65ccf25ef207c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:43.633940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:43.726668 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:43.786339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8718f7c704a0445fb1d65ccf25ef207c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:43.824677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8718f7c704a0445fb1d65ccf25ef207c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:43.826488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8718f7c704a0445fb1d65ccf25ef207c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:43.875839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8718f7c704a0445fb1d65ccf25ef207c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:43.890022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8718f7c704a0445fb1d65ccf25ef207c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:43.915062 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3258/6514] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:43 2022] DELETE /identity/v3/users/8718f7c704a0445fb1d65ccf25ef207c => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:43.920134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e637d-28a3-421f-86c6-a3885c745a53 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:43.920707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e637d-28a3-421f-86c6-a3885c745a53 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:43.920707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e637d-28a3-421f-86c6-a3885c745a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:43.997423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-211e637d-28a3-421f-86c6-a3885c745a53 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:44.001529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-211e637d-28a3-421f-86c6-a3885c745a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:44.153184 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3257/6515] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:44.169180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:44.179018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:44.308179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c38dd-4072-417d-8f51-d0152c197c2b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:44.313013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d175ff2-b729-4a43-8a70-b0fc1ddcacb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:44.313912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d175ff2-b729-4a43-8a70-b0fc1ddcacb8 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:44.320709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d175ff2-b729-4a43-8a70-b0fc1ddcacb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:44.321515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d175ff2-b729-4a43-8a70-b0fc1ddcacb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:44.352025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d175ff2-b729-4a43-8a70-b0fc1ddcacb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:44.354719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d175ff2-b729-4a43-8a70-b0fc1ddcacb8 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:44.392743 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3259/6516] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:45.058012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e637d-28a3-421f-86c6-a3885c745a53 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:45.059916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-211e637d-28a3-421f-86c6-a3885c745a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:45.079657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e637d-28a3-421f-86c6-a3885c745a53 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:45.091437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:45.092100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:45.092382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:45.092650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] PATH_INFO: `/v3/projects/0ddb2836cd3e4130814e27f0324d8e1a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:45.094388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ddb2836cd3e4130814e27f0324d8e1a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:45.096351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:45.180511 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:45.201995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ddb2836cd3e4130814e27f0324d8e1a', 'request_id': 'req-f0b539e0-9a84-4df6-9a3a-430ca1c92437'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.236988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ddb2836cd3e4130814e27f0324d8e1a', 'request_id': 'req-f0b539e0-9a84-4df6-9a3a-430ca1c92437'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.247460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ddb2836cd3e4130814e27f0324d8e1a', 'request_id': 'req-f0b539e0-9a84-4df6-9a3a-430ca1c92437'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.264870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] The token cache is being invalidate because project 0ddb2836cd3e4130814e27f0324d8e1a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:45.265178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.267360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.270697 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3258/6517] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:45 2022] DELETE /identity/v3/projects/0ddb2836cd3e4130814e27f0324d8e1a => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:45.275248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d175ff2-b729-4a43-8a70-b0fc1ddcacb8 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:45.335684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d175ff2-b729-4a43-8a70-b0fc1ddcacb8 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:45.584384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:45.585138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:45.585786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:45.590410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] PATH_INFO: `/v3/users/f54880d541f5427e9fd2af290dd29420` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:45.591873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f54880d541f5427e9fd2af290dd29420)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:45.594696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:45.697895 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:45.709872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54880d541f5427e9fd2af290dd29420'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.741380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54880d541f5427e9fd2af290dd29420'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.744511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54880d541f5427e9fd2af290dd29420'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.766786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54880d541f5427e9fd2af290dd29420'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.782657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0e1c8695-873b-4e47-a563-2591835a7e6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54880d541f5427e9fd2af290dd29420'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:45.795968 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3260/6518] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:45 2022] DELETE /identity/v3/users/f54880d541f5427e9fd2af290dd29420 => generated 0 bytes in 522 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:47.882528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:47.883978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:47.902229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b539e0-9a84-4df6-9a3a-430ca1c92437 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:48.038497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:48.039142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:48.040027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:48.040314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] PATH_INFO: `/v3/projects/440b11035587431eb6251aecad18b5b7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:48.048275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=440b11035587431eb6251aecad18b5b7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:48.050273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:48.170223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '440b11035587431eb6251aecad18b5b7', 'request_id': 'req-f6078f6e-4715-4099-a2fe-a5b267485a9d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:48.184967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '440b11035587431eb6251aecad18b5b7', 'request_id': 'req-f6078f6e-4715-4099-a2fe-a5b267485a9d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:48.192126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '440b11035587431eb6251aecad18b5b7', 'request_id': 'req-f6078f6e-4715-4099-a2fe-a5b267485a9d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:48.217155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] The token cache is being invalidate because project 440b11035587431eb6251aecad18b5b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:48.217476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:48.225781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f6078f6e-4715-4099-a2fe-a5b267485a9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:48.227457 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3259/6519] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:47 2022] DELETE /identity/v3/projects/440b11035587431eb6251aecad18b5b7 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:48.233556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6426f5-04fb-43da-8c9f-d82f959d244c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:48.234113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6426f5-04fb-43da-8c9f-d82f959d244c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:48.234416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6426f5-04fb-43da-8c9f-d82f959d244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:48.279604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fa6426f5-04fb-43da-8c9f-d82f959d244c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:48.281075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa6426f5-04fb-43da-8c9f-d82f959d244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:48.491564 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3261/6520] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:48.502202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ba16-1bf3-4c83-936e-8fff11de44c7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:48.502614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ba16-1bf3-4c83-936e-8fff11de44c7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:48.502988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3ba16-1bf3-4c83-936e-8fff11de44c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:48.554900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8dd3ba16-1bf3-4c83-936e-8fff11de44c7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:48.559308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8dd3ba16-1bf3-4c83-936e-8fff11de44c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:48.579828 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3260/6521] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:48.585734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6426f5-04fb-43da-8c9f-d82f959d244c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:48.607048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6426f5-04fb-43da-8c9f-d82f959d244c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:48.624354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d341067-d351-4bba-a651-1a5ec27310b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:48.624988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d341067-d351-4bba-a651-1a5ec27310b8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:48.625386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d341067-d351-4bba-a651-1a5ec27310b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:48.625875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d341067-d351-4bba-a651-1a5ec27310b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:48.626846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d341067-d351-4bba-a651-1a5ec27310b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:48.628071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d341067-d351-4bba-a651-1a5ec27310b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:48.636158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d341067-d351-4bba-a651-1a5ec27310b8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:48.676540 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3262/6522] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:48.678813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ba16-1bf3-4c83-936e-8fff11de44c7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:48.692034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3ba16-1bf3-4c83-936e-8fff11de44c7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:48.705329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c6dd8-5d89-48e5-b2d3-916fcbe884fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:48.706187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c6dd8-5d89-48e5-b2d3-916fcbe884fb admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:48.706640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c6dd8-5d89-48e5-b2d3-916fcbe884fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:48.707082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c6dd8-5d89-48e5-b2d3-916fcbe884fb admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:48.707867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c6dd8-5d89-48e5-b2d3-916fcbe884fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:48.710028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365c6dd8-5d89-48e5-b2d3-916fcbe884fb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:48.773388 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3261/6523] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:48 2022] POST /identity/v3/projects => generated 361 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:48.774320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d341067-d351-4bba-a651-1a5ec27310b8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:48.811023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d341067-d351-4bba-a651-1a5ec27310b8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:48.882430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c6dd8-5d89-48e5-b2d3-916fcbe884fb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:48.884554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-365c6dd8-5d89-48e5-b2d3-916fcbe884fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:48.940329 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:49.006227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435887e-2064-44ff-a40e-10634a95f688 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:49.006856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435887e-2064-44ff-a40e-10634a95f688 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:49.007133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435887e-2064-44ff-a40e-10634a95f688 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:49.007405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c435887e-2064-44ff-a40e-10634a95f688 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:49.008257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435887e-2064-44ff-a40e-10634a95f688 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:49.010280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c435887e-2064-44ff-a40e-10634a95f688 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:49.070729 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3263/6524] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:48 2022] POST /identity/v3/users => generated 281 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:49.072988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435887e-2064-44ff-a40e-10634a95f688 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:49.092310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c435887e-2064-44ff-a40e-10634a95f688 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:49.096517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365c6dd8-5d89-48e5-b2d3-916fcbe884fb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:49.104222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25898f72-9969-41bf-ba95-0ee0da22ad22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:49.104717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25898f72-9969-41bf-ba95-0ee0da22ad22 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:49.104995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25898f72-9969-41bf-ba95-0ee0da22ad22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:49.105270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25898f72-9969-41bf-ba95-0ee0da22ad22 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:49.106530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25898f72-9969-41bf-ba95-0ee0da22ad22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:49.108145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25898f72-9969-41bf-ba95-0ee0da22ad22 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:49.113756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94194c91-5e30-4522-9c94-499c2b63c440 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:49.114415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94194c91-5e30-4522-9c94-499c2b63c440 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:49.114692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94194c91-5e30-4522-9c94-499c2b63c440 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:49.115535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94194c91-5e30-4522-9c94-499c2b63c440 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:49.136220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-94194c91-5e30-4522-9c94-499c2b63c440 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:49.165585 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3264/6525] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:49.166555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25898f72-9969-41bf-ba95-0ee0da22ad22 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:49.182296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94194c91-5e30-4522-9c94-499c2b63c440 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:49.186404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94194c91-5e30-4522-9c94-499c2b63c440 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:49.188110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25898f72-9969-41bf-ba95-0ee0da22ad22 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:49.199396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a061de76-7c96-4a2d-85b5-85cf4f4c467f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:49.200053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061de76-7c96-4a2d-85b5-85cf4f4c467f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:49.200340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061de76-7c96-4a2d-85b5-85cf4f4c467f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:49.200601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a061de76-7c96-4a2d-85b5-85cf4f4c467f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:49.201241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061de76-7c96-4a2d-85b5-85cf4f4c467f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:49.202905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a061de76-7c96-4a2d-85b5-85cf4f4c467f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:49.214129 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3262/6526] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:21:49.246375 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3265/6527] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:49.252249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94194c91-5e30-4522-9c94-499c2b63c440 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:49.268917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94194c91-5e30-4522-9c94-499c2b63c440 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:49.279698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ae730-e6e1-47af-9ed5-d94fe4af7df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:49.280961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ae730-e6e1-47af-9ed5-d94fe4af7df0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:49.281243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ae730-e6e1-47af-9ed5-d94fe4af7df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:49.282559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ae730-e6e1-47af-9ed5-d94fe4af7df0 admin admin] PATH_INFO: `/v3/projects/cfb9db4704f747949368b18c2127054e/users/5ebc703f4ee84686afbff2f19cefabe0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:49.324353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ae730-e6e1-47af-9ed5-d94fe4af7df0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfb9db4704f747949368b18c2127054e, user_id=5ebc703f4ee84686afbff2f19cefabe0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:49.327452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224ae730-e6e1-47af-9ed5-d94fe4af7df0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:49.367434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3263/6528] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:49 2022] PUT /identity/v3/projects/cfb9db4704f747949368b18c2127054e/users/5ebc703f4ee84686afbff2f19cefabe0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:49.371462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c88c-8c57-40dc-a4e8-eb9491fbc0fb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:49.372032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c88c-8c57-40dc-a4e8-eb9491fbc0fb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:49.372505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9960c88c-8c57-40dc-a4e8-eb9491fbc0fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:49.427306 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:49.435073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9960c88c-8c57-40dc-a4e8-eb9491fbc0fb None None] MFA Rules not processed for user `5ebc703f4ee84686afbff2f19cefabe0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:49.436520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9960c88c-8c57-40dc-a4e8-eb9491fbc0fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:49.570914 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3266/6529] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:49 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:49.608877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ae730-e6e1-47af-9ed5-d94fe4af7df0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:49.611698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-224ae730-e6e1-47af-9ed5-d94fe4af7df0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:49.727805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224ae730-e6e1-47af-9ed5-d94fe4af7df0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:49.732057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287a40b-bd51-404d-a4a9-84d9ce986e03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:49.733067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a40b-bd51-404d-a4a9-84d9ce986e03 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:49.733371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a40b-bd51-404d-a4a9-84d9ce986e03 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:49.733753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287a40b-bd51-404d-a4a9-84d9ce986e03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:49.745003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a40b-bd51-404d-a4a9-84d9ce986e03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:49.748322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287a40b-bd51-404d-a4a9-84d9ce986e03 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:49.785647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960c88c-8c57-40dc-a4e8-eb9491fbc0fb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:49.796686 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3264/6530] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:49 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:49.862906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9960c88c-8c57-40dc-a4e8-eb9491fbc0fb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:49.874829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:49.875486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:49.875763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:49.876030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] PATH_INFO: `/v3/users/5ebc703f4ee84686afbff2f19cefabe0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:49.878247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ebc703f4ee84686afbff2f19cefabe0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:49.893020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:49.989178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ebc703f4ee84686afbff2f19cefabe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:50.034480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ebc703f4ee84686afbff2f19cefabe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:50.037131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ebc703f4ee84686afbff2f19cefabe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:50.057344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ebc703f4ee84686afbff2f19cefabe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:50.075586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ebc703f4ee84686afbff2f19cefabe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:50.092276 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3267/6531] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:49 2022] DELETE /identity/v3/users/5ebc703f4ee84686afbff2f19cefabe0 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:50.097565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24720-7d7f-44e1-b332-8d80b06eb5dc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:50.098218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24720-7d7f-44e1-b332-8d80b06eb5dc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:50.098421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c24720-7d7f-44e1-b332-8d80b06eb5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:50.129657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-37c24720-7d7f-44e1-b332-8d80b06eb5dc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:50.132141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37c24720-7d7f-44e1-b332-8d80b06eb5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:50.301281 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3265/6532] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:50.330924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:50.332600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:50.391059 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:50.463747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f250899b-3f00-4f1e-824b-22fcd7b2b543 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:50.476356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879649c9-6aec-45b1-a569-556e794be3e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:50.477194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879649c9-6aec-45b1-a569-556e794be3e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:50.477502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879649c9-6aec-45b1-a569-556e794be3e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:50.477778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879649c9-6aec-45b1-a569-556e794be3e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:50.495747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879649c9-6aec-45b1-a569-556e794be3e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:50.497763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879649c9-6aec-45b1-a569-556e794be3e6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:50.525781 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3268/6533] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:52.438743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24720-7d7f-44e1-b332-8d80b06eb5dc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:52.440726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-37c24720-7d7f-44e1-b332-8d80b06eb5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:52.459555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c24720-7d7f-44e1-b332-8d80b06eb5dc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:52.466382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:52.467304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:52.467996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:52.468481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] PATH_INFO: `/v3/projects/cfb9db4704f747949368b18c2127054e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:52.469892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfb9db4704f747949368b18c2127054e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:52.474094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:52.518582 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:52.577753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfb9db4704f747949368b18c2127054e', 'request_id': 'req-c4376e9d-99bc-46a7-848d-73b36e0101d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:52.589410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfb9db4704f747949368b18c2127054e', 'request_id': 'req-c4376e9d-99bc-46a7-848d-73b36e0101d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:52.610536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfb9db4704f747949368b18c2127054e', 'request_id': 'req-c4376e9d-99bc-46a7-848d-73b36e0101d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:52.628239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] The token cache is being invalidate because project cfb9db4704f747949368b18c2127054e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:52.628868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:52.629970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c4376e9d-99bc-46a7-848d-73b36e0101d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:52.635237 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3266/6534] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:52 2022] DELETE /identity/v3/projects/cfb9db4704f747949368b18c2127054e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:52.641350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9b615-405a-4c8e-b24e-3d5302034326 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:52.642295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9b615-405a-4c8e-b24e-3d5302034326 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:52.642780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b9b615-405a-4c8e-b24e-3d5302034326 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:52.672947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c5b9b615-405a-4c8e-b24e-3d5302034326 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:52.685367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c5b9b615-405a-4c8e-b24e-3d5302034326 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:52.871549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f323a4-ffc4-433a-abbb-9bd53184156a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:52.872873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f323a4-ffc4-433a-abbb-9bd53184156a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:52.873407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f323a4-ffc4-433a-abbb-9bd53184156a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:52.877823 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3269/6535] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:52.904793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-47f323a4-ffc4-433a-abbb-9bd53184156a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:52.906789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-47f323a4-ffc4-433a-abbb-9bd53184156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:52.932706 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3267/6536] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:52.938202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9b615-405a-4c8e-b24e-3d5302034326 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:52.964347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b9b615-405a-4c8e-b24e-3d5302034326 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:52.997488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daae960-945c-4ff7-bac7-9c8a7c70ad6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:52.998803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daae960-945c-4ff7-bac7-9c8a7c70ad6d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:53.000964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daae960-945c-4ff7-bac7-9c8a7c70ad6d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:53.001780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daae960-945c-4ff7-bac7-9c8a7c70ad6d admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:53.004006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daae960-945c-4ff7-bac7-9c8a7c70ad6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:53.007502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daae960-945c-4ff7-bac7-9c8a7c70ad6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:53.010878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daae960-945c-4ff7-bac7-9c8a7c70ad6d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:53.054241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f323a4-ffc4-433a-abbb-9bd53184156a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:53.066628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f323a4-ffc4-433a-abbb-9bd53184156a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:53.070174 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3270/6537] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:53.082409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c346221-8cca-4a37-8f70-cfe54a887144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:53.083550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c346221-8cca-4a37-8f70-cfe54a887144 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:53.084769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c346221-8cca-4a37-8f70-cfe54a887144 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:53.085657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c346221-8cca-4a37-8f70-cfe54a887144 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:53.086536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c346221-8cca-4a37-8f70-cfe54a887144 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:53.089057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c346221-8cca-4a37-8f70-cfe54a887144 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:53.157886 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3268/6538] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:53 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:21:53.166321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daae960-945c-4ff7-bac7-9c8a7c70ad6d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:53.183028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daae960-945c-4ff7-bac7-9c8a7c70ad6d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:53.268575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec4e63-47ce-41a2-ae75-bb0097cdc2d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:53.270731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec4e63-47ce-41a2-ae75-bb0097cdc2d4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:53.271658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec4e63-47ce-41a2-ae75-bb0097cdc2d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:53.272038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eec4e63-47ce-41a2-ae75-bb0097cdc2d4 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:53.273187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec4e63-47ce-41a2-ae75-bb0097cdc2d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:53.275611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eec4e63-47ce-41a2-ae75-bb0097cdc2d4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:53.342387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c346221-8cca-4a37-8f70-cfe54a887144 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:53.362062 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3271/6539] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:53 2022] POST /identity/v3/users => generated 296 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:53.383813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c346221-8cca-4a37-8f70-cfe54a887144 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:53.402200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39de31-49c4-431a-96e1-e67ccf93e240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:53.403025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39de31-49c4-431a-96e1-e67ccf93e240 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:53.403307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39de31-49c4-431a-96e1-e67ccf93e240 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:53.403578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39de31-49c4-431a-96e1-e67ccf93e240 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:53.404639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39de31-49c4-431a-96e1-e67ccf93e240 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:53.406276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39de31-49c4-431a-96e1-e67ccf93e240 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:53.436895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec4e63-47ce-41a2-ae75-bb0097cdc2d4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:53.437729 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3269/6540] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:53.459715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eec4e63-47ce-41a2-ae75-bb0097cdc2d4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:53.466959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d13ad7-e025-4eb1-8335-18e4fe3da69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:53.468472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d13ad7-e025-4eb1-8335-18e4fe3da69d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:53.468759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d13ad7-e025-4eb1-8335-18e4fe3da69d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:53.469035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d13ad7-e025-4eb1-8335-18e4fe3da69d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:53.470024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d13ad7-e025-4eb1-8335-18e4fe3da69d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:53.472493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d13ad7-e025-4eb1-8335-18e4fe3da69d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:53.503528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39de31-49c4-431a-96e1-e67ccf93e240 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:53.513143 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3272/6541] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:21:53.517968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39de31-49c4-431a-96e1-e67ccf93e240 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:53.525982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cfb23-787f-4c30-8d71-1e3de3a81401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:53.534597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cfb23-787f-4c30-8d71-1e3de3a81401 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:53.535227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cfb23-787f-4c30-8d71-1e3de3a81401 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:53.535714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22cfb23-787f-4c30-8d71-1e3de3a81401 admin admin] PATH_INFO: `/v3/projects/8c1574a4adb443bea1ff907eb02341d9/users/254637e67bc04439aa1b62a8e09eedd7/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:53.593284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cfb23-787f-4c30-8d71-1e3de3a81401 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c1574a4adb443bea1ff907eb02341d9, user_id=254637e67bc04439aa1b62a8e09eedd7, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:53.607375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22cfb23-787f-4c30-8d71-1e3de3a81401 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:53.657098 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3270/6542] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:53 2022] PUT /identity/v3/projects/8c1574a4adb443bea1ff907eb02341d9/users/254637e67bc04439aa1b62a8e09eedd7/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:53.671005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96532c-f32a-4d13-9c33-28b514b54044 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:53.672134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96532c-f32a-4d13-9c33-28b514b54044 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:53.672643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f96532c-f32a-4d13-9c33-28b514b54044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:53.754805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1f96532c-f32a-4d13-9c33-28b514b54044 None None] MFA Rules not processed for user `254637e67bc04439aa1b62a8e09eedd7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:53.757371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f96532c-f32a-4d13-9c33-28b514b54044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:53.814137 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:53.972766 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3273/6543] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:53 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:53.989180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cfb23-787f-4c30-8d71-1e3de3a81401 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:53.991904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e22cfb23-787f-4c30-8d71-1e3de3a81401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:54.119962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22cfb23-787f-4c30-8d71-1e3de3a81401 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:54.126614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940b65b2-0644-4288-9382-d040a9fa2600 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:54.127649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b65b2-0644-4288-9382-d040a9fa2600 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:54.128186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b65b2-0644-4288-9382-d040a9fa2600 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:54.128706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940b65b2-0644-4288-9382-d040a9fa2600 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:54.140867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b65b2-0644-4288-9382-d040a9fa2600 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:54.143036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940b65b2-0644-4288-9382-d040a9fa2600 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:54.160106 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3271/6544] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:53 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:55.962720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96532c-f32a-4d13-9c33-28b514b54044 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:55.964229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f96532c-f32a-4d13-9c33-28b514b54044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:56.188648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f96532c-f32a-4d13-9c33-28b514b54044 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:56.204902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:56.205715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:56.206012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:56.206385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] PATH_INFO: `/v3/users/80d02eb476574560ae3a9d4d44aee129` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:56.212459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80d02eb476574560ae3a9d4d44aee129)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:56.218746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:56.314043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80d02eb476574560ae3a9d4d44aee129'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:56.332241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80d02eb476574560ae3a9d4d44aee129'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:56.333368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80d02eb476574560ae3a9d4d44aee129'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:56.346464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80d02eb476574560ae3a9d4d44aee129'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:56.357409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80d02eb476574560ae3a9d4d44aee129'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:56.366248 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3274/6545] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:21:55 2022] DELETE /identity/v3/users/80d02eb476574560ae3a9d4d44aee129 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:56.370533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8e75-558c-448b-87ed-dbd8dc7c126a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:56.371422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8e75-558c-448b-87ed-dbd8dc7c126a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:56.371871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278c8e75-558c-448b-87ed-dbd8dc7c126a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:56.394610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-278c8e75-558c-448b-87ed-dbd8dc7c126a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:56.396982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-278c8e75-558c-448b-87ed-dbd8dc7c126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:56.468453 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:56.547727 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3272/6546] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:56.762578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:56.764380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:56.845416 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:56.871195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6affb0-7b8b-4d1c-86d2-18c840513906 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:56.877030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764c7b8b-e7ba-4469-94bd-091cfb3176ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:56.879501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7b8b-e7ba-4469-94bd-091cfb3176ae service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:56.879501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7b8b-e7ba-4469-94bd-091cfb3176ae service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:56.879501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764c7b8b-e7ba-4469-94bd-091cfb3176ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:56.894271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7b8b-e7ba-4469-94bd-091cfb3176ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:56.895748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764c7b8b-e7ba-4469-94bd-091cfb3176ae service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:56.909013 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3275/6547] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:21:57.249288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8e75-558c-448b-87ed-dbd8dc7c126a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:57.252743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-278c8e75-558c-448b-87ed-dbd8dc7c126a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:57.282157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278c8e75-558c-448b-87ed-dbd8dc7c126a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:57.295614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:57.298442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:57.300797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:57.302661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] PATH_INFO: `/v3/projects/4e3c6f9c68f247f6b17b9f3052adbab3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:57.308313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3c6f9c68f247f6b17b9f3052adbab3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:57.314232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:57.428237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3c6f9c68f247f6b17b9f3052adbab3', 'request_id': 'req-d3081725-ee5c-4c87-9689-a40ed178c05d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:57.448704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3c6f9c68f247f6b17b9f3052adbab3', 'request_id': 'req-d3081725-ee5c-4c87-9689-a40ed178c05d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:57.468390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3c6f9c68f247f6b17b9f3052adbab3', 'request_id': 'req-d3081725-ee5c-4c87-9689-a40ed178c05d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:57.488506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] The token cache is being invalidate because project 4e3c6f9c68f247f6b17b9f3052adbab3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:21:57.488731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:57.489461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3081725-ee5c-4c87-9689-a40ed178c05d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:21:57.491212 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3273/6548] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:21:57 2022] DELETE /identity/v3/projects/4e3c6f9c68f247f6b17b9f3052adbab3 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:57.496917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fa61a-d3c5-4f47-8f08-f3b854fca5fe None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:57.497491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fa61a-d3c5-4f47-8f08-f3b854fca5fe None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:57.497491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fa61a-d3c5-4f47-8f08-f3b854fca5fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:57.527888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-066fa61a-d3c5-4f47-8f08-f3b854fca5fe None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:57.529675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-066fa61a-d3c5-4f47-8f08-f3b854fca5fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:57.616470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2c04-2c9d-49c3-8677-999af9b3826b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:57.616763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2c04-2c9d-49c3-8677-999af9b3826b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:57.617042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca2c04-2c9d-49c3-8677-999af9b3826b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:57.627223 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3276/6549] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:57.650331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-60ca2c04-2c9d-49c3-8677-999af9b3826b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:57.651661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60ca2c04-2c9d-49c3-8677-999af9b3826b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:57.692212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fa61a-d3c5-4f47-8f08-f3b854fca5fe None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:57.703051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fa61a-d3c5-4f47-8f08-f3b854fca5fe None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:57.703945 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3274/6550] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:57.710081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24c238-02a8-4694-a2f2-da6904617bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:57.710759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24c238-02a8-4694-a2f2-da6904617bfb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:57.711153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24c238-02a8-4694-a2f2-da6904617bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:57.711553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f24c238-02a8-4694-a2f2-da6904617bfb admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:57.712312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24c238-02a8-4694-a2f2-da6904617bfb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:21:57.712724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24c238-02a8-4694-a2f2-da6904617bfb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:57.714522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f24c238-02a8-4694-a2f2-da6904617bfb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:57.742958 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3277/6551] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:21:57.747414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2c04-2c9d-49c3-8677-999af9b3826b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:57.758527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca2c04-2c9d-49c3-8677-999af9b3826b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:57.763444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91396a1-c3cf-4b66-a009-1357fc92577d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:57.764194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91396a1-c3cf-4b66-a009-1357fc92577d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:57.764586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91396a1-c3cf-4b66-a009-1357fc92577d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:57.764968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91396a1-c3cf-4b66-a009-1357fc92577d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:57.766023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91396a1-c3cf-4b66-a009-1357fc92577d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:57.767944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91396a1-c3cf-4b66-a009-1357fc92577d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:57.817445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24c238-02a8-4694-a2f2-da6904617bfb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:57.829009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f24c238-02a8-4694-a2f2-da6904617bfb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:57.829631 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3275/6552] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:21:57 2022] POST /identity/v3/projects => generated 381 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:57.973195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7a6b5-5497-4c27-9125-ba878f4c5706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:57.975460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7a6b5-5497-4c27-9125-ba878f4c5706 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:57.977708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7a6b5-5497-4c27-9125-ba878f4c5706 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:57.978001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb7a6b5-5497-4c27-9125-ba878f4c5706 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:57.978710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7a6b5-5497-4c27-9125-ba878f4c5706 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:57.982104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb7a6b5-5497-4c27-9125-ba878f4c5706 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:58.036466 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3278/6553] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:21:57 2022] POST /identity/v3/users => generated 291 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:21:58.037918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91396a1-c3cf-4b66-a009-1357fc92577d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:58.073273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91396a1-c3cf-4b66-a009-1357fc92577d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:58.081031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da089ab3-7f47-4600-9fe1-7ab0ad9f218f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:58.081803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089ab3-7f47-4600-9fe1-7ab0ad9f218f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:58.082007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089ab3-7f47-4600-9fe1-7ab0ad9f218f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:58.082287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da089ab3-7f47-4600-9fe1-7ab0ad9f218f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:58.084379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da089ab3-7f47-4600-9fe1-7ab0ad9f218f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:58.086402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da089ab3-7f47-4600-9fe1-7ab0ad9f218f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:58.103924 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3276/6554] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:58.105690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7a6b5-5497-4c27-9125-ba878f4c5706 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:58.133287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb7a6b5-5497-4c27-9125-ba878f4c5706 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:58.154610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb4553f-a058-4e99-af59-128aaa5cf333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:58.155380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4553f-a058-4e99-af59-128aaa5cf333 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:58.155772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4553f-a058-4e99-af59-128aaa5cf333 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:58.156188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb4553f-a058-4e99-af59-128aaa5cf333 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:58.157227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4553f-a058-4e99-af59-128aaa5cf333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:58.159724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb4553f-a058-4e99-af59-128aaa5cf333 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:58.207490 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3279/6555] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:21:58 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:21:58.212844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da089ab3-7f47-4600-9fe1-7ab0ad9f218f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:58.238594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da089ab3-7f47-4600-9fe1-7ab0ad9f218f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:58.258704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc07b13-a8cc-46ad-b970-d0ad45abddf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:58.259677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc07b13-a8cc-46ad-b970-d0ad45abddf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:58.260017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc07b13-a8cc-46ad-b970-d0ad45abddf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:58.260940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc07b13-a8cc-46ad-b970-d0ad45abddf4 admin admin] PATH_INFO: `/v3/projects/593f002715764c9da85db5bf4d1e5dbe/users/36cd1dbc142f43e38fcab5b4f0fbc2e2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:58.285566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc07b13-a8cc-46ad-b970-d0ad45abddf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=593f002715764c9da85db5bf4d1e5dbe, user_id=36cd1dbc142f43e38fcab5b4f0fbc2e2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:58.289007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc07b13-a8cc-46ad-b970-d0ad45abddf4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:58.336594 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3277/6556] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:21:58 2022] PUT /identity/v3/projects/593f002715764c9da85db5bf4d1e5dbe/users/36cd1dbc142f43e38fcab5b4f0fbc2e2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:21:58.346928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406e283-b3ec-4fad-98a0-8833a1864969 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:58.347213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406e283-b3ec-4fad-98a0-8833a1864969 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:58.347496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4406e283-b3ec-4fad-98a0-8833a1864969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:58.451861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4406e283-b3ec-4fad-98a0-8833a1864969 None None] MFA Rules not processed for user `36cd1dbc142f43e38fcab5b4f0fbc2e2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:21:58.455965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4406e283-b3ec-4fad-98a0-8833a1864969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:58.606775 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:21:58.765629 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3280/6557] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:21:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 419 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:21:58.783792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc07b13-a8cc-46ad-b970-d0ad45abddf4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:21:58.787706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7dc07b13-a8cc-46ad-b970-d0ad45abddf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:21:58.975562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc07b13-a8cc-46ad-b970-d0ad45abddf4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:21:58.989943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227a92d9-c4ca-44a5-a77e-4dce49e38d94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:21:58.991019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a92d9-c4ca-44a5-a77e-4dce49e38d94 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:21:58.991310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a92d9-c4ca-44a5-a77e-4dce49e38d94 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:21:58.991590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227a92d9-c4ca-44a5-a77e-4dce49e38d94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:21:59.014686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a92d9-c4ca-44a5-a77e-4dce49e38d94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:21:59.016161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227a92d9-c4ca-44a5-a77e-4dce49e38d94 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:21:59.043971 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3278/6558] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:21:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:03.371017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406e283-b3ec-4fad-98a0-8833a1864969 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:03.372470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4406e283-b3ec-4fad-98a0-8833a1864969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:03.638640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4406e283-b3ec-4fad-98a0-8833a1864969 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:03.658158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:03.659080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:03.659745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:03.660190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] PATH_INFO: `/v3/users/7aa1e59762bf447f80fe5d5059b66c24` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:03.664875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7aa1e59762bf447f80fe5d5059b66c24)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:03.669062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:03.782711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7aa1e59762bf447f80fe5d5059b66c24'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:03.816033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7aa1e59762bf447f80fe5d5059b66c24'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:03.816880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7aa1e59762bf447f80fe5d5059b66c24'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:03.843471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7aa1e59762bf447f80fe5d5059b66c24'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:03.855247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7aa1e59762bf447f80fe5d5059b66c24'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:03.872112 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3281/6559] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:03 2022] DELETE /identity/v3/users/7aa1e59762bf447f80fe5d5059b66c24 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:03.873901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656070-d2e6-45d0-98bd-506d75066faa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:03.877375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656070-d2e6-45d0-98bd-506d75066faa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:03.877583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08656070-d2e6-45d0-98bd-506d75066faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:03.930016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-08656070-d2e6-45d0-98bd-506d75066faa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:03.931568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08656070-d2e6-45d0-98bd-506d75066faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:03.946473 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:04.072149 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3279/6560] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:04.088790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:04.090749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:04.255306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b75045-6991-49c6-8392-4300bb67e746 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:04.271382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b86c9-c9ec-48ee-b1da-859f8e6d6722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:04.272196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b86c9-c9ec-48ee-b1da-859f8e6d6722 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:04.273214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b86c9-c9ec-48ee-b1da-859f8e6d6722 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:04.275035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b86c9-c9ec-48ee-b1da-859f8e6d6722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:04.303505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b86c9-c9ec-48ee-b1da-859f8e6d6722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:04.305743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550b86c9-c9ec-48ee-b1da-859f8e6d6722 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:04.318373 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:04.329726 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3282/6561] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:05.131814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656070-d2e6-45d0-98bd-506d75066faa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:05.133346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08656070-d2e6-45d0-98bd-506d75066faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:05.169653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08656070-d2e6-45d0-98bd-506d75066faa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:05.188639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:05.189356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:05.189826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:05.190292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] PATH_INFO: `/v3/projects/2412de64d0944bbcbc8455674ce705ff` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:05.191841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2412de64d0944bbcbc8455674ce705ff)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:05.194613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:05.304988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2412de64d0944bbcbc8455674ce705ff', 'request_id': 'req-454a5413-8900-4ad9-8916-90964f62b6d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.322914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2412de64d0944bbcbc8455674ce705ff', 'request_id': 'req-454a5413-8900-4ad9-8916-90964f62b6d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.336206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2412de64d0944bbcbc8455674ce705ff', 'request_id': 'req-454a5413-8900-4ad9-8916-90964f62b6d4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.358310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] The token cache is being invalidate because project 2412de64d0944bbcbc8455674ce705ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:05.358886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.359914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.362209 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3280/6562] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:05 2022] DELETE /identity/v3/projects/2412de64d0944bbcbc8455674ce705ff => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:22:05.366604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b86c9-c9ec-48ee-b1da-859f8e6d6722 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:05.381952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b86c9-c9ec-48ee-b1da-859f8e6d6722 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:05.538794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:05.539813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:05.540314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:05.540862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] PATH_INFO: `/v3/users/208a9d773a364c0cafcefc500e1d1dda` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:05.543214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=208a9d773a364c0cafcefc500e1d1dda)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:05.546940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:05.653034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '208a9d773a364c0cafcefc500e1d1dda'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.678858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '208a9d773a364c0cafcefc500e1d1dda'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.680086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '208a9d773a364c0cafcefc500e1d1dda'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.698991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '208a9d773a364c0cafcefc500e1d1dda'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.726203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b7d629aa-1aba-431f-a46b-9b54ee154b79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '208a9d773a364c0cafcefc500e1d1dda'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:05.735322 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3283/6563] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:05 2022] DELETE /identity/v3/users/208a9d773a364c0cafcefc500e1d1dda => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:06.591474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:06.595355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:06.641235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a5413-8900-4ad9-8916-90964f62b6d4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:06.711011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:06.711647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:06.711976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:06.712631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] PATH_INFO: `/v3/projects/a13c37ff731040e984856b3d0c002ba8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:06.714736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a13c37ff731040e984856b3d0c002ba8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:06.717186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:06.787054 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:06.799015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a13c37ff731040e984856b3d0c002ba8', 'request_id': 'req-e98b835a-67ce-4aa7-ad47-1621fc5937e4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:06.812876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a13c37ff731040e984856b3d0c002ba8', 'request_id': 'req-e98b835a-67ce-4aa7-ad47-1621fc5937e4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:06.823193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a13c37ff731040e984856b3d0c002ba8', 'request_id': 'req-e98b835a-67ce-4aa7-ad47-1621fc5937e4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:06.837455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] The token cache is being invalidate because project a13c37ff731040e984856b3d0c002ba8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:06.837856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:06.838668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e98b835a-67ce-4aa7-ad47-1621fc5937e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:06.841970 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3281/6564] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:06 2022] DELETE /identity/v3/projects/a13c37ff731040e984856b3d0c002ba8 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:06.845875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4083a6-3778-45b5-a825-eec60563c13a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:06.846777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4083a6-3778-45b5-a825-eec60563c13a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:06.847088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4083a6-3778-45b5-a825-eec60563c13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:06.874269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6a4083a6-3778-45b5-a825-eec60563c13a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:06.875524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6a4083a6-3778-45b5-a825-eec60563c13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:06.954045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3284/6565] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:06.961846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981ec5-6539-425f-b99e-ab868ff7c578 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:06.962140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981ec5-6539-425f-b99e-ab868ff7c578 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:06.962428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41981ec5-6539-425f-b99e-ab868ff7c578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:06.992008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-41981ec5-6539-425f-b99e-ab868ff7c578 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:06.994548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-41981ec5-6539-425f-b99e-ab868ff7c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:07.009526 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3282/6566] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:07.014986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4083a6-3778-45b5-a825-eec60563c13a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.020463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981ec5-6539-425f-b99e-ab868ff7c578 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.022143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-41981ec5-6539-425f-b99e-ab868ff7c578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:07.028927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4083a6-3778-45b5-a825-eec60563c13a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:07.034080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f9e65-bab5-4b6e-b3d0-b49e2b2945be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:07.035827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41981ec5-6539-425f-b99e-ab868ff7c578 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:07.042016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:07.042656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.043002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.043284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] PATH_INFO: `/v3/users/61dee6c659b540b38533e9d3a345c457` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.045207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] RBAC: Authorizing `identity:delete_user(user_id=61dee6c659b540b38533e9d3a345c457)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:07.046428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f9e65-bab5-4b6e-b3d0-b49e2b2945be admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.046727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f9e65-bab5-4b6e-b3d0-b49e2b2945be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.047009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5f9e65-bab5-4b6e-b3d0-b49e2b2945be admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.047194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:07.047700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f9e65-bab5-4b6e-b3d0-b49e2b2945be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:22:07.048008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f9e65-bab5-4b6e-b3d0-b49e2b2945be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:07.049647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5f9e65-bab5-4b6e-b3d0-b49e2b2945be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:07.076073 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3285/6567] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:22:07.080117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f9e65-bab5-4b6e-b3d0-b49e2b2945be admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.092168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5f9e65-bab5-4b6e-b3d0-b49e2b2945be admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:07.099212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e580b9-436c-4d03-85d0-ff40f2630fa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:07.100135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e580b9-436c-4d03-85d0-ff40f2630fa2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.100403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e580b9-436c-4d03-85d0-ff40f2630fa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.100690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e580b9-436c-4d03-85d0-ff40f2630fa2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.101639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e580b9-436c-4d03-85d0-ff40f2630fa2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:07.103544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e580b9-436c-4d03-85d0-ff40f2630fa2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:07.109151 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:07.118480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61dee6c659b540b38533e9d3a345c457'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:07.142339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61dee6c659b540b38533e9d3a345c457'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:07.143583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61dee6c659b540b38533e9d3a345c457'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:07.153390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3286/6568] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:07 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:22:07.156759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61dee6c659b540b38533e9d3a345c457'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:07.157076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e580b9-436c-4d03-85d0-ff40f2630fa2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.162087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a4e580b9-436c-4d03-85d0-ff40f2630fa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:07.174667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12da42c6-e2bc-4f5c-af75-c74bce7e393b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61dee6c659b540b38533e9d3a345c457'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:07.182630 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3283/6569] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:07 2022] DELETE /identity/v3/users/61dee6c659b540b38533e9d3a345c457 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:07.186761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b297f-544d-44fc-adfe-dc92d5df5268 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.187375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b297f-544d-44fc-adfe-dc92d5df5268 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.187841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b297f-544d-44fc-adfe-dc92d5df5268 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.218018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1a6b297f-544d-44fc-adfe-dc92d5df5268 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:07.219261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1a6b297f-544d-44fc-adfe-dc92d5df5268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:07.249376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e580b9-436c-4d03-85d0-ff40f2630fa2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:07.305472 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3284/6570] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:22:07.309189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b297f-544d-44fc-adfe-dc92d5df5268 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.310719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1a6b297f-544d-44fc-adfe-dc92d5df5268 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:07.318717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa81104-e1a7-43b5-bbac-95d50fdeaa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:07.319615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa81104-e1a7-43b5-bbac-95d50fdeaa0b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.320078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa81104-e1a7-43b5-bbac-95d50fdeaa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.320357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa81104-e1a7-43b5-bbac-95d50fdeaa0b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.320989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa81104-e1a7-43b5-bbac-95d50fdeaa0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:07.323719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa81104-e1a7-43b5-bbac-95d50fdeaa0b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:07.347813 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:07.349611 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3287/6571] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:07 2022] POST /identity/v3/users => generated 287 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:07.353867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa81104-e1a7-43b5-bbac-95d50fdeaa0b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.366412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa81104-e1a7-43b5-bbac-95d50fdeaa0b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:07.371782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba633181-2a13-4b2d-aed1-e43228aebc88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:07.372595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633181-2a13-4b2d-aed1-e43228aebc88 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.372989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633181-2a13-4b2d-aed1-e43228aebc88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.373321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba633181-2a13-4b2d-aed1-e43228aebc88 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.374372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba633181-2a13-4b2d-aed1-e43228aebc88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:07.375762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba633181-2a13-4b2d-aed1-e43228aebc88 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:07.387565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b297f-544d-44fc-adfe-dc92d5df5268 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:07.388225 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3288/6572] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:22:07.392528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba633181-2a13-4b2d-aed1-e43228aebc88 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.392987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb1eb9-3876-4aca-8d06-122cf2c43bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:07.393702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb1eb9-3876-4aca-8d06-122cf2c43bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.394046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb1eb9-3876-4aca-8d06-122cf2c43bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.394384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fb1eb9-3876-4aca-8d06-122cf2c43bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.403922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba633181-2a13-4b2d-aed1-e43228aebc88 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:07.404652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb1eb9-3876-4aca-8d06-122cf2c43bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:07.406138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fb1eb9-3876-4aca-8d06-122cf2c43bd4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:07.408906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca292b28-8cc6-44e4-888d-cd6ff5ec91bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:07.409603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca292b28-8cc6-44e4-888d-cd6ff5ec91bd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.410327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca292b28-8cc6-44e4-888d-cd6ff5ec91bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.410470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca292b28-8cc6-44e4-888d-cd6ff5ec91bd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.411155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca292b28-8cc6-44e4-888d-cd6ff5ec91bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:07.412822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca292b28-8cc6-44e4-888d-cd6ff5ec91bd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:07.416712 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3285/6573] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:22:07.427621 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3289/6574] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:07.431628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb1eb9-3876-4aca-8d06-122cf2c43bd4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.451258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fb1eb9-3876-4aca-8d06-122cf2c43bd4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:07.451258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a0996-05c4-477b-a00a-6ea6bd8e9b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:07.451258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0996-05c4-477b-a00a-6ea6bd8e9b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.451258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0996-05c4-477b-a00a-6ea6bd8e9b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.452293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22a0996-05c4-477b-a00a-6ea6bd8e9b1d admin admin] PATH_INFO: `/v3/projects/fad9bb408720480b964cb8b9dcd49e19/users/92f3721d4dae4467afe3c761cc582634/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.473634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a0996-05c4-477b-a00a-6ea6bd8e9b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad9bb408720480b964cb8b9dcd49e19, user_id=92f3721d4dae4467afe3c761cc582634, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:07.485276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22a0996-05c4-477b-a00a-6ea6bd8e9b1d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:07.505869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3286/6575] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:07 2022] PUT /identity/v3/projects/fad9bb408720480b964cb8b9dcd49e19/users/92f3721d4dae4467afe3c761cc582634/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:07.517163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e170-7273-4bd4-afed-ca3dad8fc06d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.517458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e170-7273-4bd4-afed-ca3dad8fc06d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.517773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb77e170-7273-4bd4-afed-ca3dad8fc06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.550966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-eb77e170-7273-4bd4-afed-ca3dad8fc06d None None] MFA Rules not processed for user `92f3721d4dae4467afe3c761cc582634`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:07.553017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eb77e170-7273-4bd4-afed-ca3dad8fc06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:07.633492 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:07.657347 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3290/6576] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:07.662173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a0996-05c4-477b-a00a-6ea6bd8e9b1d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.789189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22a0996-05c4-477b-a00a-6ea6bd8e9b1d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:07.801889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839867-1f96-4523-b1d7-c4280bb42e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:07.803424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839867-1f96-4523-b1d7-c4280bb42e67 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:07.804732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839867-1f96-4523-b1d7-c4280bb42e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:07.805107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2839867-1f96-4523-b1d7-c4280bb42e67 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:07.816844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2839867-1f96-4523-b1d7-c4280bb42e67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:07.821483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2839867-1f96-4523-b1d7-c4280bb42e67 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:07.922502 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3287/6577] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:07 2022] POST /identity/v3/projects => generated 377 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:22:07.927068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77e170-7273-4bd4-afed-ca3dad8fc06d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:07.947460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb77e170-7273-4bd4-afed-ca3dad8fc06d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:08.056868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839867-1f96-4523-b1d7-c4280bb42e67 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:08.058931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2839867-1f96-4523-b1d7-c4280bb42e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:08.129482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf7b20-79da-4c83-990c-2610af740ab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:08.131698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf7b20-79da-4c83-990c-2610af740ab7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:08.132174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf7b20-79da-4c83-990c-2610af740ab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:08.132606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecf7b20-79da-4c83-990c-2610af740ab7 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:08.133446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf7b20-79da-4c83-990c-2610af740ab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:08.135803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecf7b20-79da-4c83-990c-2610af740ab7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:08.175756 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3291/6578] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:07 2022] POST /identity/v3/users => generated 295 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:08.180919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf7b20-79da-4c83-990c-2610af740ab7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:08.195992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecf7b20-79da-4c83-990c-2610af740ab7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:08.202676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad316-f22c-43c1-ae42-b570e11999e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:08.202676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad316-f22c-43c1-ae42-b570e11999e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:08.203321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad316-f22c-43c1-ae42-b570e11999e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:08.203702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0ad316-f22c-43c1-ae42-b570e11999e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:08.204656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ad316-f22c-43c1-ae42-b570e11999e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:08.206466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0ad316-f22c-43c1-ae42-b570e11999e2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:08.218326 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3292/6579] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:08.222253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad316-f22c-43c1-ae42-b570e11999e2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:08.230043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2839867-1f96-4523-b1d7-c4280bb42e67 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:08.235010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:08.235654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:08.235937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:08.236215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] PATH_INFO: `/v3/projects/8db2e29d48ff402da2a8838e7a1ea354` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:08.237620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8db2e29d48ff402da2a8838e7a1ea354)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:08.240116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:08.250325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0ad316-f22c-43c1-ae42-b570e11999e2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:08.260237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0f0c8-ff98-47a3-8afb-b627372711ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:08.261190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0f0c8-ff98-47a3-8afb-b627372711ce admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:08.261743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0f0c8-ff98-47a3-8afb-b627372711ce admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:08.262338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0f0c8-ff98-47a3-8afb-b627372711ce admin admin] PATH_INFO: `/v3/projects/05474778119c484fb52d0e7538d72db2/users/49bb434024934bd596f06db785411d4a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:08.287415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0f0c8-ff98-47a3-8afb-b627372711ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=05474778119c484fb52d0e7538d72db2, user_id=49bb434024934bd596f06db785411d4a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:08.288350 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:08.291917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0f0c8-ff98-47a3-8afb-b627372711ce admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:08.317954 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3293/6580] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:08 2022] PUT /identity/v3/projects/05474778119c484fb52d0e7538d72db2/users/49bb434024934bd596f06db785411d4a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:08.318951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0f0c8-ff98-47a3-8afb-b627372711ce admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:08.326191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8db2e29d48ff402da2a8838e7a1ea354', 'request_id': 'req-3eba89e1-3426-4921-a07e-e3fc44301f81'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.344885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8db2e29d48ff402da2a8838e7a1ea354', 'request_id': 'req-3eba89e1-3426-4921-a07e-e3fc44301f81'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.356950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8db2e29d48ff402da2a8838e7a1ea354', 'request_id': 'req-3eba89e1-3426-4921-a07e-e3fc44301f81'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.399022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] The token cache is being invalidate because project 8db2e29d48ff402da2a8838e7a1ea354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:08.399557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.402181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.405869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3288/6581] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:08 2022] DELETE /identity/v3/projects/8db2e29d48ff402da2a8838e7a1ea354 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:22:08.409696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:08.414816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:08.442942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0f0c8-ff98-47a3-8afb-b627372711ce admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:08.450774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62109f63-78b6-4061-9fc5-b1962b4ca4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:08.452263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109f63-78b6-4061-9fc5-b1962b4ca4fa admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:08.452881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109f63-78b6-4061-9fc5-b1962b4ca4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:08.453166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62109f63-78b6-4061-9fc5-b1962b4ca4fa admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:08.453908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62109f63-78b6-4061-9fc5-b1962b4ca4fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:08.456206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62109f63-78b6-4061-9fc5-b1962b4ca4fa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:08.499755 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3294/6582] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:08.501447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62109f63-78b6-4061-9fc5-b1962b4ca4fa admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:08.509727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-62109f63-78b6-4061-9fc5-b1962b4ca4fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:08.527025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62109f63-78b6-4061-9fc5-b1962b4ca4fa admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:08.533945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7935568b-29e5-4c49-9248-0bb083aacfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:08.534840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935568b-29e5-4c49-9248-0bb083aacfe8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:08.535265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935568b-29e5-4c49-9248-0bb083aacfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:08.535650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7935568b-29e5-4c49-9248-0bb083aacfe8 admin admin] PATH_INFO: `/v3/projects/05474778119c484fb52d0e7538d72db2/users/49bb434024934bd596f06db785411d4a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:08.538856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935568b-29e5-4c49-9248-0bb083aacfe8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05474778119c484fb52d0e7538d72db2, user_id=49bb434024934bd596f06db785411d4a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:08.544177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7935568b-29e5-4c49-9248-0bb083aacfe8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:08.560361 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3295/6583] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:08 2022] PUT /identity/v3/projects/05474778119c484fb52d0e7538d72db2/users/49bb434024934bd596f06db785411d4a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:08.571410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99c8c4-dd18-42e9-b91f-1fe784318d15 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:08.571621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99c8c4-dd18-42e9-b91f-1fe784318d15 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:08.571711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eba89e1-3426-4921-a07e-e3fc44301f81 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:08.571886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e99c8c4-dd18-42e9-b91f-1fe784318d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:08.615199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4e99c8c4-dd18-42e9-b91f-1fe784318d15 None None] MFA Rules not processed for user `49bb434024934bd596f06db785411d4a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:08.616648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4e99c8c4-dd18-42e9-b91f-1fe784318d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:08.644498 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:08.737631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:08.739873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:08.740292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:08.740669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] PATH_INFO: `/v3/users/0ae38d5dc821452f98a6e1f8f899e980` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:08.743194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ae38d5dc821452f98a6e1f8f899e980)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:08.747013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:08.773097 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3296/6584] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:08 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:08.792365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99c8c4-dd18-42e9-b91f-1fe784318d15 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:08.794216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4e99c8c4-dd18-42e9-b91f-1fe784318d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:08.868731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ae38d5dc821452f98a6e1f8f899e980'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.896132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ae38d5dc821452f98a6e1f8f899e980'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.898237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ae38d5dc821452f98a6e1f8f899e980'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.912776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e99c8c4-dd18-42e9-b91f-1fe784318d15 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:08.919455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:08.920981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:08.921348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:08.921953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:08.924265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:08.926250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ae38d5dc821452f98a6e1f8f899e980'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.929043 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:08.944214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:08.946045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:08.949386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15a05c9b-9872-47fd-993c-22727fc26115 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ae38d5dc821452f98a6e1f8f899e980'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:08.973482 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3297/6586] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:22:08.978872 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3289/6586] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:08 2022] DELETE /identity/v3/users/0ae38d5dc821452f98a6e1f8f899e980 => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:09.491378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:09.493513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:09.541180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9a44f3-15f2-41ba-be54-bc9992a05222 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:09.782427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:09.798671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:09.799213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:09.800401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] PATH_INFO: `/v3/projects/fba565653ae843e38f31a9b7ededfc9f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:09.805915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fba565653ae843e38f31a9b7ededfc9f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:09.825006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:09.945766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fba565653ae843e38f31a9b7ededfc9f', 'request_id': 'req-5c475d61-ac61-4b95-abd3-10d18f0cd253'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:09.957217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fba565653ae843e38f31a9b7ededfc9f', 'request_id': 'req-5c475d61-ac61-4b95-abd3-10d18f0cd253'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:09.961029 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:09.975939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fba565653ae843e38f31a9b7ededfc9f', 'request_id': 'req-5c475d61-ac61-4b95-abd3-10d18f0cd253'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:09.993984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] The token cache is being invalidate because project fba565653ae843e38f31a9b7ededfc9f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:09.994360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:09.995298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c475d61-ac61-4b95-abd3-10d18f0cd253 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:09.998126 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3298/6587] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:09 2022] DELETE /identity/v3/projects/fba565653ae843e38f31a9b7ededfc9f => generated 0 bytes in 508 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:10.002939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590edac-16d9-4b4a-9ebb-c8580cf5d46c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:10.003829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590edac-16d9-4b4a-9ebb-c8580cf5d46c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:10.005094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f590edac-16d9-4b4a-9ebb-c8580cf5d46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:10.044208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f590edac-16d9-4b4a-9ebb-c8580cf5d46c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:10.046550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f590edac-16d9-4b4a-9ebb-c8580cf5d46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:10.191536 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3290/6588] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:22:10.200286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac813c6b-e11e-46a6-a256-7b12bb0b901c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:10.200721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac813c6b-e11e-46a6-a256-7b12bb0b901c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:10.201501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac813c6b-e11e-46a6-a256-7b12bb0b901c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:10.269883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ac813c6b-e11e-46a6-a256-7b12bb0b901c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:10.275450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ac813c6b-e11e-46a6-a256-7b12bb0b901c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:10.301079 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3299/6589] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:10.305404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590edac-16d9-4b4a-9ebb-c8580cf5d46c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:10.321171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f590edac-16d9-4b4a-9ebb-c8580cf5d46c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:10.329947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108802c-f9c8-4eef-b080-c1c504882df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:10.331566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108802c-f9c8-4eef-b080-c1c504882df5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:10.332567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108802c-f9c8-4eef-b080-c1c504882df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:10.332567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c108802c-f9c8-4eef-b080-c1c504882df5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:10.334417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108802c-f9c8-4eef-b080-c1c504882df5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:22:10.335052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108802c-f9c8-4eef-b080-c1c504882df5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:10.337183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c108802c-f9c8-4eef-b080-c1c504882df5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:10.366053 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3291/6590] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:22:10.368990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac813c6b-e11e-46a6-a256-7b12bb0b901c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:10.399005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac813c6b-e11e-46a6-a256-7b12bb0b901c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:10.410580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c507-6786-4a5c-92e0-0f4dd1282c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:10.413798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c507-6786-4a5c-92e0-0f4dd1282c8a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:10.414083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c507-6786-4a5c-92e0-0f4dd1282c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:10.414362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4c507-6786-4a5c-92e0-0f4dd1282c8a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:10.418499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4c507-6786-4a5c-92e0-0f4dd1282c8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:10.421597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4c507-6786-4a5c-92e0-0f4dd1282c8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:10.463053 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3300/6591] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:10 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:10.465444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108802c-f9c8-4eef-b080-c1c504882df5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:10.478510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c108802c-f9c8-4eef-b080-c1c504882df5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:10.550336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833e132-27ba-4abd-a098-f5ec519d8f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:10.551381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833e132-27ba-4abd-a098-f5ec519d8f82 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:10.551914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833e132-27ba-4abd-a098-f5ec519d8f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:10.552420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833e132-27ba-4abd-a098-f5ec519d8f82 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:10.553469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833e132-27ba-4abd-a098-f5ec519d8f82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:10.556148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833e132-27ba-4abd-a098-f5ec519d8f82 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:10.595797 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3292/6592] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:10 2022] POST /identity/v3/users => generated 295 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:22:10.596511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c507-6786-4a5c-92e0-0f4dd1282c8a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:10.621122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4c507-6786-4a5c-92e0-0f4dd1282c8a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:10.658019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db481-4084-45cb-8d97-1a65a77a2396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:10.658659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db481-4084-45cb-8d97-1a65a77a2396 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:10.659200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db481-4084-45cb-8d97-1a65a77a2396 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:10.659338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58db481-4084-45cb-8d97-1a65a77a2396 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:10.659916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db481-4084-45cb-8d97-1a65a77a2396 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:10.671421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58db481-4084-45cb-8d97-1a65a77a2396 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:10.693228 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3301/6593] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:10.695336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833e132-27ba-4abd-a098-f5ec519d8f82 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:10.718547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833e132-27ba-4abd-a098-f5ec519d8f82 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:10.729670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4e7a0-ecfe-4d6c-a157-bc4894aad900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:10.730432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4e7a0-ecfe-4d6c-a157-bc4894aad900 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:10.730727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4e7a0-ecfe-4d6c-a157-bc4894aad900 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:10.731006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4e7a0-ecfe-4d6c-a157-bc4894aad900 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:10.731671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4e7a0-ecfe-4d6c-a157-bc4894aad900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:10.733335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4e7a0-ecfe-4d6c-a157-bc4894aad900 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:10.747705 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3293/6594] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:10.751928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db481-4084-45cb-8d97-1a65a77a2396 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:10.764266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58db481-4084-45cb-8d97-1a65a77a2396 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:10.769698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d3416-c122-4674-ac47-2fedf0c6e6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:10.771208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d3416-c122-4674-ac47-2fedf0c6e6c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:10.771609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d3416-c122-4674-ac47-2fedf0c6e6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:10.773334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d3416-c122-4674-ac47-2fedf0c6e6c0 admin admin] PATH_INFO: `/v3/projects/f0be279025fc4b5ca7aca8bec50115f6/users/e4de60ae2f544164aaaa3453e7eeec88/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:10.791562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d3416-c122-4674-ac47-2fedf0c6e6c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0be279025fc4b5ca7aca8bec50115f6, user_id=e4de60ae2f544164aaaa3453e7eeec88, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:10.794341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d3416-c122-4674-ac47-2fedf0c6e6c0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:10.819078 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3302/6595] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:10 2022] PUT /identity/v3/projects/f0be279025fc4b5ca7aca8bec50115f6/users/e4de60ae2f544164aaaa3453e7eeec88/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:10.835871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a1bfb-daed-4f7a-8dc3-665496b1c0df None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:10.842773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a1bfb-daed-4f7a-8dc3-665496b1c0df None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:10.843078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582a1bfb-daed-4f7a-8dc3-665496b1c0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:10.900482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-582a1bfb-daed-4f7a-8dc3-665496b1c0df None None] MFA Rules not processed for user `e4de60ae2f544164aaaa3453e7eeec88`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:10.901674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-582a1bfb-daed-4f7a-8dc3-665496b1c0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:11.018226 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:11.045257 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3294/6596] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:10 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:11.057527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d3416-c122-4674-ac47-2fedf0c6e6c0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:11.168940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d3416-c122-4674-ac47-2fedf0c6e6c0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:11.186688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc228e9-d7dc-4c43-850d-05ffa1c6d9f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:11.187527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc228e9-d7dc-4c43-850d-05ffa1c6d9f1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:11.187827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc228e9-d7dc-4c43-850d-05ffa1c6d9f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:11.188104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc228e9-d7dc-4c43-850d-05ffa1c6d9f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:11.189449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc228e9-d7dc-4c43-850d-05ffa1c6d9f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:11.191624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc228e9-d7dc-4c43-850d-05ffa1c6d9f1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:11.266967 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3303/6597] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:11 2022] POST /identity/v3/projects => generated 393 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:11.271452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a1bfb-daed-4f7a-8dc3-665496b1c0df None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:11.290988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582a1bfb-daed-4f7a-8dc3-665496b1c0df None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:11.399259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc661761-f771-44ae-8d57-2aeefd042ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:11.399806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc661761-f771-44ae-8d57-2aeefd042ed4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:11.400083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc661761-f771-44ae-8d57-2aeefd042ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:11.400352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc661761-f771-44ae-8d57-2aeefd042ed4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:11.400983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc661761-f771-44ae-8d57-2aeefd042ed4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:11.403157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc661761-f771-44ae-8d57-2aeefd042ed4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:11.432126 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3295/6598] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:11 2022] POST /identity/v3/users => generated 303 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:11.436392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc228e9-d7dc-4c43-850d-05ffa1c6d9f1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:11.463354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc228e9-d7dc-4c43-850d-05ffa1c6d9f1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:11.477451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd7057-f890-43d4-a850-18900f361d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:11.482172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7057-f890-43d4-a850-18900f361d9c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:11.483681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7057-f890-43d4-a850-18900f361d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:11.484169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffd7057-f890-43d4-a850-18900f361d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:11.485018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd7057-f890-43d4-a850-18900f361d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:11.488661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffd7057-f890-43d4-a850-18900f361d9c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:11.521642 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3304/6599] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:11.522652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc661761-f771-44ae-8d57-2aeefd042ed4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:11.538489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc661761-f771-44ae-8d57-2aeefd042ed4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:11.554121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c4cec-9c21-4e58-a816-30cb424ccdb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:11.554121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c4cec-9c21-4e58-a816-30cb424ccdb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:11.557624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c4cec-9c21-4e58-a816-30cb424ccdb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:11.559129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503c4cec-9c21-4e58-a816-30cb424ccdb5 admin admin] PATH_INFO: `/v3/projects/b4bf1677f3fc4d1bbd3ed578635a8903/users/451cd908143342acbc5b99cfa0436176/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:11.588574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c4cec-9c21-4e58-a816-30cb424ccdb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4bf1677f3fc4d1bbd3ed578635a8903, user_id=451cd908143342acbc5b99cfa0436176, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:11.594697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503c4cec-9c21-4e58-a816-30cb424ccdb5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:11.629476 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3296/6600] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:11 2022] PUT /identity/v3/projects/b4bf1677f3fc4d1bbd3ed578635a8903/users/451cd908143342acbc5b99cfa0436176/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:22:11.634224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd7057-f890-43d4-a850-18900f361d9c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:11.646940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffd7057-f890-43d4-a850-18900f361d9c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:11.759761 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:11.777190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38b37-46e0-48c3-b230-3b37b1fe8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:11.778123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38b37-46e0-48c3-b230-3b37b1fe8caf admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:11.778228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38b37-46e0-48c3-b230-3b37b1fe8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:11.778460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38b37-46e0-48c3-b230-3b37b1fe8caf admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:11.779136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a38b37-46e0-48c3-b230-3b37b1fe8caf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:11.780801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a38b37-46e0-48c3-b230-3b37b1fe8caf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:11.827893 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3305/6601] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:22:11.828769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c4cec-9c21-4e58-a816-30cb424ccdb5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:11.851361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503c4cec-9c21-4e58-a816-30cb424ccdb5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:11.865984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a5d70-21d2-430c-9273-74e5d9aa73e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:11.867149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a5d70-21d2-430c-9273-74e5d9aa73e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:11.867149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a5d70-21d2-430c-9273-74e5d9aa73e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:11.867365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015a5d70-21d2-430c-9273-74e5d9aa73e8 admin admin] PATH_INFO: `/v3/projects/b4bf1677f3fc4d1bbd3ed578635a8903/users/451cd908143342acbc5b99cfa0436176/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:11.869176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a5d70-21d2-430c-9273-74e5d9aa73e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4bf1677f3fc4d1bbd3ed578635a8903, user_id=451cd908143342acbc5b99cfa0436176, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:11.871905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015a5d70-21d2-430c-9273-74e5d9aa73e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:11.906522 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3297/6602] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:11 2022] PUT /identity/v3/projects/b4bf1677f3fc4d1bbd3ed578635a8903/users/451cd908143342acbc5b99cfa0436176/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:22:11.910161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb596c-a62a-4a68-bc6e-8e77d85cc3e8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:11.910831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb596c-a62a-4a68-bc6e-8e77d85cc3e8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:11.912195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb596c-a62a-4a68-bc6e-8e77d85cc3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:11.999050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f3cb596c-a62a-4a68-bc6e-8e77d85cc3e8 None None] MFA Rules not processed for user `451cd908143342acbc5b99cfa0436176`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:12.001594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f3cb596c-a62a-4a68-bc6e-8e77d85cc3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:12.202314 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3306/6603] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:11 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:12.236545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a5d70-21d2-430c-9273-74e5d9aa73e8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:12.238813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-015a5d70-21d2-430c-9273-74e5d9aa73e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:12.380111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015a5d70-21d2-430c-9273-74e5d9aa73e8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:12.390604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d868ab-c9d3-48de-aadc-4cca06ade83e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:12.391309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d868ab-c9d3-48de-aadc-4cca06ade83e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:12.391594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d868ab-c9d3-48de-aadc-4cca06ade83e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:12.391867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d868ab-c9d3-48de-aadc-4cca06ade83e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:12.413992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d868ab-c9d3-48de-aadc-4cca06ade83e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:12.415464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d868ab-c9d3-48de-aadc-4cca06ade83e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:12.435964 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3298/6604] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:12 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:19.049543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c5a7-9a53-4a4d-8bc5-f22ac40b4980 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:19.050848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c5a7-9a53-4a4d-8bc5-f22ac40b4980 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:19.051138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595c5a7-9a53-4a4d-8bc5-f22ac40b4980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:19.082012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6595c5a7-9a53-4a4d-8bc5-f22ac40b4980 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:19.084024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6595c5a7-9a53-4a4d-8bc5-f22ac40b4980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:19.182071 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3307/6605] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:22:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:19.192774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d868ab-c9d3-48de-aadc-4cca06ade83e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:19.194502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-42d868ab-c9d3-48de-aadc-4cca06ade83e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:19.289677 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:19.362780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d868ab-c9d3-48de-aadc-4cca06ade83e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:19.376970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224492a0-be7d-4caa-9e92-448d94f154f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:19.377644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224492a0-be7d-4caa-9e92-448d94f154f8 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:19.377920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224492a0-be7d-4caa-9e92-448d94f154f8 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:19.378190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224492a0-be7d-4caa-9e92-448d94f154f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:19.400749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224492a0-be7d-4caa-9e92-448d94f154f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:19.402731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224492a0-be7d-4caa-9e92-448d94f154f8 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:19.447443 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3299/6606] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:22:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:22:23.561733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595c5a7-9a53-4a4d-8bc5-f22ac40b4980 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:23.812334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595c5a7-9a53-4a4d-8bc5-f22ac40b4980 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:23.828415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:23.829396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:23.829834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:23.830289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] PATH_INFO: `/v3/users/e4de60ae2f544164aaaa3453e7eeec88` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:23.831808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4de60ae2f544164aaaa3453e7eeec88)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:23.834525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:23.910910 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:23.953183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4de60ae2f544164aaaa3453e7eeec88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:24.011185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4de60ae2f544164aaaa3453e7eeec88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:24.012345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4de60ae2f544164aaaa3453e7eeec88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:24.037196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4de60ae2f544164aaaa3453e7eeec88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:24.047561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4de60ae2f544164aaaa3453e7eeec88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:24.062043 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3308/6607] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:23 2022] DELETE /identity/v3/users/e4de60ae2f544164aaaa3453e7eeec88 => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:24.067439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96bdb3-ae05-4ed6-963b-8cad087912e2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:24.067963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96bdb3-ae05-4ed6-963b-8cad087912e2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:24.068204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96bdb3-ae05-4ed6-963b-8cad087912e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:24.121231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ba96bdb3-ae05-4ed6-963b-8cad087912e2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:24.124985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ba96bdb3-ae05-4ed6-963b-8cad087912e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:24.335503 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3300/6608] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:24.374468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:24.375917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:24.581462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec265b6-0165-4f17-ba2e-a5ef90257d40 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:24.591884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fbd7-f0d0-4770-8e67-988b1bd39357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:24.592521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fbd7-f0d0-4770-8e67-988b1bd39357 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:24.592806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fbd7-f0d0-4770-8e67-988b1bd39357 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:24.593093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f70fbd7-f0d0-4770-8e67-988b1bd39357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:24.614145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70fbd7-f0d0-4770-8e67-988b1bd39357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:24.615641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f70fbd7-f0d0-4770-8e67-988b1bd39357 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:24.652495 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3309/6609] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:25.451968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96bdb3-ae05-4ed6-963b-8cad087912e2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:25.455208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ba96bdb3-ae05-4ed6-963b-8cad087912e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:25.478001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96bdb3-ae05-4ed6-963b-8cad087912e2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:25.488589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:25.492896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:25.494506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:25.495275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] PATH_INFO: `/v3/projects/f0be279025fc4b5ca7aca8bec50115f6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:25.499184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0be279025fc4b5ca7aca8bec50115f6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:25.505664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:25.617212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0be279025fc4b5ca7aca8bec50115f6', 'request_id': 'req-cbc68eff-e966-46b5-8c5a-6a3533bb4486'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:25.635550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0be279025fc4b5ca7aca8bec50115f6', 'request_id': 'req-cbc68eff-e966-46b5-8c5a-6a3533bb4486'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:25.645549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0be279025fc4b5ca7aca8bec50115f6', 'request_id': 'req-cbc68eff-e966-46b5-8c5a-6a3533bb4486'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:25.676953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] The token cache is being invalidate because project f0be279025fc4b5ca7aca8bec50115f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:25.677396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:25.679540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:25.687716 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3301/6610] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:25 2022] DELETE /identity/v3/projects/f0be279025fc4b5ca7aca8bec50115f6 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:25.691776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fbd7-f0d0-4770-8e67-988b1bd39357 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:25.709559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f70fbd7-f0d0-4770-8e67-988b1bd39357 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:25.865620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:25.866481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:25.866868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:25.867525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] PATH_INFO: `/v3/users/451cd908143342acbc5b99cfa0436176` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:25.869305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=451cd908143342acbc5b99cfa0436176)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:25.874762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:25.937951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:25.939758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:25.980885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc68eff-e966-46b5-8c5a-6a3533bb4486 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:25.995689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:25.996668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:25.997038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:25.997797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] PATH_INFO: `/v3/users/254637e67bc04439aa1b62a8e09eedd7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:26.012360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] RBAC: Authorizing `identity:delete_user(user_id=254637e67bc04439aa1b62a8e09eedd7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:26.018186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:26.038921 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:26.043907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '451cd908143342acbc5b99cfa0436176'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.117858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '451cd908143342acbc5b99cfa0436176'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.119557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '451cd908143342acbc5b99cfa0436176'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.154004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '451cd908143342acbc5b99cfa0436176'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.165013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7875787e-76ce-4458-b40c-26dff73f6a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '451cd908143342acbc5b99cfa0436176'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.182262 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3310/6611] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:25 2022] DELETE /identity/v3/users/451cd908143342acbc5b99cfa0436176 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:26.199925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '254637e67bc04439aa1b62a8e09eedd7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.206310 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:26.247185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '254637e67bc04439aa1b62a8e09eedd7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.249021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '254637e67bc04439aa1b62a8e09eedd7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.271031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '254637e67bc04439aa1b62a8e09eedd7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.292114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '254637e67bc04439aa1b62a8e09eedd7'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:26.304631 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3302/6612] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:25 2022] DELETE /identity/v3/users/254637e67bc04439aa1b62a8e09eedd7 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:22:26.308110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931b5aa-eabf-48cd-8dae-a829074764ab None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:26.308737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931b5aa-eabf-48cd-8dae-a829074764ab None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:26.309360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c931b5aa-eabf-48cd-8dae-a829074764ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:26.341025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c931b5aa-eabf-48cd-8dae-a829074764ab None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:26.342816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c931b5aa-eabf-48cd-8dae-a829074764ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:26.575349 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3311/6613] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:26.628086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:26.639814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:26.729217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931b5aa-eabf-48cd-8dae-a829074764ab None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:26.731580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c931b5aa-eabf-48cd-8dae-a829074764ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:26.772711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c931b5aa-eabf-48cd-8dae-a829074764ab None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:26.790952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:26.792658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:26.793271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:26.793921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] PATH_INFO: `/v3/projects/b4bf1677f3fc4d1bbd3ed578635a8903` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:26.797422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4bf1677f3fc4d1bbd3ed578635a8903)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:26.803692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:26.944048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba3cf9e-fad1-463d-a7c7-fd67c7e64ccd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:26.970087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132add59-0271-44c9-be70-e5e395158e36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:26.970813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132add59-0271-44c9-be70-e5e395158e36 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:26.971165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132add59-0271-44c9-be70-e5e395158e36 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:26.971523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132add59-0271-44c9-be70-e5e395158e36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:27.024298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132add59-0271-44c9-be70-e5e395158e36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:27.025815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132add59-0271-44c9-be70-e5e395158e36 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:27.031021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4bf1677f3fc4d1bbd3ed578635a8903', 'request_id': 'req-dc3ab067-d6a1-47a7-a690-a210845a458d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:27.050724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4bf1677f3fc4d1bbd3ed578635a8903', 'request_id': 'req-dc3ab067-d6a1-47a7-a690-a210845a458d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:27.054745 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3303/6614] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:27.118784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4bf1677f3fc4d1bbd3ed578635a8903', 'request_id': 'req-dc3ab067-d6a1-47a7-a690-a210845a458d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:27.157983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] The token cache is being invalidate because project b4bf1677f3fc4d1bbd3ed578635a8903 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:27.158343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:27.160774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc3ab067-d6a1-47a7-a690-a210845a458d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:27.168201 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3312/6615] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:26 2022] DELETE /identity/v3/projects/b4bf1677f3fc4d1bbd3ed578635a8903 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:22:27.173312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66faddf-5bbd-4bb1-9daa-7ee47ecd0a05 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:27.173679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66faddf-5bbd-4bb1-9daa-7ee47ecd0a05 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:27.173958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66faddf-5bbd-4bb1-9daa-7ee47ecd0a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:27.225321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e66faddf-5bbd-4bb1-9daa-7ee47ecd0a05 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:27.226663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e66faddf-5bbd-4bb1-9daa-7ee47ecd0a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:27.420328 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3304/6616] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:27.422541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278a02-a12e-4ae5-a9d8-7bfc280a558c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:27.424363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278a02-a12e-4ae5-a9d8-7bfc280a558c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:27.424895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02278a02-a12e-4ae5-a9d8-7bfc280a558c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:27.513555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-02278a02-a12e-4ae5-a9d8-7bfc280a558c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:27.539137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-02278a02-a12e-4ae5-a9d8-7bfc280a558c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:27.542631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66faddf-5bbd-4bb1-9daa-7ee47ecd0a05 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:27.544180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e66faddf-5bbd-4bb1-9daa-7ee47ecd0a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:27.584958 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3313/6617] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:27.591503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278a02-a12e-4ae5-a9d8-7bfc280a558c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:27.643657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02278a02-a12e-4ae5-a9d8-7bfc280a558c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:27.662255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609b7a5-4a88-4ecc-94fc-6ee1fa204f2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:27.668023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609b7a5-4a88-4ecc-94fc-6ee1fa204f2e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:27.668612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609b7a5-4a88-4ecc-94fc-6ee1fa204f2e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:27.676886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4609b7a5-4a88-4ecc-94fc-6ee1fa204f2e admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:27.681668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609b7a5-4a88-4ecc-94fc-6ee1fa204f2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:22:27.684062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609b7a5-4a88-4ecc-94fc-6ee1fa204f2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:27.690392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4609b7a5-4a88-4ecc-94fc-6ee1fa204f2e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:27.729031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66faddf-5bbd-4bb1-9daa-7ee47ecd0a05 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:27.744836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501319d-7085-4fc0-9078-8bdd6f7563c6 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49bb434024934bd596f06db785411d4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05474778119c484fb52d0e7538d72db2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:27.745913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501319d-7085-4fc0-9078-8bdd6f7563c6 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:27.746434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501319d-7085-4fc0-9078-8bdd6f7563c6 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:27.746932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501319d-7085-4fc0-9078-8bdd6f7563c6 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:27.747923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501319d-7085-4fc0-9078-8bdd6f7563c6 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:22:27.748454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501319d-7085-4fc0-9078-8bdd6f7563c6 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:27.753273 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3314/6618] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:22:27.754873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501319d-7085-4fc0-9078-8bdd6f7563c6 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:27.755504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609b7a5-4a88-4ecc-94fc-6ee1fa204f2e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:27.802647 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3305/6619] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:22:27.803850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501319d-7085-4fc0-9078-8bdd6f7563c6 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:27.806367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4609b7a5-4a88-4ecc-94fc-6ee1fa204f2e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:27.832823 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:27.834070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9dbe-5cf7-4bb7-9624-65a523642307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:27.834744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9dbe-5cf7-4bb7-9624-65a523642307 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:27.835038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9dbe-5cf7-4bb7-9624-65a523642307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:27.835385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bd9dbe-5cf7-4bb7-9624-65a523642307 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:27.841040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd9dbe-5cf7-4bb7-9624-65a523642307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:27.842415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501319d-7085-4fc0-9078-8bdd6f7563c6 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:27.851154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bd9dbe-5cf7-4bb7-9624-65a523642307 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:27.879090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761151b8-baed-4a18-93f0-67aaae8d9899 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49bb434024934bd596f06db785411d4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05474778119c484fb52d0e7538d72db2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:27.880454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761151b8-baed-4a18-93f0-67aaae8d9899 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:27.880744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761151b8-baed-4a18-93f0-67aaae8d9899 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:27.881547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761151b8-baed-4a18-93f0-67aaae8d9899 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:27.882204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761151b8-baed-4a18-93f0-67aaae8d9899 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:27.884285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761151b8-baed-4a18-93f0-67aaae8d9899 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:27.929778 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3306/6620] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:27 2022] POST /identity/v3/projects => generated 347 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:27.943665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761151b8-baed-4a18-93f0-67aaae8d9899 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:27.965809 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3315/6621] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:27 2022] POST /identity/v3/projects => generated 371 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:27.974506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9dbe-5cf7-4bb7-9624-65a523642307 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:27.995274 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:28.121758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761151b8-baed-4a18-93f0-67aaae8d9899 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:28.239308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bd9dbe-5cf7-4bb7-9624-65a523642307 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:28.273656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c33714-37bb-497a-aa9b-d720ebd0a9b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:28.274289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33714-37bb-497a-aa9b-d720ebd0a9b7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:28.274571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33714-37bb-497a-aa9b-d720ebd0a9b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:28.274848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c33714-37bb-497a-aa9b-d720ebd0a9b7 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:28.275487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c33714-37bb-497a-aa9b-d720ebd0a9b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:28.290951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c33714-37bb-497a-aa9b-d720ebd0a9b7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:28.305860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fdb2e7f-1986-4f95-8175-5a206888b8b9 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49bb434024934bd596f06db785411d4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05474778119c484fb52d0e7538d72db2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:28.306443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2e7f-1986-4f95-8175-5a206888b8b9 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:28.306727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2e7f-1986-4f95-8175-5a206888b8b9 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:28.307004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fdb2e7f-1986-4f95-8175-5a206888b8b9 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:28.307663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2e7f-1986-4f95-8175-5a206888b8b9 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:22:28.307981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2e7f-1986-4f95-8175-5a206888b8b9 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:28.309728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fdb2e7f-1986-4f95-8175-5a206888b8b9 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:28.361269 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3316/6622] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:27 2022] POST /identity/v3/users => generated 286 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:28.367993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3307/6623] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:22:28.369330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54065-c836-4386-8bfa-f6341d20158a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:28.369330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54065-c836-4386-8bfa-f6341d20158a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:28.369706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb54065-c836-4386-8bfa-f6341d20158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:28.373651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c33714-37bb-497a-aa9b-d720ebd0a9b7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:28.411927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c33714-37bb-497a-aa9b-d720ebd0a9b7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:28.430166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b845ac-b412-461d-afcd-89c85fc28121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:28.430796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b845ac-b412-461d-afcd-89c85fc28121 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:28.431237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b845ac-b412-461d-afcd-89c85fc28121 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:28.431537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b845ac-b412-461d-afcd-89c85fc28121 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:28.432260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b845ac-b412-461d-afcd-89c85fc28121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:28.433796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b845ac-b412-461d-afcd-89c85fc28121 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:28.434679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bfb54065-c836-4386-8bfa-f6341d20158a None None] MFA Rules not processed for user `9d0b4f066e344bba84c0369d4c695f8b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:28.435930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bfb54065-c836-4386-8bfa-f6341d20158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:28.475008 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3317/6624] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:28.475965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b845ac-b412-461d-afcd-89c85fc28121 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:28.499098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b845ac-b412-461d-afcd-89c85fc28121 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:28.512461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24648528-6222-4ec6-8379-438d94595568 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:28.513085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24648528-6222-4ec6-8379-438d94595568 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:28.513415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24648528-6222-4ec6-8379-438d94595568 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:28.514367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24648528-6222-4ec6-8379-438d94595568 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:28.514985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24648528-6222-4ec6-8379-438d94595568 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:28.525162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24648528-6222-4ec6-8379-438d94595568 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:28.546317 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3318/6625] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:28.550631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24648528-6222-4ec6-8379-438d94595568 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:28.582925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24648528-6222-4ec6-8379-438d94595568 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:28.593222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73110a-afe0-4f77-aef2-fc19338c1c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:28.594102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73110a-afe0-4f77-aef2-fc19338c1c5b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:28.594557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73110a-afe0-4f77-aef2-fc19338c1c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:28.595173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73110a-afe0-4f77-aef2-fc19338c1c5b admin admin] PATH_INFO: `/v3/projects/477f8b121a454b0992bae9a1fdcb9107/users/94fd900fea9f446db27ecd43f3309ac9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:28.602792 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3308/6626] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:28.639947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73110a-afe0-4f77-aef2-fc19338c1c5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=477f8b121a454b0992bae9a1fdcb9107, user_id=94fd900fea9f446db27ecd43f3309ac9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:28.649454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f73110a-afe0-4f77-aef2-fc19338c1c5b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:28.697516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa97bc0-290a-4cad-84c5-242079077c52 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:28.698099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa97bc0-290a-4cad-84c5-242079077c52 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:28.698570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa97bc0-290a-4cad-84c5-242079077c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:28.698699 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3319/6627] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:28 2022] PUT /identity/v3/projects/477f8b121a454b0992bae9a1fdcb9107/users/94fd900fea9f446db27ecd43f3309ac9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:28.775909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-faa97bc0-290a-4cad-84c5-242079077c52 None None] MFA Rules not processed for user `94fd900fea9f446db27ecd43f3309ac9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:28.778405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-faa97bc0-290a-4cad-84c5-242079077c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:28.785969 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:29.110885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3309/6628] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:29.159504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73110a-afe0-4f77-aef2-fc19338c1c5b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:29.162304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7f73110a-afe0-4f77-aef2-fc19338c1c5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:29.330696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa97bc0-290a-4cad-84c5-242079077c52 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:29.332154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-faa97bc0-290a-4cad-84c5-242079077c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:29.357991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f73110a-afe0-4f77-aef2-fc19338c1c5b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:29.364658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea97cb0-59d7-456e-9810-44dada526547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:29.365468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea97cb0-59d7-456e-9810-44dada526547 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:29.365749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea97cb0-59d7-456e-9810-44dada526547 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:29.366034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea97cb0-59d7-456e-9810-44dada526547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:29.413842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea97cb0-59d7-456e-9810-44dada526547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:29.415330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea97cb0-59d7-456e-9810-44dada526547 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:29.435020 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3320/6629] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:29.531997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa97bc0-290a-4cad-84c5-242079077c52 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:29.538818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:29.539794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:29.540494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:29.542389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] PATH_INFO: `/v3/projects/8c1574a4adb443bea1ff907eb02341d9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:29.544308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c1574a4adb443bea1ff907eb02341d9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:29.546628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:29.655417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c1574a4adb443bea1ff907eb02341d9', 'request_id': 'req-6ac785bb-928d-4964-8950-539fac94eddf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:29.675496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c1574a4adb443bea1ff907eb02341d9', 'request_id': 'req-6ac785bb-928d-4964-8950-539fac94eddf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:29.694554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c1574a4adb443bea1ff907eb02341d9', 'request_id': 'req-6ac785bb-928d-4964-8950-539fac94eddf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:29.725211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] The token cache is being invalidate because project 8c1574a4adb443bea1ff907eb02341d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:29.725557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:29.731551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:29.734569 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3310/6630] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:29 2022] DELETE /identity/v3/projects/8c1574a4adb443bea1ff907eb02341d9 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:22:29.740618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e6be7-06fe-4eb4-8d44-a43652ddaa97 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:29.740836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e6be7-06fe-4eb4-8d44-a43652ddaa97 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:29.741119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e6be7-06fe-4eb4-8d44-a43652ddaa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:29.780389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e61e6be7-06fe-4eb4-8d44-a43652ddaa97 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:29.785003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e61e6be7-06fe-4eb4-8d44-a43652ddaa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:29.943215 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:29.993976 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3321/6631] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:30.115795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:30.117795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:30.152070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e32c7-2043-4a25-addf-b2d0d96fa48f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:30.152364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e32c7-2043-4a25-addf-b2d0d96fa48f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:30.152719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5e32c7-2043-4a25-addf-b2d0d96fa48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:30.240415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9e5e32c7-2043-4a25-addf-b2d0d96fa48f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:30.248779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9e5e32c7-2043-4a25-addf-b2d0d96fa48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:30.292868 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:30.316035 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3322/6632] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:30.317610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e32c7-2043-4a25-addf-b2d0d96fa48f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:30.352944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5e32c7-2043-4a25-addf-b2d0d96fa48f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:30.370903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872c469-1ec7-4109-85d2-31e3a3b9d796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:30.371789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872c469-1ec7-4109-85d2-31e3a3b9d796 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:30.380461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872c469-1ec7-4109-85d2-31e3a3b9d796 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:30.382050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872c469-1ec7-4109-85d2-31e3a3b9d796 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:30.383089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872c469-1ec7-4109-85d2-31e3a3b9d796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:22:30.388352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac785bb-928d-4964-8950-539fac94eddf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:30.389054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872c469-1ec7-4109-85d2-31e3a3b9d796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:30.391179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872c469-1ec7-4109-85d2-31e3a3b9d796 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:30.414036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '49bb434024934bd596f06db785411d4a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '05474778119c484fb52d0e7538d72db2', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:30.414717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:30.415009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:30.415290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] PATH_INFO: `/v3/projects/da317322534f4411a8d4c749f13be008` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:30.420075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da317322534f4411a8d4c749f13be008)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:30.427926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:30.440192 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3323/6633] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:22:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:22:30.441138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872c469-1ec7-4109-85d2-31e3a3b9d796 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:30.490201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872c469-1ec7-4109-85d2-31e3a3b9d796 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:30.505125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee375dae-d01a-434e-b362-24f71686b4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:30.506442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375dae-d01a-434e-b362-24f71686b4e4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:30.507004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375dae-d01a-434e-b362-24f71686b4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:30.507543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee375dae-d01a-434e-b362-24f71686b4e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:30.508558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee375dae-d01a-434e-b362-24f71686b4e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:30.515406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee375dae-d01a-434e-b362-24f71686b4e4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:30.582852 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3324/6634] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:30 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:30.584300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee375dae-d01a-434e-b362-24f71686b4e4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:30.629259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da317322534f4411a8d4c749f13be008', 'request_id': 'req-67a8fe59-32bb-4a29-8c58-45799a90b2f3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:30.655271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da317322534f4411a8d4c749f13be008', 'request_id': 'req-67a8fe59-32bb-4a29-8c58-45799a90b2f3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:30.671707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da317322534f4411a8d4c749f13be008', 'request_id': 'req-67a8fe59-32bb-4a29-8c58-45799a90b2f3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:30.699357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] The token cache is being invalidate because project da317322534f4411a8d4c749f13be008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:30.700702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:30.709874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:30.717816 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3311/6635] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:30 2022] DELETE /identity/v3/projects/da317322534f4411a8d4c749f13be008 => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:30.761838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee375dae-d01a-434e-b362-24f71686b4e4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:30.765844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:30.769579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:30.782157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a96e2-7c97-413e-8b0a-05b2933286c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:30.782805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a96e2-7c97-413e-8b0a-05b2933286c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:30.783092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a96e2-7c97-413e-8b0a-05b2933286c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:30.783420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a96e2-7c97-413e-8b0a-05b2933286c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:30.784152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a96e2-7c97-413e-8b0a-05b2933286c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:30.786307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974a96e2-7c97-413e-8b0a-05b2933286c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:30.835292 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3325/6636] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:30 2022] POST /identity/v3/users => generated 291 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:30.837072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a96e2-7c97-413e-8b0a-05b2933286c2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:30.842513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-974a96e2-7c97-413e-8b0a-05b2933286c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:30.872600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a96e2-7c97-413e-8b0a-05b2933286c2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:30.919815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c75990-8791-45ad-b964-5de6f9be019a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:30.920547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c75990-8791-45ad-b964-5de6f9be019a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:30.920836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c75990-8791-45ad-b964-5de6f9be019a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:30.925040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c75990-8791-45ad-b964-5de6f9be019a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:30.925870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c75990-8791-45ad-b964-5de6f9be019a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:30.931235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c75990-8791-45ad-b964-5de6f9be019a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:30.957808 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3326/6637] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:22:30.959764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c75990-8791-45ad-b964-5de6f9be019a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:30.993118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c75990-8791-45ad-b964-5de6f9be019a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:31.017637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b76eb4-ea48-4b83-ba52-ae38199054b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:31.024640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a8fe59-32bb-4a29-8c58-45799a90b2f3 tempest-RoutersIpV6AdminTest-1111446207 tempest-RoutersIpV6AdminTest-1111446207-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:31.025441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b76eb4-ea48-4b83-ba52-ae38199054b2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:31.025895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b76eb4-ea48-4b83-ba52-ae38199054b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:31.026173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b76eb4-ea48-4b83-ba52-ae38199054b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:31.026856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b76eb4-ea48-4b83-ba52-ae38199054b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:31.039934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b76eb4-ea48-4b83-ba52-ae38199054b2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:31.080881 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3327/6638] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:31.086296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b76eb4-ea48-4b83-ba52-ae38199054b2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:31.121125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b76eb4-ea48-4b83-ba52-ae38199054b2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:31.146466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4791a2d7-442e-48f9-94fb-63a580d4ee0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:31.147861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a2d7-442e-48f9-94fb-63a580d4ee0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:31.148153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a2d7-442e-48f9-94fb-63a580d4ee0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:31.148431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4791a2d7-442e-48f9-94fb-63a580d4ee0d admin admin] PATH_INFO: `/v3/projects/4d1e02ca39f2424697cca9c0976b9965/users/b045e2d0ebbf4172a733832763e6adcd/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:31.165419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:31.167717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:31.168878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:31.169809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:31.172134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:31.192276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791a2d7-442e-48f9-94fb-63a580d4ee0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d1e02ca39f2424697cca9c0976b9965, user_id=b045e2d0ebbf4172a733832763e6adcd, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:31.199372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4791a2d7-442e-48f9-94fb-63a580d4ee0d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:31.300961 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3328/6639] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:31 2022] PUT /identity/v3/projects/4d1e02ca39f2424697cca9c0976b9965/users/b045e2d0ebbf4172a733832763e6adcd/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:22:31.311107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da5e2a-e118-404f-9360-9cbf493532bb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:31.313128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da5e2a-e118-404f-9360-9cbf493532bb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:31.313463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7da5e2a-e118-404f-9360-9cbf493532bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:31.361628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b7da5e2a-e118-404f-9360-9cbf493532bb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:31.364972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b7da5e2a-e118-404f-9360-9cbf493532bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:31.419340 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:31.478784 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:31.492229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:31.493741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:31.517779 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3329/6640] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:22:31.527751 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3312/6641] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:30 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 763 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:22:31.682235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da5e2a-e118-404f-9360-9cbf493532bb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:31.684097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b7da5e2a-e118-404f-9360-9cbf493532bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:31.862286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7da5e2a-e118-404f-9360-9cbf493532bb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:31.867331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b95a7-a330-4336-89d3-4e3675f27a64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:31.867980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b95a7-a330-4336-89d3-4e3675f27a64 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:31.868326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b95a7-a330-4336-89d3-4e3675f27a64 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:31.868605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b95a7-a330-4336-89d3-4e3675f27a64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:31.898757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b95a7-a330-4336-89d3-4e3675f27a64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:31.900256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b95a7-a330-4336-89d3-4e3675f27a64 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:31.923274 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3330/6642] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:33.460756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:33.463033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:33.510819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e36d030-81fb-42f8-8e61-563666f64ec5 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:33.547913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:33.550105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:33.550398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:33.551762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] PATH_INFO: `/v3/users/36cd1dbc142f43e38fcab5b4f0fbc2e2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:33.553929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36cd1dbc142f43e38fcab5b4f0fbc2e2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:33.557266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:33.717799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36cd1dbc142f43e38fcab5b4f0fbc2e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:33.732299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36cd1dbc142f43e38fcab5b4f0fbc2e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:33.733077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36cd1dbc142f43e38fcab5b4f0fbc2e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:33.743738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36cd1dbc142f43e38fcab5b4f0fbc2e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:33.762169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36cd1dbc142f43e38fcab5b4f0fbc2e2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:33.777249 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3313/6643] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:33 2022] DELETE /identity/v3/users/36cd1dbc142f43e38fcab5b4f0fbc2e2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:33.778301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209dcff-e5b4-496c-b1b8-274f87ea4fbb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:33.779174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209dcff-e5b4-496c-b1b8-274f87ea4fbb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:33.779764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c209dcff-e5b4-496c-b1b8-274f87ea4fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:33.825479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c209dcff-e5b4-496c-b1b8-274f87ea4fbb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:33.829517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c209dcff-e5b4-496c-b1b8-274f87ea4fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:34.001310 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3331/6644] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:34.020895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:34.023717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:34.130783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15130f20-7d18-493f-a00a-4f47a0e25bd7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:34.135838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bae75-5ff7-4911-8db7-6958f545a4f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:34.136612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bae75-5ff7-4911-8db7-6958f545a4f8 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:34.137007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bae75-5ff7-4911-8db7-6958f545a4f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:34.137577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bae75-5ff7-4911-8db7-6958f545a4f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:34.162835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bae75-5ff7-4911-8db7-6958f545a4f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:34.165694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bae75-5ff7-4911-8db7-6958f545a4f8 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:34.181045 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3314/6645] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:35.068304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209dcff-e5b4-496c-b1b8-274f87ea4fbb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:35.072613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c209dcff-e5b4-496c-b1b8-274f87ea4fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:35.122738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c209dcff-e5b4-496c-b1b8-274f87ea4fbb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:35.140140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:35.141224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:35.142588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:35.143149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] PATH_INFO: `/v3/projects/593f002715764c9da85db5bf4d1e5dbe` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:35.150337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=593f002715764c9da85db5bf4d1e5dbe)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:35.156128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:35.251737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '593f002715764c9da85db5bf4d1e5dbe', 'request_id': 'req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:35.261924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '593f002715764c9da85db5bf4d1e5dbe', 'request_id': 'req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:35.273117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '593f002715764c9da85db5bf4d1e5dbe', 'request_id': 'req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:35.289966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] The token cache is being invalidate because project 593f002715764c9da85db5bf4d1e5dbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:35.290257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:35.292169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4fcaf72f-b84f-499d-8d90-0e84e1ff8ecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:35.295113 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3332/6646] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:35 2022] DELETE /identity/v3/projects/593f002715764c9da85db5bf4d1e5dbe => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:35.300295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78b70-8fbb-47da-9b4a-ea9e9678e75e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:35.301673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78b70-8fbb-47da-9b4a-ea9e9678e75e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:35.301673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d78b70-8fbb-47da-9b4a-ea9e9678e75e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:35.336372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-74d78b70-8fbb-47da-9b4a-ea9e9678e75e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:35.338894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-74d78b70-8fbb-47da-9b4a-ea9e9678e75e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:35.410747 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:35.457360 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3315/6647] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:22:35.463228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30748da-6aed-4ec1-8fd9-ec1a6850be76 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:35.463549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30748da-6aed-4ec1-8fd9-ec1a6850be76 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:35.463825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30748da-6aed-4ec1-8fd9-ec1a6850be76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:35.495935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d30748da-6aed-4ec1-8fd9-ec1a6850be76 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:35.499320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d30748da-6aed-4ec1-8fd9-ec1a6850be76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:35.509334 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3333/6648] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:35.513356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78b70-8fbb-47da-9b4a-ea9e9678e75e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:35.532144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d78b70-8fbb-47da-9b4a-ea9e9678e75e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:35.538154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f75d8-50b5-4b75-9677-6c3b08701795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:35.538712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f75d8-50b5-4b75-9677-6c3b08701795 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:35.538996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f75d8-50b5-4b75-9677-6c3b08701795 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:35.539277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f75d8-50b5-4b75-9677-6c3b08701795 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:35.540275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f75d8-50b5-4b75-9677-6c3b08701795 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:22:35.540608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f75d8-50b5-4b75-9677-6c3b08701795 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:35.542454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768f75d8-50b5-4b75-9677-6c3b08701795 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:35.565047 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3316/6649] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:22:35.567096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30748da-6aed-4ec1-8fd9-ec1a6850be76 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:35.584346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30748da-6aed-4ec1-8fd9-ec1a6850be76 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:35.589866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92173b-472d-4028-982a-8cd5493fc79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:35.590494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92173b-472d-4028-982a-8cd5493fc79e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:35.590778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92173b-472d-4028-982a-8cd5493fc79e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:35.591137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92173b-472d-4028-982a-8cd5493fc79e admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:35.592253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92173b-472d-4028-982a-8cd5493fc79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:35.594325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92173b-472d-4028-982a-8cd5493fc79e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:35.609801 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:35.670030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f75d8-50b5-4b75-9677-6c3b08701795 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:35.686567 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3334/6650] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:35 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:35.692457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768f75d8-50b5-4b75-9677-6c3b08701795 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:35.789193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c4889-d611-4063-ae3a-a5da63b5dae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:35.790763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4889-d611-4063-ae3a-a5da63b5dae1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:35.791195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4889-d611-4063-ae3a-a5da63b5dae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:35.791701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c4889-d611-4063-ae3a-a5da63b5dae1 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:35.792562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c4889-d611-4063-ae3a-a5da63b5dae1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:35.795424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c4889-d611-4063-ae3a-a5da63b5dae1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:35.835613 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3317/6651] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:35 2022] POST /identity/v3/users => generated 292 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:35.839596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92173b-472d-4028-982a-8cd5493fc79e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:35.850469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92173b-472d-4028-982a-8cd5493fc79e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:35.861659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6e46-b05c-43ff-9d39-d3b59bcefdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:35.862288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6e46-b05c-43ff-9d39-d3b59bcefdd8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:35.862566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6e46-b05c-43ff-9d39-d3b59bcefdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:35.864025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baa6e46-b05c-43ff-9d39-d3b59bcefdd8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:35.864705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6e46-b05c-43ff-9d39-d3b59bcefdd8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:35.866479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baa6e46-b05c-43ff-9d39-d3b59bcefdd8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:35.893165 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3335/6652] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:35.899150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c4889-d611-4063-ae3a-a5da63b5dae1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:35.919467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c4889-d611-4063-ae3a-a5da63b5dae1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:35.932643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ced9b1-e56a-43a0-9b2b-32efd9860aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:35.933326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ced9b1-e56a-43a0-9b2b-32efd9860aff admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:35.933851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ced9b1-e56a-43a0-9b2b-32efd9860aff admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:35.934141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ced9b1-e56a-43a0-9b2b-32efd9860aff admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:35.936529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ced9b1-e56a-43a0-9b2b-32efd9860aff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:35.938733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ced9b1-e56a-43a0-9b2b-32efd9860aff admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:35.960696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6e46-b05c-43ff-9d39-d3b59bcefdd8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:35.977185 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3318/6653] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:35.985218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baa6e46-b05c-43ff-9d39-d3b59bcefdd8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:35.993481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12ad0-7ec4-4684-b2de-09a9001c275a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:35.994199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12ad0-7ec4-4684-b2de-09a9001c275a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:35.994614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12ad0-7ec4-4684-b2de-09a9001c275a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:35.994895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c12ad0-7ec4-4684-b2de-09a9001c275a admin admin] PATH_INFO: `/v3/projects/6aac0f8a19c54aedbb870ecf3953ace6/users/4f36e9706292448e94c99321c0782028/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:36.024874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c12ad0-7ec4-4684-b2de-09a9001c275a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aac0f8a19c54aedbb870ecf3953ace6, user_id=4f36e9706292448e94c99321c0782028, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:36.034631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c12ad0-7ec4-4684-b2de-09a9001c275a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:36.080390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3336/6654] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:35 2022] PUT /identity/v3/projects/6aac0f8a19c54aedbb870ecf3953ace6/users/4f36e9706292448e94c99321c0782028/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:36.094765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c63031-3111-43eb-a042-7fc47a330647 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:36.095055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c63031-3111-43eb-a042-7fc47a330647 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:36.095338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c63031-3111-43eb-a042-7fc47a330647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:36.198356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d0c63031-3111-43eb-a042-7fc47a330647 None None] MFA Rules not processed for user `4f36e9706292448e94c99321c0782028`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:36.199583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0c63031-3111-43eb-a042-7fc47a330647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:36.368021 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3319/6655] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:36.410870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12ad0-7ec4-4684-b2de-09a9001c275a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:36.417327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-63c12ad0-7ec4-4684-b2de-09a9001c275a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:36.574206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c12ad0-7ec4-4684-b2de-09a9001c275a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:36.581338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282f84-9a86-4057-b46b-f8b8629b40cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:36.582769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282f84-9a86-4057-b46b-f8b8629b40cd service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:36.584633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282f84-9a86-4057-b46b-f8b8629b40cd service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:36.585091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6282f84-9a86-4057-b46b-f8b8629b40cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:36.612287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282f84-9a86-4057-b46b-f8b8629b40cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:36.613838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6282f84-9a86-4057-b46b-f8b8629b40cd service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:36.639468 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3337/6656] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:38.077533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c63031-3111-43eb-a042-7fc47a330647 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:38.077533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0c63031-3111-43eb-a042-7fc47a330647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:38.143928 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:38.177636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c63031-3111-43eb-a042-7fc47a330647 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:38.195070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7506b-06ec-4363-8bd6-ca458f6f8d14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:38.195070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7506b-06ec-4363-8bd6-ca458f6f8d14 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:38.195070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7506b-06ec-4363-8bd6-ca458f6f8d14 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:38.195070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7506b-06ec-4363-8bd6-ca458f6f8d14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:38.195493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e0b7506b-06ec-4363-8bd6-ca458f6f8d14 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:38.210052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7506b-06ec-4363-8bd6-ca458f6f8d14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:38.211663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7506b-06ec-4363-8bd6-ca458f6f8d14 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:38.237717 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3320/6657] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:38.373485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282f84-9a86-4057-b46b-f8b8629b40cd service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:38.510438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6282f84-9a86-4057-b46b-f8b8629b40cd service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:38.523269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:38.524852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:38.525363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:38.525820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] PATH_INFO: `/v3/users/4f36e9706292448e94c99321c0782028` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:38.527264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f36e9706292448e94c99321c0782028)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:38.529428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:38.634022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f36e9706292448e94c99321c0782028'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:38.655366 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:38.664416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f36e9706292448e94c99321c0782028'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:38.666158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f36e9706292448e94c99321c0782028'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:38.679672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f36e9706292448e94c99321c0782028'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:38.693940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f36e9706292448e94c99321c0782028'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:38.705248 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3338/6658] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:38 2022] DELETE /identity/v3/users/4f36e9706292448e94c99321c0782028 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:22:38.710796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fc53-b55f-48ce-9a7a-ffa4f39e1cab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:38.712084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fc53-b55f-48ce-9a7a-ffa4f39e1cab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:38.712475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1012fc53-b55f-48ce-9a7a-ffa4f39e1cab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:38.749825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1012fc53-b55f-48ce-9a7a-ffa4f39e1cab None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:38.751717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1012fc53-b55f-48ce-9a7a-ffa4f39e1cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:38.854518 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3321/6659] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:38.867828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:38.871202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:38.992828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d534b2-5dcd-4f7b-97f4-7123d093ec75 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:38.998866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14500a6-dcc7-4e79-a31c-28da98289f30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:39.002251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14500a6-dcc7-4e79-a31c-28da98289f30 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:39.003268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14500a6-dcc7-4e79-a31c-28da98289f30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:39.003717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14500a6-dcc7-4e79-a31c-28da98289f30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:39.034699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14500a6-dcc7-4e79-a31c-28da98289f30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:39.036820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14500a6-dcc7-4e79-a31c-28da98289f30 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:39.053245 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3339/6660] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:39.828958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97aff4-3749-4fd4-a941-23d55ebf923a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:39.830096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97aff4-3749-4fd4-a941-23d55ebf923a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:39.830649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d97aff4-3749-4fd4-a941-23d55ebf923a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:39.868830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0d97aff4-3749-4fd4-a941-23d55ebf923a None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:39.872231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d97aff4-3749-4fd4-a941-23d55ebf923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:39.894861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14500a6-dcc7-4e79-a31c-28da98289f30 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:39.896619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f14500a6-dcc7-4e79-a31c-28da98289f30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:39.915507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14500a6-dcc7-4e79-a31c-28da98289f30 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:39.942505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:39.943327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:39.944194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:39.946329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] PATH_INFO: `/v3/projects/6aac0f8a19c54aedbb870ecf3953ace6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:39.947968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aac0f8a19c54aedbb870ecf3953ace6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:39.950886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:39.988310 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3322/6661] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:22:39 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:40.027940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97aff4-3749-4fd4-a941-23d55ebf923a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:40.029914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d97aff4-3749-4fd4-a941-23d55ebf923a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:40.069371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aac0f8a19c54aedbb870ecf3953ace6', 'request_id': 'req-c96c9bc7-078e-40eb-805b-7f6f650a873e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:40.079182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aac0f8a19c54aedbb870ecf3953ace6', 'request_id': 'req-c96c9bc7-078e-40eb-805b-7f6f650a873e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:40.099974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aac0f8a19c54aedbb870ecf3953ace6', 'request_id': 'req-c96c9bc7-078e-40eb-805b-7f6f650a873e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:40.115945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] The token cache is being invalidate because project 6aac0f8a19c54aedbb870ecf3953ace6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:40.116353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:40.117384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c96c9bc7-078e-40eb-805b-7f6f650a873e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:40.123065 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3340/6662] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:39 2022] DELETE /identity/v3/projects/6aac0f8a19c54aedbb870ecf3953ace6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:40.126707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66724e4-56fe-451a-b918-a4ad1e57e9b2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:40.126988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66724e4-56fe-451a-b918-a4ad1e57e9b2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:40.127259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66724e4-56fe-451a-b918-a4ad1e57e9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:40.167729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a66724e4-56fe-451a-b918-a4ad1e57e9b2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:40.169214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a66724e4-56fe-451a-b918-a4ad1e57e9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:40.172277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d97aff4-3749-4fd4-a941-23d55ebf923a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:40.212156 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:40.306132 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3341/6663] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:40.307125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66724e4-56fe-451a-b918-a4ad1e57e9b2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:40.323817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a66724e4-56fe-451a-b918-a4ad1e57e9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:40.342427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0888d1ad-29f7-404d-b9f1-e1f62b94e9b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:40.342705 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:40.344819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888d1ad-29f7-404d-b9f1-e1f62b94e9b7 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:40.345765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888d1ad-29f7-404d-b9f1-e1f62b94e9b7 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:40.346185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0888d1ad-29f7-404d-b9f1-e1f62b94e9b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:40.360359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0888d1ad-29f7-404d-b9f1-e1f62b94e9b7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:40.476817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888d1ad-29f7-404d-b9f1-e1f62b94e9b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:40.479349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0888d1ad-29f7-404d-b9f1-e1f62b94e9b7 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:40.479694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66724e4-56fe-451a-b918-a4ad1e57e9b2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:40.491893 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3323/6664] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:22:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:22:40.493346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aca7a-cf0b-4503-8e93-a0eb6df77c00 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:40.493649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aca7a-cf0b-4503-8e93-a0eb6df77c00 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:40.493984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aca7a-cf0b-4503-8e93-a0eb6df77c00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:40.517446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b39a7-1a85-4315-8072-aac0cc83752d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:40.518134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b39a7-1a85-4315-8072-aac0cc83752d service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:40.518413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b39a7-1a85-4315-8072-aac0cc83752d service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:40.518687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9b39a7-1a85-4315-8072-aac0cc83752d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:40.520227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a64aca7a-cf0b-4503-8e93-a0eb6df77c00 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:40.522044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a64aca7a-cf0b-4503-8e93-a0eb6df77c00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:40.526800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ec9b39a7-1a85-4315-8072-aac0cc83752d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:40.534847 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3324/6665] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:40.538006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aca7a-cf0b-4503-8e93-a0eb6df77c00 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:40.556094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64aca7a-cf0b-4503-8e93-a0eb6df77c00 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:40.560369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b39a7-1a85-4315-8072-aac0cc83752d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:40.562029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9b39a7-1a85-4315-8072-aac0cc83752d service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:40.563588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9702b-ebd7-462d-88c0-d1c46bf87611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:40.564209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9702b-ebd7-462d-88c0-d1c46bf87611 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:40.564496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9702b-ebd7-462d-88c0-d1c46bf87611 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:40.564777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9702b-ebd7-462d-88c0-d1c46bf87611 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:40.565471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9702b-ebd7-462d-88c0-d1c46bf87611 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:22:40.565826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9702b-ebd7-462d-88c0-d1c46bf87611 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:40.568170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9702b-ebd7-462d-88c0-d1c46bf87611 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:40.583727 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3325/6666] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:22:40.584382 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3342/6667] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:40 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:40.597680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9702b-ebd7-462d-88c0-d1c46bf87611 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:40.620622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9702b-ebd7-462d-88c0-d1c46bf87611 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:40.643613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73fc89-600f-4bea-bb8b-dba05d9bdd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:40.644411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73fc89-600f-4bea-bb8b-dba05d9bdd3e admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:40.644762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73fc89-600f-4bea-bb8b-dba05d9bdd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:40.645732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b73fc89-600f-4bea-bb8b-dba05d9bdd3e admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:40.646634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73fc89-600f-4bea-bb8b-dba05d9bdd3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:40.649900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b73fc89-600f-4bea-bb8b-dba05d9bdd3e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:40.700954 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3326/6668] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:40 2022] POST /identity/v3/projects => generated 363 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:40.705376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b39a7-1a85-4315-8072-aac0cc83752d service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:40.730089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9b39a7-1a85-4315-8072-aac0cc83752d service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:40.877065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac658d7-e5f4-426f-ab88-70f5228e24f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:40.878362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac658d7-e5f4-426f-ab88-70f5228e24f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:40.878362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac658d7-e5f4-426f-ab88-70f5228e24f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:40.878362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac658d7-e5f4-426f-ab88-70f5228e24f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:40.879053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac658d7-e5f4-426f-ab88-70f5228e24f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:40.881724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac658d7-e5f4-426f-ab88-70f5228e24f4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:40.933197 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3343/6669] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:40 2022] POST /identity/v3/users => generated 282 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:40.937646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73fc89-600f-4bea-bb8b-dba05d9bdd3e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:40.957614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b73fc89-600f-4bea-bb8b-dba05d9bdd3e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:40.975869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7382f-0cbc-4cf0-aa23-7972c6eda51b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:40.978274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7382f-0cbc-4cf0-aa23-7972c6eda51b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:40.980041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7382f-0cbc-4cf0-aa23-7972c6eda51b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:40.980346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a7382f-0cbc-4cf0-aa23-7972c6eda51b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:40.981488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7382f-0cbc-4cf0-aa23-7972c6eda51b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:40.983138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a7382f-0cbc-4cf0-aa23-7972c6eda51b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:41.005116 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3327/6670] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:41.007991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac658d7-e5f4-426f-ab88-70f5228e24f4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:41.031935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac658d7-e5f4-426f-ab88-70f5228e24f4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:41.041970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50455b23-c079-4b94-b819-d8fbeafdded6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:41.042590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455b23-c079-4b94-b819-d8fbeafdded6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:41.042869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455b23-c079-4b94-b819-d8fbeafdded6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:41.043139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50455b23-c079-4b94-b819-d8fbeafdded6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:41.043782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50455b23-c079-4b94-b819-d8fbeafdded6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:41.045417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50455b23-c079-4b94-b819-d8fbeafdded6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:41.089127 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3344/6671] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:41 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:41.090497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7382f-0cbc-4cf0-aa23-7972c6eda51b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:41.102752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a7382f-0cbc-4cf0-aa23-7972c6eda51b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:41.110841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d6d6c-593e-4359-a5a0-066157216e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:41.111932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d6d6c-593e-4359-a5a0-066157216e44 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:41.112222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d6d6c-593e-4359-a5a0-066157216e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:41.112570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d6d6c-593e-4359-a5a0-066157216e44 admin admin] PATH_INFO: `/v3/projects/111ce72c00d745d69ceb04183b50abd0/users/5a97fc9cee17444699a11bd8baa5a4d9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:41.158328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d6d6c-593e-4359-a5a0-066157216e44 admin admin] RBAC: Authorizing `identity:create_grant(project_id=111ce72c00d745d69ceb04183b50abd0, user_id=5a97fc9cee17444699a11bd8baa5a4d9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:41.166062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d6d6c-593e-4359-a5a0-066157216e44 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:41.194126 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3328/6672] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:41 2022] PUT /identity/v3/projects/111ce72c00d745d69ceb04183b50abd0/users/5a97fc9cee17444699a11bd8baa5a4d9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:41.204511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a304b06-f439-41ea-a339-939dff1bbd69 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:41.204800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a304b06-f439-41ea-a339-939dff1bbd69 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:41.205247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a304b06-f439-41ea-a339-939dff1bbd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:41.251742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1a304b06-f439-41ea-a339-939dff1bbd69 None None] MFA Rules not processed for user `5a97fc9cee17444699a11bd8baa5a4d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:41.253187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a304b06-f439-41ea-a339-939dff1bbd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:41.381398 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:41.395889 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3345/6673] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:41.433609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d6d6c-593e-4359-a5a0-066157216e44 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:41.436442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5e5d6d6c-593e-4359-a5a0-066157216e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:41.567998 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:41.581685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d6d6c-593e-4359-a5a0-066157216e44 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:41.586109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bac873-77b8-4433-b9b1-fc68c2f993a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:41.586780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bac873-77b8-4433-b9b1-fc68c2f993a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:41.587057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bac873-77b8-4433-b9b1-fc68c2f993a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:41.587339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8bac873-77b8-4433-b9b1-fc68c2f993a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:41.603110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bac873-77b8-4433-b9b1-fc68c2f993a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:41.604869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8bac873-77b8-4433-b9b1-fc68c2f993a0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:41.618484 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3329/6674] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:44.620496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da9af4-fb36-44c6-82a2-6f0dfb1e183c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:44.621654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da9af4-fb36-44c6-82a2-6f0dfb1e183c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:44.622165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47da9af4-fb36-44c6-82a2-6f0dfb1e183c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:44.661460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-47da9af4-fb36-44c6-82a2-6f0dfb1e183c None None] MFA Rules not processed for user `b045e2d0ebbf4172a733832763e6adcd`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:44.663467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-47da9af4-fb36-44c6-82a2-6f0dfb1e183c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:44.809633 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3346/6675] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:44 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:44.813840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bac873-77b8-4433-b9b1-fc68c2f993a0 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:44.825214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a8bac873-77b8-4433-b9b1-fc68c2f993a0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:45.040856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8bac873-77b8-4433-b9b1-fc68c2f993a0 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:45.064484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2492c-11ac-4f75-ae1a-58a392719da2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:45.065992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2492c-11ac-4f75-ae1a-58a392719da2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:45.066843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2492c-11ac-4f75-ae1a-58a392719da2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:45.067124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2492c-11ac-4f75-ae1a-58a392719da2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:45.067978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2492c-11ac-4f75-ae1a-58a392719da2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:45.076486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c2492c-11ac-4f75-ae1a-58a392719da2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:45.135593 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3330/6676] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:44 2022] POST /identity/v3/projects => generated 381 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:22:45.146192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da9af4-fb36-44c6-82a2-6f0dfb1e183c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:45.164648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47da9af4-fb36-44c6-82a2-6f0dfb1e183c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:45.299560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e229a-9964-413c-ac13-dae22b017d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:45.303758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e229a-9964-413c-ac13-dae22b017d5b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:45.303758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e229a-9964-413c-ac13-dae22b017d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:45.303958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4e229a-9964-413c-ac13-dae22b017d5b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:45.304452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e229a-9964-413c-ac13-dae22b017d5b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:45.307922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4e229a-9964-413c-ac13-dae22b017d5b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:45.353162 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3347/6677] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:45 2022] POST /identity/v3/users => generated 297 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:45.353657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2492c-11ac-4f75-ae1a-58a392719da2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:45.371636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2492c-11ac-4f75-ae1a-58a392719da2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:45.383787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cb211-5717-4a81-931a-b3fcc7c92300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:45.384144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cb211-5717-4a81-931a-b3fcc7c92300 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:45.384401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cb211-5717-4a81-931a-b3fcc7c92300 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:45.384688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660cb211-5717-4a81-931a-b3fcc7c92300 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:45.385401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cb211-5717-4a81-931a-b3fcc7c92300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:45.387053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660cb211-5717-4a81-931a-b3fcc7c92300 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:45.422933 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3331/6678] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:22:45.427200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e229a-9964-413c-ac13-dae22b017d5b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:45.451317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4e229a-9964-413c-ac13-dae22b017d5b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:45.456784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fab65-645f-487a-944d-86c51f3ed2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:45.457655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fab65-645f-487a-944d-86c51f3ed2f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:45.458019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fab65-645f-487a-944d-86c51f3ed2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:45.458524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25fab65-645f-487a-944d-86c51f3ed2f1 admin admin] PATH_INFO: `/v3/projects/9c52f6db137b471b8ad35b2085f9f0b0/users/c77010456a034195bd4c7ddd566f81b3/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:45.496778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fab65-645f-487a-944d-86c51f3ed2f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c52f6db137b471b8ad35b2085f9f0b0, user_id=c77010456a034195bd4c7ddd566f81b3, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:45.499893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25fab65-645f-487a-944d-86c51f3ed2f1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:45.540077 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3348/6679] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:45 2022] PUT /identity/v3/projects/9c52f6db137b471b8ad35b2085f9f0b0/users/c77010456a034195bd4c7ddd566f81b3/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:45.544078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cb211-5717-4a81-931a-b3fcc7c92300 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:45.560210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660cb211-5717-4a81-931a-b3fcc7c92300 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:45.707605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6653eb3-cd61-4dd6-8523-5545f71d6bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:45.708459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6653eb3-cd61-4dd6-8523-5545f71d6bdc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:45.711004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6653eb3-cd61-4dd6-8523-5545f71d6bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:45.711298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6653eb3-cd61-4dd6-8523-5545f71d6bdc admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:45.711975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6653eb3-cd61-4dd6-8523-5545f71d6bdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:45.713646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6653eb3-cd61-4dd6-8523-5545f71d6bdc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:45.742246 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3332/6680] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:22:45.743735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fab65-645f-487a-944d-86c51f3ed2f1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:45.755699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25fab65-645f-487a-944d-86c51f3ed2f1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:45.773827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca984fe3-c1a3-402d-bb72-f5e5d16f4816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:45.774818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca984fe3-c1a3-402d-bb72-f5e5d16f4816 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:45.775274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca984fe3-c1a3-402d-bb72-f5e5d16f4816 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:45.775722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca984fe3-c1a3-402d-bb72-f5e5d16f4816 admin admin] PATH_INFO: `/v3/projects/9c52f6db137b471b8ad35b2085f9f0b0/users/c77010456a034195bd4c7ddd566f81b3/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:45.781864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca984fe3-c1a3-402d-bb72-f5e5d16f4816 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c52f6db137b471b8ad35b2085f9f0b0, user_id=c77010456a034195bd4c7ddd566f81b3, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:45.784758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca984fe3-c1a3-402d-bb72-f5e5d16f4816 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:45.815686 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3349/6681] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:45 2022] PUT /identity/v3/projects/9c52f6db137b471b8ad35b2085f9f0b0/users/c77010456a034195bd4c7ddd566f81b3/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:53.822263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6653eb3-cd61-4dd6-8523-5545f71d6bdc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:53.828054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e6653eb3-cd61-4dd6-8523-5545f71d6bdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:53.852110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6653eb3-cd61-4dd6-8523-5545f71d6bdc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:53.984652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:53.985401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:53.985637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:53.985895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] PATH_INFO: `/v3/users/94fd900fea9f446db27ecd43f3309ac9` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:53.987173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fd900fea9f446db27ecd43f3309ac9)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:53.991778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:53.993311 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:54.103690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fd900fea9f446db27ecd43f3309ac9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:54.151877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fd900fea9f446db27ecd43f3309ac9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:54.157789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fd900fea9f446db27ecd43f3309ac9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:54.180572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fd900fea9f446db27ecd43f3309ac9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:54.221672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fd900fea9f446db27ecd43f3309ac9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:54.229951 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3333/6682] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:22:53 2022] DELETE /identity/v3/users/94fd900fea9f446db27ecd43f3309ac9 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:54.234593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff211f01-f94e-4de3-b946-f181265a6085 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:54.235139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff211f01-f94e-4de3-b946-f181265a6085 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:54.235439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff211f01-f94e-4de3-b946-f181265a6085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:54.264609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ff211f01-f94e-4de3-b946-f181265a6085 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:54.266256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ff211f01-f94e-4de3-b946-f181265a6085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:54.317611 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:54.363898 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3350/6683] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:54.376506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:54.378924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:54.473203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db0dd1-fdc4-440a-9668-b146f5fefad6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:54.478826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00317d-ae45-4a57-aada-13a276de330c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:54.479647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00317d-ae45-4a57-aada-13a276de330c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:54.480340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00317d-ae45-4a57-aada-13a276de330c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:54.480807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00317d-ae45-4a57-aada-13a276de330c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:54.495664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00317d-ae45-4a57-aada-13a276de330c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:54.497176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00317d-ae45-4a57-aada-13a276de330c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:54.511461 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3334/6684] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:22:54.731809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff211f01-f94e-4de3-b946-f181265a6085 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:54.734000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ff211f01-f94e-4de3-b946-f181265a6085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:54.760143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff211f01-f94e-4de3-b946-f181265a6085 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:54.769354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:54.770411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:54.771495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:54.771941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] PATH_INFO: `/v3/projects/477f8b121a454b0992bae9a1fdcb9107` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:54.774107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=477f8b121a454b0992bae9a1fdcb9107)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:54.777342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:54.961505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '477f8b121a454b0992bae9a1fdcb9107', 'request_id': 'req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:54.978873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '477f8b121a454b0992bae9a1fdcb9107', 'request_id': 'req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:55.000414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '477f8b121a454b0992bae9a1fdcb9107', 'request_id': 'req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:55.020779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] The token cache is being invalidate because project 477f8b121a454b0992bae9a1fdcb9107 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:22:55.021387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:55.022301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f9eecfed-8cec-4cd7-b523-6b736b34fa7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:22:55.024332 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3351/6685] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:22:54 2022] DELETE /identity/v3/projects/477f8b121a454b0992bae9a1fdcb9107 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:55.029708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8272f-364c-4cea-bf4f-aa7f3991db0e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:55.030186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8272f-364c-4cea-bf4f-aa7f3991db0e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:55.030186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8272f-364c-4cea-bf4f-aa7f3991db0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:55.093028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e3e8272f-364c-4cea-bf4f-aa7f3991db0e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:55.095614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e3e8272f-364c-4cea-bf4f-aa7f3991db0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:55.203506 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3335/6686] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:55.205838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502c51e-03ff-409d-9f85-2cec8af60585 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:55.206205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502c51e-03ff-409d-9f85-2cec8af60585 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:55.207215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502c51e-03ff-409d-9f85-2cec8af60585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:55.253160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6502c51e-03ff-409d-9f85-2cec8af60585 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:55.258147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6502c51e-03ff-409d-9f85-2cec8af60585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:55.287844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8272f-364c-4cea-bf4f-aa7f3991db0e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:55.297975 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3352/6687] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:55.299465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8272f-364c-4cea-bf4f-aa7f3991db0e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:55.307541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007509b-2af1-4ceb-9f2b-9487b6f76982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:55.309580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007509b-2af1-4ceb-9f2b-9487b6f76982 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:55.310087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007509b-2af1-4ceb-9f2b-9487b6f76982 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:55.310951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f007509b-2af1-4ceb-9f2b-9487b6f76982 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:55.312841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007509b-2af1-4ceb-9f2b-9487b6f76982 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:22:55.313605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007509b-2af1-4ceb-9f2b-9487b6f76982 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:55.323282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f007509b-2af1-4ceb-9f2b-9487b6f76982 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:55.348035 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3336/6688] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:22:55.348748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502c51e-03ff-409d-9f85-2cec8af60585 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:55.358588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502c51e-03ff-409d-9f85-2cec8af60585 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:55.364556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be9ceb-5479-4c45-b738-18a01163eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:55.365756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be9ceb-5479-4c45-b738-18a01163eb28 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:55.366297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be9ceb-5479-4c45-b738-18a01163eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:55.366805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be9ceb-5479-4c45-b738-18a01163eb28 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:55.367731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be9ceb-5479-4c45-b738-18a01163eb28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:55.370025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be9ceb-5479-4c45-b738-18a01163eb28 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:55.410170 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3353/6689] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:22:55 2022] POST /identity/v3/projects => generated 359 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:55.415219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007509b-2af1-4ceb-9f2b-9487b6f76982 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:55.427402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f007509b-2af1-4ceb-9f2b-9487b6f76982 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:55.438984 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:22:55.512361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82947d3d-6345-41c3-bf73-2b9f62db82bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:55.513119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82947d3d-6345-41c3-bf73-2b9f62db82bc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:55.513524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82947d3d-6345-41c3-bf73-2b9f62db82bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:55.513897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82947d3d-6345-41c3-bf73-2b9f62db82bc admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:55.514635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82947d3d-6345-41c3-bf73-2b9f62db82bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:55.516740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82947d3d-6345-41c3-bf73-2b9f62db82bc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:55.545380 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3337/6690] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:22:55 2022] POST /identity/v3/users => generated 280 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:22:55.547364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be9ceb-5479-4c45-b738-18a01163eb28 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:55.558985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be9ceb-5479-4c45-b738-18a01163eb28 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:55.563945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4831e-14d1-4c6f-949f-b1d7268ad660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:55.564648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4831e-14d1-4c6f-949f-b1d7268ad660 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:55.565119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4831e-14d1-4c6f-949f-b1d7268ad660 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:55.566758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe4831e-14d1-4c6f-949f-b1d7268ad660 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:55.567564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4831e-14d1-4c6f-949f-b1d7268ad660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:55.569465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe4831e-14d1-4c6f-949f-b1d7268ad660 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:55.581508 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3354/6691] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:55.585252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82947d3d-6345-41c3-bf73-2b9f62db82bc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:55.597908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82947d3d-6345-41c3-bf73-2b9f62db82bc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:55.603796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509119a4-ea0f-4174-9339-d664de738d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:55.604541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509119a4-ea0f-4174-9339-d664de738d67 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:55.604904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509119a4-ea0f-4174-9339-d664de738d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:55.605281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509119a4-ea0f-4174-9339-d664de738d67 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:55.606153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509119a4-ea0f-4174-9339-d664de738d67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:55.607937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509119a4-ea0f-4174-9339-d664de738d67 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:55.623244 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3338/6692] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:22:55.627168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4831e-14d1-4c6f-949f-b1d7268ad660 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:55.642137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe4831e-14d1-4c6f-949f-b1d7268ad660 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:55.657336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba339e8-6bb0-43da-bc42-b49b72ec5949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:55.658461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba339e8-6bb0-43da-bc42-b49b72ec5949 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:55.659004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba339e8-6bb0-43da-bc42-b49b72ec5949 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:55.659547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba339e8-6bb0-43da-bc42-b49b72ec5949 admin admin] PATH_INFO: `/v3/projects/1d84b28bdbc643c39eadc29be5fe460d/users/d8418557e89941a88a0e52f66d021e21/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:55.684904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba339e8-6bb0-43da-bc42-b49b72ec5949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d84b28bdbc643c39eadc29be5fe460d, user_id=d8418557e89941a88a0e52f66d021e21, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:55.688964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba339e8-6bb0-43da-bc42-b49b72ec5949 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:55.710430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3355/6693] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:22:55 2022] PUT /identity/v3/projects/1d84b28bdbc643c39eadc29be5fe460d/users/d8418557e89941a88a0e52f66d021e21/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:22:55.727572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e03c-5569-4a9e-99f9-39c0dacf7db7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:55.729451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e03c-5569-4a9e-99f9-39c0dacf7db7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:55.729624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8381e03c-5569-4a9e-99f9-39c0dacf7db7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:55.770180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8381e03c-5569-4a9e-99f9-39c0dacf7db7 None None] MFA Rules not processed for user `d8418557e89941a88a0e52f66d021e21`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:22:55.771561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8381e03c-5569-4a9e-99f9-39c0dacf7db7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:55.867217 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3339/6694] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:22:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:22:55.886543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba339e8-6bb0-43da-bc42-b49b72ec5949 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:22:55.888466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9ba339e8-6bb0-43da-bc42-b49b72ec5949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:22:56.031656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba339e8-6bb0-43da-bc42-b49b72ec5949 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:22:56.044806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e538e8b-ec41-438f-91de-df4e036e07e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:22:56.046715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e538e8b-ec41-438f-91de-df4e036e07e2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:22:56.047114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e538e8b-ec41-438f-91de-df4e036e07e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:22:56.049195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e538e8b-ec41-438f-91de-df4e036e07e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:22:56.073860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e538e8b-ec41-438f-91de-df4e036e07e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:22:56.076129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e538e8b-ec41-438f-91de-df4e036e07e2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:22:56.089320 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3356/6695] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:22:55 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:23:02.462369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f227cc-7236-412a-bece-789164426a1c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:02.463027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f227cc-7236-412a-bece-789164426a1c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:02.463027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f227cc-7236-412a-bece-789164426a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:02.593054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-55f227cc-7236-412a-bece-789164426a1c None None] MFA Rules not processed for user `c77010456a034195bd4c7ddd566f81b3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:02.602647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-55f227cc-7236-412a-bece-789164426a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:02.850584 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3340/6696] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:02 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 384 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:02.863042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e538e8b-ec41-438f-91de-df4e036e07e2 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:02.864711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4e538e8b-ec41-438f-91de-df4e036e07e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:02.870414 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:03.078839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e538e8b-ec41-438f-91de-df4e036e07e2 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:03.094821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb8645-f418-4248-84db-f0f0c1904a52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:03.095552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb8645-f418-4248-84db-f0f0c1904a52 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:03.095921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb8645-f418-4248-84db-f0f0c1904a52 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:03.096891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb8645-f418-4248-84db-f0f0c1904a52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:03.119994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb8645-f418-4248-84db-f0f0c1904a52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:03.122606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb8645-f418-4248-84db-f0f0c1904a52 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:03.149247 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3357/6697] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:23:02 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:23:12.833990 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:13.135121 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=33 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:14.850802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d5f81-34be-4dc5-8670-ccf3730b4587 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:14.851800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d5f81-34be-4dc5-8670-ccf3730b4587 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:14.852334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136d5f81-34be-4dc5-8670-ccf3730b4587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:14.910453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-136d5f81-34be-4dc5-8670-ccf3730b4587 None None] MFA Rules not processed for user `b62fde68e8c747bfbea881c71421c5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:14.912652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-136d5f81-34be-4dc5-8670-ccf3730b4587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:15.122234 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3341/6698] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:14 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:25.119398 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=29 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:32.656963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb8645-f418-4248-84db-f0f0c1904a52 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:32.659265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7bb8645-f418-4248-84db-f0f0c1904a52 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:32.687868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb8645-f418-4248-84db-f0f0c1904a52 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:32.701802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e21aa0-f4b8-49fa-816a-c20968b47eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:32.702422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e21aa0-f4b8-49fa-816a-c20968b47eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:32.702917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e21aa0-f4b8-49fa-816a-c20968b47eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:32.703374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e21aa0-f4b8-49fa-816a-c20968b47eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:32.705384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-16e21aa0-f4b8-49fa-816a-c20968b47eb4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:32.844173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e21aa0-f4b8-49fa-816a-c20968b47eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:32.846963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e21aa0-f4b8-49fa-816a-c20968b47eb4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:32.872904 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3358/6699] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:23:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:23:35.761100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d5f81-34be-4dc5-8670-ccf3730b4587 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:35.763397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-136d5f81-34be-4dc5-8670-ccf3730b4587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:35.786328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136d5f81-34be-4dc5-8670-ccf3730b4587 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:35.796501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:35.800817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:35.801531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:35.802293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] PATH_INFO: `/v3/users/b045e2d0ebbf4172a733832763e6adcd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:35.805827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] RBAC: Authorizing `identity:delete_user(user_id=b045e2d0ebbf4172a733832763e6adcd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:35.808276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:35.898012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b045e2d0ebbf4172a733832763e6adcd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:35.915060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b045e2d0ebbf4172a733832763e6adcd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:35.915912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b045e2d0ebbf4172a733832763e6adcd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:35.930098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b045e2d0ebbf4172a733832763e6adcd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:35.951478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b045e2d0ebbf4172a733832763e6adcd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:35.963105 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3342/6700] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:23:35 2022] DELETE /identity/v3/users/b045e2d0ebbf4172a733832763e6adcd => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:37.214191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e21aa0-f4b8-49fa-816a-c20968b47eb4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:37.234666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e21aa0-f4b8-49fa-816a-c20968b47eb4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:37.340799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:37.341678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:37.341963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:37.342389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] PATH_INFO: `/v3/projects/4d1e02ca39f2424697cca9c0976b9965` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:37.343842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d1e02ca39f2424697cca9c0976b9965)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:37.347987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:37.461288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d1e02ca39f2424697cca9c0976b9965', 'request_id': 'req-febb2c79-ff75-440a-ac9f-152618b46ccc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.471562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d1e02ca39f2424697cca9c0976b9965', 'request_id': 'req-febb2c79-ff75-440a-ac9f-152618b46ccc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.487838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d1e02ca39f2424697cca9c0976b9965', 'request_id': 'req-febb2c79-ff75-440a-ac9f-152618b46ccc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.509893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] The token cache is being invalidate because project 4d1e02ca39f2424697cca9c0976b9965 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:23:37.510099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.510924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.512803 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3359/6701] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:23:37 2022] DELETE /identity/v3/projects/4d1e02ca39f2424697cca9c0976b9965 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:23:37.518319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:37.520435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:37.543574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c4618e-e67a-4236-bafe-03865e5cdfea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:37.656508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:37.657480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:37.657872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:37.658354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] PATH_INFO: `/v3/users/c77010456a034195bd4c7ddd566f81b3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:37.659753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c77010456a034195bd4c7ddd566f81b3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:37.661948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:37.737637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c77010456a034195bd4c7ddd566f81b3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.755257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c77010456a034195bd4c7ddd566f81b3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.756585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c77010456a034195bd4c7ddd566f81b3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.776241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c77010456a034195bd4c7ddd566f81b3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.780466 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:37.792562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff12e9ee-5b26-4b21-8830-216d1e95d024 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c77010456a034195bd4c7ddd566f81b3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:37.802281 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3343/6702] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:23:37 2022] DELETE /identity/v3/users/c77010456a034195bd4c7ddd566f81b3 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:38.605051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:38.609714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:38.656511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febb2c79-ff75-440a-ac9f-152618b46ccc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:38.713782 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:38.805250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:38.806115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:38.806399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:38.806670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] PATH_INFO: `/v3/projects/9c52f6db137b471b8ad35b2085f9f0b0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:38.807887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c52f6db137b471b8ad35b2085f9f0b0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:38.811205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:38.876677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c52f6db137b471b8ad35b2085f9f0b0', 'request_id': 'req-999b7e0a-111b-4f4f-811e-aa01bef174d7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:38.887571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c52f6db137b471b8ad35b2085f9f0b0', 'request_id': 'req-999b7e0a-111b-4f4f-811e-aa01bef174d7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:38.900628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c52f6db137b471b8ad35b2085f9f0b0', 'request_id': 'req-999b7e0a-111b-4f4f-811e-aa01bef174d7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:38.935259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] The token cache is being invalidate because project 9c52f6db137b471b8ad35b2085f9f0b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:23:38.935855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:38.936871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-999b7e0a-111b-4f4f-811e-aa01bef174d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:38.951715 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3360/6703] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:23:38 2022] DELETE /identity/v3/projects/9c52f6db137b471b8ad35b2085f9f0b0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:38.962873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6252-90bb-4871-a5ee-6b500d7852bd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:38.964086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6252-90bb-4871-a5ee-6b500d7852bd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:38.964664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ea6252-90bb-4871-a5ee-6b500d7852bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:38.991177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d2ea6252-90bb-4871-a5ee-6b500d7852bd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:38.993378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d2ea6252-90bb-4871-a5ee-6b500d7852bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:39.091341 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3344/6704] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:39.099771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86367-afeb-4d6a-a5da-d2bfd74953f0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:39.100088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86367-afeb-4d6a-a5da-d2bfd74953f0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:39.100333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e86367-afeb-4d6a-a5da-d2bfd74953f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:39.138135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e1e86367-afeb-4d6a-a5da-d2bfd74953f0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:39.139828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e1e86367-afeb-4d6a-a5da-d2bfd74953f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:39.169109 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3361/6705] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:39.170960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6252-90bb-4871-a5ee-6b500d7852bd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:39.180984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ea6252-90bb-4871-a5ee-6b500d7852bd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:39.230699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb9266-f10c-49b2-8b01-12e80bfefee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:39.231625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb9266-f10c-49b2-8b01-12e80bfefee2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:39.232089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb9266-f10c-49b2-8b01-12e80bfefee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:39.232567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdb9266-f10c-49b2-8b01-12e80bfefee2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:39.233556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb9266-f10c-49b2-8b01-12e80bfefee2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:23:39.234080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb9266-f10c-49b2-8b01-12e80bfefee2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:39.235931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdb9266-f10c-49b2-8b01-12e80bfefee2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:39.280243 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3345/6706] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:23:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:23:39.285209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e86367-afeb-4d6a-a5da-d2bfd74953f0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:39.299183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e86367-afeb-4d6a-a5da-d2bfd74953f0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:39.305034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e79f-4633-42dd-b31b-7a492a59edc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:39.305727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e79f-4633-42dd-b31b-7a492a59edc7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:39.306004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e79f-4633-42dd-b31b-7a492a59edc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:39.306271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd11e79f-4633-42dd-b31b-7a492a59edc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:39.307078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11e79f-4633-42dd-b31b-7a492a59edc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:39.309041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd11e79f-4633-42dd-b31b-7a492a59edc7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:39.357326 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3362/6707] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:23:39 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:39.360973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb9266-f10c-49b2-8b01-12e80bfefee2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:39.383487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdb9266-f10c-49b2-8b01-12e80bfefee2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:39.467694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad71dd-132b-4b68-b15a-c609e531d0ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:39.468359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad71dd-132b-4b68-b15a-c609e531d0ea admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:39.468645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad71dd-132b-4b68-b15a-c609e531d0ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:39.468922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad71dd-132b-4b68-b15a-c609e531d0ea admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:39.469731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad71dd-132b-4b68-b15a-c609e531d0ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:39.472574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddad71dd-132b-4b68-b15a-c609e531d0ea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:39.511998 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3346/6708] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:23:39 2022] POST /identity/v3/users => generated 289 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:39.516038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e79f-4633-42dd-b31b-7a492a59edc7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:39.528132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd11e79f-4633-42dd-b31b-7a492a59edc7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:39.535505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b5733-4fc8-4316-ba42-1cc36863d491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:39.536396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b5733-4fc8-4316-ba42-1cc36863d491 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:39.536708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b5733-4fc8-4316-ba42-1cc36863d491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:39.536954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072b5733-4fc8-4316-ba42-1cc36863d491 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:39.538578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b5733-4fc8-4316-ba42-1cc36863d491 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:39.539320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072b5733-4fc8-4316-ba42-1cc36863d491 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:39.553657 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3363/6709] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:39.557272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad71dd-132b-4b68-b15a-c609e531d0ea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:39.571906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad71dd-132b-4b68-b15a-c609e531d0ea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:39.581073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda83b6-9009-4fc6-acd1-d928dd1e74ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:39.582198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda83b6-9009-4fc6-acd1-d928dd1e74ca admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:39.582665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda83b6-9009-4fc6-acd1-d928dd1e74ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:39.583098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda83b6-9009-4fc6-acd1-d928dd1e74ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:39.586638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda83b6-9009-4fc6-acd1-d928dd1e74ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:39.592124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda83b6-9009-4fc6-acd1-d928dd1e74ca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:39.613160 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3347/6710] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:39.617196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b5733-4fc8-4316-ba42-1cc36863d491 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:39.635904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072b5733-4fc8-4316-ba42-1cc36863d491 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:39.645410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9999893-d271-40fb-8b17-cd3e6d2f8ac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:39.646571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9999893-d271-40fb-8b17-cd3e6d2f8ac5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:39.646571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9999893-d271-40fb-8b17-cd3e6d2f8ac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:39.646968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9999893-d271-40fb-8b17-cd3e6d2f8ac5 admin admin] PATH_INFO: `/v3/projects/a3f2fcdaa9cd434797881937ea940b89/users/47cc2bea7f764515920d59cae9ef0111/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:39.670439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9999893-d271-40fb-8b17-cd3e6d2f8ac5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3f2fcdaa9cd434797881937ea940b89, user_id=47cc2bea7f764515920d59cae9ef0111, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:39.673781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9999893-d271-40fb-8b17-cd3e6d2f8ac5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:39.691382 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3364/6711] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:39 2022] PUT /identity/v3/projects/a3f2fcdaa9cd434797881937ea940b89/users/47cc2bea7f764515920d59cae9ef0111/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:39.696361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623ba34-d568-4465-bbe5-131fa24fbbd0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:39.696361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623ba34-d568-4465-bbe5-131fa24fbbd0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:39.696659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623ba34-d568-4465-bbe5-131fa24fbbd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:39.728777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6623ba34-d568-4465-bbe5-131fa24fbbd0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:39.730491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6623ba34-d568-4465-bbe5-131fa24fbbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:39.875560 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:39.896747 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3348/6712] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:23:39.945337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9999893-d271-40fb-8b17-cd3e6d2f8ac5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:39.947972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b9999893-d271-40fb-8b17-cd3e6d2f8ac5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:40.065338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9999893-d271-40fb-8b17-cd3e6d2f8ac5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:40.069448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321617bf-77d2-4842-89ec-b3024a195048 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:40.070080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321617bf-77d2-4842-89ec-b3024a195048 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:40.070361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321617bf-77d2-4842-89ec-b3024a195048 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:40.070634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321617bf-77d2-4842-89ec-b3024a195048 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:40.081765 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:40.086690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321617bf-77d2-4842-89ec-b3024a195048 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:40.088637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321617bf-77d2-4842-89ec-b3024a195048 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:40.101612 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3365/6713] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:23:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:23:41.565078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623ba34-d568-4465-bbe5-131fa24fbbd0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:41.567364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6623ba34-d568-4465-bbe5-131fa24fbbd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:41.583112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623ba34-d568-4465-bbe5-131fa24fbbd0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:41.600086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:41.600920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:41.601336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:41.601689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] PATH_INFO: `/v3/users/92f3721d4dae4467afe3c761cc582634` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:41.603706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] RBAC: Authorizing `identity:delete_user(user_id=92f3721d4dae4467afe3c761cc582634)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:41.608048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:41.739819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '92f3721d4dae4467afe3c761cc582634'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:41.775887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '92f3721d4dae4467afe3c761cc582634'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:41.777269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '92f3721d4dae4467afe3c761cc582634'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:41.829852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '92f3721d4dae4467afe3c761cc582634'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:41.844415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '92f3721d4dae4467afe3c761cc582634'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:41.868779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22365-3556-490d-b08c-39a75f2c8ddc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:41.869412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22365-3556-490d-b08c-39a75f2c8ddc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:41.869757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db22365-3556-490d-b08c-39a75f2c8ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:41.874000 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3349/6714] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:23:41 2022] DELETE /identity/v3/users/92f3721d4dae4467afe3c761cc582634 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:41.915727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6db22365-3556-490d-b08c-39a75f2c8ddc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:41.919618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6db22365-3556-490d-b08c-39a75f2c8ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:42.058807 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3366/6715] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:42.073764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:42.077329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:42.167631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f95432-a5b7-4cd5-a0bd-ae003bfb5580 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:42.184083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9532e8-9df4-495d-8d2f-2e51cd077308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:42.184727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9532e8-9df4-495d-8d2f-2e51cd077308 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:42.186030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9532e8-9df4-495d-8d2f-2e51cd077308 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:42.186030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9532e8-9df4-495d-8d2f-2e51cd077308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:42.202262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9532e8-9df4-495d-8d2f-2e51cd077308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:42.203206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9532e8-9df4-495d-8d2f-2e51cd077308 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:42.227538 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3350/6716] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:23:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:23:42.690910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302e1d-c840-4b99-85af-c5534f147482 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:42.691197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302e1d-c840-4b99-85af-c5534f147482 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:42.691518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51302e1d-c840-4b99-85af-c5534f147482 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:42.771142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-51302e1d-c840-4b99-85af-c5534f147482 None None] MFA Rules not processed for user `47cc2bea7f764515920d59cae9ef0111`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:42.774322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-51302e1d-c840-4b99-85af-c5534f147482 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:42.932721 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3367/6717] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:42.937329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9532e8-9df4-495d-8d2f-2e51cd077308 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:42.939022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8c9532e8-9df4-495d-8d2f-2e51cd077308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:42.966870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9532e8-9df4-495d-8d2f-2e51cd077308 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:42.977999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef48eda-f7da-478c-8762-c9614f365b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:42.978718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef48eda-f7da-478c-8762-c9614f365b54 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:42.979425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef48eda-f7da-478c-8762-c9614f365b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:42.979717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef48eda-f7da-478c-8762-c9614f365b54 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:42.980376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef48eda-f7da-478c-8762-c9614f365b54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:42.982671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef48eda-f7da-478c-8762-c9614f365b54 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:43.042529 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3351/6718] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:23:42 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:43.045808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302e1d-c840-4b99-85af-c5534f147482 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:43.063616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51302e1d-c840-4b99-85af-c5534f147482 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:43.196469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8439-a7cd-4b62-9455-d9a2a826616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:43.197102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8439-a7cd-4b62-9455-d9a2a826616c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:43.197859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8439-a7cd-4b62-9455-d9a2a826616c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:43.198131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8439-a7cd-4b62-9455-d9a2a826616c admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:43.198911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8439-a7cd-4b62-9455-d9a2a826616c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:43.201921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8439-a7cd-4b62-9455-d9a2a826616c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:43.248300 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3368/6719] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:23:43 2022] POST /identity/v3/users => generated 295 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:43.262503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef48eda-f7da-478c-8762-c9614f365b54 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:43.278559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef48eda-f7da-478c-8762-c9614f365b54 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:43.300077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539344-21b9-44c1-84fa-0e28ae1d9b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:43.300709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539344-21b9-44c1-84fa-0e28ae1d9b1c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:43.301369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539344-21b9-44c1-84fa-0e28ae1d9b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:43.301652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c539344-21b9-44c1-84fa-0e28ae1d9b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:43.302457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c539344-21b9-44c1-84fa-0e28ae1d9b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:43.306016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c539344-21b9-44c1-84fa-0e28ae1d9b1c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:43.330608 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3352/6720] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:43.334975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8439-a7cd-4b62-9455-d9a2a826616c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:43.346573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8439-a7cd-4b62-9455-d9a2a826616c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:43.351710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c548b-567b-4dfb-890e-c412777c7dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:43.352652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c548b-567b-4dfb-890e-c412777c7dd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:43.353139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c548b-567b-4dfb-890e-c412777c7dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:43.354407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5c548b-567b-4dfb-890e-c412777c7dd3 admin admin] PATH_INFO: `/v3/projects/2fb846f8159447f5bc60747e3b3067cf/users/4b5d32052b5f4ce89b64e53c7ec76f1d/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:43.377717 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:43.387277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c548b-567b-4dfb-890e-c412777c7dd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb846f8159447f5bc60747e3b3067cf, user_id=4b5d32052b5f4ce89b64e53c7ec76f1d, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:43.399812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc5c548b-567b-4dfb-890e-c412777c7dd3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:43.445895 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3369/6721] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:43 2022] PUT /identity/v3/projects/2fb846f8159447f5bc60747e3b3067cf/users/4b5d32052b5f4ce89b64e53c7ec76f1d/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:43.448687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539344-21b9-44c1-84fa-0e28ae1d9b1c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:43.460849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c539344-21b9-44c1-84fa-0e28ae1d9b1c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:43.503567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c548b-567b-4dfb-890e-c412777c7dd3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:43.505716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cc5c548b-567b-4dfb-890e-c412777c7dd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:43.553130 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:43.630427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109d3e-adf4-4806-9cfe-d2224091f9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:43.631332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109d3e-adf4-4806-9cfe-d2224091f9f3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:43.631617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109d3e-adf4-4806-9cfe-d2224091f9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:43.631906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c109d3e-adf4-4806-9cfe-d2224091f9f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:43.633175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109d3e-adf4-4806-9cfe-d2224091f9f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:43.636249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c109d3e-adf4-4806-9cfe-d2224091f9f3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:43.661428 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3353/6722] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:43 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:43.662473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109d3e-adf4-4806-9cfe-d2224091f9f3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:43.679671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c109d3e-adf4-4806-9cfe-d2224091f9f3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:43.686165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66ca2c-4c81-48ea-9f36-f0ed7ac38c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:43.687370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66ca2c-4c81-48ea-9f36-f0ed7ac38c16 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:43.687659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66ca2c-4c81-48ea-9f36-f0ed7ac38c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:43.687951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec66ca2c-4c81-48ea-9f36-f0ed7ac38c16 admin admin] PATH_INFO: `/v3/projects/2fb846f8159447f5bc60747e3b3067cf/users/4b5d32052b5f4ce89b64e53c7ec76f1d/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:43.691010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66ca2c-4c81-48ea-9f36-f0ed7ac38c16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fb846f8159447f5bc60747e3b3067cf, user_id=4b5d32052b5f4ce89b64e53c7ec76f1d, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:43.695319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec66ca2c-4c81-48ea-9f36-f0ed7ac38c16 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:43.702198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5c548b-567b-4dfb-890e-c412777c7dd3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:43.711926 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3354/6723] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:43 2022] PUT /identity/v3/projects/2fb846f8159447f5bc60747e3b3067cf/users/4b5d32052b5f4ce89b64e53c7ec76f1d/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:43.813284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:43.813899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:43.815909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:43.816906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] PATH_INFO: `/v3/projects/fad9bb408720480b964cb8b9dcd49e19` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:43.817813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad9bb408720480b964cb8b9dcd49e19)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:43.820180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:43.906615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad9bb408720480b964cb8b9dcd49e19', 'request_id': 'req-48a3e786-a3d9-4220-8881-2469ebdea10a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:43.914351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad9bb408720480b964cb8b9dcd49e19', 'request_id': 'req-48a3e786-a3d9-4220-8881-2469ebdea10a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:43.928477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad9bb408720480b964cb8b9dcd49e19', 'request_id': 'req-48a3e786-a3d9-4220-8881-2469ebdea10a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:43.954331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] The token cache is being invalidate because project fad9bb408720480b964cb8b9dcd49e19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:23:43.955648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:43.956215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:43.961174 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3370/6724] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:23:43 2022] DELETE /identity/v3/projects/fad9bb408720480b964cb8b9dcd49e19 => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:43.962809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66ca2c-4c81-48ea-9f36-f0ed7ac38c16 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:43.965447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ec66ca2c-4c81-48ea-9f36-f0ed7ac38c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:43.985191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec66ca2c-4c81-48ea-9f36-f0ed7ac38c16 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:44.073198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:44.074255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:44.074508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:44.075105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] PATH_INFO: `/v3/users/49bb434024934bd596f06db785411d4a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:44.076234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=49bb434024934bd596f06db785411d4a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:44.079064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:44.188734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '49bb434024934bd596f06db785411d4a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:44.209722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '49bb434024934bd596f06db785411d4a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:44.210651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '49bb434024934bd596f06db785411d4a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:44.226255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '49bb434024934bd596f06db785411d4a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:44.239224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dc3a995f-c944-452c-9352-6704b3cd13fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '49bb434024934bd596f06db785411d4a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:44.253929 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3355/6725] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:23:43 2022] DELETE /identity/v3/users/49bb434024934bd596f06db785411d4a => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:45.024556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:45.043361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a3e786-a3d9-4220-8881-2469ebdea10a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:45.148035 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:45.212992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:45.213808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:45.214182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:45.214535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] PATH_INFO: `/v3/projects/05474778119c484fb52d0e7538d72db2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:45.215780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05474778119c484fb52d0e7538d72db2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:45.219146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:45.291732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05474778119c484fb52d0e7538d72db2', 'request_id': 'req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.301634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05474778119c484fb52d0e7538d72db2', 'request_id': 'req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.313866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05474778119c484fb52d0e7538d72db2', 'request_id': 'req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.344608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] The token cache is being invalidate because project 05474778119c484fb52d0e7538d72db2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:23:45.346232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.348758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6820053c-1aab-4a6a-809c-4ca4eaaa1e56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.355049 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3371/6726] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:23:45 2022] DELETE /identity/v3/projects/05474778119c484fb52d0e7538d72db2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:45.356801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a531d-423c-4ad5-b5de-283a4a49594d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:45.357284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a531d-423c-4ad5-b5de-283a4a49594d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:45.357416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a531d-423c-4ad5-b5de-283a4a49594d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:45.398470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-980a531d-423c-4ad5-b5de-283a4a49594d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:45.399716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-980a531d-423c-4ad5-b5de-283a4a49594d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:45.494731 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:45.563259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3356/6727] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:45.572539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e8422-d1c4-495d-917d-d7c202f39399 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:45.572954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e8422-d1c4-495d-917d-d7c202f39399 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:45.576199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266e8422-d1c4-495d-917d-d7c202f39399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:45.622519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-266e8422-d1c4-495d-917d-d7c202f39399 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:45.624106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-266e8422-d1c4-495d-917d-d7c202f39399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:45.657491 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3372/6728] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:45.662158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a531d-423c-4ad5-b5de-283a4a49594d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:45.679923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a531d-423c-4ad5-b5de-283a4a49594d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:45.682750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e8422-d1c4-495d-917d-d7c202f39399 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:45.684783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-266e8422-d1c4-495d-917d-d7c202f39399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:45.704335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dda3a-2158-4148-8422-1f29872f5a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:45.709003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dda3a-2158-4148-8422-1f29872f5a88 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:45.709376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dda3a-2158-4148-8422-1f29872f5a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:45.714158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9dda3a-2158-4148-8422-1f29872f5a88 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:45.720273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266e8422-d1c4-495d-917d-d7c202f39399 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:45.727801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dda3a-2158-4148-8422-1f29872f5a88 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:23:45.728205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dda3a-2158-4148-8422-1f29872f5a88 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:45.743635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9dda3a-2158-4148-8422-1f29872f5a88 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:45.762971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:45.764449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:45.764846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:45.765125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] PATH_INFO: `/v3/users/b2755c3ea93440999d287890d328ecd6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:45.768687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2755c3ea93440999d287890d328ecd6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:45.776913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:45.799399 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3357/6729] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:23:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:23:45.800442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dda3a-2158-4148-8422-1f29872f5a88 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:45.814913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9dda3a-2158-4148-8422-1f29872f5a88 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:45.821211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e47348-3c5f-4e4c-9bcd-936aced92c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:45.821944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47348-3c5f-4e4c-9bcd-936aced92c99 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:45.822234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47348-3c5f-4e4c-9bcd-936aced92c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:45.822512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e47348-3c5f-4e4c-9bcd-936aced92c99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:45.824021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e47348-3c5f-4e4c-9bcd-936aced92c99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:45.826243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e47348-3c5f-4e4c-9bcd-936aced92c99 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:45.888019 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3358/6730] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:23:45 2022] POST /identity/v3/projects => generated 395 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:45.889136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e47348-3c5f-4e4c-9bcd-936aced92c99 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:45.904895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2755c3ea93440999d287890d328ecd6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.947355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2755c3ea93440999d287890d328ecd6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.948213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2755c3ea93440999d287890d328ecd6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.967028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2755c3ea93440999d287890d328ecd6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.980601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-792579f3-110e-4a01-a37f-a9cd84e5ac70 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2755c3ea93440999d287890d328ecd6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:45.993740 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3373/6731] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:23:45 2022] DELETE /identity/v3/users/b2755c3ea93440999d287890d328ecd6 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:23:46.079679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e47348-3c5f-4e4c-9bcd-936aced92c99 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:46.202928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ce0f0-9cde-4a8d-a124-b7190f1d3fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:46.203673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce0f0-9cde-4a8d-a124-b7190f1d3fba admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:46.204258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce0f0-9cde-4a8d-a124-b7190f1d3fba admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:46.204600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ce0f0-9cde-4a8d-a124-b7190f1d3fba admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:46.206305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ce0f0-9cde-4a8d-a124-b7190f1d3fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:46.208982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ce0f0-9cde-4a8d-a124-b7190f1d3fba admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:46.237494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e3bd2-0b8c-453d-902f-c6c68ada9f43 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:46.237974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e3bd2-0b8c-453d-902f-c6c68ada9f43 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:46.238067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5e3bd2-0b8c-453d-902f-c6c68ada9f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:46.256599 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3359/6732] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:23:45 2022] POST /identity/v3/users => generated 298 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:46.260728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ce0f0-9cde-4a8d-a124-b7190f1d3fba admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:46.266279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7f6ce0f0-9cde-4a8d-a124-b7190f1d3fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:46.301883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6b5e3bd2-0b8c-453d-902f-c6c68ada9f43 None None] MFA Rules not processed for user `4b5d32052b5f4ce89b64e53c7ec76f1d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:46.303195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6b5e3bd2-0b8c-453d-902f-c6c68ada9f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:46.307628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ce0f0-9cde-4a8d-a124-b7190f1d3fba admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:46.321578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c343c46-ce1c-4c2b-ab10-11229c782a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:46.322022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c343c46-ce1c-4c2b-ab10-11229c782a94 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:46.322306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c343c46-ce1c-4c2b-ab10-11229c782a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:46.322627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c343c46-ce1c-4c2b-ab10-11229c782a94 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:46.324699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c343c46-ce1c-4c2b-ab10-11229c782a94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:46.324855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c343c46-ce1c-4c2b-ab10-11229c782a94 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:46.328291 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:46.348725 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3360/6733] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:46.352503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c343c46-ce1c-4c2b-ab10-11229c782a94 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:46.370669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c343c46-ce1c-4c2b-ab10-11229c782a94 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:46.388979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac20db-637c-420b-b23c-623181f3e5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:46.389631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac20db-637c-420b-b23c-623181f3e5b0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:46.389911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac20db-637c-420b-b23c-623181f3e5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:46.390261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaac20db-637c-420b-b23c-623181f3e5b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:46.390907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac20db-637c-420b-b23c-623181f3e5b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:46.392528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaac20db-637c-420b-b23c-623181f3e5b0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:46.416123 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3361/6734] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:46 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:23:46.422392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac20db-637c-420b-b23c-623181f3e5b0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:46.446289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaac20db-637c-420b-b23c-623181f3e5b0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:46.459286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbb4d08-47b5-4744-a168-310da282e850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:46.459961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb4d08-47b5-4744-a168-310da282e850 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:46.460240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb4d08-47b5-4744-a168-310da282e850 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:46.460518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbb4d08-47b5-4744-a168-310da282e850 admin admin] PATH_INFO: `/v3/projects/c6f373e6cee745149bb84a3c5568ba0f/users/80021ed736034de9951f37cef3b20209/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:46.491791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb4d08-47b5-4744-a168-310da282e850 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6f373e6cee745149bb84a3c5568ba0f, user_id=80021ed736034de9951f37cef3b20209, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:46.494760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbb4d08-47b5-4744-a168-310da282e850 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:46.513233 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3374/6735] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:46 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:23:46.531738 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:46.533412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ae488-386c-4a85-a87a-590856291544 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:46.533968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ae488-386c-4a85-a87a-590856291544 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:46.536271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69ae488-386c-4a85-a87a-590856291544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:46.538354 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3362/6736] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:46 2022] PUT /identity/v3/projects/c6f373e6cee745149bb84a3c5568ba0f/users/80021ed736034de9951f37cef3b20209/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:46.550040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7e72-9916-4ab2-8cbf-87012b80fe89 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:46.550724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7e72-9916-4ab2-8cbf-87012b80fe89 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:46.551366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545d7e72-9916-4ab2-8cbf-87012b80fe89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:46.603729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-545d7e72-9916-4ab2-8cbf-87012b80fe89 None None] MFA Rules not processed for user `80021ed736034de9951f37cef3b20209`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:46.604947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-545d7e72-9916-4ab2-8cbf-87012b80fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:46.617523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e69ae488-386c-4a85-a87a-590856291544 None None] MFA Rules not processed for user `47cc2bea7f764515920d59cae9ef0111`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:46.619265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e69ae488-386c-4a85-a87a-590856291544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:46.780571 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3363/6737] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:46 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:23:46.781893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d7e72-9916-4ab2-8cbf-87012b80fe89 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:46.786184 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3375/6738] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:46 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:46.793634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ae488-386c-4a85-a87a-590856291544 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:46.795081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-545d7e72-9916-4ab2-8cbf-87012b80fe89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:46.795216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e69ae488-386c-4a85-a87a-590856291544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:46.907657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545d7e72-9916-4ab2-8cbf-87012b80fe89 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:46.913598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:46.914411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:46.914793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:46.916275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] PATH_INFO: `/v3/projects/c6f88028805e42a0a83e7de1f6f39d99` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:46.917613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f88028805e42a0a83e7de1f6f39d99)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:46.921879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:47.002954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69ae488-386c-4a85-a87a-590856291544 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:47.024955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:47.025787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:47.026276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:47.030785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f88028805e42a0a83e7de1f6f39d99', 'request_id': 'req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:47.031026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:47.033284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:47.040637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f88028805e42a0a83e7de1f6f39d99', 'request_id': 'req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:47.049282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:47.052330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:47.061513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f88028805e42a0a83e7de1f6f39d99', 'request_id': 'req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:47.072956 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3376/6739] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:23:46 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:23:47.074342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:47.076274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:47.082489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] The token cache is being invalidate because project c6f88028805e42a0a83e7de1f6f39d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:23:47.082953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:47.083640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-53fc1f1c-4d64-4e02-98d1-f5aff746a5f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:47.086177 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3364/6740] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:23:46 2022] DELETE /identity/v3/projects/c6f88028805e42a0a83e7de1f6f39d99 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:47.091514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d594-2611-43da-a312-8bd2eb96f12a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:47.091974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d594-2611-43da-a312-8bd2eb96f12a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:47.092373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59d594-2611-43da-a312-8bd2eb96f12a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:47.167390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8b59d594-2611-43da-a312-8bd2eb96f12a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:47.172392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8b59d594-2611-43da-a312-8bd2eb96f12a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:47.226418 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:47.233900 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:47.271762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b822ae32-bc5d-4d14-bed2-52cb3f602609 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:47.379310 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3365/6741] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:47.387149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef263-b2a4-4e2d-af78-a4abe3b13d14 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:47.387450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef263-b2a4-4e2d-af78-a4abe3b13d14 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:47.387706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebef263-b2a4-4e2d-af78-a4abe3b13d14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:47.412906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca8a37-151a-4bba-a9f8-a14537cc1d60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:47.413705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca8a37-151a-4bba-a9f8-a14537cc1d60 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:47.413983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca8a37-151a-4bba-a9f8-a14537cc1d60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:47.414254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca8a37-151a-4bba-a9f8-a14537cc1d60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:47.418217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e6ca8a37-151a-4bba-a9f8-a14537cc1d60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:47.426309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bebef263-b2a4-4e2d-af78-a4abe3b13d14 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:47.435066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bebef263-b2a4-4e2d-af78-a4abe3b13d14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:47.458458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3366/6742] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:47.462291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebef263-b2a4-4e2d-af78-a4abe3b13d14 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:47.485199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebef263-b2a4-4e2d-af78-a4abe3b13d14 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:47.499404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f73b3-9ec3-4bc8-a55a-a620ca50e211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:47.500038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f73b3-9ec3-4bc8-a55a-a620ca50e211 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:47.500312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f73b3-9ec3-4bc8-a55a-a620ca50e211 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:47.500584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f73b3-9ec3-4bc8-a55a-a620ca50e211 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:47.501235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f73b3-9ec3-4bc8-a55a-a620ca50e211 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:23:47.501571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f73b3-9ec3-4bc8-a55a-a620ca50e211 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:47.511023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7f73b3-9ec3-4bc8-a55a-a620ca50e211 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:47.554136 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3367/6743] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:23:47.558341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f73b3-9ec3-4bc8-a55a-a620ca50e211 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:47.581411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f73b3-9ec3-4bc8-a55a-a620ca50e211 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:47.587490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4677-ec1f-4f84-a04e-c3240ba46a5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:47.588111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4677-ec1f-4f84-a04e-c3240ba46a5a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:47.588396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4677-ec1f-4f84-a04e-c3240ba46a5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:47.588668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dc4677-ec1f-4f84-a04e-c3240ba46a5a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:47.589328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc4677-ec1f-4f84-a04e-c3240ba46a5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:47.591258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dc4677-ec1f-4f84-a04e-c3240ba46a5a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:47.594161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca8a37-151a-4bba-a9f8-a14537cc1d60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:47.597588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ca8a37-151a-4bba-a9f8-a14537cc1d60 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:47.623980 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3377/6744] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:23:47 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:23:47.656894 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3368/6745] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:23:47 2022] POST /identity/v3/projects => generated 373 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:47.661445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca8a37-151a-4bba-a9f8-a14537cc1d60 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:47.679062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca8a37-151a-4bba-a9f8-a14537cc1d60 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:47.821622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3369a-a0fe-4ef7-80e8-f9512b9f5d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:47.822230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3369a-a0fe-4ef7-80e8-f9512b9f5d34 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:47.822662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3369a-a0fe-4ef7-80e8-f9512b9f5d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:47.822815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd3369a-a0fe-4ef7-80e8-f9512b9f5d34 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:47.823414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3369a-a0fe-4ef7-80e8-f9512b9f5d34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:47.825388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd3369a-a0fe-4ef7-80e8-f9512b9f5d34 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:47.884863 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3378/6746] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:23:47 2022] POST /identity/v3/users => generated 287 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:47.889371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4677-ec1f-4f84-a04e-c3240ba46a5a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:47.903884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dc4677-ec1f-4f84-a04e-c3240ba46a5a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:47.910401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d10f0-bfa4-47e0-bd56-71251c7e9a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:47.911141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d10f0-bfa4-47e0-bd56-71251c7e9a9c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:47.911537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d10f0-bfa4-47e0-bd56-71251c7e9a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:47.911882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d10f0-bfa4-47e0-bd56-71251c7e9a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:47.912701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d10f0-bfa4-47e0-bd56-71251c7e9a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:47.916568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d10f0-bfa4-47e0-bd56-71251c7e9a9c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:47.949563 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3369/6747] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:47.953574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3369a-a0fe-4ef7-80e8-f9512b9f5d34 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:47.976691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd3369a-a0fe-4ef7-80e8-f9512b9f5d34 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:47.995139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6c4c0-e8d6-4f5d-9ec8-d8d2cbe9483f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:47.997213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6c4c0-e8d6-4f5d-9ec8-d8d2cbe9483f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:47.998761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6c4c0-e8d6-4f5d-9ec8-d8d2cbe9483f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:47.999436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6c4c0-e8d6-4f5d-9ec8-d8d2cbe9483f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:48.001065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6c4c0-e8d6-4f5d-9ec8-d8d2cbe9483f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:48.007389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb6c4c0-e8d6-4f5d-9ec8-d8d2cbe9483f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:48.037706 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3379/6748] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:48.041571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d10f0-bfa4-47e0-bd56-71251c7e9a9c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:48.058082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d10f0-bfa4-47e0-bd56-71251c7e9a9c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:48.064025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69943fb6-42e5-4a8f-8b53-528e925ab5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:48.065655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69943fb6-42e5-4a8f-8b53-528e925ab5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:48.066254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69943fb6-42e5-4a8f-8b53-528e925ab5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:48.066694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69943fb6-42e5-4a8f-8b53-528e925ab5e4 admin admin] PATH_INFO: `/v3/projects/f7321d20739d490aac91ec5bd124711c/users/ac39ca0b94dd496cbdef568156fd9731/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:48.091205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69943fb6-42e5-4a8f-8b53-528e925ab5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7321d20739d490aac91ec5bd124711c, user_id=ac39ca0b94dd496cbdef568156fd9731, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:48.097579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69943fb6-42e5-4a8f-8b53-528e925ab5e4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:48.136136 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3370/6749] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:48 2022] PUT /identity/v3/projects/f7321d20739d490aac91ec5bd124711c/users/ac39ca0b94dd496cbdef568156fd9731/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:23:48.148406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5667c-c216-4059-be1a-ab084d2f9c04 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:48.149003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5667c-c216-4059-be1a-ab084d2f9c04 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:48.149285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5667c-c216-4059-be1a-ab084d2f9c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:48.211862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-92c5667c-c216-4059-be1a-ab084d2f9c04 None None] MFA Rules not processed for user `ac39ca0b94dd496cbdef568156fd9731`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:48.214837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-92c5667c-c216-4059-be1a-ab084d2f9c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:48.252543 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:48.337053 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3380/6750] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:23:48.349545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69943fb6-42e5-4a8f-8b53-528e925ab5e4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:48.352172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-69943fb6-42e5-4a8f-8b53-528e925ab5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:48.440733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69943fb6-42e5-4a8f-8b53-528e925ab5e4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:48.448534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc63533-ef72-4ac0-b37c-a92204ab29ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:48.449507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63533-ef72-4ac0-b37c-a92204ab29ee service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:48.450004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63533-ef72-4ac0-b37c-a92204ab29ee service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:48.450486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc63533-ef72-4ac0-b37c-a92204ab29ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:48.459450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc63533-ef72-4ac0-b37c-a92204ab29ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:48.461356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc63533-ef72-4ac0-b37c-a92204ab29ee service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:48.472766 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3371/6751] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:23:48 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:23:55.073801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5667c-c216-4059-be1a-ab084d2f9c04 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:55.240963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c5667c-c216-4059-be1a-ab084d2f9c04 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:55.261052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:55.261773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:55.262057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:55.262343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] PATH_INFO: `/v3/users/ac39ca0b94dd496cbdef568156fd9731` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:55.270320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac39ca0b94dd496cbdef568156fd9731)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:55.272451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:55.398951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac39ca0b94dd496cbdef568156fd9731'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:55.427528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac39ca0b94dd496cbdef568156fd9731'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:55.429202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac39ca0b94dd496cbdef568156fd9731'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:55.458842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac39ca0b94dd496cbdef568156fd9731'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:55.473908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac39ca0b94dd496cbdef568156fd9731'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:55.493687 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3381/6752] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:23:55 2022] DELETE /identity/v3/users/ac39ca0b94dd496cbdef568156fd9731 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:55.495562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fec1e8-9202-4544-8cd4-19e01d6ef264 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:55.496067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fec1e8-9202-4544-8cd4-19e01d6ef264 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:55.496435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fec1e8-9202-4544-8cd4-19e01d6ef264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:55.536760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-47fec1e8-9202-4544-8cd4-19e01d6ef264 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:55.542328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-47fec1e8-9202-4544-8cd4-19e01d6ef264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:55.589679 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:55.650110 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3372/6753] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:55.683750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:55.686209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:55.803184 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:55.826406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e00873-b0ee-469d-933b-2664f683f0fa admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:55.832745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f2079-fe50-4853-b543-43657356bff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:55.834195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2079-fe50-4853-b543-43657356bff1 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:55.834554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2079-fe50-4853-b543-43657356bff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:55.834947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f2079-fe50-4853-b543-43657356bff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:55.852314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f2079-fe50-4853-b543-43657356bff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:55.856361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f2079-fe50-4853-b543-43657356bff1 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:55.874433 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3382/6754] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:23:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:23:56.947910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fec1e8-9202-4544-8cd4-19e01d6ef264 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:56.949439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-47fec1e8-9202-4544-8cd4-19e01d6ef264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:56.971541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fec1e8-9202-4544-8cd4-19e01d6ef264 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:56.990275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:56.991263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:56.991862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:56.992318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] PATH_INFO: `/v3/projects/f7321d20739d490aac91ec5bd124711c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:56.994352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7321d20739d490aac91ec5bd124711c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:56.997445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:57.109367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7321d20739d490aac91ec5bd124711c', 'request_id': 'req-117c9581-fea8-4aa0-9e71-d34a6863ee9a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:57.123342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7321d20739d490aac91ec5bd124711c', 'request_id': 'req-117c9581-fea8-4aa0-9e71-d34a6863ee9a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:57.143332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7321d20739d490aac91ec5bd124711c', 'request_id': 'req-117c9581-fea8-4aa0-9e71-d34a6863ee9a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:57.164774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] The token cache is being invalidate because project f7321d20739d490aac91ec5bd124711c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:23:57.165376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:57.168031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-117c9581-fea8-4aa0-9e71-d34a6863ee9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:23:57.169912 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3373/6755] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:23:56 2022] DELETE /identity/v3/projects/f7321d20739d490aac91ec5bd124711c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:57.177880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd901a6-b0fd-426a-94bf-ef21c0cbb1b8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:57.178353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd901a6-b0fd-426a-94bf-ef21c0cbb1b8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:57.178447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd901a6-b0fd-426a-94bf-ef21c0cbb1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:57.233658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ebd901a6-b0fd-426a-94bf-ef21c0cbb1b8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:57.235251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ebd901a6-b0fd-426a-94bf-ef21c0cbb1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:57.344120 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3383/6756] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:57.352825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fa1aa-dec4-427c-aa3a-ceb32aff3ced None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:57.353423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fa1aa-dec4-427c-aa3a-ceb32aff3ced None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:57.353981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8fa1aa-dec4-427c-aa3a-ceb32aff3ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:57.395537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1b8fa1aa-dec4-427c-aa3a-ceb32aff3ced None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:57.396852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1b8fa1aa-dec4-427c-aa3a-ceb32aff3ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:57.411364 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3374/6757] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:57.415842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd901a6-b0fd-426a-94bf-ef21c0cbb1b8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:57.437790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd901a6-b0fd-426a-94bf-ef21c0cbb1b8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:57.443289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce66f0-1743-4573-a410-7b86e5bfd68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:57.444721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce66f0-1743-4573-a410-7b86e5bfd68f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:57.445231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce66f0-1743-4573-a410-7b86e5bfd68f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:57.445705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce66f0-1743-4573-a410-7b86e5bfd68f admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:57.446547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce66f0-1743-4573-a410-7b86e5bfd68f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:23:57.447026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce66f0-1743-4573-a410-7b86e5bfd68f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:57.448854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce66f0-1743-4573-a410-7b86e5bfd68f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:57.468219 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3384/6758] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:23:57.473202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fa1aa-dec4-427c-aa3a-ceb32aff3ced None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:57.511966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8fa1aa-dec4-427c-aa3a-ceb32aff3ced None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:57.517765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e026fc1-c805-47a7-9bba-72867fa696d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:57.518657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e026fc1-c805-47a7-9bba-72867fa696d8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:57.519115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e026fc1-c805-47a7-9bba-72867fa696d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:57.519573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e026fc1-c805-47a7-9bba-72867fa696d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:57.520573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e026fc1-c805-47a7-9bba-72867fa696d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:57.523137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e026fc1-c805-47a7-9bba-72867fa696d8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:57.582448 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3375/6759] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:23:57 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:57.586295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce66f0-1743-4573-a410-7b86e5bfd68f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:57.607696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce66f0-1743-4573-a410-7b86e5bfd68f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:57.755064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768d8af-3762-42ae-8178-05f895166c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:57.755720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768d8af-3762-42ae-8178-05f895166c08 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:57.756262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768d8af-3762-42ae-8178-05f895166c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:57.756539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1768d8af-3762-42ae-8178-05f895166c08 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:57.757177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768d8af-3762-42ae-8178-05f895166c08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:57.759190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1768d8af-3762-42ae-8178-05f895166c08 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:57.797432 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3385/6760] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:23:57 2022] POST /identity/v3/users => generated 285 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:57.801140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e026fc1-c805-47a7-9bba-72867fa696d8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:57.828696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e026fc1-c805-47a7-9bba-72867fa696d8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:57.839561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c4a11-ff65-44d2-9b00-ec8a2158950f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:57.840899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c4a11-ff65-44d2-9b00-ec8a2158950f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:57.841235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c4a11-ff65-44d2-9b00-ec8a2158950f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:57.841503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4c4a11-ff65-44d2-9b00-ec8a2158950f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:57.842179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c4a11-ff65-44d2-9b00-ec8a2158950f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:57.848851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4c4a11-ff65-44d2-9b00-ec8a2158950f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:57.860528 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3376/6761] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:57.864831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768d8af-3762-42ae-8178-05f895166c08 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:57.888557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1768d8af-3762-42ae-8178-05f895166c08 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:57.898692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28af644-de43-41df-92fd-38dd80d7e33a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:57.899436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28af644-de43-41df-92fd-38dd80d7e33a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:57.899832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28af644-de43-41df-92fd-38dd80d7e33a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:57.900288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28af644-de43-41df-92fd-38dd80d7e33a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:57.901055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28af644-de43-41df-92fd-38dd80d7e33a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:57.902934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28af644-de43-41df-92fd-38dd80d7e33a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:57.930785 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3386/6762] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:57.934620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c4a11-ff65-44d2-9b00-ec8a2158950f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:57.946503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4c4a11-ff65-44d2-9b00-ec8a2158950f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:57.953249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c888f-755d-4e23-b921-7adbe0257be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:57.956768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c888f-755d-4e23-b921-7adbe0257be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:57.957412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c888f-755d-4e23-b921-7adbe0257be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:57.957906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c888f-755d-4e23-b921-7adbe0257be5 admin admin] PATH_INFO: `/v3/projects/6fadb58f8b0546afb5150cbc303ce032/users/12a8d774a5ec4e4aaaac075098771fb7/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:57.987608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c888f-755d-4e23-b921-7adbe0257be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fadb58f8b0546afb5150cbc303ce032, user_id=12a8d774a5ec4e4aaaac075098771fb7, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:57.991459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c888f-755d-4e23-b921-7adbe0257be5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:58.015074 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3377/6763] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:57 2022] PUT /identity/v3/projects/6fadb58f8b0546afb5150cbc303ce032/users/12a8d774a5ec4e4aaaac075098771fb7/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:58.026910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98df63-bae5-43c8-bea5-d12329ba4e8e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:58.027425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98df63-bae5-43c8-bea5-d12329ba4e8e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:58.027926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f98df63-bae5-43c8-bea5-d12329ba4e8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:58.079991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6f98df63-bae5-43c8-bea5-d12329ba4e8e None None] MFA Rules not processed for user `12a8d774a5ec4e4aaaac075098771fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:58.082685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6f98df63-bae5-43c8-bea5-d12329ba4e8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:58.147715 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:58.202456 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3387/6764] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:58.208372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c888f-755d-4e23-b921-7adbe0257be5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:58.301053 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:58.321834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c888f-755d-4e23-b921-7adbe0257be5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:58.333396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75ed6-a967-491d-a29a-72d9445c87ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:58.334417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75ed6-a967-491d-a29a-72d9445c87ef admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:58.334904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75ed6-a967-491d-a29a-72d9445c87ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:58.335395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd75ed6-a967-491d-a29a-72d9445c87ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:58.336260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd75ed6-a967-491d-a29a-72d9445c87ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:58.338745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd75ed6-a967-491d-a29a-72d9445c87ef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:58.375352 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3378/6765] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:23:58 2022] POST /identity/v3/projects => generated 367 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:58.379723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98df63-bae5-43c8-bea5-d12329ba4e8e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:58.398272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f98df63-bae5-43c8-bea5-d12329ba4e8e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:58.491180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf1b27-f52e-454f-b5f4-21c6b3b16265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:58.492304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf1b27-f52e-454f-b5f4-21c6b3b16265 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:58.492641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf1b27-f52e-454f-b5f4-21c6b3b16265 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:58.492981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf1b27-f52e-454f-b5f4-21c6b3b16265 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:58.493587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf1b27-f52e-454f-b5f4-21c6b3b16265 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:58.496191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf1b27-f52e-454f-b5f4-21c6b3b16265 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:58.528224 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3388/6766] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:23:58 2022] POST /identity/v3/users => generated 290 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:23:58.532421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75ed6-a967-491d-a29a-72d9445c87ef admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:58.545033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd75ed6-a967-491d-a29a-72d9445c87ef admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:58.551878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca33326-2a3b-4dbc-a0fd-5e8f6fdb6dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:58.553086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca33326-2a3b-4dbc-a0fd-5e8f6fdb6dec admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:58.553522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca33326-2a3b-4dbc-a0fd-5e8f6fdb6dec admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:58.554852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca33326-2a3b-4dbc-a0fd-5e8f6fdb6dec admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:58.555718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca33326-2a3b-4dbc-a0fd-5e8f6fdb6dec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:58.557527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca33326-2a3b-4dbc-a0fd-5e8f6fdb6dec admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:58.601407 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3379/6767] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:58.602302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf1b27-f52e-454f-b5f4-21c6b3b16265 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:58.614146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf1b27-f52e-454f-b5f4-21c6b3b16265 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:58.628197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce6ecd-2847-474a-a3e6-bb111b2db87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:58.629097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce6ecd-2847-474a-a3e6-bb111b2db87b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:58.630291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce6ecd-2847-474a-a3e6-bb111b2db87b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:58.631369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce6ecd-2847-474a-a3e6-bb111b2db87b admin admin] PATH_INFO: `/v3/projects/5d103e8f65c24604b8d60becba18235a/users/f4e3598cfa9d489cb1e061142cbe4628/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:58.659350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce6ecd-2847-474a-a3e6-bb111b2db87b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d103e8f65c24604b8d60becba18235a, user_id=f4e3598cfa9d489cb1e061142cbe4628, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:58.662721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce6ecd-2847-474a-a3e6-bb111b2db87b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:58.705045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3389/6768] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:58 2022] PUT /identity/v3/projects/5d103e8f65c24604b8d60becba18235a/users/f4e3598cfa9d489cb1e061142cbe4628/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:23:58.712900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca33326-2a3b-4dbc-a0fd-5e8f6fdb6dec admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:58.724905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca33326-2a3b-4dbc-a0fd-5e8f6fdb6dec admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:58.822916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ecc965-550a-4d8d-b85a-a643fab8bae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:58.824024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecc965-550a-4d8d-b85a-a643fab8bae3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:58.824024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecc965-550a-4d8d-b85a-a643fab8bae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:58.824262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ecc965-550a-4d8d-b85a-a643fab8bae3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:58.824733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecc965-550a-4d8d-b85a-a643fab8bae3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:58.826519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ecc965-550a-4d8d-b85a-a643fab8bae3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:58.842085 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3380/6769] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:23:58.846885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce6ecd-2847-474a-a3e6-bb111b2db87b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:58.859372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce6ecd-2847-474a-a3e6-bb111b2db87b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:58.867097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2917c-f3d6-42f8-942b-8b7c2c1f1359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:58.867776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2917c-f3d6-42f8-942b-8b7c2c1f1359 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:58.868059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2917c-f3d6-42f8-942b-8b7c2c1f1359 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:58.868810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d2917c-f3d6-42f8-942b-8b7c2c1f1359 admin admin] PATH_INFO: `/v3/projects/5d103e8f65c24604b8d60becba18235a/users/f4e3598cfa9d489cb1e061142cbe4628/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:58.872317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2917c-f3d6-42f8-942b-8b7c2c1f1359 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d103e8f65c24604b8d60becba18235a, user_id=f4e3598cfa9d489cb1e061142cbe4628, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:58.875040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d2917c-f3d6-42f8-942b-8b7c2c1f1359 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:58.898480 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3390/6770] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:58 2022] PUT /identity/v3/projects/5d103e8f65c24604b8d60becba18235a/users/f4e3598cfa9d489cb1e061142cbe4628/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:23:58.902887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f5630-839b-4d5a-8131-dc63385ada26 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:58.903213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f5630-839b-4d5a-8131-dc63385ada26 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:58.903500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f5630-839b-4d5a-8131-dc63385ada26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:58.954272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-478f5630-839b-4d5a-8131-dc63385ada26 None None] MFA Rules not processed for user `f4e3598cfa9d489cb1e061142cbe4628`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:23:58.957078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-478f5630-839b-4d5a-8131-dc63385ada26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:23:59.137589 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3381/6771] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:23:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:23:59.145626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2917c-f3d6-42f8-942b-8b7c2c1f1359 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:59.182777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d2917c-f3d6-42f8-942b-8b7c2c1f1359 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:59.188102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fe522-f57d-4c80-a81e-68a1ec17b318 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:59.191125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fe522-f57d-4c80-a81e-68a1ec17b318 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:59.191527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fe522-f57d-4c80-a81e-68a1ec17b318 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:59.191913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41fe522-f57d-4c80-a81e-68a1ec17b318 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:59.193950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fe522-f57d-4c80-a81e-68a1ec17b318 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:59.196862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41fe522-f57d-4c80-a81e-68a1ec17b318 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:59.248737 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3391/6772] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:23:59 2022] POST /identity/v3/projects => generated 328 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:23:59.250263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f5630-839b-4d5a-8131-dc63385ada26 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:59.264140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f5630-839b-4d5a-8131-dc63385ada26 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:59.369764 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:59.400558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e78a7b-7ea9-47da-8aca-85d977b58a66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:59.401439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78a7b-7ea9-47da-8aca-85d977b58a66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:59.401932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78a7b-7ea9-47da-8aca-85d977b58a66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:59.402351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e78a7b-7ea9-47da-8aca-85d977b58a66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:59.403289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e78a7b-7ea9-47da-8aca-85d977b58a66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:59.405931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e78a7b-7ea9-47da-8aca-85d977b58a66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:59.441971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fe522-f57d-4c80-a81e-68a1ec17b318 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:59.442204 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3382/6773] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:23:59 2022] POST /identity/v3/users => generated 413 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:23:59.457847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41fe522-f57d-4c80-a81e-68a1ec17b318 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:59.464679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792a530-21b8-419f-89e2-9103cb8c4355 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:59.467916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792a530-21b8-419f-89e2-9103cb8c4355 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:59.468256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792a530-21b8-419f-89e2-9103cb8c4355 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:59.468540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b792a530-21b8-419f-89e2-9103cb8c4355 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:59.469807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792a530-21b8-419f-89e2-9103cb8c4355 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:59.472409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b792a530-21b8-419f-89e2-9103cb8c4355 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:59.505420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e78a7b-7ea9-47da-8aca-85d977b58a66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:59.518962 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3392/6774] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:23:59 2022] POST /identity/v3/roles => generated 244 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:23:59.521775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e78a7b-7ea9-47da-8aca-85d977b58a66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:59.529552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13725f29-08c1-4b72-b6be-058c62eac8fe tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:59.530749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13725f29-08c1-4b72-b6be-058c62eac8fe tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:59.531034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13725f29-08c1-4b72-b6be-058c62eac8fe tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:59.531307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13725f29-08c1-4b72-b6be-058c62eac8fe tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:59.531973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13725f29-08c1-4b72-b6be-058c62eac8fe tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:59.534312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13725f29-08c1-4b72-b6be-058c62eac8fe tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:59.573935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792a530-21b8-419f-89e2-9103cb8c4355 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:59.574164 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3383/6775] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:23:59 2022] POST /identity/v3/roles => generated 247 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:23:59.586475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b792a530-21b8-419f-89e2-9103cb8c4355 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:59.592131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890d3a6-0305-4069-8f92-76b35987fd6c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:59.594252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890d3a6-0305-4069-8f92-76b35987fd6c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:59.594678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890d3a6-0305-4069-8f92-76b35987fd6c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:59.595670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6890d3a6-0305-4069-8f92-76b35987fd6c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/b0244780a685426281e637bb913475ea/users/e85d9e9107a34c8a93f3d24509387cd5/roles/feac78d298ec451b92692525096b5d31` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:59.624515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890d3a6-0305-4069-8f92-76b35987fd6c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b0244780a685426281e637bb913475ea, user_id=e85d9e9107a34c8a93f3d24509387cd5, role_id=feac78d298ec451b92692525096b5d31)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:59.627833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6890d3a6-0305-4069-8f92-76b35987fd6c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:59.652560 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3393/6776] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:59 2022] PUT /identity/v3/projects/b0244780a685426281e637bb913475ea/users/e85d9e9107a34c8a93f3d24509387cd5/roles/feac78d298ec451b92692525096b5d31 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:59.656043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13725f29-08c1-4b72-b6be-058c62eac8fe tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:59.668994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13725f29-08c1-4b72-b6be-058c62eac8fe tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:59.761388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e014ee5a-86b1-4b10-931d-b8975e6dddbc tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:59.762074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014ee5a-86b1-4b10-931d-b8975e6dddbc tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:59.762432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014ee5a-86b1-4b10-931d-b8975e6dddbc tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:59.762716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e014ee5a-86b1-4b10-931d-b8975e6dddbc tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/b0244780a685426281e637bb913475ea/users/e85d9e9107a34c8a93f3d24509387cd5/roles/bd72fb2e49dc434aac12087c28ab4416` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:59.772861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014ee5a-86b1-4b10-931d-b8975e6dddbc tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=b0244780a685426281e637bb913475ea, user_id=e85d9e9107a34c8a93f3d24509387cd5, role_id=bd72fb2e49dc434aac12087c28ab4416)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:59.775735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e014ee5a-86b1-4b10-931d-b8975e6dddbc tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:23:59.808721 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3384/6777] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:23:59 2022] PUT /identity/v3/projects/b0244780a685426281e637bb913475ea/users/e85d9e9107a34c8a93f3d24509387cd5/roles/bd72fb2e49dc434aac12087c28ab4416 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:23:59.813724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890d3a6-0305-4069-8f92-76b35987fd6c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:23:59.835356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6890d3a6-0305-4069-8f92-76b35987fd6c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:23:59.880188 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:23:59.932687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b947b6-905c-4bfd-bdaa-19f6f41ddf6d tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:23:59.933405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b947b6-905c-4bfd-bdaa-19f6f41ddf6d tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:23:59.933746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b947b6-905c-4bfd-bdaa-19f6f41ddf6d tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:23:59.934031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b947b6-905c-4bfd-bdaa-19f6f41ddf6d tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:23:59.934756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b947b6-905c-4bfd-bdaa-19f6f41ddf6d tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:23:59.937718 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-89b947b6-905c-4bfd-bdaa-19f6f41ddf6d tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_users": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:23:59.937718 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:23:59.937718 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:23:59.940326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b947b6-905c-4bfd-bdaa-19f6f41ddf6d tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:00.025446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da712559-acd3-4383-afb2-91520dd3c66c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:00.026419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da712559-acd3-4383-afb2-91520dd3c66c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:00.026966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da712559-acd3-4383-afb2-91520dd3c66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:00.060596 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3394/6778] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:23:59 2022] GET /identity/v3/users => generated 9189 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:00.178894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-da712559-acd3-4383-afb2-91520dd3c66c None None] MFA Rules not processed for user `e85d9e9107a34c8a93f3d24509387cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:00.180731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da712559-acd3-4383-afb2-91520dd3c66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:00.334763 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3385/6779] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 311 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:00.344234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259896-03cc-4914-a47b-fc91ecaf49ac None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:00.344794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259896-03cc-4914-a47b-fc91ecaf49ac None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:00.344997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57259896-03cc-4914-a47b-fc91ecaf49ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:00.372476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-57259896-03cc-4914-a47b-fc91ecaf49ac None None] MFA Rules not processed for user `e85d9e9107a34c8a93f3d24509387cd5`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:00.373916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57259896-03cc-4914-a47b-fc91ecaf49ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:00.382815 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3395/6780] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:00 2022] POST /identity/v3/auth/tokens => generated 3279 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:00.387086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da712559-acd3-4383-afb2-91520dd3c66c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:00.400953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da712559-acd3-4383-afb2-91520dd3c66c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:00.407077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4206-9b7b-4853-98d6-66e47e5d509b tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e85d9e9107a34c8a93f3d24509387cd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0244780a685426281e637bb913475ea', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1476414484', 'tempest-DelegatedRole-1837822845'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:00.408966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4206-9b7b-4853-98d6-66e47e5d509b tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:00.409681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4206-9b7b-4853-98d6-66e47e5d509b tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:00.410183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5f4206-9b7b-4853-98d6-66e47e5d509b tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:00.431015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f4206-9b7b-4853-98d6-66e47e5d509b tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] RBAC: Authorizing `identity:create_trust()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:00.432511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5f4206-9b7b-4853-98d6-66e47e5d509b tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:00.499688 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:00.577806 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3386/6781] 10.222.0.25 () {60 vars in 1174 bytes} [Mon Oct 24 09:24:00 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:00.583578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259896-03cc-4914-a47b-fc91ecaf49ac None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:00.611478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57259896-03cc-4914-a47b-fc91ecaf49ac None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:00.626438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:00.627081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:00.627864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:00.627864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:00.628283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:list_trusts()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:00.629347 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_trusts": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:24:00.629347 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:24:00.629347 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:24:00.630393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:00.654251 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3396/6782] 10.222.0.25 () {58 vars in 1155 bytes} [Mon Oct 24 09:24:00 2022] GET /identity/v3/OS-TRUST/trusts/ => generated 562 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:00.655906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4206-9b7b-4853-98d6-66e47e5d509b tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:00.672990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5f4206-9b7b-4853-98d6-66e47e5d509b tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:00.699598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e85d9e9107a34c8a93f3d24509387cd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0244780a685426281e637bb913475ea', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1476414484', 'tempest-DelegatedRole-1837822845'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:00.700282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:00.700568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:00.700852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] PATH_INFO: `/v3/OS-TRUST/trusts/4f54bd2ac71f4e7ba08bd99a61e5395a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:00.731682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] RBAC: Authorizing `identity:delete_trust(trust_id=4f54bd2ac71f4e7ba08bd99a61e5395a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:00.738414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:00.815976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4f54bd2ac71f4e7ba08bd99a61e5395a', 'request_id': 'req-5c539130-39e6-4265-857c-cc5fa4230c7c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:00.817271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '4f54bd2ac71f4e7ba08bd99a61e5395a', 'request_id': 'req-5c539130-39e6-4265-857c-cc5fa4230c7c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:00.818233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '4f54bd2ac71f4e7ba08bd99a61e5395a', 'request_id': 'req-5c539130-39e6-4265-857c-cc5fa4230c7c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:00.858309 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3387/6783] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:24:00 2022] DELETE /identity/v3/OS-TRUST/trusts/4f54bd2ac71f4e7ba08bd99a61e5395a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:00.868028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:00.872156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:00.904553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce251d1-2bbb-4209-a58f-9d06336cb473 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:00.918972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365e5a2-a30d-425a-a410-a412bbad8501 tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e85d9e9107a34c8a93f3d24509387cd5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b0244780a685426281e637bb913475ea', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-1476414484', 'tempest-DelegatedRole-1837822845'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:00.919649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365e5a2-a30d-425a-a410-a412bbad8501 tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:00.919938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365e5a2-a30d-425a-a410-a412bbad8501 tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:00.920219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1365e5a2-a30d-425a-a410-a412bbad8501 tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] PATH_INFO: `/v3/OS-TRUST/trusts/4f54bd2ac71f4e7ba08bd99a61e5395a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1365e5a2-a30d-425a-a410-a412bbad8501 tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Could not find trust: 4f54bd2ac71f4e7ba08bd99a61e5395a.: keystone.exception.TrustNotFound: Could not find trust: 4f54bd2ac71f4e7ba08bd99a61e5395a. Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 24 09:24:00.957546 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 4f54bd2ac71f4e7ba08bd99a61e5395a. Oct 24 09:24:00.958976 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:24:00.969584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:00.972449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:00.978085 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3397/6784] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:24:00 2022] GET /identity/v3/OS-TRUST/trusts/4f54bd2ac71f4e7ba08bd99a61e5395a => generated 111 bytes in 110 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:24:00.994056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c539130-39e6-4265-857c-cc5fa4230c7c tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:01.019522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:01.023536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:01.023536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:01.024090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/bd72fb2e49dc434aac12087c28ab4416` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:01.030220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=bd72fb2e49dc434aac12087c28ab4416)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:01.032564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:01.119767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role bd72fb2e49dc434aac12087c28ab4416 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:01.120095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.120780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.125345 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3388/6785] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:00 2022] DELETE /identity/v3/roles/bd72fb2e49dc434aac12087c28ab4416 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:01.128003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365e5a2-a30d-425a-a410-a412bbad8501 tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:01.130129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1365e5a2-a30d-425a-a410-a412bbad8501 tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:01.150821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1365e5a2-a30d-425a-a410-a412bbad8501 tempest-TrustsV3TestJSON-367497812 tempest-user-726610699] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:01.238692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:01.239274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:01.239561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:01.239841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/feac78d298ec451b92692525096b5d31` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:01.245004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=feac78d298ec451b92692525096b5d31)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:01.250818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:01.332574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role feac78d298ec451b92692525096b5d31 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:01.332922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.333780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.339115 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3398/6786] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:01 2022] DELETE /identity/v3/roles/feac78d298ec451b92692525096b5d31 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:01.341112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:01.365180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fdeee1-782a-455c-ab03-537cedd20758 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:01.489218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:01.490766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:01.491366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:01.492899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users/e85d9e9107a34c8a93f3d24509387cd5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:01.495225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=e85d9e9107a34c8a93f3d24509387cd5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:01.498322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:01.607044 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:01.613047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e85d9e9107a34c8a93f3d24509387cd5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.648280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e85d9e9107a34c8a93f3d24509387cd5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.649160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e85d9e9107a34c8a93f3d24509387cd5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.660052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e85d9e9107a34c8a93f3d24509387cd5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.671128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e85d9e9107a34c8a93f3d24509387cd5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.679218 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3389/6787] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:01 2022] DELETE /identity/v3/users/e85d9e9107a34c8a93f3d24509387cd5 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:01.684484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:01.686718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:01.703069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65d416-ae1b-4461-8c7d-6de62d928d9f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:01.792273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:01.793378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:01.793797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:01.794751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/b0244780a685426281e637bb913475ea` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:01.796101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b0244780a685426281e637bb913475ea)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:01.799025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:01.808237 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:01.913847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0244780a685426281e637bb913475ea', 'request_id': 'req-4032a318-f522-48f0-9337-534d6f10fd62'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.934523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0244780a685426281e637bb913475ea', 'request_id': 'req-4032a318-f522-48f0-9337-534d6f10fd62'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.950245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0244780a685426281e637bb913475ea', 'request_id': 'req-4032a318-f522-48f0-9337-534d6f10fd62'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.981564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] The token cache is being invalidate because project b0244780a685426281e637bb913475ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:01.982786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.983741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:01.991452 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3399/6788] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:01 2022] DELETE /identity/v3/projects/b0244780a685426281e637bb913475ea => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:01.991836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:01.993333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:02.013734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e2f434-5dfc-4d38-b7bf-eedc21950615 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:02.185956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d1db-ad26-4a2e-9b65-5024c6f38a77 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:02.188281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d1db-ad26-4a2e-9b65-5024c6f38a77 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:02.190292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d1db-ad26-4a2e-9b65-5024c6f38a77 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:02.191024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a48d1db-ad26-4a2e-9b65-5024c6f38a77 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:02.198945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48d1db-ad26-4a2e-9b65-5024c6f38a77 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:02.201283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a48d1db-ad26-4a2e-9b65-5024c6f38a77 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:02.269424 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3390/6789] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:24:01 2022] POST /identity/v3/projects => generated 328 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:02.274159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:02.275515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:02.310222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4032a318-f522-48f0-9337-534d6f10fd62 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:02.447857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63f069-0cf1-46b4-910e-0da6834af585 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:02.449458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63f069-0cf1-46b4-910e-0da6834af585 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:02.449923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63f069-0cf1-46b4-910e-0da6834af585 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:02.450986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63f069-0cf1-46b4-910e-0da6834af585 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:02.451826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63f069-0cf1-46b4-910e-0da6834af585 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:02.454737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63f069-0cf1-46b4-910e-0da6834af585 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:02.516590 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3400/6790] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:02 2022] POST /identity/v3/users => generated 413 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:02.521021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d1db-ad26-4a2e-9b65-5024c6f38a77 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:02.535082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a48d1db-ad26-4a2e-9b65-5024c6f38a77 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:02.539857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8da4e-9235-4a10-b6fa-e62f77e870df tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:02.540481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8da4e-9235-4a10-b6fa-e62f77e870df tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:02.540762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8da4e-9235-4a10-b6fa-e62f77e870df tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:02.541038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c8da4e-9235-4a10-b6fa-e62f77e870df tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:02.541753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8da4e-9235-4a10-b6fa-e62f77e870df tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:02.543506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c8da4e-9235-4a10-b6fa-e62f77e870df tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:02.576933 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3391/6791] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:02 2022] POST /identity/v3/roles => generated 244 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:02.578666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63f069-0cf1-46b4-910e-0da6834af585 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:02.597947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63f069-0cf1-46b4-910e-0da6834af585 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:02.613610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a626d-4fdd-49f9-b802-396fd4c01baa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:02.614832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a626d-4fdd-49f9-b802-396fd4c01baa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:02.615332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a626d-4fdd-49f9-b802-396fd4c01baa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:02.615695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a626d-4fdd-49f9-b802-396fd4c01baa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:02.616457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a626d-4fdd-49f9-b802-396fd4c01baa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:02.619669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11a626d-4fdd-49f9-b802-396fd4c01baa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:02.653978 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3401/6792] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:02 2022] POST /identity/v3/roles => generated 246 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:02.657236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8da4e-9235-4a10-b6fa-e62f77e870df tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:02.675545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c8da4e-9235-4a10-b6fa-e62f77e870df tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:02.689103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb33f8-486e-4abc-b1fa-8f68b1204fd9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:02.689840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb33f8-486e-4abc-b1fa-8f68b1204fd9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:02.690127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb33f8-486e-4abc-b1fa-8f68b1204fd9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:02.690409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbb33f8-486e-4abc-b1fa-8f68b1204fd9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/597de5b281df4ffca27271d68c608788/users/faf0c8e584ac4b6cb5874b3f85717a6c/roles/a612d4778c6741809992137694beaaed` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:02.747501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb33f8-486e-4abc-b1fa-8f68b1204fd9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=597de5b281df4ffca27271d68c608788, user_id=faf0c8e584ac4b6cb5874b3f85717a6c, role_id=a612d4778c6741809992137694beaaed)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:02.750335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbb33f8-486e-4abc-b1fa-8f68b1204fd9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:02.778746 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3392/6793] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:02 2022] PUT /identity/v3/projects/597de5b281df4ffca27271d68c608788/users/faf0c8e584ac4b6cb5874b3f85717a6c/roles/a612d4778c6741809992137694beaaed => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:02.783758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a626d-4fdd-49f9-b802-396fd4c01baa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:02.810909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a626d-4fdd-49f9-b802-396fd4c01baa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:02.943580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7c3c76-7e45-418f-967b-6d45207be181 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:02.946281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3c76-7e45-418f-967b-6d45207be181 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:02.946566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3c76-7e45-418f-967b-6d45207be181 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:02.946845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7c3c76-7e45-418f-967b-6d45207be181 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/597de5b281df4ffca27271d68c608788/users/faf0c8e584ac4b6cb5874b3f85717a6c/roles/07a4785dd8f643498ff082cef506238a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:02.957911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c3c76-7e45-418f-967b-6d45207be181 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=597de5b281df4ffca27271d68c608788, user_id=faf0c8e584ac4b6cb5874b3f85717a6c, role_id=07a4785dd8f643498ff082cef506238a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:02.966802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7c3c76-7e45-418f-967b-6d45207be181 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:03.002377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb33f8-486e-4abc-b1fa-8f68b1204fd9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:03.002650 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3402/6794] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:02 2022] PUT /identity/v3/projects/597de5b281df4ffca27271d68c608788/users/faf0c8e584ac4b6cb5874b3f85717a6c/roles/07a4785dd8f643498ff082cef506238a => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:03.026017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbb33f8-486e-4abc-b1fa-8f68b1204fd9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:03.230692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97063626-2406-4bfa-9395-2a4a1c6ecc39 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:03.231756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063626-2406-4bfa-9395-2a4a1c6ecc39 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:03.232161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063626-2406-4bfa-9395-2a4a1c6ecc39 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:03.232534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97063626-2406-4bfa-9395-2a4a1c6ecc39 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:03.233318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97063626-2406-4bfa-9395-2a4a1c6ecc39 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:03.238578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97063626-2406-4bfa-9395-2a4a1c6ecc39 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:03.315524 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3393/6795] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:03 2022] GET /identity/v3/users => generated 9189 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:03.322526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b65a-8360-49cd-86fa-039d23341118 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:03.322815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b65a-8360-49cd-86fa-039d23341118 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:03.323095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b20b65a-8360-49cd-86fa-039d23341118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:03.331875 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:03.403499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8b20b65a-8360-49cd-86fa-039d23341118 None None] MFA Rules not processed for user `faf0c8e584ac4b6cb5874b3f85717a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:03.404990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b20b65a-8360-49cd-86fa-039d23341118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:03.618635 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3403/6796] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:03.629614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf95afe-d773-4596-8770-186aac312fc1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:03.630051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf95afe-d773-4596-8770-186aac312fc1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:03.630535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf95afe-d773-4596-8770-186aac312fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:03.660684 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:03.680114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7cf95afe-d773-4596-8770-186aac312fc1 None None] MFA Rules not processed for user `faf0c8e584ac4b6cb5874b3f85717a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:03.682594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7cf95afe-d773-4596-8770-186aac312fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:03.693601 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3394/6797] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:03 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:03.697279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b65a-8360-49cd-86fa-039d23341118 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:03.708068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b20b65a-8360-49cd-86fa-039d23341118 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:03.715907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f4ea3-5a34-4b7a-9a0c-62d8bad98be7 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf0c8e584ac4b6cb5874b3f85717a6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '597de5b281df4ffca27271d68c608788', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1183680466', 'tempest-NotDelegatedRole-100140195'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:03.716652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f4ea3-5a34-4b7a-9a0c-62d8bad98be7 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:03.717029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f4ea3-5a34-4b7a-9a0c-62d8bad98be7 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:03.717441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8f4ea3-5a34-4b7a-9a0c-62d8bad98be7 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:03.718269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f4ea3-5a34-4b7a-9a0c-62d8bad98be7 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: Authorizing `identity:create_trust()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:03.719629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8f4ea3-5a34-4b7a-9a0c-62d8bad98be7 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:03.861631 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3404/6798] 10.222.0.25 () {60 vars in 1174 bytes} [Mon Oct 24 09:24:03 2022] POST /identity/v3/OS-TRUST/trusts => generated 834 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:03.865506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf95afe-d773-4596-8770-186aac312fc1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:03.878678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf95afe-d773-4596-8770-186aac312fc1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:03.885375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2f523-9c22-4199-8879-1d3d5cbae495 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf0c8e584ac4b6cb5874b3f85717a6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '597de5b281df4ffca27271d68c608788', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1183680466', 'tempest-NotDelegatedRole-100140195'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:03.886448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2f523-9c22-4199-8879-1d3d5cbae495 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:03.887926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2f523-9c22-4199-8879-1d3d5cbae495 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:03.889049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c2f523-9c22-4199-8879-1d3d5cbae495 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:03.890479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2f523-9c22-4199-8879-1d3d5cbae495 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: Authorizing `identity:list_trusts_for_trustor()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:03.896598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c2f523-9c22-4199-8879-1d3d5cbae495 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:03.908974 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3395/6799] 10.222.0.25 () {58 vars in 1252 bytes} [Mon Oct 24 09:24:03 2022] GET /identity/v3/OS-TRUST/trusts/?trustor_user_id=faf0c8e584ac4b6cb5874b3f85717a6c => generated 611 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:24:03.910385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f4ea3-5a34-4b7a-9a0c-62d8bad98be7 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:03.927688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8f4ea3-5a34-4b7a-9a0c-62d8bad98be7 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:03.933964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf0c8e584ac4b6cb5874b3f85717a6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '597de5b281df4ffca27271d68c608788', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1183680466', 'tempest-NotDelegatedRole-100140195'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:03.938065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:03.940024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:03.940386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] PATH_INFO: `/v3/OS-TRUST/trusts/f1977cf5bd3442979c7cdfbf1977dfd5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:03.958460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: Authorizing `identity:delete_trust(trust_id=f1977cf5bd3442979c7cdfbf1977dfd5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:03.959762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:04.000773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f1977cf5bd3442979c7cdfbf1977dfd5', 'request_id': 'req-d434cde8-d601-441c-b7c0-14c5e7923d7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.000773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'f1977cf5bd3442979c7cdfbf1977dfd5', 'request_id': 'req-d434cde8-d601-441c-b7c0-14c5e7923d7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.001137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'f1977cf5bd3442979c7cdfbf1977dfd5', 'request_id': 'req-d434cde8-d601-441c-b7c0-14c5e7923d7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.022720 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3405/6800] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:24:03 2022] DELETE /identity/v3/OS-TRUST/trusts/f1977cf5bd3442979c7cdfbf1977dfd5 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:04.027077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2f523-9c22-4199-8879-1d3d5cbae495 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:04.028799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-57c2f523-9c22-4199-8879-1d3d5cbae495 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:04.042390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c2f523-9c22-4199-8879-1d3d5cbae495 tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:04.047511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f5287-0689-4b4a-ada2-0fbff693001e tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'faf0c8e584ac4b6cb5874b3f85717a6c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '597de5b281df4ffca27271d68c608788', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1183680466', 'tempest-NotDelegatedRole-100140195'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:04.048773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f5287-0689-4b4a-ada2-0fbff693001e tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:04.049059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f5287-0689-4b4a-ada2-0fbff693001e tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:04.049400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f5287-0689-4b4a-ada2-0fbff693001e tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] PATH_INFO: `/v3/OS-TRUST/trusts/f1977cf5bd3442979c7cdfbf1977dfd5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-1e9f5287-0689-4b4a-ada2-0fbff693001e tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Could not find trust: f1977cf5bd3442979c7cdfbf1977dfd5.: keystone.exception.TrustNotFound: Could not find trust: f1977cf5bd3442979c7cdfbf1977dfd5. Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 24 09:24:04.060567 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: f1977cf5bd3442979c7cdfbf1977dfd5. Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:04.061786 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3396/6801] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:24:04 2022] GET /identity/v3/OS-TRUST/trusts/f1977cf5bd3442979c7cdfbf1977dfd5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:24:04.065728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:04.067898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:04.089419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d434cde8-d601-441c-b7c0-14c5e7923d7a tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:04.097039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:04.097735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:04.100331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:04.100620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/07a4785dd8f643498ff082cef506238a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:04.102337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=07a4785dd8f643498ff082cef506238a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:04.104764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:04.148950 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:04.172464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role 07a4785dd8f643498ff082cef506238a has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:04.172756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.176494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.182047 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3406/6802] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:04 2022] DELETE /identity/v3/roles/07a4785dd8f643498ff082cef506238a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:04.183497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f5287-0689-4b4a-ada2-0fbff693001e tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:04.186286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1e9f5287-0689-4b4a-ada2-0fbff693001e tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:04.205667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f5287-0689-4b4a-ada2-0fbff693001e tempest-TrustsV3TestJSON-820865535 tempest-user-270683409] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:04.337813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:04.338580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:04.338935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:04.339283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/a612d4778c6741809992137694beaaed` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:04.340817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=a612d4778c6741809992137694beaaed)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:04.343762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:04.403040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role a612d4778c6741809992137694beaaed has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:04.404174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.405287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.412781 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3397/6803] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:04 2022] DELETE /identity/v3/roles/a612d4778c6741809992137694beaaed => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:04.414102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:04.433046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fcc8bf-f940-4051-8f6a-1337a8de58db tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:04.533345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:04.534004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:04.534289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:04.534620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users/faf0c8e584ac4b6cb5874b3f85717a6c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:04.535795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=faf0c8e584ac4b6cb5874b3f85717a6c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:04.541560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:04.605979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faf0c8e584ac4b6cb5874b3f85717a6c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.634320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faf0c8e584ac4b6cb5874b3f85717a6c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.636041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faf0c8e584ac4b6cb5874b3f85717a6c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.664150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faf0c8e584ac4b6cb5874b3f85717a6c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.695358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faf0c8e584ac4b6cb5874b3f85717a6c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:04.713617 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3407/6804] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:04 2022] DELETE /identity/v3/users/faf0c8e584ac4b6cb5874b3f85717a6c => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:04.718139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:04.721710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:04.744971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153012a-80d0-476f-802e-e85e6358182e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:04.960140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:04.961516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:04.962267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:04.962719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/597de5b281df4ffca27271d68c608788` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:04.964114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_project(project_id=597de5b281df4ffca27271d68c608788)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:04.966129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:05.091238 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:05.092950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '597de5b281df4ffca27271d68c608788', 'request_id': 'req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:05.113843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '597de5b281df4ffca27271d68c608788', 'request_id': 'req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:05.122293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '597de5b281df4ffca27271d68c608788', 'request_id': 'req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:05.137923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] The token cache is being invalidate because project 597de5b281df4ffca27271d68c608788 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:05.138425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:05.139218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:05.141238 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3398/6805] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:04 2022] DELETE /identity/v3/projects/597de5b281df4ffca27271d68c608788 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:05.147990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:05.150231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:05.164717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dcf47f-8e8f-415e-aa9b-7809dca61451 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:05.296957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ce880-205d-4d80-a093-aa6664471f84 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:05.297670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ce880-205d-4d80-a093-aa6664471f84 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:05.298698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ce880-205d-4d80-a093-aa6664471f84 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:05.298986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569ce880-205d-4d80-a093-aa6664471f84 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:05.299635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ce880-205d-4d80-a093-aa6664471f84 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:05.301891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569ce880-205d-4d80-a093-aa6664471f84 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:05.335095 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:05.346420 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3408/6806] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:24:05 2022] POST /identity/v3/projects => generated 329 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:05.350193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:05.352604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:05.388720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1a2d7d-0c1d-4914-b8cb-cd1875545af9 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:05.484559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406e41-9295-4e5d-815d-2af642b7321c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:05.485229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406e41-9295-4e5d-815d-2af642b7321c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:05.485606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406e41-9295-4e5d-815d-2af642b7321c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:05.486578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78406e41-9295-4e5d-815d-2af642b7321c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:05.488048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78406e41-9295-4e5d-815d-2af642b7321c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:05.491033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78406e41-9295-4e5d-815d-2af642b7321c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:05.533188 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3399/6807] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:05 2022] POST /identity/v3/users => generated 413 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:05.533464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ce880-205d-4d80-a093-aa6664471f84 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:05.552719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569ce880-205d-4d80-a093-aa6664471f84 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:05.557874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd6982-5fc2-4cb9-ae6e-2846b7de6e88 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:05.558601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd6982-5fc2-4cb9-ae6e-2846b7de6e88 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:05.559039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd6982-5fc2-4cb9-ae6e-2846b7de6e88 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:05.559427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dd6982-5fc2-4cb9-ae6e-2846b7de6e88 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:05.560915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd6982-5fc2-4cb9-ae6e-2846b7de6e88 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:05.563166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dd6982-5fc2-4cb9-ae6e-2846b7de6e88 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:05.593783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406e41-9295-4e5d-815d-2af642b7321c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:05.594725 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3409/6808] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:05 2022] POST /identity/v3/roles => generated 244 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:05.614975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78406e41-9295-4e5d-815d-2af642b7321c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:05.631644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0da3a9-2af1-4658-a5d4-5d8cb604dbf5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:05.632662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0da3a9-2af1-4658-a5d4-5d8cb604dbf5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:05.634652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0da3a9-2af1-4658-a5d4-5d8cb604dbf5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:05.635128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0da3a9-2af1-4658-a5d4-5d8cb604dbf5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:05.636042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0da3a9-2af1-4658-a5d4-5d8cb604dbf5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:05.645329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0da3a9-2af1-4658-a5d4-5d8cb604dbf5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:05.680661 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3400/6809] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:05 2022] POST /identity/v3/roles => generated 247 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:05.684252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd6982-5fc2-4cb9-ae6e-2846b7de6e88 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:05.696556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dd6982-5fc2-4cb9-ae6e-2846b7de6e88 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:05.725229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c04c-c672-4276-b664-c8291381ee2f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:05.726203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c04c-c672-4276-b664-c8291381ee2f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:05.726783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c04c-c672-4276-b664-c8291381ee2f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:05.727106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f84c04c-c672-4276-b664-c8291381ee2f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/94fe227691b34665abd110bad6267af6/users/442675a7493740d3b972d690e1cd7541/roles/b136d7e81183467f857ca4e0acc3c85b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:05.755529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84c04c-c672-4276-b664-c8291381ee2f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=94fe227691b34665abd110bad6267af6, user_id=442675a7493740d3b972d690e1cd7541, role_id=b136d7e81183467f857ca4e0acc3c85b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:05.759841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f84c04c-c672-4276-b664-c8291381ee2f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:05.781685 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3410/6810] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:05 2022] PUT /identity/v3/projects/94fe227691b34665abd110bad6267af6/users/442675a7493740d3b972d690e1cd7541/roles/b136d7e81183467f857ca4e0acc3c85b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:05.788749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0da3a9-2af1-4658-a5d4-5d8cb604dbf5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:05.805283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0da3a9-2af1-4658-a5d4-5d8cb604dbf5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:05.940231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9064e8-8b46-4658-b16f-7d019308610e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:05.940946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9064e8-8b46-4658-b16f-7d019308610e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:05.941236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9064e8-8b46-4658-b16f-7d019308610e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:05.941551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9064e8-8b46-4658-b16f-7d019308610e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/94fe227691b34665abd110bad6267af6/users/442675a7493740d3b972d690e1cd7541/roles/1c501b0ac8f54bd29596ab5acb046f08` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:05.946105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9064e8-8b46-4658-b16f-7d019308610e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=94fe227691b34665abd110bad6267af6, user_id=442675a7493740d3b972d690e1cd7541, role_id=1c501b0ac8f54bd29596ab5acb046f08)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:05.948820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9064e8-8b46-4658-b16f-7d019308610e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:05.978448 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3401/6811] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:05 2022] PUT /identity/v3/projects/94fe227691b34665abd110bad6267af6/users/442675a7493740d3b972d690e1cd7541/roles/1c501b0ac8f54bd29596ab5acb046f08 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:05.980139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c04c-c672-4276-b664-c8291381ee2f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:06.004503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f84c04c-c672-4276-b664-c8291381ee2f tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:06.171176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e2081a-b363-43bf-8ac1-6d0e6ef6ecbd tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:06.172452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2081a-b363-43bf-8ac1-6d0e6ef6ecbd tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:06.172764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2081a-b363-43bf-8ac1-6d0e6ef6ecbd tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:06.183296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e2081a-b363-43bf-8ac1-6d0e6ef6ecbd tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:06.184348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2081a-b363-43bf-8ac1-6d0e6ef6ecbd tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:06.186461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e2081a-b363-43bf-8ac1-6d0e6ef6ecbd tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:06.252478 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3411/6812] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:05 2022] GET /identity/v3/users => generated 9189 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:06.259466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19b9d4-ce92-4c29-aeba-a63280d6bd53 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:06.259466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19b9d4-ce92-4c29-aeba-a63280d6bd53 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:06.259466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c19b9d4-ce92-4c29-aeba-a63280d6bd53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:06.328751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8c19b9d4-ce92-4c29-aeba-a63280d6bd53 None None] MFA Rules not processed for user `442675a7493740d3b972d690e1cd7541`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:06.330641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8c19b9d4-ce92-4c29-aeba-a63280d6bd53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:06.374036 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=6,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:06.467776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93430c01-dec0-4970-8d8b-ae376e78df89 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:06.468306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93430c01-dec0-4970-8d8b-ae376e78df89 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:06.468646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3402/6813] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:06.468969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93430c01-dec0-4970-8d8b-ae376e78df89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:06.499794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-93430c01-dec0-4970-8d8b-ae376e78df89 None None] MFA Rules not processed for user `442675a7493740d3b972d690e1cd7541`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:06.501497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-93430c01-dec0-4970-8d8b-ae376e78df89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:06.521529 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3412/6814] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:24:06.525884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19b9d4-ce92-4c29-aeba-a63280d6bd53 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:06.546377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c19b9d4-ce92-4c29-aeba-a63280d6bd53 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:06.551222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03327ccc-1945-497d-99ef-0ff35f2431c4 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442675a7493740d3b972d690e1cd7541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fe227691b34665abd110bad6267af6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1186550345', 'tempest-NotDelegatedRole-1413399491'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:06.551858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03327ccc-1945-497d-99ef-0ff35f2431c4 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:06.552135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03327ccc-1945-497d-99ef-0ff35f2431c4 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:06.552472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03327ccc-1945-497d-99ef-0ff35f2431c4 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:06.553202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03327ccc-1945-497d-99ef-0ff35f2431c4 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorizing `identity:create_trust()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:06.554391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03327ccc-1945-497d-99ef-0ff35f2431c4 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:06.714966 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3403/6815] 10.222.0.25 () {60 vars in 1174 bytes} [Mon Oct 24 09:24:06 2022] POST /identity/v3/OS-TRUST/trusts => generated 859 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:06.717439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93430c01-dec0-4970-8d8b-ae376e78df89 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:06.730451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93430c01-dec0-4970-8d8b-ae376e78df89 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:06.738951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536beff1-9289-4d22-b435-8a3bbf8461dc tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442675a7493740d3b972d690e1cd7541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fe227691b34665abd110bad6267af6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1186550345', 'tempest-NotDelegatedRole-1413399491'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:06.739698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536beff1-9289-4d22-b435-8a3bbf8461dc tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:06.740050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536beff1-9289-4d22-b435-8a3bbf8461dc tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:06.740438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536beff1-9289-4d22-b435-8a3bbf8461dc tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] PATH_INFO: `/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:06.759721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536beff1-9289-4d22-b435-8a3bbf8461dc tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorizing `identity:get_trust(trust_id=044b5274aa18489db2b2ed30edc1710d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:06.765880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536beff1-9289-4d22-b435-8a3bbf8461dc tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:06.793429 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3413/6816] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:24:06 2022] GET /identity/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d => generated 859 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:06.795313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03327ccc-1945-497d-99ef-0ff35f2431c4 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:06.814279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03327ccc-1945-497d-99ef-0ff35f2431c4 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:06.836402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6312a-75e9-49f0-b8a1-65f1bd5a1e15 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442675a7493740d3b972d690e1cd7541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fe227691b34665abd110bad6267af6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1186550345', 'tempest-NotDelegatedRole-1413399491'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:06.837346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6312a-75e9-49f0-b8a1-65f1bd5a1e15 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:06.838493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6312a-75e9-49f0-b8a1-65f1bd5a1e15 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:06.838941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d6312a-75e9-49f0-b8a1-65f1bd5a1e15 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] PATH_INFO: `/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:06.859389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6312a-75e9-49f0-b8a1-65f1bd5a1e15 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=044b5274aa18489db2b2ed30edc1710d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:06.861542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d6312a-75e9-49f0-b8a1-65f1bd5a1e15 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:06.885488 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3404/6817] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:24:06 2022] GET /identity/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles => generated 371 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:06.889657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536beff1-9289-4d22-b435-8a3bbf8461dc tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:06.904456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536beff1-9289-4d22-b435-8a3bbf8461dc tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:06.915971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b690-bcff-41b9-8f9b-b90fd1c514f5 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442675a7493740d3b972d690e1cd7541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fe227691b34665abd110bad6267af6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1186550345', 'tempest-NotDelegatedRole-1413399491'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:06.917521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b690-bcff-41b9-8f9b-b90fd1c514f5 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:06.917804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b690-bcff-41b9-8f9b-b90fd1c514f5 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:06.918080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19b690-bcff-41b9-8f9b-b90fd1c514f5 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] PATH_INFO: `/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles/b136d7e81183467f857ca4e0acc3c85b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:06.934782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b690-bcff-41b9-8f9b-b90fd1c514f5 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorizing `identity:get_role_for_trust(trust_id=044b5274aa18489db2b2ed30edc1710d, role_id=b136d7e81183467f857ca4e0acc3c85b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:06.936249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19b690-bcff-41b9-8f9b-b90fd1c514f5 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:06.948133 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3414/6818] 10.222.0.25 () {58 vars in 1368 bytes} [Mon Oct 24 09:24:06 2022] GET /identity/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles/b136d7e81183467f857ca4e0acc3c85b => generated 244 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:06.952089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6312a-75e9-49f0-b8a1-65f1bd5a1e15 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:06.970798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d6312a-75e9-49f0-b8a1-65f1bd5a1e15 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:06.987375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76d9e6-bacc-4e84-a864-18a80cf46df6 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442675a7493740d3b972d690e1cd7541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fe227691b34665abd110bad6267af6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1186550345', 'tempest-NotDelegatedRole-1413399491'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:06.991838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d9e6-bacc-4e84-a864-18a80cf46df6 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:06.992130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d9e6-bacc-4e84-a864-18a80cf46df6 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:06.992417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee76d9e6-bacc-4e84-a864-18a80cf46df6 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] PATH_INFO: `/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles/b136d7e81183467f857ca4e0acc3c85b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:07.011801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76d9e6-bacc-4e84-a864-18a80cf46df6 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorizing `identity:get_role_for_trust(trust_id=044b5274aa18489db2b2ed30edc1710d, role_id=b136d7e81183467f857ca4e0acc3c85b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:07.013325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee76d9e6-bacc-4e84-a864-18a80cf46df6 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:07.040158 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3405/6819] 10.222.0.25 () {58 vars in 1369 bytes} [Mon Oct 24 09:24:06 2022] HEAD /identity/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles/b136d7e81183467f857ca4e0acc3c85b => generated 0 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 24 09:24:07.042754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b690-bcff-41b9-8f9b-b90fd1c514f5 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:07.055968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19b690-bcff-41b9-8f9b-b90fd1c514f5 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:07.066593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2af057-d2ba-47a7-89b4-ac3c06281280 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442675a7493740d3b972d690e1cd7541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fe227691b34665abd110bad6267af6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1186550345', 'tempest-NotDelegatedRole-1413399491'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:07.067003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af057-d2ba-47a7-89b4-ac3c06281280 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:07.067290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af057-d2ba-47a7-89b4-ac3c06281280 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:07.067569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2af057-d2ba-47a7-89b4-ac3c06281280 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] PATH_INFO: `/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles/1c501b0ac8f54bd29596ab5acb046f08` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:07.091131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2af057-d2ba-47a7-89b4-ac3c06281280 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorizing `identity:get_role_for_trust(trust_id=044b5274aa18489db2b2ed30edc1710d, role_id=1c501b0ac8f54bd29596ab5acb046f08)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:07.092999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2af057-d2ba-47a7-89b4-ac3c06281280 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-2b2af057-d2ba-47a7-89b4-ac3c06281280 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Could not find role: 1c501b0ac8f54bd29596ab5acb046f08.: keystone.exception.RoleNotFound: Could not find role: 1c501b0ac8f54bd29596ab5acb046f08. Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 09:24:07.124200 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1c501b0ac8f54bd29596ab5acb046f08. Oct 24 09:24:07.125518 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:24:07.128667 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3415/6820] 10.222.0.25 () {58 vars in 1368 bytes} [Mon Oct 24 09:24:07 2022] GET /identity/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles/1c501b0ac8f54bd29596ab5acb046f08 => generated 110 bytes in 88 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:24:07.133218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76d9e6-bacc-4e84-a864-18a80cf46df6 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:07.146759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee76d9e6-bacc-4e84-a864-18a80cf46df6 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:07.152595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442675a7493740d3b972d690e1cd7541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fe227691b34665abd110bad6267af6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1186550345', 'tempest-NotDelegatedRole-1413399491'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:07.153575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:07.153936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:07.154294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] PATH_INFO: `/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles/1c501b0ac8f54bd29596ab5acb046f08` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:07.164655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorizing `identity:get_role_for_trust(trust_id=044b5274aa18489db2b2ed30edc1710d, role_id=1c501b0ac8f54bd29596ab5acb046f08)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:07.166313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Could not find role: 1c501b0ac8f54bd29596ab5acb046f08.: keystone.exception.RoleNotFound: Could not find role: 1c501b0ac8f54bd29596ab5acb046f08. Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 09:24:07.182198 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 1c501b0ac8f54bd29596ab5acb046f08. Oct 24 09:24:07.183724 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:07.184613 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3406/6821] 10.222.0.25 () {58 vars in 1369 bytes} [Mon Oct 24 09:24:07 2022] HEAD /identity/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d/roles/1c501b0ac8f54bd29596ab5acb046f08 => generated 0 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 24 09:24:07.189132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2af057-d2ba-47a7-89b4-ac3c06281280 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:07.203558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2af057-d2ba-47a7-89b4-ac3c06281280 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:07.208866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442675a7493740d3b972d690e1cd7541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fe227691b34665abd110bad6267af6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1186550345', 'tempest-NotDelegatedRole-1413399491'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:07.209749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:07.210349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:07.210790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] PATH_INFO: `/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:07.221917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorizing `identity:delete_trust(trust_id=044b5274aa18489db2b2ed30edc1710d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:07.223979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:07.249715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '044b5274aa18489db2b2ed30edc1710d', 'request_id': 'req-d05c7264-08ae-46ff-96fc-154d980374fe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.250851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '044b5274aa18489db2b2ed30edc1710d', 'request_id': 'req-d05c7264-08ae-46ff-96fc-154d980374fe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.252250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '044b5274aa18489db2b2ed30edc1710d', 'request_id': 'req-d05c7264-08ae-46ff-96fc-154d980374fe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.273227 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3416/6822] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:24:07 2022] DELETE /identity/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:07.277278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:07.279464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:07.306198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af53130a-56fb-4823-9749-e379be4f5bd9 tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:07.315555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca97d3e-9c3a-4d09-a1f2-2dcd48d7d1ea tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '442675a7493740d3b972d690e1cd7541', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '94fe227691b34665abd110bad6267af6', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1186550345', 'tempest-NotDelegatedRole-1413399491'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:07.319325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97d3e-9c3a-4d09-a1f2-2dcd48d7d1ea tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:07.321548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97d3e-9c3a-4d09-a1f2-2dcd48d7d1ea tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:07.322058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca97d3e-9c3a-4d09-a1f2-2dcd48d7d1ea tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] PATH_INFO: `/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4ca97d3e-9c3a-4d09-a1f2-2dcd48d7d1ea tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Could not find trust: 044b5274aa18489db2b2ed30edc1710d.: keystone.exception.TrustNotFound: Could not find trust: 044b5274aa18489db2b2ed30edc1710d. Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 24 09:24:07.338469 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 044b5274aa18489db2b2ed30edc1710d. Oct 24 09:24:07.339993 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:07.344429 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3407/6823] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:24:07 2022] GET /identity/v3/OS-TRUST/trusts/044b5274aa18489db2b2ed30edc1710d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:24:07.348593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:07.350405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:07.373934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c7264-08ae-46ff-96fc-154d980374fe tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:07.380814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:07.390484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:07.391074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:07.392221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/1c501b0ac8f54bd29596ab5acb046f08` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:07.398959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=1c501b0ac8f54bd29596ab5acb046f08)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:07.399603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:07.423836 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:UPDATE=1,keystone:DELETE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:07.482627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role 1c501b0ac8f54bd29596ab5acb046f08 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:07.483263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.484678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.488295 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3417/6824] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:07 2022] DELETE /identity/v3/roles/1c501b0ac8f54bd29596ab5acb046f08 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:07.492734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca97d3e-9c3a-4d09-a1f2-2dcd48d7d1ea tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:07.494882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4ca97d3e-9c3a-4d09-a1f2-2dcd48d7d1ea tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:07.512066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca97d3e-9c3a-4d09-a1f2-2dcd48d7d1ea tempest-TrustsV3TestJSON-1694131813 tempest-user-414620793] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:07.581426 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:07.588039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:07.588718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:07.590583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:07.590878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/b136d7e81183467f857ca4e0acc3c85b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:07.592475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=b136d7e81183467f857ca4e0acc3c85b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:07.596408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:07.688998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role b136d7e81183467f857ca4e0acc3c85b has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:07.689554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.694646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.702893 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3408/6825] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:07 2022] DELETE /identity/v3/roles/b136d7e81183467f857ca4e0acc3c85b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:07.707260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:07.726299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d8c099-e573-4a3b-8fbd-1ec90d0bd52e tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:07.847355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:07.849372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:07.850060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:07.851950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users/442675a7493740d3b972d690e1cd7541` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:07.854040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=442675a7493740d3b972d690e1cd7541)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:07.857663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:07.960818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442675a7493740d3b972d690e1cd7541'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.977616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442675a7493740d3b972d690e1cd7541'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.978648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442675a7493740d3b972d690e1cd7541'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:07.993128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442675a7493740d3b972d690e1cd7541'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:08.003895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442675a7493740d3b972d690e1cd7541'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:08.015474 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3418/6826] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:07 2022] DELETE /identity/v3/users/442675a7493740d3b972d690e1cd7541 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:08.017428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:08.020075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:08.066431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d440739-35c4-4783-965d-3cdb1b9b04e3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:08.155237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:08.155956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:08.156244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:08.156575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/94fe227691b34665abd110bad6267af6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:08.157867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_project(project_id=94fe227691b34665abd110bad6267af6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:08.159890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:08.264931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94fe227691b34665abd110bad6267af6', 'request_id': 'req-5cf746ad-5139-4474-aee8-227717d9a792'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:08.288623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94fe227691b34665abd110bad6267af6', 'request_id': 'req-5cf746ad-5139-4474-aee8-227717d9a792'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:08.297356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94fe227691b34665abd110bad6267af6', 'request_id': 'req-5cf746ad-5139-4474-aee8-227717d9a792'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:08.318515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] The token cache is being invalidate because project 94fe227691b34665abd110bad6267af6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:08.319219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:08.320178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:08.323267 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3409/6827] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:08 2022] DELETE /identity/v3/projects/94fe227691b34665abd110bad6267af6 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:08.329062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:08.330981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:08.363798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35d58-8c6a-4854-bf25-1fa172acdc9b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:08.444166 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:08.453223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcc396-dc02-4d30-8973-50c98c1f95e1 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:08.454248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcc396-dc02-4d30-8973-50c98c1f95e1 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:08.454770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcc396-dc02-4d30-8973-50c98c1f95e1 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:08.455233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcc396-dc02-4d30-8973-50c98c1f95e1 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:08.456051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcc396-dc02-4d30-8973-50c98c1f95e1 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:08.458179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcc396-dc02-4d30-8973-50c98c1f95e1 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:08.502492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:08.503962 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3419/6828] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:24:08 2022] POST /identity/v3/projects => generated 329 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:08.504166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:08.521746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf746ad-5139-4474-aee8-227717d9a792 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:08.582839 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:08.623428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3646220-2c9a-46d9-a719-f77a1ec3a7d4 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:08.625618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3646220-2c9a-46d9-a719-f77a1ec3a7d4 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:08.625915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3646220-2c9a-46d9-a719-f77a1ec3a7d4 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:08.626373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3646220-2c9a-46d9-a719-f77a1ec3a7d4 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:08.627128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3646220-2c9a-46d9-a719-f77a1ec3a7d4 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:08.629112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3646220-2c9a-46d9-a719-f77a1ec3a7d4 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:08.713817 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3410/6829] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:08 2022] POST /identity/v3/users => generated 416 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:08.719472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcc396-dc02-4d30-8973-50c98c1f95e1 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:08.768523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcc396-dc02-4d30-8973-50c98c1f95e1 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:08.788078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e90b91-def9-4865-b721-0ab2ac6b7203 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:08.789060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e90b91-def9-4865-b721-0ab2ac6b7203 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:08.792623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e90b91-def9-4865-b721-0ab2ac6b7203 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:08.793191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e90b91-def9-4865-b721-0ab2ac6b7203 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:08.794242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e90b91-def9-4865-b721-0ab2ac6b7203 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:08.796079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e90b91-def9-4865-b721-0ab2ac6b7203 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:08.832212 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3420/6830] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:08 2022] POST /identity/v3/roles => generated 244 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:08.833360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3646220-2c9a-46d9-a719-f77a1ec3a7d4 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:08.852128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3646220-2c9a-46d9-a719-f77a1ec3a7d4 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:08.868888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fb252-4d8f-4cc6-b848-11da35972f53 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:08.869723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fb252-4d8f-4cc6-b848-11da35972f53 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:08.870694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fb252-4d8f-4cc6-b848-11da35972f53 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:08.872285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264fb252-4d8f-4cc6-b848-11da35972f53 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:08.872285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fb252-4d8f-4cc6-b848-11da35972f53 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:08.873744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264fb252-4d8f-4cc6-b848-11da35972f53 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:08.925409 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3411/6831] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:08 2022] POST /identity/v3/roles => generated 246 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:08.927855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e90b91-def9-4865-b721-0ab2ac6b7203 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:08.946121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e90b91-def9-4865-b721-0ab2ac6b7203 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:08.961492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fcbf-fd80-49c3-b82b-be599047d6fa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:08.962638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fcbf-fd80-49c3-b82b-be599047d6fa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:08.963233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fcbf-fd80-49c3-b82b-be599047d6fa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:08.963757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c6fcbf-fd80-49c3-b82b-be599047d6fa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/31470c34da1b42138154226103eb250c/users/b83ba619b4014e9d85a9ce353db6fa9c/roles/73a6f1097bb14f3398b6514beed2a223` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:09.004957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6fcbf-fd80-49c3-b82b-be599047d6fa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=31470c34da1b42138154226103eb250c, user_id=b83ba619b4014e9d85a9ce353db6fa9c, role_id=73a6f1097bb14f3398b6514beed2a223)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:09.009137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c6fcbf-fd80-49c3-b82b-be599047d6fa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:09.046608 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3421/6832] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:08 2022] PUT /identity/v3/projects/31470c34da1b42138154226103eb250c/users/b83ba619b4014e9d85a9ce353db6fa9c/roles/73a6f1097bb14f3398b6514beed2a223 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:09.052363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fb252-4d8f-4cc6-b848-11da35972f53 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:09.067592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264fb252-4d8f-4cc6-b848-11da35972f53 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:09.265280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683514f-eac5-4146-8d36-de93abc23f10 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:09.266339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683514f-eac5-4146-8d36-de93abc23f10 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:09.267068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683514f-eac5-4146-8d36-de93abc23f10 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:09.267545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683514f-eac5-4146-8d36-de93abc23f10 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/31470c34da1b42138154226103eb250c/users/b83ba619b4014e9d85a9ce353db6fa9c/roles/ff02f418e3a940408d9acea4e1870d52` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:09.274625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683514f-eac5-4146-8d36-de93abc23f10 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=31470c34da1b42138154226103eb250c, user_id=b83ba619b4014e9d85a9ce353db6fa9c, role_id=ff02f418e3a940408d9acea4e1870d52)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:09.277810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683514f-eac5-4146-8d36-de93abc23f10 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:09.309484 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3412/6833] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:09 2022] PUT /identity/v3/projects/31470c34da1b42138154226103eb250c/users/b83ba619b4014e9d85a9ce353db6fa9c/roles/ff02f418e3a940408d9acea4e1870d52 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:09.313787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fcbf-fd80-49c3-b82b-be599047d6fa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:09.328709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c6fcbf-fd80-49c3-b82b-be599047d6fa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:09.466883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0929758e-7151-4a64-a7de-f27708d7d702 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:09.468314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929758e-7151-4a64-a7de-f27708d7d702 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:09.468828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929758e-7151-4a64-a7de-f27708d7d702 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:09.469372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0929758e-7151-4a64-a7de-f27708d7d702 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:09.471008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929758e-7151-4a64-a7de-f27708d7d702 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:09.473660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0929758e-7151-4a64-a7de-f27708d7d702 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:09.545554 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3422/6834] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:09 2022] GET /identity/v3/users => generated 9192 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:09.552660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef51e79-fcee-4339-931d-dfb537da118f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:09.553414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef51e79-fcee-4339-931d-dfb537da118f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:09.553414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef51e79-fcee-4339-931d-dfb537da118f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:09.666195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5ef51e79-fcee-4339-931d-dfb537da118f None None] MFA Rules not processed for user `b83ba619b4014e9d85a9ce353db6fa9c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:09.668229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5ef51e79-fcee-4339-931d-dfb537da118f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:09.846915 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3413/6835] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:09.857578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81183446-4178-4e13-84fc-de1042d1e8ef None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:09.857872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81183446-4178-4e13-84fc-de1042d1e8ef None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:09.858152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81183446-4178-4e13-84fc-de1042d1e8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:09.905999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-81183446-4178-4e13-84fc-de1042d1e8ef None None] MFA Rules not processed for user `b83ba619b4014e9d85a9ce353db6fa9c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:09.907265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81183446-4178-4e13-84fc-de1042d1e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:09.928592 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3423/6836] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:09 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:09.929770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef51e79-fcee-4339-931d-dfb537da118f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:09.944925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef51e79-fcee-4339-931d-dfb537da118f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:09.955032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dbff3-6b54-408d-87d1-890676ba362c tempest-TrustsV3TestJSON-1188303029 tempest-user-1512569979] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b83ba619b4014e9d85a9ce353db6fa9c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '31470c34da1b42138154226103eb250c', 'project_domain_id': 'default', 'roles': ['tempest-NotDelegatedRole-494796563', 'tempest-DelegatedRole-1417900565'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:09.955796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dbff3-6b54-408d-87d1-890676ba362c tempest-TrustsV3TestJSON-1188303029 tempest-user-1512569979] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:09.956117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dbff3-6b54-408d-87d1-890676ba362c tempest-TrustsV3TestJSON-1188303029 tempest-user-1512569979] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:09.956988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dbff3-6b54-408d-87d1-890676ba362c tempest-TrustsV3TestJSON-1188303029 tempest-user-1512569979] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:09.958631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dbff3-6b54-408d-87d1-890676ba362c tempest-TrustsV3TestJSON-1188303029 tempest-user-1512569979] RBAC: Authorizing `identity:create_trust()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:09.963628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5dbff3-6b54-408d-87d1-890676ba362c tempest-TrustsV3TestJSON-1188303029 tempest-user-1512569979] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:10.103269 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:10.156949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81183446-4178-4e13-84fc-de1042d1e8ef None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:10.159181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81183446-4178-4e13-84fc-de1042d1e8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ad5dbff3-6b54-408d-87d1-890676ba362c tempest-TrustsV3TestJSON-1188303029 tempest-user-1512569979] Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error.: keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 44, in parse_isotime Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return iso8601.parse_date(timestr) Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/iso8601/iso8601.py", line 127, in parse_date Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise ParseError(f"Unable to parse date string {datestring!r}") Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application iso8601.iso8601.ParseError: Unable to parse date string 'bad.123Z' Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 346, in parse_expiration_date Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application expiration_time = timeutils.parse_isotime(expiration_date) Oct 24 09:24:10.196919 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py", line 46, in parse_isotime Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise ValueError(str(e)) Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ValueError: Unable to parse date string 'bad.123Z' Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 296, in post Oct 24 09:24:10.198438 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application trust['expires_at'] = self._parse_expiration_date( Oct 24 09:24:10.199669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 127, in _parse_expiration_date Oct 24 09:24:10.199669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return utils.parse_expiration_date(expiration_date) Oct 24 09:24:10.199669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/utils.py", line 348, in parse_expiration_date Oct 24 09:24:10.199669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ValidationTimeStampError() Oct 24 09:24:10.199669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ValidationTimeStampError: Timestamp not in expected format. The server could not comply with the request since it is either malformed or otherwise incorrect. The client is assumed to be in error. Oct 24 09:24:10.199669 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:10.199669 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3414/6837] 10.222.0.25 () {60 vars in 1174 bytes} [Mon Oct 24 09:24:09 2022] POST /identity/v3/OS-TRUST/trusts => generated 227 bytes in 269 msecs (HTTP/1.1 400) 5 headers in 186 bytes (1 switches on core 0) Oct 24 09:24:10.202792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dbff3-6b54-408d-87d1-890676ba362c tempest-TrustsV3TestJSON-1188303029 tempest-user-1512569979] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:10.226285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dbff3-6b54-408d-87d1-890676ba362c tempest-TrustsV3TestJSON-1188303029 tempest-user-1512569979] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:10.235141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:10.235826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:10.236110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:10.236392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/ff02f418e3a940408d9acea4e1870d52` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:10.240130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=ff02f418e3a940408d9acea4e1870d52)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:10.241802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:10.348241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role ff02f418e3a940408d9acea4e1870d52 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:10.348552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:10.361544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:10.361544 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3415/6838] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:10 2022] DELETE /identity/v3/roles/ff02f418e3a940408d9acea4e1870d52 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:10.361544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:10.362161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:10.409870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81183446-4178-4e13-84fc-de1042d1e8ef None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:10.508763 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:10.530733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd66dd32-7df1-4107-87ab-252d24366042 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:10.576873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:10.577629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:10.577841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:10.578116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/73a6f1097bb14f3398b6514beed2a223` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:10.581576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=73a6f1097bb14f3398b6514beed2a223)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:10.584875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:10.601543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:10.602273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:10.604396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:10.604888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] PATH_INFO: `/v3/users/80021ed736034de9951f37cef3b20209` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:10.607245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80021ed736034de9951f37cef3b20209)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:10.615076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:10.684802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role 73a6f1097bb14f3398b6514beed2a223 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:10.685566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:10.690102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:10.695473 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3416/6839] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:10 2022] DELETE /identity/v3/roles/73a6f1097bb14f3398b6514beed2a223 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:10.696550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:10.700618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:10.734745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80021ed736034de9951f37cef3b20209'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:10.786455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80021ed736034de9951f37cef3b20209'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:10.787445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80021ed736034de9951f37cef3b20209'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:10.804745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80021ed736034de9951f37cef3b20209'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:10.817213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5dc2e753-b347-44ed-81e9-4bcce6daf7d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80021ed736034de9951f37cef3b20209'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:10.828347 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3424/6840] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:10 2022] DELETE /identity/v3/users/80021ed736034de9951f37cef3b20209 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:10.841330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6aef-3a55-4050-b316-c2d1716e9225 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:10.854287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6aef-3a55-4050-b316-c2d1716e9225 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:10.854711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71d6aef-3a55-4050-b316-c2d1716e9225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:10.873469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd753e-3198-490d-a743-312a6dc3cb46 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:10.894347 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:10.955753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d71d6aef-3a55-4050-b316-c2d1716e9225 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:10.961737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d71d6aef-3a55-4050-b316-c2d1716e9225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:11.056737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:11.063900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:11.064201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:11.064462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users/b83ba619b4014e9d85a9ce353db6fa9c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:11.066341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=b83ba619b4014e9d85a9ce353db6fa9c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:11.068297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:11.136095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b83ba619b4014e9d85a9ce353db6fa9c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.141657 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3425/6841] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:11.164559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b83ba619b4014e9d85a9ce353db6fa9c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.165443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b83ba619b4014e9d85a9ce353db6fa9c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.166732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d6aef-3a55-4050-b316-c2d1716e9225 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:11.168361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d71d6aef-3a55-4050-b316-c2d1716e9225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:11.180812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b83ba619b4014e9d85a9ce353db6fa9c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.200764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b83ba619b4014e9d85a9ce353db6fa9c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.214431 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3417/6842] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:10 2022] DELETE /identity/v3/users/b83ba619b4014e9d85a9ce353db6fa9c => generated 0 bytes in 518 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:11.224157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:11.226865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:11.343135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71d6aef-3a55-4050-b316-c2d1716e9225 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:11.371589 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:11.422611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1432704-5d41-4bcf-adf6-022b58db7b93 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:11.442097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:11.442756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:11.443037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:11.443313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/31470c34da1b42138154226103eb250c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:11.444703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_project(project_id=31470c34da1b42138154226103eb250c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:11.446662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:11.460312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7d3e-8a20-4591-98b7-aefbd1f0ee79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:11.460955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7d3e-8a20-4591-98b7-aefbd1f0ee79 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:11.461239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7d3e-8a20-4591-98b7-aefbd1f0ee79 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:11.461542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246f7d3e-8a20-4591-98b7-aefbd1f0ee79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:11.463489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-246f7d3e-8a20-4591-98b7-aefbd1f0ee79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:11.539058 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:11.549732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31470c34da1b42138154226103eb250c', 'request_id': 'req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.571096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31470c34da1b42138154226103eb250c', 'request_id': 'req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.586342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31470c34da1b42138154226103eb250c', 'request_id': 'req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.587889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7d3e-8a20-4591-98b7-aefbd1f0ee79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:11.590077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246f7d3e-8a20-4591-98b7-aefbd1f0ee79 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:11.605782 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3426/6843] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:11.606509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] The token cache is being invalidate because project 31470c34da1b42138154226103eb250c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:11.606880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.609416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:11.618412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3418/6844] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:11 2022] DELETE /identity/v3/projects/31470c34da1b42138154226103eb250c => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:11.619818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7d3e-8a20-4591-98b7-aefbd1f0ee79 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:11.645726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246f7d3e-8a20-4591-98b7-aefbd1f0ee79 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:11.725642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:11.727485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:11.820680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438f1d8-88a6-4647-9eea-f35bc29a394a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:11.822768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438f1d8-88a6-4647-9eea-f35bc29a394a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:11.823083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438f1d8-88a6-4647-9eea-f35bc29a394a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:11.823934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8438f1d8-88a6-4647-9eea-f35bc29a394a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:11.824980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438f1d8-88a6-4647-9eea-f35bc29a394a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:11.831681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8438f1d8-88a6-4647-9eea-f35bc29a394a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:11.843608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef4ccd0-e641-4187-a6b1-ab5a7edbbf7a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:11.850481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:11.851714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:11.853091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:11.853614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:11.856409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:11.874912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:11.878903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:11.899094 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3419/6845] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:11.904786 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3427/6846] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:24:11 2022] POST /identity/v3/projects => generated 328 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:11.914674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:11.917373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:11.944629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4902bbbd-5b7f-41aa-b8de-934df7b78f89 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:12.040616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4749fb4-e965-460d-975c-5f121b3f6d66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:12.041455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4749fb4-e965-460d-975c-5f121b3f6d66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:12.042194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4749fb4-e965-460d-975c-5f121b3f6d66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:12.042547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4749fb4-e965-460d-975c-5f121b3f6d66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:12.043320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4749fb4-e965-460d-975c-5f121b3f6d66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:12.047614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4749fb4-e965-460d-975c-5f121b3f6d66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:12.114073 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3420/6847] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:11 2022] POST /identity/v3/users => generated 416 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:12.114338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438f1d8-88a6-4647-9eea-f35bc29a394a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:12.130727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8438f1d8-88a6-4647-9eea-f35bc29a394a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:12.152424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2066c-5e17-493b-8380-b4e7cb5b23aa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:12.153058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2066c-5e17-493b-8380-b4e7cb5b23aa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:12.153362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2066c-5e17-493b-8380-b4e7cb5b23aa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:12.153655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e2066c-5e17-493b-8380-b4e7cb5b23aa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:12.154551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2066c-5e17-493b-8380-b4e7cb5b23aa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:12.156407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e2066c-5e17-493b-8380-b4e7cb5b23aa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:12.185558 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3428/6848] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:12 2022] POST /identity/v3/roles => generated 243 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:12.189893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4749fb4-e965-460d-975c-5f121b3f6d66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:12.204354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4749fb4-e965-460d-975c-5f121b3f6d66 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:12.213511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59575006-8338-448d-82d8-9de9df4aceec tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:12.214432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59575006-8338-448d-82d8-9de9df4aceec tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:12.214909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59575006-8338-448d-82d8-9de9df4aceec tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:12.215363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59575006-8338-448d-82d8-9de9df4aceec tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:12.216242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59575006-8338-448d-82d8-9de9df4aceec tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:12.218184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59575006-8338-448d-82d8-9de9df4aceec tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:12.269057 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3421/6849] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:12 2022] POST /identity/v3/roles => generated 246 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:12.270770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2066c-5e17-493b-8380-b4e7cb5b23aa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:12.291677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e2066c-5e17-493b-8380-b4e7cb5b23aa tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:12.303152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204f9bc-f69e-4979-ad6f-f3e6b8dc20ce tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:12.304094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204f9bc-f69e-4979-ad6f-f3e6b8dc20ce tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:12.304600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204f9bc-f69e-4979-ad6f-f3e6b8dc20ce tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:12.305514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7204f9bc-f69e-4979-ad6f-f3e6b8dc20ce tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/7f59156b3b494ea5860e25bc2cc7b585/users/aa6805ccf80744128515ea842595e01f/roles/c3467c2d2b4b421081653c589f6dc901` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:12.350219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204f9bc-f69e-4979-ad6f-f3e6b8dc20ce tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7f59156b3b494ea5860e25bc2cc7b585, user_id=aa6805ccf80744128515ea842595e01f, role_id=c3467c2d2b4b421081653c589f6dc901)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:12.353033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7204f9bc-f69e-4979-ad6f-f3e6b8dc20ce tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:12.388216 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3429/6850] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:12 2022] PUT /identity/v3/projects/7f59156b3b494ea5860e25bc2cc7b585/users/aa6805ccf80744128515ea842595e01f/roles/c3467c2d2b4b421081653c589f6dc901 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:12.389329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59575006-8338-448d-82d8-9de9df4aceec tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:12.408647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59575006-8338-448d-82d8-9de9df4aceec tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:12.503724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204f9bc-f69e-4979-ad6f-f3e6b8dc20ce tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:12.506685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7204f9bc-f69e-4979-ad6f-f3e6b8dc20ce tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:12.550334 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:12.612639 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:12.654806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7204f9bc-f69e-4979-ad6f-f3e6b8dc20ce tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:12.670711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:12.673820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:12.674189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:12.674479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] PATH_INFO: `/v3/projects/c6f373e6cee745149bb84a3c5568ba0f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:12.681578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8617a4-d93c-4599-8e1b-a3255163eea7 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:12.682283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8617a4-d93c-4599-8e1b-a3255163eea7 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:12.682564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8617a4-d93c-4599-8e1b-a3255163eea7 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:12.683270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6f373e6cee745149bb84a3c5568ba0f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:12.684902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8617a4-d93c-4599-8e1b-a3255163eea7 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/7f59156b3b494ea5860e25bc2cc7b585/users/aa6805ccf80744128515ea842595e01f/roles/70f5b84b55874c8c8fea9c388606fa9d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:12.694604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8617a4-d93c-4599-8e1b-a3255163eea7 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=7f59156b3b494ea5860e25bc2cc7b585, user_id=aa6805ccf80744128515ea842595e01f, role_id=70f5b84b55874c8c8fea9c388606fa9d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:12.697243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:12.706301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8617a4-d93c-4599-8e1b-a3255163eea7 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:12.739706 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3422/6851] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:12 2022] PUT /identity/v3/projects/7f59156b3b494ea5860e25bc2cc7b585/users/aa6805ccf80744128515ea842595e01f/roles/70f5b84b55874c8c8fea9c388606fa9d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:12.744520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8617a4-d93c-4599-8e1b-a3255163eea7 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:12.882630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6f373e6cee745149bb84a3c5568ba0f', 'request_id': 'req-7beaf864-def4-4234-8e17-cdbec5b18c3f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:12.914186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6f373e6cee745149bb84a3c5568ba0f', 'request_id': 'req-7beaf864-def4-4234-8e17-cdbec5b18c3f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:12.940899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6f373e6cee745149bb84a3c5568ba0f', 'request_id': 'req-7beaf864-def4-4234-8e17-cdbec5b18c3f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:12.982508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] The token cache is being invalidate because project c6f373e6cee745149bb84a3c5568ba0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:12.982783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:12.986810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:12.995480 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3430/6852] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:12 2022] DELETE /identity/v3/projects/c6f373e6cee745149bb84a3c5568ba0f => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:12.997494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:13.005248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:13.019007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8617a4-d93c-4599-8e1b-a3255163eea7 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:13.227032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaf864-def4-4234-8e17-cdbec5b18c3f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:13.235752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c73361c-e652-4ef5-a9e9-94f7128cf3d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:13.238630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73361c-e652-4ef5-a9e9-94f7128cf3d4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:13.238922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73361c-e652-4ef5-a9e9-94f7128cf3d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:13.239202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c73361c-e652-4ef5-a9e9-94f7128cf3d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:13.242743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d960b-0439-4dba-8fec-dc5b500aaa85 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:13.243464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d960b-0439-4dba-8fec-dc5b500aaa85 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:13.243871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d960b-0439-4dba-8fec-dc5b500aaa85 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:13.244565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d960b-0439-4dba-8fec-dc5b500aaa85 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:13.245416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d960b-0439-4dba-8fec-dc5b500aaa85 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:13.247840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d960b-0439-4dba-8fec-dc5b500aaa85 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:13.248515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0c73361c-e652-4ef5-a9e9-94f7128cf3d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:13.299518 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3431/6853] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:12 2022] GET /identity/v3/users => generated 8903 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:13.301221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ccbcc-5e53-4d24-8a71-2d12350ff1c2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:13.301637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ccbcc-5e53-4d24-8a71-2d12350ff1c2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:13.301979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15ccbcc-5e53-4d24-8a71-2d12350ff1c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:13.350070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b15ccbcc-5e53-4d24-8a71-2d12350ff1c2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:13.356374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b15ccbcc-5e53-4d24-8a71-2d12350ff1c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:13.441175 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:13.502655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73361c-e652-4ef5-a9e9-94f7128cf3d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:13.504166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c73361c-e652-4ef5-a9e9-94f7128cf3d4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:13.522305 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3432/6854] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:13.524005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3434-6070-4f3c-8657-d40c6ae4a3a6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:13.525420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3434-6070-4f3c-8657-d40c6ae4a3a6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:13.525870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720b3434-6070-4f3c-8657-d40c6ae4a3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:13.535459 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3423/6855] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 795 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:13.536767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2008afd-547d-4809-8261-5d24be5377ab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:13.537061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2008afd-547d-4809-8261-5d24be5377ab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:13.537358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2008afd-547d-4809-8261-5d24be5377ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:13.622450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-720b3434-6070-4f3c-8657-d40c6ae4a3a6 None None] MFA Rules not processed for user `aa6805ccf80744128515ea842595e01f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:13.623604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-720b3434-6070-4f3c-8657-d40c6ae4a3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:13.629265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b2008afd-547d-4809-8261-5d24be5377ab None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:13.631390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2008afd-547d-4809-8261-5d24be5377ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:13.664546 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3424/6856] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:13.673247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2008afd-547d-4809-8261-5d24be5377ab None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:13.687653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2008afd-547d-4809-8261-5d24be5377ab None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:13.710259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f4ec1-10e9-43b5-9b5e-31b5904cf6a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:13.711327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f4ec1-10e9-43b5-9b5e-31b5904cf6a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:13.711793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f4ec1-10e9-43b5-9b5e-31b5904cf6a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:13.712862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f4ec1-10e9-43b5-9b5e-31b5904cf6a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:13.713735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f4ec1-10e9-43b5-9b5e-31b5904cf6a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:13.714321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f4ec1-10e9-43b5-9b5e-31b5904cf6a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:13.716192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f4ec1-10e9-43b5-9b5e-31b5904cf6a1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:13.749437 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3425/6857] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:13.751109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f4ec1-10e9-43b5-9b5e-31b5904cf6a1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:13.784314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f4ec1-10e9-43b5-9b5e-31b5904cf6a1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:13.800518 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3433/6858] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:13.802018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a108b2-c455-4504-aa98-6c6ab10aa370 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:13.802305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a108b2-c455-4504-aa98-6c6ab10aa370 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:13.802579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a108b2-c455-4504-aa98-6c6ab10aa370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:13.807079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b70ba9-60a1-4241-b516-7aedf7e23ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:13.809192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b70ba9-60a1-4241-b516-7aedf7e23ddf admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:13.809767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b70ba9-60a1-4241-b516-7aedf7e23ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:13.810305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b70ba9-60a1-4241-b516-7aedf7e23ddf admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:13.811229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b70ba9-60a1-4241-b516-7aedf7e23ddf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:13.813532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b70ba9-60a1-4241-b516-7aedf7e23ddf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:13.825567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-88a108b2-c455-4504-aa98-6c6ab10aa370 None None] MFA Rules not processed for user `aa6805ccf80744128515ea842595e01f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:13.826688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-88a108b2-c455-4504-aa98-6c6ab10aa370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:13.837335 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:13.846691 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3434/6859] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:13.847894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a108b2-c455-4504-aa98-6c6ab10aa370 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:13.867665 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3426/6860] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:13 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:13.878392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b70ba9-60a1-4241-b516-7aedf7e23ddf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:13.884471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a108b2-c455-4504-aa98-6c6ab10aa370 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.017336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b70ba9-60a1-4241-b516-7aedf7e23ddf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.023199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e84af5-7932-428a-82b4-7c4c0209ff92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.024370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e84af5-7932-428a-82b4-7c4c0209ff92 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.024658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e84af5-7932-428a-82b4-7c4c0209ff92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.024940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e84af5-7932-428a-82b4-7c4c0209ff92 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.026047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e84af5-7932-428a-82b4-7c4c0209ff92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.029711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e84af5-7932-428a-82b4-7c4c0209ff92 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.036420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a9c0f-7da1-4213-970d-72143a107580 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6805ccf80744128515ea842595e01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f59156b3b494ea5860e25bc2cc7b585', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-282164370', 'tempest-NotDelegatedRole-853091153'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.038920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a9c0f-7da1-4213-970d-72143a107580 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.039266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a9c0f-7da1-4213-970d-72143a107580 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.039622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706a9c0f-7da1-4213-970d-72143a107580 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.040530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a9c0f-7da1-4213-970d-72143a107580 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorizing `identity:create_trust()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.041894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706a9c0f-7da1-4213-970d-72143a107580 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.092846 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3427/6861] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:13 2022] POST /identity/v3/users => generated 292 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:14.096602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e84af5-7932-428a-82b4-7c4c0209ff92 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:14.119811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e84af5-7932-428a-82b4-7c4c0209ff92 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.127922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a0ea9-081d-4574-8e44-35c824e8e27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.128546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a0ea9-081d-4574-8e44-35c824e8e27f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.128831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a0ea9-081d-4574-8e44-35c824e8e27f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.129108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a0ea9-081d-4574-8e44-35c824e8e27f admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.130055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a0ea9-081d-4574-8e44-35c824e8e27f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.131950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a0ea9-081d-4574-8e44-35c824e8e27f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.158131 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3428/6862] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:14 2022] GET /identity/v3/roles => generated 1891 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:14.162017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a0ea9-081d-4574-8e44-35c824e8e27f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:14.185129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a0ea9-081d-4574-8e44-35c824e8e27f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.202793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c069fc-7345-4fc5-9aa7-5343681ab804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.203533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c069fc-7345-4fc5-9aa7-5343681ab804 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.204098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c069fc-7345-4fc5-9aa7-5343681ab804 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.204383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c069fc-7345-4fc5-9aa7-5343681ab804 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.205038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c069fc-7345-4fc5-9aa7-5343681ab804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.207427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c069fc-7345-4fc5-9aa7-5343681ab804 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.248841 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3429/6863] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:14 2022] GET /identity/v3/roles => generated 1891 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:14.250007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c069fc-7345-4fc5-9aa7-5343681ab804 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:14.273198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c069fc-7345-4fc5-9aa7-5343681ab804 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.280618 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:14.290483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0ac8ed-00f1-4e3b-bbdf-68a939ebb007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.291172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac8ed-00f1-4e3b-bbdf-68a939ebb007 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.291456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac8ed-00f1-4e3b-bbdf-68a939ebb007 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.291738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0ac8ed-00f1-4e3b-bbdf-68a939ebb007 admin admin] PATH_INFO: `/v3/projects/bdbe813ada9c4de69369975d945d7f2d/users/31873afb6a9a43aaa870cdd33a29443e/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.309731 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3435/6864] 10.222.0.25 () {60 vars in 1174 bytes} [Mon Oct 24 09:24:13 2022] POST /identity/v3/OS-TRUST/trusts => generated 833 bytes in 460 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:14.311226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a9c0f-7da1-4213-970d-72143a107580 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:14.352165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ac8ed-00f1-4e3b-bbdf-68a939ebb007 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdbe813ada9c4de69369975d945d7f2d, user_id=31873afb6a9a43aaa870cdd33a29443e, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.355059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0ac8ed-00f1-4e3b-bbdf-68a939ebb007 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.360132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706a9c0f-7da1-4213-970d-72143a107580 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.379688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ecd35-935b-4700-9f38-2f7b0b426a80 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6805ccf80744128515ea842595e01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f59156b3b494ea5860e25bc2cc7b585', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-282164370', 'tempest-NotDelegatedRole-853091153'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.382957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ecd35-935b-4700-9f38-2f7b0b426a80 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.384026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ecd35-935b-4700-9f38-2f7b0b426a80 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.385020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8ecd35-935b-4700-9f38-2f7b0b426a80 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] PATH_INFO: `/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.393611 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3430/6865] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:14 2022] PUT /identity/v3/projects/bdbe813ada9c4de69369975d945d7f2d/users/31873afb6a9a43aaa870cdd33a29443e/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:14.406986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351576cf-1835-4f84-be74-ad163af37105 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.408747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351576cf-1835-4f84-be74-ad163af37105 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.409217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351576cf-1835-4f84-be74-ad163af37105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.437015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ecd35-935b-4700-9f38-2f7b0b426a80 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorizing `identity:get_trust(trust_id=3fbb83740bdd4c20b7bdc0be20dbda9b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.439075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8ecd35-935b-4700-9f38-2f7b0b426a80 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.467489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-351576cf-1835-4f84-be74-ad163af37105 None None] MFA Rules not processed for user `31873afb6a9a43aaa870cdd33a29443e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:14.468839 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3436/6866] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:24:14 2022] GET /identity/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b => generated 833 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:14.469269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-351576cf-1835-4f84-be74-ad163af37105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:14.473451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ecd35-935b-4700-9f38-2f7b0b426a80 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:14.491526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8ecd35-935b-4700-9f38-2f7b0b426a80 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.637350 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3431/6867] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:24:14.659644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351576cf-1835-4f84-be74-ad163af37105 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:14.663634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-351576cf-1835-4f84-be74-ad163af37105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:14.666559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01320eb-3692-427a-aadc-4ed43ea3c53d tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6805ccf80744128515ea842595e01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f59156b3b494ea5860e25bc2cc7b585', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-282164370', 'tempest-NotDelegatedRole-853091153'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.667230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01320eb-3692-427a-aadc-4ed43ea3c53d tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.667513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01320eb-3692-427a-aadc-4ed43ea3c53d tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.667791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01320eb-3692-427a-aadc-4ed43ea3c53d tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] PATH_INFO: `/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.682516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01320eb-3692-427a-aadc-4ed43ea3c53d tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=3fbb83740bdd4c20b7bdc0be20dbda9b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.684483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01320eb-3692-427a-aadc-4ed43ea3c53d tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.702399 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3437/6868] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:24:14 2022] GET /identity/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles => generated 370 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:14.706817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01320eb-3692-427a-aadc-4ed43ea3c53d tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:14.725346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01320eb-3692-427a-aadc-4ed43ea3c53d tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.731318 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:14.736444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad51d-4d4b-4925-8515-1c6c50e08f58 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6805ccf80744128515ea842595e01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f59156b3b494ea5860e25bc2cc7b585', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-282164370', 'tempest-NotDelegatedRole-853091153'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.737112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad51d-4d4b-4925-8515-1c6c50e08f58 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.737421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad51d-4d4b-4925-8515-1c6c50e08f58 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.737701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ad51d-4d4b-4925-8515-1c6c50e08f58 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] PATH_INFO: `/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles/c3467c2d2b4b421081653c589f6dc901` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.780076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ad51d-4d4b-4925-8515-1c6c50e08f58 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3fbb83740bdd4c20b7bdc0be20dbda9b, role_id=c3467c2d2b4b421081653c589f6dc901)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.781596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085ad51d-4d4b-4925-8515-1c6c50e08f58 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.800712 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3438/6869] 10.222.0.25 () {58 vars in 1368 bytes} [Mon Oct 24 09:24:14 2022] GET /identity/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles/c3467c2d2b4b421081653c589f6dc901 => generated 243 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:24:14.804511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad51d-4d4b-4925-8515-1c6c50e08f58 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:14.825776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ad51d-4d4b-4925-8515-1c6c50e08f58 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.838142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c49d2-ab61-41ae-a44e-c9124f55334f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6805ccf80744128515ea842595e01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f59156b3b494ea5860e25bc2cc7b585', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-282164370', 'tempest-NotDelegatedRole-853091153'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.838892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c49d2-ab61-41ae-a44e-c9124f55334f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] REQUEST_METHOD: `HEAD` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.839217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c49d2-ab61-41ae-a44e-c9124f55334f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.839522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c49d2-ab61-41ae-a44e-c9124f55334f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] PATH_INFO: `/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles/c3467c2d2b4b421081653c589f6dc901` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.862505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351576cf-1835-4f84-be74-ad163af37105 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.863698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c49d2-ab61-41ae-a44e-c9124f55334f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3fbb83740bdd4c20b7bdc0be20dbda9b, role_id=c3467c2d2b4b421081653c589f6dc901)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.865658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c49d2-ab61-41ae-a44e-c9124f55334f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.882070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d397a-9d20-49ab-9251-2da83245c400 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.884664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d397a-9d20-49ab-9251-2da83245c400 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.884939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d397a-9d20-49ab-9251-2da83245c400 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.886710 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3439/6870] 10.222.0.25 () {58 vars in 1369 bytes} [Mon Oct 24 09:24:14 2022] HEAD /identity/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles/c3467c2d2b4b421081653c589f6dc901 => generated 0 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:14.892893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9d397a-9d20-49ab-9251-2da83245c400 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.894836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c49d2-ab61-41ae-a44e-c9124f55334f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:14.918708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c49d2-ab61-41ae-a44e-c9124f55334f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:14.925321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d397a-9d20-49ab-9251-2da83245c400 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.927263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9d397a-9d20-49ab-9251-2da83245c400 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.931512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cee3c-76a6-4094-9fd2-fdd7497664af tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6805ccf80744128515ea842595e01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f59156b3b494ea5860e25bc2cc7b585', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-282164370', 'tempest-NotDelegatedRole-853091153'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:14.932179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cee3c-76a6-4094-9fd2-fdd7497664af tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:14.932466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cee3c-76a6-4094-9fd2-fdd7497664af tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:14.932749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3cee3c-76a6-4094-9fd2-fdd7497664af tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] PATH_INFO: `/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles/70f5b84b55874c8c8fea9c388606fa9d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:14.945394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cee3c-76a6-4094-9fd2-fdd7497664af tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3fbb83740bdd4c20b7bdc0be20dbda9b, role_id=70f5b84b55874c8c8fea9c388606fa9d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:14.946894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3cee3c-76a6-4094-9fd2-fdd7497664af tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:14.954481 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3432/6871] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:14 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-4d3cee3c-76a6-4094-9fd2-fdd7497664af tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Could not find role: 70f5b84b55874c8c8fea9c388606fa9d.: keystone.exception.RoleNotFound: Could not find role: 70f5b84b55874c8c8fea9c388606fa9d. Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 09:24:14.959635 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 70f5b84b55874c8c8fea9c388606fa9d. Oct 24 09:24:14.960896 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:24:14.974626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3440/6872] 10.222.0.25 () {58 vars in 1368 bytes} [Mon Oct 24 09:24:14 2022] GET /identity/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles/70f5b84b55874c8c8fea9c388606fa9d => generated 110 bytes in 78 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:24:14.976152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d397a-9d20-49ab-9251-2da83245c400 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:15.003629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9d397a-9d20-49ab-9251-2da83245c400 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:15.027785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6805ccf80744128515ea842595e01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f59156b3b494ea5860e25bc2cc7b585', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-282164370', 'tempest-NotDelegatedRole-853091153'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:15.034861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:15.035161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:15.035449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] PATH_INFO: `/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles/70f5b84b55874c8c8fea9c388606fa9d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:15.058234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorizing `identity:get_role_for_trust(trust_id=3fbb83740bdd4c20b7bdc0be20dbda9b, role_id=70f5b84b55874c8c8fea9c388606fa9d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:15.064683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Could not find role: 70f5b84b55874c8c8fea9c388606fa9d.: keystone.exception.RoleNotFound: Could not find role: 70f5b84b55874c8c8fea9c388606fa9d. Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 09:24:15.103416 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: 70f5b84b55874c8c8fea9c388606fa9d. Oct 24 09:24:15.104875 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:15.111006 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3433/6873] 10.222.0.25 () {58 vars in 1369 bytes} [Mon Oct 24 09:24:14 2022] HEAD /identity/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b/roles/70f5b84b55874c8c8fea9c388606fa9d => generated 0 bytes in 131 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 24 09:24:15.112519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cee3c-76a6-4094-9fd2-fdd7497664af tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:15.123560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3cee3c-76a6-4094-9fd2-fdd7497664af tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:15.129564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6805ccf80744128515ea842595e01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f59156b3b494ea5860e25bc2cc7b585', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-282164370', 'tempest-NotDelegatedRole-853091153'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:15.130206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:15.130486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:15.132066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] PATH_INFO: `/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:15.140284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorizing `identity:delete_trust(trust_id=3fbb83740bdd4c20b7bdc0be20dbda9b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:15.148083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:15.177629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3fbb83740bdd4c20b7bdc0be20dbda9b', 'request_id': 'req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:15.179330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': '3fbb83740bdd4c20b7bdc0be20dbda9b', 'request_id': 'req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:15.180053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': '3fbb83740bdd4c20b7bdc0be20dbda9b', 'request_id': 'req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:15.216753 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3441/6874] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:24:15 2022] DELETE /identity/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:15.218685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:15.221264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:15.263845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4cd1ae-b119-4f59-adee-319088b32983 tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:15.283454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa2871-ae49-41f9-8954-7c43f006530e tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aa6805ccf80744128515ea842595e01f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7f59156b3b494ea5860e25bc2cc7b585', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-282164370', 'tempest-NotDelegatedRole-853091153'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:15.284777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa2871-ae49-41f9-8954-7c43f006530e tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:15.285126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa2871-ae49-41f9-8954-7c43f006530e tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:15.285590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa2871-ae49-41f9-8954-7c43f006530e tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] PATH_INFO: `/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6daa2871-ae49-41f9-8954-7c43f006530e tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Could not find trust: 3fbb83740bdd4c20b7bdc0be20dbda9b.: keystone.exception.TrustNotFound: Could not find trust: 3fbb83740bdd4c20b7bdc0be20dbda9b. Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 24 09:24:15.363959 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: 3fbb83740bdd4c20b7bdc0be20dbda9b. Oct 24 09:24:15.365268 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:15.375340 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3434/6875] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:24:15 2022] GET /identity/v3/OS-TRUST/trusts/3fbb83740bdd4c20b7bdc0be20dbda9b => generated 111 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:24:15.379390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:15.383490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:15.455161 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:UPDATE=1,keystone:INSERT=1,keystone:DELETE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:15.491026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c32d99a-f9b6-4a39-a324-309f1d1fc41f tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:15.497243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:15.506739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:15.507387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:15.508459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/70f5b84b55874c8c8fea9c388606fa9d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:15.510875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=70f5b84b55874c8c8fea9c388606fa9d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:15.513604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:15.589425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role 70f5b84b55874c8c8fea9c388606fa9d has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:15.589725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:15.595689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:15.597818 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3442/6876] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:15 2022] DELETE /identity/v3/roles/70f5b84b55874c8c8fea9c388606fa9d => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:15.603902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa2871-ae49-41f9-8954-7c43f006530e tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:15.605998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6daa2871-ae49-41f9-8954-7c43f006530e tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:15.637769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa2871-ae49-41f9-8954-7c43f006530e tempest-TrustsV3TestJSON-208684480 tempest-user-2018729152] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:15.776529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:15.777195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:15.777934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:15.778468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/c3467c2d2b4b421081653c589f6dc901` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:15.782822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=c3467c2d2b4b421081653c589f6dc901)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:15.793368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:15.902714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role c3467c2d2b4b421081653c589f6dc901 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:15.903023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:15.924210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:15.930662 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3435/6877] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:15 2022] DELETE /identity/v3/roles/c3467c2d2b4b421081653c589f6dc901 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:15.934496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:15.976550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264dbc73-5bf3-44eb-90ad-37c8c44dca74 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:16.082920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:16.083595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:16.083908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:16.084192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users/aa6805ccf80744128515ea842595e01f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:16.093207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=aa6805ccf80744128515ea842595e01f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:16.098423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:16.241558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa6805ccf80744128515ea842595e01f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.269726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa6805ccf80744128515ea842595e01f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.270638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa6805ccf80744128515ea842595e01f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.300329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa6805ccf80744128515ea842595e01f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.313831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa6805ccf80744128515ea842595e01f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.325469 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3443/6878] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:15 2022] DELETE /identity/v3/users/aa6805ccf80744128515ea842595e01f => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:16.330127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:16.331760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:16.350436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71131e2-83ef-46ff-876b-6a6db9dc51f8 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:16.445272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:16.446799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:16.447174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:16.447655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/7f59156b3b494ea5860e25bc2cc7b585` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:16.448918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7f59156b3b494ea5860e25bc2cc7b585)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:16.451543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:16.480721 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:16.550183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f59156b3b494ea5860e25bc2cc7b585', 'request_id': 'req-a44b3d17-7ede-4324-8e74-f52845433d95'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.570385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f59156b3b494ea5860e25bc2cc7b585', 'request_id': 'req-a44b3d17-7ede-4324-8e74-f52845433d95'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.583803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f59156b3b494ea5860e25bc2cc7b585', 'request_id': 'req-a44b3d17-7ede-4324-8e74-f52845433d95'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.618108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] The token cache is being invalidate because project 7f59156b3b494ea5860e25bc2cc7b585 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:16.618416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.619882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:16.623693 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3436/6879] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:16 2022] DELETE /identity/v3/projects/7f59156b3b494ea5860e25bc2cc7b585 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:16.629544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:16.633353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:16.652379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c6cd2-8ef4-4962-a0d7-4a08e97d6b08 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:16.696504 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:16.748957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320baf42-a917-42eb-95d3-b65975138d8b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:16.749840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320baf42-a917-42eb-95d3-b65975138d8b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:16.750296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320baf42-a917-42eb-95d3-b65975138d8b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:16.751284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320baf42-a917-42eb-95d3-b65975138d8b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:16.752111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320baf42-a917-42eb-95d3-b65975138d8b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:16.755313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320baf42-a917-42eb-95d3-b65975138d8b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:16.810495 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3444/6880] 10.222.0.25 () {60 vars in 1152 bytes} [Mon Oct 24 09:24:16 2022] POST /identity/v3/projects => generated 328 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:16.815308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:16.817769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:16.848678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b3d17-7ede-4324-8e74-f52845433d95 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:16.964420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b340e87-2e56-480c-8d08-e2a5149e1fae tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:16.965149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340e87-2e56-480c-8d08-e2a5149e1fae tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:16.965523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340e87-2e56-480c-8d08-e2a5149e1fae tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:16.965904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b340e87-2e56-480c-8d08-e2a5149e1fae tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:16.966630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b340e87-2e56-480c-8d08-e2a5149e1fae tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:16.968828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b340e87-2e56-480c-8d08-e2a5149e1fae tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:17.003683 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3437/6881] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:16 2022] POST /identity/v3/users => generated 413 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:17.009051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320baf42-a917-42eb-95d3-b65975138d8b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:17.027988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320baf42-a917-42eb-95d3-b65975138d8b tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:17.033105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c57023-a5ca-49b0-a3ee-3b7ffbf4064c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:17.033791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c57023-a5ca-49b0-a3ee-3b7ffbf4064c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.034115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c57023-a5ca-49b0-a3ee-3b7ffbf4064c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.034402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c57023-a5ca-49b0-a3ee-3b7ffbf4064c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:17.035078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c57023-a5ca-49b0-a3ee-3b7ffbf4064c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:17.038171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c57023-a5ca-49b0-a3ee-3b7ffbf4064c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:17.061571 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3445/6882] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:17 2022] POST /identity/v3/roles => generated 244 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:17.065734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b340e87-2e56-480c-8d08-e2a5149e1fae tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:17.078575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b340e87-2e56-480c-8d08-e2a5149e1fae tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:17.085084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285efea-a79f-4ba9-959e-6a1ea8649e1c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:17.086029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285efea-a79f-4ba9-959e-6a1ea8649e1c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.086499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285efea-a79f-4ba9-959e-6a1ea8649e1c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.086942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285efea-a79f-4ba9-959e-6a1ea8649e1c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:17.088614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285efea-a79f-4ba9-959e-6a1ea8649e1c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:17.091125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285efea-a79f-4ba9-959e-6a1ea8649e1c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:17.123223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3438/6883] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:17 2022] POST /identity/v3/roles => generated 246 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:17.124375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c57023-a5ca-49b0-a3ee-3b7ffbf4064c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:17.138229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c57023-a5ca-49b0-a3ee-3b7ffbf4064c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:17.146463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65667707-6c60-46be-8f6d-2923354b95f3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:17.147489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65667707-6c60-46be-8f6d-2923354b95f3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.147489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65667707-6c60-46be-8f6d-2923354b95f3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.147710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65667707-6c60-46be-8f6d-2923354b95f3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/717c948970484ac3836c89d76d8c1af3/users/cda94b6a9c6f4c78b88fa46e395cca84/roles/f768d32bfece4f08b55bcfcae6876140` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:17.168815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65667707-6c60-46be-8f6d-2923354b95f3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=717c948970484ac3836c89d76d8c1af3, user_id=cda94b6a9c6f4c78b88fa46e395cca84, role_id=f768d32bfece4f08b55bcfcae6876140)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:17.172052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65667707-6c60-46be-8f6d-2923354b95f3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:17.196507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3446/6884] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:17 2022] PUT /identity/v3/projects/717c948970484ac3836c89d76d8c1af3/users/cda94b6a9c6f4c78b88fa46e395cca84/roles/f768d32bfece4f08b55bcfcae6876140 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:17.197860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285efea-a79f-4ba9-959e-6a1ea8649e1c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:17.210194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285efea-a79f-4ba9-959e-6a1ea8649e1c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:17.301745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2147196-2efe-48d9-a080-2b87d6a6171a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:17.302725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147196-2efe-48d9-a080-2b87d6a6171a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.303111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147196-2efe-48d9-a080-2b87d6a6171a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.303467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2147196-2efe-48d9-a080-2b87d6a6171a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/717c948970484ac3836c89d76d8c1af3/users/cda94b6a9c6f4c78b88fa46e395cca84/roles/fe9bf2f67d754024a5fd89755dcf1e54` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:17.306598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2147196-2efe-48d9-a080-2b87d6a6171a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:create_grant(project_id=717c948970484ac3836c89d76d8c1af3, user_id=cda94b6a9c6f4c78b88fa46e395cca84, role_id=fe9bf2f67d754024a5fd89755dcf1e54)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:17.309720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2147196-2efe-48d9-a080-2b87d6a6171a tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:17.333051 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3439/6885] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:17 2022] PUT /identity/v3/projects/717c948970484ac3836c89d76d8c1af3/users/cda94b6a9c6f4c78b88fa46e395cca84/roles/fe9bf2f67d754024a5fd89755dcf1e54 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:17.338159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65667707-6c60-46be-8f6d-2923354b95f3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:17.352974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65667707-6c60-46be-8f6d-2923354b95f3 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:17.450434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38b14-064c-4e6c-86a2-7d4938d106c5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:17.451340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38b14-064c-4e6c-86a2-7d4938d106c5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.451699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38b14-064c-4e6c-86a2-7d4938d106c5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.452081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38b14-064c-4e6c-86a2-7d4938d106c5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:17.454197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38b14-064c-4e6c-86a2-7d4938d106c5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:17.457197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d38b14-064c-4e6c-86a2-7d4938d106c5 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:17.515824 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3447/6886] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:17 2022] GET /identity/v3/users => generated 9183 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:17.516720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669593-320a-4804-8aa3-8bf9f5b84069 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.517066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669593-320a-4804-8aa3-8bf9f5b84069 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.517509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08669593-320a-4804-8aa3-8bf9f5b84069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:17.546238 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:UPDATE=1,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:17.604942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-08669593-320a-4804-8aa3-8bf9f5b84069 None None] MFA Rules not processed for user `cda94b6a9c6f4c78b88fa46e395cca84`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:17.606529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08669593-320a-4804-8aa3-8bf9f5b84069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:17.725830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafd237-cba7-4f99-81ef-528898f5e099 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.726408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafd237-cba7-4f99-81ef-528898f5e099 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.726844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fafd237-cba7-4f99-81ef-528898f5e099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:17.730002 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3440/6887] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:17 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:17.754059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7fafd237-cba7-4f99-81ef-528898f5e099 None None] MFA Rules not processed for user `cda94b6a9c6f4c78b88fa46e395cca84`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:17.757028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7fafd237-cba7-4f99-81ef-528898f5e099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:17.775773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08669593-320a-4804-8aa3-8bf9f5b84069 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:17.781881 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3448/6888] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:17 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:17.788940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08669593-320a-4804-8aa3-8bf9f5b84069 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:17.795200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef3284-23e0-45a2-8568-21ae7dd6d642 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda94b6a9c6f4c78b88fa46e395cca84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '717c948970484ac3836c89d76d8c1af3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1294136431', 'tempest-NotDelegatedRole-980954352'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:17.796707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef3284-23e0-45a2-8568-21ae7dd6d642 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.796707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef3284-23e0-45a2-8568-21ae7dd6d642 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.796707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ef3284-23e0-45a2-8568-21ae7dd6d642 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] PATH_INFO: `/v3/OS-TRUST/trusts` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:17.797500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef3284-23e0-45a2-8568-21ae7dd6d642 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorizing `identity:create_trust()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:17.800084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ef3284-23e0-45a2-8568-21ae7dd6d642 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:17.908256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafd237-cba7-4f99-81ef-528898f5e099 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:17.908664 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3441/6889] 10.222.0.25 () {60 vars in 1174 bytes} [Mon Oct 24 09:24:17 2022] POST /identity/v3/OS-TRUST/trusts => generated 835 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:17.920952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fafd237-cba7-4f99-81ef-528898f5e099 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:17.933576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620cd38-0551-4e6f-8b99-c5ccd6a6f50e tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda94b6a9c6f4c78b88fa46e395cca84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '717c948970484ac3836c89d76d8c1af3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1294136431', 'tempest-NotDelegatedRole-980954352'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:17.934324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620cd38-0551-4e6f-8b99-c5ccd6a6f50e tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.934670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620cd38-0551-4e6f-8b99-c5ccd6a6f50e tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.935015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1620cd38-0551-4e6f-8b99-c5ccd6a6f50e tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] PATH_INFO: `/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:17.946611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620cd38-0551-4e6f-8b99-c5ccd6a6f50e tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorizing `identity:get_trust(trust_id=ce1676d502684e81a96d763562061886)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:17.954599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1620cd38-0551-4e6f-8b99-c5ccd6a6f50e tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:17.971991 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3449/6890] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:24:17 2022] GET /identity/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886 => generated 835 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:24:17.976410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef3284-23e0-45a2-8568-21ae7dd6d642 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:17.992171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ef3284-23e0-45a2-8568-21ae7dd6d642 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:17.998275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc193-d015-492f-a2ee-b16039165746 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda94b6a9c6f4c78b88fa46e395cca84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '717c948970484ac3836c89d76d8c1af3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1294136431', 'tempest-NotDelegatedRole-980954352'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:17.998970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc193-d015-492f-a2ee-b16039165746 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:17.999253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc193-d015-492f-a2ee-b16039165746 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:17.999529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbcc193-d015-492f-a2ee-b16039165746 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] PATH_INFO: `/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.007611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcc193-d015-492f-a2ee-b16039165746 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorizing `identity:list_roles_for_trust(trust_id=ce1676d502684e81a96d763562061886)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:18.010250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbcc193-d015-492f-a2ee-b16039165746 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:18.020561 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3442/6891] 10.222.0.25 () {58 vars in 1269 bytes} [Mon Oct 24 09:24:17 2022] GET /identity/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles => generated 371 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:18.024057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620cd38-0551-4e6f-8b99-c5ccd6a6f50e tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:18.036299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1620cd38-0551-4e6f-8b99-c5ccd6a6f50e tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:18.041621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c411e33-5b78-4c42-8813-e29bdcb5fb94 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda94b6a9c6f4c78b88fa46e395cca84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '717c948970484ac3836c89d76d8c1af3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1294136431', 'tempest-NotDelegatedRole-980954352'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:18.042870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c411e33-5b78-4c42-8813-e29bdcb5fb94 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:18.042870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c411e33-5b78-4c42-8813-e29bdcb5fb94 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:18.042870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c411e33-5b78-4c42-8813-e29bdcb5fb94 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] PATH_INFO: `/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles/f768d32bfece4f08b55bcfcae6876140` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.051550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c411e33-5b78-4c42-8813-e29bdcb5fb94 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ce1676d502684e81a96d763562061886, role_id=f768d32bfece4f08b55bcfcae6876140)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:18.053085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c411e33-5b78-4c42-8813-e29bdcb5fb94 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:18.070665 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3450/6892] 10.222.0.25 () {58 vars in 1368 bytes} [Mon Oct 24 09:24:18 2022] GET /identity/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles/f768d32bfece4f08b55bcfcae6876140 => generated 244 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:18.075857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc193-d015-492f-a2ee-b16039165746 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:18.089945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbcc193-d015-492f-a2ee-b16039165746 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:18.095442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f368a-ba73-4f00-af4d-ac79dc736447 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda94b6a9c6f4c78b88fa46e395cca84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '717c948970484ac3836c89d76d8c1af3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1294136431', 'tempest-NotDelegatedRole-980954352'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:18.096183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f368a-ba73-4f00-af4d-ac79dc736447 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:18.096387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f368a-ba73-4f00-af4d-ac79dc736447 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:18.096794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54f368a-ba73-4f00-af4d-ac79dc736447 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] PATH_INFO: `/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles/f768d32bfece4f08b55bcfcae6876140` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.108520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f368a-ba73-4f00-af4d-ac79dc736447 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ce1676d502684e81a96d763562061886, role_id=f768d32bfece4f08b55bcfcae6876140)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:18.111202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54f368a-ba73-4f00-af4d-ac79dc736447 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:18.124256 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3443/6893] 10.222.0.25 () {58 vars in 1369 bytes} [Mon Oct 24 09:24:18 2022] HEAD /identity/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles/f768d32bfece4f08b55bcfcae6876140 => generated 0 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (0 switches on core 0) Oct 24 09:24:18.134919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c411e33-5b78-4c42-8813-e29bdcb5fb94 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:18.162686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c411e33-5b78-4c42-8813-e29bdcb5fb94 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:18.167550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e547ad-e708-4aca-84d7-5e57980188bc tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda94b6a9c6f4c78b88fa46e395cca84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '717c948970484ac3836c89d76d8c1af3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1294136431', 'tempest-NotDelegatedRole-980954352'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:18.168241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e547ad-e708-4aca-84d7-5e57980188bc tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:18.168522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e547ad-e708-4aca-84d7-5e57980188bc tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:18.169210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e547ad-e708-4aca-84d7-5e57980188bc tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] PATH_INFO: `/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles/fe9bf2f67d754024a5fd89755dcf1e54` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.177942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e547ad-e708-4aca-84d7-5e57980188bc tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ce1676d502684e81a96d763562061886, role_id=fe9bf2f67d754024a5fd89755dcf1e54)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:18.179645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e547ad-e708-4aca-84d7-5e57980188bc tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-35e547ad-e708-4aca-84d7-5e57980188bc tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Could not find role: fe9bf2f67d754024a5fd89755dcf1e54.: keystone.exception.RoleNotFound: Could not find role: fe9bf2f67d754024a5fd89755dcf1e54. Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 09:24:18.193615 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: fe9bf2f67d754024a5fd89755dcf1e54. Oct 24 09:24:18.194857 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:24:18.198961 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3451/6894] 10.222.0.25 () {58 vars in 1368 bytes} [Mon Oct 24 09:24:18 2022] GET /identity/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles/fe9bf2f67d754024a5fd89755dcf1e54 => generated 110 bytes in 61 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:24:18.199696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f368a-ba73-4f00-af4d-ac79dc736447 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:18.211179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54f368a-ba73-4f00-af4d-ac79dc736447 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:18.222683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda94b6a9c6f4c78b88fa46e395cca84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '717c948970484ac3836c89d76d8c1af3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1294136431', 'tempest-NotDelegatedRole-980954352'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:18.223426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] REQUEST_METHOD: `HEAD` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:18.224302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:18.224302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] PATH_INFO: `/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles/fe9bf2f67d754024a5fd89755dcf1e54` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.232198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorizing `identity:get_role_for_trust(trust_id=ce1676d502684e81a96d763562061886, role_id=fe9bf2f67d754024a5fd89755dcf1e54)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:18.233658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Could not find role: fe9bf2f67d754024a5fd89755dcf1e54.: keystone.exception.RoleNotFound: Could not find role: fe9bf2f67d754024a5fd89755dcf1e54. Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 438, in get Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 24 09:24:18.247763 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: fe9bf2f67d754024a5fd89755dcf1e54. Oct 24 09:24:18.248996 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:18.253187 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3444/6895] 10.222.0.25 () {58 vars in 1369 bytes} [Mon Oct 24 09:24:18 2022] HEAD /identity/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886/roles/fe9bf2f67d754024a5fd89755dcf1e54 => generated 0 bytes in 50 msecs (HTTP/1.1 404) 5 headers in 184 bytes (0 switches on core 0) Oct 24 09:24:18.256428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e547ad-e708-4aca-84d7-5e57980188bc tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:18.268454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e547ad-e708-4aca-84d7-5e57980188bc tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:18.278426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda94b6a9c6f4c78b88fa46e395cca84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '717c948970484ac3836c89d76d8c1af3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1294136431', 'tempest-NotDelegatedRole-980954352'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:18.279262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:18.279614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:18.280495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] PATH_INFO: `/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.287516 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:18.289930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorizing `identity:delete_trust(trust_id=ce1676d502684e81a96d763562061886)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:18.294079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:18.321206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Invoking callback _drop_token_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ce1676d502684e81a96d763562061886', 'request_id': 'req-d1367460-6dee-4be6-9f1d-b166a8178b88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:18.322661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Invoking callback _drop_receipt_cache for event identity OS-TRUST:trust deleted for {'resource_info': 'ce1676d502684e81a96d763562061886', 'request_id': 'req-d1367460-6dee-4be6-9f1d-b166a8178b88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:18.323533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Invoking callback _trust_callback for event identity OS-TRUST:trust deleted for {'resource_info': 'ce1676d502684e81a96d763562061886', 'request_id': 'req-d1367460-6dee-4be6-9f1d-b166a8178b88'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:18.359782 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3452/6896] 10.222.0.25 () {58 vars in 1254 bytes} [Mon Oct 24 09:24:18 2022] DELETE /identity/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:18.361617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:18.364309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:18.383259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200d7981-ebc7-4846-aa17-bbf8c97c05b9 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:18.422976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f35d-f194-443c-984e-8c30f28905b0 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cda94b6a9c6f4c78b88fa46e395cca84', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '717c948970484ac3836c89d76d8c1af3', 'project_domain_id': 'default', 'roles': ['tempest-DelegatedRole-1294136431', 'tempest-NotDelegatedRole-980954352'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:18.423740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f35d-f194-443c-984e-8c30f28905b0 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:18.425208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f35d-f194-443c-984e-8c30f28905b0 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:18.426534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91f35d-f194-443c-984e-8c30f28905b0 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] PATH_INFO: `/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-ca91f35d-f194-443c-984e-8c30f28905b0 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Could not find trust: ce1676d502684e81a96d763562061886.: keystone.exception.TrustNotFound: Could not find trust: ce1676d502684e81a96d763562061886. Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 268, in get Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_trust(trust_id=trust_id) Oct 24 09:24:18.460721 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 167, in _get_trust Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_trust', Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 431, in enforce_call Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict['target'] = target_attr or build_target() Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/trusts.py", line 54, in _build_trust_target_enforcement Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application target['trust'] = PROVIDERS.trust_api.get_trust( Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/core.py", line 117, in get_trust Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application trust = self.driver.get_trust(trust_id, deleted) Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/trust/backends/sql.py", line 148, in get_trust Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.TrustNotFound(trust_id=trust_id) Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.TrustNotFound: Could not find trust: ce1676d502684e81a96d763562061886. Oct 24 09:24:18.462513 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:24:18.470407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:18.472167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:18.486502 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3445/6897] 10.222.0.25 () {58 vars in 1251 bytes} [Mon Oct 24 09:24:18 2022] GET /identity/v3/OS-TRUST/trusts/ce1676d502684e81a96d763562061886 => generated 111 bytes in 120 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 24 09:24:18.517090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1367460-6dee-4be6-9f1d-b166a8178b88 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:18.525163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:18.526374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:18.527042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:18.527617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/fe9bf2f67d754024a5fd89755dcf1e54` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.530345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=fe9bf2f67d754024a5fd89755dcf1e54)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:18.535687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:18.660381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role fe9bf2f67d754024a5fd89755dcf1e54 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:18.661512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:18.663230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:18.670073 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3453/6898] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:18 2022] DELETE /identity/v3/roles/fe9bf2f67d754024a5fd89755dcf1e54 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:18.675923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f35d-f194-443c-984e-8c30f28905b0 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:18.678943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ca91f35d-f194-443c-984e-8c30f28905b0 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:18.700593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca91f35d-f194-443c-984e-8c30f28905b0 tempest-TrustsV3TestJSON-283349899 tempest-user-386160669] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:18.724552 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:18.798397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:18.799515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:18.799904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:18.800277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/roles/f768d32bfece4f08b55bcfcae6876140` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.802358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_role(role_id=f768d32bfece4f08b55bcfcae6876140)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:18.804585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:18.866911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invalidating the token cache because role f768d32bfece4f08b55bcfcae6876140 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:18.867646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:18.869031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:18.872208 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3446/6899] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:18 2022] DELETE /identity/v3/roles/f768d32bfece4f08b55bcfcae6876140 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:18.876938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:18.895953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6967b336-b211-4808-81cd-50105fc3e838 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:18.989876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:18.990869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:18.991394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:18.991996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/users/cda94b6a9c6f4c78b88fa46e395cca84` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:18.994121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cda94b6a9c6f4c78b88fa46e395cca84)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:18.996565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:19.081729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cda94b6a9c6f4c78b88fa46e395cca84'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.101338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cda94b6a9c6f4c78b88fa46e395cca84'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.102111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cda94b6a9c6f4c78b88fa46e395cca84'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.118571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cda94b6a9c6f4c78b88fa46e395cca84'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.139920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cda94b6a9c6f4c78b88fa46e395cca84'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.154077 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3454/6900] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:18 2022] DELETE /identity/v3/users/cda94b6a9c6f4c78b88fa46e395cca84 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:19.158498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:19.160182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:19.180847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d34a3f-ecf0-469a-ab03-d90010b75294 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:19.271039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f4e3598cfa9d489cb1e061142cbe4628', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '5d103e8f65c24604b8d60becba18235a', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:19.271761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:19.272298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:19.272583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] PATH_INFO: `/v3/projects/717c948970484ac3836c89d76d8c1af3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:19.274042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorizing `identity:delete_project(project_id=717c948970484ac3836c89d76d8c1af3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:19.276296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:19.384747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '717c948970484ac3836c89d76d8c1af3', 'request_id': 'req-0d4f0414-9317-4e3d-a021-94660bffa929'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.399337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '717c948970484ac3836c89d76d8c1af3', 'request_id': 'req-0d4f0414-9317-4e3d-a021-94660bffa929'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.410168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '717c948970484ac3836c89d76d8c1af3', 'request_id': 'req-0d4f0414-9317-4e3d-a021-94660bffa929'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.427733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] The token cache is being invalidate because project 717c948970484ac3836c89d76d8c1af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:19.428282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.429785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0d4f0414-9317-4e3d-a021-94660bffa929 tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.445474 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3447/6901] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:19 2022] DELETE /identity/v3/projects/717c948970484ac3836c89d76d8c1af3 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:19.452169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:19.453523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:19.479107 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:UPDATE=1,keystone:INSERT=2,keystone:DELETE=14 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:19.622635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79881963-e297-4292-b93e-7de3e2785f5c tempest-TrustsV3TestJSON-629440033 tempest-TrustsV3TestJSON-629440033-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:19.737242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:19.741284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:19.741945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:19.742819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] PATH_INFO: `/v3/users/12a8d774a5ec4e4aaaac075098771fb7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:19.745407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12a8d774a5ec4e4aaaac075098771fb7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:19.749140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:19.860901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12a8d774a5ec4e4aaaac075098771fb7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.876726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12a8d774a5ec4e4aaaac075098771fb7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.877554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12a8d774a5ec4e4aaaac075098771fb7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.890794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12a8d774a5ec4e4aaaac075098771fb7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.899439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12a8d774a5ec4e4aaaac075098771fb7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:19.907525 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3455/6902] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:19 2022] DELETE /identity/v3/users/12a8d774a5ec4e4aaaac075098771fb7 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:19.912998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6958262-ed9b-492e-ae44-6306e982abb6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:19.913756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6958262-ed9b-492e-ae44-6306e982abb6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:19.914240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6958262-ed9b-492e-ae44-6306e982abb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:19.941348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f6958262-ed9b-492e-ae44-6306e982abb6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:19.943620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6958262-ed9b-492e-ae44-6306e982abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:19.950957 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:UPDATE=1,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:20.137376 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3448/6903] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:20.161403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:20.166166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:20.282819 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:20.315098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01daedab-844c-4d6b-b8ec-27f4ee365ce1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:20.319253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4b8c4-3a55-4c04-8191-5381a00c3176 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:20.319897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4b8c4-3a55-4c04-8191-5381a00c3176 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:20.320314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4b8c4-3a55-4c04-8191-5381a00c3176 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:20.320605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc4b8c4-3a55-4c04-8191-5381a00c3176 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:20.332701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4b8c4-3a55-4c04-8191-5381a00c3176 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:20.334225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc4b8c4-3a55-4c04-8191-5381a00c3176 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:20.345821 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3456/6904] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:20.740607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6958262-ed9b-492e-ae44-6306e982abb6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:20.743279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6958262-ed9b-492e-ae44-6306e982abb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:20.773897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6958262-ed9b-492e-ae44-6306e982abb6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:20.794830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff49ed-18d1-4607-844c-f816b798b59c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:20.795771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff49ed-18d1-4607-844c-f816b798b59c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:20.798529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff49ed-18d1-4607-844c-f816b798b59c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:20.800210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abff49ed-18d1-4607-844c-f816b798b59c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:20.804774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-abff49ed-18d1-4607-844c-f816b798b59c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:20.917952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff49ed-18d1-4607-844c-f816b798b59c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:20.920502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abff49ed-18d1-4607-844c-f816b798b59c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:20.948905 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3449/6905] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:21.191677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4b8c4-3a55-4c04-8191-5381a00c3176 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:21.193241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ffc4b8c4-3a55-4c04-8191-5381a00c3176 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:21.246449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc4b8c4-3a55-4c04-8191-5381a00c3176 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:21.275073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:21.275987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:21.277808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:21.278336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] PATH_INFO: `/v3/projects/6fadb58f8b0546afb5150cbc303ce032` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:21.283987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fadb58f8b0546afb5150cbc303ce032)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:21.293927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:21.459620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fadb58f8b0546afb5150cbc303ce032', 'request_id': 'req-b2b665ca-6fce-492a-a849-2d3789be19bd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.477719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fadb58f8b0546afb5150cbc303ce032', 'request_id': 'req-b2b665ca-6fce-492a-a849-2d3789be19bd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.513029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fadb58f8b0546afb5150cbc303ce032', 'request_id': 'req-b2b665ca-6fce-492a-a849-2d3789be19bd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.537347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] The token cache is being invalidate because project 6fadb58f8b0546afb5150cbc303ce032 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:21.538612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.539573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.541578 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3457/6906] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:21 2022] DELETE /identity/v3/projects/6fadb58f8b0546afb5150cbc303ce032 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:21.545740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff49ed-18d1-4607-844c-f816b798b59c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:21.565071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abff49ed-18d1-4607-844c-f816b798b59c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:21.648028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:21.680446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:21.680830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:21.681120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] PATH_INFO: `/v3/users/f4e3598cfa9d489cb1e061142cbe4628` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:21.694339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4e3598cfa9d489cb1e061142cbe4628)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:21.704458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:21.828062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:21.829924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:21.858384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4e3598cfa9d489cb1e061142cbe4628'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.879833 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:21.902248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4e3598cfa9d489cb1e061142cbe4628'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.903515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4e3598cfa9d489cb1e061142cbe4628'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.925085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4e3598cfa9d489cb1e061142cbe4628'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.937346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4e3598cfa9d489cb1e061142cbe4628'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:21.948553 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3450/6907] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:21 2022] DELETE /identity/v3/users/f4e3598cfa9d489cb1e061142cbe4628 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:22.030826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b665ca-6fce-492a-a849-2d3789be19bd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:22.152301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf568fa-f2b5-4f75-9ba1-c85c451f8e6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:22.155935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf568fa-f2b5-4f75-9ba1-c85c451f8e6d service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:22.157588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf568fa-f2b5-4f75-9ba1-c85c451f8e6d service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:22.158045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf568fa-f2b5-4f75-9ba1-c85c451f8e6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:22.166430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bcf568fa-f2b5-4f75-9ba1-c85c451f8e6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:22.181932 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:22.201105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf568fa-f2b5-4f75-9ba1-c85c451f8e6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:22.205407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf568fa-f2b5-4f75-9ba1-c85c451f8e6d service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:22.228638 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3458/6908] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:24:23.272784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:23.274373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:23.362419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c06fe-164a-484d-ad24-7f052cdedca8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:23.373164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:23.374852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:23.375377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:23.376391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] PATH_INFO: `/v3/projects/5d103e8f65c24604b8d60becba18235a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:23.379766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d103e8f65c24604b8d60becba18235a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:23.385097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:23.471496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d103e8f65c24604b8d60becba18235a', 'request_id': 'req-07819475-cf31-4bba-a936-fcd57c8f71e1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:23.493549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d103e8f65c24604b8d60becba18235a', 'request_id': 'req-07819475-cf31-4bba-a936-fcd57c8f71e1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:23.509842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d103e8f65c24604b8d60becba18235a', 'request_id': 'req-07819475-cf31-4bba-a936-fcd57c8f71e1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:23.543337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] The token cache is being invalidate because project 5d103e8f65c24604b8d60becba18235a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:23.544066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:23.545444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-07819475-cf31-4bba-a936-fcd57c8f71e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:23.552840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672194-d9a0-431d-b295-d994d45c15b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:23.553377 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3451/6909] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:23 2022] DELETE /identity/v3/projects/5d103e8f65c24604b8d60becba18235a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:23.554059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672194-d9a0-431d-b295-d994d45c15b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:23.554524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46672194-d9a0-431d-b295-d994d45c15b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:23.601602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-46672194-d9a0-431d-b295-d994d45c15b9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:23.603629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46672194-d9a0-431d-b295-d994d45c15b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:23.710899 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3459/6910] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:24:23.718339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508dbdb-e456-46d6-8069-a419768adaa7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:23.724710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508dbdb-e456-46d6-8069-a419768adaa7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:23.725193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508dbdb-e456-46d6-8069-a419768adaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:23.776450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b508dbdb-e456-46d6-8069-a419768adaa7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:23.777985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b508dbdb-e456-46d6-8069-a419768adaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:23.806716 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3452/6911] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:23.808048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672194-d9a0-431d-b295-d994d45c15b9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:23.820590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46672194-d9a0-431d-b295-d994d45c15b9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:23.827573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558409-5e49-4bf5-9e9d-f3811554889b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:23.829975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558409-5e49-4bf5-9e9d-f3811554889b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:23.831200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558409-5e49-4bf5-9e9d-f3811554889b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:23.831200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af558409-5e49-4bf5-9e9d-f3811554889b admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:23.832730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af558409-5e49-4bf5-9e9d-f3811554889b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:23.833347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af558409-5e49-4bf5-9e9d-f3811554889b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:23.835693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af558409-5e49-4bf5-9e9d-f3811554889b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:23.856695 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3460/6912] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:23.861604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508dbdb-e456-46d6-8069-a419768adaa7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:23.873864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508dbdb-e456-46d6-8069-a419768adaa7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:23.882549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2c4ab-e47c-4896-b273-d47926620768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:23.884747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2c4ab-e47c-4896-b273-d47926620768 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:23.885268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2c4ab-e47c-4896-b273-d47926620768 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:23.885812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b2c4ab-e47c-4896-b273-d47926620768 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:23.887740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2c4ab-e47c-4896-b273-d47926620768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:23.891684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b2c4ab-e47c-4896-b273-d47926620768 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:23.930357 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3453/6913] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:23 2022] POST /identity/v3/projects => generated 367 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:23.934495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558409-5e49-4bf5-9e9d-f3811554889b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:23.957570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af558409-5e49-4bf5-9e9d-f3811554889b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:24.104771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d4963-36a3-40b6-94ed-83700c5be541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:24.113509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d4963-36a3-40b6-94ed-83700c5be541 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.113813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d4963-36a3-40b6-94ed-83700c5be541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.114183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7d4963-36a3-40b6-94ed-83700c5be541 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.114870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d4963-36a3-40b6-94ed-83700c5be541 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:24.117107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7d4963-36a3-40b6-94ed-83700c5be541 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:24.190641 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3461/6914] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:23 2022] POST /identity/v3/users => generated 284 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:24.194458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2c4ab-e47c-4896-b273-d47926620768 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:24.207562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b2c4ab-e47c-4896-b273-d47926620768 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:24.216551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdb337-a85b-4890-89eb-6da1fb850ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:24.221160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d4963-36a3-40b6-94ed-83700c5be541 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:24.222210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdb337-a85b-4890-89eb-6da1fb850ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.222692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdb337-a85b-4890-89eb-6da1fb850ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.222972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bf7d4963-36a3-40b6-94ed-83700c5be541 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:24.223473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bdb337-a85b-4890-89eb-6da1fb850ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.224386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdb337-a85b-4890-89eb-6da1fb850ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:24.226290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bdb337-a85b-4890-89eb-6da1fb850ce8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:24.238052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7d4963-36a3-40b6-94ed-83700c5be541 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:24.245609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:24.246249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.246526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.247386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] PATH_INFO: `/v3/users/d8418557e89941a88a0e52f66d021e21` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.252199 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3454/6915] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:24.252398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8418557e89941a88a0e52f66d021e21)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:24.252398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:24.259953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdb337-a85b-4890-89eb-6da1fb850ce8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:24.274366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bdb337-a85b-4890-89eb-6da1fb850ce8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:24.283783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6618da7-043f-440b-8204-fd30d49b5ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:24.284857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6618da7-043f-440b-8204-fd30d49b5ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.285811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6618da7-043f-440b-8204-fd30d49b5ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.286504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6618da7-043f-440b-8204-fd30d49b5ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.288166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6618da7-043f-440b-8204-fd30d49b5ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:24.291960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6618da7-043f-440b-8204-fd30d49b5ea8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:24.314568 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3455/6916] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:24.316495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6618da7-043f-440b-8204-fd30d49b5ea8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:24.361608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6618da7-043f-440b-8204-fd30d49b5ea8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:24.375493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8418557e89941a88a0e52f66d021e21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:24.376568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95cd73-7526-40a0-a6c0-334543e569e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:24.378631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95cd73-7526-40a0-a6c0-334543e569e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.378917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95cd73-7526-40a0-a6c0-334543e569e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.379195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95cd73-7526-40a0-a6c0-334543e569e0 admin admin] PATH_INFO: `/v3/projects/df0b3af860a34003b2e57ceeaa2d85a8/users/dc08481cc6df48a094a8ad8a90299d0a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.385760 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:24.407981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8418557e89941a88a0e52f66d021e21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:24.410566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8418557e89941a88a0e52f66d021e21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:24.416070 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:24.417787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95cd73-7526-40a0-a6c0-334543e569e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df0b3af860a34003b2e57ceeaa2d85a8, user_id=dc08481cc6df48a094a8ad8a90299d0a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:24.423836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95cd73-7526-40a0-a6c0-334543e569e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:24.431084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8418557e89941a88a0e52f66d021e21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:24.444305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9f8c2ff-8e97-4206-a313-bcc7c539a9fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8418557e89941a88a0e52f66d021e21'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:24.457353 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3456/6917] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:24 2022] PUT /identity/v3/projects/df0b3af860a34003b2e57ceeaa2d85a8/users/dc08481cc6df48a094a8ad8a90299d0a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:24.458362 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3462/6918] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:24 2022] DELETE /identity/v3/users/d8418557e89941a88a0e52f66d021e21 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:24.469925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655fdb2-6181-48c0-ab41-8ef46aeaea2f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.470524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655fdb2-6181-48c0-ab41-8ef46aeaea2f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.470812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655fdb2-6181-48c0-ab41-8ef46aeaea2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.472863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c1d1c-7332-4556-af86-332ced79143a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.473205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c1d1c-7332-4556-af86-332ced79143a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.474150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c1d1c-7332-4556-af86-332ced79143a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.512891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1c2c1d1c-7332-4556-af86-332ced79143a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:24.514466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1c2c1d1c-7332-4556-af86-332ced79143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:24.532926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7655fdb2-6181-48c0-ab41-8ef46aeaea2f None None] MFA Rules not processed for user `dc08481cc6df48a094a8ad8a90299d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:24.534346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7655fdb2-6181-48c0-ab41-8ef46aeaea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:24.620600 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3457/6919] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:24.626406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655fdb2-6181-48c0-ab41-8ef46aeaea2f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:24.628122 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3463/6920] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:24.629021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7655fdb2-6181-48c0-ab41-8ef46aeaea2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:24.640672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c1d1c-7332-4556-af86-332ced79143a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:24.645765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1c2c1d1c-7332-4556-af86-332ced79143a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:24.658544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655fdb2-6181-48c0-ab41-8ef46aeaea2f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:24.663680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e68615-58a2-4cc9-8201-db6508bc7c82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:24.664384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e68615-58a2-4cc9-8201-db6508bc7c82 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.664874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e68615-58a2-4cc9-8201-db6508bc7c82 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.665514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e68615-58a2-4cc9-8201-db6508bc7c82 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.666465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e68615-58a2-4cc9-8201-db6508bc7c82 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:24.668591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e68615-58a2-4cc9-8201-db6508bc7c82 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:24.731483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3458/6921] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:24 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:24.736853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e68615-58a2-4cc9-8201-db6508bc7c82 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:24.803216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c1d1c-7332-4556-af86-332ced79143a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:24.848576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e68615-58a2-4cc9-8201-db6508bc7c82 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:24.862585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597dda9-5589-4638-9e0c-0fd4dfced1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:24.863351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597dda9-5589-4638-9e0c-0fd4dfced1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.863704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597dda9-5589-4638-9e0c-0fd4dfced1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.864052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8597dda9-5589-4638-9e0c-0fd4dfced1a4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.864772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597dda9-5589-4638-9e0c-0fd4dfced1a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:24.867177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8597dda9-5589-4638-9e0c-0fd4dfced1a4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:24.878676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b94eb-d915-4f8f-8e99-a8aadd3caa7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:24.880312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b94eb-d915-4f8f-8e99-a8aadd3caa7a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.881532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b94eb-d915-4f8f-8e99-a8aadd3caa7a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.882035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b94eb-d915-4f8f-8e99-a8aadd3caa7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.896318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b94eb-d915-4f8f-8e99-a8aadd3caa7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:24.898276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255b94eb-d915-4f8f-8e99-a8aadd3caa7a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:24.914787 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3464/6922] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:24.932697 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3459/6923] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:24 2022] POST /identity/v3/users => generated 290 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:24.936204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b94eb-d915-4f8f-8e99-a8aadd3caa7a service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:24.955314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b94eb-d915-4f8f-8e99-a8aadd3caa7a service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:24.969821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a0970-49ce-427e-80a1-0089ef2aafc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:24.970582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a0970-49ce-427e-80a1-0089ef2aafc0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:24.970934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a0970-49ce-427e-80a1-0089ef2aafc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:24.971378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a0970-49ce-427e-80a1-0089ef2aafc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:24.973553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a0970-49ce-427e-80a1-0089ef2aafc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:24.975329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a0970-49ce-427e-80a1-0089ef2aafc0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:24.992058 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3465/6924] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:24 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:24.996066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597dda9-5589-4638-9e0c-0fd4dfced1a4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:25.009907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8597dda9-5589-4638-9e0c-0fd4dfced1a4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:25.060703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df645a4-3f11-4674-af1b-9424cb80ec59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:25.063998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df645a4-3f11-4674-af1b-9424cb80ec59 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:25.064631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df645a4-3f11-4674-af1b-9424cb80ec59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:25.067228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df645a4-3f11-4674-af1b-9424cb80ec59 admin admin] PATH_INFO: `/v3/projects/d9fd552f4c424a5b8eb98915141c3a8b/users/ba9312ddebdb4786a52a4e604b148a89/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:25.100271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df645a4-3f11-4674-af1b-9424cb80ec59 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fd552f4c424a5b8eb98915141c3a8b, user_id=ba9312ddebdb4786a52a4e604b148a89, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:25.103641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df645a4-3f11-4674-af1b-9424cb80ec59 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:25.132751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a0970-49ce-427e-80a1-0089ef2aafc0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:25.133253 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3460/6925] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:24 2022] PUT /identity/v3/projects/d9fd552f4c424a5b8eb98915141c3a8b/users/ba9312ddebdb4786a52a4e604b148a89/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:25.143551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a0970-49ce-427e-80a1-0089ef2aafc0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:25.183755 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:25.241920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49bf4d-a600-44f7-8d3b-5e4188c2cf8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:25.242616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49bf4d-a600-44f7-8d3b-5e4188c2cf8f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:25.243760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49bf4d-a600-44f7-8d3b-5e4188c2cf8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:25.243949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49bf4d-a600-44f7-8d3b-5e4188c2cf8f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:25.245110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49bf4d-a600-44f7-8d3b-5e4188c2cf8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:25.246946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49bf4d-a600-44f7-8d3b-5e4188c2cf8f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:25.265180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df645a4-3f11-4674-af1b-9424cb80ec59 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:25.265839 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3466/6926] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:25 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:25.277043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df645a4-3f11-4674-af1b-9424cb80ec59 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:25.284626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbbcf9-d635-4c64-a3c9-4b883fe9e066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:25.285456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbbcf9-d635-4c64-a3c9-4b883fe9e066 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:25.285859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbbcf9-d635-4c64-a3c9-4b883fe9e066 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:25.286349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fbbcf9-d635-4c64-a3c9-4b883fe9e066 admin admin] PATH_INFO: `/v3/projects/d9fd552f4c424a5b8eb98915141c3a8b/users/ba9312ddebdb4786a52a4e604b148a89/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:25.289535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbbcf9-d635-4c64-a3c9-4b883fe9e066 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fd552f4c424a5b8eb98915141c3a8b, user_id=ba9312ddebdb4786a52a4e604b148a89, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:25.293660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fbbcf9-d635-4c64-a3c9-4b883fe9e066 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:25.310639 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3461/6927] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:25 2022] PUT /identity/v3/projects/d9fd552f4c424a5b8eb98915141c3a8b/users/ba9312ddebdb4786a52a4e604b148a89/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:25.321176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9e27-7868-4fe5-8a14-39e5e26ca956 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:25.321511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9e27-7868-4fe5-8a14-39e5e26ca956 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:25.321785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fca9e27-7868-4fe5-8a14-39e5e26ca956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:25.357499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5fca9e27-7868-4fe5-8a14-39e5e26ca956 None None] MFA Rules not processed for user `ba9312ddebdb4786a52a4e604b148a89`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:25.357499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5fca9e27-7868-4fe5-8a14-39e5e26ca956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:25.459537 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3467/6928] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:25 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:25.461160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbbcf9-d635-4c64-a3c9-4b883fe9e066 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:25.468446 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:25.475371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fbbcf9-d635-4c64-a3c9-4b883fe9e066 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:25.482545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a5f3-7573-4b47-9d01-4eca7ad42e13 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:25.484220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a5f3-7573-4b47-9d01-4eca7ad42e13 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:25.484220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a5f3-7573-4b47-9d01-4eca7ad42e13 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:25.484467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412a5f3-7573-4b47-9d01-4eca7ad42e13 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:25.485288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412a5f3-7573-4b47-9d01-4eca7ad42e13 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:25.487929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412a5f3-7573-4b47-9d01-4eca7ad42e13 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:25.529473 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3462/6929] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:25 2022] POST /identity/v3/projects => generated 358 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:25.535028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9e27-7868-4fe5-8a14-39e5e26ca956 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:25.547901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fca9e27-7868-4fe5-8a14-39e5e26ca956 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:25.651151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7f9fe-491a-4a22-bb2f-2a0a1d22a4e9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:25.652980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7f9fe-491a-4a22-bb2f-2a0a1d22a4e9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:25.653550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7f9fe-491a-4a22-bb2f-2a0a1d22a4e9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:25.654933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f7f9fe-491a-4a22-bb2f-2a0a1d22a4e9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:25.656067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7f9fe-491a-4a22-bb2f-2a0a1d22a4e9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:25.658932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f7f9fe-491a-4a22-bb2f-2a0a1d22a4e9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:25.739281 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3468/6930] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:25 2022] POST /identity/v3/users => generated 373 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:25.739685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a5f3-7573-4b47-9d01-4eca7ad42e13 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:25.749516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412a5f3-7573-4b47-9d01-4eca7ad42e13 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:25.761276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e820da1-22fa-42a7-9ec9-71996fda82c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:25.763882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e820da1-22fa-42a7-9ec9-71996fda82c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:25.764442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e820da1-22fa-42a7-9ec9-71996fda82c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:25.765127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e820da1-22fa-42a7-9ec9-71996fda82c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/4e25074698e94f83b55adea9e92d5917` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:25.787471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e820da1-22fa-42a7-9ec9-71996fda82c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:get_user(user_id=4e25074698e94f83b55adea9e92d5917)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:25.790458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e820da1-22fa-42a7-9ec9-71996fda82c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:25.798362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7f9fe-491a-4a22-bb2f-2a0a1d22a4e9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:25.799354 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3463/6931] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:24:25 2022] GET /identity/v3/users/4e25074698e94f83b55adea9e92d5917 => generated 373 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:25.815955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f7f9fe-491a-4a22-bb2f-2a0a1d22a4e9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:25.830188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:25.832528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:25.832899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:25.833469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/4e25074698e94f83b55adea9e92d5917` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:25.836030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=4e25074698e94f83b55adea9e92d5917)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:25.841080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:25.959656 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:25.987750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e25074698e94f83b55adea9e92d5917'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.021205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e25074698e94f83b55adea9e92d5917'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.022259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e25074698e94f83b55adea9e92d5917'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.040590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e25074698e94f83b55adea9e92d5917'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.074334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e25074698e94f83b55adea9e92d5917'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.109404 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3469/6932] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:25 2022] DELETE /identity/v3/users/4e25074698e94f83b55adea9e92d5917 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:26.113986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e820da1-22fa-42a7-9ec9-71996fda82c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:26.126263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e820da1-22fa-42a7-9ec9-71996fda82c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:26.154026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:26.189598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:26.212145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e820da1-22fa-42a7-9ec9-71996fda82c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:26.348496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:26.349336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:26.349556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:26.351527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects/36acf1b5507846a6aea11afa26c85c24` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:26.353899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=36acf1b5507846a6aea11afa26c85c24)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:26.363841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:26.364958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7c788-7271-4c61-9255-c0b35214dd97 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:26.374922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:26.375606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:26.375893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:26.376172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] PATH_INFO: `/v3/projects/1d84b28bdbc643c39eadc29be5fe460d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:26.377940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d84b28bdbc643c39eadc29be5fe460d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:26.379866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:26.510885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36acf1b5507846a6aea11afa26c85c24', 'request_id': 'req-69e45cbb-1d57-4a9a-95ab-d6961433c304'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.536127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d84b28bdbc643c39eadc29be5fe460d', 'request_id': 'req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.538131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36acf1b5507846a6aea11afa26c85c24', 'request_id': 'req-69e45cbb-1d57-4a9a-95ab-d6961433c304'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.544987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36acf1b5507846a6aea11afa26c85c24', 'request_id': 'req-69e45cbb-1d57-4a9a-95ab-d6961433c304'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.545761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d84b28bdbc643c39eadc29be5fe460d', 'request_id': 'req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.557359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d84b28bdbc643c39eadc29be5fe460d', 'request_id': 'req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.576124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] The token cache is being invalidate because project 36acf1b5507846a6aea11afa26c85c24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:26.576422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.577203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.578451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] The token cache is being invalidate because project 1d84b28bdbc643c39eadc29be5fe460d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:26.579706 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3464/6933] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:26 2022] DELETE /identity/v3/projects/36acf1b5507846a6aea11afa26c85c24 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:26.580097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.581287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e69acff4-913e-4eb3-a4ac-cbe4b4e8fcc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:26.584816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:26.586403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:26.586753 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3470/6934] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:26 2022] DELETE /identity/v3/projects/1d84b28bdbc643c39eadc29be5fe460d => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:26.592471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d90dc7-a741-4634-ae8a-f28e1674f5b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:26.592785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d90dc7-a741-4634-ae8a-f28e1674f5b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:26.594185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d90dc7-a741-4634-ae8a-f28e1674f5b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:26.649354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-17d90dc7-a741-4634-ae8a-f28e1674f5b9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:26.653322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-17d90dc7-a741-4634-ae8a-f28e1674f5b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:26.682325 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:26.687714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e45cbb-1d57-4a9a-95ab-d6961433c304 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:26.811248 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:26.891227 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3471/6935] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:26.893178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ef402-8537-4d64-9d5a-40d828820995 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:26.893178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ef402-8537-4d64-9d5a-40d828820995 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:26.895312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417ef402-8537-4d64-9d5a-40d828820995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:26.916338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bcd92-35e0-46a0-809d-72a66f6aa6c0 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:26.918759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bcd92-35e0-46a0-809d-72a66f6aa6c0 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:26.920967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bcd92-35e0-46a0-809d-72a66f6aa6c0 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:26.920967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2bcd92-35e0-46a0-809d-72a66f6aa6c0 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:26.921518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bcd92-35e0-46a0-809d-72a66f6aa6c0 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:26.933065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2bcd92-35e0-46a0-809d-72a66f6aa6c0 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:26.955329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-417ef402-8537-4d64-9d5a-40d828820995 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:26.957901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-417ef402-8537-4d64-9d5a-40d828820995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:26.982928 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3472/6936] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:26.987580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ef402-8537-4d64-9d5a-40d828820995 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.015917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417ef402-8537-4d64-9d5a-40d828820995 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.017146 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3465/6937] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:26 2022] POST /identity/v3/projects => generated 360 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:27.018449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bcd92-35e0-46a0-809d-72a66f6aa6c0 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.022362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0b2bcd92-35e0-46a0-809d-72a66f6aa6c0 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:27.176905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c9f7-2299-413f-8cac-5293bd842143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.179310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c9f7-2299-413f-8cac-5293bd842143 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.179694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c9f7-2299-413f-8cac-5293bd842143 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.181318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8390c9f7-2299-413f-8cac-5293bd842143 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.182085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c9f7-2299-413f-8cac-5293bd842143 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:27.183598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c9f7-2299-413f-8cac-5293bd842143 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.189473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8390c9f7-2299-413f-8cac-5293bd842143 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.202356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2bcd92-35e0-46a0-809d-72a66f6aa6c0 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.231045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3473/6938] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:27.239592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802c36-0b7b-4721-a970-46de3bbb25c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.241664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c9f7-2299-413f-8cac-5293bd842143 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.244680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802c36-0b7b-4721-a970-46de3bbb25c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.246485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802c36-0b7b-4721-a970-46de3bbb25c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.248192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38802c36-0b7b-4721-a970-46de3bbb25c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.253155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38802c36-0b7b-4721-a970-46de3bbb25c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.259269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38802c36-0b7b-4721-a970-46de3bbb25c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.283739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8390c9f7-2299-413f-8cac-5293bd842143 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.312994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4e415-9323-4683-a55f-872ba42901f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.313688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e415-9323-4683-a55f-872ba42901f9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.313978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e415-9323-4683-a55f-872ba42901f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.314262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f4e415-9323-4683-a55f-872ba42901f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.317102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4e415-9323-4683-a55f-872ba42901f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.322943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f4e415-9323-4683-a55f-872ba42901f9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.339609 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3466/6939] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:27 2022] POST /identity/v3/users => generated 411 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:27.340856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802c36-0b7b-4721-a970-46de3bbb25c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.364814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38802c36-0b7b-4721-a970-46de3bbb25c1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.372636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd329-6074-4b77-966b-515125080584 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.373553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd329-6074-4b77-966b-515125080584 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.373946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd329-6074-4b77-966b-515125080584 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.374330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421bd329-6074-4b77-966b-515125080584 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.375114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bd329-6074-4b77-966b-515125080584 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_role()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.377186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421bd329-6074-4b77-966b-515125080584 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.384893 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3474/6940] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:27 2022] POST /identity/v3/projects => generated 377 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:27.390066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4e415-9323-4683-a55f-872ba42901f9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.449852 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3467/6941] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:27 2022] POST /identity/v3/roles => generated 240 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:27.454720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd329-6074-4b77-966b-515125080584 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.483723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421bd329-6074-4b77-966b-515125080584 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.575567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f4e415-9323-4683-a55f-872ba42901f9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.582207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd017ae-df23-466b-92c5-f4ace971e313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.583046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd017ae-df23-466b-92c5-f4ace971e313 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.583447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd017ae-df23-466b-92c5-f4ace971e313 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.583828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd017ae-df23-466b-92c5-f4ace971e313 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.584638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd017ae-df23-466b-92c5-f4ace971e313 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.587481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd017ae-df23-466b-92c5-f4ace971e313 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.631804 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3475/6942] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:27 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:27.643265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd017ae-df23-466b-92c5-f4ace971e313 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.655951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc2965-06d3-49d7-a5a6-52afd4beaa0e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.655951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc2965-06d3-49d7-a5a6-52afd4beaa0e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.655951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc2965-06d3-49d7-a5a6-52afd4beaa0e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.658908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bc2965-06d3-49d7-a5a6-52afd4beaa0e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/f54c50aaf4824faaa3e56791b53d439f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.677925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd017ae-df23-466b-92c5-f4ace971e313 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.683071 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:27.690436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc2965-06d3-49d7-a5a6-52afd4beaa0e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:get_user(user_id=f54c50aaf4824faaa3e56791b53d439f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.697903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bc2965-06d3-49d7-a5a6-52afd4beaa0e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.705587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440afe72-c180-4dbd-bf80-56731f504c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.705921 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3468/6943] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:24:27 2022] GET /identity/v3/users/f54c50aaf4824faaa3e56791b53d439f => generated 411 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:27.706415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440afe72-c180-4dbd-bf80-56731f504c99 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.706984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc2965-06d3-49d7-a5a6-52afd4beaa0e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.707284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440afe72-c180-4dbd-bf80-56731f504c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.707663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440afe72-c180-4dbd-bf80-56731f504c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.708474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440afe72-c180-4dbd-bf80-56731f504c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.710223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440afe72-c180-4dbd-bf80-56731f504c99 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.721950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bc2965-06d3-49d7-a5a6-52afd4beaa0e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.729523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629e422-f849-472e-b8d8-b39afe26c256 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.730187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e422-f849-472e-b8d8-b39afe26c256 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.730470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e422-f849-472e-b8d8-b39afe26c256 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.730749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0629e422-f849-472e-b8d8-b39afe26c256 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/roles/5908c0a6a4d74a10bead114e7e897b88` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.732367 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3476/6944] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:27 2022] GET /identity/v3/roles => generated 1651 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:27.737053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440afe72-c180-4dbd-bf80-56731f504c99 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.737716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629e422-f849-472e-b8d8-b39afe26c256 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:get_role(role_id=5908c0a6a4d74a10bead114e7e897b88)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.740882 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-0629e422-f849-472e-b8d8-b39afe26c256 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_role": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:24:27.740882 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:24:27.740882 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:24:27.744256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0629e422-f849-472e-b8d8-b39afe26c256 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.748588 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3469/6945] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:24:27 2022] GET /identity/v3/roles/5908c0a6a4d74a10bead114e7e897b88 => generated 240 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:27.750204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629e422-f849-472e-b8d8-b39afe26c256 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.768437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440afe72-c180-4dbd-bf80-56731f504c99 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.773144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0629e422-f849-472e-b8d8-b39afe26c256 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.775347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced660a1-fe28-447e-809e-140d6269a2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.777114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced660a1-fe28-447e-809e-140d6269a2c1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.777513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced660a1-fe28-447e-809e-140d6269a2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.777744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced660a1-fe28-447e-809e-140d6269a2c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.779550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced660a1-fe28-447e-809e-140d6269a2c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.783841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced660a1-fe28-447e-809e-140d6269a2c1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.789976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72be4e-5071-4bab-8c8f-f646871daeb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.790834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72be4e-5071-4bab-8c8f-f646871daeb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.791236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72be4e-5071-4bab-8c8f-f646871daeb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.791616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a72be4e-5071-4bab-8c8f-f646871daeb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.792348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72be4e-5071-4bab-8c8f-f646871daeb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.794686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a72be4e-5071-4bab-8c8f-f646871daeb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.815216 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3477/6946] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:27 2022] GET /identity/v3/roles => generated 1651 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:27.815216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced660a1-fe28-447e-809e-140d6269a2c1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.842285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced660a1-fe28-447e-809e-140d6269a2c1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:27.855874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08699ba4-5be0-43e6-ae86-cf2bc5d8a55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:27.857469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08699ba4-5be0-43e6-ae86-cf2bc5d8a55c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.857756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08699ba4-5be0-43e6-ae86-cf2bc5d8a55c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.858178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08699ba4-5be0-43e6-ae86-cf2bc5d8a55c admin admin] PATH_INFO: `/v3/projects/b59628ea142748b6ae9fa7e1c26b4d44/users/4db4a11631204229b286934a9aa69262/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:27.872804 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3470/6947] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:27 2022] POST /identity/v3/projects => generated 359 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:27.875225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72be4e-5071-4bab-8c8f-f646871daeb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:27.905742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08699ba4-5be0-43e6-ae86-cf2bc5d8a55c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b59628ea142748b6ae9fa7e1c26b4d44, user_id=4db4a11631204229b286934a9aa69262, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:27.908799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08699ba4-5be0-43e6-ae86-cf2bc5d8a55c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:27.914834 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:27.942989 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3478/6948] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:27 2022] PUT /identity/v3/projects/b59628ea142748b6ae9fa7e1c26b4d44/users/4db4a11631204229b286934a9aa69262/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:27.959202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d457-dba0-4299-81a0-f8ad54bb845e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:27.959480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d457-dba0-4299-81a0-f8ad54bb845e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:27.959759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f5d457-dba0-4299-81a0-f8ad54bb845e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:28.001993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-40f5d457-dba0-4299-81a0-f8ad54bb845e None None] MFA Rules not processed for user `4db4a11631204229b286934a9aa69262`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:28.004191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-40f5d457-dba0-4299-81a0-f8ad54bb845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:28.012871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a72be4e-5071-4bab-8c8f-f646871daeb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:28.136566 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3479/6949] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:28.144571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5d457-dba0-4299-81a0-f8ad54bb845e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:28.157350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e7897-1efd-4ec7-b462-6fab31070be5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:28.167907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e7897-1efd-4ec7-b462-6fab31070be5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:28.167907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e7897-1efd-4ec7-b462-6fab31070be5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:28.167907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986e7897-1efd-4ec7-b462-6fab31070be5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects/d62e99d2fa3e4a88bb5c46909cb02b63` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:28.175594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e7897-1efd-4ec7-b462-6fab31070be5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:get_project(project_id=d62e99d2fa3e4a88bb5c46909cb02b63)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:28.178066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986e7897-1efd-4ec7-b462-6fab31070be5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:28.184087 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3471/6950] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:24:27 2022] GET /identity/v3/projects/d62e99d2fa3e4a88bb5c46909cb02b63 => generated 359 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:28.193793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-40f5d457-dba0-4299-81a0-f8ad54bb845e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:28.194962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e7897-1efd-4ec7-b462-6fab31070be5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:28.213799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986e7897-1efd-4ec7-b462-6fab31070be5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:28.230863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ca031-1aaa-4da2-ad5a-56ae579ec170 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:28.232547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ca031-1aaa-4da2-ad5a-56ae579ec170 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:28.233040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ca031-1aaa-4da2-ad5a-56ae579ec170 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:28.234457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ca031-1aaa-4da2-ad5a-56ae579ec170 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects/d62e99d2fa3e4a88bb5c46909cb02b63/users/f54c50aaf4824faaa3e56791b53d439f/roles/5908c0a6a4d74a10bead114e7e897b88` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:28.244491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ca031-1aaa-4da2-ad5a-56ae579ec170 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=d62e99d2fa3e4a88bb5c46909cb02b63, user_id=f54c50aaf4824faaa3e56791b53d439f, role_id=5908c0a6a4d74a10bead114e7e897b88)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:28.248425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ca031-1aaa-4da2-ad5a-56ae579ec170 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:28.290113 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3472/6951] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:28 2022] PUT /identity/v3/projects/d62e99d2fa3e4a88bb5c46909cb02b63/users/f54c50aaf4824faaa3e56791b53d439f/roles/5908c0a6a4d74a10bead114e7e897b88 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:28.292830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ca031-1aaa-4da2-ad5a-56ae579ec170 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:28.324493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f5d457-dba0-4299-81a0-f8ad54bb845e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:28.495616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69a016-e03e-4b9c-93f4-2c725282b96d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:28.496596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69a016-e03e-4b9c-93f4-2c725282b96d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:28.500035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69a016-e03e-4b9c-93f4-2c725282b96d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:28.501091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69a016-e03e-4b9c-93f4-2c725282b96d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:28.566061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ca031-1aaa-4da2-ad5a-56ae579ec170 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:28.580121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f321dc6-e869-436e-9816-c4ac7d0b3a5d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:28.583833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321dc6-e869-436e-9816-c4ac7d0b3a5d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:28.584224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321dc6-e869-436e-9816-c4ac7d0b3a5d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:28.584862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321dc6-e869-436e-9816-c4ac7d0b3a5d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:28.585671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f321dc6-e869-436e-9816-c4ac7d0b3a5d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:28.587979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f321dc6-e869-436e-9816-c4ac7d0b3a5d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:28.656420 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:28.694291 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3473/6952] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:28 2022] POST /identity/v3/projects => generated 360 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:28.695805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f321dc6-e869-436e-9816-c4ac7d0b3a5d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:28.701331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0f321dc6-e869-436e-9816-c4ac7d0b3a5d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:28.757049 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:28.777819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69a016-e03e-4b9c-93f4-2c725282b96d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:28.779563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69a016-e03e-4b9c-93f4-2c725282b96d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:28.823901 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3480/6953] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:28.825173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69a016-e03e-4b9c-93f4-2c725282b96d service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:28.898063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69a016-e03e-4b9c-93f4-2c725282b96d service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:28.955866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f321dc6-e869-436e-9816-c4ac7d0b3a5d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:28.968384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:28.969096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:28.969396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:28.969684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] PATH_INFO: `/v3/users/9d0b4f066e344bba84c0369d4c695f8b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:28.973098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d0b4f066e344bba84c0369d4c695f8b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:28.975305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:29.092781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d0b4f066e344bba84c0369d4c695f8b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.110352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d0b4f066e344bba84c0369d4c695f8b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.111228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d0b4f066e344bba84c0369d4c695f8b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.127728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d0b4f066e344bba84c0369d4c695f8b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.138494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d0b4f066e344bba84c0369d4c695f8b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.159569 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3474/6954] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:28 2022] DELETE /identity/v3/users/9d0b4f066e344bba84c0369d4c695f8b => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:29.164216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:29.170569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:29.175774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4801c8ea-1848-43a3-a96b-1019caccc1c3 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:29.180441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801c8ea-1848-43a3-a96b-1019caccc1c3 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:29.180848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801c8ea-1848-43a3-a96b-1019caccc1c3 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:29.181205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4801c8ea-1848-43a3-a96b-1019caccc1c3 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects/1245c21e6b2e4ca99ee99bdc409634b2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:29.184851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801c8ea-1848-43a3-a96b-1019caccc1c3 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:get_project(project_id=1245c21e6b2e4ca99ee99bdc409634b2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:29.190331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4801c8ea-1848-43a3-a96b-1019caccc1c3 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:29.198350 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3481/6955] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:24:28 2022] GET /identity/v3/projects/1245c21e6b2e4ca99ee99bdc409634b2 => generated 360 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:29.199662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9e56a-979c-43eb-89c3-ad43bc61e51a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:29.201534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9e56a-979c-43eb-89c3-ad43bc61e51a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:29.201921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe9e56a-979c-43eb-89c3-ad43bc61e51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:29.247223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ffe9e56a-979c-43eb-89c3-ad43bc61e51a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:29.248793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ffe9e56a-979c-43eb-89c3-ad43bc61e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:29.362681 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3482/6956] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:29.364505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9e56a-979c-43eb-89c3-ad43bc61e51a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:29.366034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ffe9e56a-979c-43eb-89c3-ad43bc61e51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:29.368117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402f7d24-7119-4b09-a9be-46ea51f4dbbe admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:29.373762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:29.374976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:29.375276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:29.376154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] PATH_INFO: `/v3/users/4db4a11631204229b286934a9aa69262` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:29.377388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4db4a11631204229b286934a9aa69262)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:29.379341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:29.410259 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=2,keystone:SELECT=87,keystone:DELETE=11 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:29.475756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4db4a11631204229b286934a9aa69262'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.506981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4db4a11631204229b286934a9aa69262'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.509725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4db4a11631204229b286934a9aa69262'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.527910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4db4a11631204229b286934a9aa69262'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.551818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe9e56a-979c-43eb-89c3-ad43bc61e51a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:29.562428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4db4a11631204229b286934a9aa69262'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:29.569659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40b469a-8ea4-44ea-ada9-c5a3e524be3a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:29.571934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b469a-8ea4-44ea-ada9-c5a3e524be3a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:29.573183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b469a-8ea4-44ea-ada9-c5a3e524be3a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:29.574871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40b469a-8ea4-44ea-ada9-c5a3e524be3a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects/1245c21e6b2e4ca99ee99bdc409634b2/users/f54c50aaf4824faaa3e56791b53d439f/roles/5908c0a6a4d74a10bead114e7e897b88` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:29.578120 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3475/6957] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:29 2022] DELETE /identity/v3/users/4db4a11631204229b286934a9aa69262 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:29.583313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b469a-8ea4-44ea-ada9-c5a3e524be3a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_grant(project_id=1245c21e6b2e4ca99ee99bdc409634b2, user_id=f54c50aaf4824faaa3e56791b53d439f, role_id=5908c0a6a4d74a10bead114e7e897b88)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:29.583813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:29.588044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40b469a-8ea4-44ea-ada9-c5a3e524be3a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:29.601685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:29.629998 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3483/6958] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:29 2022] PUT /identity/v3/projects/1245c21e6b2e4ca99ee99bdc409634b2/users/f54c50aaf4824faaa3e56791b53d439f/roles/5908c0a6a4d74a10bead114e7e897b88 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:29.634661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ff342-9ebf-4fea-80c9-e12481f05b20 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:29.634967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ff342-9ebf-4fea-80c9-e12481f05b20 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:29.635221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ff342-9ebf-4fea-80c9-e12481f05b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:29.686059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9b9ff342-9ebf-4fea-80c9-e12481f05b20 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:29.687312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9b9ff342-9ebf-4fea-80c9-e12481f05b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:29.766176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade2dd6d-7efb-438f-988c-4531f997d393 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:29.771803 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:29.862971 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3484/6959] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:29.862971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ff342-9ebf-4fea-80c9-e12481f05b20 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:29.866177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9b9ff342-9ebf-4fea-80c9-e12481f05b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:29.889801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:29.890661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:29.890869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:29.891182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:29.895409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:29.924934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:29.928858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:29.953093 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3476/6960] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:29.994021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ff342-9ebf-4fea-80c9-e12481f05b20 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:30.002264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e676b68-ab3e-4068-aab2-3555c8cf9963 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:30.002939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e676b68-ab3e-4068-aab2-3555c8cf9963 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:30.003282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e676b68-ab3e-4068-aab2-3555c8cf9963 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:30.003566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e676b68-ab3e-4068-aab2-3555c8cf9963 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/f54c50aaf4824faaa3e56791b53d439f/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:30.005660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e676b68-ab3e-4068-aab2-3555c8cf9963 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:list_user_projects(user_id=f54c50aaf4824faaa3e56791b53d439f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:30.008415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e676b68-ab3e-4068-aab2-3555c8cf9963 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:30.014674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:30.018184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:30.076251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae5bb62-4385-4390-a02f-6a83fef4e0d0 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:30.081334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac393bb6-dab1-4a55-afcf-55b4142e5c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:30.082188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393bb6-dab1-4a55-afcf-55b4142e5c91 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:30.082473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393bb6-dab1-4a55-afcf-55b4142e5c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:30.082752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac393bb6-dab1-4a55-afcf-55b4142e5c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:30.108012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac393bb6-dab1-4a55-afcf-55b4142e5c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:30.109593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac393bb6-dab1-4a55-afcf-55b4142e5c91 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:30.122483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3477/6961] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:24:30.123783 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3485/6962] 10.222.0.25 () {58 vars in 1248 bytes} [Mon Oct 24 09:24:29 2022] GET /identity/v3/users/f54c50aaf4824faaa3e56791b53d439f/projects => generated 843 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:30.129503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac393bb6-dab1-4a55-afcf-55b4142e5c91 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:30.148480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac393bb6-dab1-4a55-afcf-55b4142e5c91 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:30.156065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:30.170420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:30.171278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:30.171766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects/1245c21e6b2e4ca99ee99bdc409634b2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:30.174547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=1245c21e6b2e4ca99ee99bdc409634b2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:30.178665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:30.256446 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:30.285013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1245c21e6b2e4ca99ee99bdc409634b2', 'request_id': 'req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.298837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1245c21e6b2e4ca99ee99bdc409634b2', 'request_id': 'req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.312521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1245c21e6b2e4ca99ee99bdc409634b2', 'request_id': 'req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.327692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] The token cache is being invalidate because project 1245c21e6b2e4ca99ee99bdc409634b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:30.328019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.329007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.337789 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3478/6963] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:30 2022] DELETE /identity/v3/projects/1245c21e6b2e4ca99ee99bdc409634b2 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:30.338731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e676b68-ab3e-4068-aab2-3555c8cf9963 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:30.340600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4e676b68-ab3e-4068-aab2-3555c8cf9963 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:30.361094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e676b68-ab3e-4068-aab2-3555c8cf9963 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:30.456034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:30.456981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:30.457454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:30.457836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects/d62e99d2fa3e4a88bb5c46909cb02b63` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:30.459392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=d62e99d2fa3e4a88bb5c46909cb02b63)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:30.462522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:30.557193 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:30.565775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd62e99d2fa3e4a88bb5c46909cb02b63', 'request_id': 'req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.576966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd62e99d2fa3e4a88bb5c46909cb02b63', 'request_id': 'req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.593895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd62e99d2fa3e4a88bb5c46909cb02b63', 'request_id': 'req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.613286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] The token cache is being invalidate because project d62e99d2fa3e4a88bb5c46909cb02b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:30.614801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.617013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.622980 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3486/6964] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:30 2022] DELETE /identity/v3/projects/d62e99d2fa3e4a88bb5c46909cb02b63 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:30.629013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:30.654203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5dc8-21b7-4ac9-ba85-0a41c1712508 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:30.807190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:30.808140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:30.808432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:30.808713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/roles/5908c0a6a4d74a10bead114e7e897b88` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:30.815948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_role(role_id=5908c0a6a4d74a10bead114e7e897b88)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:30.821731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:30.899617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invalidating the token cache because role 5908c0a6a4d74a10bead114e7e897b88 has been removed. Role assignments for users will be recalculated and enforced accordingly the next time they authenticate or validate a token {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:30.899912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.901720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:30.906523 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3479/6965] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:30 2022] DELETE /identity/v3/roles/5908c0a6a4d74a10bead114e7e897b88 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:30.912926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:30.915676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:30.953163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b87f357-3f45-44d2-96b5-fdc6894e5dd9 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:31.061263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:31.062360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:31.063396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:31.064425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/f54c50aaf4824faaa3e56791b53d439f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:31.067003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=f54c50aaf4824faaa3e56791b53d439f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:31.072955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:31.148376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f54c50aaf4824faaa3e56791b53d439f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:31.165924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f54c50aaf4824faaa3e56791b53d439f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:31.166677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f54c50aaf4824faaa3e56791b53d439f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:31.185142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f54c50aaf4824faaa3e56791b53d439f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:31.200655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f54c50aaf4824faaa3e56791b53d439f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:31.215596 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3487/6966] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:30 2022] DELETE /identity/v3/users/f54c50aaf4824faaa3e56791b53d439f => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:31.219747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:31.221736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:31.264249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2c370-a49e-4bcf-b37c-485b2436eabf tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:31.408177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:31.410556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:31.411105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:31.411718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects/f3b7acde9252460caf4a50faaf0bfff1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:31.413511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=f3b7acde9252460caf4a50faaf0bfff1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:31.416077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:31.493499 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:31.532998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3b7acde9252460caf4a50faaf0bfff1', 'request_id': 'req-45d1fb43-e47f-4ba4-b632-69aad1ab417f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:31.553408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3b7acde9252460caf4a50faaf0bfff1', 'request_id': 'req-45d1fb43-e47f-4ba4-b632-69aad1ab417f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:31.585499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:31.587141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:31.729441 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:31.772656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fe7c73-afbe-49ca-bc2e-80555d9e6e1a tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:31.924779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:31.925683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:31.925857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:31.926019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] PATH_INFO: `/v3/projects/1104d284053c4625bcb91c06e3fa5848` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:31.927341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1104d284053c4625bcb91c06e3fa5848)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:31.929392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:31.982027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3b7acde9252460caf4a50faaf0bfff1', 'request_id': 'req-45d1fb43-e47f-4ba4-b632-69aad1ab417f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.015098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] The token cache is being invalidate because project f3b7acde9252460caf4a50faaf0bfff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:32.017046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.018205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.026001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3480/6967] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:31 2022] DELETE /identity/v3/projects/f3b7acde9252460caf4a50faaf0bfff1 => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:32.034999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:32.035300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1104d284053c4625bcb91c06e3fa5848', 'request_id': 'req-5901422c-0be2-4fc3-8e6c-016569048e9f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.037615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:32.058819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1104d284053c4625bcb91c06e3fa5848', 'request_id': 'req-5901422c-0be2-4fc3-8e6c-016569048e9f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.079695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1104d284053c4625bcb91c06e3fa5848', 'request_id': 'req-5901422c-0be2-4fc3-8e6c-016569048e9f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.131748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] The token cache is being invalidate because project 1104d284053c4625bcb91c06e3fa5848 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:32.133432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.134980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.143258 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3488/6968] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:31 2022] DELETE /identity/v3/projects/1104d284053c4625bcb91c06e3fa5848 => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:32.145560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:32.147845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:32.226121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d1fb43-e47f-4ba4-b632-69aad1ab417f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:32.320690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5901422c-0be2-4fc3-8e6c-016569048e9f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:32.331280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:32.332745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.334442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.334866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] PATH_INFO: `/v3/users/378cdc708e6c4070ad719ad65f25dfe0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.338119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=378cdc708e6c4070ad719ad65f25dfe0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:32.342150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:32.363254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:32.364264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.364765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.365235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/dc08481cc6df48a094a8ad8a90299d0a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.367308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:update_user(user_id=dc08481cc6df48a094a8ad8a90299d0a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:32.368678 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:24:32.368678 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:24:32.368678 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:24:32.370895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:32.421746 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:32.435297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dc08481cc6df48a094a8ad8a90299d0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.445034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '378cdc708e6c4070ad719ad65f25dfe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.463460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invalidating the token cache because user dc08481cc6df48a094a8ad8a90299d0a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:32.463817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.464381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.466962 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3481/6969] 10.222.0.25 () {60 vars in 1243 bytes} [Mon Oct 24 09:24:32 2022] PATCH /identity/v3/users/dc08481cc6df48a094a8ad8a90299d0a => generated 297 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:32.467840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:32.471324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:32.475352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '378cdc708e6c4070ad719ad65f25dfe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.476328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '378cdc708e6c4070ad719ad65f25dfe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.492367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '378cdc708e6c4070ad719ad65f25dfe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.500339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8497f78d-1d4b-4fa7-bd29-453deba53327 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:32.508705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d2c7de06-a577-41ea-a164-67afb08f8f80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '378cdc708e6c4070ad719ad65f25dfe0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.513644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:32.516017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.521745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.523330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] PATH_INFO: `/v3/projects/b59628ea142748b6ae9fa7e1c26b4d44` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.524933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b59628ea142748b6ae9fa7e1c26b4d44)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:32.528024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:32.533474 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3489/6970] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:32 2022] DELETE /identity/v3/users/378cdc708e6c4070ad719ad65f25dfe0 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:32.537413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc295c9-84ef-4f2d-b252-f42aba7bc75f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.537704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc295c9-84ef-4f2d-b252-f42aba7bc75f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.537980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc295c9-84ef-4f2d-b252-f42aba7bc75f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.593721 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=8,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:32.613212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b59628ea142748b6ae9fa7e1c26b4d44', 'request_id': 'req-e0a35482-2eec-4dee-8902-ec280fa8f2c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.613911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3bc295c9-84ef-4f2d-b252-f42aba7bc75f None None] MFA Rules not processed for user `dc08481cc6df48a094a8ad8a90299d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:32.615212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3bc295c9-84ef-4f2d-b252-f42aba7bc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:32.625261 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3490/6971] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:32 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:24:32.630180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b59628ea142748b6ae9fa7e1c26b4d44', 'request_id': 'req-e0a35482-2eec-4dee-8902-ec280fa8f2c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.630392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc295c9-84ef-4f2d-b252-f42aba7bc75f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:32.632071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3bc295c9-84ef-4f2d-b252-f42aba7bc75f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:32.641011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b59628ea142748b6ae9fa7e1c26b4d44', 'request_id': 'req-e0a35482-2eec-4dee-8902-ec280fa8f2c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.669456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] The token cache is being invalidate because project b59628ea142748b6ae9fa7e1c26b4d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:32.671520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.673401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e0a35482-2eec-4dee-8902-ec280fa8f2c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.677393 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3482/6972] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:32 2022] DELETE /identity/v3/projects/b59628ea142748b6ae9fa7e1c26b4d44 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:32.682671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1808c52-d2c1-4d66-b98b-0b5a43de2748 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.683176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1808c52-d2c1-4d66-b98b-0b5a43de2748 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.684319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1808c52-d2c1-4d66-b98b-0b5a43de2748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.719802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a1808c52-d2c1-4d66-b98b-0b5a43de2748 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:32.721850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a1808c52-d2c1-4d66-b98b-0b5a43de2748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:32.743351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc295c9-84ef-4f2d-b252-f42aba7bc75f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:32.755299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:32.757408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.760158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.760724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/dc08481cc6df48a094a8ad8a90299d0a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.764974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:update_user(user_id=dc08481cc6df48a094a8ad8a90299d0a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:32.766386 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:24:32.766386 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:24:32.766386 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:24:32.771709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:32.851774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dc08481cc6df48a094a8ad8a90299d0a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.853882 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3483/6973] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:32.855599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4efa-59b1-448c-867e-147b0a8e24f1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.855887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4efa-59b1-448c-867e-147b0a8e24f1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.856161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4efa-59b1-448c-867e-147b0a8e24f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.870065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invalidating the token cache because user dc08481cc6df48a094a8ad8a90299d0a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:32.870385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.871186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:32.873287 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3491/6974] 10.222.0.25 () {60 vars in 1243 bytes} [Mon Oct 24 09:24:32 2022] PATCH /identity/v3/users/dc08481cc6df48a094a8ad8a90299d0a => generated 297 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:24:32.877906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:32.879411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:32.885018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-511b4efa-59b1-448c-867e-147b0a8e24f1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:32.886507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-511b4efa-59b1-448c-867e-147b0a8e24f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:32.898136 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3484/6975] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:32.902281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c122a28e-c422-4646-abc8-719cc6e0a5b5 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:32.902868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b4efa-59b1-448c-867e-147b0a8e24f1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:32.916087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b4efa-59b1-448c-867e-147b0a8e24f1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:32.919374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:32.920129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.920479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.920869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/dc08481cc6df48a094a8ad8a90299d0a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.924136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600ef45-d90c-4d0b-af6c-fb99e520cc1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:32.926589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600ef45-d90c-4d0b-af6c-fb99e520cc1f admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.927204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600ef45-d90c-4d0b-af6c-fb99e520cc1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.927676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600ef45-d90c-4d0b-af6c-fb99e520cc1f admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.928570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600ef45-d90c-4d0b-af6c-fb99e520cc1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:32.929094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600ef45-d90c-4d0b-af6c-fb99e520cc1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:32.931011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600ef45-d90c-4d0b-af6c-fb99e520cc1f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:32.957589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:update_user(user_id=dc08481cc6df48a094a8ad8a90299d0a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:32.962966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:32.964859 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3485/6976] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:32.966363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600ef45-d90c-4d0b-af6c-fb99e520cc1f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:32.978469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600ef45-d90c-4d0b-af6c-fb99e520cc1f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:32.988288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d50732-8610-4e9c-829e-cac399c3044f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:32.990040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d50732-8610-4e9c-829e-cac399c3044f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:32.990572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d50732-8610-4e9c-829e-cac399c3044f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:32.991064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d50732-8610-4e9c-829e-cac399c3044f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:32.992007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d50732-8610-4e9c-829e-cac399c3044f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:32.994504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d50732-8610-4e9c-829e-cac399c3044f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:33.035919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dc08481cc6df48a094a8ad8a90299d0a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:33.043041 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3486/6977] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:32 2022] POST /identity/v3/projects => generated 385 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:33.049365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d50732-8610-4e9c-829e-cac399c3044f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:33.053804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invalidating the token cache because user dc08481cc6df48a094a8ad8a90299d0a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:33.054123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:33.054869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0025ff65-14ff-46a4-8173-5142187a182d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:33.059383 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3492/6978] 10.222.0.25 () {60 vars in 1243 bytes} [Mon Oct 24 09:24:32 2022] PATCH /identity/v3/users/dc08481cc6df48a094a8ad8a90299d0a => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:33.060876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c430061-8219-4787-9bf7-493289ba4e8c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.061162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c430061-8219-4787-9bf7-493289ba4e8c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.061600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c430061-8219-4787-9bf7-493289ba4e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.159705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8c430061-8219-4787-9bf7-493289ba4e8c None None] MFA Rules not processed for user `dc08481cc6df48a094a8ad8a90299d0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:33.162925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c430061-8219-4787-9bf7-493289ba4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:33.174327 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3493/6979] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:33 2022] POST /identity/v3/auth/tokens => generated 349 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:24:33.176113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c430061-8219-4787-9bf7-493289ba4e8c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:33.178938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c430061-8219-4787-9bf7-493289ba4e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:33.196058 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=8,keystone:INSERT=5,keystone:UPDATE=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:33.207001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d50732-8610-4e9c-829e-cac399c3044f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:33.214768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483064d-f817-4549-8cf9-068125dc3430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:33.215785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483064d-f817-4549-8cf9-068125dc3430 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.216320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483064d-f817-4549-8cf9-068125dc3430 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.216818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3483064d-f817-4549-8cf9-068125dc3430 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.217704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483064d-f817-4549-8cf9-068125dc3430 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:33.221364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3483064d-f817-4549-8cf9-068125dc3430 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:33.288710 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3487/6980] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:33 2022] POST /identity/v3/users => generated 293 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:33.293006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483064d-f817-4549-8cf9-068125dc3430 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:33.294823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3483064d-f817-4549-8cf9-068125dc3430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:33.321348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c430061-8219-4787-9bf7-493289ba4e8c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:33.325866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3483064d-f817-4549-8cf9-068125dc3430 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:33.327725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:33.329219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.330006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.331497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/dc08481cc6df48a094a8ad8a90299d0a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.333230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:update_user(user_id=dc08481cc6df48a094a8ad8a90299d0a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:33.345216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d37d-8e83-49ef-9de6-342cb2090267 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:33.345768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d37d-8e83-49ef-9de6-342cb2090267 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.346061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d37d-8e83-49ef-9de6-342cb2090267 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.346367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3574d37d-8e83-49ef-9de6-342cb2090267 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.347223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574d37d-8e83-49ef-9de6-342cb2090267 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:33.348817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3574d37d-8e83-49ef-9de6-342cb2090267 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:33.352673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:33.358170 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:33.375841 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3488/6981] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:33.379158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d37d-8e83-49ef-9de6-342cb2090267 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:33.397682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3574d37d-8e83-49ef-9de6-342cb2090267 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:33.403671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1997-0a1f-4403-a9b0-2fb140a23ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:33.404298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1997-0a1f-4403-a9b0-2fb140a23ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.404582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1997-0a1f-4403-a9b0-2fb140a23ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.404870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb1997-0a1f-4403-a9b0-2fb140a23ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.405765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb1997-0a1f-4403-a9b0-2fb140a23ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:33.407791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb1997-0a1f-4403-a9b0-2fb140a23ae5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:33.418443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': 'dc08481cc6df48a094a8ad8a90299d0a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:33.419842 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3489/6982] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:33.425249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1997-0a1f-4403-a9b0-2fb140a23ae5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:33.438425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invalidating the token cache because user dc08481cc6df48a094a8ad8a90299d0a was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:33.438931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:33.441119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:33.447814 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3494/6983] 10.222.0.25 () {60 vars in 1243 bytes} [Mon Oct 24 09:24:33 2022] PATCH /identity/v3/users/dc08481cc6df48a094a8ad8a90299d0a => generated 297 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:33.451879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:33.452045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb1997-0a1f-4403-a9b0-2fb140a23ae5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:33.453027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:33.467307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff684db-5e4e-441c-9714-49ca0bc15403 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:33.468559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff684db-5e4e-441c-9714-49ca0bc15403 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.468559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff684db-5e4e-441c-9714-49ca0bc15403 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.469101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff684db-5e4e-441c-9714-49ca0bc15403 admin admin] PATH_INFO: `/v3/projects/5f0d8463b69a485d8470625582a93cf1/users/5c3a80ae513a45f9a705e13e17396ae5/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.481269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a531df-3cd9-4eee-b7d3-2d58da9607ba tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:33.487329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79244580-2c6b-4e23-bc07-8ebb47b5e915 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:33.488183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79244580-2c6b-4e23-bc07-8ebb47b5e915 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.488893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79244580-2c6b-4e23-bc07-8ebb47b5e915 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.491562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79244580-2c6b-4e23-bc07-8ebb47b5e915 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.492219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79244580-2c6b-4e23-bc07-8ebb47b5e915 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:33.494145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff684db-5e4e-441c-9714-49ca0bc15403 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f0d8463b69a485d8470625582a93cf1, user_id=5c3a80ae513a45f9a705e13e17396ae5, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:33.497787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff684db-5e4e-441c-9714-49ca0bc15403 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:33.501093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79244580-2c6b-4e23-bc07-8ebb47b5e915 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:33.534197 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3490/6984] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:33 2022] PUT /identity/v3/projects/5f0d8463b69a485d8470625582a93cf1/users/5c3a80ae513a45f9a705e13e17396ae5/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:33.543604 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3495/6985] 10.222.0.25 () {60 vars in 1143 bytes} [Mon Oct 24 09:24:33 2022] POST /identity/v3/users => generated 264 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:33.544970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051e153-a835-40d0-b867-06b9605e6246 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.544970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051e153-a835-40d0-b867-06b9605e6246 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.544970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051e153-a835-40d0-b867-06b9605e6246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.549549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79244580-2c6b-4e23-bc07-8ebb47b5e915 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:33.562170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79244580-2c6b-4e23-bc07-8ebb47b5e915 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:33.596049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6051e153-a835-40d0-b867-06b9605e6246 None None] MFA Rules not processed for user `5c3a80ae513a45f9a705e13e17396ae5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:33.597645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6051e153-a835-40d0-b867-06b9605e6246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:33.701811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5e91e-2292-40fd-9563-374dd8ee6772 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:33.702939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5e91e-2292-40fd-9563-374dd8ee6772 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.703188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5e91e-2292-40fd-9563-374dd8ee6772 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.704013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5e91e-2292-40fd-9563-374dd8ee6772 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/1e8fde972a794bba88b21cf33f6de55b/password` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.722008 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3491/6986] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:33.723389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051e153-a835-40d0-b867-06b9605e6246 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:33.724047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6051e153-a835-40d0-b867-06b9605e6246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:33.844044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051e153-a835-40d0-b867-06b9605e6246 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:33.856149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8461f14-1b96-490a-aeea-c19655768f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:33.856693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8461f14-1b96-490a-aeea-c19655768f9d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:33.856980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8461f14-1b96-490a-aeea-c19655768f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:33.857362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8461f14-1b96-490a-aeea-c19655768f9d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:33.858004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8461f14-1b96-490a-aeea-c19655768f9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:33.863226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8461f14-1b96-490a-aeea-c19655768f9d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:33.871506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-90a5e91e-2292-40fd-9563-374dd8ee6772 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '1e8fde972a794bba88b21cf33f6de55b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:33.889854 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3496/6987] 10.222.0.25 () {60 vars in 1269 bytes} [Mon Oct 24 09:24:33 2022] POST /identity/v3/users/1e8fde972a794bba88b21cf33f6de55b/password => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:33.923365 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3492/6988] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:33 2022] POST /identity/v3/projects => generated 387 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:33.926613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5e91e-2292-40fd-9563-374dd8ee6772 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:33.944555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5e91e-2292-40fd-9563-374dd8ee6772 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:33.971386 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:UPDATE=2,keystone:INSERT=7,keystone:DELETE=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:34.040527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8461f14-1b96-490a-aeea-c19655768f9d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:34.042355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e8461f14-1b96-490a-aeea-c19655768f9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:34.050022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce5b6b-3be4-487c-9f4f-b4b8b5bbcdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:34.050838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce5b6b-3be4-487c-9f4f-b4b8b5bbcdce admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.051281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce5b6b-3be4-487c-9f4f-b4b8b5bbcdce admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.051720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ce5b6b-3be4-487c-9f4f-b4b8b5bbcdce admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.052545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce5b6b-3be4-487c-9f4f-b4b8b5bbcdce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:34.055270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ce5b6b-3be4-487c-9f4f-b4b8b5bbcdce admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:34.087988 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3497/6989] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:33 2022] POST /identity/v3/users => generated 300 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:34.089413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce5b6b-3be4-487c-9f4f-b4b8b5bbcdce admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:34.102759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ce5b6b-3be4-487c-9f4f-b4b8b5bbcdce admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:34.108330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919081a-57d2-4811-963d-e0c6b13118ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:34.108964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919081a-57d2-4811-963d-e0c6b13118ea admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.109251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919081a-57d2-4811-963d-e0c6b13118ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.111408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b919081a-57d2-4811-963d-e0c6b13118ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.112041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919081a-57d2-4811-963d-e0c6b13118ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:34.115911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b919081a-57d2-4811-963d-e0c6b13118ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:34.128867 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:34.134868 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3498/6990] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:34.137581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919081a-57d2-4811-963d-e0c6b13118ea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:34.152391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b919081a-57d2-4811-963d-e0c6b13118ea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:34.163096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730c3ed-2b5a-4985-8599-59d4fbf945d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:34.163783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730c3ed-2b5a-4985-8599-59d4fbf945d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.164061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730c3ed-2b5a-4985-8599-59d4fbf945d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.164337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1730c3ed-2b5a-4985-8599-59d4fbf945d6 admin admin] PATH_INFO: `/v3/projects/8f97e53bfc5748f98b5e0d69977c5afa/users/3ca04ba31163496d9fa427dda25de56e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.173088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8461f14-1b96-490a-aeea-c19655768f9d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:34.199515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:34.200463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.200934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.201470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] PATH_INFO: `/v3/projects/ac83741c2ea74c7b88f80ee7891f137e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.204132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730c3ed-2b5a-4985-8599-59d4fbf945d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f97e53bfc5748f98b5e0d69977c5afa, user_id=3ca04ba31163496d9fa427dda25de56e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:34.206401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac83741c2ea74c7b88f80ee7891f137e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:34.207381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1730c3ed-2b5a-4985-8599-59d4fbf945d6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:34.210428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:34.239241 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3499/6991] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:34 2022] PUT /identity/v3/projects/8f97e53bfc5748f98b5e0d69977c5afa/users/3ca04ba31163496d9fa427dda25de56e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:34.252667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730c3ed-2b5a-4985-8599-59d4fbf945d6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:34.361690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1730c3ed-2b5a-4985-8599-59d4fbf945d6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:34.362484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac83741c2ea74c7b88f80ee7891f137e', 'request_id': 'req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:34.384219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac83741c2ea74c7b88f80ee7891f137e', 'request_id': 'req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:34.412757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac83741c2ea74c7b88f80ee7891f137e', 'request_id': 'req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:34.441462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] The token cache is being invalidate because project ac83741c2ea74c7b88f80ee7891f137e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:34.442009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:34.444218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0c1793bd-f85c-4bcf-8cc4-d76a84bb8554 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:34.454241 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3493/6992] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:34 2022] DELETE /identity/v3/projects/ac83741c2ea74c7b88f80ee7891f137e => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:34.455873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1ceb-d4d1-432a-9653-4a39801f041a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.456265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1ceb-d4d1-432a-9653-4a39801f041a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.457417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc1ceb-d4d1-432a-9653-4a39801f041a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.491898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b851e-5549-4c70-accf-a7dbe4099582 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:34.492811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b851e-5549-4c70-accf-a7dbe4099582 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.493268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b851e-5549-4c70-accf-a7dbe4099582 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.493764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5b851e-5549-4c70-accf-a7dbe4099582 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.494944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b851e-5549-4c70-accf-a7dbe4099582 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:34.497066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5b851e-5549-4c70-accf-a7dbe4099582 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:34.506346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-33cc1ceb-d4d1-432a-9653-4a39801f041a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:34.508820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-33cc1ceb-d4d1-432a-9653-4a39801f041a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:34.520972 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3500/6993] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:34.525414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b851e-5549-4c70-accf-a7dbe4099582 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:34.531071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-df5b851e-5549-4c70-accf-a7dbe4099582 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:34.531547 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3494/6994] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:34.539891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dfcac-35f1-49e0-b7d8-0537f79a65b7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.541482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dfcac-35f1-49e0-b7d8-0537f79a65b7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.541873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48dfcac-35f1-49e0-b7d8-0537f79a65b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.558938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5b851e-5549-4c70-accf-a7dbe4099582 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:34.570787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a59775a-d93f-4740-97d3-5c53a5db0e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:34.571833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59775a-d93f-4740-97d3-5c53a5db0e89 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.572139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59775a-d93f-4740-97d3-5c53a5db0e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.574035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a59775a-d93f-4740-97d3-5c53a5db0e89 admin admin] PATH_INFO: `/v3/projects/8f97e53bfc5748f98b5e0d69977c5afa/users/3ca04ba31163496d9fa427dda25de56e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.576693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59775a-d93f-4740-97d3-5c53a5db0e89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f97e53bfc5748f98b5e0d69977c5afa, user_id=3ca04ba31163496d9fa427dda25de56e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:34.580269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a59775a-d93f-4740-97d3-5c53a5db0e89 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:34.605189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d48dfcac-35f1-49e0-b7d8-0537f79a65b7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:34.606569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d48dfcac-35f1-49e0-b7d8-0537f79a65b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:34.609111 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3501/6995] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:34 2022] PUT /identity/v3/projects/8f97e53bfc5748f98b5e0d69977c5afa/users/3ca04ba31163496d9fa427dda25de56e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:34.625917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92071c5f-0f95-4cdf-b4ab-88c0a71e5e73 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.626185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92071c5f-0f95-4cdf-b4ab-88c0a71e5e73 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.626456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92071c5f-0f95-4cdf-b4ab-88c0a71e5e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.646490 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:34.699197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-92071c5f-0f95-4cdf-b4ab-88c0a71e5e73 None None] MFA Rules not processed for user `3ca04ba31163496d9fa427dda25de56e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:34.700576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-92071c5f-0f95-4cdf-b4ab-88c0a71e5e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:34.708167 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3495/6996] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:34.709217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dfcac-35f1-49e0-b7d8-0537f79a65b7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:34.722425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48dfcac-35f1-49e0-b7d8-0537f79a65b7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:34.727834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a22c1-31a8-4598-a6f3-5ceb007dde72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:34.728587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a22c1-31a8-4598-a6f3-5ceb007dde72 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.728874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a22c1-31a8-4598-a6f3-5ceb007dde72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.729148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52a22c1-31a8-4598-a6f3-5ceb007dde72 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.729898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a22c1-31a8-4598-a6f3-5ceb007dde72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:34.730373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a22c1-31a8-4598-a6f3-5ceb007dde72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:34.732246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52a22c1-31a8-4598-a6f3-5ceb007dde72 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:34.746624 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3496/6997] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:34.751392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a22c1-31a8-4598-a6f3-5ceb007dde72 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:34.763181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52a22c1-31a8-4598-a6f3-5ceb007dde72 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:34.768825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a9a25-5a39-40e4-8535-e40281dd1962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:34.769530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a9a25-5a39-40e4-8535-e40281dd1962 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.769815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a9a25-5a39-40e4-8535-e40281dd1962 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.770093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6a9a25-5a39-40e4-8535-e40281dd1962 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.770916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a9a25-5a39-40e4-8535-e40281dd1962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:34.773033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6a9a25-5a39-40e4-8535-e40281dd1962 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:34.811065 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3497/6998] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:34 2022] POST /identity/v3/projects => generated 365 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:34.816979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a9a25-5a39-40e4-8535-e40281dd1962 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:34.879073 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3502/6999] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:34 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:34.884719 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:34.892465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92071c5f-0f95-4cdf-b4ab-88c0a71e5e73 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:34.894976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-92071c5f-0f95-4cdf-b4ab-88c0a71e5e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:34.958842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6a9a25-5a39-40e4-8535-e40281dd1962 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:34.971272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77187c-f452-407f-9166-50b40eb9eda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:34.973422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77187c-f452-407f-9166-50b40eb9eda8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:34.973722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77187c-f452-407f-9166-50b40eb9eda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:34.974001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77187c-f452-407f-9166-50b40eb9eda8 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:34.974644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77187c-f452-407f-9166-50b40eb9eda8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:34.976978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a77187c-f452-407f-9166-50b40eb9eda8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:34.981530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92071c5f-0f95-4cdf-b4ab-88c0a71e5e73 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.011554 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3498/7000] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:34 2022] POST /identity/v3/users => generated 283 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:35.018256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c2fd5-acc3-4639-a12a-3c5271d692ec None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.018636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c2fd5-acc3-4639-a12a-3c5271d692ec None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.018931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8c2fd5-acc3-4639-a12a-3c5271d692ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.067952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405cf6f-a5b6-4a7d-8f77-b1fee886e53c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.068577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cf6f-a5b6-4a7d-8f77-b1fee886e53c service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.068869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cf6f-a5b6-4a7d-8f77-b1fee886e53c service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.069319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f405cf6f-a5b6-4a7d-8f77-b1fee886e53c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.074378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fc8c2fd5-acc3-4639-a12a-3c5271d692ec None None] MFA Rules not processed for user `1e8fde972a794bba88b21cf33f6de55b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:35.075963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fc8c2fd5-acc3-4639-a12a-3c5271d692ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:35.081471 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3499/7001] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:35 2022] POST /identity/v3/auth/tokens => generated 329 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 24 09:24:35.082501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c2fd5-acc3-4639-a12a-3c5271d692ec None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:35.099449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8c2fd5-acc3-4639-a12a-3c5271d692ec None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.105491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3c9ac-601c-48a2-a591-49691a71a9e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.106194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c9ac-601c-48a2-a591-49691a71a9e4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.106546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c9ac-601c-48a2-a591-49691a71a9e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.106894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb3c9ac-601c-48a2-a591-49691a71a9e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.107616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3c9ac-601c-48a2-a591-49691a71a9e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.110924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb3c9ac-601c-48a2-a591-49691a71a9e4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:35.169677 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3500/7002] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:35.171979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3c9ac-601c-48a2-a591-49691a71a9e4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:35.176719 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:35.178357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8cb3c9ac-601c-48a2-a591-49691a71a9e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:35.184870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405cf6f-a5b6-4a7d-8f77-b1fee886e53c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.186992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f405cf6f-a5b6-4a7d-8f77-b1fee886e53c service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:35.201193 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3503/7003] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:34 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:24:35.213261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405cf6f-a5b6-4a7d-8f77-b1fee886e53c service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:35.246699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f405cf6f-a5b6-4a7d-8f77-b1fee886e53c service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.255092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5391d8c-1fdb-42bd-afbd-00269da1afcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.256370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5391d8c-1fdb-42bd-afbd-00269da1afcd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.256987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5391d8c-1fdb-42bd-afbd-00269da1afcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.259444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5391d8c-1fdb-42bd-afbd-00269da1afcd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.260340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5391d8c-1fdb-42bd-afbd-00269da1afcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.262877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5391d8c-1fdb-42bd-afbd-00269da1afcd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:35.290118 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3504/7004] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:35.291592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5391d8c-1fdb-42bd-afbd-00269da1afcd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:35.304880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5391d8c-1fdb-42bd-afbd-00269da1afcd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.311679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb3c9ac-601c-48a2-a591-49691a71a9e4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.313577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f9b454-7d46-455e-95e4-2dd663319c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.314408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9b454-7d46-455e-95e4-2dd663319c67 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.314984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9b454-7d46-455e-95e4-2dd663319c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.315432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f9b454-7d46-455e-95e4-2dd663319c67 admin admin] PATH_INFO: `/v3/projects/aa170485aaa74cf39b3ebe23893403ad/users/a9e772b13aa441f194793eaecf668a6c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.332305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213cfdb-0b0e-41a2-9396-bc6ad977adb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.332938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213cfdb-0b0e-41a2-9396-bc6ad977adb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.333223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213cfdb-0b0e-41a2-9396-bc6ad977adb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.333550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5213cfdb-0b0e-41a2-9396-bc6ad977adb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.339130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9b454-7d46-455e-95e4-2dd663319c67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa170485aaa74cf39b3ebe23893403ad, user_id=a9e772b13aa441f194793eaecf668a6c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.343019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f9b454-7d46-455e-95e4-2dd663319c67 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:35.347344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213cfdb-0b0e-41a2-9396-bc6ad977adb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.349621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5213cfdb-0b0e-41a2-9396-bc6ad977adb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:35.362372 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3501/7005] 10.222.0.25 () {56 vars in 1263 bytes} [Mon Oct 24 09:24:35 2022] GET /identity/v3/auth/tokens => generated 329 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 24 09:24:35.363490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213cfdb-0b0e-41a2-9396-bc6ad977adb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:35.367493 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3505/7006] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:35 2022] PUT /identity/v3/projects/aa170485aaa74cf39b3ebe23893403ad/users/a9e772b13aa441f194793eaecf668a6c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:35.374303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aea48-2cd4-488a-89bc-639582e69b0f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.374758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aea48-2cd4-488a-89bc-639582e69b0f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.382327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486aea48-2cd4-488a-89bc-639582e69b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.382681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5213cfdb-0b0e-41a2-9396-bc6ad977adb1 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.406044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-486aea48-2cd4-488a-89bc-639582e69b0f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:35.407445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-486aea48-2cd4-488a-89bc-639582e69b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:35.467447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.468022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.468584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.469515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/1e8fde972a794bba88b21cf33f6de55b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.470942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=1e8fde972a794bba88b21cf33f6de55b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.474129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:35.505553 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3506/7007] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:24:35.507468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486aea48-2cd4-488a-89bc-639582e69b0f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:35.522866 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:35.524479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486aea48-2cd4-488a-89bc-639582e69b0f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.536330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.537927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e8fde972a794bba88b21cf33f6de55b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.538109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.538428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.539038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] PATH_INFO: `/v3/users/5c3a80ae513a45f9a705e13e17396ae5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.539878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3a80ae513a45f9a705e13e17396ae5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.542558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:35.574487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e8fde972a794bba88b21cf33f6de55b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.576160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e8fde972a794bba88b21cf33f6de55b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.596221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e8fde972a794bba88b21cf33f6de55b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.615250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e8fde972a794bba88b21cf33f6de55b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.616571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3a80ae513a45f9a705e13e17396ae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.630750 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3502/7008] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:35 2022] DELETE /identity/v3/users/1e8fde972a794bba88b21cf33f6de55b => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:35.632561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:35.634973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:35.637364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3a80ae513a45f9a705e13e17396ae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.638331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3a80ae513a45f9a705e13e17396ae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.650364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3a80ae513a45f9a705e13e17396ae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.666844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3a80ae513a45f9a705e13e17396ae5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:35.695762 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3507/7009] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:35 2022] DELETE /identity/v3/users/5c3a80ae513a45f9a705e13e17396ae5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:35.697736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:35.700296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:35.744576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1b9e07-927a-4fc3-ac1f-263478d6856b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.757980 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:35.802361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848a3f1c-ca48-4b41-89b4-8397ef97468c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.810215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c9d4e-b4ab-4ae9-aed5-9f705201e43e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.811100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c9d4e-b4ab-4ae9-aed5-9f705201e43e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.811497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c9d4e-b4ab-4ae9-aed5-9f705201e43e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.811783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c9d4e-b4ab-4ae9-aed5-9f705201e43e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.812437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c9d4e-b4ab-4ae9-aed5-9f705201e43e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.815326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c9d4e-b4ab-4ae9-aed5-9f705201e43e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:35.830787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e8978b-51e8-4469-966c-88d0a76790d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.832048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8978b-51e8-4469-966c-88d0a76790d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.832583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8978b-51e8-4469-966c-88d0a76790d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.833284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e8978b-51e8-4469-966c-88d0a76790d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.837356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-67e8978b-51e8-4469-966c-88d0a76790d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:35.857774 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3508/7010] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:35 2022] POST /identity/v3/users => generated 367 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:35.860174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c9d4e-b4ab-4ae9-aed5-9f705201e43e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:35.862565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a61c9d4e-b4ab-4ae9-aed5-9f705201e43e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:35.947572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8978b-51e8-4469-966c-88d0a76790d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.949022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e8978b-51e8-4469-966c-88d0a76790d5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:35.967758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c9d4e-b4ab-4ae9-aed5-9f705201e43e tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:35.975505 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3503/7011] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:35.976741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d2a00-5833-41d6-9852-bf3084883cb6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.977109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d2a00-5833-41d6-9852-bf3084883cb6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.978064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3d2a00-5833-41d6-9852-bf3084883cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.979021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:35.980243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:35.980536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:35.980823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] PATH_INFO: `/v3/users/47cc2bea7f764515920d59cae9ef0111` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:35.983392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cc2bea7f764515920d59cae9ef0111)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:35.988676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:36.022469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1e3d2a00-5833-41d6-9852-bf3084883cb6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:36.025600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1e3d2a00-5833-41d6-9852-bf3084883cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:36.035266 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3504/7012] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:36.036217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d2a00-5833-41d6-9852-bf3084883cb6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:36.065355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cc2bea7f764515920d59cae9ef0111'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.069032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3d2a00-5833-41d6-9852-bf3084883cb6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:36.079063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2bfe-fc9e-4c26-9f34-a27634ff819d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:36.079763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2bfe-fc9e-4c26-9f34-a27634ff819d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:36.079875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2bfe-fc9e-4c26-9f34-a27634ff819d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:36.080139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941d2bfe-fc9e-4c26-9f34-a27634ff819d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:36.081451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2bfe-fc9e-4c26-9f34-a27634ff819d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:36.084076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941d2bfe-fc9e-4c26-9f34-a27634ff819d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:36.085570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cc2bea7f764515920d59cae9ef0111'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.087605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cc2bea7f764515920d59cae9ef0111'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.098516 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:36.134392 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3505/7013] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:36 2022] POST /identity/v3/projects => generated 358 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:36.135652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2bfe-fc9e-4c26-9f34-a27634ff819d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:36.138047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-941d2bfe-fc9e-4c26-9f34-a27634ff819d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:36.141375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cc2bea7f764515920d59cae9ef0111'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.174574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cc2bea7f764515920d59cae9ef0111'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.194443 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3509/7014] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:35 2022] DELETE /identity/v3/users/47cc2bea7f764515920d59cae9ef0111 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:36.194443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:36.195891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:36.255113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941d2bfe-fc9e-4c26-9f34-a27634ff819d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:36.291102 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:36.325317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8468c87-e2de-46f1-a690-81cbf8b6fbd8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:36.325954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8468c87-e2de-46f1-a690-81cbf8b6fbd8 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:36.327476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8468c87-e2de-46f1-a690-81cbf8b6fbd8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:36.327476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8468c87-e2de-46f1-a690-81cbf8b6fbd8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:36.329567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b8468c87-e2de-46f1-a690-81cbf8b6fbd8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:36.353641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8816bd8b-cab3-4d17-b418-2dbb22db4340 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:36.359542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f63a6e-88ef-46a5-9f5a-d2f8bfa8dc7b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:36.361003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f63a6e-88ef-46a5-9f5a-d2f8bfa8dc7b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:36.361493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f63a6e-88ef-46a5-9f5a-d2f8bfa8dc7b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:36.362030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f63a6e-88ef-46a5-9f5a-d2f8bfa8dc7b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/cbfe829567774729a33d7b5e2d7b3053` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:36.387892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f63a6e-88ef-46a5-9f5a-d2f8bfa8dc7b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:update_user(user_id=cbfe829567774729a33d7b5e2d7b3053)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:36.391676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f63a6e-88ef-46a5-9f5a-d2f8bfa8dc7b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:36.415287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8468c87-e2de-46f1-a690-81cbf8b6fbd8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:36.417556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8468c87-e2de-46f1-a690-81cbf8b6fbd8 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:36.431076 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3506/7015] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:36.437353 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3510/7016] 10.222.0.25 () {60 vars in 1244 bytes} [Mon Oct 24 09:24:36 2022] PATCH /identity/v3/users/cbfe829567774729a33d7b5e2d7b3053 => generated 523 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:36.441182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8468c87-e2de-46f1-a690-81cbf8b6fbd8 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:36.458224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8468c87-e2de-46f1-a690-81cbf8b6fbd8 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:36.465090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d36f47-30f6-4285-b13d-9b8553dbc14d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:36.465997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d36f47-30f6-4285-b13d-9b8553dbc14d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:36.466389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d36f47-30f6-4285-b13d-9b8553dbc14d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:36.467382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d36f47-30f6-4285-b13d-9b8553dbc14d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/cbfe829567774729a33d7b5e2d7b3053` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:36.503689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d36f47-30f6-4285-b13d-9b8553dbc14d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:get_user(user_id=cbfe829567774729a33d7b5e2d7b3053)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:36.508041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d36f47-30f6-4285-b13d-9b8553dbc14d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:36.517033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f63a6e-88ef-46a5-9f5a-d2f8bfa8dc7b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:36.522089 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3507/7017] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:24:36 2022] GET /identity/v3/users/cbfe829567774729a33d7b5e2d7b3053 => generated 389 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:36.529857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f63a6e-88ef-46a5-9f5a-d2f8bfa8dc7b tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:36.535328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:36.536066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:36.536362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:36.536811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/projects/b4ad7afd8b804e7ebaf5a8a5ef3940b0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:36.538521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b4ad7afd8b804e7ebaf5a8a5ef3940b0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:36.540533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:36.611565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ad7afd8b804e7ebaf5a8a5ef3940b0', 'request_id': 'req-24accf7b-270d-474a-abec-cfd2429ed64f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.619656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ad7afd8b804e7ebaf5a8a5ef3940b0', 'request_id': 'req-24accf7b-270d-474a-abec-cfd2429ed64f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.628779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ad7afd8b804e7ebaf5a8a5ef3940b0', 'request_id': 'req-24accf7b-270d-474a-abec-cfd2429ed64f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.646725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] The token cache is being invalidate because project b4ad7afd8b804e7ebaf5a8a5ef3940b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:36.647060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.647896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.654366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d36f47-30f6-4285-b13d-9b8553dbc14d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:36.655765 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3511/7018] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:36 2022] DELETE /identity/v3/projects/b4ad7afd8b804e7ebaf5a8a5ef3940b0 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:36.657541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93d36f47-30f6-4285-b13d-9b8553dbc14d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:36.674566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d36f47-30f6-4285-b13d-9b8553dbc14d tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:36.721681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:36.723290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:36.741267 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:36.833575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba9312ddebdb4786a52a4e604b148a89', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd9fd552f4c424a5b8eb98915141c3a8b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:36.834655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:36.835186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:36.835690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] PATH_INFO: `/v3/users/cbfe829567774729a33d7b5e2d7b3053` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:36.837765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorizing `identity:delete_user(user_id=cbfe829567774729a33d7b5e2d7b3053)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:36.841601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:36.858602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24accf7b-270d-474a-abec-cfd2429ed64f tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:36.876225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:36.878630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:36.879558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:36.880386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] PATH_INFO: `/v3/projects/a3f2fcdaa9cd434797881937ea940b89` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:36.884337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3f2fcdaa9cd434797881937ea940b89)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:36.888616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:36.917860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbfe829567774729a33d7b5e2d7b3053'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.937223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbfe829567774729a33d7b5e2d7b3053'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.941883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbfe829567774729a33d7b5e2d7b3053'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.957546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbfe829567774729a33d7b5e2d7b3053'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.972396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbfe829567774729a33d7b5e2d7b3053'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:36.975073 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:UPDATE=2,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:36.985394 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3508/7019] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:36 2022] DELETE /identity/v3/users/cbfe829567774729a33d7b5e2d7b3053 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:36.986641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:36.990129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:37.007419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3f2fcdaa9cd434797881937ea940b89', 'request_id': 'req-ab1ee015-3852-4deb-a04b-2b806fefed12'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.020519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3f2fcdaa9cd434797881937ea940b89', 'request_id': 'req-ab1ee015-3852-4deb-a04b-2b806fefed12'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.037574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3f2fcdaa9cd434797881937ea940b89', 'request_id': 'req-ab1ee015-3852-4deb-a04b-2b806fefed12'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.065016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] The token cache is being invalidate because project a3f2fcdaa9cd434797881937ea940b89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:37.065323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.065998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.069309 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3512/7020] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:36 2022] DELETE /identity/v3/projects/a3f2fcdaa9cd434797881937ea940b89 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:37.073711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:37.078165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:37.130066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60697dc6-5ca6-49bb-a2de-969ae0b63a52 tempest-UsersV3TestJSON-1517854424 tempest-UsersV3TestJSON-1517854424-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:37.135503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:37.136274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:37.136657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:37.137114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] PATH_INFO: `/v3/users/dc08481cc6df48a094a8ad8a90299d0a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:37.159676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc08481cc6df48a094a8ad8a90299d0a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:37.161595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:37.173915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1ee015-3852-4deb-a04b-2b806fefed12 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:37.182029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:37.184053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:37.184526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:37.185016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] PATH_INFO: `/v3/users/4b5d32052b5f4ce89b64e53c7ec76f1d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:37.186875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5d32052b5f4ce89b64e53c7ec76f1d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:37.191141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:37.240712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc08481cc6df48a094a8ad8a90299d0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.247357 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:37.258832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc08481cc6df48a094a8ad8a90299d0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.259826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc08481cc6df48a094a8ad8a90299d0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.272115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc08481cc6df48a094a8ad8a90299d0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.280663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5d32052b5f4ce89b64e53c7ec76f1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.286162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-63e080f8-2110-4052-8c34-276a42c4908c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc08481cc6df48a094a8ad8a90299d0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.297415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5d32052b5f4ce89b64e53c7ec76f1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.298487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5d32052b5f4ce89b64e53c7ec76f1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.313127 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3509/7021] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:36 2022] DELETE /identity/v3/users/dc08481cc6df48a094a8ad8a90299d0a => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:37.315908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc51aa6-e578-4b14-97a5-80d7a9ada369 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:37.316245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc51aa6-e578-4b14-97a5-80d7a9ada369 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:37.316552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc51aa6-e578-4b14-97a5-80d7a9ada369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:37.317625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5d32052b5f4ce89b64e53c7ec76f1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.340968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5d32052b5f4ce89b64e53c7ec76f1d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:37.348235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dfc51aa6-e578-4b14-97a5-80d7a9ada369 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:37.349820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dfc51aa6-e578-4b14-97a5-80d7a9ada369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:37.350080 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3513/7022] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:37 2022] DELETE /identity/v3/users/4b5d32052b5f4ce89b64e53c7ec76f1d => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:37.461943 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3510/7023] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:37.494839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:37.500868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:37.629215 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:37.652732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac64c08-a7a2-48d6-9953-8339e69d532e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:37.660887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f9653-9ed1-4a2b-b300-43ece6057cc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:37.661982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f9653-9ed1-4a2b-b300-43ece6057cc4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:37.662455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f9653-9ed1-4a2b-b300-43ece6057cc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:37.662897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f9653-9ed1-4a2b-b300-43ece6057cc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:37.681216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f9653-9ed1-4a2b-b300-43ece6057cc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:37.684010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f9653-9ed1-4a2b-b300-43ece6057cc4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:37.711847 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3514/7024] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:38.288590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc51aa6-e578-4b14-97a5-80d7a9ada369 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:38.290270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dfc51aa6-e578-4b14-97a5-80d7a9ada369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:38.304569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc51aa6-e578-4b14-97a5-80d7a9ada369 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:38.310239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:38.310520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:38.310898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:38.311276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] PATH_INFO: `/v3/projects/5f0d8463b69a485d8470625582a93cf1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:38.313283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f0d8463b69a485d8470625582a93cf1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:38.315340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:38.378638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f0d8463b69a485d8470625582a93cf1', 'request_id': 'req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.390886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f0d8463b69a485d8470625582a93cf1', 'request_id': 'req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.404282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f0d8463b69a485d8470625582a93cf1', 'request_id': 'req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.423257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] The token cache is being invalidate because project 5f0d8463b69a485d8470625582a93cf1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:38.423685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.424728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.429555 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3511/7025] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:38 2022] DELETE /identity/v3/projects/5f0d8463b69a485d8470625582a93cf1 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:38.431102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f9653-9ed1-4a2b-b300-43ece6057cc4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:38.453490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f9653-9ed1-4a2b-b300-43ece6057cc4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:38.575025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:38.575750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:38.576039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:38.576361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] PATH_INFO: `/v3/users/3ca04ba31163496d9fa427dda25de56e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:38.577778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ca04ba31163496d9fa427dda25de56e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:38.579989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:38.668629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ca04ba31163496d9fa427dda25de56e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.692743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ca04ba31163496d9fa427dda25de56e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.693686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ca04ba31163496d9fa427dda25de56e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.711087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ca04ba31163496d9fa427dda25de56e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.724455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ca04ba31163496d9fa427dda25de56e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:38.741485 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3515/7026] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:38 2022] DELETE /identity/v3/users/3ca04ba31163496d9fa427dda25de56e => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:39.138428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:39.142478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:39.166015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce4c6a5-2dd7-451e-9673-2f5cf20d06a9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:39.236267 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:39.250060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:39.251109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:39.251972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:39.253376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] PATH_INFO: `/v3/projects/2fb846f8159447f5bc60747e3b3067cf` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:39.255691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fb846f8159447f5bc60747e3b3067cf)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:39.260776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:39.378986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fb846f8159447f5bc60747e3b3067cf', 'request_id': 'req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.395073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fb846f8159447f5bc60747e3b3067cf', 'request_id': 'req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.412604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fb846f8159447f5bc60747e3b3067cf', 'request_id': 'req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.425609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:39.428205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:39.429129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] The token cache is being invalidate because project 2fb846f8159447f5bc60747e3b3067cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:39.430797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.431846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.446515 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3512/7027] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:39 2022] DELETE /identity/v3/projects/2fb846f8159447f5bc60747e3b3067cf => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:39.449264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1490e4-7b8d-4b85-8353-843a2aa3f491 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:39.541818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:39.542821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:39.543303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:39.543858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] PATH_INFO: `/v3/projects/df0b3af860a34003b2e57ceeaa2d85a8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:39.545950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] RBAC: Authorizing `identity:delete_project(project_id=df0b3af860a34003b2e57ceeaa2d85a8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:39.549186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:39.560162 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:39.748474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df0b3af860a34003b2e57ceeaa2d85a8', 'request_id': 'req-c0b2f9dd-0871-4139-81a9-648bb58febee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.788699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df0b3af860a34003b2e57ceeaa2d85a8', 'request_id': 'req-c0b2f9dd-0871-4139-81a9-648bb58febee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.823154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df0b3af860a34003b2e57ceeaa2d85a8', 'request_id': 'req-c0b2f9dd-0871-4139-81a9-648bb58febee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.870601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] The token cache is being invalidate because project df0b3af860a34003b2e57ceeaa2d85a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:39.870902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.877890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:39.887243 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3516/7028] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:39 2022] DELETE /identity/v3/projects/df0b3af860a34003b2e57ceeaa2d85a8 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:39.887628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:39.889958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:39.927299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec3345c-bc36-4fa5-bc16-59d58f389aa9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:39.993915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:39.995996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:40.110897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:40.111556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:40.111833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:40.112106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] PATH_INFO: `/v3/users/ba9312ddebdb4786a52a4e604b148a89` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:40.115310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba9312ddebdb4786a52a4e604b148a89)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:40.117362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:40.134042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b2f9dd-0871-4139-81a9-648bb58febee admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:40.146238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:40.146898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:40.158251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:40.158691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] PATH_INFO: `/v3/projects/8f97e53bfc5748f98b5e0d69977c5afa` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:40.163736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f97e53bfc5748f98b5e0d69977c5afa)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:40.172552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:40.249180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba9312ddebdb4786a52a4e604b148a89'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.267580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba9312ddebdb4786a52a4e604b148a89'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.268628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba9312ddebdb4786a52a4e604b148a89'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.281972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba9312ddebdb4786a52a4e604b148a89'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.289059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f97e53bfc5748f98b5e0d69977c5afa', 'request_id': 'req-938e811c-e530-4d45-98aa-474b282ff9eb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.305318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f97e53bfc5748f98b5e0d69977c5afa', 'request_id': 'req-938e811c-e530-4d45-98aa-474b282ff9eb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.317643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-763bac9f-a6da-49be-8b20-053419c65ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba9312ddebdb4786a52a4e604b148a89'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.321820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f97e53bfc5748f98b5e0d69977c5afa', 'request_id': 'req-938e811c-e530-4d45-98aa-474b282ff9eb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.325974 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3513/7029] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:39 2022] DELETE /identity/v3/users/ba9312ddebdb4786a52a4e604b148a89 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:40.337741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] The token cache is being invalidate because project 8f97e53bfc5748f98b5e0d69977c5afa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:40.338193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.338888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-938e811c-e530-4d45-98aa-474b282ff9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.351711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3517/7030] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:39 2022] DELETE /identity/v3/projects/8f97e53bfc5748f98b5e0d69977c5afa => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:40.353191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f440f6a-897f-4f92-b040-26496aaaac7d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:40.353699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f440f6a-897f-4f92-b040-26496aaaac7d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:40.354146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f440f6a-897f-4f92-b040-26496aaaac7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:40.363657 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:40.387259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2f440f6a-897f-4f92-b040-26496aaaac7d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:40.388857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2f440f6a-897f-4f92-b040-26496aaaac7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:40.478102 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3514/7031] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:40.489067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173b9be-f063-4ad7-ad27-d453ecbf62b3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:40.489674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173b9be-f063-4ad7-ad27-d453ecbf62b3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:40.489869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a173b9be-f063-4ad7-ad27-d453ecbf62b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:40.527694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a173b9be-f063-4ad7-ad27-d453ecbf62b3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:40.529189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a173b9be-f063-4ad7-ad27-d453ecbf62b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:40.546759 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3518/7032] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:40.547113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f440f6a-897f-4f92-b040-26496aaaac7d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:40.560683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f440f6a-897f-4f92-b040-26496aaaac7d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:40.567282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb3679-51e9-4ddb-bb98-ae394759c61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:40.568871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3679-51e9-4ddb-bb98-ae394759c61c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:40.569309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3679-51e9-4ddb-bb98-ae394759c61c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:40.569741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bb3679-51e9-4ddb-bb98-ae394759c61c admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:40.570509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3679-51e9-4ddb-bb98-ae394759c61c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:40.570984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3679-51e9-4ddb-bb98-ae394759c61c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:40.573207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bb3679-51e9-4ddb-bb98-ae394759c61c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:40.592317 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3515/7033] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:40.596962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173b9be-f063-4ad7-ad27-d453ecbf62b3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:40.610046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a173b9be-f063-4ad7-ad27-d453ecbf62b3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:40.618487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0899b0-2325-4094-9d5a-4748400c5a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:40.619385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0899b0-2325-4094-9d5a-4748400c5a5e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:40.619711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0899b0-2325-4094-9d5a-4748400c5a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:40.620212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0899b0-2325-4094-9d5a-4748400c5a5e admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:40.621155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0899b0-2325-4094-9d5a-4748400c5a5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:40.623283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0899b0-2325-4094-9d5a-4748400c5a5e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:40.663365 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:40.680042 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3519/7034] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:40 2022] POST /identity/v3/projects => generated 383 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:40.684541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb3679-51e9-4ddb-bb98-ae394759c61c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:40.710693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bb3679-51e9-4ddb-bb98-ae394759c61c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:40.721652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0899b0-2325-4094-9d5a-4748400c5a5e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:40.723720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cb0899b0-2325-4094-9d5a-4748400c5a5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:40.826043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a046-e516-4660-aca6-52dceee451f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:40.827891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a046-e516-4660-aca6-52dceee451f7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:40.828943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a046-e516-4660-aca6-52dceee451f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:40.829320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37a046-e516-4660-aca6-52dceee451f7 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:40.830208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37a046-e516-4660-aca6-52dceee451f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:40.833775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37a046-e516-4660-aca6-52dceee451f7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:40.878863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0899b0-2325-4094-9d5a-4748400c5a5e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:40.882067 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3516/7035] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:40 2022] POST /identity/v3/users => generated 292 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:40.886675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a046-e516-4660-aca6-52dceee451f7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:40.892827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:40.894155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:40.895672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:40.895921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] PATH_INFO: `/v3/projects/d9fd552f4c424a5b8eb98915141c3a8b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:40.898016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fd552f4c424a5b8eb98915141c3a8b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:40.902318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37a046-e516-4660-aca6-52dceee451f7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:40.902553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:40.910885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342e454-653f-49a2-8cdd-f2cefd0fb63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:40.911777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e454-653f-49a2-8cdd-f2cefd0fb63d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:40.912155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e454-653f-49a2-8cdd-f2cefd0fb63d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:40.912532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8342e454-653f-49a2-8cdd-f2cefd0fb63d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:40.914001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342e454-653f-49a2-8cdd-f2cefd0fb63d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:40.915859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8342e454-653f-49a2-8cdd-f2cefd0fb63d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:40.932769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3517/7036] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:40.933873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342e454-653f-49a2-8cdd-f2cefd0fb63d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:40.957459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8342e454-653f-49a2-8cdd-f2cefd0fb63d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:40.979181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fd552f4c424a5b8eb98915141c3a8b', 'request_id': 'req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:40.987686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fd552f4c424a5b8eb98915141c3a8b', 'request_id': 'req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:41.001821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fd552f4c424a5b8eb98915141c3a8b', 'request_id': 'req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:41.020024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] The token cache is being invalidate because project d9fd552f4c424a5b8eb98915141c3a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:41.020302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:41.021770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1d3cbb2f-f5f8-4e9b-9a00-0bd4bcc6f492 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:41.026804 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3520/7037] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:40 2022] DELETE /identity/v3/projects/d9fd552f4c424a5b8eb98915141c3a8b => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:41.030333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eb742-ac99-477b-ac16-372e046f29c7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.030639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eb742-ac99-477b-ac16-372e046f29c7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.030920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694eb742-ac99-477b-ac16-372e046f29c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.042871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3137a-d88d-475d-9f0d-a13113f8c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.043643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3137a-d88d-475d-9f0d-a13113f8c9ee admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.044081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3137a-d88d-475d-9f0d-a13113f8c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.045098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b3137a-d88d-475d-9f0d-a13113f8c9ee admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.045905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3137a-d88d-475d-9f0d-a13113f8c9ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.047779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b3137a-d88d-475d-9f0d-a13113f8c9ee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.060691 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3518/7038] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:41.065268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3137a-d88d-475d-9f0d-a13113f8c9ee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.067486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c0b3137a-d88d-475d-9f0d-a13113f8c9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:41.067834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-694eb742-ac99-477b-ac16-372e046f29c7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:41.069288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-694eb742-ac99-477b-ac16-372e046f29c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:41.079989 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:41.089666 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3521/7039] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:41.091386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2797d-1735-42f6-95b5-953869c3e6a8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.091779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2797d-1735-42f6-95b5-953869c3e6a8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.092062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a2797d-1735-42f6-95b5-953869c3e6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.101609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b3137a-d88d-475d-9f0d-a13113f8c9ee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.110815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec62d73-588f-49ac-bd7f-ff73f3e96749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.111820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec62d73-588f-49ac-bd7f-ff73f3e96749 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.112373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec62d73-588f-49ac-bd7f-ff73f3e96749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.112855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec62d73-588f-49ac-bd7f-ff73f3e96749 admin admin] PATH_INFO: `/v3/projects/819c9198b88a4c21813b5642f1db1efb/users/0b26380968044d3899b5a76aac1549d4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.122394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a5a2797d-1735-42f6-95b5-953869c3e6a8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:41.127317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a5a2797d-1735-42f6-95b5-953869c3e6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:41.141142 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3522/7040] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:41.145667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2797d-1735-42f6-95b5-953869c3e6a8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.155084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec62d73-588f-49ac-bd7f-ff73f3e96749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=819c9198b88a4c21813b5642f1db1efb, user_id=0b26380968044d3899b5a76aac1549d4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.157757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec62d73-588f-49ac-bd7f-ff73f3e96749 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.167610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a2797d-1735-42f6-95b5-953869c3e6a8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.173703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392fccd-f4e3-4df3-85f5-549333e4d789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.174383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392fccd-f4e3-4df3-85f5-549333e4d789 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.174668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392fccd-f4e3-4df3-85f5-549333e4d789 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.174944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392fccd-f4e3-4df3-85f5-549333e4d789 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.175604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392fccd-f4e3-4df3-85f5-549333e4d789 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:41.175908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392fccd-f4e3-4df3-85f5-549333e4d789 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.178559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392fccd-f4e3-4df3-85f5-549333e4d789 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.182119 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3519/7041] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:41 2022] PUT /identity/v3/projects/819c9198b88a4c21813b5642f1db1efb/users/0b26380968044d3899b5a76aac1549d4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:41.193234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded801c-2b6f-48c5-a6b1-abdd958e6d64 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.193950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded801c-2b6f-48c5-a6b1-abdd958e6d64 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.194631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ded801c-2b6f-48c5-a6b1-abdd958e6d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.206156 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3523/7042] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:24:41.209318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392fccd-f4e3-4df3-85f5-549333e4d789 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.230537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392fccd-f4e3-4df3-85f5-549333e4d789 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.256620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2ded801c-2b6f-48c5-a6b1-abdd958e6d64 None None] MFA Rules not processed for user `0b26380968044d3899b5a76aac1549d4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:41.259865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2ded801c-2b6f-48c5-a6b1-abdd958e6d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:41.327193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14073-6b34-4457-b2ba-95a280f71a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.329518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14073-6b34-4457-b2ba-95a280f71a68 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.330478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14073-6b34-4457-b2ba-95a280f71a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.330764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c14073-6b34-4457-b2ba-95a280f71a68 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.331421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c14073-6b34-4457-b2ba-95a280f71a68 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.334452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c14073-6b34-4457-b2ba-95a280f71a68 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.342811 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:41.382912 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3524/7043] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:41 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:41.388080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14073-6b34-4457-b2ba-95a280f71a68 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.396142 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3520/7044] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:24:41.405168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded801c-2b6f-48c5-a6b1-abdd958e6d64 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.430766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ded801c-2b6f-48c5-a6b1-abdd958e6d64 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.486720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c14073-6b34-4457-b2ba-95a280f71a68 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.492417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fa7ef-1c19-465f-9e4a-b4a24e490b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.493188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fa7ef-1c19-465f-9e4a-b4a24e490b5c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.493538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fa7ef-1c19-465f-9e4a-b4a24e490b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.493817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1fa7ef-1c19-465f-9e4a-b4a24e490b5c admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.494674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fa7ef-1c19-465f-9e4a-b4a24e490b5c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.496782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1fa7ef-1c19-465f-9e4a-b4a24e490b5c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.526852 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3525/7045] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:41 2022] POST /identity/v3/users => generated 286 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:41.530721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fa7ef-1c19-465f-9e4a-b4a24e490b5c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.550124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1fa7ef-1c19-465f-9e4a-b4a24e490b5c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.551808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ffe1a-b554-4e82-8bb2-3bb0c3eeeafd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.552725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ffe1a-b554-4e82-8bb2-3bb0c3eeeafd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.553195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ffe1a-b554-4e82-8bb2-3bb0c3eeeafd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.553823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ffe1a-b554-4e82-8bb2-3bb0c3eeeafd admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.554946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ffe1a-b554-4e82-8bb2-3bb0c3eeeafd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.555427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adce15-8bec-43ff-939b-d36a445a2a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.556044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adce15-8bec-43ff-939b-d36a445a2a3c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.556504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adce15-8bec-43ff-939b-d36a445a2a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.556790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94adce15-8bec-43ff-939b-d36a445a2a3c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.557479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adce15-8bec-43ff-939b-d36a445a2a3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.559101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94adce15-8bec-43ff-939b-d36a445a2a3c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.559693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ffe1a-b554-4e82-8bb2-3bb0c3eeeafd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.571593 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3526/7046] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:41.576238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adce15-8bec-43ff-939b-d36a445a2a3c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.592559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94adce15-8bec-43ff-939b-d36a445a2a3c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.602206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefde41-6e67-41bf-83ca-bf355b447deb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.603077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefde41-6e67-41bf-83ca-bf355b447deb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.605207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefde41-6e67-41bf-83ca-bf355b447deb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.606368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefde41-6e67-41bf-83ca-bf355b447deb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.608353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefde41-6e67-41bf-83ca-bf355b447deb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.611014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fefde41-6e67-41bf-83ca-bf355b447deb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.613185 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3521/7047] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:41 2022] POST /identity/v3/projects => generated 383 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:41.618275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ffe1a-b554-4e82-8bb2-3bb0c3eeeafd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.638688 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3527/7048] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:41.639772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefde41-6e67-41bf-83ca-bf355b447deb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.655397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefde41-6e67-41bf-83ca-bf355b447deb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.705284 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:41.710873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ffe1a-b554-4e82-8bb2-3bb0c3eeeafd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.720687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad7b5-93f5-4cb4-8053-9b4d901d3aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.721334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad7b5-93f5-4cb4-8053-9b4d901d3aef admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.721624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad7b5-93f5-4cb4-8053-9b4d901d3aef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.721933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfad7b5-93f5-4cb4-8053-9b4d901d3aef admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.722565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfad7b5-93f5-4cb4-8053-9b4d901d3aef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.724621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfad7b5-93f5-4cb4-8053-9b4d901d3aef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.737538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b05410-7c62-40e5-a4c0-722f0dd43da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.738339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b05410-7c62-40e5-a4c0-722f0dd43da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.738715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b05410-7c62-40e5-a4c0-722f0dd43da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.739154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b05410-7c62-40e5-a4c0-722f0dd43da7 admin admin] PATH_INFO: `/v3/projects/28777888796546b5a87c56977439faef/users/f8bbc8b06d0347f3bfa14addd84b3b43/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.752571 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3522/7049] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:41 2022] POST /identity/v3/users => generated 298 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:41.756751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad7b5-93f5-4cb4-8053-9b4d901d3aef admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.757928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b05410-7c62-40e5-a4c0-722f0dd43da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28777888796546b5a87c56977439faef, user_id=f8bbc8b06d0347f3bfa14addd84b3b43, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.760716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b05410-7c62-40e5-a4c0-722f0dd43da7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.767474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfad7b5-93f5-4cb4-8053-9b4d901d3aef admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.774555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b591-fc4a-4b27-89d8-be02a7641f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.775075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b591-fc4a-4b27-89d8-be02a7641f5b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.775360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b591-fc4a-4b27-89d8-be02a7641f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.775640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16b591-fc4a-4b27-89d8-be02a7641f5b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.776288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16b591-fc4a-4b27-89d8-be02a7641f5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.777983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16b591-fc4a-4b27-89d8-be02a7641f5b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.781751 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3528/7050] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:41 2022] PUT /identity/v3/projects/28777888796546b5a87c56977439faef/users/f8bbc8b06d0347f3bfa14addd84b3b43/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:41.789513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1bcc6-7edb-407e-a731-ecf8b56f483b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.790013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1bcc6-7edb-407e-a731-ecf8b56f483b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.790482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a1bcc6-7edb-407e-a731-ecf8b56f483b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.794007 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3523/7051] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:41.798815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b591-fc4a-4b27-89d8-be02a7641f5b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.810039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16b591-fc4a-4b27-89d8-be02a7641f5b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:41.849654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-57a1bcc6-7edb-407e-a731-ecf8b56f483b None None] MFA Rules not processed for user `f8bbc8b06d0347f3bfa14addd84b3b43`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:41.851686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57a1bcc6-7edb-407e-a731-ecf8b56f483b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:41.900748 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:41.908168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216e56-6fcf-4604-add2-b292f3dd65b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:41.909249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216e56-6fcf-4604-add2-b292f3dd65b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:41.909416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216e56-6fcf-4604-add2-b292f3dd65b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:41.909854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d216e56-6fcf-4604-add2-b292f3dd65b9 admin admin] PATH_INFO: `/v3/projects/92039ac1fd8a42fe8d4f33c0da304c8e/users/4ef2cd1baba1458fbe6efbdf5df05f37/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:41.932805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d216e56-6fcf-4604-add2-b292f3dd65b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92039ac1fd8a42fe8d4f33c0da304c8e, user_id=4ef2cd1baba1458fbe6efbdf5df05f37, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:41.936565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d216e56-6fcf-4604-add2-b292f3dd65b9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:41.959515 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3524/7052] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:41 2022] PUT /identity/v3/projects/92039ac1fd8a42fe8d4f33c0da304c8e/users/4ef2cd1baba1458fbe6efbdf5df05f37/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:41.960469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216e56-6fcf-4604-add2-b292f3dd65b9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.974566 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3529/7053] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:41 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:24:41.979196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1bcc6-7edb-407e-a731-ecf8b56f483b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:41.991766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a1bcc6-7edb-407e-a731-ecf8b56f483b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.051418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d216e56-6fcf-4604-add2-b292f3dd65b9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.067413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82bbd-c0c8-47c0-bff4-ea2b7b57cf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.068385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82bbd-c0c8-47c0-bff4-ea2b7b57cf98 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.068666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82bbd-c0c8-47c0-bff4-ea2b7b57cf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.068853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df82bbd-c0c8-47c0-bff4-ea2b7b57cf98 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.069713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82bbd-c0c8-47c0-bff4-ea2b7b57cf98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.071613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df82bbd-c0c8-47c0-bff4-ea2b7b57cf98 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.080633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b547a2-9345-4b44-854f-b97fe19372d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.081446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b547a2-9345-4b44-854f-b97fe19372d5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.081728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b547a2-9345-4b44-854f-b97fe19372d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.081997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b547a2-9345-4b44-854f-b97fe19372d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.082832 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3525/7054] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:42.086915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82bbd-c0c8-47c0-bff4-ea2b7b57cf98 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:42.087091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b547a2-9345-4b44-854f-b97fe19372d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.089440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b547a2-9345-4b44-854f-b97fe19372d5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.108957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df82bbd-c0c8-47c0-bff4-ea2b7b57cf98 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.115570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d1fcf-8cae-4f28-a6f5-4712d38d836c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.116385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d1fcf-8cae-4f28-a6f5-4712d38d836c admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.116671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d1fcf-8cae-4f28-a6f5-4712d38d836c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.116954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7d1fcf-8cae-4f28-a6f5-4712d38d836c admin admin] PATH_INFO: `/v3/projects/92039ac1fd8a42fe8d4f33c0da304c8e/users/4ef2cd1baba1458fbe6efbdf5df05f37/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.119406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d1fcf-8cae-4f28-a6f5-4712d38d836c admin admin] RBAC: Authorizing `identity:create_grant(project_id=92039ac1fd8a42fe8d4f33c0da304c8e, user_id=4ef2cd1baba1458fbe6efbdf5df05f37, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.122875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7d1fcf-8cae-4f28-a6f5-4712d38d836c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.151223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3526/7055] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:42 2022] PUT /identity/v3/projects/92039ac1fd8a42fe8d4f33c0da304c8e/users/4ef2cd1baba1458fbe6efbdf5df05f37/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:42.152606 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3530/7056] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:41 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:42.152703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d1fcf-8cae-4f28-a6f5-4712d38d836c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:42.153002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be051c-e2af-4044-ba45-e5a2b0366a21 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.153400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be051c-e2af-4044-ba45-e5a2b0366a21 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.153748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7be051c-e2af-4044-ba45-e5a2b0366a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.203089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d7be051c-e2af-4044-ba45-e5a2b0366a21 None None] MFA Rules not processed for user `4ef2cd1baba1458fbe6efbdf5df05f37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:42.204779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7be051c-e2af-4044-ba45-e5a2b0366a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:42.230594 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:42.260752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7d1fcf-8cae-4f28-a6f5-4712d38d836c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.320730 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3531/7057] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:42.336869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be051c-e2af-4044-ba45-e5a2b0366a21 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:42.338686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7be051c-e2af-4044-ba45-e5a2b0366a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:42.342126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bc38d-3b97-4520-b0be-58b9cb41e34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.342748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bc38d-3b97-4520-b0be-58b9cb41e34a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.343025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bc38d-3b97-4520-b0be-58b9cb41e34a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.343292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682bc38d-3b97-4520-b0be-58b9cb41e34a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.344591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bc38d-3b97-4520-b0be-58b9cb41e34a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.346635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682bc38d-3b97-4520-b0be-58b9cb41e34a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.377552 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3527/7058] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:42 2022] POST /identity/v3/users => generated 292 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:42.381652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bc38d-3b97-4520-b0be-58b9cb41e34a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:42.398544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682bc38d-3b97-4520-b0be-58b9cb41e34a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.413761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b2e35-18e3-4584-acb4-5b58b431a1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.414378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b2e35-18e3-4584-acb4-5b58b431a1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.414828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b2e35-18e3-4584-acb4-5b58b431a1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.415079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7b2e35-18e3-4584-acb4-5b58b431a1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.415730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b2e35-18e3-4584-acb4-5b58b431a1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.417589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7b2e35-18e3-4584-acb4-5b58b431a1e7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.427080 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:42.441893 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3528/7059] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:42.446113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b2e35-18e3-4584-acb4-5b58b431a1e7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:42.455216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7be051c-e2af-4044-ba45-e5a2b0366a21 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.460832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5c4f-e91f-4bd7-9348-7dc7d1486672 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.462132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5c4f-e91f-4bd7-9348-7dc7d1486672 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.462750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5c4f-e91f-4bd7-9348-7dc7d1486672 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.463213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14f5c4f-e91f-4bd7-9348-7dc7d1486672 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.465571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7b2e35-18e3-4584-acb4-5b58b431a1e7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.478260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5c4f-e91f-4bd7-9348-7dc7d1486672 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.479712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14f5c4f-e91f-4bd7-9348-7dc7d1486672 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.482179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36065c64-b210-4b59-b64e-01ce66161dea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.482919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36065c64-b210-4b59-b64e-01ce66161dea admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.483144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36065c64-b210-4b59-b64e-01ce66161dea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.483423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36065c64-b210-4b59-b64e-01ce66161dea admin admin] PATH_INFO: `/v3/projects/9bfd572d587c40299ac53c28ca81ad3f/users/b304c29ed6c24cfcb23d26d1b5aa486a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.492718 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3532/7060] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:42 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:24:42.503205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36065c64-b210-4b59-b64e-01ce66161dea admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfd572d587c40299ac53c28ca81ad3f, user_id=b304c29ed6c24cfcb23d26d1b5aa486a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.516081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36065c64-b210-4b59-b64e-01ce66161dea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.557115 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3529/7061] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:42 2022] PUT /identity/v3/projects/9bfd572d587c40299ac53c28ca81ad3f/users/b304c29ed6c24cfcb23d26d1b5aa486a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:42.559101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5c4f-e91f-4bd7-9348-7dc7d1486672 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:42.579119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14f5c4f-e91f-4bd7-9348-7dc7d1486672 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.649001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36065c64-b210-4b59-b64e-01ce66161dea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:42.725364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc32bde-9c16-45a8-a8e6-39449018971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.726096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32bde-9c16-45a8-a8e6-39449018971a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.726383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32bde-9c16-45a8-a8e6-39449018971a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.726660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc32bde-9c16-45a8-a8e6-39449018971a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.727309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc32bde-9c16-45a8-a8e6-39449018971a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.729068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc32bde-9c16-45a8-a8e6-39449018971a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.732964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36065c64-b210-4b59-b64e-01ce66161dea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.738828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfc32b-e6e2-4396-b282-d7aef1bfe172 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.739589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfc32b-e6e2-4396-b282-d7aef1bfe172 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.739975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfc32b-e6e2-4396-b282-d7aef1bfe172 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.740348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecfc32b-e6e2-4396-b282-d7aef1bfe172 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.746081 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3533/7062] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:42.749791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc32bde-9c16-45a8-a8e6-39449018971a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:42.768990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc32bde-9c16-45a8-a8e6-39449018971a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:42.785132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1274f-02f9-47b4-83ef-8ba896a35174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:42.786527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1274f-02f9-47b4-83ef-8ba896a35174 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.786527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1274f-02f9-47b4-83ef-8ba896a35174 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.786527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1274f-02f9-47b4-83ef-8ba896a35174 admin admin] PATH_INFO: `/v3/projects/9bfd572d587c40299ac53c28ca81ad3f/users/b304c29ed6c24cfcb23d26d1b5aa486a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.792007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1274f-02f9-47b4-83ef-8ba896a35174 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bfd572d587c40299ac53c28ca81ad3f, user_id=b304c29ed6c24cfcb23d26d1b5aa486a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.794768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1274f-02f9-47b4-83ef-8ba896a35174 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.832670 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3534/7063] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:42 2022] PUT /identity/v3/projects/9bfd572d587c40299ac53c28ca81ad3f/users/b304c29ed6c24cfcb23d26d1b5aa486a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:42.839914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2a72b-61b7-47c2-8d8f-15828d1926aa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:42.840559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2a72b-61b7-47c2-8d8f-15828d1926aa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:42.842152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb2a72b-61b7-47c2-8d8f-15828d1926aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:42.860655 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:42.864812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfc32b-e6e2-4396-b282-d7aef1bfe172 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:42.866431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecfc32b-e6e2-4396-b282-d7aef1bfe172 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:42.881955 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3530/7064] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:24:42.938907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-efb2a72b-61b7-47c2-8d8f-15828d1926aa None None] MFA Rules not processed for user `b304c29ed6c24cfcb23d26d1b5aa486a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:42.940702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-efb2a72b-61b7-47c2-8d8f-15828d1926aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:43.109094 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3535/7065] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:42 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:43.111292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfc32b-e6e2-4396-b282-d7aef1bfe172 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:43.277842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecfc32b-e6e2-4396-b282-d7aef1bfe172 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:43.295639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3abd70-9291-44d9-b4fc-7717fbd2a097 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b304c29ed6c24cfcb23d26d1b5aa486a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfd572d587c40299ac53c28ca81ad3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:43.296292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3abd70-9291-44d9-b4fc-7717fbd2a097 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:43.296604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3abd70-9291-44d9-b4fc-7717fbd2a097 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:43.296952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3abd70-9291-44d9-b4fc-7717fbd2a097 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:43.297839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3abd70-9291-44d9-b4fc-7717fbd2a097 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:43.299718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3abd70-9291-44d9-b4fc-7717fbd2a097 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:43.371484 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3531/7066] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:43 2022] POST /identity/v3/projects => generated 360 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:43.374514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2a72b-61b7-47c2-8d8f-15828d1926aa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:43.397878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb2a72b-61b7-47c2-8d8f-15828d1926aa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:43.549093 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:43.571811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e3d7f-108d-4126-a9ac-c8bd2c972f2e tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b304c29ed6c24cfcb23d26d1b5aa486a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfd572d587c40299ac53c28ca81ad3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:43.572441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e3d7f-108d-4126-a9ac-c8bd2c972f2e tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:43.572726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e3d7f-108d-4126-a9ac-c8bd2c972f2e tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:43.573004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e3d7f-108d-4126-a9ac-c8bd2c972f2e tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:43.573782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e3d7f-108d-4126-a9ac-c8bd2c972f2e tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:43.575881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e3d7f-108d-4126-a9ac-c8bd2c972f2e tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:43.622311 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3536/7067] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:43 2022] POST /identity/v3/users => generated 371 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:43.624115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3abd70-9291-44d9-b4fc-7717fbd2a097 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:43.643416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3abd70-9291-44d9-b4fc-7717fbd2a097 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:43.662539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4f679-3574-4a5b-8cae-8a51a47733f1 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b304c29ed6c24cfcb23d26d1b5aa486a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfd572d587c40299ac53c28ca81ad3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:43.663513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4f679-3574-4a5b-8cae-8a51a47733f1 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:43.663967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4f679-3574-4a5b-8cae-8a51a47733f1 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:43.666551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4f679-3574-4a5b-8cae-8a51a47733f1 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:43.667468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4f679-3574-4a5b-8cae-8a51a47733f1 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Adding query filter params (domain_id=default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:43.667962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4f679-3574-4a5b-8cae-8a51a47733f1 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorizing `identity:list_users()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:43.674681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4f679-3574-4a5b-8cae-8a51a47733f1 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:43.719695 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3532/7068] 10.222.0.25 () {58 vars in 1157 bytes} [Mon Oct 24 09:24:43 2022] GET /identity/v3/users?domain_id=default => generated 8306 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:43.723757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e3d7f-108d-4126-a9ac-c8bd2c972f2e tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:43.737576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e3d7f-108d-4126-a9ac-c8bd2c972f2e tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:43.745221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b304c29ed6c24cfcb23d26d1b5aa486a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfd572d587c40299ac53c28ca81ad3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:43.746183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:43.746666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:43.747107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] PATH_INFO: `/v3/users/379bb5a9cb1945688970f8a148137b72` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:43.768273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorizing `identity:update_user(user_id=379bb5a9cb1945688970f8a148137b72)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:43.770982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:43.837155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _user_callback for event identity persist_revocation_event_for_user internal for {'resource_info': '379bb5a9cb1945688970f8a148137b72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:43.850682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invalidating the token cache because user 379bb5a9cb1945688970f8a148137b72 was enabled or disabled. Authorization will be calculated and enforced accordingly the next time they authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:43.852263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:43.854342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:43.858663 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3537/7069] 10.222.0.25 () {60 vars in 1244 bytes} [Mon Oct 24 09:24:43 2022] PATCH /identity/v3/users/379bb5a9cb1945688970f8a148137b72 => generated 485 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:24:43.864683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a720568-ff23-4f7e-ae55-06e520797676 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:43.867428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a720568-ff23-4f7e-ae55-06e520797676 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:43.867772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a720568-ff23-4f7e-ae55-06e520797676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:43.927860 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.auth.plugins.core [None req-8a720568-ff23-4f7e-ae55-06e520797676 None None] User is disabled: 379bb5a9cb1945688970f8a148137b72: AssertionError: User is disabled: 379bb5a9cb1945688970f8a148137b72 Oct 24 09:24:43.942552 n-d-master-1 devstack@keystone.service[88312]: WARNING keystone.server.flask.application [None req-8a720568-ff23-4f7e-ae55-06e520797676 None None] Authorization failed. The request you have made requires authentication. from 10.222.0.25: keystone.exception.Unauthorized: The request you have made requires authentication. Oct 24 09:24:43.945172 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3533/7070] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:43 2022] POST /identity/v3/auth/tokens => generated 109 bytes in 83 msecs (HTTP/1.1 401) 6 headers in 252 bytes (1 switches on core 0) Oct 24 09:24:43.948983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:43.952473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:43.975575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cfe355-1cc8-430f-9707-0872c7f6439b tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:43.983101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b304c29ed6c24cfcb23d26d1b5aa486a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfd572d587c40299ac53c28ca81ad3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:43.985671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:43.986240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:43.986683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] PATH_INFO: `/v3/users/379bb5a9cb1945688970f8a148137b72` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:44.013358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorizing `identity:delete_user(user_id=379bb5a9cb1945688970f8a148137b72)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:44.016567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:44.088132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '379bb5a9cb1945688970f8a148137b72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.108432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '379bb5a9cb1945688970f8a148137b72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.110617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '379bb5a9cb1945688970f8a148137b72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.149274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '379bb5a9cb1945688970f8a148137b72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.162493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '379bb5a9cb1945688970f8a148137b72'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.175202 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3538/7071] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:43 2022] DELETE /identity/v3/users/379bb5a9cb1945688970f8a148137b72 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:44.179607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a720568-ff23-4f7e-ae55-06e520797676 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:44.182492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8a720568-ff23-4f7e-ae55-06e520797676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:44.381782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a720568-ff23-4f7e-ae55-06e520797676 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:44.397440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b304c29ed6c24cfcb23d26d1b5aa486a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfd572d587c40299ac53c28ca81ad3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:44.400663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:44.401235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:44.401734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] PATH_INFO: `/v3/projects/a505db320dc14b89a4cf12146cd5adbd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:44.404266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorizing `identity:delete_project(project_id=a505db320dc14b89a4cf12146cd5adbd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:44.412876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:44.557837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a505db320dc14b89a4cf12146cd5adbd', 'request_id': 'req-d4903c35-5728-418c-ac61-2edef90165c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.580379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a505db320dc14b89a4cf12146cd5adbd', 'request_id': 'req-d4903c35-5728-418c-ac61-2edef90165c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.592394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a505db320dc14b89a4cf12146cd5adbd', 'request_id': 'req-d4903c35-5728-418c-ac61-2edef90165c6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.602212 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:44.623830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] The token cache is being invalidate because project a505db320dc14b89a4cf12146cd5adbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:44.624038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.629133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:44.637531 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3534/7072] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:44 2022] DELETE /identity/v3/projects/a505db320dc14b89a4cf12146cd5adbd => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:44.646697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:44.663572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fce50-585c-4bfb-a6d4-c0f23c66ab15 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:44.803922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e08f3-d75c-4994-a459-ae1a5f6bc65d tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b304c29ed6c24cfcb23d26d1b5aa486a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9bfd572d587c40299ac53c28ca81ad3f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:44.804578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e08f3-d75c-4994-a459-ae1a5f6bc65d tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:44.804866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e08f3-d75c-4994-a459-ae1a5f6bc65d tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:44.805147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e08f3-d75c-4994-a459-ae1a5f6bc65d tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:44.805864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e08f3-d75c-4994-a459-ae1a5f6bc65d tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:44.819308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e08f3-d75c-4994-a459-ae1a5f6bc65d tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:44.831464 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:INSERT=5,keystone:UPDATE=1,keystone:DELETE=11 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-211e08f3-d75c-4994-a459-ae1a5f6bc65d tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Could not find domain: fb83f402f760438aac52e16d62b0ee2e.: keystone.exception.DomainNotFound: Could not find domain: fb83f402f760438aac52e16d62b0ee2e. Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: fb83f402f760438aac52e16d62b0ee2e. Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:44.865382 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:24:44.866791 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 987, in create_user Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.resource_api.get_domain(domain_id) Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:24:44.868377 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:24:44.869925 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:24:44.869925 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:24:44.869925 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: fb83f402f760438aac52e16d62b0ee2e. Oct 24 09:24:44.869925 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:24:44.877094 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3539/7073] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:44 2022] POST /identity/v3/users => generated 112 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:24:44.878421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:44.880207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:45.026772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4903c35-5728-418c-ac61-2edef90165c6 tempest-UsersNegativeTest-1424991355 tempest-UsersNegativeTest-1424991355-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:45.032716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:45.033748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:45.034259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:45.034760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] PATH_INFO: `/v3/users/f8bbc8b06d0347f3bfa14addd84b3b43` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:45.036153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8bbc8b06d0347f3bfa14addd84b3b43)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:45.038481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:45.112621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8bbc8b06d0347f3bfa14addd84b3b43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:45.138894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8bbc8b06d0347f3bfa14addd84b3b43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:45.140279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8bbc8b06d0347f3bfa14addd84b3b43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:45.164346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8bbc8b06d0347f3bfa14addd84b3b43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:45.178675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8bbc8b06d0347f3bfa14addd84b3b43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:45.190217 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3535/7074] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:44 2022] DELETE /identity/v3/users/f8bbc8b06d0347f3bfa14addd84b3b43 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:45.194684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51761a0e-fd16-4949-b3f3-a83dcb9091d5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:45.196012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51761a0e-fd16-4949-b3f3-a83dcb9091d5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:45.196012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51761a0e-fd16-4949-b3f3-a83dcb9091d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:45.219182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-51761a0e-fd16-4949-b3f3-a83dcb9091d5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:45.221177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-51761a0e-fd16-4949-b3f3-a83dcb9091d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:45.303623 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3540/7075] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:45.316801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:45.318487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:45.455228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5613a75b-d321-4aeb-ac7e-490cac084850 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:45.467519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c84522-1472-497a-a069-710fe8af29de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:45.468550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c84522-1472-497a-a069-710fe8af29de service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:45.469402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c84522-1472-497a-a069-710fe8af29de service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:45.469848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c84522-1472-497a-a069-710fe8af29de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:45.483350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c84522-1472-497a-a069-710fe8af29de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:45.490953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c84522-1472-497a-a069-710fe8af29de service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:45.508687 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3536/7076] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:46.162279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51761a0e-fd16-4949-b3f3-a83dcb9091d5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:46.164360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-51761a0e-fd16-4949-b3f3-a83dcb9091d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:46.347044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51761a0e-fd16-4949-b3f3-a83dcb9091d5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:46.356242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c0af5-1cc4-45c1-a87e-86546409fb6d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:46.356991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c0af5-1cc4-45c1-a87e-86546409fb6d service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:46.357435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c0af5-1cc4-45c1-a87e-86546409fb6d service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:46.357906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c0af5-1cc4-45c1-a87e-86546409fb6d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:46.360628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d57c0af5-1cc4-45c1-a87e-86546409fb6d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:46.381442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c0af5-1cc4-45c1-a87e-86546409fb6d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:46.384100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57c0af5-1cc4-45c1-a87e-86546409fb6d service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:46.408382 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3541/7077] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:46.828966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c84522-1472-497a-a069-710fe8af29de service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:46.830538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-33c84522-1472-497a-a069-710fe8af29de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:46.860415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c84522-1472-497a-a069-710fe8af29de service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:46.875515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3375-34af-4753-b283-648517935540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:46.876487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3375-34af-4753-b283-648517935540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:46.876940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3375-34af-4753-b283-648517935540 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:46.877406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488b3375-34af-4753-b283-648517935540 admin admin] PATH_INFO: `/v3/projects/28777888796546b5a87c56977439faef` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:46.880439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b3375-34af-4753-b283-648517935540 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28777888796546b5a87c56977439faef)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:46.891190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488b3375-34af-4753-b283-648517935540 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:46.921701 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:46.998643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-488b3375-34af-4753-b283-648517935540 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28777888796546b5a87c56977439faef', 'request_id': 'req-488b3375-34af-4753-b283-648517935540'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.014080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-488b3375-34af-4753-b283-648517935540 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28777888796546b5a87c56977439faef', 'request_id': 'req-488b3375-34af-4753-b283-648517935540'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.029411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-488b3375-34af-4753-b283-648517935540 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28777888796546b5a87c56977439faef', 'request_id': 'req-488b3375-34af-4753-b283-648517935540'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.079470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-488b3375-34af-4753-b283-648517935540 admin admin] The token cache is being invalidate because project 28777888796546b5a87c56977439faef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:47.079777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-488b3375-34af-4753-b283-648517935540 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.081565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-488b3375-34af-4753-b283-648517935540 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.087417 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3537/7078] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:46 2022] DELETE /identity/v3/projects/28777888796546b5a87c56977439faef => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:47.091389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c0af5-1cc4-45c1-a87e-86546409fb6d service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:47.126754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57c0af5-1cc4-45c1-a87e-86546409fb6d service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:47.278665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:47.279329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:47.282897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:47.283232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] PATH_INFO: `/v3/users/b304c29ed6c24cfcb23d26d1b5aa486a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:47.286048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b304c29ed6c24cfcb23d26d1b5aa486a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:47.304326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:47.379331 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:47.416178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b304c29ed6c24cfcb23d26d1b5aa486a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.440512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b304c29ed6c24cfcb23d26d1b5aa486a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.441343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b304c29ed6c24cfcb23d26d1b5aa486a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.476523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b304c29ed6c24cfcb23d26d1b5aa486a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.488434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0b763be9-7fab-47a8-ba9b-4139b7552d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b304c29ed6c24cfcb23d26d1b5aa486a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:47.507885 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3542/7079] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:47 2022] DELETE /identity/v3/users/b304c29ed6c24cfcb23d26d1b5aa486a => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:48.408557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3375-34af-4753-b283-648517935540 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:48.410024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-488b3375-34af-4753-b283-648517935540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:48.431746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488b3375-34af-4753-b283-648517935540 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:48.557887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:48.558618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:48.559043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:48.559386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] PATH_INFO: `/v3/projects/9bfd572d587c40299ac53c28ca81ad3f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:48.560719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bfd572d587c40299ac53c28ca81ad3f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:48.563466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:48.684505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bfd572d587c40299ac53c28ca81ad3f', 'request_id': 'req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:48.707278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bfd572d587c40299ac53c28ca81ad3f', 'request_id': 'req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:48.752547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bfd572d587c40299ac53c28ca81ad3f', 'request_id': 'req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:48.795438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] The token cache is being invalidate because project 9bfd572d587c40299ac53c28ca81ad3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:48.795781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:48.798617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6324e1d5-751d-49b8-ad26-7e8bcde70cfd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:48.801653 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3538/7080] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:48 2022] DELETE /identity/v3/projects/9bfd572d587c40299ac53c28ca81ad3f => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:48.807642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57254b5-a8d1-49fa-9bbf-24c0c2fd62e9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:48.808152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57254b5-a8d1-49fa-9bbf-24c0c2fd62e9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:48.808388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57254b5-a8d1-49fa-9bbf-24c0c2fd62e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:48.858477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a57254b5-a8d1-49fa-9bbf-24c0c2fd62e9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:48.860519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a57254b5-a8d1-49fa-9bbf-24c0c2fd62e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:49.048481 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3543/7081] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:49.157751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96de93c-2596-4bcc-8f31-4d9d3a5ae43d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:49.158047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96de93c-2596-4bcc-8f31-4d9d3a5ae43d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:49.158469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96de93c-2596-4bcc-8f31-4d9d3a5ae43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:49.238984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f96de93c-2596-4bcc-8f31-4d9d3a5ae43d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:49.238984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f96de93c-2596-4bcc-8f31-4d9d3a5ae43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:49.260378 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3539/7082] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:49.264743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57254b5-a8d1-49fa-9bbf-24c0c2fd62e9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:49.279763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57254b5-a8d1-49fa-9bbf-24c0c2fd62e9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:49.294569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe9839-78d2-448b-a318-fa8eec9dd4e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:49.295404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe9839-78d2-448b-a318-fa8eec9dd4e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:49.295863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe9839-78d2-448b-a318-fa8eec9dd4e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:49.296342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe9839-78d2-448b-a318-fa8eec9dd4e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:49.297779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe9839-78d2-448b-a318-fa8eec9dd4e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:49.300514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe9839-78d2-448b-a318-fa8eec9dd4e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:49.302457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe9839-78d2-448b-a318-fa8eec9dd4e8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:49.324763 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3544/7083] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:49.329421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96de93c-2596-4bcc-8f31-4d9d3a5ae43d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:49.352153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96de93c-2596-4bcc-8f31-4d9d3a5ae43d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:49.366324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbd0b9-0f9c-404b-9231-9820415462c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:49.367081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbd0b9-0f9c-404b-9231-9820415462c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:49.368603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbd0b9-0f9c-404b-9231-9820415462c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:49.371430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbd0b9-0f9c-404b-9231-9820415462c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:49.372865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbd0b9-0f9c-404b-9231-9820415462c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:49.382705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbd0b9-0f9c-404b-9231-9820415462c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:49.432627 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:49.443328 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3540/7084] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:49 2022] POST /identity/v3/projects => generated 387 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:24:49.447007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe9839-78d2-448b-a318-fa8eec9dd4e8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:49.461920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe9839-78d2-448b-a318-fa8eec9dd4e8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:49.613283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e0e16-360c-4c56-bac3-3c8d8045a6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:49.613834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e0e16-360c-4c56-bac3-3c8d8045a6c7 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:49.614509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e0e16-360c-4c56-bac3-3c8d8045a6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:49.615266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141e0e16-360c-4c56-bac3-3c8d8045a6c7 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:49.615749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e0e16-360c-4c56-bac3-3c8d8045a6c7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:49.620427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141e0e16-360c-4c56-bac3-3c8d8045a6c7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:49.716606 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3545/7085] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:49 2022] POST /identity/v3/users => generated 300 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:49.717916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbd0b9-0f9c-404b-9231-9820415462c2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:49.729574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbd0b9-0f9c-404b-9231-9820415462c2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:49.735345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e344176-52ff-47f1-8217-2056fa158a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:49.736420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344176-52ff-47f1-8217-2056fa158a6a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:49.737003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344176-52ff-47f1-8217-2056fa158a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:49.737585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e344176-52ff-47f1-8217-2056fa158a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:49.738486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e344176-52ff-47f1-8217-2056fa158a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:49.740530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e344176-52ff-47f1-8217-2056fa158a6a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:49.767856 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3541/7086] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:49.772106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e0e16-360c-4c56-bac3-3c8d8045a6c7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:49.788487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141e0e16-360c-4c56-bac3-3c8d8045a6c7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:49.794577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bddd1-25f5-4df7-8ea2-9ed16fe93eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:49.795640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bddd1-25f5-4df7-8ea2-9ed16fe93eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:49.796160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bddd1-25f5-4df7-8ea2-9ed16fe93eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:49.797250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bddd1-25f5-4df7-8ea2-9ed16fe93eeb admin admin] PATH_INFO: `/v3/projects/b60c5972aa634146919d19718905409c/users/ba21a841ac014c87949fe547e251ed9b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:49.817762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bddd1-25f5-4df7-8ea2-9ed16fe93eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60c5972aa634146919d19718905409c, user_id=ba21a841ac014c87949fe547e251ed9b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:49.822449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bddd1-25f5-4df7-8ea2-9ed16fe93eeb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:49.857036 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:49.873610 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3546/7087] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:49 2022] PUT /identity/v3/projects/b60c5972aa634146919d19718905409c/users/ba21a841ac014c87949fe547e251ed9b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:49.875345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e344176-52ff-47f1-8217-2056fa158a6a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:49.888942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e344176-52ff-47f1-8217-2056fa158a6a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:50.041645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e41d9-dcbe-4455-b372-d8b8dc884cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:50.042284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e41d9-dcbe-4455-b372-d8b8dc884cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.042568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e41d9-dcbe-4455-b372-d8b8dc884cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.043024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e41d9-dcbe-4455-b372-d8b8dc884cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.043868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e41d9-dcbe-4455-b372-d8b8dc884cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:50.045527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e41d9-dcbe-4455-b372-d8b8dc884cf3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:50.075608 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3542/7088] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:49 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:50.076822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bddd1-25f5-4df7-8ea2-9ed16fe93eeb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:50.090627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bddd1-25f5-4df7-8ea2-9ed16fe93eeb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:50.103499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71946-4ac0-4635-9ff2-0c98021d96be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:50.104730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71946-4ac0-4635-9ff2-0c98021d96be admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.105183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71946-4ac0-4635-9ff2-0c98021d96be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.105761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac71946-4ac0-4635-9ff2-0c98021d96be admin admin] PATH_INFO: `/v3/projects/b60c5972aa634146919d19718905409c/users/ba21a841ac014c87949fe547e251ed9b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.109768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71946-4ac0-4635-9ff2-0c98021d96be admin admin] RBAC: Authorizing `identity:create_grant(project_id=b60c5972aa634146919d19718905409c, user_id=ba21a841ac014c87949fe547e251ed9b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:50.112963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac71946-4ac0-4635-9ff2-0c98021d96be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:50.139025 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3547/7089] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:50 2022] PUT /identity/v3/projects/b60c5972aa634146919d19718905409c/users/ba21a841ac014c87949fe547e251ed9b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:50.150050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b309ce-ccec-413c-b0f2-d2f53efed5cc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.152571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b309ce-ccec-413c-b0f2-d2f53efed5cc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.152800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b309ce-ccec-413c-b0f2-d2f53efed5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.207624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-96b309ce-ccec-413c-b0f2-d2f53efed5cc None None] MFA Rules not processed for user `ba21a841ac014c87949fe547e251ed9b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:50.209404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-96b309ce-ccec-413c-b0f2-d2f53efed5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:50.324628 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3543/7090] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:50 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:50.328104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71946-4ac0-4635-9ff2-0c98021d96be admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:50.426487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac71946-4ac0-4635-9ff2-0c98021d96be admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:50.432665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d0516-ff50-45ff-a36d-9649942a8cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:50.433429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d0516-ff50-45ff-a36d-9649942a8cd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.433843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d0516-ff50-45ff-a36d-9649942a8cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.434142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d0516-ff50-45ff-a36d-9649942a8cd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.434912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d0516-ff50-45ff-a36d-9649942a8cd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:50.438305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d0516-ff50-45ff-a36d-9649942a8cd4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:50.485042 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3548/7091] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:50 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:50.487153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b309ce-ccec-413c-b0f2-d2f53efed5cc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:50.502478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b309ce-ccec-413c-b0f2-d2f53efed5cc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:50.630039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d0516-ff50-45ff-a36d-9649942a8cd4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:50.633473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-018d0516-ff50-45ff-a36d-9649942a8cd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:50.669995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24954ace-03ea-406c-b736-a3e9c2ce5f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:50.671061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24954ace-03ea-406c-b736-a3e9c2ce5f29 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.673594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24954ace-03ea-406c-b736-a3e9c2ce5f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.675990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24954ace-03ea-406c-b736-a3e9c2ce5f29 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.678005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24954ace-03ea-406c-b736-a3e9c2ce5f29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:50.684229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24954ace-03ea-406c-b736-a3e9c2ce5f29 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:50.725670 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:50.739798 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3544/7092] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:50 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:50.741182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24954ace-03ea-406c-b736-a3e9c2ce5f29 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:50.755257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24954ace-03ea-406c-b736-a3e9c2ce5f29 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:50.763581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e82de-eb90-4076-968e-ee8cb596e86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:50.764657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e82de-eb90-4076-968e-ee8cb596e86b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.765172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e82de-eb90-4076-968e-ee8cb596e86b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.765763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592e82de-eb90-4076-968e-ee8cb596e86b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.766693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e82de-eb90-4076-968e-ee8cb596e86b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:50.768544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592e82de-eb90-4076-968e-ee8cb596e86b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:50.783386 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3545/7093] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:50.787763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e82de-eb90-4076-968e-ee8cb596e86b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:50.800640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592e82de-eb90-4076-968e-ee8cb596e86b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:50.826746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8547eb-58de-4868-903b-27c16e002e05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:50.828288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8547eb-58de-4868-903b-27c16e002e05 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.829228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8547eb-58de-4868-903b-27c16e002e05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.829970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8547eb-58de-4868-903b-27c16e002e05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.830859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8547eb-58de-4868-903b-27c16e002e05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:50.833390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d0516-ff50-45ff-a36d-9649942a8cd4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:50.835139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8547eb-58de-4868-903b-27c16e002e05 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:50.839054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:50.839700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.840128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.840250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] PATH_INFO: `/v3/users/0b26380968044d3899b5a76aac1549d4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.842348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b26380968044d3899b5a76aac1549d4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:50.845569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:50.857034 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3546/7094] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:50 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:50.858292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8547eb-58de-4868-903b-27c16e002e05 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:50.882233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8547eb-58de-4868-903b-27c16e002e05 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:50.889355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b51d9b3-24b0-40b3-aad3-9a020247a107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:50.890336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51d9b3-24b0-40b3-aad3-9a020247a107 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.890720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51d9b3-24b0-40b3-aad3-9a020247a107 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.891162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b51d9b3-24b0-40b3-aad3-9a020247a107 admin admin] PATH_INFO: `/v3/projects/ee9f6b036ab345b8a597eb483c2e5737/users/28ed5df4fffc496ea003f99716662d81/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.920119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51d9b3-24b0-40b3-aad3-9a020247a107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee9f6b036ab345b8a597eb483c2e5737, user_id=28ed5df4fffc496ea003f99716662d81, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:50.925569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b51d9b3-24b0-40b3-aad3-9a020247a107 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:50.940804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b26380968044d3899b5a76aac1549d4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:50.951392 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3547/7095] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:50 2022] PUT /identity/v3/projects/ee9f6b036ab345b8a597eb483c2e5737/users/28ed5df4fffc496ea003f99716662d81/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:50.961857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b26380968044d3899b5a76aac1549d4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:50.962682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b26380968044d3899b5a76aac1549d4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:50.965319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71468ba9-135d-48de-85ac-0307a8dccb70 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:50.965719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71468ba9-135d-48de-85ac-0307a8dccb70 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:50.966173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71468ba9-135d-48de-85ac-0307a8dccb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:50.980353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b26380968044d3899b5a76aac1549d4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:50.983043 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:50.996016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4e83a18-38bb-4d84-b364-3cce25f60002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b26380968044d3899b5a76aac1549d4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:51.011804 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3549/7096] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:50 2022] DELETE /identity/v3/users/0b26380968044d3899b5a76aac1549d4 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:51.027952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf046e99-e782-4102-b1a2-aa1f7fcbe369 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:51.029114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf046e99-e782-4102-b1a2-aa1f7fcbe369 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:51.030645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf046e99-e782-4102-b1a2-aa1f7fcbe369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:51.044316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-71468ba9-135d-48de-85ac-0307a8dccb70 None None] MFA Rules not processed for user `28ed5df4fffc496ea003f99716662d81`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:51.048879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-71468ba9-135d-48de-85ac-0307a8dccb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:51.093120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cf046e99-e782-4102-b1a2-aa1f7fcbe369 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:51.094789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cf046e99-e782-4102-b1a2-aa1f7fcbe369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:51.258249 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3550/7097] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:51.265832 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3548/7098] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:51.272859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf046e99-e782-4102-b1a2-aa1f7fcbe369 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:51.274472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cf046e99-e782-4102-b1a2-aa1f7fcbe369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:51.369802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71468ba9-135d-48de-85ac-0307a8dccb70 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:51.375456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-71468ba9-135d-48de-85ac-0307a8dccb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:51.390237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf046e99-e782-4102-b1a2-aa1f7fcbe369 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:51.401263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:51.402213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:51.402680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:51.403125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:51.407786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:51.513746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:51.515505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:51.529231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71468ba9-135d-48de-85ac-0307a8dccb70 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:51.536331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971df463-77b9-4418-98ca-f005a509187e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:51.537015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971df463-77b9-4418-98ca-f005a509187e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:51.537224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971df463-77b9-4418-98ca-f005a509187e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:51.539487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971df463-77b9-4418-98ca-f005a509187e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:51.540628 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3551/7099] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:51 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:51.555122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971df463-77b9-4418-98ca-f005a509187e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:51.556602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971df463-77b9-4418-98ca-f005a509187e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:51.574948 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3549/7100] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:51.953668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:51.955136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:51.983045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02d8afe-5211-4318-82da-8302c8f9c4c8 service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:51.995074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:51.996019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:51.996476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:51.996937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] PATH_INFO: `/v3/users/ba21a841ac014c87949fe547e251ed9b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:51.998445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba21a841ac014c87949fe547e251ed9b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:52.001428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:52.102027 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:52.129214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba21a841ac014c87949fe547e251ed9b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.155550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba21a841ac014c87949fe547e251ed9b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.156983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba21a841ac014c87949fe547e251ed9b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.176053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba21a841ac014c87949fe547e251ed9b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.188095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d881146d-a791-4b22-af39-b9aa92cd6f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba21a841ac014c87949fe547e251ed9b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.201396 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3552/7101] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:51 2022] DELETE /identity/v3/users/ba21a841ac014c87949fe547e251ed9b => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:52.206975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b23130-2470-40fe-8116-8f323171fe31 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:52.207276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b23130-2470-40fe-8116-8f323171fe31 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:52.207560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b23130-2470-40fe-8116-8f323171fe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:52.231978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-66b23130-2470-40fe-8116-8f323171fe31 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:52.233280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-66b23130-2470-40fe-8116-8f323171fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:52.303128 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:52.356424 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3550/7102] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:52.397236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd04330-8363-4b3a-8c85-56d4c678146e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:52.397572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd04330-8363-4b3a-8c85-56d4c678146e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:52.398003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd04330-8363-4b3a-8c85-56d4c678146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:52.416145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b23130-2470-40fe-8116-8f323171fe31 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:52.418232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-66b23130-2470-40fe-8116-8f323171fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:52.463846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9dd04330-8363-4b3a-8c85-56d4c678146e None None] MFA Rules not processed for user `a9e772b13aa441f194793eaecf668a6c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:52.468567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9dd04330-8363-4b3a-8c85-56d4c678146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:52.584668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b23130-2470-40fe-8116-8f323171fe31 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:52.590958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c9aa-feed-43e1-a6e3-65bd4460fab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:52.592103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c9aa-feed-43e1-a6e3-65bd4460fab4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:52.593666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c9aa-feed-43e1-a6e3-65bd4460fab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:52.594610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041c9aa-feed-43e1-a6e3-65bd4460fab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:52.609712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041c9aa-feed-43e1-a6e3-65bd4460fab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:52.611625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6041c9aa-feed-43e1-a6e3-65bd4460fab4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:52.628620 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3551/7103] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:24:52.629934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3553/7104] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:52.636955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd04330-8363-4b3a-8c85-56d4c678146e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:52.637316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c9aa-feed-43e1-a6e3-65bd4460fab4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:52.639024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6041c9aa-feed-43e1-a6e3-65bd4460fab4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:52.639790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9dd04330-8363-4b3a-8c85-56d4c678146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:52.662271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd04330-8363-4b3a-8c85-56d4c678146e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:52.667150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041c9aa-feed-43e1-a6e3-65bd4460fab4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:52.676709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47b96-0fb4-488a-891c-5c2fdd5c3665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:52.677811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47b96-0fb4-488a-891c-5c2fdd5c3665 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:52.678344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47b96-0fb4-488a-891c-5c2fdd5c3665 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:52.678810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d47b96-0fb4-488a-891c-5c2fdd5c3665 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:52.683697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:52.683697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:52.684274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:52.684653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] PATH_INFO: `/v3/projects/819c9198b88a4c21813b5642f1db1efb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:52.687701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d47b96-0fb4-488a-891c-5c2fdd5c3665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:52.691827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d47b96-0fb4-488a-891c-5c2fdd5c3665 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:52.700630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=819c9198b88a4c21813b5642f1db1efb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:52.710741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:52.798135 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3554/7105] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:52 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:52.799577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47b96-0fb4-488a-891c-5c2fdd5c3665 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:52.837475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d47b96-0fb4-488a-891c-5c2fdd5c3665 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:52.842958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '819c9198b88a4c21813b5642f1db1efb', 'request_id': 'req-c0284973-2ef2-4172-b3a4-9cf0848209cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.862078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '819c9198b88a4c21813b5642f1db1efb', 'request_id': 'req-c0284973-2ef2-4172-b3a4-9cf0848209cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.871826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '819c9198b88a4c21813b5642f1db1efb', 'request_id': 'req-c0284973-2ef2-4172-b3a4-9cf0848209cd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.913561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] The token cache is being invalidate because project 819c9198b88a4c21813b5642f1db1efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:52.914090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.915120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:52.919122 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3552/7106] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:52 2022] DELETE /identity/v3/projects/819c9198b88a4c21813b5642f1db1efb => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:52.923171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:52.927198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:53.034880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289a703-179f-450e-969c-e4004c49e886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:53.035682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289a703-179f-450e-969c-e4004c49e886 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:53.036063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289a703-179f-450e-969c-e4004c49e886 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:53.036493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3289a703-179f-450e-969c-e4004c49e886 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:53.040659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289a703-179f-450e-969c-e4004c49e886 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:53.042696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3289a703-179f-450e-969c-e4004c49e886 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:53.072102 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3555/7107] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:52 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:24:53.073115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289a703-179f-450e-969c-e4004c49e886 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:53.075880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0284973-2ef2-4172-b3a4-9cf0848209cd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:53.078597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3289a703-179f-450e-969c-e4004c49e886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:53.099525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:53.101996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:53.102586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:53.102878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] PATH_INFO: `/v3/users/4ef2cd1baba1458fbe6efbdf5df05f37` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:53.118296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ef2cd1baba1458fbe6efbdf5df05f37)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:53.118296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:53.131575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3289a703-179f-450e-969c-e4004c49e886 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:53.150797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a83bc9e-a322-42e0-a940-ec378f18ce11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:53.152084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83bc9e-a322-42e0-a940-ec378f18ce11 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:53.152451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83bc9e-a322-42e0-a940-ec378f18ce11 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:53.152674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a83bc9e-a322-42e0-a940-ec378f18ce11 admin admin] PATH_INFO: `/v3/system/users/58eedc93409b47ebacc0a800cc03617f/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:53.184294 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:53.209355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83bc9e-a322-42e0-a940-ec378f18ce11 admin admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=58eedc93409b47ebacc0a800cc03617f, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:53.209355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a83bc9e-a322-42e0-a940-ec378f18ce11 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:53.224908 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3556/7108] 10.222.0.25 () {60 vars in 1378 bytes} [Mon Oct 24 09:24:53 2022] PUT /identity/v3/system/users/58eedc93409b47ebacc0a800cc03617f/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:53.239750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b5985-5c4b-45d2-b5d0-570fdd5e1393 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:53.240128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b5985-5c4b-45d2-b5d0-570fdd5e1393 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:53.240418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30b5985-5c4b-45d2-b5d0-570fdd5e1393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:53.250451 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:53.299676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ef2cd1baba1458fbe6efbdf5df05f37'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:53.305941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c30b5985-5c4b-45d2-b5d0-570fdd5e1393 None None] MFA Rules not processed for user `58eedc93409b47ebacc0a800cc03617f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:53.310555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c30b5985-5c4b-45d2-b5d0-570fdd5e1393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:53.330186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ef2cd1baba1458fbe6efbdf5df05f37'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:53.331005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ef2cd1baba1458fbe6efbdf5df05f37'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:53.355133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ef2cd1baba1458fbe6efbdf5df05f37'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:53.372299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ef2cd1baba1458fbe6efbdf5df05f37'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:53.385137 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3553/7109] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:52 2022] DELETE /identity/v3/users/4ef2cd1baba1458fbe6efbdf5df05f37 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:53.518442 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3557/7110] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:53 2022] POST /identity/v3/auth/tokens => generated 2414 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 24 09:24:53.523062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:53.727423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a16b0-dfed-41aa-82bf-9d289a959cc8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:53.802107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66301206-9784-4385-a9ca-89364780770b None tempest-ImageQuotaTest-368475053-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58eedc93409b47ebacc0a800cc03617f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:53.803038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66301206-9784-4385-a9ca-89364780770b None tempest-ImageQuotaTest-368475053-system-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:53.803674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66301206-9784-4385-a9ca-89364780770b None tempest-ImageQuotaTest-368475053-system-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:53.804127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66301206-9784-4385-a9ca-89364780770b None tempest-ImageQuotaTest-368475053-system-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:53.804923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66301206-9784-4385-a9ca-89364780770b None tempest-ImageQuotaTest-368475053-system-admin] RBAC: Authorizing `identity:list_services()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:53.808860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66301206-9784-4385-a9ca-89364780770b None tempest-ImageQuotaTest-368475053-system-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:53.819046 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3554/7111] 10.222.0.25 () {58 vars in 1110 bytes} [Mon Oct 24 09:24:53 2022] GET /identity/v3/services => generated 2191 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:53.824722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b5985-5c4b-45d2-b5d0-570fdd5e1393 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:53.979907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30b5985-5c4b-45d2-b5d0-570fdd5e1393 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:54.028777 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:54.051487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568afca-0196-4654-b317-4201aa28938e None tempest-ImageQuotaTest-368475053-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58eedc93409b47ebacc0a800cc03617f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:54.052181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568afca-0196-4654-b317-4201aa28938e None tempest-ImageQuotaTest-368475053-system-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:54.052388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568afca-0196-4654-b317-4201aa28938e None tempest-ImageQuotaTest-368475053-system-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:54.053936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f568afca-0196-4654-b317-4201aa28938e None tempest-ImageQuotaTest-368475053-system-admin] PATH_INFO: `/v3/limits` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:54.053936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568afca-0196-4654-b317-4201aa28938e None tempest-ImageQuotaTest-368475053-system-admin] RBAC: Authorizing `identity:create_limits()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:54.057851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f568afca-0196-4654-b317-4201aa28938e None tempest-ImageQuotaTest-368475053-system-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-f568afca-0196-4654-b317-4201aa28938e None tempest-ImageQuotaTest-368475053-system-admin] Unable to create a limit that has no corresponding registered limit.: keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/limits.py", line 110, in post Oct 24 09:24:54.120288 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application refs = PROVIDERS.unified_limit_api.create_limits(limits) Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/core.py", line 116, in create_limits Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.create_limits(limits) Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 260, in create_limits Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application target = self._check_and_fill_registered_limit_id(limit) Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/limit/backends/sql.py", line 249, in _check_and_fill_registered_limit_id Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.NoLimitReference Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.NoLimitReference: Unable to create a limit that has no corresponding registered limit. Oct 24 09:24:54.121913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:24:54.123165 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3558/7112] 10.222.0.25 () {60 vars in 1126 bytes} [Mon Oct 24 09:24:53 2022] POST /identity/v3/limits => generated 124 bytes in 300 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:24:54.129471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66301206-9784-4385-a9ca-89364780770b None tempest-ImageQuotaTest-368475053-system-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:54.133048 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:54.339527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66301206-9784-4385-a9ca-89364780770b None tempest-ImageQuotaTest-368475053-system-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:54.401826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab8693-5071-4b22-8166-be9ab821a0e1 None tempest-ImageQuotaTest-368475053-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58eedc93409b47ebacc0a800cc03617f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:54.402594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab8693-5071-4b22-8166-be9ab821a0e1 None tempest-ImageQuotaTest-368475053-system-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:54.408768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab8693-5071-4b22-8166-be9ab821a0e1 None tempest-ImageQuotaTest-368475053-system-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:54.409524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ab8693-5071-4b22-8166-be9ab821a0e1 None tempest-ImageQuotaTest-368475053-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:54.410788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab8693-5071-4b22-8166-be9ab821a0e1 None tempest-ImageQuotaTest-368475053-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:54.424564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ab8693-5071-4b22-8166-be9ab821a0e1 None tempest-ImageQuotaTest-368475053-system-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:54.450733 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3555/7113] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:24:54 2022] GET /identity/v3/registered_limits => generated 129 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:54.457879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568afca-0196-4654-b317-4201aa28938e None tempest-ImageQuotaTest-368475053-system-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:54.654539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f568afca-0196-4654-b317-4201aa28938e None tempest-ImageQuotaTest-368475053-system-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:54.804832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59d1e6-85d9-4e51-93f9-118e0dd60d07 None tempest-ImageQuotaTest-368475053-system-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '58eedc93409b47ebacc0a800cc03617f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:54.805539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59d1e6-85d9-4e51-93f9-118e0dd60d07 None tempest-ImageQuotaTest-368475053-system-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:54.805826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59d1e6-85d9-4e51-93f9-118e0dd60d07 None tempest-ImageQuotaTest-368475053-system-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:54.806107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a59d1e6-85d9-4e51-93f9-118e0dd60d07 None tempest-ImageQuotaTest-368475053-system-admin] PATH_INFO: `/v3/registered_limits` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:54.806731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59d1e6-85d9-4e51-93f9-118e0dd60d07 None tempest-ImageQuotaTest-368475053-system-admin] RBAC: Authorizing `identity:list_registered_limits()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:54.816112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a59d1e6-85d9-4e51-93f9-118e0dd60d07 None tempest-ImageQuotaTest-368475053-system-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:54.841802 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3559/7114] 10.222.0.25 () {58 vars in 1137 bytes} [Mon Oct 24 09:24:54 2022] GET /identity/v3/registered_limits => generated 129 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:54.933082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab8693-5071-4b22-8166-be9ab821a0e1 None tempest-ImageQuotaTest-368475053-system-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:54.936909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-88ab8693-5071-4b22-8166-be9ab821a0e1 None tempest-ImageQuotaTest-368475053-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:55.207634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ab8693-5071-4b22-8166-be9ab821a0e1 None tempest-ImageQuotaTest-368475053-system-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:55.215499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:55.216452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:55.216837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:55.217222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] PATH_INFO: `/v3/projects/b60c5972aa634146919d19718905409c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:55.218734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b60c5972aa634146919d19718905409c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:55.223223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:55.258047 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:55.322805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b60c5972aa634146919d19718905409c', 'request_id': 'req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.340404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b60c5972aa634146919d19718905409c', 'request_id': 'req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.352243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b60c5972aa634146919d19718905409c', 'request_id': 'req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.378780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] The token cache is being invalidate because project b60c5972aa634146919d19718905409c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:55.379155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.380377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.387778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59d1e6-85d9-4e51-93f9-118e0dd60d07 None tempest-ImageQuotaTest-368475053-system-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:55.388884 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3556/7115] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:54 2022] DELETE /identity/v3/projects/b60c5972aa634146919d19718905409c => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:55.390413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a59d1e6-85d9-4e51-93f9-118e0dd60d07 None tempest-ImageQuotaTest-368475053-system-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:55.512251 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:55.532962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a59d1e6-85d9-4e51-93f9-118e0dd60d07 None tempest-ImageQuotaTest-368475053-system-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:55.545671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:55.548678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:55.552635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:55.553620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:55.554163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:55.554683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] PATH_INFO: `/v3/users/28ed5df4fffc496ea003f99716662d81` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:55.556883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=28ed5df4fffc496ea003f99716662d81)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:55.559738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:55.587172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6244c99a-d0f3-46ce-85e0-e5bd1e33b77f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:55.598075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:55.599048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:55.599518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:55.599978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] PATH_INFO: `/v3/projects/92039ac1fd8a42fe8d4f33c0da304c8e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:55.601396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92039ac1fd8a42fe8d4f33c0da304c8e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:55.603387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:55.631880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28ed5df4fffc496ea003f99716662d81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.664959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28ed5df4fffc496ea003f99716662d81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.666861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28ed5df4fffc496ea003f99716662d81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.684573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28ed5df4fffc496ea003f99716662d81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.691486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92039ac1fd8a42fe8d4f33c0da304c8e', 'request_id': 'req-bbcdd1e3-801a-4239-8a6f-670040ba4e95'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.701477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-344c4449-28c5-477b-88eb-f28d4515d9ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28ed5df4fffc496ea003f99716662d81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.705145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92039ac1fd8a42fe8d4f33c0da304c8e', 'request_id': 'req-bbcdd1e3-801a-4239-8a6f-670040ba4e95'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.709606 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3560/7116] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:24:55 2022] DELETE /identity/v3/users/28ed5df4fffc496ea003f99716662d81 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:55.725088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92039ac1fd8a42fe8d4f33c0da304c8e', 'request_id': 'req-bbcdd1e3-801a-4239-8a6f-670040ba4e95'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.753644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] The token cache is being invalidate because project 92039ac1fd8a42fe8d4f33c0da304c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:55.754383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.755340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bbcdd1e3-801a-4239-8a6f-670040ba4e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:55.761860 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3557/7117] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:55 2022] DELETE /identity/v3/projects/92039ac1fd8a42fe8d4f33c0da304c8e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:55.763179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134afb14-e775-4ee1-9c02-967ecc2fc7c4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:55.763481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134afb14-e775-4ee1-9c02-967ecc2fc7c4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:55.763763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134afb14-e775-4ee1-9c02-967ecc2fc7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:55.793444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-134afb14-e775-4ee1-9c02-967ecc2fc7c4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:55.795235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-134afb14-e775-4ee1-9c02-967ecc2fc7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:55.904761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385fd8b-22f2-4549-a7da-22a32cf09b32 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:55.905056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385fd8b-22f2-4549-a7da-22a32cf09b32 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:55.907903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d385fd8b-22f2-4549-a7da-22a32cf09b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:55.918054 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3561/7118] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:55.942688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d385fd8b-22f2-4549-a7da-22a32cf09b32 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:55.948197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d385fd8b-22f2-4549-a7da-22a32cf09b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:55.978575 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3558/7119] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:55.984025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134afb14-e775-4ee1-9c02-967ecc2fc7c4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:56.000345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134afb14-e775-4ee1-9c02-967ecc2fc7c4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:56.008141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272404e-6596-40be-bfa5-d82b9c73e65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:56.008759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272404e-6596-40be-bfa5-d82b9c73e65a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:56.009039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272404e-6596-40be-bfa5-d82b9c73e65a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:56.009361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d272404e-6596-40be-bfa5-d82b9c73e65a admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:56.010639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272404e-6596-40be-bfa5-d82b9c73e65a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:56.010953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272404e-6596-40be-bfa5-d82b9c73e65a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:56.034926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d272404e-6596-40be-bfa5-d82b9c73e65a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:56.060374 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3562/7120] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:24:56.061948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385fd8b-22f2-4549-a7da-22a32cf09b32 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:56.076781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d385fd8b-22f2-4549-a7da-22a32cf09b32 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:56.092082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b562f4-4475-4fd4-af21-891025b098ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:56.092781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b562f4-4475-4fd4-af21-891025b098ac admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:56.092996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b562f4-4475-4fd4-af21-891025b098ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:56.094065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b562f4-4475-4fd4-af21-891025b098ac admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:56.095240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b562f4-4475-4fd4-af21-891025b098ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:56.100654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b562f4-4475-4fd4-af21-891025b098ac admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:56.161217 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3559/7121] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:56 2022] POST /identity/v3/projects => generated 377 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:56.162631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272404e-6596-40be-bfa5-d82b9c73e65a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:56.188058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d272404e-6596-40be-bfa5-d82b9c73e65a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:56.287083 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:56.331186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaccbc-1d71-4313-9b33-21fc8bfa054a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:56.333841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaccbc-1d71-4313-9b33-21fc8bfa054a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:56.334759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaccbc-1d71-4313-9b33-21fc8bfa054a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:56.335833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eaccbc-1d71-4313-9b33-21fc8bfa054a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:56.340087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaccbc-1d71-4313-9b33-21fc8bfa054a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:56.346336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eaccbc-1d71-4313-9b33-21fc8bfa054a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:56.393971 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3563/7122] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:56 2022] POST /identity/v3/users => generated 289 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:56.396048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b562f4-4475-4fd4-af21-891025b098ac admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:56.409798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b562f4-4475-4fd4-af21-891025b098ac admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:56.426635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f4c7e-07f0-4cbd-8552-3e811ed1467c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:56.427632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f4c7e-07f0-4cbd-8552-3e811ed1467c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:56.429559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f4c7e-07f0-4cbd-8552-3e811ed1467c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:56.429559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8f4c7e-07f0-4cbd-8552-3e811ed1467c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:56.431957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f4c7e-07f0-4cbd-8552-3e811ed1467c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:56.436268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8f4c7e-07f0-4cbd-8552-3e811ed1467c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:56.459073 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3560/7123] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:56.463111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaccbc-1d71-4313-9b33-21fc8bfa054a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:56.496564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eaccbc-1d71-4313-9b33-21fc8bfa054a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:56.512591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330400d5-e74d-4f4f-a432-66ec78a2a93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:56.513508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330400d5-e74d-4f4f-a432-66ec78a2a93c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:56.513970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330400d5-e74d-4f4f-a432-66ec78a2a93c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:56.514417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330400d5-e74d-4f4f-a432-66ec78a2a93c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:56.515441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330400d5-e74d-4f4f-a432-66ec78a2a93c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:56.517229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330400d5-e74d-4f4f-a432-66ec78a2a93c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:56.541780 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3564/7124] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:56.546414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f4c7e-07f0-4cbd-8552-3e811ed1467c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:56.561534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8f4c7e-07f0-4cbd-8552-3e811ed1467c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:56.576547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f8b6-35a8-40f7-9bf1-66e4e3d99d39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:56.577432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f8b6-35a8-40f7-9bf1-66e4e3d99d39 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:56.578000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f8b6-35a8-40f7-9bf1-66e4e3d99d39 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:56.578388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a275f8b6-35a8-40f7-9bf1-66e4e3d99d39 admin admin] PATH_INFO: `/v3/projects/b8ad472b3f164622b7eda861797cd7a2/users/333d72041d3f496bb443d1bb5cc48c87/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:56.616094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275f8b6-35a8-40f7-9bf1-66e4e3d99d39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8ad472b3f164622b7eda861797cd7a2, user_id=333d72041d3f496bb443d1bb5cc48c87, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:56.625288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a275f8b6-35a8-40f7-9bf1-66e4e3d99d39 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:56.647888 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3561/7125] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:56 2022] PUT /identity/v3/projects/b8ad472b3f164622b7eda861797cd7a2/users/333d72041d3f496bb443d1bb5cc48c87/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:56.660275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689027e1-66d8-4d8f-a9d0-626f4938b66b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:56.660540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689027e1-66d8-4d8f-a9d0-626f4938b66b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:56.661360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689027e1-66d8-4d8f-a9d0-626f4938b66b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:56.731979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-689027e1-66d8-4d8f-a9d0-626f4938b66b None None] MFA Rules not processed for user `333d72041d3f496bb443d1bb5cc48c87`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:56.733249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-689027e1-66d8-4d8f-a9d0-626f4938b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:56.888389 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3565/7126] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:56.892881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f8b6-35a8-40f7-9bf1-66e4e3d99d39 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:56.961440 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=82,keystone:DELETE=14,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:57.053889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a275f8b6-35a8-40f7-9bf1-66e4e3d99d39 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:57.062943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab2473-f713-4cf3-9a36-07b6b0f9d2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:57.063779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab2473-f713-4cf3-9a36-07b6b0f9d2e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:57.064107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab2473-f713-4cf3-9a36-07b6b0f9d2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:57.064228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aab2473-f713-4cf3-9a36-07b6b0f9d2e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:57.064936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab2473-f713-4cf3-9a36-07b6b0f9d2e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:57.067019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aab2473-f713-4cf3-9a36-07b6b0f9d2e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:57.124342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689027e1-66d8-4d8f-a9d0-626f4938b66b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:57.126625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-689027e1-66d8-4d8f-a9d0-626f4938b66b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:57.140121 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3562/7127] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:56 2022] POST /identity/v3/projects => generated 379 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:57.142422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab2473-f713-4cf3-9a36-07b6b0f9d2e8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:57.164193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689027e1-66d8-4d8f-a9d0-626f4938b66b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:57.289467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aab2473-f713-4cf3-9a36-07b6b0f9d2e8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:57.297558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886654-0919-48eb-8900-a9c6000c1597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:57.298199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886654-0919-48eb-8900-a9c6000c1597 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:57.298456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886654-0919-48eb-8900-a9c6000c1597 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:57.298733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f886654-0919-48eb-8900-a9c6000c1597 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:57.299417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f886654-0919-48eb-8900-a9c6000c1597 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:57.301559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f886654-0919-48eb-8900-a9c6000c1597 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:57.341720 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3563/7128] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:57 2022] POST /identity/v3/users => generated 290 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:57.346939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886654-0919-48eb-8900-a9c6000c1597 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:57.373587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f886654-0919-48eb-8900-a9c6000c1597 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:57.388253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:57.389213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf4ea0-f5c7-4bec-ac69-b36df9e91e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:57.390179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:57.391062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf4ea0-f5c7-4bec-ac69-b36df9e91e4b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:57.391564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:57.392304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf4ea0-f5c7-4bec-ac69-b36df9e91e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:57.392799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] PATH_INFO: `/v3/projects/ee9f6b036ab345b8a597eb483c2e5737` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:57.393272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbf4ea0-f5c7-4bec-ac69-b36df9e91e4b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:57.394357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf4ea0-f5c7-4bec-ac69-b36df9e91e4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:57.396767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee9f6b036ab345b8a597eb483c2e5737)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:57.397876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbf4ea0-f5c7-4bec-ac69-b36df9e91e4b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:57.398736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:57.412283 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3564/7129] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:57.415839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf4ea0-f5c7-4bec-ac69-b36df9e91e4b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:57.448166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbf4ea0-f5c7-4bec-ac69-b36df9e91e4b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:57.454350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2654c8-1c99-43e5-91b0-06fd3b06dc84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:57.455326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2654c8-1c99-43e5-91b0-06fd3b06dc84 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:57.455993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2654c8-1c99-43e5-91b0-06fd3b06dc84 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:57.456490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2654c8-1c99-43e5-91b0-06fd3b06dc84 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:57.457523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2654c8-1c99-43e5-91b0-06fd3b06dc84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:57.459759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2654c8-1c99-43e5-91b0-06fd3b06dc84 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:57.489165 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3565/7130] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:57 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:57.493139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2654c8-1c99-43e5-91b0-06fd3b06dc84 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:57.507746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2654c8-1c99-43e5-91b0-06fd3b06dc84 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:57.516172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990e29e-7342-4c1a-9e26-dba32b30f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:57.517472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990e29e-7342-4c1a-9e26-dba32b30f94e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:57.517977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990e29e-7342-4c1a-9e26-dba32b30f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:57.519980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990e29e-7342-4c1a-9e26-dba32b30f94e admin admin] PATH_INFO: `/v3/projects/1197971126ed474d8e0402c926966015/users/3f22c33058cc4a6ca41f9e7fcee974ec/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:57.555458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990e29e-7342-4c1a-9e26-dba32b30f94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1197971126ed474d8e0402c926966015, user_id=3f22c33058cc4a6ca41f9e7fcee974ec, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:57.561638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990e29e-7342-4c1a-9e26-dba32b30f94e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:57.675760 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3566/7131] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:57 2022] PUT /identity/v3/projects/1197971126ed474d8e0402c926966015/users/3f22c33058cc4a6ca41f9e7fcee974ec/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:57.826893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ac09-4f86-411c-9fe9-55905c97053c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:57.827306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ac09-4f86-411c-9fe9-55905c97053c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:57.828168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77ac09-4f86-411c-9fe9-55905c97053c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:57.861443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2e77ac09-4f86-411c-9fe9-55905c97053c None None] MFA Rules not processed for user `3f22c33058cc4a6ca41f9e7fcee974ec`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:57.862945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e77ac09-4f86-411c-9fe9-55905c97053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:57.901425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee9f6b036ab345b8a597eb483c2e5737', 'request_id': 'req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:57.912973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee9f6b036ab345b8a597eb483c2e5737', 'request_id': 'req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:57.929660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee9f6b036ab345b8a597eb483c2e5737', 'request_id': 'req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:57.932346 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=4,keystone:DELETE=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:57.956901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] The token cache is being invalidate because project ee9f6b036ab345b8a597eb483c2e5737 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:24:57.958357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:57.959877 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:57.960041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-433957ce-596f-4ce0-a8d2-b4aa69a69bfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:24:57.961705 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3566/7132] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:24:57 2022] DELETE /identity/v3/projects/ee9f6b036ab345b8a597eb483c2e5737 => generated 0 bytes in 838 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:24:57.966678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3da7-e5ea-4ca0-977e-d3a8d68863d7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:57.967042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3da7-e5ea-4ca0-977e-d3a8d68863d7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:57.969015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82de3da7-e5ea-4ca0-977e-d3a8d68863d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.014759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-82de3da7-e5ea-4ca0-977e-d3a8d68863d7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:58.016173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82de3da7-e5ea-4ca0-977e-d3a8d68863d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:58.019054 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3567/7133] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:57 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:58.025005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ac09-4f86-411c-9fe9-55905c97053c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.029427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2e77ac09-4f86-411c-9fe9-55905c97053c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:58.201038 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3567/7134] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:58.209384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ae0a-1f32-40de-948e-b54dd9591762 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.209725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ae0a-1f32-40de-948e-b54dd9591762 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.209941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f5ae0a-1f32-40de-948e-b54dd9591762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.226411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77ac09-4f86-411c-9fe9-55905c97053c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.241232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82fb39-b820-4f21-9fd3-b2231d168294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:58.241887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82fb39-b820-4f21-9fd3-b2231d168294 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.242448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82fb39-b820-4f21-9fd3-b2231d168294 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.242733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82fb39-b820-4f21-9fd3-b2231d168294 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.243383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82fb39-b820-4f21-9fd3-b2231d168294 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:58.246614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-49f5ae0a-1f32-40de-948e-b54dd9591762 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:58.248087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-49f5ae0a-1f32-40de-948e-b54dd9591762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:58.248857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82fb39-b820-4f21-9fd3-b2231d168294 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:58.279630 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3568/7135] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:58.282917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ae0a-1f32-40de-948e-b54dd9591762 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.296050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f5ae0a-1f32-40de-948e-b54dd9591762 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.314627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbc1c3-b641-49b8-85c3-95ba90ff7e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:58.314627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbc1c3-b641-49b8-85c3-95ba90ff7e5c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.315068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbc1c3-b641-49b8-85c3-95ba90ff7e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.315353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fbc1c3-b641-49b8-85c3-95ba90ff7e5c admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.315497 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3568/7136] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:58 2022] POST /identity/v3/projects => generated 379 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:58.317209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbc1c3-b641-49b8-85c3-95ba90ff7e5c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:24:58.317209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbc1c3-b641-49b8-85c3-95ba90ff7e5c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:58.317505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82fb39-b820-4f21-9fd3-b2231d168294 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.317931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fbc1c3-b641-49b8-85c3-95ba90ff7e5c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:58.356231 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3569/7137] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:24:58.357247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbc1c3-b641-49b8-85c3-95ba90ff7e5c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.376529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fbc1c3-b641-49b8-85c3-95ba90ff7e5c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.409064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82fb39-b820-4f21-9fd3-b2231d168294 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.414974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701497ac-d866-40bc-a6a6-302e5683e642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:58.415913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701497ac-d866-40bc-a6a6-302e5683e642 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.416056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701497ac-d866-40bc-a6a6-302e5683e642 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.416221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701497ac-d866-40bc-a6a6-302e5683e642 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.416976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701497ac-d866-40bc-a6a6-302e5683e642 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:58.419349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701497ac-d866-40bc-a6a6-302e5683e642 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:58.460981 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3569/7138] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:58 2022] POST /identity/v3/users => generated 296 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:58.467480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701497ac-d866-40bc-a6a6-302e5683e642 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.484531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701497ac-d866-40bc-a6a6-302e5683e642 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.490220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b31f0c-b900-4c5a-a871-d32a3532cd66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:58.491627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b31f0c-b900-4c5a-a871-d32a3532cd66 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.492090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b31f0c-b900-4c5a-a871-d32a3532cd66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.492677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b31f0c-b900-4c5a-a871-d32a3532cd66 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.493720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b31f0c-b900-4c5a-a871-d32a3532cd66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:58.495585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b31f0c-b900-4c5a-a871-d32a3532cd66 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:58.528788 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3570/7139] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:58.533038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b31f0c-b900-4c5a-a871-d32a3532cd66 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.547363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69437212-3d5d-484b-b2ef-8b0030fb44eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:58.549559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69437212-3d5d-484b-b2ef-8b0030fb44eb admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.549850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69437212-3d5d-484b-b2ef-8b0030fb44eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.550994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69437212-3d5d-484b-b2ef-8b0030fb44eb admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.553514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69437212-3d5d-484b-b2ef-8b0030fb44eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:58.555764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69437212-3d5d-484b-b2ef-8b0030fb44eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:58.565618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b31f0c-b900-4c5a-a871-d32a3532cd66 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.577198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12050be7-7d94-42b5-83aa-82f0f2eee8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:58.579117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12050be7-7d94-42b5-83aa-82f0f2eee8fd admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.579404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12050be7-7d94-42b5-83aa-82f0f2eee8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.580790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12050be7-7d94-42b5-83aa-82f0f2eee8fd admin admin] PATH_INFO: `/v3/projects/fd66b231006f464784faa548bd2a9d63/users/6aa939b6798f49e7b24e8e9cbbcd59d1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.628863 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3570/7140] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:24:58 2022] POST /identity/v3/projects => generated 387 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:58.629195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12050be7-7d94-42b5-83aa-82f0f2eee8fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd66b231006f464784faa548bd2a9d63, user_id=6aa939b6798f49e7b24e8e9cbbcd59d1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:58.633530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69437212-3d5d-484b-b2ef-8b0030fb44eb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.634442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12050be7-7d94-42b5-83aa-82f0f2eee8fd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:58.666548 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3571/7141] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:58 2022] PUT /identity/v3/projects/fd66b231006f464784faa548bd2a9d63/users/6aa939b6798f49e7b24e8e9cbbcd59d1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:58.670491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12050be7-7d94-42b5-83aa-82f0f2eee8fd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.709289 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:58.776042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12050be7-7d94-42b5-83aa-82f0f2eee8fd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.782975 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:58.787106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659461c-e7ae-4969-afbf-bea40a0b148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:58.788170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659461c-e7ae-4969-afbf-bea40a0b148d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.788460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659461c-e7ae-4969-afbf-bea40a0b148d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.788739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8659461c-e7ae-4969-afbf-bea40a0b148d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.789430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659461c-e7ae-4969-afbf-bea40a0b148d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:58.791878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8659461c-e7ae-4969-afbf-bea40a0b148d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:58.792246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69437212-3d5d-484b-b2ef-8b0030fb44eb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.809873 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3572/7142] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:58.813966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a52afa-ebd6-4276-8fff-3607f38b6669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:58.814163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659461c-e7ae-4969-afbf-bea40a0b148d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.814913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a52afa-ebd6-4276-8fff-3607f38b6669 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.815267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a52afa-ebd6-4276-8fff-3607f38b6669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.815610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a52afa-ebd6-4276-8fff-3607f38b6669 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.816321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a52afa-ebd6-4276-8fff-3607f38b6669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:58.818653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a52afa-ebd6-4276-8fff-3607f38b6669 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:58.835721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8659461c-e7ae-4969-afbf-bea40a0b148d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.861435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2046acad-7cc3-43d5-87ba-ac6e371493d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:58.863160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046acad-7cc3-43d5-87ba-ac6e371493d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.863589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046acad-7cc3-43d5-87ba-ac6e371493d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.864035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2046acad-7cc3-43d5-87ba-ac6e371493d0 admin admin] PATH_INFO: `/v3/projects/fd66b231006f464784faa548bd2a9d63/users/6aa939b6798f49e7b24e8e9cbbcd59d1/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.867644 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3571/7143] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:24:58 2022] POST /identity/v3/users => generated 294 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:24:58.872373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a52afa-ebd6-4276-8fff-3607f38b6669 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:58.875282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046acad-7cc3-43d5-87ba-ac6e371493d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd66b231006f464784faa548bd2a9d63, user_id=6aa939b6798f49e7b24e8e9cbbcd59d1, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:58.883786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2046acad-7cc3-43d5-87ba-ac6e371493d0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:58.916164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a52afa-ebd6-4276-8fff-3607f38b6669 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:58.917283 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3573/7144] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:58 2022] PUT /identity/v3/projects/fd66b231006f464784faa548bd2a9d63/users/6aa939b6798f49e7b24e8e9cbbcd59d1/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:58.928214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc369fdb-bb63-4b1e-938e-700732928657 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:58.928504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc369fdb-bb63-4b1e-938e-700732928657 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:58.928787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc369fdb-bb63-4b1e-938e-700732928657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:58.991680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bc369fdb-bb63-4b1e-938e-700732928657 None None] MFA Rules not processed for user `6aa939b6798f49e7b24e8e9cbbcd59d1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:58.992936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc369fdb-bb63-4b1e-938e-700732928657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:59.128639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e2c88-458f-44f4-9a0b-5ffd4c973134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:59.136910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e2c88-458f-44f4-9a0b-5ffd4c973134 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:59.137807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e2c88-458f-44f4-9a0b-5ffd4c973134 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:59.137807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20e2c88-458f-44f4-9a0b-5ffd4c973134 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:59.142189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e2c88-458f-44f4-9a0b-5ffd4c973134 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:59.147544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20e2c88-458f-44f4-9a0b-5ffd4c973134 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:59.177446 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3572/7145] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:59.178652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e2c88-458f-44f4-9a0b-5ffd4c973134 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:59.203807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20e2c88-458f-44f4-9a0b-5ffd4c973134 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:59.211819 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3574/7146] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:58 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:59.224332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc369fdb-bb63-4b1e-938e-700732928657 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:59.225789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18cca8-6050-4927-ae12-1399d991ddee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:59.225986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc369fdb-bb63-4b1e-938e-700732928657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:59.226486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18cca8-6050-4927-ae12-1399d991ddee admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:59.226774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18cca8-6050-4927-ae12-1399d991ddee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:59.227048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d18cca8-6050-4927-ae12-1399d991ddee admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:59.228653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18cca8-6050-4927-ae12-1399d991ddee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:59.231103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d18cca8-6050-4927-ae12-1399d991ddee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:59.256850 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3573/7147] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:24:59 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:24:59.258863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18cca8-6050-4927-ae12-1399d991ddee admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:59.274276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d18cca8-6050-4927-ae12-1399d991ddee admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:59.282710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c21fa-79ae-4e56-b5cf-0a8ae6241c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:59.283315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c21fa-79ae-4e56-b5cf-0a8ae6241c5f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:59.283548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c21fa-79ae-4e56-b5cf-0a8ae6241c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:59.283834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c21fa-79ae-4e56-b5cf-0a8ae6241c5f admin admin] PATH_INFO: `/v3/projects/0bf614ac20954d5f9e42678fefa5c8c5/users/0f6882e80bb9481e876265edbe0352b7/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:59.316508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c21fa-79ae-4e56-b5cf-0a8ae6241c5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bf614ac20954d5f9e42678fefa5c8c5, user_id=0f6882e80bb9481e876265edbe0352b7, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:59.319462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c21fa-79ae-4e56-b5cf-0a8ae6241c5f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:59.344652 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3574/7148] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:24:59 2022] PUT /identity/v3/projects/0bf614ac20954d5f9e42678fefa5c8c5/users/0f6882e80bb9481e876265edbe0352b7/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:24:59.345047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc369fdb-bb63-4b1e-938e-700732928657 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:59.347033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa6c31-7760-4e9e-b45a-233127074e99 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:59.347431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa6c31-7760-4e9e-b45a-233127074e99 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:59.347710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14aa6c31-7760-4e9e-b45a-233127074e99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:59.393610 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:59.401233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafe6c8-81cb-411d-bdc5-7e40a631edf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:59.402374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafe6c8-81cb-411d-bdc5-7e40a631edf1 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:59.403494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-14aa6c31-7760-4e9e-b45a-233127074e99 None None] MFA Rules not processed for user `0f6882e80bb9481e876265edbe0352b7`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:24:59.404277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafe6c8-81cb-411d-bdc5-7e40a631edf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:59.404566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bafe6c8-81cb-411d-bdc5-7e40a631edf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:59.406239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-14aa6c31-7760-4e9e-b45a-233127074e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:59.486990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafe6c8-81cb-411d-bdc5-7e40a631edf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:59.488747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bafe6c8-81cb-411d-bdc5-7e40a631edf1 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:59.522375 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3575/7149] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:59.530318 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3575/7150] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:24:59 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:24:59.544468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafe6c8-81cb-411d-bdc5-7e40a631edf1 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:59.546008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8bafe6c8-81cb-411d-bdc5-7e40a631edf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:59.603765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa6c31-7760-4e9e-b45a-233127074e99 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:24:59.607614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-14aa6c31-7760-4e9e-b45a-233127074e99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:59.638224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14aa6c31-7760-4e9e-b45a-233127074e99 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:59.649770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:59.650515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:59.650996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:59.651529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:59.656658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:24:59.702647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bafe6c8-81cb-411d-bdc5-7e40a631edf1 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:24:59.708446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d950ba0d-af8a-45c4-bdde-aed4d6104000 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:24:59.709235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ba0d-af8a-45c4-bdde-aed4d6104000 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:24:59.709830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ba0d-af8a-45c4-bdde-aed4d6104000 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:24:59.710211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d950ba0d-af8a-45c4-bdde-aed4d6104000 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:24:59.734649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950ba0d-af8a-45c4-bdde-aed4d6104000 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:59.737426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d950ba0d-af8a-45c4-bdde-aed4d6104000 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:59.758432 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3576/7151] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:59 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:24:59.774567 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:24:59.851141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:24:59.853762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:24:59.905743 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3576/7152] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:24:59 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:00.063233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026094cb-75fd-4e33-8f79-ebb9884a89da None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:00.063665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026094cb-75fd-4e33-8f79-ebb9884a89da None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:00.063963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026094cb-75fd-4e33-8f79-ebb9884a89da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:00.120700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-026094cb-75fd-4e33-8f79-ebb9884a89da None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:00.130391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-026094cb-75fd-4e33-8f79-ebb9884a89da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:00.296906 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3577/7153] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:25:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:00.394264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:00.396542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:00.620809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd835ad2-4dd0-4063-9999-553ceb14edb9 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:00.633102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fff1d5-ffda-4cf1-9a0c-423684f58900 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:00.634342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fff1d5-ffda-4cf1-9a0c-423684f58900 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:00.634875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fff1d5-ffda-4cf1-9a0c-423684f58900 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:00.635584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fff1d5-ffda-4cf1-9a0c-423684f58900 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:00.648464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fff1d5-ffda-4cf1-9a0c-423684f58900 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:00.650539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19fff1d5-ffda-4cf1-9a0c-423684f58900 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:00.665824 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3577/7154] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:25:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:25:01.417111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55afc2-d95d-4505-a973-b69645ce4b1f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:01.418354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55afc2-d95d-4505-a973-b69645ce4b1f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:01.418817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b55afc2-d95d-4505-a973-b69645ce4b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:01.460307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1b55afc2-d95d-4505-a973-b69645ce4b1f None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:01.466188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1b55afc2-d95d-4505-a973-b69645ce4b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:01.492617 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3578/7155] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:25:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:25:01.510509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fff1d5-ffda-4cf1-9a0c-423684f58900 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:01.530484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fff1d5-ffda-4cf1-9a0c-423684f58900 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:01.543137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62812303-22cf-4358-8a87-fb49aa6124cc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:01.544165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62812303-22cf-4358-8a87-fb49aa6124cc service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:01.544700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62812303-22cf-4358-8a87-fb49aa6124cc service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:01.545209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62812303-22cf-4358-8a87-fb49aa6124cc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:01.570320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62812303-22cf-4358-8a87-fb49aa6124cc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:01.571964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62812303-22cf-4358-8a87-fb49aa6124cc service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:01.594087 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3578/7156] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:25:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:25:02.264252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa904-6da6-4ef4-89f5-60aed78ffc4b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:02.264809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa904-6da6-4ef4-89f5-60aed78ffc4b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:02.265865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa904-6da6-4ef4-89f5-60aed78ffc4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:02.301364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7a5fa904-6da6-4ef4-89f5-60aed78ffc4b None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:02.305140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7a5fa904-6da6-4ef4-89f5-60aed78ffc4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:02.327179 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3579/7157] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:25:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:02.346208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62812303-22cf-4358-8a87-fb49aa6124cc service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:02.375194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62812303-22cf-4358-8a87-fb49aa6124cc service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:02.406047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4d23-9e0f-4760-b5d0-c21c3ec86e7e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:02.411470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4d23-9e0f-4760-b5d0-c21c3ec86e7e service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:02.413928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4d23-9e0f-4760-b5d0-c21c3ec86e7e service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:02.414481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b4d23-9e0f-4760-b5d0-c21c3ec86e7e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:02.456598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b4d23-9e0f-4760-b5d0-c21c3ec86e7e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:02.458274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b4d23-9e0f-4760-b5d0-c21c3ec86e7e service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:02.484976 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3579/7158] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:25:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:25:02.765977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81501-0b38-438f-b72c-d3cdf58fd9eb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:02.766539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81501-0b38-438f-b72c-d3cdf58fd9eb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:02.766539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed81501-0b38-438f-b72c-d3cdf58fd9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:02.803556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3ed81501-0b38-438f-b72c-d3cdf58fd9eb None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:02.805096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3ed81501-0b38-438f-b72c-d3cdf58fd9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:02.828458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3580/7159] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:25:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:02.849585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4d23-9e0f-4760-b5d0-c21c3ec86e7e service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:02.868539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b4d23-9e0f-4760-b5d0-c21c3ec86e7e service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:02.894305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f238-5ebb-49ee-b490-0d9896a9bd15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:02.894932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f238-5ebb-49ee-b490-0d9896a9bd15 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:02.895264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f238-5ebb-49ee-b490-0d9896a9bd15 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:02.895713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a4f238-5ebb-49ee-b490-0d9896a9bd15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:02.908685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4f238-5ebb-49ee-b490-0d9896a9bd15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:02.911522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a4f238-5ebb-49ee-b490-0d9896a9bd15 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:02.940728 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3580/7160] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:25:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:25:03.821226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bbdff-3e03-4375-ae86-0cde445dbfe1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:03.825467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bbdff-3e03-4375-ae86-0cde445dbfe1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:03.828426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916bbdff-3e03-4375-ae86-0cde445dbfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:03.935506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-916bbdff-3e03-4375-ae86-0cde445dbfe1 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:03.937541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-916bbdff-3e03-4375-ae86-0cde445dbfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:03.961062 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3581/7161] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:25:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:03.974314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f238-5ebb-49ee-b490-0d9896a9bd15 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:03.996106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a4f238-5ebb-49ee-b490-0d9896a9bd15 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:04.026213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d0226-de91-4ea9-a118-1fe0ac628ec1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:04.027013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d0226-de91-4ea9-a118-1fe0ac628ec1 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:04.027299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d0226-de91-4ea9-a118-1fe0ac628ec1 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:04.027584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d0226-de91-4ea9-a118-1fe0ac628ec1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:04.075172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d0226-de91-4ea9-a118-1fe0ac628ec1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:04.077104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72d0226-de91-4ea9-a118-1fe0ac628ec1 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:04.106444 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3581/7162] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:25:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:25:04.477184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cf4dc-ea22-4853-9c24-3e2e32f6384e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:04.477523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cf4dc-ea22-4853-9c24-3e2e32f6384e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:04.477782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75cf4dc-ea22-4853-9c24-3e2e32f6384e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:04.521767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f75cf4dc-ea22-4853-9c24-3e2e32f6384e None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:04.523530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f75cf4dc-ea22-4853-9c24-3e2e32f6384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:04.554228 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3582/7163] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:25:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:04.555146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d0226-de91-4ea9-a118-1fe0ac628ec1 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:04.568667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d0226-de91-4ea9-a118-1fe0ac628ec1 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:04.586813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab63c9-1097-4b29-a33e-aeb8db8449e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:04.587384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab63c9-1097-4b29-a33e-aeb8db8449e0 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:04.587940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab63c9-1097-4b29-a33e-aeb8db8449e0 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:04.588993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab63c9-1097-4b29-a33e-aeb8db8449e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:04.626561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab63c9-1097-4b29-a33e-aeb8db8449e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:04.628459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dab63c9-1097-4b29-a33e-aeb8db8449e0 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:04.656621 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3582/7164] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:25:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:25:04.722643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cf4dc-ea22-4853-9c24-3e2e32f6384e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:04.724733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f75cf4dc-ea22-4853-9c24-3e2e32f6384e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:04.765058 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:04.861368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab63c9-1097-4b29-a33e-aeb8db8449e0 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:04.906246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75cf4dc-ea22-4853-9c24-3e2e32f6384e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:04.920849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:04.921644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:04.921922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:04.922198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] PATH_INFO: `/v3/users/a9e772b13aa441f194793eaecf668a6c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:04.923876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9e772b13aa441f194793eaecf668a6c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:04.926245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:04.994884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab63c9-1097-4b29-a33e-aeb8db8449e0 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:05.012206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:05.013741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:05.014586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:05.022649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] PATH_INFO: `/v3/users/0f6882e80bb9481e876265edbe0352b7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:05.031210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f6882e80bb9481e876265edbe0352b7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:05.036964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:05.068437 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:05.091966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9e772b13aa441f194793eaecf668a6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.125718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9e772b13aa441f194793eaecf668a6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.126796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9e772b13aa441f194793eaecf668a6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.155819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9e772b13aa441f194793eaecf668a6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.169938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9e772b13aa441f194793eaecf668a6c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.191760 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3583/7165] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:04 2022] DELETE /identity/v3/users/a9e772b13aa441f194793eaecf668a6c => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:05.193703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:05.197206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:05.224159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f6882e80bb9481e876265edbe0352b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.261242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f6882e80bb9481e876265edbe0352b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.262493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f6882e80bb9481e876265edbe0352b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.277216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f6882e80bb9481e876265edbe0352b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.301163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-93baf096-2eee-412d-a05c-6a1c8cb3c85d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f6882e80bb9481e876265edbe0352b7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:05.328907 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3583/7166] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:04 2022] DELETE /identity/v3/users/0f6882e80bb9481e876265edbe0352b7 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:05.333060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa31cc1-7a80-4e72-95c5-f9a5d8e0ec53 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:05.334252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc505a7-917e-4ad0-940a-8b417b43b971 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:05.334667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc505a7-917e-4ad0-940a-8b417b43b971 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:05.334964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc505a7-917e-4ad0-940a-8b417b43b971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:05.394630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ffc505a7-917e-4ad0-940a-8b417b43b971 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:05.401630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ffc505a7-917e-4ad0-940a-8b417b43b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:05.450788 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:05.475490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:05.477371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:05.479986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:05.481815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:05.490576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:05.521217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:05.524832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:05.557328 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3584/7167] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:05.566159 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3584/7168] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:05.606547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:05.608315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:05.637329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92a825-9b35-41c7-985d-791c67731722 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:05.650351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe729bd-14cf-461a-829e-17273502dd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:05.652646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe729bd-14cf-461a-829e-17273502dd37 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:05.652983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe729bd-14cf-461a-829e-17273502dd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:05.653269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe729bd-14cf-461a-829e-17273502dd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:05.674818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe729bd-14cf-461a-829e-17273502dd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:05.677010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe729bd-14cf-461a-829e-17273502dd37 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:05.693793 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3585/7169] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:06.170892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc505a7-917e-4ad0-940a-8b417b43b971 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:06.173596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ffc505a7-917e-4ad0-940a-8b417b43b971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:06.196035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc505a7-917e-4ad0-940a-8b417b43b971 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:06.207616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:06.208351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:06.208637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:06.208972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] PATH_INFO: `/v3/projects/aa170485aaa74cf39b3ebe23893403ad` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:06.212072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa170485aaa74cf39b3ebe23893403ad)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:06.222016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:06.268297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe729bd-14cf-461a-829e-17273502dd37 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:06.290815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe729bd-14cf-461a-829e-17273502dd37 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:06.295206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7b7e-dd08-415c-aedd-77472181120f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:06.296927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7b7e-dd08-415c-aedd-77472181120f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:06.297543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7b7e-dd08-415c-aedd-77472181120f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:06.298835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea7b7e-dd08-415c-aedd-77472181120f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:06.301060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8aea7b7e-dd08-415c-aedd-77472181120f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:06.323534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7b7e-dd08-415c-aedd-77472181120f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:06.328470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea7b7e-dd08-415c-aedd-77472181120f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:06.340954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa170485aaa74cf39b3ebe23893403ad', 'request_id': 'req-e39bb716-0959-4b78-8cca-2d54319c7670'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.364938 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3586/7170] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:06.380524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa170485aaa74cf39b3ebe23893403ad', 'request_id': 'req-e39bb716-0959-4b78-8cca-2d54319c7670'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.392174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa170485aaa74cf39b3ebe23893403ad', 'request_id': 'req-e39bb716-0959-4b78-8cca-2d54319c7670'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.419202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] The token cache is being invalidate because project aa170485aaa74cf39b3ebe23893403ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:06.420485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.422390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.425906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3585/7171] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:06 2022] DELETE /identity/v3/projects/aa170485aaa74cf39b3ebe23893403ad => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:06.429783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7b7e-dd08-415c-aedd-77472181120f service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:06.445336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea7b7e-dd08-415c-aedd-77472181120f service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:06.544062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:06.545056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:06.545478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:06.545850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] PATH_INFO: `/v3/users/58eedc93409b47ebacc0a800cc03617f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:06.548196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58eedc93409b47ebacc0a800cc03617f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:06.550757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:06.651711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58eedc93409b47ebacc0a800cc03617f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.683765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58eedc93409b47ebacc0a800cc03617f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.696681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58eedc93409b47ebacc0a800cc03617f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.714791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58eedc93409b47ebacc0a800cc03617f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.730572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ddf11e03-55a6-494c-87cc-4e238f57b2b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58eedc93409b47ebacc0a800cc03617f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:06.738631 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3587/7172] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:06 2022] DELETE /identity/v3/users/58eedc93409b47ebacc0a800cc03617f => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:06.806845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:06.808577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:06.830207 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:06.838333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39bb716-0959-4b78-8cca-2d54319c7670 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:06.978299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:06.979941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:06.980528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:06.980995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] PATH_INFO: `/v3/projects/0bf614ac20954d5f9e42678fefa5c8c5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:06.982609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bf614ac20954d5f9e42678fefa5c8c5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:06.986043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:07.189250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bf614ac20954d5f9e42678fefa5c8c5', 'request_id': 'req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:07.211513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bf614ac20954d5f9e42678fefa5c8c5', 'request_id': 'req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:07.235394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bf614ac20954d5f9e42678fefa5c8c5', 'request_id': 'req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:07.266921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] The token cache is being invalidate because project 0bf614ac20954d5f9e42678fefa5c8c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:07.267454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:07.268797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5c61c692-e5a3-4e6f-9cb6-890c01a8fb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:07.278180 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3586/7173] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:06 2022] DELETE /identity/v3/projects/0bf614ac20954d5f9e42678fefa5c8c5 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:07.279540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ac03-adc6-4f71-8141-9f790d8afb60 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:07.280003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ac03-adc6-4f71-8141-9f790d8afb60 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:07.280101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e3ac03-adc6-4f71-8141-9f790d8afb60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:07.342447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c8e3ac03-adc6-4f71-8141-9f790d8afb60 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:07.344263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8e3ac03-adc6-4f71-8141-9f790d8afb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:07.443717 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:07.554158 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3588/7174] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:07.558734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73822719-8762-42a0-b8e4-8bbf37920b5f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:07.559349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73822719-8762-42a0-b8e4-8bbf37920b5f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:07.564061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73822719-8762-42a0-b8e4-8bbf37920b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:07.605520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-73822719-8762-42a0-b8e4-8bbf37920b5f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:07.606934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-73822719-8762-42a0-b8e4-8bbf37920b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:07.637072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3ac03-adc6-4f71-8141-9f790d8afb60 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:07.637538 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3587/7175] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:07.649671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e3ac03-adc6-4f71-8141-9f790d8afb60 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:07.665358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493bfa9-4164-42a4-b723-db94d89a3ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:07.667691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493bfa9-4164-42a4-b723-db94d89a3ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:07.668148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493bfa9-4164-42a4-b723-db94d89a3ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:07.669493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0493bfa9-4164-42a4-b723-db94d89a3ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:07.673772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493bfa9-4164-42a4-b723-db94d89a3ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:07.674427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493bfa9-4164-42a4-b723-db94d89a3ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:07.676275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0493bfa9-4164-42a4-b723-db94d89a3ca6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:07.712511 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3589/7176] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:25:07.716619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73822719-8762-42a0-b8e4-8bbf37920b5f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:07.730914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73822719-8762-42a0-b8e4-8bbf37920b5f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:07.741585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f343ec-fcce-4e59-a0c5-4e79ebe23497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:07.742331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f343ec-fcce-4e59-a0c5-4e79ebe23497 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:07.742614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f343ec-fcce-4e59-a0c5-4e79ebe23497 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:07.742887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f343ec-fcce-4e59-a0c5-4e79ebe23497 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:07.743528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f343ec-fcce-4e59-a0c5-4e79ebe23497 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:07.750477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f343ec-fcce-4e59-a0c5-4e79ebe23497 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:07.837917 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3588/7177] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:07 2022] POST /identity/v3/projects => generated 363 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:07.845202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493bfa9-4164-42a4-b723-db94d89a3ca6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:07.864067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0493bfa9-4164-42a4-b723-db94d89a3ca6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:08.010349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f343ec-fcce-4e59-a0c5-4e79ebe23497 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:08.014654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c5f343ec-fcce-4e59-a0c5-4e79ebe23497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:08.015636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292dd21-a1e4-4485-8c2a-8cf8f87cbe07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:08.016281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292dd21-a1e4-4485-8c2a-8cf8f87cbe07 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.016569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292dd21-a1e4-4485-8c2a-8cf8f87cbe07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.016840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c292dd21-a1e4-4485-8c2a-8cf8f87cbe07 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.017557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292dd21-a1e4-4485-8c2a-8cf8f87cbe07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:08.021922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c292dd21-a1e4-4485-8c2a-8cf8f87cbe07 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:08.048796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f343ec-fcce-4e59-a0c5-4e79ebe23497 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:08.080317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:08.081094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.081739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.082148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] PATH_INFO: `/v3/users/31873afb6a9a43aaa870cdd33a29443e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.082792 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3590/7178] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:07 2022] POST /identity/v3/users => generated 282 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:25:08.084511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31873afb6a9a43aaa870cdd33a29443e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:08.084877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292dd21-a1e4-4485-8c2a-8cf8f87cbe07 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:08.090220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:08.104311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c292dd21-a1e4-4485-8c2a-8cf8f87cbe07 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:08.111403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8b0e4-636f-4c65-bc9b-cf5a0da982e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:08.112270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8b0e4-636f-4c65-bc9b-cf5a0da982e8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.112920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8b0e4-636f-4c65-bc9b-cf5a0da982e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.114023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c8b0e4-636f-4c65-bc9b-cf5a0da982e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.115072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8b0e4-636f-4c65-bc9b-cf5a0da982e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:08.117342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c8b0e4-636f-4c65-bc9b-cf5a0da982e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:08.135550 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3591/7179] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:08.139601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8b0e4-636f-4c65-bc9b-cf5a0da982e8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:08.152086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c8b0e4-636f-4c65-bc9b-cf5a0da982e8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:08.158089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166f307-68ce-44e7-a197-a3bd3db23fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:08.158943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166f307-68ce-44e7-a197-a3bd3db23fab admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.159392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166f307-68ce-44e7-a197-a3bd3db23fab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.159838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a166f307-68ce-44e7-a197-a3bd3db23fab admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.160928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166f307-68ce-44e7-a197-a3bd3db23fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:08.163191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a166f307-68ce-44e7-a197-a3bd3db23fab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:08.176766 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3592/7180] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:08.180775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166f307-68ce-44e7-a197-a3bd3db23fab admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:08.181426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31873afb6a9a43aaa870cdd33a29443e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.194185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a166f307-68ce-44e7-a197-a3bd3db23fab admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:08.197770 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:08.207005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5317b2d6-c8d8-47f1-ac06-637195946aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:08.208596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317b2d6-c8d8-47f1-ac06-637195946aae admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.209439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317b2d6-c8d8-47f1-ac06-637195946aae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.210863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317b2d6-c8d8-47f1-ac06-637195946aae admin admin] PATH_INFO: `/v3/projects/9938542b7d1042269f6dfbf3b3682c02/users/b792fe89bc22476495d24a66a690ce61/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.214854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31873afb6a9a43aaa870cdd33a29443e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.216557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31873afb6a9a43aaa870cdd33a29443e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.235897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31873afb6a9a43aaa870cdd33a29443e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.237139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317b2d6-c8d8-47f1-ac06-637195946aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=9938542b7d1042269f6dfbf3b3682c02, user_id=b792fe89bc22476495d24a66a690ce61, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:08.241788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5317b2d6-c8d8-47f1-ac06-637195946aae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:08.245772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9fce52c1-2bbb-484a-8cab-191b369dc632 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31873afb6a9a43aaa870cdd33a29443e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.259325 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3589/7181] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:08 2022] DELETE /identity/v3/users/31873afb6a9a43aaa870cdd33a29443e => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:08.263059 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3593/7182] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:08 2022] PUT /identity/v3/projects/9938542b7d1042269f6dfbf3b3682c02/users/b792fe89bc22476495d24a66a690ce61/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:25:08.264830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad45a4b-4d67-4483-b462-531a6eb6e618 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.265323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad45a4b-4d67-4483-b462-531a6eb6e618 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.265609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad45a4b-4d67-4483-b462-531a6eb6e618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.274855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaca1d-5a63-4ce0-b88e-6a19720462a2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.277692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaca1d-5a63-4ce0-b88e-6a19720462a2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.278385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeaca1d-5a63-4ce0-b88e-6a19720462a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.307032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3ad45a4b-4d67-4483-b462-531a6eb6e618 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:08.307864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3ad45a4b-4d67-4483-b462-531a6eb6e618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:08.326069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5eeaca1d-5a63-4ce0-b88e-6a19720462a2 None None] MFA Rules not processed for user `b792fe89bc22476495d24a66a690ce61`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:08.328234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5eeaca1d-5a63-4ce0-b88e-6a19720462a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:08.429743 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:08.465957 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3590/7183] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:08.474522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad45a4b-4d67-4483-b462-531a6eb6e618 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:08.479372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3ad45a4b-4d67-4483-b462-531a6eb6e618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:08.498550 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3594/7184] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:08 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:25:08.499615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaca1d-5a63-4ce0-b88e-6a19720462a2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:08.502044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5eeaca1d-5a63-4ce0-b88e-6a19720462a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:08.623613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad45a4b-4d67-4483-b462-531a6eb6e618 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:08.632792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eeaca1d-5a63-4ce0-b88e-6a19720462a2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:08.638030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52e351-f23e-47a2-abe6-1b4daf0cc5b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:08.638760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52e351-f23e-47a2-abe6-1b4daf0cc5b3 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.638971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52e351-f23e-47a2-abe6-1b4daf0cc5b3 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.696789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52e351-f23e-47a2-abe6-1b4daf0cc5b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.700643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656032e6-914f-4be5-b655-9379ed398609 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:08.700643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656032e6-914f-4be5-b655-9379ed398609 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.700643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656032e6-914f-4be5-b655-9379ed398609 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.700643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656032e6-914f-4be5-b655-9379ed398609 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.701215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656032e6-914f-4be5-b655-9379ed398609 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:08.701215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656032e6-914f-4be5-b655-9379ed398609 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:08.701354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52e351-f23e-47a2-abe6-1b4daf0cc5b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:08.703694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa52e351-f23e-47a2-abe6-1b4daf0cc5b3 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:08.725355 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3595/7186] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:08 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:08.728185 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3591/7186] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:08.741668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656032e6-914f-4be5-b655-9379ed398609 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:08.743880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-656032e6-914f-4be5-b655-9379ed398609 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:08.777451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656032e6-914f-4be5-b655-9379ed398609 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:08.800736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:08.801980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:08.802461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:08.803104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] PATH_INFO: `/v3/users/333d72041d3f496bb443d1bb5cc48c87` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:08.804751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=333d72041d3f496bb443d1bb5cc48c87)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:08.806953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:08.890175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '333d72041d3f496bb443d1bb5cc48c87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.923637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '333d72041d3f496bb443d1bb5cc48c87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.925409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '333d72041d3f496bb443d1bb5cc48c87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.951102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '333d72041d3f496bb443d1bb5cc48c87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.957107 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:08.977163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0177449b-9148-4fb5-b48b-3eaf986dcba2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '333d72041d3f496bb443d1bb5cc48c87'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:08.993005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52e351-f23e-47a2-abe6-1b4daf0cc5b3 service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:08.994520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa52e351-f23e-47a2-abe6-1b4daf0cc5b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:09.006703 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3592/7187] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:08 2022] DELETE /identity/v3/users/333d72041d3f496bb443d1bb5cc48c87 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:09.011493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052701d0-fdd9-47ec-81aa-8680ea9c7ad3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:09.011741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052701d0-fdd9-47ec-81aa-8680ea9c7ad3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:09.012020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052701d0-fdd9-47ec-81aa-8680ea9c7ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:09.017247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52e351-f23e-47a2-abe6-1b4daf0cc5b3 service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:09.078437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-052701d0-fdd9-47ec-81aa-8680ea9c7ad3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:09.083038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-052701d0-fdd9-47ec-81aa-8680ea9c7ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:09.179201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:09.180045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:09.180334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:09.180613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] PATH_INFO: `/v3/projects/bdbe813ada9c4de69369975d945d7f2d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:09.182659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdbe813ada9c4de69369975d945d7f2d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:09.189449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:09.215229 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3593/7188] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:09.227464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052701d0-fdd9-47ec-81aa-8680ea9c7ad3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:09.229408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-052701d0-fdd9-47ec-81aa-8680ea9c7ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:09.313039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdbe813ada9c4de69369975d945d7f2d', 'request_id': 'req-44a5dd50-a058-4fca-84ff-c2d2d68071fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.324147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdbe813ada9c4de69369975d945d7f2d', 'request_id': 'req-44a5dd50-a058-4fca-84ff-c2d2d68071fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.338824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdbe813ada9c4de69369975d945d7f2d', 'request_id': 'req-44a5dd50-a058-4fca-84ff-c2d2d68071fa'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.359979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] The token cache is being invalidate because project bdbe813ada9c4de69369975d945d7f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:09.360599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.361573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-44a5dd50-a058-4fca-84ff-c2d2d68071fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.363950 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3596/7189] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:08 2022] DELETE /identity/v3/projects/bdbe813ada9c4de69369975d945d7f2d => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:25:09.368636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c445fa5-b750-48a1-a678-3d2c6e56e644 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:09.369223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c445fa5-b750-48a1-a678-3d2c6e56e644 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:09.369643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c445fa5-b750-48a1-a678-3d2c6e56e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:09.374930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052701d0-fdd9-47ec-81aa-8680ea9c7ad3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:09.416083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0c445fa5-b750-48a1-a678-3d2c6e56e644 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:09.420324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0c445fa5-b750-48a1-a678-3d2c6e56e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:09.447958 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:09.481931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc6514-3c78-4326-a0ee-4afff8641845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:09.482549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc6514-3c78-4326-a0ee-4afff8641845 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:09.482831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc6514-3c78-4326-a0ee-4afff8641845 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:09.483108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc6514-3c78-4326-a0ee-4afff8641845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:09.485708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-69bc6514-3c78-4326-a0ee-4afff8641845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:09.528111 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3597/7190] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:09.536317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c445fa5-b750-48a1-a678-3d2c6e56e644 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:09.536317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0c445fa5-b750-48a1-a678-3d2c6e56e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:09.549276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c445fa5-b750-48a1-a678-3d2c6e56e644 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:09.555017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:09.555781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:09.556179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:09.556528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] PATH_INFO: `/v3/users/b792fe89bc22476495d24a66a690ce61` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:09.558063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b792fe89bc22476495d24a66a690ce61)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:09.560386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:09.596457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc6514-3c78-4326-a0ee-4afff8641845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:09.598273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc6514-3c78-4326-a0ee-4afff8641845 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:09.616613 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:09.630760 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3594/7191] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:09.632611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae54127-f658-427b-bc65-c33541c99d87 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:09.632905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae54127-f658-427b-bc65-c33541c99d87 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:09.633452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae54127-f658-427b-bc65-c33541c99d87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:09.678259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b792fe89bc22476495d24a66a690ce61'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.689244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2ae54127-f658-427b-bc65-c33541c99d87 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:09.691819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2ae54127-f658-427b-bc65-c33541c99d87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:09.707818 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3595/7192] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:09.712748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae54127-f658-427b-bc65-c33541c99d87 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:09.719863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b792fe89bc22476495d24a66a690ce61'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.720973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b792fe89bc22476495d24a66a690ce61'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.732590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae54127-f658-427b-bc65-c33541c99d87 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:09.741049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:09.741852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:09.742462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:09.742786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:09.743077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b792fe89bc22476495d24a66a690ce61'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.743494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:09.743799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:09.745449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:09.766060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7909b2c3-b18b-4308-8e3d-980f347b4049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b792fe89bc22476495d24a66a690ce61'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:09.771540 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3596/7193] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:09.773971 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3598/7194] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:09 2022] DELETE /identity/v3/users/b792fe89bc22476495d24a66a690ce61 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:09.777081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:09.779140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d583-fe41-4408-a41a-15a1ceeb3e80 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:09.779533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:09.779667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d583-fe41-4408-a41a-15a1ceeb3e80 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:09.780940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9d583-fe41-4408-a41a-15a1ceeb3e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:09.811786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0020d2-ae5e-42be-aae0-9e495a5c3885 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:09.818998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0be9d583-fe41-4408-a41a-15a1ceeb3e80 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:09.820732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0be9d583-fe41-4408-a41a-15a1ceeb3e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:09.932778 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3599/7195] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:09.938039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7383ee-a1d0-4c79-8b44-9f47f5a3b07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:09.938858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7383ee-a1d0-4c79-8b44-9f47f5a3b07c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:09.939285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7383ee-a1d0-4c79-8b44-9f47f5a3b07c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:09.939753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7383ee-a1d0-4c79-8b44-9f47f5a3b07c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:09.940539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7383ee-a1d0-4c79-8b44-9f47f5a3b07c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:09.942667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7383ee-a1d0-4c79-8b44-9f47f5a3b07c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:09.965092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d583-fe41-4408-a41a-15a1ceeb3e80 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:09.966946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0be9d583-fe41-4408-a41a-15a1ceeb3e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:10.003711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3597/7196] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:09 2022] POST /identity/v3/projects => generated 405 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:10.008213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7383ee-a1d0-4c79-8b44-9f47f5a3b07c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:10.089939 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:10.132546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7383ee-a1d0-4c79-8b44-9f47f5a3b07c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:10.139400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be9d583-fe41-4408-a41a-15a1ceeb3e80 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:10.139817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62ede-ee46-4e67-a8b2-dfc47fff23c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:10.140427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62ede-ee46-4e67-a8b2-dfc47fff23c2 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:10.140750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62ede-ee46-4e67-a8b2-dfc47fff23c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:10.140974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f62ede-ee46-4e67-a8b2-dfc47fff23c2 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:10.142187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62ede-ee46-4e67-a8b2-dfc47fff23c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:10.143788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f62ede-ee46-4e67-a8b2-dfc47fff23c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:10.177129 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3598/7197] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:10 2022] POST /identity/v3/users => generated 303 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:10.177129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62ede-ee46-4e67-a8b2-dfc47fff23c2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:10.180628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a6f62ede-ee46-4e67-a8b2-dfc47fff23c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:10.200931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f62ede-ee46-4e67-a8b2-dfc47fff23c2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:10.207314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:10.208725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:10.209669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:10.210153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] PATH_INFO: `/v3/projects/b8ad472b3f164622b7eda861797cd7a2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:10.211577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8ad472b3f164622b7eda861797cd7a2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:10.214147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:10.236650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6f061-d36a-4fb7-b63c-578067abe011 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:10.237402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6f061-d36a-4fb7-b63c-578067abe011 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:10.237689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6f061-d36a-4fb7-b63c-578067abe011 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:10.237964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e6f061-d36a-4fb7-b63c-578067abe011 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:10.251824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6f061-d36a-4fb7-b63c-578067abe011 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:10.253672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e6f061-d36a-4fb7-b63c-578067abe011 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:10.271437 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3600/7198] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:10.272217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6f061-d36a-4fb7-b63c-578067abe011 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:10.282367 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:10.283740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8ad472b3f164622b7eda861797cd7a2', 'request_id': 'req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.290958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e6f061-d36a-4fb7-b63c-578067abe011 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:10.293251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8ad472b3f164622b7eda861797cd7a2', 'request_id': 'req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.312751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8ad472b3f164622b7eda861797cd7a2', 'request_id': 'req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.338499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] The token cache is being invalidate because project b8ad472b3f164622b7eda861797cd7a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:10.339201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.341459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.344109 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3599/7199] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:10 2022] DELETE /identity/v3/projects/b8ad472b3f164622b7eda861797cd7a2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:10.351414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:10.353081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:10.450019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1547e-0df4-4355-935e-73ba89645e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:10.451272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1547e-0df4-4355-935e-73ba89645e3d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:10.451975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1547e-0df4-4355-935e-73ba89645e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:10.452520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1547e-0df4-4355-935e-73ba89645e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:10.453683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1547e-0df4-4355-935e-73ba89645e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:10.456234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be1547e-0df4-4355-935e-73ba89645e3d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:10.472395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fb6f1f-5d4f-4b2f-978c-ea15257b40f8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:10.478207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:10.478702 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3601/7200] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:10.479006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:10.479364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:10.479854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] PATH_INFO: `/v3/users/3f22c33058cc4a6ca41f9e7fcee974ec` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:10.480541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1547e-0df4-4355-935e-73ba89645e3d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:10.481345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f22c33058cc4a6ca41f9e7fcee974ec)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:10.482682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5be1547e-0df4-4355-935e-73ba89645e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:10.484399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:10.509762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1547e-0df4-4355-935e-73ba89645e3d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:10.516628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b56b37-40e1-451f-bd28-60b7e2a59a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:10.517571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56b37-40e1-451f-bd28-60b7e2a59a8d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:10.518041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56b37-40e1-451f-bd28-60b7e2a59a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:10.518633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b56b37-40e1-451f-bd28-60b7e2a59a8d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:10.519438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b56b37-40e1-451f-bd28-60b7e2a59a8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:10.521597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b56b37-40e1-451f-bd28-60b7e2a59a8d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:10.538959 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3602/7201] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:10.546601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b56b37-40e1-451f-bd28-60b7e2a59a8d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:10.568186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b56b37-40e1-451f-bd28-60b7e2a59a8d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:10.575791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52a2244-536a-4bc4-9305-dac842149d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:10.575791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a2244-536a-4bc4-9305-dac842149d94 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:10.576373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a2244-536a-4bc4-9305-dac842149d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:10.576738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52a2244-536a-4bc4-9305-dac842149d94 admin admin] PATH_INFO: `/v3/projects/5ada4c42222443a589432ee5bbdb7cf3/users/557c973f86dd4475b7b7511a67b5eba1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:10.598590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f22c33058cc4a6ca41f9e7fcee974ec'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.603100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a2244-536a-4bc4-9305-dac842149d94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ada4c42222443a589432ee5bbdb7cf3, user_id=557c973f86dd4475b7b7511a67b5eba1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:10.607114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52a2244-536a-4bc4-9305-dac842149d94 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:10.629941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f22c33058cc4a6ca41f9e7fcee974ec'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.637358 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3603/7202] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:10 2022] PUT /identity/v3/projects/5ada4c42222443a589432ee5bbdb7cf3/users/557c973f86dd4475b7b7511a67b5eba1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:10.638064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f22c33058cc4a6ca41f9e7fcee974ec'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.643414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48963600-c9c3-4142-8431-68dad65f7c91 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:10.644004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48963600-c9c3-4142-8431-68dad65f7c91 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:10.644454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48963600-c9c3-4142-8431-68dad65f7c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:10.660504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f22c33058cc4a6ca41f9e7fcee974ec'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.680266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f22c33058cc4a6ca41f9e7fcee974ec'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:10.694194 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3600/7203] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:10 2022] DELETE /identity/v3/users/3f22c33058cc4a6ca41f9e7fcee974ec => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:10.709348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-48963600-c9c3-4142-8431-68dad65f7c91 None None] MFA Rules not processed for user `557c973f86dd4475b7b7511a67b5eba1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:10.711774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48963600-c9c3-4142-8431-68dad65f7c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:10.800808 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:10.853783 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3604/7204] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:10 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:10.856073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:10.860356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:10.869911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48963600-c9c3-4142-8431-68dad65f7c91 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:10.869911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48963600-c9c3-4142-8431-68dad65f7c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:11.004302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48963600-c9c3-4142-8431-68dad65f7c91 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.010939 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:11.023587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.024517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.024937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.025442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] PATH_INFO: `/v3/projects/9938542b7d1042269f6dfbf3b3682c02` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.027139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9938542b7d1042269f6dfbf3b3682c02)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.030710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.033733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6f7e93-4345-4377-8583-71664646c5c0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.052953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d132f-378c-42a7-9057-a905111fc076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.053668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d132f-378c-42a7-9057-a905111fc076 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.060462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d132f-378c-42a7-9057-a905111fc076 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.060462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027d132f-378c-42a7-9057-a905111fc076 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.060462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d132f-378c-42a7-9057-a905111fc076 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.060462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027d132f-378c-42a7-9057-a905111fc076 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.123108 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3601/7205] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:10 2022] POST /identity/v3/projects => generated 405 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:11.127546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d132f-378c-42a7-9057-a905111fc076 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:11.148540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9938542b7d1042269f6dfbf3b3682c02', 'request_id': 'req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.164166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9938542b7d1042269f6dfbf3b3682c02', 'request_id': 'req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.179061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9938542b7d1042269f6dfbf3b3682c02', 'request_id': 'req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.203480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] The token cache is being invalidate because project 9938542b7d1042269f6dfbf3b3682c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:11.203849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.204857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-28df3c72-3a0c-45d8-8ce8-9dfc64142d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.207197 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3605/7206] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:10 2022] DELETE /identity/v3/projects/9938542b7d1042269f6dfbf3b3682c02 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:11.216481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dea87-8d63-4121-b547-95747373e053 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.217008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dea87-8d63-4121-b547-95747373e053 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.217313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07dea87-8d63-4121-b547-95747373e053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.258216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d07dea87-8d63-4121-b547-95747373e053 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:11.263141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d07dea87-8d63-4121-b547-95747373e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:11.308117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027d132f-378c-42a7-9057-a905111fc076 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.319978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f804c-02d4-481b-b9a1-855ea0564135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.321395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f804c-02d4-481b-b9a1-855ea0564135 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.321824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f804c-02d4-481b-b9a1-855ea0564135 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.322243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f804c-02d4-481b-b9a1-855ea0564135 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.323570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f804c-02d4-481b-b9a1-855ea0564135 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.327650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f804c-02d4-481b-b9a1-855ea0564135 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.373142 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3602/7207] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:11 2022] POST /identity/v3/users => generated 309 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:11.375735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f804c-02d4-481b-b9a1-855ea0564135 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:11.379143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e48f804c-02d4-481b-b9a1-855ea0564135 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:11.392055 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3606/7208] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:11.393843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dea87-8d63-4121-b547-95747373e053 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:11.396358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d07dea87-8d63-4121-b547-95747373e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:11.399440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f804c-02d4-481b-b9a1-855ea0564135 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.407910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.409364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.409727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.410069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] PATH_INFO: `/v3/projects/1197971126ed474d8e0402c926966015` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.411536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1197971126ed474d8e0402c926966015)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.413163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07dea87-8d63-4121-b547-95747373e053 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.415291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.419293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59edd44-25c2-489e-a6ce-8fe92e5188a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.419986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59edd44-25c2-489e-a6ce-8fe92e5188a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.420336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59edd44-25c2-489e-a6ce-8fe92e5188a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.420695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59edd44-25c2-489e-a6ce-8fe92e5188a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.421487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59edd44-25c2-489e-a6ce-8fe92e5188a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.423158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59edd44-25c2-489e-a6ce-8fe92e5188a6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.437443 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3607/7209] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:11.438996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d21c36-6f36-4edf-bab8-bfae022c52a9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.439292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d21c36-6f36-4edf-bab8-bfae022c52a9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.439571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d21c36-6f36-4edf-bab8-bfae022c52a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.450524 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:11.471668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c3d21c36-6f36-4edf-bab8-bfae022c52a9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:11.473029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c3d21c36-6f36-4edf-bab8-bfae022c52a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:11.486581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1197971126ed474d8e0402c926966015', 'request_id': 'req-2b1dba19-c7c6-4ef0-a964-8e25348c3147'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.504484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1197971126ed474d8e0402c926966015', 'request_id': 'req-2b1dba19-c7c6-4ef0-a964-8e25348c3147'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.518794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1197971126ed474d8e0402c926966015', 'request_id': 'req-2b1dba19-c7c6-4ef0-a964-8e25348c3147'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.532643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] The token cache is being invalidate because project 1197971126ed474d8e0402c926966015 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:11.532845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.533678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.537968 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3603/7210] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:11 2022] DELETE /identity/v3/projects/1197971126ed474d8e0402c926966015 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:11.538889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:11.540271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:11.581501 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3608/7211] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:11.582217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d21c36-6f36-4edf-bab8-bfae022c52a9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:11.585192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c3d21c36-6f36-4edf-bab8-bfae022c52a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:11.600564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d21c36-6f36-4edf-bab8-bfae022c52a9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.607134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.608256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.609239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.609834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] PATH_INFO: `/v3/users/6aa939b6798f49e7b24e8e9cbbcd59d1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.611886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aa939b6798f49e7b24e8e9cbbcd59d1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.615050 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:11.615933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.632238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dba19-c7c6-4ef0-a964-8e25348c3147 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.638957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d8339-6540-42e0-99ab-8976ef01d5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.639785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d8339-6540-42e0-99ab-8976ef01d5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.640128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d8339-6540-42e0-99ab-8976ef01d5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.641239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0d8339-6540-42e0-99ab-8976ef01d5b0 admin admin] PATH_INFO: `/v3/projects/5cd5e115a13245c0b8085fab773a4562/users/62ed916d1c43425f8f8d66bd89225ab6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.662537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d8339-6540-42e0-99ab-8976ef01d5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd5e115a13245c0b8085fab773a4562, user_id=62ed916d1c43425f8f8d66bd89225ab6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.667266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0d8339-6540-42e0-99ab-8976ef01d5b0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.682516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aa939b6798f49e7b24e8e9cbbcd59d1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.682827 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3604/7212] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:11 2022] PUT /identity/v3/projects/5cd5e115a13245c0b8085fab773a4562/users/62ed916d1c43425f8f8d66bd89225ab6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:11.683832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d8339-6540-42e0-99ab-8976ef01d5b0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:11.699317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aa939b6798f49e7b24e8e9cbbcd59d1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.700472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aa939b6798f49e7b24e8e9cbbcd59d1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.712003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aa939b6798f49e7b24e8e9cbbcd59d1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.720850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aa939b6798f49e7b24e8e9cbbcd59d1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:11.731225 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3609/7213] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:11 2022] DELETE /identity/v3/users/6aa939b6798f49e7b24e8e9cbbcd59d1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:11.732084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:11.734223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:11.773049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0d8339-6540-42e0-99ab-8976ef01d5b0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.851853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937958b5-6b43-45ee-9bc7-dee21e9076b8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.860586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b8eeb-7f99-4325-a1fb-62c507e81a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.861273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b8eeb-7f99-4325-a1fb-62c507e81a51 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.861676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b8eeb-7f99-4325-a1fb-62c507e81a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.862805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912b8eeb-7f99-4325-a1fb-62c507e81a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.862805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b8eeb-7f99-4325-a1fb-62c507e81a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.864781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912b8eeb-7f99-4325-a1fb-62c507e81a51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.870928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.871821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.872990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.873467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.874935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:11.875227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.877493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.880506 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3610/7214] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:11 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:11.885968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b8eeb-7f99-4325-a1fb-62c507e81a51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:11.898688 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3605/7215] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:11.902633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:11.903955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912b8eeb-7f99-4325-a1fb-62c507e81a51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.907497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:11.909875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b683b-30e5-47ea-933a-2eecfaed8626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:11.910619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b683b-30e5-47ea-933a-2eecfaed8626 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:11.910971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b683b-30e5-47ea-933a-2eecfaed8626 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:11.911324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b683b-30e5-47ea-933a-2eecfaed8626 admin admin] PATH_INFO: `/v3/projects/5cd5e115a13245c0b8085fab773a4562/users/62ed916d1c43425f8f8d66bd89225ab6/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:11.913534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b683b-30e5-47ea-933a-2eecfaed8626 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5cd5e115a13245c0b8085fab773a4562, user_id=62ed916d1c43425f8f8d66bd89225ab6, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:11.916667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607b683b-30e5-47ea-933a-2eecfaed8626 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:11.924855 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:11.929984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2ef00-a8a4-4e04-857f-61dbabe62f55 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:11.934739 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3611/7216] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:11 2022] PUT /identity/v3/projects/5cd5e115a13245c0b8085fab773a4562/users/62ed916d1c43425f8f8d66bd89225ab6/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:12.041209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876db3cf-77fb-49c0-aabb-ea0f6df51735 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.041442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876db3cf-77fb-49c0-aabb-ea0f6df51735 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.041731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876db3cf-77fb-49c0-aabb-ea0f6df51735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.087181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45587-2abe-482a-bd3e-a72fd33b27a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:12.088429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45587-2abe-482a-bd3e-a72fd33b27a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.089048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45587-2abe-482a-bd3e-a72fd33b27a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.094597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa45587-2abe-482a-bd3e-a72fd33b27a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.095983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa45587-2abe-482a-bd3e-a72fd33b27a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:12.099230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-876db3cf-77fb-49c0-aabb-ea0f6df51735 None None] MFA Rules not processed for user `62ed916d1c43425f8f8d66bd89225ab6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:12.099438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa45587-2abe-482a-bd3e-a72fd33b27a5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:12.101126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-876db3cf-77fb-49c0-aabb-ea0f6df51735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:12.163240 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3606/7217] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:11 2022] POST /identity/v3/projects => generated 359 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:25:12.168817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45587-2abe-482a-bd3e-a72fd33b27a5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:12.184501 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:12.222617 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3612/7218] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:12 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:25:12.236455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876db3cf-77fb-49c0-aabb-ea0f6df51735 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:12.238225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-876db3cf-77fb-49c0-aabb-ea0f6df51735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:12.274082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa45587-2abe-482a-bd3e-a72fd33b27a5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:12.284010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b61e3-d4d9-4eb9-91f3-fd33f69774b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:12.284654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b61e3-d4d9-4eb9-91f3-fd33f69774b3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.285513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b61e3-d4d9-4eb9-91f3-fd33f69774b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.285804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b61e3-d4d9-4eb9-91f3-fd33f69774b3 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.286461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b61e3-d4d9-4eb9-91f3-fd33f69774b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:12.288413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b61e3-d4d9-4eb9-91f3-fd33f69774b3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:12.328358 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3607/7219] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:12 2022] POST /identity/v3/users => generated 280 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:12.329339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b61e3-d4d9-4eb9-91f3-fd33f69774b3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:12.334626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c03b61e3-d4d9-4eb9-91f3-fd33f69774b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:12.347712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876db3cf-77fb-49c0-aabb-ea0f6df51735 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:12.352937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b61e3-d4d9-4eb9-91f3-fd33f69774b3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:12.358312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:12.359763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.360099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.360428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] PATH_INFO: `/v3/projects/fd66b231006f464784faa548bd2a9d63` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.361896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd66b231006f464784faa548bd2a9d63)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:12.363923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:12.432431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb75fa-88f8-441d-93df-adbdce9299cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:12.433069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb75fa-88f8-441d-93df-adbdce9299cf service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.433406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb75fa-88f8-441d-93df-adbdce9299cf service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.433686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb75fa-88f8-441d-93df-adbdce9299cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.448176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd66b231006f464784faa548bd2a9d63', 'request_id': 'req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.458485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd66b231006f464784faa548bd2a9d63', 'request_id': 'req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.472872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd66b231006f464784faa548bd2a9d63', 'request_id': 'req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.487494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] The token cache is being invalidate because project fd66b231006f464784faa548bd2a9d63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:12.487879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.488662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.494921 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3608/7220] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:12 2022] DELETE /identity/v3/projects/fd66b231006f464784faa548bd2a9d63 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:12.496466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:12.497975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:12.510731 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:12.528121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb75fa-88f8-441d-93df-adbdce9299cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:12.529649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb75fa-88f8-441d-93df-adbdce9299cf service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:12.541826 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3613/7221] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:12 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:12.543422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13f8f-356f-4242-95d2-e4dbf149dbba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.543722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13f8f-356f-4242-95d2-e4dbf149dbba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.544008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae13f8f-356f-4242-95d2-e4dbf149dbba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.568532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cae13f8f-356f-4242-95d2-e4dbf149dbba None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:12.569869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cae13f8f-356f-4242-95d2-e4dbf149dbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:12.596812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3a9f4a-e362-4b71-a7c6-c4bb6a9cf4f6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:12.602579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4dc89-5969-43bf-a352-e797c747c011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:12.603446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4dc89-5969-43bf-a352-e797c747c011 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.603782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4dc89-5969-43bf-a352-e797c747c011 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.604117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d4dc89-5969-43bf-a352-e797c747c011 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.604826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4dc89-5969-43bf-a352-e797c747c011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:12.606638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d4dc89-5969-43bf-a352-e797c747c011 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:12.625033 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3609/7222] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:12.629476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4dc89-5969-43bf-a352-e797c747c011 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:12.645532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d4dc89-5969-43bf-a352-e797c747c011 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:12.652049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456bd89-b7dd-4c72-81f3-756b91b46c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:12.652912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456bd89-b7dd-4c72-81f3-756b91b46c3d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.653383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456bd89-b7dd-4c72-81f3-756b91b46c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.653824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d456bd89-b7dd-4c72-81f3-756b91b46c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.662526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456bd89-b7dd-4c72-81f3-756b91b46c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:12.665617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d456bd89-b7dd-4c72-81f3-756b91b46c3d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:12.673360 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:12.687705 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3610/7223] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:25:12.693846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456bd89-b7dd-4c72-81f3-756b91b46c3d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:12.709055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d456bd89-b7dd-4c72-81f3-756b91b46c3d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:12.724767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1f3516-79dd-461d-8735-3adf65d4de3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:12.726768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f3516-79dd-461d-8735-3adf65d4de3b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.726768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f3516-79dd-461d-8735-3adf65d4de3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.726768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1f3516-79dd-461d-8735-3adf65d4de3b admin admin] PATH_INFO: `/v3/projects/783825833dec48ef88b65993a6de256d/users/f1312d2a52594bfb90dbe22b95861697/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.736196 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3614/7224] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:12.737252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13f8f-356f-4242-95d2-e4dbf149dbba None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:12.739430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cae13f8f-356f-4242-95d2-e4dbf149dbba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:12.746181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f3516-79dd-461d-8735-3adf65d4de3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=783825833dec48ef88b65993a6de256d, user_id=f1312d2a52594bfb90dbe22b95861697, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:12.748879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1f3516-79dd-461d-8735-3adf65d4de3b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:12.761166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae13f8f-356f-4242-95d2-e4dbf149dbba None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:12.766028 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3611/7225] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:12 2022] PUT /identity/v3/projects/783825833dec48ef88b65993a6de256d/users/f1312d2a52594bfb90dbe22b95861697/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:12.768368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d67b7-fe25-4b4c-a3bc-cb481dcf9f49 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.769367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d67b7-fe25-4b4c-a3bc-cb481dcf9f49 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.769367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d67b7-fe25-4b4c-a3bc-cb481dcf9f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.800018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-171d67b7-fe25-4b4c-a3bc-cb481dcf9f49 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:12.801324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-171d67b7-fe25-4b4c-a3bc-cb481dcf9f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:12.837327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:12.838033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.838313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.838588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] PATH_INFO: `/v3/users/557c973f86dd4475b7b7511a67b5eba1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.839920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=557c973f86dd4475b7b7511a67b5eba1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:12.841916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:12.902165 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3612/7226] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:12.903437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fb19c-0cbe-4a4e-b7c4-dfc1c85175e1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:12.903802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fb19c-0cbe-4a4e-b7c4-dfc1c85175e1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:12.904087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0fb19c-0cbe-4a4e-b7c4-dfc1c85175e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:12.913211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '557c973f86dd4475b7b7511a67b5eba1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.931190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '557c973f86dd4475b7b7511a67b5eba1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.932723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '557c973f86dd4475b7b7511a67b5eba1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.943310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '557c973f86dd4475b7b7511a67b5eba1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.946829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bb0fb19c-0cbe-4a4e-b7c4-dfc1c85175e1 None None] MFA Rules not processed for user `f1312d2a52594bfb90dbe22b95861697`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:12.948585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bb0fb19c-0cbe-4a4e-b7c4-dfc1c85175e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:12.956255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '557c973f86dd4475b7b7511a67b5eba1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:12.964298 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3615/7227] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:12 2022] DELETE /identity/v3/users/557c973f86dd4475b7b7511a67b5eba1 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:12.965409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:12.967090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:12.989120 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:13.087634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac2586d-045a-4b96-9071-10147739db1b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:13.089132 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3613/7228] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:13.091263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd636b-692b-4eb7-aea6-91abc79ab582 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.091661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd636b-692b-4eb7-aea6-91abc79ab582 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.092110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffd636b-692b-4eb7-aea6-91abc79ab582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.095021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb999eb-7ff8-428a-97c6-301108c7c455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:13.096078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb999eb-7ff8-428a-97c6-301108c7c455 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.096501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb999eb-7ff8-428a-97c6-301108c7c455 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.096977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb999eb-7ff8-428a-97c6-301108c7c455 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.099170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb999eb-7ff8-428a-97c6-301108c7c455 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:13.099749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb999eb-7ff8-428a-97c6-301108c7c455 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:13.102315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb999eb-7ff8-428a-97c6-301108c7c455 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:13.119833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bffd636b-692b-4eb7-aea6-91abc79ab582 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:13.121241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bffd636b-692b-4eb7-aea6-91abc79ab582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:13.134032 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3614/7229] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:13.135132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd636b-692b-4eb7-aea6-91abc79ab582 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.136720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bffd636b-692b-4eb7-aea6-91abc79ab582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:13.141462 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3616/7230] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:13.142452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb999eb-7ff8-428a-97c6-301108c7c455 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.162820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffd636b-692b-4eb7-aea6-91abc79ab582 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:13.166091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb999eb-7ff8-428a-97c6-301108c7c455 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:13.171583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:13.172293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.172646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.172981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] PATH_INFO: `/v3/users/f1312d2a52594bfb90dbe22b95861697` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.174340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1312d2a52594bfb90dbe22b95861697)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:13.176436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:13.182700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8e289-a9ca-45b4-a581-21b2e5fb4c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:13.183533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8e289-a9ca-45b4-a581-21b2e5fb4c6c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.184083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8e289-a9ca-45b4-a581-21b2e5fb4c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.184668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a8e289-a9ca-45b4-a581-21b2e5fb4c6c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.185803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8e289-a9ca-45b4-a581-21b2e5fb4c6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:13.188963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a8e289-a9ca-45b4-a581-21b2e5fb4c6c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:13.255398 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3617/7231] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:13 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:13.259429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8e289-a9ca-45b4-a581-21b2e5fb4c6c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.261217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c4a8e289-a9ca-45b4-a581-21b2e5fb4c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:13.265437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1312d2a52594bfb90dbe22b95861697'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:13.272483 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:13.286588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1312d2a52594bfb90dbe22b95861697'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:13.287603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1312d2a52594bfb90dbe22b95861697'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:13.321618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1312d2a52594bfb90dbe22b95861697'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:13.338958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a8e289-a9ca-45b4-a581-21b2e5fb4c6c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:13.341615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1312d2a52594bfb90dbe22b95861697'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:13.345337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be215b8a-3057-4944-8ff9-c275d25317dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:13.346327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be215b8a-3057-4944-8ff9-c275d25317dd service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.346942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be215b8a-3057-4944-8ff9-c275d25317dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.347424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be215b8a-3057-4944-8ff9-c275d25317dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.349765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-be215b8a-3057-4944-8ff9-c275d25317dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:13.351116 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3615/7232] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:13 2022] DELETE /identity/v3/users/f1312d2a52594bfb90dbe22b95861697 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:13.352098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.354095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:13.462718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be215b8a-3057-4944-8ff9-c275d25317dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:13.464535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be215b8a-3057-4944-8ff9-c275d25317dd service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:13.469834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954db4b4-18cf-4b3a-a6c3-30431469f55b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:13.476288 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3618/7233] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:13.478569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e855-17a9-4411-81a5-0dee73f7e6b7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.478865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e855-17a9-4411-81a5-0dee73f7e6b7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.479157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b62e855-17a9-4411-81a5-0dee73f7e6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.495488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce033b9-d87b-42e9-b208-e5a1d392a974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:13.496665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce033b9-d87b-42e9-b208-e5a1d392a974 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.496970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce033b9-d87b-42e9-b208-e5a1d392a974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.497245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce033b9-d87b-42e9-b208-e5a1d392a974 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.497951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce033b9-d87b-42e9-b208-e5a1d392a974 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:13.499977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce033b9-d87b-42e9-b208-e5a1d392a974 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:13.508433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3b62e855-17a9-4411-81a5-0dee73f7e6b7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:13.509970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3b62e855-17a9-4411-81a5-0dee73f7e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:13.532431 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3619/7234] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:13.538704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e855-17a9-4411-81a5-0dee73f7e6b7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.540791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3b62e855-17a9-4411-81a5-0dee73f7e6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:13.563184 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3616/7235] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:13 2022] POST /identity/v3/users => generated 292 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:13.564325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce033b9-d87b-42e9-b208-e5a1d392a974 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.584393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce033b9-d87b-42e9-b208-e5a1d392a974 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:13.592313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8425f1-0825-432a-bb04-198799658829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:13.594572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8425f1-0825-432a-bb04-198799658829 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.595560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8425f1-0825-432a-bb04-198799658829 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.596367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8425f1-0825-432a-bb04-198799658829 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.598191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8425f1-0825-432a-bb04-198799658829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:13.601053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8425f1-0825-432a-bb04-198799658829 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:13.609186 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:13.629448 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3617/7236] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:13.637524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8425f1-0825-432a-bb04-198799658829 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.657267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b62e855-17a9-4411-81a5-0dee73f7e6b7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:13.663574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8425f1-0825-432a-bb04-198799658829 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:13.665381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b72e06-900d-45be-9931-be71567b8ceb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:13.665747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b72e06-900d-45be-9931-be71567b8ceb service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.666098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b72e06-900d-45be-9931-be71567b8ceb service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.666375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b72e06-900d-45be-9931-be71567b8ceb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.670838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79216358-299c-4dcd-97a2-68d176ebd5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:13.671642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216358-299c-4dcd-97a2-68d176ebd5ea admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.672631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216358-299c-4dcd-97a2-68d176ebd5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.673132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79216358-299c-4dcd-97a2-68d176ebd5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.673934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79216358-299c-4dcd-97a2-68d176ebd5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:13.675736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79216358-299c-4dcd-97a2-68d176ebd5ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:13.676780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b72e06-900d-45be-9931-be71567b8ceb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:13.678352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b72e06-900d-45be-9931-be71567b8ceb service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:13.690078 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3620/7237] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:13.698067 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3618/7238] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:13.701475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b72e06-900d-45be-9931-be71567b8ceb service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.716358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b72e06-900d-45be-9931-be71567b8ceb service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:13.723685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16389f45-7c31-4707-8d5f-fa8a57fb79c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:13.725398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16389f45-7c31-4707-8d5f-fa8a57fb79c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.725398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16389f45-7c31-4707-8d5f-fa8a57fb79c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.725772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16389f45-7c31-4707-8d5f-fa8a57fb79c0 admin admin] PATH_INFO: `/v3/projects/848d43c65aba4eb1925cf89b2cbc2719/users/95e222b5282446348a7572dd8493eff9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.748698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16389f45-7c31-4707-8d5f-fa8a57fb79c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=848d43c65aba4eb1925cf89b2cbc2719, user_id=95e222b5282446348a7572dd8493eff9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:13.750621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16389f45-7c31-4707-8d5f-fa8a57fb79c0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:13.775642 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3621/7239] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:13 2022] PUT /identity/v3/projects/848d43c65aba4eb1925cf89b2cbc2719/users/95e222b5282446348a7572dd8493eff9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:25:13.789024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b0e79-73c5-42c1-9e26-4d93e9c36cbe None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:13.789358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b0e79-73c5-42c1-9e26-4d93e9c36cbe None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:13.789703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b0e79-73c5-42c1-9e26-4d93e9c36cbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:13.822217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-824b0e79-73c5-42c1-9e26-4d93e9c36cbe None None] MFA Rules not processed for user `95e222b5282446348a7572dd8493eff9`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:13.823554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-824b0e79-73c5-42c1-9e26-4d93e9c36cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:13.917073 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3619/7240] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:13.918980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16389f45-7c31-4707-8d5f-fa8a57fb79c0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.922542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b0e79-73c5-42c1-9e26-4d93e9c36cbe None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:13.923923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-824b0e79-73c5-42c1-9e26-4d93e9c36cbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:13.977787 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:14.000658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16389f45-7c31-4707-8d5f-fa8a57fb79c0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.006897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c4de3-99a2-4e2e-87c2-0f6ca4960093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.007965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c4de3-99a2-4e2e-87c2-0f6ca4960093 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.008348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c4de3-99a2-4e2e-87c2-0f6ca4960093 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.008694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7c4de3-99a2-4e2e-87c2-0f6ca4960093 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.017720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c4de3-99a2-4e2e-87c2-0f6ca4960093 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.020818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7c4de3-99a2-4e2e-87c2-0f6ca4960093 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.022790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b0e79-73c5-42c1-9e26-4d93e9c36cbe None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.028181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.029086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.029539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.030044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] PATH_INFO: `/v3/projects/5ada4c42222443a589432ee5bbdb7cf3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.032172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ada4c42222443a589432ee5bbdb7cf3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.034449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.058517 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3622/7241] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:13 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:14.065367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c4de3-99a2-4e2e-87c2-0f6ca4960093 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.108295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ada4c42222443a589432ee5bbdb7cf3', 'request_id': 'req-e9859bfc-6645-4519-b936-ba8ea4b5129e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.117810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ada4c42222443a589432ee5bbdb7cf3', 'request_id': 'req-e9859bfc-6645-4519-b936-ba8ea4b5129e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.128052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ada4c42222443a589432ee5bbdb7cf3', 'request_id': 'req-e9859bfc-6645-4519-b936-ba8ea4b5129e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.153744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] The token cache is being invalidate because project 5ada4c42222443a589432ee5bbdb7cf3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:14.154058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.154789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.159910 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3620/7242] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:13 2022] DELETE /identity/v3/projects/5ada4c42222443a589432ee5bbdb7cf3 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:14.160969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.162495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.183025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7c4de3-99a2-4e2e-87c2-0f6ca4960093 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.253004 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:14.261773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9859bfc-6645-4519-b936-ba8ea4b5129e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.270742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.271643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.272027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.272380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] PATH_INFO: `/v3/users/62ed916d1c43425f8f8d66bd89225ab6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.274119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62ed916d1c43425f8f8d66bd89225ab6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.276287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.285116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134d89c-1c92-4d53-aebd-6c37e33f96dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.286116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d89c-1c92-4d53-aebd-6c37e33f96dc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.286465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d89c-1c92-4d53-aebd-6c37e33f96dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.287306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5134d89c-1c92-4d53-aebd-6c37e33f96dc admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.288160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134d89c-1c92-4d53-aebd-6c37e33f96dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.290342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5134d89c-1c92-4d53-aebd-6c37e33f96dc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.323432 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3623/7243] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:14 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:25:14.323432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134d89c-1c92-4d53-aebd-6c37e33f96dc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.323432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5134d89c-1c92-4d53-aebd-6c37e33f96dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.335420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5134d89c-1c92-4d53-aebd-6c37e33f96dc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.340617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.341335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.341570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.341854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] PATH_INFO: `/v3/projects/783825833dec48ef88b65993a6de256d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.343565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=783825833dec48ef88b65993a6de256d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.345523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.347309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62ed916d1c43425f8f8d66bd89225ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.359060 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:14.361458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62ed916d1c43425f8f8d66bd89225ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.362743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62ed916d1c43425f8f8d66bd89225ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.370773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62ed916d1c43425f8f8d66bd89225ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.379401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62ed916d1c43425f8f8d66bd89225ab6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.386090 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3621/7244] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:14 2022] DELETE /identity/v3/users/62ed916d1c43425f8f8d66bd89225ab6 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:14.387060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.388387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.397452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '783825833dec48ef88b65993a6de256d', 'request_id': 'req-422fd1e8-bf07-4753-a54a-951e055deb8b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.406970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '783825833dec48ef88b65993a6de256d', 'request_id': 'req-422fd1e8-bf07-4753-a54a-951e055deb8b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.416209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '783825833dec48ef88b65993a6de256d', 'request_id': 'req-422fd1e8-bf07-4753-a54a-951e055deb8b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.431443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] The token cache is being invalidate because project 783825833dec48ef88b65993a6de256d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:14.431736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.432437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.434493 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3624/7245] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:14 2022] DELETE /identity/v3/projects/783825833dec48ef88b65993a6de256d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:14.439297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.441150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.471783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a10c40-f452-4ac5-9618-a0ad8f3d6ee2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.477524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.478403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.479038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.479575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] PATH_INFO: `/v3/users/5a97fc9cee17444699a11bd8baa5a4d9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.481626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a97fc9cee17444699a11bd8baa5a4d9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.484606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.523233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422fd1e8-bf07-4753-a54a-951e055deb8b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.529438 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e016e17c-66f1-4c4e-92f9-dc43a7d8a813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.530181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e17c-66f1-4c4e-92f9-dc43a7d8a813 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.530381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e17c-66f1-4c4e-92f9-dc43a7d8a813 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.530658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e016e17c-66f1-4c4e-92f9-dc43a7d8a813 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.531702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016e17c-66f1-4c4e-92f9-dc43a7d8a813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.532899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e016e17c-66f1-4c4e-92f9-dc43a7d8a813 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.543580 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3625/7246] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:14.544810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2667f91-5169-4081-b08b-1045efef4e96 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.545155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2667f91-5169-4081-b08b-1045efef4e96 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.545388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2667f91-5169-4081-b08b-1045efef4e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.547056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a97fc9cee17444699a11bd8baa5a4d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.576836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d2667f91-5169-4081-b08b-1045efef4e96 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:14.578664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d2667f91-5169-4081-b08b-1045efef4e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.579449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a97fc9cee17444699a11bd8baa5a4d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.580634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a97fc9cee17444699a11bd8baa5a4d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.590158 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3626/7247] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:14.591001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2667f91-5169-4081-b08b-1045efef4e96 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.592372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d2667f91-5169-4081-b08b-1045efef4e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.599659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a97fc9cee17444699a11bd8baa5a4d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.604690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2667f91-5169-4081-b08b-1045efef4e96 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.609596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225a2d47-ddb5-4119-9274-1364dc870814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.610354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a2d47-ddb5-4119-9274-1364dc870814 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.610714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a2d47-ddb5-4119-9274-1364dc870814 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.611167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225a2d47-ddb5-4119-9274-1364dc870814 admin admin] PATH_INFO: `/v3/projects/a1407d42bd10439fb42979bd323c889a/users/2613c659b737462182cacbae68de611e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.615774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a59beefe-fe5d-468c-af9d-f05080f88910 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a97fc9cee17444699a11bd8baa5a4d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.625616 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3622/7248] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:14 2022] DELETE /identity/v3/users/5a97fc9cee17444699a11bd8baa5a4d9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:14.627430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c2bff-e6a1-486e-ab74-7a811df9b748 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.627781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c2bff-e6a1-486e-ab74-7a811df9b748 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.628157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8c2bff-e6a1-486e-ab74-7a811df9b748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.631531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a2d47-ddb5-4119-9274-1364dc870814 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1407d42bd10439fb42979bd323c889a, user_id=2613c659b737462182cacbae68de611e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.634399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225a2d47-ddb5-4119-9274-1364dc870814 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.655743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1a8c2bff-e6a1-486e-ab74-7a811df9b748 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:14.657224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a8c2bff-e6a1-486e-ab74-7a811df9b748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.658473 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3627/7249] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:14 2022] PUT /identity/v3/projects/a1407d42bd10439fb42979bd323c889a/users/2613c659b737462182cacbae68de611e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:14.660447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315d9a-c01c-431f-8bef-916c465b9b3a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.661615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315d9a-c01c-431f-8bef-916c465b9b3a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.661892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f315d9a-c01c-431f-8bef-916c465b9b3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.685901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3f315d9a-c01c-431f-8bef-916c465b9b3a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:14.687083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3f315d9a-c01c-431f-8bef-916c465b9b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.701413 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:14.736360 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:14.751244 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3623/7250] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:14.752327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c2bff-e6a1-486e-ab74-7a811df9b748 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.762289 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3628/7251] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:14.763282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f315d9a-c01c-431f-8bef-916c465b9b3a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.764662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3f315d9a-c01c-431f-8bef-916c465b9b3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.765964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8c2bff-e6a1-486e-ab74-7a811df9b748 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.771037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d867d24-832c-4ec4-96f7-cb40427e3d9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.771444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d867d24-832c-4ec4-96f7-cb40427e3d9c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.771880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d867d24-832c-4ec4-96f7-cb40427e3d9c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.772030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d867d24-832c-4ec4-96f7-cb40427e3d9c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.772662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d867d24-832c-4ec4-96f7-cb40427e3d9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.774420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d867d24-832c-4ec4-96f7-cb40427e3d9c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.777129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f315d9a-c01c-431f-8bef-916c465b9b3a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.782480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.783100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.783378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.783653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] PATH_INFO: `/v3/projects/5cd5e115a13245c0b8085fab773a4562` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.784921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5cd5e115a13245c0b8085fab773a4562)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.785519 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3624/7252] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:14.786399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d867d24-832c-4ec4-96f7-cb40427e3d9c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.787041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.796757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d867d24-832c-4ec4-96f7-cb40427e3d9c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.801471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.802041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.802316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.802585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.803210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:14.803506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.805057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.817340 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3625/7253] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:14.818134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.820064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.836893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5cd5e115a13245c0b8085fab773a4562', 'request_id': 'req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.845889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5cd5e115a13245c0b8085fab773a4562', 'request_id': 'req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.852467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5cd5e115a13245c0b8085fab773a4562', 'request_id': 'req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.863727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] The token cache is being invalidate because project 5cd5e115a13245c0b8085fab773a4562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:14.864018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.864798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:14.866371 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3629/7254] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:14 2022] DELETE /identity/v3/projects/5cd5e115a13245c0b8085fab773a4562 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:14.867123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.868606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.884512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8f2e78-bb88-48da-b1a5-17fedd6445d8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.933954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7904ebbb-5d37-4a30-aedd-daf4f8071530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.934554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ebbb-5d37-4a30-aedd-daf4f8071530 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.934834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ebbb-5d37-4a30-aedd-daf4f8071530 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.935106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7904ebbb-5d37-4a30-aedd-daf4f8071530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.935811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7d7040-56ef-4925-b564-a8d3e5ca27e9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:14.937954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7904ebbb-5d37-4a30-aedd-daf4f8071530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.943054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e23cf-42c6-4284-87ec-e4d4318fe037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:14.943721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e23cf-42c6-4284-87ec-e4d4318fe037 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.944001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e23cf-42c6-4284-87ec-e4d4318fe037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.944274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e23cf-42c6-4284-87ec-e4d4318fe037 admin admin] PATH_INFO: `/v3/projects/a1407d42bd10439fb42979bd323c889a/users/2613c659b737462182cacbae68de611e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.946225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e23cf-42c6-4284-87ec-e4d4318fe037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1407d42bd10439fb42979bd323c889a, user_id=2613c659b737462182cacbae68de611e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.948903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e23cf-42c6-4284-87ec-e4d4318fe037 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.950424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904ebbb-5d37-4a30-aedd-daf4f8071530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:14.951848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7904ebbb-5d37-4a30-aedd-daf4f8071530 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:14.960346 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3630/7255] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:14 2022] PUT /identity/v3/projects/a1407d42bd10439fb42979bd323c889a/users/2613c659b737462182cacbae68de611e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:14.961199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e23cf-42c6-4284-87ec-e4d4318fe037 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:14.962750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f33e23cf-42c6-4284-87ec-e4d4318fe037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:14.967162 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3626/7256] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:14.968435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff235f0c-2024-4b42-aa0f-0b1e414dcd67 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:14.968718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff235f0c-2024-4b42-aa0f-0b1e414dcd67 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:14.969144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff235f0c-2024-4b42-aa0f-0b1e414dcd67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:14.991995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ff235f0c-2024-4b42-aa0f-0b1e414dcd67 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:14.992839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ff235f0c-2024-4b42-aa0f-0b1e414dcd67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.003379 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:15.047499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e23cf-42c6-4284-87ec-e4d4318fe037 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.072162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e587534-0482-4608-b6f0-934d8e385a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.072722 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3627/7257] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:15.072837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e587534-0482-4608-b6f0-934d8e385a96 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.073381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e587534-0482-4608-b6f0-934d8e385a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.073735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e587534-0482-4608-b6f0-934d8e385a96 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.074022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aa321-c444-4c9d-a700-d5e518ad9dba None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.074307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aa321-c444-4c9d-a700-d5e518ad9dba None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.074406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e587534-0482-4608-b6f0-934d8e385a96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.074586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aa321-c444-4c9d-a700-d5e518ad9dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.076280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e587534-0482-4608-b6f0-934d8e385a96 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.111947 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3631/7258] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:14 2022] POST /identity/v3/projects => generated 385 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:15.111947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6e40c-fde0-4306-bf73-84f875d998cd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.111947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6e40c-fde0-4306-bf73-84f875d998cd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.111947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6e40c-fde0-4306-bf73-84f875d998cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.120634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-576aa321-c444-4c9d-a700-d5e518ad9dba None None] MFA Rules not processed for user `2613c659b737462182cacbae68de611e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:15.122507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-576aa321-c444-4c9d-a700-d5e518ad9dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.138570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4ee6e40c-fde0-4306-bf73-84f875d998cd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:15.140025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4ee6e40c-fde0-4306-bf73-84f875d998cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.159905 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:15.226053 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3632/7259] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:15.227199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6e40c-fde0-4306-bf73-84f875d998cd None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.233160 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3628/7260] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:15.234701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aa321-c444-4c9d-a700-d5e518ad9dba None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.236364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-576aa321-c444-4c9d-a700-d5e518ad9dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.244803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6e40c-fde0-4306-bf73-84f875d998cd None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.250729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d367c7-c287-47c4-971e-931d8840a57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.251003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aa321-c444-4c9d-a700-d5e518ad9dba None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.251344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d367c7-c287-47c4-971e-931d8840a57f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.251627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d367c7-c287-47c4-971e-931d8840a57f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.251907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d367c7-c287-47c4-971e-931d8840a57f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.252534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d367c7-c287-47c4-971e-931d8840a57f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.254497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d367c7-c287-47c4-971e-931d8840a57f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.256349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.257012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.257381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.257676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] PATH_INFO: `/v3/projects/111ce72c00d745d69ceb04183b50abd0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.258876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=111ce72c00d745d69ceb04183b50abd0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.260901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.280588 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3633/7261] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:15.280588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d367c7-c287-47c4-971e-931d8840a57f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.290011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d367c7-c287-47c4-971e-931d8840a57f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.295280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.296598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.296991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.297319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.298630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:15.299046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.300768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.317061 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3634/7262] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:15.318060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.319775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.321232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '111ce72c00d745d69ceb04183b50abd0', 'request_id': 'req-316aef01-e611-4f39-b2ef-47d76a2b4d0a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:15.328127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '111ce72c00d745d69ceb04183b50abd0', 'request_id': 'req-316aef01-e611-4f39-b2ef-47d76a2b4d0a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:15.338844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '111ce72c00d745d69ceb04183b50abd0', 'request_id': 'req-316aef01-e611-4f39-b2ef-47d76a2b4d0a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:15.352080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] The token cache is being invalidate because project 111ce72c00d745d69ceb04183b50abd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:15.352684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:15.353063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:15.361988 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3629/7263] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:15 2022] DELETE /identity/v3/projects/111ce72c00d745d69ceb04183b50abd0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:15.361988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.362953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.388214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a91f1a7-2d3f-4a37-99c9-fc9c03f3cc98 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.433930 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:15.442655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316aef01-e611-4f39-b2ef-47d76a2b4d0a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.443905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f5555-5826-478d-b428-c165bbc4541c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.444852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5555-5826-478d-b428-c165bbc4541c service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.445225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5555-5826-478d-b428-c165bbc4541c service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.445976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046f5555-5826-478d-b428-c165bbc4541c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.447542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf04054-ae4d-45c1-b67d-156a29931638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.447670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-046f5555-5826-478d-b428-c165bbc4541c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.448152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf04054-ae4d-45c1-b67d-156a29931638 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.448437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf04054-ae4d-45c1-b67d-156a29931638 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.448716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf04054-ae4d-45c1-b67d-156a29931638 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.449402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf04054-ae4d-45c1-b67d-156a29931638 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.451037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf04054-ae4d-45c1-b67d-156a29931638 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.461906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3630/7264] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:15.465707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf04054-ae4d-45c1-b67d-156a29931638 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.468117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8cf04054-ae4d-45c1-b67d-156a29931638 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.485513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf04054-ae4d-45c1-b67d-156a29931638 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.490856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5844fea-25fa-47b5-9300-b46a1756a3de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.491469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5844fea-25fa-47b5-9300-b46a1756a3de admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.491749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5844fea-25fa-47b5-9300-b46a1756a3de admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.492021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5844fea-25fa-47b5-9300-b46a1756a3de admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.493347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5844fea-25fa-47b5-9300-b46a1756a3de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.494607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5844fea-25fa-47b5-9300-b46a1756a3de admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.520090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f5555-5826-478d-b428-c165bbc4541c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.521651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046f5555-5826-478d-b428-c165bbc4541c service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.534745 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3631/7265] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/projects => generated 355 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:15.534908 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3635/7266] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:15.535326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd847e-3a9c-49df-9e94-6a70ad632388 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.535326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd847e-3a9c-49df-9e94-6a70ad632388 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.535475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f5555-5826-478d-b428-c165bbc4541c service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.535575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd847e-3a9c-49df-9e94-6a70ad632388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.551269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046f5555-5826-478d-b428-c165bbc4541c service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.566732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3dbd847e-3a9c-49df-9e94-6a70ad632388 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:15.567941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3dbd847e-3a9c-49df-9e94-6a70ad632388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.580300 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:15.619107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108e2a-0bff-4de4-ba05-c90f19c3ee31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.619872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108e2a-0bff-4de4-ba05-c90f19c3ee31 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.620157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108e2a-0bff-4de4-ba05-c90f19c3ee31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.621028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36108e2a-0bff-4de4-ba05-c90f19c3ee31 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.621711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36108e2a-0bff-4de4-ba05-c90f19c3ee31 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.623836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36108e2a-0bff-4de4-ba05-c90f19c3ee31 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.638620 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3636/7267] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:15.638620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108e2a-0bff-4de4-ba05-c90f19c3ee31 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.644160 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3632/7268] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:15.647741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36108e2a-0bff-4de4-ba05-c90f19c3ee31 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.651040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd847e-3a9c-49df-9e94-6a70ad632388 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.652591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f267886-01b9-4c61-8eda-e4142cea8c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.653135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f267886-01b9-4c61-8eda-e4142cea8c16 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.653428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f267886-01b9-4c61-8eda-e4142cea8c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.653700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f267886-01b9-4c61-8eda-e4142cea8c16 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.654318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f267886-01b9-4c61-8eda-e4142cea8c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.656951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f267886-01b9-4c61-8eda-e4142cea8c16 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.661711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd847e-3a9c-49df-9e94-6a70ad632388 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.667496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45333514-fdc1-42e0-bfff-0cc566e4da94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.668459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45333514-fdc1-42e0-bfff-0cc566e4da94 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.668746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45333514-fdc1-42e0-bfff-0cc566e4da94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.669017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45333514-fdc1-42e0-bfff-0cc566e4da94 admin admin] PATH_INFO: `/v3/projects/ce56fd7486ac402d8b896061cfc8e679/users/9c374e77c5f84226a96451a339cc19a5/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.680487 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3637/7269] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/users => generated 278 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:15.681910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb56a-cc87-4ec0-b1ad-87fc51c3e862 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.682329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb56a-cc87-4ec0-b1ad-87fc51c3e862 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.682875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdcb56a-cc87-4ec0-b1ad-87fc51c3e862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.687610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45333514-fdc1-42e0-bfff-0cc566e4da94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce56fd7486ac402d8b896061cfc8e679, user_id=9c374e77c5f84226a96451a339cc19a5, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.691162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45333514-fdc1-42e0-bfff-0cc566e4da94 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.706232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ffdcb56a-cc87-4ec0-b1ad-87fc51c3e862 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:15.714942 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3633/7270] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:15 2022] PUT /identity/v3/projects/ce56fd7486ac402d8b896061cfc8e679/users/9c374e77c5f84226a96451a339cc19a5/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:15.715097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ffdcb56a-cc87-4ec0-b1ad-87fc51c3e862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.715314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45333514-fdc1-42e0-bfff-0cc566e4da94 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.789990 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3638/7271] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:15.790393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45333514-fdc1-42e0-bfff-0cc566e4da94 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.791086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72244a56-1286-458c-847a-791c89df993a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.791411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72244a56-1286-458c-847a-791c89df993a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.791732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72244a56-1286-458c-847a-791c89df993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.796938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201b87a-d6df-46f7-845d-48728edfc299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.797778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201b87a-d6df-46f7-845d-48728edfc299 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.798215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201b87a-d6df-46f7-845d-48728edfc299 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.798563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a201b87a-d6df-46f7-845d-48728edfc299 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.799336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201b87a-d6df-46f7-845d-48728edfc299 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.801408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a201b87a-d6df-46f7-845d-48728edfc299 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.812741 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3634/7272] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:15.814214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201b87a-d6df-46f7-845d-48728edfc299 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.823441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-72244a56-1286-458c-847a-791c89df993a None None] MFA Rules not processed for user `9c374e77c5f84226a96451a339cc19a5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:15.826208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-72244a56-1286-458c-847a-791c89df993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:15.826496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a201b87a-d6df-46f7-845d-48728edfc299 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.832385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072eda54-97b3-4c41-b187-9fcd9f5e7be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.832996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072eda54-97b3-4c41-b187-9fcd9f5e7be2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.833279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072eda54-97b3-4c41-b187-9fcd9f5e7be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.833600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072eda54-97b3-4c41-b187-9fcd9f5e7be2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.834239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072eda54-97b3-4c41-b187-9fcd9f5e7be2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:15.834547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072eda54-97b3-4c41-b187-9fcd9f5e7be2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.834701 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:15.836235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072eda54-97b3-4c41-b187-9fcd9f5e7be2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.863714 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3635/7273] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:15.864708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072eda54-97b3-4c41-b187-9fcd9f5e7be2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.876627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072eda54-97b3-4c41-b187-9fcd9f5e7be2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.882828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c2b5-2fd6-4b2b-8971-bc4475688de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.883552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c2b5-2fd6-4b2b-8971-bc4475688de4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.883699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c2b5-2fd6-4b2b-8971-bc4475688de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.883977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a4c2b5-2fd6-4b2b-8971-bc4475688de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.884624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4c2b5-2fd6-4b2b-8971-bc4475688de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.886477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a4c2b5-2fd6-4b2b-8971-bc4475688de4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.901620 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3636/7274] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:15.901620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c2b5-2fd6-4b2b-8971-bc4475688de4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.916107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a4c2b5-2fd6-4b2b-8971-bc4475688de4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.921445 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3639/7275] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:15.922363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72244a56-1286-458c-847a-791c89df993a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.925541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3235af-6752-4514-b8d8-9b8d9a44e5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.926161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3235af-6752-4514-b8d8-9b8d9a44e5ad admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.926485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3235af-6752-4514-b8d8-9b8d9a44e5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.926749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3235af-6752-4514-b8d8-9b8d9a44e5ad admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.927381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3235af-6752-4514-b8d8-9b8d9a44e5ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.929319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3235af-6752-4514-b8d8-9b8d9a44e5ad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.933657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72244a56-1286-458c-847a-791c89df993a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:15.939180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d415748-973d-4425-9f8c-c598950c7162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:15.940042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d415748-973d-4425-9f8c-c598950c7162 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:15.941333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d415748-973d-4425-9f8c-c598950c7162 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:15.941333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d415748-973d-4425-9f8c-c598950c7162 admin admin] PATH_INFO: `/v3/projects/b24272a6376d4868a5aa83d7e50f2554/users/e7ddb50ed0824a98b624802377ee03d5/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:15.957413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d415748-973d-4425-9f8c-c598950c7162 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b24272a6376d4868a5aa83d7e50f2554, user_id=e7ddb50ed0824a98b624802377ee03d5, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:15.960743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d415748-973d-4425-9f8c-c598950c7162 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:15.964841 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3637/7276] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:15.964841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3235af-6752-4514-b8d8-9b8d9a44e5ad admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:15.977405 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3640/7277] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:15 2022] PUT /identity/v3/projects/b24272a6376d4868a5aa83d7e50f2554/users/e7ddb50ed0824a98b624802377ee03d5/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:15.978508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d415748-973d-4425-9f8c-c598950c7162 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.043880 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:16.053087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d415748-973d-4425-9f8c-c598950c7162 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.059754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b699454c-76d1-4730-8d60-3fd7c4c496e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.060382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699454c-76d1-4730-8d60-3fd7c4c496e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.060645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699454c-76d1-4730-8d60-3fd7c4c496e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.060915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b699454c-76d1-4730-8d60-3fd7c4c496e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.062375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699454c-76d1-4730-8d60-3fd7c4c496e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.066390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b699454c-76d1-4730-8d60-3fd7c4c496e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.073732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3235af-6752-4514-b8d8-9b8d9a44e5ad admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.080905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15108d-a4ec-4dd0-9baa-1129420e0fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.081524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15108d-a4ec-4dd0-9baa-1129420e0fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.081871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15108d-a4ec-4dd0-9baa-1129420e0fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.082207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c15108d-a4ec-4dd0-9baa-1129420e0fe9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.082866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15108d-a4ec-4dd0-9baa-1129420e0fe9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.084904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c15108d-a4ec-4dd0-9baa-1129420e0fe9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.093070 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3641/7278] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/users => generated 285 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:16.093070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d300082-db6c-4531-8f15-8552aea1d4ca None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.093070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d300082-db6c-4531-8f15-8552aea1d4ca None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.093070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d300082-db6c-4531-8f15-8552aea1d4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.116218 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3638/7279] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:15 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:16.117134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15108d-a4ec-4dd0-9baa-1129420e0fe9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.124731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1d300082-db6c-4531-8f15-8552aea1d4ca None None] MFA Rules not processed for user `e7ddb50ed0824a98b624802377ee03d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:16.126039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d300082-db6c-4531-8f15-8552aea1d4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:16.191316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c15108d-a4ec-4dd0-9baa-1129420e0fe9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.196162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afad8f7-5f21-4978-8ce1-7926a946dd59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.196831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afad8f7-5f21-4978-8ce1-7926a946dd59 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.197175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afad8f7-5f21-4978-8ce1-7926a946dd59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.197545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afad8f7-5f21-4978-8ce1-7926a946dd59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.198248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afad8f7-5f21-4978-8ce1-7926a946dd59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.199908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afad8f7-5f21-4978-8ce1-7926a946dd59 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.203339 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3642/7280] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:16.206942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d300082-db6c-4531-8f15-8552aea1d4ca None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.211149 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:16.212266 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3639/7281] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:16.213417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afad8f7-5f21-4978-8ce1-7926a946dd59 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.220101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d300082-db6c-4531-8f15-8552aea1d4ca None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.223600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afad8f7-5f21-4978-8ce1-7926a946dd59 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.225657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867136a-a3b6-4afc-8e77-7c25528a018b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.226331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867136a-a3b6-4afc-8e77-7c25528a018b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.226837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867136a-a3b6-4afc-8e77-7c25528a018b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.227186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867136a-a3b6-4afc-8e77-7c25528a018b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.227906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867136a-a3b6-4afc-8e77-7c25528a018b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.228639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0f836-f045-433c-9ad7-82b444f28fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.229345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0f836-f045-433c-9ad7-82b444f28fba admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.229726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0f836-f045-433c-9ad7-82b444f28fba admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.229921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867136a-a3b6-4afc-8e77-7c25528a018b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.230267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b0f836-f045-433c-9ad7-82b444f28fba admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.230979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0f836-f045-433c-9ad7-82b444f28fba admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.232965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b0f836-f045-433c-9ad7-82b444f28fba admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.258436 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3643/7282] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:16 2022] POST /identity/v3/users => generated 298 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:16.258436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867136a-a3b6-4afc-8e77-7c25528a018b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.269663 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3640/7283] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:16 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:16.269663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0f836-f045-433c-9ad7-82b444f28fba admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.269922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867136a-a3b6-4afc-8e77-7c25528a018b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.333766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3511dd5-a38d-40a5-9304-3be9dc95559d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.334293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3511dd5-a38d-40a5-9304-3be9dc95559d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.334406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b0f836-f045-433c-9ad7-82b444f28fba admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.334574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3511dd5-a38d-40a5-9304-3be9dc95559d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.334845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3511dd5-a38d-40a5-9304-3be9dc95559d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.335478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3511dd5-a38d-40a5-9304-3be9dc95559d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.337124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3511dd5-a38d-40a5-9304-3be9dc95559d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.339745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3d0c7-59ff-4d44-9557-ba55787143f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.340445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3d0c7-59ff-4d44-9557-ba55787143f5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.340847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3d0c7-59ff-4d44-9557-ba55787143f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.341221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b3d0c7-59ff-4d44-9557-ba55787143f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.341999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3d0c7-59ff-4d44-9557-ba55787143f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.343705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b3d0c7-59ff-4d44-9557-ba55787143f5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.349593 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3644/7284] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:16.352179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3511dd5-a38d-40a5-9304-3be9dc95559d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.364283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3511dd5-a38d-40a5-9304-3be9dc95559d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.368430 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3641/7285] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:16.368430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3d0c7-59ff-4d44-9557-ba55787143f5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.375607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad7ff-0343-4f9a-b83f-feb695f10fbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.376230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad7ff-0343-4f9a-b83f-feb695f10fbb admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.376514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad7ff-0343-4f9a-b83f-feb695f10fbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.376793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877ad7ff-0343-4f9a-b83f-feb695f10fbb admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.377470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ad7ff-0343-4f9a-b83f-feb695f10fbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.379479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877ad7ff-0343-4f9a-b83f-feb695f10fbb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.380088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b3d0c7-59ff-4d44-9557-ba55787143f5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.385244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a64b2-1a46-40e7-9037-07f175b379ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.385920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a64b2-1a46-40e7-9037-07f175b379ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.386198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a64b2-1a46-40e7-9037-07f175b379ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.386470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4a64b2-1a46-40e7-9037-07f175b379ab admin admin] PATH_INFO: `/v3/projects/4baca0a3afd245108c3216b3e7b34c5a/users/a24c9142ffcd4a38966ae41745b9029b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.404846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a64b2-1a46-40e7-9037-07f175b379ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4baca0a3afd245108c3216b3e7b34c5a, user_id=a24c9142ffcd4a38966ae41745b9029b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.409380 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3645/7286] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:16 2022] POST /identity/v3/users => generated 285 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:16.409380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad7ff-0343-4f9a-b83f-feb695f10fbb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.409572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4a64b2-1a46-40e7-9037-07f175b379ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.421564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877ad7ff-0343-4f9a-b83f-feb695f10fbb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.433410 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3642/7287] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:16 2022] PUT /identity/v3/projects/4baca0a3afd245108c3216b3e7b34c5a/users/a24c9142ffcd4a38966ae41745b9029b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:16.435148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a64b2-1a46-40e7-9037-07f175b379ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.451142 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:16.498465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd62ebf-df3c-4e38-a126-667d6b09cdc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.499736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd62ebf-df3c-4e38-a126-667d6b09cdc2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.500014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd62ebf-df3c-4e38-a126-667d6b09cdc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.500286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd62ebf-df3c-4e38-a126-667d6b09cdc2 admin admin] PATH_INFO: `/v3/projects/8b60668729024760bbeb35ce231c607b/users/3083c110c3584bffa5b07bc58e8311b4/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.517712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4a64b2-1a46-40e7-9037-07f175b379ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.518153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd62ebf-df3c-4e38-a126-667d6b09cdc2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b60668729024760bbeb35ce231c607b, user_id=3083c110c3584bffa5b07bc58e8311b4, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.520918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd62ebf-df3c-4e38-a126-667d6b09cdc2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.522355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a23c64d-1df4-4ca4-8bcc-db890bbe8a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.522949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c64d-1df4-4ca4-8bcc-db890bbe8a16 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.523230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c64d-1df4-4ca4-8bcc-db890bbe8a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.523498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a23c64d-1df4-4ca4-8bcc-db890bbe8a16 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.524125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23c64d-1df4-4ca4-8bcc-db890bbe8a16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.525760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a23c64d-1df4-4ca4-8bcc-db890bbe8a16 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.536070 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3643/7288] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:16.539303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e73f7-9d74-433d-86d7-98f5d3542700 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.539303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e73f7-9d74-433d-86d7-98f5d3542700 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.539303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62e73f7-9d74-433d-86d7-98f5d3542700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.540063 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3646/7289] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:16 2022] PUT /identity/v3/projects/8b60668729024760bbeb35ce231c607b/users/3083c110c3584bffa5b07bc58e8311b4/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:16.541527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd62ebf-df3c-4e38-a126-667d6b09cdc2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.568372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a62e73f7-9d74-433d-86d7-98f5d3542700 None None] MFA Rules not processed for user `a24c9142ffcd4a38966ae41745b9029b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:16.569621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a62e73f7-9d74-433d-86d7-98f5d3542700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:16.596730 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:16.623647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd62ebf-df3c-4e38-a126-667d6b09cdc2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.629771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a840ce-0329-412c-86c6-2b198a7c1e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.631048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a840ce-0329-412c-86c6-2b198a7c1e5a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.631513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a840ce-0329-412c-86c6-2b198a7c1e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.631909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a840ce-0329-412c-86c6-2b198a7c1e5a admin admin] PATH_INFO: `/v3/projects/fbe208b47e8f4758a2049dd2038468f8/users/ad9cf27ce95043a89b98e7e138a40e00/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.649552 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3644/7290] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:16.650724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e73f7-9d74-433d-86d7-98f5d3542700 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.651549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a840ce-0329-412c-86c6-2b198a7c1e5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe208b47e8f4758a2049dd2038468f8, user_id=ad9cf27ce95043a89b98e7e138a40e00, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.654751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a840ce-0329-412c-86c6-2b198a7c1e5a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.669573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62e73f7-9d74-433d-86d7-98f5d3542700 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.672399 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3647/7291] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:16 2022] PUT /identity/v3/projects/fbe208b47e8f4758a2049dd2038468f8/users/ad9cf27ce95043a89b98e7e138a40e00/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:16.672399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a840ce-0329-412c-86c6-2b198a7c1e5a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.679459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b2a840ce-0329-412c-86c6-2b198a7c1e5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:16.753582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73573-1369-45a9-9c3b-9d742cce6354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.754356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73573-1369-45a9-9c3b-9d742cce6354 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.754723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73573-1369-45a9-9c3b-9d742cce6354 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.755062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a73573-1369-45a9-9c3b-9d742cce6354 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.756039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a73573-1369-45a9-9c3b-9d742cce6354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.756134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a840ce-0329-412c-86c6-2b198a7c1e5a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.757832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a73573-1369-45a9-9c3b-9d742cce6354 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.760800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a06615-01a6-4f2e-bbfa-6b9c639d24e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.761468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06615-01a6-4f2e-bbfa-6b9c639d24e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.761746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06615-01a6-4f2e-bbfa-6b9c639d24e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.762022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a06615-01a6-4f2e-bbfa-6b9c639d24e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.771229 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3645/7292] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:16.772505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73573-1369-45a9-9c3b-9d742cce6354 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.783673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a73573-1369-45a9-9c3b-9d742cce6354 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.788892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbce67-f29a-47fa-a45e-e539274ed4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.789540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbce67-f29a-47fa-a45e-e539274ed4ff admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.789818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbce67-f29a-47fa-a45e-e539274ed4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.790086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efbce67-f29a-47fa-a45e-e539274ed4ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.790718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbce67-f29a-47fa-a45e-e539274ed4ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.792326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efbce67-f29a-47fa-a45e-e539274ed4ff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.803727 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3646/7293] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:16.804509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbce67-f29a-47fa-a45e-e539274ed4ff admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.815373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efbce67-f29a-47fa-a45e-e539274ed4ff admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.820662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d026b9-79aa-42f1-9e79-37e1ea7be3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.821328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d026b9-79aa-42f1-9e79-37e1ea7be3f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.821614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d026b9-79aa-42f1-9e79-37e1ea7be3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.821867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d026b9-79aa-42f1-9e79-37e1ea7be3f9 admin admin] PATH_INFO: `/v3/projects/8b60668729024760bbeb35ce231c607b/users/3083c110c3584bffa5b07bc58e8311b4/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.823764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d026b9-79aa-42f1-9e79-37e1ea7be3f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b60668729024760bbeb35ce231c607b, user_id=3083c110c3584bffa5b07bc58e8311b4, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.827157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d026b9-79aa-42f1-9e79-37e1ea7be3f9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.828210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a06615-01a6-4f2e-bbfa-6b9c639d24e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.829832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a06615-01a6-4f2e-bbfa-6b9c639d24e4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.840646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3648/7294] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:16 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:16.841282 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3647/7295] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:16 2022] PUT /identity/v3/projects/8b60668729024760bbeb35ce231c607b/users/3083c110c3584bffa5b07bc58e8311b4/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:16.849845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a06615-01a6-4f2e-bbfa-6b9c639d24e4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:16.853258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cfc50-2b87-4423-a6dc-ae960848196a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.853706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cfc50-2b87-4423-a6dc-ae960848196a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.853980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cfc50-2b87-4423-a6dc-ae960848196a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.864367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a06615-01a6-4f2e-bbfa-6b9c639d24e4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:16.877727 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:16.887387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-151cfc50-2b87-4423-a6dc-ae960848196a None None] MFA Rules not processed for user `3083c110c3584bffa5b07bc58e8311b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:16.889174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-151cfc50-2b87-4423-a6dc-ae960848196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:16.942110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e280a1-957f-411f-9ce3-60dcb9e99495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:16.942886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e280a1-957f-411f-9ce3-60dcb9e99495 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.943364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e280a1-957f-411f-9ce3-60dcb9e99495 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.943721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e280a1-957f-411f-9ce3-60dcb9e99495 admin admin] PATH_INFO: `/v3/projects/fbe208b47e8f4758a2049dd2038468f8/users/ad9cf27ce95043a89b98e7e138a40e00/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:16.946096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e280a1-957f-411f-9ce3-60dcb9e99495 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fbe208b47e8f4758a2049dd2038468f8, user_id=ad9cf27ce95043a89b98e7e138a40e00, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:16.949020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e280a1-957f-411f-9ce3-60dcb9e99495 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:16.966688 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3649/7296] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:16 2022] PUT /identity/v3/projects/fbe208b47e8f4758a2049dd2038468f8/users/ad9cf27ce95043a89b98e7e138a40e00/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:16.976853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f87de-a84a-4243-9c35-6e94947ecdce None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:16.977204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f87de-a84a-4243-9c35-6e94947ecdce None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:16.977626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f87de-a84a-4243-9c35-6e94947ecdce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:17.007919 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3648/7297] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:17.013738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ff0f87de-a84a-4243-9c35-6e94947ecdce None None] MFA Rules not processed for user `ad9cf27ce95043a89b98e7e138a40e00`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:17.015821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff0f87de-a84a-4243-9c35-6e94947ecdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:17.020036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cfc50-2b87-4423-a6dc-ae960848196a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:17.021508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-151cfc50-2b87-4423-a6dc-ae960848196a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:17.027311 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:17.121552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cfc50-2b87-4423-a6dc-ae960848196a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:17.147067 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3650/7298] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:16 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:17.162139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f87de-a84a-4243-9c35-6e94947ecdce None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:17.174422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ff0f87de-a84a-4243-9c35-6e94947ecdce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:17.207649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ff7a-6b46-4771-8726-b307afddcf94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:17.208866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ff7a-6b46-4771-8726-b307afddcf94 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:17.210013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ff7a-6b46-4771-8726-b307afddcf94 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:17.211504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698ff7a-6b46-4771-8726-b307afddcf94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:17.287128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f87de-a84a-4243-9c35-6e94947ecdce None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:17.292873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c91db-e00f-4462-93af-1667ced69c94 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:17.293532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c91db-e00f-4462-93af-1667ced69c94 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:17.293813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c91db-e00f-4462-93af-1667ced69c94 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:17.294085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c91db-e00f-4462-93af-1667ced69c94 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:17.301170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698ff7a-6b46-4771-8726-b307afddcf94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:17.302923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698ff7a-6b46-4771-8726-b307afddcf94 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:17.305805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c91db-e00f-4462-93af-1667ced69c94 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:17.307325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c91db-e00f-4462-93af-1667ced69c94 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:17.319214 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3649/7299] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:17.320426 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3651/7300] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:17 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:17.438406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ff7a-6b46-4771-8726-b307afddcf94 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:17.479557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698ff7a-6b46-4771-8726-b307afddcf94 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:17.486404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fb3e2-2c87-479b-8e24-71f5ce07d196 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:17.487985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fb3e2-2c87-479b-8e24-71f5ce07d196 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:17.487985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fb3e2-2c87-479b-8e24-71f5ce07d196 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:17.488289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974fb3e2-2c87-479b-8e24-71f5ce07d196 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:17.497607 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:17.580142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fb3e2-2c87-479b-8e24-71f5ce07d196 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:17.582012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974fb3e2-2c87-479b-8e24-71f5ce07d196 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:17.600930 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3650/7301] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:17 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:18.182488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c91db-e00f-4462-93af-1667ced69c94 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:18.200119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c91db-e00f-4462-93af-1667ced69c94 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:18.204151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7305f7f-ea11-45cd-bfbe-2a5dce8f3f0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:18.204767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7305f7f-ea11-45cd-bfbe-2a5dce8f3f0d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:18.205044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7305f7f-ea11-45cd-bfbe-2a5dce8f3f0d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:18.205338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7305f7f-ea11-45cd-bfbe-2a5dce8f3f0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:18.308546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7305f7f-ea11-45cd-bfbe-2a5dce8f3f0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:18.310074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7305f7f-ea11-45cd-bfbe-2a5dce8f3f0d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:18.325183 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3652/7302] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:22.473045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fb3e2-2c87-479b-8e24-71f5ce07d196 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:22.474983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-974fb3e2-2c87-479b-8e24-71f5ce07d196 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:22.590255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974fb3e2-2c87-479b-8e24-71f5ce07d196 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:22.599695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c2bb4-ae13-430d-96fd-a0e2cd0cc581 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:22.600335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c2bb4-ae13-430d-96fd-a0e2cd0cc581 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:22.600625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c2bb4-ae13-430d-96fd-a0e2cd0cc581 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:22.601138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c2bb4-ae13-430d-96fd-a0e2cd0cc581 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:22.604204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3e6c2bb4-ae13-430d-96fd-a0e2cd0cc581 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:22.737430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c2bb4-ae13-430d-96fd-a0e2cd0cc581 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:22.740439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c2bb4-ae13-430d-96fd-a0e2cd0cc581 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:22.753114 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3651/7303] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:22 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:25.286381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7305f7f-ea11-45cd-bfbe-2a5dce8f3f0d service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:25.288939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7305f7f-ea11-45cd-bfbe-2a5dce8f3f0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:25.354511 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:25.407894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7305f7f-ea11-45cd-bfbe-2a5dce8f3f0d service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:25.414354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6947f9b0-dbd7-438d-9706-19f645b62a20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:25.415003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f9b0-dbd7-438d-9706-19f645b62a20 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:25.415287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f9b0-dbd7-438d-9706-19f645b62a20 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:25.415566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6947f9b0-dbd7-438d-9706-19f645b62a20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:25.540430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947f9b0-dbd7-438d-9706-19f645b62a20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:25.550167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6947f9b0-dbd7-438d-9706-19f645b62a20 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:25.567979 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3653/7304] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:25:25 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:25:28.197672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c2bb4-ae13-430d-96fd-a0e2cd0cc581 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:28.298131 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:28.372723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c2bb4-ae13-430d-96fd-a0e2cd0cc581 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:28.383227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:28.384020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:28.387753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:28.387753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] PATH_INFO: `/v3/users/9c374e77c5f84226a96451a339cc19a5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:28.387753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c374e77c5f84226a96451a339cc19a5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:28.390231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:28.486075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c374e77c5f84226a96451a339cc19a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:28.503994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c374e77c5f84226a96451a339cc19a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:28.504715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c374e77c5f84226a96451a339cc19a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:28.514304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c374e77c5f84226a96451a339cc19a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:28.523541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c374e77c5f84226a96451a339cc19a5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:28.530913 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3652/7305] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:28 2022] DELETE /identity/v3/users/9c374e77c5f84226a96451a339cc19a5 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:28.535674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688efe1a-2ce0-4b66-84d6-eebb946bf8fa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:28.536435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688efe1a-2ce0-4b66-84d6-eebb946bf8fa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:28.536884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688efe1a-2ce0-4b66-84d6-eebb946bf8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:28.573638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-688efe1a-2ce0-4b66-84d6-eebb946bf8fa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:28.574938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-688efe1a-2ce0-4b66-84d6-eebb946bf8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:28.791062 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3654/7306] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:28.802215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:28.804016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:28.959714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396f46ee-426c-4109-ad4c-e71b581556f6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:28.968267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bca47-0af6-4c4e-a156-fd3059a8d86e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:28.969905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bca47-0af6-4c4e-a156-fd3059a8d86e service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:28.970197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bca47-0af6-4c4e-a156-fd3059a8d86e service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:28.971377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bca47-0af6-4c4e-a156-fd3059a8d86e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:28.991788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bca47-0af6-4c4e-a156-fd3059a8d86e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:28.993419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bca47-0af6-4c4e-a156-fd3059a8d86e service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:29.007009 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3653/7307] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:29.288541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688efe1a-2ce0-4b66-84d6-eebb946bf8fa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:29.290554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-688efe1a-2ce0-4b66-84d6-eebb946bf8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:29.395832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688efe1a-2ce0-4b66-84d6-eebb946bf8fa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:29.401816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a01ae-24c8-465e-975a-18e0342faacd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:29.402612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a01ae-24c8-465e-975a-18e0342faacd service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:29.402836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a01ae-24c8-465e-975a-18e0342faacd service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:29.402989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74a01ae-24c8-465e-975a-18e0342faacd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:29.404715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d74a01ae-24c8-465e-975a-18e0342faacd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:29.425441 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:29.465182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bca47-0af6-4c4e-a156-fd3059a8d86e service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:29.469522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f72bca47-0af6-4c4e-a156-fd3059a8d86e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:29.500916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bca47-0af6-4c4e-a156-fd3059a8d86e service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:29.501504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a01ae-24c8-465e-975a-18e0342faacd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:29.503391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74a01ae-24c8-465e-975a-18e0342faacd service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:29.507087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:29.507959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:29.508243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:29.508520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] PATH_INFO: `/v3/projects/ce56fd7486ac402d8b896061cfc8e679` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:29.509813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce56fd7486ac402d8b896061cfc8e679)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:29.512658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:29.527434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3655/7308] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:29.597375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce56fd7486ac402d8b896061cfc8e679', 'request_id': 'req-71241258-ec33-45d8-8b69-f82fe33a1a9e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.605246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce56fd7486ac402d8b896061cfc8e679', 'request_id': 'req-71241258-ec33-45d8-8b69-f82fe33a1a9e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.609780 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:29.616723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce56fd7486ac402d8b896061cfc8e679', 'request_id': 'req-71241258-ec33-45d8-8b69-f82fe33a1a9e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.665368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] The token cache is being invalidate because project ce56fd7486ac402d8b896061cfc8e679 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:29.665658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.666286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.669356 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3654/7309] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:29 2022] DELETE /identity/v3/projects/ce56fd7486ac402d8b896061cfc8e679 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:25:29.673537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a01ae-24c8-465e-975a-18e0342faacd service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:29.685160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74a01ae-24c8-465e-975a-18e0342faacd service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:29.773825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:29.775144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:29.775571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:29.776043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] PATH_INFO: `/v3/users/3083c110c3584bffa5b07bc58e8311b4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:29.793015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3083c110c3584bffa5b07bc58e8311b4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:29.797707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:29.828881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:29.835165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:29.864758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71241258-ec33-45d8-8b69-f82fe33a1a9e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:29.870513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:29.871160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:29.871500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:29.871771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] PATH_INFO: `/v3/users/a24c9142ffcd4a38966ae41745b9029b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:29.872986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a24c9142ffcd4a38966ae41745b9029b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:29.876230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:29.890724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3083c110c3584bffa5b07bc58e8311b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.911045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3083c110c3584bffa5b07bc58e8311b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.912163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3083c110c3584bffa5b07bc58e8311b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.923829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3083c110c3584bffa5b07bc58e8311b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.939036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a24c9142ffcd4a38966ae41745b9029b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.940464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ff3523d6-9f39-428c-8188-56b313d63d8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3083c110c3584bffa5b07bc58e8311b4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.950883 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3656/7310] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:29 2022] DELETE /identity/v3/users/3083c110c3584bffa5b07bc58e8311b4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:25:29.959925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a24c9142ffcd4a38966ae41745b9029b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.960877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a24c9142ffcd4a38966ae41745b9029b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.971271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a24c9142ffcd4a38966ae41745b9029b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.984444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a24c9142ffcd4a38966ae41745b9029b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:29.993415 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3655/7311] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:29 2022] DELETE /identity/v3/users/a24c9142ffcd4a38966ae41745b9029b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:29.997793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f205-2584-4d40-b324-7328cd460c7d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:29.998088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f205-2584-4d40-b324-7328cd460c7d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:29.998395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f773f205-2584-4d40-b324-7328cd460c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:30.020614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f773f205-2584-4d40-b324-7328cd460c7d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:30.021889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f773f205-2584-4d40-b324-7328cd460c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:30.042833 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:30.125747 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3657/7312] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:30.146930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:30.149473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:30.204928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f205-2584-4d40-b324-7328cd460c7d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:30.205961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f773f205-2584-4d40-b324-7328cd460c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:30.236551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f773f205-2584-4d40-b324-7328cd460c7d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:30.255112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:30.256026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:30.256315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:30.256646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] PATH_INFO: `/v3/projects/8b60668729024760bbeb35ce231c607b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:30.258402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b60668729024760bbeb35ce231c607b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:30.260251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:30.285815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78cc810-f279-4eca-b804-4458f96978b1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:30.290713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e0d88f-e700-4479-be52-849b9c64a2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:30.291459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d88f-e700-4479-be52-849b9c64a2bd service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:30.292207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d88f-e700-4479-be52-849b9c64a2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:30.292553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e0d88f-e700-4479-be52-849b9c64a2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:30.307255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0d88f-e700-4479-be52-849b9c64a2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:30.309522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e0d88f-e700-4479-be52-849b9c64a2bd service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:30.336180 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3656/7313] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:30.338616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b60668729024760bbeb35ce231c607b', 'request_id': 'req-e6a92490-4d11-4eb6-95cd-a768e7682159'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:30.352831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b60668729024760bbeb35ce231c607b', 'request_id': 'req-e6a92490-4d11-4eb6-95cd-a768e7682159'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:30.363950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b60668729024760bbeb35ce231c607b', 'request_id': 'req-e6a92490-4d11-4eb6-95cd-a768e7682159'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:30.382276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] The token cache is being invalidate because project 8b60668729024760bbeb35ce231c607b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:30.382276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:30.382931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e6a92490-4d11-4eb6-95cd-a768e7682159 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:30.385938 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3658/7314] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:30 2022] DELETE /identity/v3/projects/8b60668729024760bbeb35ce231c607b => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:25:30.390250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebb63a-bfec-438a-921b-df500624a157 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:30.391684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebb63a-bfec-438a-921b-df500624a157 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:30.392729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ebb63a-bfec-438a-921b-df500624a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:30.432903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d2ebb63a-bfec-438a-921b-df500624a157 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:30.434702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2ebb63a-bfec-438a-921b-df500624a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:30.597367 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3657/7315] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:30.599494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba8817-d41b-494b-a08c-a1631d3a87e9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:30.599912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba8817-d41b-494b-a08c-a1631d3a87e9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:30.600403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba8817-d41b-494b-a08c-a1631d3a87e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:30.645840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-82ba8817-d41b-494b-a08c-a1631d3a87e9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:30.654806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-82ba8817-d41b-494b-a08c-a1631d3a87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:30.676939 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3659/7316] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:25:30.682284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebb63a-bfec-438a-921b-df500624a157 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:30.691804 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:30.701607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba8817-d41b-494b-a08c-a1631d3a87e9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:30.703395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-82ba8817-d41b-494b-a08c-a1631d3a87e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:30.705785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ebb63a-bfec-438a-921b-df500624a157 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:30.719808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a3ef-beeb-462b-839f-5766f8dc4886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:30.721207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a3ef-beeb-462b-839f-5766f8dc4886 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:30.722144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a3ef-beeb-462b-839f-5766f8dc4886 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:30.722429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a6a3ef-beeb-462b-839f-5766f8dc4886 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:30.724284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6a3ef-beeb-462b-839f-5766f8dc4886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:30.724599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6a3ef-beeb-462b-839f-5766f8dc4886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:30.728399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a6a3ef-beeb-462b-839f-5766f8dc4886 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:30.734884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba8817-d41b-494b-a08c-a1631d3a87e9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:30.752970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:30.757008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:30.758005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:30.761962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] PATH_INFO: `/v3/projects/4baca0a3afd245108c3216b3e7b34c5a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:30.765437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4baca0a3afd245108c3216b3e7b34c5a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:30.767478 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3658/7317] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:30.772751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a3ef-beeb-462b-839f-5766f8dc4886 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:30.776015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:30.797421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a6a3ef-beeb-462b-839f-5766f8dc4886 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:30.803135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6239e8-4ca4-4427-a354-3b8b310f4eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:30.804793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6239e8-4ca4-4427-a354-3b8b310f4eda admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:30.805572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6239e8-4ca4-4427-a354-3b8b310f4eda admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:30.805919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6239e8-4ca4-4427-a354-3b8b310f4eda admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:30.806630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6239e8-4ca4-4427-a354-3b8b310f4eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:30.808813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6239e8-4ca4-4427-a354-3b8b310f4eda admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:30.903017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4baca0a3afd245108c3216b3e7b34c5a', 'request_id': 'req-46774c32-1786-40ce-a484-4efe829774a1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:30.908277 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3659/7318] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:30 2022] POST /identity/v3/projects => generated 371 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:25:30.912620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6239e8-4ca4-4427-a354-3b8b310f4eda admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:30.922437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4baca0a3afd245108c3216b3e7b34c5a', 'request_id': 'req-46774c32-1786-40ce-a484-4efe829774a1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:30.962078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4baca0a3afd245108c3216b3e7b34c5a', 'request_id': 'req-46774c32-1786-40ce-a484-4efe829774a1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:31.011281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] The token cache is being invalidate because project 4baca0a3afd245108c3216b3e7b34c5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:31.011897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:31.013023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46774c32-1786-40ce-a484-4efe829774a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:31.015476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6239e8-4ca4-4427-a354-3b8b310f4eda admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.015594 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3660/7319] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:30 2022] DELETE /identity/v3/projects/4baca0a3afd245108c3216b3e7b34c5a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:31.020621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4d77-2d3e-415e-99e4-772f7e918d93 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.021235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4d77-2d3e-415e-99e4-772f7e918d93 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.024575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290f283-c061-4fb9-8bb8-561f449e3f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.025378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290f283-c061-4fb9-8bb8-561f449e3f83 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.025558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3e4d77-2d3e-415e-99e4-772f7e918d93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.025793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290f283-c061-4fb9-8bb8-561f449e3f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.026183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290f283-c061-4fb9-8bb8-561f449e3f83 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.027743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290f283-c061-4fb9-8bb8-561f449e3f83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.030447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290f283-c061-4fb9-8bb8-561f449e3f83 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.058690 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3660/7320] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:30 2022] POST /identity/v3/users => generated 286 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:31.061783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8a3e4d77-2d3e-415e-99e4-772f7e918d93 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:31.062893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290f283-c061-4fb9-8bb8-561f449e3f83 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.062992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8a3e4d77-2d3e-415e-99e4-772f7e918d93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:31.064774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d290f283-c061-4fb9-8bb8-561f449e3f83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:31.090552 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3661/7321] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:31.094287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290f283-c061-4fb9-8bb8-561f449e3f83 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.099918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8b24b-9613-45da-bbc1-ba31de8c71fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.100561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8b24b-9613-45da-bbc1-ba31de8c71fc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.100969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8b24b-9613-45da-bbc1-ba31de8c71fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.101255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8b24b-9613-45da-bbc1-ba31de8c71fc admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.101936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8b24b-9613-45da-bbc1-ba31de8c71fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.103561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8b24b-9613-45da-bbc1-ba31de8c71fc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.110869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111be71-192a-4c2a-9899-fe0d503cd9f2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.111396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111be71-192a-4c2a-9899-fe0d503cd9f2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.112399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6111be71-192a-4c2a-9899-fe0d503cd9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.115739 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3661/7322] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:31.119476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8b24b-9613-45da-bbc1-ba31de8c71fc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.144622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8b24b-9613-45da-bbc1-ba31de8c71fc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.148648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6111be71-192a-4c2a-9899-fe0d503cd9f2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:31.150533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6111be71-192a-4c2a-9899-fe0d503cd9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:31.160401 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3662/7323] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:31.166058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111be71-192a-4c2a-9899-fe0d503cd9f2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.166914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056507de-0ef0-44e5-8e7a-d2a9b5605f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.167706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056507de-0ef0-44e5-8e7a-d2a9b5605f14 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.168131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056507de-0ef0-44e5-8e7a-d2a9b5605f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.168558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056507de-0ef0-44e5-8e7a-d2a9b5605f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.169361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056507de-0ef0-44e5-8e7a-d2a9b5605f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.172237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056507de-0ef0-44e5-8e7a-d2a9b5605f14 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.183301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6111be71-192a-4c2a-9899-fe0d503cd9f2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.196296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d352d0-99c9-41d5-a3fa-6bd1f30007e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.198678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d352d0-99c9-41d5-a3fa-6bd1f30007e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.199363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d352d0-99c9-41d5-a3fa-6bd1f30007e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.199363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d352d0-99c9-41d5-a3fa-6bd1f30007e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.200921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d352d0-99c9-41d5-a3fa-6bd1f30007e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:31.201246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d352d0-99c9-41d5-a3fa-6bd1f30007e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.206937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d352d0-99c9-41d5-a3fa-6bd1f30007e6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.208062 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3662/7324] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:31.213467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056507de-0ef0-44e5-8e7a-d2a9b5605f14 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.224373 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:31.237096 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3663/7325] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:31.237683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056507de-0ef0-44e5-8e7a-d2a9b5605f14 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.241980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d352d0-99c9-41d5-a3fa-6bd1f30007e6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.256546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cc255d-b9d2-42fd-acdb-a6529d722396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.257531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d352d0-99c9-41d5-a3fa-6bd1f30007e6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.257750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc255d-b9d2-42fd-acdb-a6529d722396 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.258030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc255d-b9d2-42fd-acdb-a6529d722396 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.258296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cc255d-b9d2-42fd-acdb-a6529d722396 admin admin] PATH_INFO: `/v3/projects/d913e4a2a6ab49298034a1bc84811bb7/users/4bf94c47fa14420e9a3e899993e2bb7f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.265704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d95190-90ca-463f-9dfa-1612ac4064b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.266549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d95190-90ca-463f-9dfa-1612ac4064b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.267110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d95190-90ca-463f-9dfa-1612ac4064b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.267540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d95190-90ca-463f-9dfa-1612ac4064b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.268381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d95190-90ca-463f-9dfa-1612ac4064b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.272297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d95190-90ca-463f-9dfa-1612ac4064b6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.295614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc255d-b9d2-42fd-acdb-a6529d722396 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d913e4a2a6ab49298034a1bc84811bb7, user_id=4bf94c47fa14420e9a3e899993e2bb7f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.298443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05cc255d-b9d2-42fd-acdb-a6529d722396 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.319119 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3663/7326] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:31 2022] PUT /identity/v3/projects/d913e4a2a6ab49298034a1bc84811bb7/users/4bf94c47fa14420e9a3e899993e2bb7f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:31.326010 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3664/7327] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:31 2022] POST /identity/v3/projects => generated 353 bytes in 85 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:31.334811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d95190-90ca-463f-9dfa-1612ac4064b6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.339494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a0273-7c2e-4f13-9473-448a008d5a97 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.339783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a0273-7c2e-4f13-9473-448a008d5a97 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.340080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a0273-7c2e-4f13-9473-448a008d5a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.425986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5f6a0273-7c2e-4f13-9473-448a008d5a97 None None] MFA Rules not processed for user `4bf94c47fa14420e9a3e899993e2bb7f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:31.427324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5f6a0273-7c2e-4f13-9473-448a008d5a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:31.474799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d95190-90ca-463f-9dfa-1612ac4064b6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.486884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe796b1-3d45-49a9-9c3c-795734bd303b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.487517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe796b1-3d45-49a9-9c3c-795734bd303b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.487800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe796b1-3d45-49a9-9c3c-795734bd303b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.488077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe796b1-3d45-49a9-9c3c-795734bd303b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.488712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe796b1-3d45-49a9-9c3c-795734bd303b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.493335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe796b1-3d45-49a9-9c3c-795734bd303b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.566897 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3665/7328] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:31 2022] POST /identity/v3/users => generated 277 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:31.571170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe796b1-3d45-49a9-9c3c-795734bd303b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.604400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe796b1-3d45-49a9-9c3c-795734bd303b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.605779 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:31.625467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfb96f-a89e-4202-858b-fb0db3ece47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.625467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfb96f-a89e-4202-858b-fb0db3ece47b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.625467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfb96f-a89e-4202-858b-fb0db3ece47b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.625808 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3664/7329] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:31.625890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cfb96f-a89e-4202-858b-fb0db3ece47b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.625890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfb96f-a89e-4202-858b-fb0db3ece47b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.626867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cfb96f-a89e-4202-858b-fb0db3ece47b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.629320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a0273-7c2e-4f13-9473-448a008d5a97 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.648011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a0273-7c2e-4f13-9473-448a008d5a97 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.662220 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3666/7330] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:31.681415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfb96f-a89e-4202-858b-fb0db3ece47b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.683539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6294a57-6dc9-438e-8776-e64c703974f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.686583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294a57-6dc9-438e-8776-e64c703974f8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.686975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294a57-6dc9-438e-8776-e64c703974f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.688393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6294a57-6dc9-438e-8776-e64c703974f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.689054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6294a57-6dc9-438e-8776-e64c703974f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.694909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6294a57-6dc9-438e-8776-e64c703974f8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.703565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cfb96f-a89e-4202-858b-fb0db3ece47b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.715076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75a5d-5ac4-4598-8285-811e8058a4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.715691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75a5d-5ac4-4598-8285-811e8058a4a0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.716197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75a5d-5ac4-4598-8285-811e8058a4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.716480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f75a5d-5ac4-4598-8285-811e8058a4a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.717809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f75a5d-5ac4-4598-8285-811e8058a4a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.725600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f75a5d-5ac4-4598-8285-811e8058a4a0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.760513 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3667/7331] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:31.771355 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3665/7332] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:31 2022] POST /identity/v3/projects => generated 371 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:31.771584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75a5d-5ac4-4598-8285-811e8058a4a0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.772324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6294a57-6dc9-438e-8776-e64c703974f8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:31.788343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f75a5d-5ac4-4598-8285-811e8058a4a0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:31.873014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db15a39-5c9e-428b-87f8-1318a5bc8a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:31.874335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15a39-5c9e-428b-87f8-1318a5bc8a92 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.875530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15a39-5c9e-428b-87f8-1318a5bc8a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.879638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db15a39-5c9e-428b-87f8-1318a5bc8a92 admin admin] PATH_INFO: `/v3/projects/df180c027e38499d9f5815de28c17aa7/users/4f9bd700fd51400f9224b284af6831bc/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.915580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db15a39-5c9e-428b-87f8-1318a5bc8a92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df180c027e38499d9f5815de28c17aa7, user_id=4f9bd700fd51400f9224b284af6831bc, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:31.922696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db15a39-5c9e-428b-87f8-1318a5bc8a92 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:31.965684 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3668/7333] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:31 2022] PUT /identity/v3/projects/df180c027e38499d9f5815de28c17aa7/users/4f9bd700fd51400f9224b284af6831bc/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:31.977382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457d3d5-d157-4ffa-93d6-4eb85f208dba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:31.977829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457d3d5-d157-4ffa-93d6-4eb85f208dba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:31.978216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2457d3d5-d157-4ffa-93d6-4eb85f208dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:31.993257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6294a57-6dc9-438e-8776-e64c703974f8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:32.066147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2457d3d5-d157-4ffa-93d6-4eb85f208dba None None] MFA Rules not processed for user `4f9bd700fd51400f9224b284af6831bc`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:32.080344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2457d3d5-d157-4ffa-93d6-4eb85f208dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:32.135358 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:32.172134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b68397-3efc-481f-a54c-11bab60bf217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:32.173906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b68397-3efc-481f-a54c-11bab60bf217 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.174196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b68397-3efc-481f-a54c-11bab60bf217 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.174468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b68397-3efc-481f-a54c-11bab60bf217 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.178788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b68397-3efc-481f-a54c-11bab60bf217 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:32.184183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b68397-3efc-481f-a54c-11bab60bf217 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:32.220576 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3666/7334] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:31 2022] POST /identity/v3/users => generated 292 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:32.222664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b68397-3efc-481f-a54c-11bab60bf217 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:32.251344 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3669/7335] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:31 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:32.257886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457d3d5-d157-4ffa-93d6-4eb85f208dba None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:32.259368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2457d3d5-d157-4ffa-93d6-4eb85f208dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:32.260007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b68397-3efc-481f-a54c-11bab60bf217 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:32.266082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79903a5-ad81-4116-bb83-02393a5e6ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:32.266825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79903a5-ad81-4116-bb83-02393a5e6ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.267372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79903a5-ad81-4116-bb83-02393a5e6ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.268002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79903a5-ad81-4116-bb83-02393a5e6ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.268848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79903a5-ad81-4116-bb83-02393a5e6ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:32.273566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79903a5-ad81-4116-bb83-02393a5e6ed0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:32.289956 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3667/7336] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:32.290978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79903a5-ad81-4116-bb83-02393a5e6ed0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:32.306523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79903a5-ad81-4116-bb83-02393a5e6ed0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:32.316128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a433a0-23ef-403b-9c9e-e969866564ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:32.316955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a433a0-23ef-403b-9c9e-e969866564ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.317241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a433a0-23ef-403b-9c9e-e969866564ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.317553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a433a0-23ef-403b-9c9e-e969866564ff admin admin] PATH_INFO: `/v3/projects/dd5aea6db7df47fd8826554810d3fc5d/users/57e94fb302844dd7a1705d6e6dc4db81/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.336073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2457d3d5-d157-4ffa-93d6-4eb85f208dba None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:32.338942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a433a0-23ef-403b-9c9e-e969866564ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5aea6db7df47fd8826554810d3fc5d, user_id=57e94fb302844dd7a1705d6e6dc4db81, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:32.340060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3faaf-241a-4003-8614-f5e05ede1022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:32.340682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3faaf-241a-4003-8614-f5e05ede1022 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.340963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3faaf-241a-4003-8614-f5e05ede1022 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.341237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b3faaf-241a-4003-8614-f5e05ede1022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.341670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a433a0-23ef-403b-9c9e-e969866564ff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:32.351611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3faaf-241a-4003-8614-f5e05ede1022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:32.353062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b3faaf-241a-4003-8614-f5e05ede1022 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:32.364689 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3670/7337] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:32 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:32.368954 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3668/7338] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:32 2022] PUT /identity/v3/projects/dd5aea6db7df47fd8826554810d3fc5d/users/57e94fb302844dd7a1705d6e6dc4db81/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:32.372675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3faaf-241a-4003-8614-f5e05ede1022 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:32.386059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b3faaf-241a-4003-8614-f5e05ede1022 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:32.470255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c04548-3a3f-4809-878c-a679dc28fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:32.471935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04548-3a3f-4809-878c-a679dc28fae5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.473321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04548-3a3f-4809-878c-a679dc28fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.473321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c04548-3a3f-4809-878c-a679dc28fae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.474676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c04548-3a3f-4809-878c-a679dc28fae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:32.476542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c04548-3a3f-4809-878c-a679dc28fae5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:32.490742 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3671/7339] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:25:32.494866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a433a0-23ef-403b-9c9e-e969866564ff admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:32.507823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a433a0-23ef-403b-9c9e-e969866564ff admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:32.513217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01869623-a33b-403b-801b-b38eddf81766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:32.514004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01869623-a33b-403b-801b-b38eddf81766 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.514900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01869623-a33b-403b-801b-b38eddf81766 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.515311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01869623-a33b-403b-801b-b38eddf81766 admin admin] PATH_INFO: `/v3/projects/dd5aea6db7df47fd8826554810d3fc5d/users/57e94fb302844dd7a1705d6e6dc4db81/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.517321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01869623-a33b-403b-801b-b38eddf81766 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd5aea6db7df47fd8826554810d3fc5d, user_id=57e94fb302844dd7a1705d6e6dc4db81, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:32.520423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01869623-a33b-403b-801b-b38eddf81766 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:32.543328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3669/7340] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:32 2022] PUT /identity/v3/projects/dd5aea6db7df47fd8826554810d3fc5d/users/57e94fb302844dd7a1705d6e6dc4db81/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:32.544701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf951b-66bf-418c-b68c-afd163845c76 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.545060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf951b-66bf-418c-b68c-afd163845c76 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.546009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf951b-66bf-418c-b68c-afd163845c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.597644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9ddf951b-66bf-418c-b68c-afd163845c76 None None] MFA Rules not processed for user `57e94fb302844dd7a1705d6e6dc4db81`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:32.599855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9ddf951b-66bf-418c-b68c-afd163845c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:32.679370 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:32.735167 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3672/7341] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:32 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:32.739864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01869623-a33b-403b-801b-b38eddf81766 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:32.759100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01869623-a33b-403b-801b-b38eddf81766 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:32.765592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3e028-603c-4582-a8b6-00611abdd7bc tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e94fb302844dd7a1705d6e6dc4db81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5aea6db7df47fd8826554810d3fc5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:32.766531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3e028-603c-4582-a8b6-00611abdd7bc tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.767166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3e028-603c-4582-a8b6-00611abdd7bc tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.767690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b3e028-603c-4582-a8b6-00611abdd7bc tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.768561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3e028-603c-4582-a8b6-00611abdd7bc tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:32.769067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3e028-603c-4582-a8b6-00611abdd7bc tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:32.771008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b3e028-603c-4582-a8b6-00611abdd7bc tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:32.794080 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3670/7342] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:32.794211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf951b-66bf-418c-b68c-afd163845c76 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:32.806670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddf951b-66bf-418c-b68c-afd163845c76 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:32.816207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640ca88-4da5-490c-b2d7-f39ba9cae851 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e94fb302844dd7a1705d6e6dc4db81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5aea6db7df47fd8826554810d3fc5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:32.816924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640ca88-4da5-490c-b2d7-f39ba9cae851 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.817312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640ca88-4da5-490c-b2d7-f39ba9cae851 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.817659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3640ca88-4da5-490c-b2d7-f39ba9cae851 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.818980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640ca88-4da5-490c-b2d7-f39ba9cae851 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:32.821470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3640ca88-4da5-490c-b2d7-f39ba9cae851 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:32.866158 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3673/7343] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:32 2022] POST /identity/v3/projects => generated 349 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:32.866915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3e028-603c-4582-a8b6-00611abdd7bc tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:32.879879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b3e028-603c-4582-a8b6-00611abdd7bc tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:32.890047 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:32.991203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5af56-3f25-474c-8bba-95d546cff364 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e94fb302844dd7a1705d6e6dc4db81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5aea6db7df47fd8826554810d3fc5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:32.993975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5af56-3f25-474c-8bba-95d546cff364 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:32.994317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5af56-3f25-474c-8bba-95d546cff364 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:32.994666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5af56-3f25-474c-8bba-95d546cff364 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:32.996261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5af56-3f25-474c-8bba-95d546cff364 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:32.996404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5af56-3f25-474c-8bba-95d546cff364 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:32.998115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5af56-3f25-474c-8bba-95d546cff364 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:33.017871 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3671/7344] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:33.029284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640ca88-4da5-490c-b2d7-f39ba9cae851 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:33.165006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3640ca88-4da5-490c-b2d7-f39ba9cae851 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:33.177108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4343f53a-1645-4cb6-87a5-169fad2e8f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:33.177924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f53a-1645-4cb6-87a5-169fad2e8f4c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:33.178307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f53a-1645-4cb6-87a5-169fad2e8f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:33.179726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343f53a-1645-4cb6-87a5-169fad2e8f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:33.200026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343f53a-1645-4cb6-87a5-169fad2e8f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:33.201867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4343f53a-1645-4cb6-87a5-169fad2e8f4c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:33.215054 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3674/7345] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:33 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:35.575773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5af56-3f25-474c-8bba-95d546cff364 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:35.658166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5af56-3f25-474c-8bba-95d546cff364 tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:35.663125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:35.664465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:35.664465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:35.664465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] PATH_INFO: `/v3/users/4f9bd700fd51400f9224b284af6831bc` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:35.665718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f9bd700fd51400f9224b284af6831bc)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:35.667645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:35.750918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f9bd700fd51400f9224b284af6831bc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:35.766442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f9bd700fd51400f9224b284af6831bc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:35.767441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f9bd700fd51400f9224b284af6831bc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:35.781316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f9bd700fd51400f9224b284af6831bc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:35.794711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f9bd700fd51400f9224b284af6831bc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:35.805483 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3672/7346] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:35 2022] DELETE /identity/v3/users/4f9bd700fd51400f9224b284af6831bc => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:35.810542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9ba9-e057-4559-860b-646c006f509d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:35.810952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9ba9-e057-4559-860b-646c006f509d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:35.810952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06e9ba9-e057-4559-860b-646c006f509d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:35.835818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c06e9ba9-e057-4559-860b-646c006f509d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:35.837401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c06e9ba9-e057-4559-860b-646c006f509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:35.981677 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3675/7347] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:35.996040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:35.997845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:36.069084 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:36.126773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9017625c-8fd6-49dd-b9ae-c15a17333511 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:36.154020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9b1b0-c8b5-4820-80df-4c0bc08f4590 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:36.155425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9b1b0-c8b5-4820-80df-4c0bc08f4590 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:36.156710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9b1b0-c8b5-4820-80df-4c0bc08f4590 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:36.157495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e9b1b0-c8b5-4820-80df-4c0bc08f4590 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:36.188579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9b1b0-c8b5-4820-80df-4c0bc08f4590 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:36.190935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e9b1b0-c8b5-4820-80df-4c0bc08f4590 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:36.213402 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3673/7348] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:36.453945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9ba9-e057-4559-860b-646c006f509d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:36.455462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c06e9ba9-e057-4559-860b-646c006f509d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:36.555702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06e9ba9-e057-4559-860b-646c006f509d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:36.564833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '57e94fb302844dd7a1705d6e6dc4db81', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dd5aea6db7df47fd8826554810d3fc5d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:36.565423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:36.565708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:36.565982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] PATH_INFO: `/v3/projects/133e47176fbe43dea2f61ed03c891bd0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:36.569540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Authorizing `identity:delete_project(project_id=133e47176fbe43dea2f61ed03c891bd0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:36.572390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:36.575965 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:36.594086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9b1b0-c8b5-4820-80df-4c0bc08f4590 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:36.596418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-65e9b1b0-c8b5-4820-80df-4c0bc08f4590 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:36.635314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e9b1b0-c8b5-4820-80df-4c0bc08f4590 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:36.641112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:36.641852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:36.642222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:36.642569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] PATH_INFO: `/v3/projects/df180c027e38499d9f5815de28c17aa7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:36.643779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] RBAC: Authorizing `identity:delete_project(project_id=df180c027e38499d9f5815de28c17aa7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:36.646301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:36.689181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '133e47176fbe43dea2f61ed03c891bd0', 'request_id': 'req-59ce9965-3b42-4173-a655-1e0030725b6b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.699007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '133e47176fbe43dea2f61ed03c891bd0', 'request_id': 'req-59ce9965-3b42-4173-a655-1e0030725b6b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.711709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '133e47176fbe43dea2f61ed03c891bd0', 'request_id': 'req-59ce9965-3b42-4173-a655-1e0030725b6b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.712921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df180c027e38499d9f5815de28c17aa7', 'request_id': 'req-45e036e5-57bb-4bf2-a560-e967e4bcb54f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.720507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df180c027e38499d9f5815de28c17aa7', 'request_id': 'req-45e036e5-57bb-4bf2-a560-e967e4bcb54f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.723265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] The token cache is being invalidate because project 133e47176fbe43dea2f61ed03c891bd0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:36.723576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.724265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.730853 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3676/7349] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:36 2022] DELETE /identity/v3/projects/133e47176fbe43dea2f61ed03c891bd0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:36.732329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:36.734914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:36.736684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df180c027e38499d9f5815de28c17aa7', 'request_id': 'req-45e036e5-57bb-4bf2-a560-e967e4bcb54f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.759263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] The token cache is being invalidate because project df180c027e38499d9f5815de28c17aa7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:36.759868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.760726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-45e036e5-57bb-4bf2-a560-e967e4bcb54f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:36.764869 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3674/7350] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:36 2022] DELETE /identity/v3/projects/df180c027e38499d9f5815de28c17aa7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:36.769143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5f95d-c7b5-42fd-827f-1b1f90ac789f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:36.772637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5f95d-c7b5-42fd-827f-1b1f90ac789f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:36.772926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5f95d-c7b5-42fd-827f-1b1f90ac789f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:36.797212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cfd5f95d-c7b5-42fd-827f-1b1f90ac789f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:36.798850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cfd5f95d-c7b5-42fd-827f-1b1f90ac789f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:36.839245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce9965-3b42-4173-a655-1e0030725b6b tempest-QuotasNegativeTest-611136522 tempest-QuotasNegativeTest-611136522-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:36.930000 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3675/7351] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:36.940345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fc751-349e-4b95-926c-16a63d17fcf3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:36.940701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fc751-349e-4b95-926c-16a63d17fcf3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:36.941050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2fc751-349e-4b95-926c-16a63d17fcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:36.964231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:36.965400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:36.965957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:36.966153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1d2fc751-349e-4b95-926c-16a63d17fcf3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:36.966627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] PATH_INFO: `/v3/users/4bf94c47fa14420e9a3e899993e2bb7f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:36.968045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1d2fc751-349e-4b95-926c-16a63d17fcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:36.968954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bf94c47fa14420e9a3e899993e2bb7f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:36.971507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:36.984052 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3676/7352] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:36.984975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fc751-349e-4b95-926c-16a63d17fcf3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:36.998064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2fc751-349e-4b95-926c-16a63d17fcf3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:37.006813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d74df-75fd-4fe9-9cc5-45ecd4d76da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:37.007434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d74df-75fd-4fe9-9cc5-45ecd4d76da5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:37.007849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d74df-75fd-4fe9-9cc5-45ecd4d76da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:37.007963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d74df-75fd-4fe9-9cc5-45ecd4d76da5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:37.008537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d74df-75fd-4fe9-9cc5-45ecd4d76da5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:37.008921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d74df-75fd-4fe9-9cc5-45ecd4d76da5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:37.011080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84d74df-75fd-4fe9-9cc5-45ecd4d76da5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:37.031248 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3677/7353] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:37.035863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d74df-75fd-4fe9-9cc5-45ecd4d76da5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:37.038089 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:37.047919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bf94c47fa14420e9a3e899993e2bb7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:37.051049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d74df-75fd-4fe9-9cc5-45ecd4d76da5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:37.057091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac3fa8-0756-43dc-9a28-8a2a68b831ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:37.058346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac3fa8-0756-43dc-9a28-8a2a68b831ed admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:37.058632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac3fa8-0756-43dc-9a28-8a2a68b831ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:37.059042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac3fa8-0756-43dc-9a28-8a2a68b831ed admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:37.059826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac3fa8-0756-43dc-9a28-8a2a68b831ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:37.062728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac3fa8-0756-43dc-9a28-8a2a68b831ed admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:37.068616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bf94c47fa14420e9a3e899993e2bb7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:37.070093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bf94c47fa14420e9a3e899993e2bb7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:37.084621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bf94c47fa14420e9a3e899993e2bb7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:37.101473 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3678/7354] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:37 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:37.102419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-56e7a8f7-2cf3-4ab6-9b3b-b423436e8abc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bf94c47fa14420e9a3e899993e2bb7f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:37.105218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac3fa8-0756-43dc-9a28-8a2a68b831ed admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:37.106878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-54ac3fa8-0756-43dc-9a28-8a2a68b831ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:37.124630 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:37.125036 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3677/7355] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:36 2022] DELETE /identity/v3/users/4bf94c47fa14420e9a3e899993e2bb7f => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:37.126914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21063-1539-4e0b-af15-d384c655a866 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:37.127210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21063-1539-4e0b-af15-d384c655a866 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:37.127490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e21063-1539-4e0b-af15-d384c655a866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:37.160538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-33e21063-1539-4e0b-af15-d384c655a866 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:37.162393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-33e21063-1539-4e0b-af15-d384c655a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:37.216382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac3fa8-0756-43dc-9a28-8a2a68b831ed admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:37.305663 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3678/7356] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:25:37.307628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21063-1539-4e0b-af15-d384c655a866 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:37.309428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-33e21063-1539-4e0b-af15-d384c655a866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:37.393999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f0eed-f2bd-40d8-83aa-a374dedd72e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:37.394624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f0eed-f2bd-40d8-83aa-a374dedd72e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:37.394909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f0eed-f2bd-40d8-83aa-a374dedd72e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:37.395187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03f0eed-f2bd-40d8-83aa-a374dedd72e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:37.395999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f0eed-f2bd-40d8-83aa-a374dedd72e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:37.398304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03f0eed-f2bd-40d8-83aa-a374dedd72e8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:37.440063 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3679/7357] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:37 2022] POST /identity/v3/users => generated 284 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:25:37.443693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f0eed-f2bd-40d8-83aa-a374dedd72e8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:37.448840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e21063-1539-4e0b-af15-d384c655a866 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:37.453568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e8c76-2b5a-4492-8bca-18c58c4d38c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:37.454320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e8c76-2b5a-4492-8bca-18c58c4d38c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:37.454800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e8c76-2b5a-4492-8bca-18c58c4d38c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:37.455128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421e8c76-2b5a-4492-8bca-18c58c4d38c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:37.469140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03f0eed-f2bd-40d8-83aa-a374dedd72e8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:37.471106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e8c76-2b5a-4492-8bca-18c58c4d38c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:37.472814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421e8c76-2b5a-4492-8bca-18c58c4d38c0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:37.485075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dcba6-2f28-44e6-94e5-b62d81210815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:37.486755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dcba6-2f28-44e6-94e5-b62d81210815 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:37.487610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dcba6-2f28-44e6-94e5-b62d81210815 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:37.488763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dcba6-2f28-44e6-94e5-b62d81210815 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:37.491540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dcba6-2f28-44e6-94e5-b62d81210815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:37.494636 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3679/7358] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:37.505643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2dcba6-2f28-44e6-94e5-b62d81210815 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:37.528453 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3680/7359] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:37.532545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e8c76-2b5a-4492-8bca-18c58c4d38c0 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:37.562610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421e8c76-2b5a-4492-8bca-18c58c4d38c0 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:37.578485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4933c2c-44e4-4403-b31a-f49f0da5dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:37.579442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4933c2c-44e4-4403-b31a-f49f0da5dd72 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:37.579996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4933c2c-44e4-4403-b31a-f49f0da5dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:37.580188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4933c2c-44e4-4403-b31a-f49f0da5dd72 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:37.583414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4933c2c-44e4-4403-b31a-f49f0da5dd72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:37.585147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4933c2c-44e4-4403-b31a-f49f0da5dd72 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:37.636623 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3680/7360] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:37 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:37.638042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dcba6-2f28-44e6-94e5-b62d81210815 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:37.652838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2dcba6-2f28-44e6-94e5-b62d81210815 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:37.659366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281a6ba-539d-49a1-bceb-62ea71e77e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:37.661963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281a6ba-539d-49a1-bceb-62ea71e77e02 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:37.662510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281a6ba-539d-49a1-bceb-62ea71e77e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:37.662986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6281a6ba-539d-49a1-bceb-62ea71e77e02 admin admin] PATH_INFO: `/v3/projects/d67a41a7f1c5455789de9f1d87b74020/users/8a63e7f9675e4c199271be3687551035/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:37.698167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281a6ba-539d-49a1-bceb-62ea71e77e02 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d67a41a7f1c5455789de9f1d87b74020, user_id=8a63e7f9675e4c199271be3687551035, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:37.730758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6281a6ba-539d-49a1-bceb-62ea71e77e02 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:37.774447 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3681/7361] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:37 2022] PUT /identity/v3/projects/d67a41a7f1c5455789de9f1d87b74020/users/8a63e7f9675e4c199271be3687551035/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:37.787242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295eb53-255f-4179-a41c-b213080cdfd2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:37.787788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295eb53-255f-4179-a41c-b213080cdfd2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:37.788746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4295eb53-255f-4179-a41c-b213080cdfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:37.866486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4295eb53-255f-4179-a41c-b213080cdfd2 None None] MFA Rules not processed for user `8a63e7f9675e4c199271be3687551035`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:37.868019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4295eb53-255f-4179-a41c-b213080cdfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:37.938113 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:37.984702 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3681/7362] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:37.987953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281a6ba-539d-49a1-bceb-62ea71e77e02 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:38.100429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6281a6ba-539d-49a1-bceb-62ea71e77e02 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:38.105865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17060922-6168-4d80-8978-d38ea21516d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:38.106629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17060922-6168-4d80-8978-d38ea21516d6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:38.107011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17060922-6168-4d80-8978-d38ea21516d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:38.107386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17060922-6168-4d80-8978-d38ea21516d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:38.108653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17060922-6168-4d80-8978-d38ea21516d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:38.110876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17060922-6168-4d80-8978-d38ea21516d6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:38.184287 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:38.197609 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3682/7363] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:37 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:38.205544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295eb53-255f-4179-a41c-b213080cdfd2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:38.241460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4295eb53-255f-4179-a41c-b213080cdfd2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:38.265195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17060922-6168-4d80-8978-d38ea21516d6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:38.267952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-17060922-6168-4d80-8978-d38ea21516d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:38.436844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f700e6-8a18-498e-9677-4ae9f78e39a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:38.437721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f700e6-8a18-498e-9677-4ae9f78e39a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:38.438078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f700e6-8a18-498e-9677-4ae9f78e39a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:38.438416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f700e6-8a18-498e-9677-4ae9f78e39a5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:38.439218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f700e6-8a18-498e-9677-4ae9f78e39a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:38.441543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f700e6-8a18-498e-9677-4ae9f78e39a5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:38.453429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17060922-6168-4d80-8978-d38ea21516d6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:38.466426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:38.468216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:38.468505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:38.469642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] PATH_INFO: `/v3/projects/d913e4a2a6ab49298034a1bc84811bb7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:38.471028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d913e4a2a6ab49298034a1bc84811bb7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:38.479000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:38.482995 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3682/7364] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:38 2022] POST /identity/v3/users => generated 291 bytes in 278 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:38.488518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f700e6-8a18-498e-9677-4ae9f78e39a5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:38.515145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f700e6-8a18-498e-9677-4ae9f78e39a5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:38.535120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c61ef2-d930-4450-b0c0-42119bcb724c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:38.557511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c61ef2-d930-4450-b0c0-42119bcb724c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:38.557511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c61ef2-d930-4450-b0c0-42119bcb724c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:38.557511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c61ef2-d930-4450-b0c0-42119bcb724c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:38.586416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd913e4a2a6ab49298034a1bc84811bb7', 'request_id': 'req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:38.594566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c61ef2-d930-4450-b0c0-42119bcb724c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:38.601594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c61ef2-d930-4450-b0c0-42119bcb724c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:38.606007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd913e4a2a6ab49298034a1bc84811bb7', 'request_id': 'req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:38.626935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd913e4a2a6ab49298034a1bc84811bb7', 'request_id': 'req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:38.633238 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3683/7365] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:38.640153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c61ef2-d930-4450-b0c0-42119bcb724c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:38.653978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] The token cache is being invalidate because project d913e4a2a6ab49298034a1bc84811bb7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:38.655063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:38.657271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:38.660877 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3683/7366] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:38 2022] DELETE /identity/v3/projects/d913e4a2a6ab49298034a1bc84811bb7 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:38.665672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:38.669651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c61ef2-d930-4450-b0c0-42119bcb724c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:38.673133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:38.832326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f7bdd-507a-4de8-876c-171bb6f3f5b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:38.833183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b373520-a4c2-4ebe-bdb2-af35a7a1055b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:38.833847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7bdd-507a-4de8-876c-171bb6f3f5b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:38.834133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7bdd-507a-4de8-876c-171bb6f3f5b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:38.834418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28f7bdd-507a-4de8-876c-171bb6f3f5b1 admin admin] PATH_INFO: `/v3/projects/15d2051bc31c4a819fe5bb94aa39fd12/users/c2dcb156686542f1a7af49f46abc8b23/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:38.852598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:38.856238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:38.856238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:38.856461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] PATH_INFO: `/v3/users/57e94fb302844dd7a1705d6e6dc4db81` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:38.864534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57e94fb302844dd7a1705d6e6dc4db81)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:38.866741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:38.894232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f7bdd-507a-4de8-876c-171bb6f3f5b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d2051bc31c4a819fe5bb94aa39fd12, user_id=c2dcb156686542f1a7af49f46abc8b23, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:38.899278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28f7bdd-507a-4de8-876c-171bb6f3f5b1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:38.930282 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3684/7367] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:38 2022] PUT /identity/v3/projects/15d2051bc31c4a819fe5bb94aa39fd12/users/c2dcb156686542f1a7af49f46abc8b23/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:38.934183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f7bdd-507a-4de8-876c-171bb6f3f5b1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:38.937987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b28f7bdd-507a-4de8-876c-171bb6f3f5b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:38.978216 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:39.024589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57e94fb302844dd7a1705d6e6dc4db81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:39.055786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57e94fb302844dd7a1705d6e6dc4db81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:39.056755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57e94fb302844dd7a1705d6e6dc4db81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:39.071140 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:39.082676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57e94fb302844dd7a1705d6e6dc4db81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:39.106030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57e94fb302844dd7a1705d6e6dc4db81'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:39.131733 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3684/7368] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:38 2022] DELETE /identity/v3/users/57e94fb302844dd7a1705d6e6dc4db81 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:39.139882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28f7bdd-507a-4de8-876c-171bb6f3f5b1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:39.340652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f601e3-f4f6-4a76-baab-d2abe48e8dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:39.341511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f601e3-f4f6-4a76-baab-d2abe48e8dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:39.342419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f601e3-f4f6-4a76-baab-d2abe48e8dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:39.342946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f601e3-f4f6-4a76-baab-d2abe48e8dc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:39.343908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f601e3-f4f6-4a76-baab-d2abe48e8dc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:39.350215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f601e3-f4f6-4a76-baab-d2abe48e8dc2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:39.373842 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3685/7369] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:38 2022] GET /identity/v3/roles => generated 1420 bytes in 440 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:39.377410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:39.378948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:39.408114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a12144d-0118-43cd-a816-c45118505f00 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:39.427768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7fdb4-fac7-4d59-9d0c-1814c3ff6554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:39.429202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7fdb4-fac7-4d59-9d0c-1814c3ff6554 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:39.429514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7fdb4-fac7-4d59-9d0c-1814c3ff6554 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:39.429786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f7fdb4-fac7-4d59-9d0c-1814c3ff6554 admin admin] PATH_INFO: `/v3/projects/15d2051bc31c4a819fe5bb94aa39fd12/users/c2dcb156686542f1a7af49f46abc8b23/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:39.439188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7fdb4-fac7-4d59-9d0c-1814c3ff6554 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15d2051bc31c4a819fe5bb94aa39fd12, user_id=c2dcb156686542f1a7af49f46abc8b23, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:39.453068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f7fdb4-fac7-4d59-9d0c-1814c3ff6554 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:39.493575 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3685/7370] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:39 2022] PUT /identity/v3/projects/15d2051bc31c4a819fe5bb94aa39fd12/users/c2dcb156686542f1a7af49f46abc8b23/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:39.519055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb87f-9e9f-4193-ab42-baf227a908d0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:39.519467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb87f-9e9f-4193-ab42-baf227a908d0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:39.519816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7edfb87f-9e9f-4193-ab42-baf227a908d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:39.611241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7edfb87f-9e9f-4193-ab42-baf227a908d0 None None] MFA Rules not processed for user `c2dcb156686542f1a7af49f46abc8b23`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:39.612844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7edfb87f-9e9f-4193-ab42-baf227a908d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:39.811148 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3686/7371] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:39.819415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7fdb4-fac7-4d59-9d0c-1814c3ff6554 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:39.822979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c8f7fdb4-fac7-4d59-9d0c-1814c3ff6554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:39.858355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfb87f-9e9f-4193-ab42-baf227a908d0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:39.860390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7edfb87f-9e9f-4193-ab42-baf227a908d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:40.031896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7edfb87f-9e9f-4193-ab42-baf227a908d0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:40.042077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:40.042739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:40.043024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:40.043304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] PATH_INFO: `/v3/projects/dd5aea6db7df47fd8826554810d3fc5d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:40.044879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f7fdb4-fac7-4d59-9d0c-1814c3ff6554 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:40.046240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd5aea6db7df47fd8826554810d3fc5d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:40.048200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:40.057245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240bc61-993e-4315-9648-a73b2633c8bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:40.057907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240bc61-993e-4315-9648-a73b2633c8bd service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:40.058191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240bc61-993e-4315-9648-a73b2633c8bd service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:40.058471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240bc61-993e-4315-9648-a73b2633c8bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:40.075681 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:40.077115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240bc61-993e-4315-9648-a73b2633c8bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:40.079249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4240bc61-993e-4315-9648-a73b2633c8bd service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:40.103543 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3686/7372] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:39 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:40.175011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240bc61-993e-4315-9648-a73b2633c8bd service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:40.177524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4240bc61-993e-4315-9648-a73b2633c8bd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:40.188125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd5aea6db7df47fd8826554810d3fc5d', 'request_id': 'req-b873aad9-211d-486f-bc53-d87019c9431f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:40.202478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240bc61-993e-4315-9648-a73b2633c8bd service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:40.210578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd5aea6db7df47fd8826554810d3fc5d', 'request_id': 'req-b873aad9-211d-486f-bc53-d87019c9431f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:40.241081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd5aea6db7df47fd8826554810d3fc5d', 'request_id': 'req-b873aad9-211d-486f-bc53-d87019c9431f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:40.271687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] The token cache is being invalidate because project dd5aea6db7df47fd8826554810d3fc5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:40.273245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:40.275019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b873aad9-211d-486f-bc53-d87019c9431f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:40.281248 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3687/7373] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:39 2022] DELETE /identity/v3/projects/dd5aea6db7df47fd8826554810d3fc5d => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:40.286580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253859bc-e666-4b74-94e5-1e1193c0a1ca None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:40.287141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253859bc-e666-4b74-94e5-1e1193c0a1ca None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:40.287558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253859bc-e666-4b74-94e5-1e1193c0a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:40.332334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-253859bc-e666-4b74-94e5-1e1193c0a1ca None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:40.335178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-253859bc-e666-4b74-94e5-1e1193c0a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:40.335432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f4fef-e277-4520-afca-8790228ec8ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:40.336515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f4fef-e277-4520-afca-8790228ec8ff service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:40.336954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f4fef-e277-4520-afca-8790228ec8ff service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:40.337401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892f4fef-e277-4520-afca-8790228ec8ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:40.355790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-892f4fef-e277-4520-afca-8790228ec8ff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:40.461714 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:40.499048 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3688/7374] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:40.502980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cab0d7-d4c6-48d6-a255-ac383db22dc2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:40.503266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cab0d7-d4c6-48d6-a255-ac383db22dc2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:40.503555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cab0d7-d4c6-48d6-a255-ac383db22dc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:40.506251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f4fef-e277-4520-afca-8790228ec8ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:40.509969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892f4fef-e277-4520-afca-8790228ec8ff service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:40.535787 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3687/7375] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:40 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:40.542662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-85cab0d7-d4c6-48d6-a255-ac383db22dc2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:40.543987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-85cab0d7-d4c6-48d6-a255-ac383db22dc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:40.559497 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3689/7376] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:40.564297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f4fef-e277-4520-afca-8790228ec8ff service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:40.585214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892f4fef-e277-4520-afca-8790228ec8ff service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:40.589937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535491b-fab9-4c74-84a6-25392ca8ef36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:40.590554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535491b-fab9-4c74-84a6-25392ca8ef36 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:40.590840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535491b-fab9-4c74-84a6-25392ca8ef36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:40.591258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7535491b-fab9-4c74-84a6-25392ca8ef36 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:40.591945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535491b-fab9-4c74-84a6-25392ca8ef36 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:40.592250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535491b-fab9-4c74-84a6-25392ca8ef36 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:40.593906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7535491b-fab9-4c74-84a6-25392ca8ef36 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:40.651014 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3688/7377] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:40.652398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cab0d7-d4c6-48d6-a255-ac383db22dc2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:40.663308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cab0d7-d4c6-48d6-a255-ac383db22dc2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:40.670496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934557b-8e77-462a-afd4-07264f0cf4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:40.670496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934557b-8e77-462a-afd4-07264f0cf4bc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:40.670496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934557b-8e77-462a-afd4-07264f0cf4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:40.670496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934557b-8e77-462a-afd4-07264f0cf4bc admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:40.671316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934557b-8e77-462a-afd4-07264f0cf4bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:40.673617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934557b-8e77-462a-afd4-07264f0cf4bc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:40.722949 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3690/7378] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:40 2022] POST /identity/v3/projects => generated 369 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:25:40.727209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535491b-fab9-4c74-84a6-25392ca8ef36 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:40.749150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7535491b-fab9-4c74-84a6-25392ca8ef36 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:40.905977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666a7e-9fac-4869-87a2-c211c07a4df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:40.906753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666a7e-9fac-4869-87a2-c211c07a4df3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:40.907001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666a7e-9fac-4869-87a2-c211c07a4df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:40.907283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c666a7e-9fac-4869-87a2-c211c07a4df3 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:40.907982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c666a7e-9fac-4869-87a2-c211c07a4df3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:40.912910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c666a7e-9fac-4869-87a2-c211c07a4df3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:40.964573 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3689/7379] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:40 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:40.968815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934557b-8e77-462a-afd4-07264f0cf4bc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:40.988928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934557b-8e77-462a-afd4-07264f0cf4bc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:41.011291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ad0fd-0445-4490-8d9b-a2629d3de541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:41.011291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad0fd-0445-4490-8d9b-a2629d3de541 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:41.011291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad0fd-0445-4490-8d9b-a2629d3de541 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:41.011291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7ad0fd-0445-4490-8d9b-a2629d3de541 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:41.012054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ad0fd-0445-4490-8d9b-a2629d3de541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:41.012054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7ad0fd-0445-4490-8d9b-a2629d3de541 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:41.022690 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3691/7380] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:41.023732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666a7e-9fac-4869-87a2-c211c07a4df3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:41.050876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c666a7e-9fac-4869-87a2-c211c07a4df3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:41.089722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7041e6bb-08f4-4994-a20e-4416378252ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:41.091716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e6bb-08f4-4994-a20e-4416378252ea admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:41.094672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e6bb-08f4-4994-a20e-4416378252ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:41.095205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7041e6bb-08f4-4994-a20e-4416378252ea admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:41.096064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041e6bb-08f4-4994-a20e-4416378252ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:41.127075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7041e6bb-08f4-4994-a20e-4416378252ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:41.179792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ad0fd-0445-4490-8d9b-a2629d3de541 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:41.187362 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3690/7381] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:41 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:41.193878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7ad0fd-0445-4490-8d9b-a2629d3de541 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:41.207659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207d02d-71bf-4ad6-a46a-f86e36ad6a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:41.208375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207d02d-71bf-4ad6-a46a-f86e36ad6a87 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:41.208762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207d02d-71bf-4ad6-a46a-f86e36ad6a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:41.209997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e207d02d-71bf-4ad6-a46a-f86e36ad6a87 admin admin] PATH_INFO: `/v3/projects/9513e7c72eef4692a5205c580ec88a8b/users/87885223d7ec43df8521c7a8b98df77a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:41.278770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207d02d-71bf-4ad6-a46a-f86e36ad6a87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9513e7c72eef4692a5205c580ec88a8b, user_id=87885223d7ec43df8521c7a8b98df77a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:41.286048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e207d02d-71bf-4ad6-a46a-f86e36ad6a87 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:41.311699 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3692/7382] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:41 2022] PUT /identity/v3/projects/9513e7c72eef4692a5205c580ec88a8b/users/87885223d7ec43df8521c7a8b98df77a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:41.322306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74546a6-68dc-4492-807b-5335fee4a3ff None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:41.322586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74546a6-68dc-4492-807b-5335fee4a3ff None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:41.322867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74546a6-68dc-4492-807b-5335fee4a3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:41.415261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e74546a6-68dc-4492-807b-5335fee4a3ff None None] MFA Rules not processed for user `87885223d7ec43df8521c7a8b98df77a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:41.416664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e74546a6-68dc-4492-807b-5335fee4a3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:41.569076 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3691/7383] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:41 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:41.588961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207d02d-71bf-4ad6-a46a-f86e36ad6a87 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:41.590723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e207d02d-71bf-4ad6-a46a-f86e36ad6a87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:41.638500 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:41.644001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74546a6-68dc-4492-807b-5335fee4a3ff None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:41.645681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e74546a6-68dc-4492-807b-5335fee4a3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:41.718999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e207d02d-71bf-4ad6-a46a-f86e36ad6a87 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:41.727535 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:41.734507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:41.735254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:41.735425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:41.735698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:41.738008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:41.755516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74546a6-68dc-4492-807b-5335fee4a3ff None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:41.761167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f377246-f504-4ec7-bf3a-b1d5fa07d00a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:41.761936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377246-f504-4ec7-bf3a-b1d5fa07d00a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:41.762336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377246-f504-4ec7-bf3a-b1d5fa07d00a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:41.762693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f377246-f504-4ec7-bf3a-b1d5fa07d00a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:41.773515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:41.775313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:41.782018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f377246-f504-4ec7-bf3a-b1d5fa07d00a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:41.783480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f377246-f504-4ec7-bf3a-b1d5fa07d00a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:41.792261 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3693/7384] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:41.811721 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3692/7385] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:41 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:45.116053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:45.117715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:45.204344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7cf7f8-f0df-470a-bb5b-19fbc39e8b87 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:45.209650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:45.210461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:45.210889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:45.211722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] PATH_INFO: `/v3/users/8a63e7f9675e4c199271be3687551035` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:45.213665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a63e7f9675e4c199271be3687551035)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:45.215741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:45.360569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a63e7f9675e4c199271be3687551035'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:45.417507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a63e7f9675e4c199271be3687551035'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:45.420855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a63e7f9675e4c199271be3687551035'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:45.452234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a63e7f9675e4c199271be3687551035'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:45.463072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a63e7f9675e4c199271be3687551035'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:45.487883 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3694/7386] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:45 2022] DELETE /identity/v3/users/8a63e7f9675e4c199271be3687551035 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:45.489542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca15d-31c5-4e90-905b-3922a141a446 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:45.490006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca15d-31c5-4e90-905b-3922a141a446 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:45.490301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4eca15d-31c5-4e90-905b-3922a141a446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:45.559117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b4eca15d-31c5-4e90-905b-3922a141a446 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:45.564111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b4eca15d-31c5-4e90-905b-3922a141a446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:45.800601 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3693/7387] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:45.807062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:45.808818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:45.948117 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:45.964683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6753d8d-cbe0-4ce6-baff-f69f70b6fd30 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:45.970300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7985b-2bb4-4e48-a4ca-2363129d199a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:45.971035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7985b-2bb4-4e48-a4ca-2363129d199a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:45.971432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7985b-2bb4-4e48-a4ca-2363129d199a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:45.971783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7985b-2bb4-4e48-a4ca-2363129d199a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:45.986993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7985b-2bb4-4e48-a4ca-2363129d199a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:45.989551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7985b-2bb4-4e48-a4ca-2363129d199a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:46.004103 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3695/7388] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:46.841610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca15d-31c5-4e90-905b-3922a141a446 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:46.843094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b4eca15d-31c5-4e90-905b-3922a141a446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:46.872278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4eca15d-31c5-4e90-905b-3922a141a446 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:46.878185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:46.878828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:46.879107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:46.879381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] PATH_INFO: `/v3/projects/d67a41a7f1c5455789de9f1d87b74020` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:46.880537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d67a41a7f1c5455789de9f1d87b74020)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:46.882750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:46.991895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd67a41a7f1c5455789de9f1d87b74020', 'request_id': 'req-727872a8-4973-432a-9707-3426579a48d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.008425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd67a41a7f1c5455789de9f1d87b74020', 'request_id': 'req-727872a8-4973-432a-9707-3426579a48d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.031282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd67a41a7f1c5455789de9f1d87b74020', 'request_id': 'req-727872a8-4973-432a-9707-3426579a48d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.050365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] The token cache is being invalidate because project d67a41a7f1c5455789de9f1d87b74020 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:47.051063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.064791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.068371 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3694/7389] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:46 2022] DELETE /identity/v3/projects/d67a41a7f1c5455789de9f1d87b74020 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:47.072286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7985b-2bb4-4e48-a4ca-2363129d199a service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:47.093027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7985b-2bb4-4e48-a4ca-2363129d199a service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:47.238872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:47.240330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:47.347259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:47.347919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:47.348201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:47.348497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] PATH_INFO: `/v3/users/c2dcb156686542f1a7af49f46abc8b23` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:47.350803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2dcb156686542f1a7af49f46abc8b23)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:47.352769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:47.430034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727872a8-4973-432a-9707-3426579a48d9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:47.456012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:47.458131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:47.458415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:47.459244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] PATH_INFO: `/v3/users/e7ddb50ed0824a98b624802377ee03d5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:47.459967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2dcb156686542f1a7af49f46abc8b23'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.462287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7ddb50ed0824a98b624802377ee03d5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:47.465563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:47.490470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2dcb156686542f1a7af49f46abc8b23'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.492153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2dcb156686542f1a7af49f46abc8b23'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.501006 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:47.511584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2dcb156686542f1a7af49f46abc8b23'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.530632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8f60cb7a-15de-40d0-a0a3-649dc4e0dffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2dcb156686542f1a7af49f46abc8b23'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.541577 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3696/7390] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:47 2022] DELETE /identity/v3/users/c2dcb156686542f1a7af49f46abc8b23 => generated 0 bytes in 470 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:47.603420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7ddb50ed0824a98b624802377ee03d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.620768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7ddb50ed0824a98b624802377ee03d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.621725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7ddb50ed0824a98b624802377ee03d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.638181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7ddb50ed0824a98b624802377ee03d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.657122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7ddb50ed0824a98b624802377ee03d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:47.717950 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3695/7391] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:47 2022] DELETE /identity/v3/users/e7ddb50ed0824a98b624802377ee03d5 => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:47.719376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f405-b0a5-4d72-8487-e88cc6456f59 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:47.719733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f405-b0a5-4d72-8487-e88cc6456f59 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:47.720013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f405-b0a5-4d72-8487-e88cc6456f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:47.772088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9fb7f405-b0a5-4d72-8487-e88cc6456f59 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:47.773283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9fb7f405-b0a5-4d72-8487-e88cc6456f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:47.924251 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3697/7392] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:25:47.938804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:47.940945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:48.090463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bebf5-9701-4dc1-b077-46360c806aac admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:48.102191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d5bd31-bd70-4b7f-8fa4-94622565f975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:48.102526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5bd31-bd70-4b7f-8fa4-94622565f975 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:48.102874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5bd31-bd70-4b7f-8fa4-94622565f975 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:48.103215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d5bd31-bd70-4b7f-8fa4-94622565f975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:48.126791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5bd31-bd70-4b7f-8fa4-94622565f975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:48.128354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d5bd31-bd70-4b7f-8fa4-94622565f975 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:48.156306 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3696/7393] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:48.390070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f405-b0a5-4d72-8487-e88cc6456f59 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:48.391603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9fb7f405-b0a5-4d72-8487-e88cc6456f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:48.414123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f405-b0a5-4d72-8487-e88cc6456f59 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:48.428745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:48.429443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:48.429791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:48.430001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] PATH_INFO: `/v3/projects/15d2051bc31c4a819fe5bb94aa39fd12` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:48.433602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15d2051bc31c4a819fe5bb94aa39fd12)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:48.435709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:48.444675 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:48.558516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15d2051bc31c4a819fe5bb94aa39fd12', 'request_id': 'req-48f53b87-4946-46fd-b2ce-e66695112750'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:48.584349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15d2051bc31c4a819fe5bb94aa39fd12', 'request_id': 'req-48f53b87-4946-46fd-b2ce-e66695112750'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:48.598340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15d2051bc31c4a819fe5bb94aa39fd12', 'request_id': 'req-48f53b87-4946-46fd-b2ce-e66695112750'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:48.614531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] The token cache is being invalidate because project 15d2051bc31c4a819fe5bb94aa39fd12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:48.614827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:48.620377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-48f53b87-4946-46fd-b2ce-e66695112750 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:48.625465 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3698/7394] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:48 2022] DELETE /identity/v3/projects/15d2051bc31c4a819fe5bb94aa39fd12 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:48.627767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98b59e-720d-4a6b-bfee-380364fa3676 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:48.628225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98b59e-720d-4a6b-bfee-380364fa3676 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:48.628651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e98b59e-720d-4a6b-bfee-380364fa3676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:48.670427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6e98b59e-720d-4a6b-bfee-380364fa3676 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:48.671834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6e98b59e-720d-4a6b-bfee-380364fa3676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:48.813114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75435d0b-49a5-4c30-970e-9e5d1f2493ba None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:48.813440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75435d0b-49a5-4c30-970e-9e5d1f2493ba None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:48.813719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75435d0b-49a5-4c30-970e-9e5d1f2493ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:48.817738 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3697/7395] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:48.856450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-75435d0b-49a5-4c30-970e-9e5d1f2493ba None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:48.858555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75435d0b-49a5-4c30-970e-9e5d1f2493ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:48.874076 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3699/7396] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:25:48.878641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98b59e-720d-4a6b-bfee-380364fa3676 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:48.894055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e98b59e-720d-4a6b-bfee-380364fa3676 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:48.900261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beda0b-ab18-49ac-8e59-5070639d16a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:48.901498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beda0b-ab18-49ac-8e59-5070639d16a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:48.901933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beda0b-ab18-49ac-8e59-5070639d16a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:48.902383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13beda0b-ab18-49ac-8e59-5070639d16a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:48.904699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13beda0b-ab18-49ac-8e59-5070639d16a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:48.905281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13beda0b-ab18-49ac-8e59-5070639d16a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:48.907322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13beda0b-ab18-49ac-8e59-5070639d16a6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:48.923088 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3698/7397] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:48.927132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75435d0b-49a5-4c30-970e-9e5d1f2493ba None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:48.942777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75435d0b-49a5-4c30-970e-9e5d1f2493ba None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:48.953734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf8e5-099e-4578-a163-425ba6789e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:48.954622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf8e5-099e-4578-a163-425ba6789e45 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:48.957260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf8e5-099e-4578-a163-425ba6789e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:48.957709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7bf8e5-099e-4578-a163-425ba6789e45 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:48.958512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf8e5-099e-4578-a163-425ba6789e45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:48.963816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7bf8e5-099e-4578-a163-425ba6789e45 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:49.061223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3700/7398] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:48 2022] POST /identity/v3/projects => generated 387 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:25:49.065732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beda0b-ab18-49ac-8e59-5070639d16a6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:49.085850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13beda0b-ab18-49ac-8e59-5070639d16a6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:49.100471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf8e5-099e-4578-a163-425ba6789e45 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:49.104521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5d7bf8e5-099e-4578-a163-425ba6789e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:49.168717 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:49.270370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa07b8-e7ef-484e-a196-ca9c5d5ba25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:49.271270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa07b8-e7ef-484e-a196-ca9c5d5ba25c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:49.271771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa07b8-e7ef-484e-a196-ca9c5d5ba25c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:49.272245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fa07b8-e7ef-484e-a196-ca9c5d5ba25c admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:49.273790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa07b8-e7ef-484e-a196-ca9c5d5ba25c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:49.278751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fa07b8-e7ef-484e-a196-ca9c5d5ba25c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:49.342286 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3699/7399] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:49 2022] POST /identity/v3/users => generated 294 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:49.343285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa07b8-e7ef-484e-a196-ca9c5d5ba25c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:49.343582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7bf8e5-099e-4578-a163-425ba6789e45 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:49.360256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fa07b8-e7ef-484e-a196-ca9c5d5ba25c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:49.362851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:49.363424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:49.363708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:49.364062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] PATH_INFO: `/v3/projects/b24272a6376d4868a5aa83d7e50f2554` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:49.365170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b24272a6376d4868a5aa83d7e50f2554)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:49.367171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:49.367915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34638caa-8c99-4fe1-92e2-43e7494a9010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:49.368796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34638caa-8c99-4fe1-92e2-43e7494a9010 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:49.369568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34638caa-8c99-4fe1-92e2-43e7494a9010 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:49.370315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34638caa-8c99-4fe1-92e2-43e7494a9010 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:49.371180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34638caa-8c99-4fe1-92e2-43e7494a9010 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:49.373779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34638caa-8c99-4fe1-92e2-43e7494a9010 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:49.390811 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3700/7400] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:49.392082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34638caa-8c99-4fe1-92e2-43e7494a9010 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:49.403741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34638caa-8c99-4fe1-92e2-43e7494a9010 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:49.409927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420edb71-c7a7-43d7-b374-b2dec51bf16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:49.410843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420edb71-c7a7-43d7-b374-b2dec51bf16b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:49.411765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420edb71-c7a7-43d7-b374-b2dec51bf16b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:49.412240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420edb71-c7a7-43d7-b374-b2dec51bf16b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:49.413411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420edb71-c7a7-43d7-b374-b2dec51bf16b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:49.415316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420edb71-c7a7-43d7-b374-b2dec51bf16b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:49.431373 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3701/7401] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:49 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:49.438332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420edb71-c7a7-43d7-b374-b2dec51bf16b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:49.464518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420edb71-c7a7-43d7-b374-b2dec51bf16b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:49.472918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b24272a6376d4868a5aa83d7e50f2554', 'request_id': 'req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.490496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b24272a6376d4868a5aa83d7e50f2554', 'request_id': 'req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.501073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b24272a6376d4868a5aa83d7e50f2554', 'request_id': 'req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.506819 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:49.524320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] The token cache is being invalidate because project b24272a6376d4868a5aa83d7e50f2554 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:49.524611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.525829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.532514 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3701/7402] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:49 2022] DELETE /identity/v3/projects/b24272a6376d4868a5aa83d7e50f2554 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:49.533602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:49.535272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:49.612624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d74055-f264-4d2d-a5b1-b2b6d281ad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:49.613721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d74055-f264-4d2d-a5b1-b2b6d281ad63 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:49.614232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d74055-f264-4d2d-a5b1-b2b6d281ad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:49.614659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d74055-f264-4d2d-a5b1-b2b6d281ad63 admin admin] PATH_INFO: `/v3/projects/5e80c415977641fea2e904d02d737356/users/1e585612a71f4ca492e98865d0c0e606/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:49.635804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79f6e96-32f7-49f5-9f38-47ca5d7c12c9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:49.638532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d74055-f264-4d2d-a5b1-b2b6d281ad63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e80c415977641fea2e904d02d737356, user_id=1e585612a71f4ca492e98865d0c0e606, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:49.642211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:49.642967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:49.643323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:49.643672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] PATH_INFO: `/v3/users/ad9cf27ce95043a89b98e7e138a40e00` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:49.644884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d74055-f264-4d2d-a5b1-b2b6d281ad63 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:49.645216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad9cf27ce95043a89b98e7e138a40e00)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:49.647260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:49.667857 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3702/7403] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:49 2022] PUT /identity/v3/projects/5e80c415977641fea2e904d02d737356/users/1e585612a71f4ca492e98865d0c0e606/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:49.679387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd159b7-2fee-4566-9a00-bcda881b111c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:49.680103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd159b7-2fee-4566-9a00-bcda881b111c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:49.680810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd159b7-2fee-4566-9a00-bcda881b111c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:49.738033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad9cf27ce95043a89b98e7e138a40e00'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.756012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad9cf27ce95043a89b98e7e138a40e00'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.756770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad9cf27ce95043a89b98e7e138a40e00'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.764596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fcd159b7-2fee-4566-9a00-bcda881b111c None None] MFA Rules not processed for user `1e585612a71f4ca492e98865d0c0e606`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:49.766813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad9cf27ce95043a89b98e7e138a40e00'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.767537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fcd159b7-2fee-4566-9a00-bcda881b111c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:49.776022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad9cf27ce95043a89b98e7e138a40e00'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:49.784659 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3702/7404] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:49 2022] DELETE /identity/v3/users/ad9cf27ce95043a89b98e7e138a40e00 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:49.896941 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3703/7405] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:49 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:25:49.902009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:49.903644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:49.994872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c549bbc-ca18-4a10-9296-adf34a2c7b95 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:50.001329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0144-75c4-44b5-a4a5-28c0c1629cf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:50.002742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0144-75c4-44b5-a4a5-28c0c1629cf8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.003142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0144-75c4-44b5-a4a5-28c0c1629cf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.003514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7e0144-75c4-44b5-a4a5-28c0c1629cf8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.004520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0144-75c4-44b5-a4a5-28c0c1629cf8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:50.007090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7e0144-75c4-44b5-a4a5-28c0c1629cf8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:50.036809 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:50.063526 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3703/7406] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:49 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:50.068364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd159b7-2fee-4566-9a00-bcda881b111c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:50.079836 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:50.180032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0144-75c4-44b5-a4a5-28c0c1629cf8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:50.182367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7f7e0144-75c4-44b5-a4a5-28c0c1629cf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:50.195218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd159b7-2fee-4566-9a00-bcda881b111c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:50.358642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa93598-5c22-4a16-bce5-20d5fe68fc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:50.359949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa93598-5c22-4a16-bce5-20d5fe68fc1d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.360244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa93598-5c22-4a16-bce5-20d5fe68fc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.363196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa93598-5c22-4a16-bce5-20d5fe68fc1d admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.363920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa93598-5c22-4a16-bce5-20d5fe68fc1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:50.366942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa93598-5c22-4a16-bce5-20d5fe68fc1d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:50.387095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7e0144-75c4-44b5-a4a5-28c0c1629cf8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:50.406221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876838-732d-46aa-85ec-555e42390f1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:50.406987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876838-732d-46aa-85ec-555e42390f1e service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.407186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876838-732d-46aa-85ec-555e42390f1e service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.407879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be876838-732d-46aa-85ec-555e42390f1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.417792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-be876838-732d-46aa-85ec-555e42390f1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:50.444603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be876838-732d-46aa-85ec-555e42390f1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:50.446569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be876838-732d-46aa-85ec-555e42390f1e service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:50.459481 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3704/7407] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:50 2022] POST /identity/v3/users => generated 294 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:50.461342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa93598-5c22-4a16-bce5-20d5fe68fc1d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:50.462264 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3704/7408] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:50 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:50.463052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876838-732d-46aa-85ec-555e42390f1e service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:50.467501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-baa93598-5c22-4a16-bce5-20d5fe68fc1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:50.477147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be876838-732d-46aa-85ec-555e42390f1e service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:50.485214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910f575-cad2-44b7-9582-74baf003547c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:50.486188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910f575-cad2-44b7-9582-74baf003547c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.486751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910f575-cad2-44b7-9582-74baf003547c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.487135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3910f575-cad2-44b7-9582-74baf003547c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.488329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910f575-cad2-44b7-9582-74baf003547c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:50.490849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3910f575-cad2-44b7-9582-74baf003547c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:50.504158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa93598-5c22-4a16-bce5-20d5fe68fc1d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:50.515151 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3705/7409] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:50.516785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910f575-cad2-44b7-9582-74baf003547c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:50.553145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:50.555283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.559631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.561238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] PATH_INFO: `/v3/projects/fbe208b47e8f4758a2049dd2038468f8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.566273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fbe208b47e8f4758a2049dd2038468f8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:50.570106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:50.577464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3910f575-cad2-44b7-9582-74baf003547c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:50.594297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd95c9-0148-4cef-b412-ba1f2d5533d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:50.595766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd95c9-0148-4cef-b412-ba1f2d5533d7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.597660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd95c9-0148-4cef-b412-ba1f2d5533d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.598165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcd95c9-0148-4cef-b412-ba1f2d5533d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.599533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd95c9-0148-4cef-b412-ba1f2d5533d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:50.602666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcd95c9-0148-4cef-b412-ba1f2d5533d7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:50.632454 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3706/7410] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:50 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:50.635765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd95c9-0148-4cef-b412-ba1f2d5533d7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:50.661883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcd95c9-0148-4cef-b412-ba1f2d5533d7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:50.714823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fbe208b47e8f4758a2049dd2038468f8', 'request_id': 'req-d430880c-cc5a-4d55-a59d-35877155ed50'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:50.731396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fbe208b47e8f4758a2049dd2038468f8', 'request_id': 'req-d430880c-cc5a-4d55-a59d-35877155ed50'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:50.750391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fbe208b47e8f4758a2049dd2038468f8', 'request_id': 'req-d430880c-cc5a-4d55-a59d-35877155ed50'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:50.771986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] The token cache is being invalidate because project fbe208b47e8f4758a2049dd2038468f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:50.772622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:50.774510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d430880c-cc5a-4d55-a59d-35877155ed50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:50.782954 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3705/7411] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:50 2022] DELETE /identity/v3/projects/fbe208b47e8f4758a2049dd2038468f8 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:50.788724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5b52a-5031-475d-8d6d-49a892fe0251 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.789400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5b52a-5031-475d-8d6d-49a892fe0251 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.789886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c5b52a-5031-475d-8d6d-49a892fe0251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.828487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f075f7a9-9681-4bcd-98a6-a9bb87ed5c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:50.829259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f7a9-9681-4bcd-98a6-a9bb87ed5c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.829570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f7a9-9681-4bcd-98a6-a9bb87ed5c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.829848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f075f7a9-9681-4bcd-98a6-a9bb87ed5c3b admin admin] PATH_INFO: `/v3/projects/a99ce40ba8fb4012810c995749451d67/users/917681a698464618820d67e720bf22d6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.837071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b8c5b52a-5031-475d-8d6d-49a892fe0251 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:50.841020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b8c5b52a-5031-475d-8d6d-49a892fe0251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:50.869038 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3706/7412] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:50.878162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97559a-b858-45cd-b5c1-f0ac7661d44d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.878646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97559a-b858-45cd-b5c1-f0ac7661d44d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.879057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd97559a-b858-45cd-b5c1-f0ac7661d44d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.883086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f7a9-9681-4bcd-98a6-a9bb87ed5c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a99ce40ba8fb4012810c995749451d67, user_id=917681a698464618820d67e720bf22d6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:50.890411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f075f7a9-9681-4bcd-98a6-a9bb87ed5c3b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:50.927918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bd97559a-b858-45cd-b5c1-f0ac7661d44d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:50.929451 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3707/7413] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:50 2022] PUT /identity/v3/projects/a99ce40ba8fb4012810c995749451d67/users/917681a698464618820d67e720bf22d6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:50.938974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bd97559a-b858-45cd-b5c1-f0ac7661d44d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:50.940231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e68bd-467d-4ca9-a43a-a084919512db None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:50.940565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e68bd-467d-4ca9-a43a-a084919512db None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:50.940848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31e68bd-467d-4ca9-a43a-a084919512db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:50.956258 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:51.056851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d31e68bd-467d-4ca9-a43a-a084919512db None None] MFA Rules not processed for user `917681a698464618820d67e720bf22d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:51.057454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d31e68bd-467d-4ca9-a43a-a084919512db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:51.145809 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3707/7414] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:51.148658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97559a-b858-45cd-b5c1-f0ac7661d44d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.184612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd97559a-b858-45cd-b5c1-f0ac7661d44d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:51.204610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a56b1-4293-4304-833d-dc7c39c82025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:51.205259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a56b1-4293-4304-833d-dc7c39c82025 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:51.209174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a56b1-4293-4304-833d-dc7c39c82025 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:51.211468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4a56b1-4293-4304-833d-dc7c39c82025 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:51.214658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a56b1-4293-4304-833d-dc7c39c82025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:25:51.218586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a56b1-4293-4304-833d-dc7c39c82025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:51.224117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4a56b1-4293-4304-833d-dc7c39c82025 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:51.239930 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:51.290729 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3708/7415] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:25:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:25:51.295864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a56b1-4293-4304-833d-dc7c39c82025 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.332774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4a56b1-4293-4304-833d-dc7c39c82025 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:51.352931 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3708/7416] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:50 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:51.358016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e68bd-467d-4ca9-a43a-a084919512db None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.358670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd2482-990a-4e90-b60c-d3f575b0d974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:51.360095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd2482-990a-4e90-b60c-d3f575b0d974 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:51.360095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd2482-990a-4e90-b60c-d3f575b0d974 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:51.360095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd2482-990a-4e90-b60c-d3f575b0d974 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:51.360826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd2482-990a-4e90-b60c-d3f575b0d974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:51.361609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d31e68bd-467d-4ca9-a43a-a084919512db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:51.362967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd2482-990a-4e90-b60c-d3f575b0d974 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:51.387632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31e68bd-467d-4ca9-a43a-a084919512db None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:51.405339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83dfdf-86a1-4323-bd2e-b9250f7a27b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:51.406346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83dfdf-86a1-4323-bd2e-b9250f7a27b6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:51.406859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83dfdf-86a1-4323-bd2e-b9250f7a27b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:51.407449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba83dfdf-86a1-4323-bd2e-b9250f7a27b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:51.408362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83dfdf-86a1-4323-bd2e-b9250f7a27b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:51.410691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba83dfdf-86a1-4323-bd2e-b9250f7a27b6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:51.436533 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3709/7417] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:51 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:51.440955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd2482-990a-4e90-b60c-d3f575b0d974 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.493322 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3709/7418] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:51 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:51.496216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83dfdf-86a1-4323-bd2e-b9250f7a27b6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.586936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd2482-990a-4e90-b60c-d3f575b0d974 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:51.612037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba83dfdf-86a1-4323-bd2e-b9250f7a27b6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:51.626975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0def1c-0292-41c0-9957-d50a61295723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:51.627614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0def1c-0292-41c0-9957-d50a61295723 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:51.627897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0def1c-0292-41c0-9957-d50a61295723 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:51.628174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0def1c-0292-41c0-9957-d50a61295723 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:51.631488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0def1c-0292-41c0-9957-d50a61295723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:51.633714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0def1c-0292-41c0-9957-d50a61295723 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:51.679191 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3710/7419] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:51 2022] POST /identity/v3/users => generated 300 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:51.683230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0def1c-0292-41c0-9957-d50a61295723 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.711680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0def1c-0292-41c0-9957-d50a61295723 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:51.721475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd127174-1a2c-4c05-ad5e-9e75661a8dd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:51.722184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd127174-1a2c-4c05-ad5e-9e75661a8dd4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:51.722504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd127174-1a2c-4c05-ad5e-9e75661a8dd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:51.722783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd127174-1a2c-4c05-ad5e-9e75661a8dd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:51.723443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd127174-1a2c-4c05-ad5e-9e75661a8dd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:51.725072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd127174-1a2c-4c05-ad5e-9e75661a8dd4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:51.735039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6066b-7347-4e2d-b4eb-458c71dca617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:51.735662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6066b-7347-4e2d-b4eb-458c71dca617 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:51.735946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6066b-7347-4e2d-b4eb-458c71dca617 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:51.736279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6066b-7347-4e2d-b4eb-458c71dca617 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:51.736926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6066b-7347-4e2d-b4eb-458c71dca617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:51.740257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6066b-7347-4e2d-b4eb-458c71dca617 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:51.757727 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3711/7420] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:51.758806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd127174-1a2c-4c05-ad5e-9e75661a8dd4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.774476 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3710/7421] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:51 2022] POST /identity/v3/users => generated 291 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:51.779704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6066b-7347-4e2d-b4eb-458c71dca617 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.783482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd127174-1a2c-4c05-ad5e-9e75661a8dd4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:51.788556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242c795-e51d-4d84-b632-4d83ec4643d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:51.789504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242c795-e51d-4d84-b632-4d83ec4643d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:51.789933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242c795-e51d-4d84-b632-4d83ec4643d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:51.790355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d242c795-e51d-4d84-b632-4d83ec4643d0 admin admin] PATH_INFO: `/v3/projects/c1fdc622826b4e96bba6b3d51e3adba1/users/be7b7e5790ec4376b0e0765d2f9229be/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:51.797929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6066b-7347-4e2d-b4eb-458c71dca617 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:51.804931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da26211-f9f2-48e2-8441-8d4ba2b12a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:51.805688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da26211-f9f2-48e2-8441-8d4ba2b12a57 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:51.806053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da26211-f9f2-48e2-8441-8d4ba2b12a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:51.806396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da26211-f9f2-48e2-8441-8d4ba2b12a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:51.807114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da26211-f9f2-48e2-8441-8d4ba2b12a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:51.808382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242c795-e51d-4d84-b632-4d83ec4643d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fdc622826b4e96bba6b3d51e3adba1, user_id=be7b7e5790ec4376b0e0765d2f9229be, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:51.811583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d242c795-e51d-4d84-b632-4d83ec4643d0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:51.812580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4da26211-f9f2-48e2-8441-8d4ba2b12a57 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:51.835581 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3712/7422] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:51 2022] PUT /identity/v3/projects/c1fdc622826b4e96bba6b3d51e3adba1/users/be7b7e5790ec4376b0e0765d2f9229be/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:51.836844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242c795-e51d-4d84-b632-4d83ec4643d0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.851842 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3711/7423] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:51.867073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da26211-f9f2-48e2-8441-8d4ba2b12a57 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:51.882483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4da26211-f9f2-48e2-8441-8d4ba2b12a57 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:51.892728 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:52.001037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d242c795-e51d-4d84-b632-4d83ec4643d0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:52.015103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fecc1f-0282-426f-901b-18a511215ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:52.018314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fecc1f-0282-426f-901b-18a511215ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:52.018599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fecc1f-0282-426f-901b-18a511215ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:52.018879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fecc1f-0282-426f-901b-18a511215ec0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:52.019535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fecc1f-0282-426f-901b-18a511215ec0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:52.033693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fecc1f-0282-426f-901b-18a511215ec0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:52.073758 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3713/7424] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:25:52.077147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3c5fc-7aa8-4316-9051-5e2b806e6892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:52.077936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3c5fc-7aa8-4316-9051-5e2b806e6892 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:52.078224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3c5fc-7aa8-4316-9051-5e2b806e6892 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:52.078505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c3c5fc-7aa8-4316-9051-5e2b806e6892 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:52.079174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3c5fc-7aa8-4316-9051-5e2b806e6892 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:52.081024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c3c5fc-7aa8-4316-9051-5e2b806e6892 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:52.082418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fecc1f-0282-426f-901b-18a511215ec0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:52.101343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fecc1f-0282-426f-901b-18a511215ec0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:52.110021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3712/7425] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:51 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:25:52.110931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3c5fc-7aa8-4316-9051-5e2b806e6892 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:52.120146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece18e7-cad1-415c-9e0f-c16c728d9b89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:52.120834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece18e7-cad1-415c-9e0f-c16c728d9b89 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:52.121171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece18e7-cad1-415c-9e0f-c16c728d9b89 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:52.121478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece18e7-cad1-415c-9e0f-c16c728d9b89 admin admin] PATH_INFO: `/v3/projects/c1fdc622826b4e96bba6b3d51e3adba1/users/be7b7e5790ec4376b0e0765d2f9229be/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:52.125116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece18e7-cad1-415c-9e0f-c16c728d9b89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c1fdc622826b4e96bba6b3d51e3adba1, user_id=be7b7e5790ec4376b0e0765d2f9229be, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:52.129552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece18e7-cad1-415c-9e0f-c16c728d9b89 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:52.132326 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:52.135170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c3c5fc-7aa8-4316-9051-5e2b806e6892 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:52.156046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523288e-ed96-4c16-b458-50c53d5c23c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:52.156967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523288e-ed96-4c16-b458-50c53d5c23c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:52.158718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523288e-ed96-4c16-b458-50c53d5c23c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:52.159038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523288e-ed96-4c16-b458-50c53d5c23c4 admin admin] PATH_INFO: `/v3/projects/655872e944fb4d1ca2b0f7e4fd25b45c/users/0cd0d1278d3f40359f4d8fba38ead646/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:52.163907 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3714/7426] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:52 2022] PUT /identity/v3/projects/c1fdc622826b4e96bba6b3d51e3adba1/users/be7b7e5790ec4376b0e0765d2f9229be/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:52.176648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb6fb3-5f96-4c7e-8c5b-3be0d194c72d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:52.176929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb6fb3-5f96-4c7e-8c5b-3be0d194c72d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:52.177204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eceb6fb3-5f96-4c7e-8c5b-3be0d194c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:52.210111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523288e-ed96-4c16-b458-50c53d5c23c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655872e944fb4d1ca2b0f7e4fd25b45c, user_id=0cd0d1278d3f40359f4d8fba38ead646, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:52.215996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523288e-ed96-4c16-b458-50c53d5c23c4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:52.258296 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3713/7427] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:52 2022] PUT /identity/v3/projects/655872e944fb4d1ca2b0f7e4fd25b45c/users/0cd0d1278d3f40359f4d8fba38ead646/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:52.269372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0fd20-aebd-416a-9736-e4e328ccae1d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:52.269372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0fd20-aebd-416a-9736-e4e328ccae1d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:52.269372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0fd20-aebd-416a-9736-e4e328ccae1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:52.273227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-eceb6fb3-5f96-4c7e-8c5b-3be0d194c72d None None] MFA Rules not processed for user `be7b7e5790ec4376b0e0765d2f9229be`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:52.274402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eceb6fb3-5f96-4c7e-8c5b-3be0d194c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:52.368913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1eb0fd20-aebd-416a-9736-e4e328ccae1d None None] MFA Rules not processed for user `0cd0d1278d3f40359f4d8fba38ead646`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:52.370190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1eb0fd20-aebd-416a-9736-e4e328ccae1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:52.484080 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3715/7428] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:52.497160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb6fb3-5f96-4c7e-8c5b-3be0d194c72d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:52.500312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-eceb6fb3-5f96-4c7e-8c5b-3be0d194c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:52.556624 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3714/7429] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:52 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:52.561284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0fd20-aebd-416a-9736-e4e328ccae1d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:52.655426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eceb6fb3-5f96-4c7e-8c5b-3be0d194c72d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:52.667969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaa193-b715-40a7-81f0-222b862ec2da service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:52.669921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaa193-b715-40a7-81f0-222b862ec2da service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:52.671744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaa193-b715-40a7-81f0-222b862ec2da service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:52.672942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaaa193-b715-40a7-81f0-222b862ec2da service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:52.699716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaa193-b715-40a7-81f0-222b862ec2da service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:52.705245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaaa193-b715-40a7-81f0-222b862ec2da service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:52.748950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0fd20-aebd-416a-9736-e4e328ccae1d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:52.756211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f16884-6451-479d-82bf-cba956ec2fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:52.756853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f16884-6451-479d-82bf-cba956ec2fd1 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:52.757178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f16884-6451-479d-82bf-cba956ec2fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:52.757774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f16884-6451-479d-82bf-cba956ec2fd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:52.758700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f16884-6451-479d-82bf-cba956ec2fd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:52.760668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f16884-6451-479d-82bf-cba956ec2fd1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:52.783684 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:52.785775 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3716/7430] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:52.810010 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3715/7431] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:25:52 2022] POST /identity/v3/projects => generated 381 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:52.814629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaa193-b715-40a7-81f0-222b862ec2da service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:52.828513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaaa193-b715-40a7-81f0-222b862ec2da service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:52.988265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaeb1d-6921-48b7-8462-823240dc9ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:52.988912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaeb1d-6921-48b7-8462-823240dc9ede admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:52.989202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaeb1d-6921-48b7-8462-823240dc9ede admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:52.989511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adaeb1d-6921-48b7-8462-823240dc9ede admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:52.990160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaeb1d-6921-48b7-8462-823240dc9ede admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:52.992117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adaeb1d-6921-48b7-8462-823240dc9ede admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:53.057992 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3717/7432] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:25:52 2022] POST /identity/v3/users => generated 297 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:25:53.058992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f16884-6451-479d-82bf-cba956ec2fd1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:53.092218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f16884-6451-479d-82bf-cba956ec2fd1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:53.100679 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77815d8f-38f2-4a93-a971-ec1c5a2f0257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:53.101591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815d8f-38f2-4a93-a971-ec1c5a2f0257 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:53.102026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815d8f-38f2-4a93-a971-ec1c5a2f0257 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:53.102484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77815d8f-38f2-4a93-a971-ec1c5a2f0257 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:53.103291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77815d8f-38f2-4a93-a971-ec1c5a2f0257 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:53.108877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77815d8f-38f2-4a93-a971-ec1c5a2f0257 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:53.149900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaeb1d-6921-48b7-8462-823240dc9ede admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:53.152868 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3716/7433] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:53.171986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adaeb1d-6921-48b7-8462-823240dc9ede admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:53.192822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8357d-1785-4752-9762-b02713c0ade7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:53.193603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8357d-1785-4752-9762-b02713c0ade7 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:53.193898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8357d-1785-4752-9762-b02713c0ade7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:53.194178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c8357d-1785-4752-9762-b02713c0ade7 admin admin] PATH_INFO: `/v3/projects/27a9284412bc48b4b9f457811bf335a6/users/27958c9254b443d4b77585f5fe73475b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:53.232643 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:53.243122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8357d-1785-4752-9762-b02713c0ade7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a9284412bc48b4b9f457811bf335a6, user_id=27958c9254b443d4b77585f5fe73475b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:53.246779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c8357d-1785-4752-9762-b02713c0ade7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:53.277690 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3718/7434] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:53 2022] PUT /identity/v3/projects/27a9284412bc48b4b9f457811bf335a6/users/27958c9254b443d4b77585f5fe73475b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:25:53.282258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77815d8f-38f2-4a93-a971-ec1c5a2f0257 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:53.308276 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77815d8f-38f2-4a93-a971-ec1c5a2f0257 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:53.478688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6ea735-26c8-4e5b-91e4-3f9ed755a32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:53.479749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea735-26c8-4e5b-91e4-3f9ed755a32b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:53.480109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea735-26c8-4e5b-91e4-3f9ed755a32b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:53.480455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6ea735-26c8-4e5b-91e4-3f9ed755a32b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:53.481273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ea735-26c8-4e5b-91e4-3f9ed755a32b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:53.484298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6ea735-26c8-4e5b-91e4-3f9ed755a32b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:53.498008 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3717/7435] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:25:53 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:25:53.502277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8357d-1785-4752-9762-b02713c0ade7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:53.515031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c8357d-1785-4752-9762-b02713c0ade7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:53.524460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeb2b1-00e3-4e20-99e2-0ee14b7e60ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:53.525992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeb2b1-00e3-4e20-99e2-0ee14b7e60ff admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:53.526504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeb2b1-00e3-4e20-99e2-0ee14b7e60ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:53.527881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedeb2b1-00e3-4e20-99e2-0ee14b7e60ff admin admin] PATH_INFO: `/v3/projects/27a9284412bc48b4b9f457811bf335a6/users/27958c9254b443d4b77585f5fe73475b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:53.533514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeb2b1-00e3-4e20-99e2-0ee14b7e60ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=27a9284412bc48b4b9f457811bf335a6, user_id=27958c9254b443d4b77585f5fe73475b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:53.538920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedeb2b1-00e3-4e20-99e2-0ee14b7e60ff admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:53.560115 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3719/7436] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:25:53 2022] PUT /identity/v3/projects/27a9284412bc48b4b9f457811bf335a6/users/27958c9254b443d4b77585f5fe73475b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:53.570251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825533ac-cacf-45c3-955a-ec2595961d55 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:53.572665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825533ac-cacf-45c3-955a-ec2595961d55 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:53.573261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825533ac-cacf-45c3-955a-ec2595961d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:53.678437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-825533ac-cacf-45c3-955a-ec2595961d55 None None] MFA Rules not processed for user `27958c9254b443d4b77585f5fe73475b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:53.679852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-825533ac-cacf-45c3-955a-ec2595961d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:53.896646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeb2b1-00e3-4e20-99e2-0ee14b7e60ff admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:53.899941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cedeb2b1-00e3-4e20-99e2-0ee14b7e60ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:53.977738 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3718/7437] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:53.994222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825533ac-cacf-45c3-955a-ec2595961d55 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:54.067625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedeb2b1-00e3-4e20-99e2-0ee14b7e60ff admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:54.075270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe0302-17a9-4c50-95bf-5dec6dfcd014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:54.075963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe0302-17a9-4c50-95bf-5dec6dfcd014 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:54.076242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe0302-17a9-4c50-95bf-5dec6dfcd014 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:54.076539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe0302-17a9-4c50-95bf-5dec6dfcd014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:54.086828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6cfe0302-17a9-4c50-95bf-5dec6dfcd014 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:54.139219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825533ac-cacf-45c3-955a-ec2595961d55 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:54.157081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3dd62-4949-4525-92ca-00d90eec36e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:54.158090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3dd62-4949-4525-92ca-00d90eec36e2 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:54.159332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3dd62-4949-4525-92ca-00d90eec36e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:54.159836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b3dd62-4949-4525-92ca-00d90eec36e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:54.194722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3dd62-4949-4525-92ca-00d90eec36e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:54.197915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b3dd62-4949-4525-92ca-00d90eec36e2 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:54.251677 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3719/7438] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:54.254980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe0302-17a9-4c50-95bf-5dec6dfcd014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:54.261037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfe0302-17a9-4c50-95bf-5dec6dfcd014 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:54.294653 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3720/7439] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:53 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:54.535182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3dd62-4949-4525-92ca-00d90eec36e2 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:54.549362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b3dd62-4949-4525-92ca-00d90eec36e2 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:54.559834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d67308-ce0b-473a-94c7-a5969b056a3f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:54.561242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d67308-ce0b-473a-94c7-a5969b056a3f service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:54.561546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d67308-ce0b-473a-94c7-a5969b056a3f service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:54.561991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d67308-ce0b-473a-94c7-a5969b056a3f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:54.569208 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:54.646883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d67308-ce0b-473a-94c7-a5969b056a3f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:54.648290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d67308-ce0b-473a-94c7-a5969b056a3f service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:54.660711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3720/7440] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:55.102484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86dfe-e6ea-4bb9-b24e-31040399ac3a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:55.102973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86dfe-e6ea-4bb9-b24e-31040399ac3a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:55.103231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef86dfe-e6ea-4bb9-b24e-31040399ac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:55.154386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cef86dfe-e6ea-4bb9-b24e-31040399ac3a None None] MFA Rules not processed for user `b62fde68e8c747bfbea881c71421c5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:55.156901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cef86dfe-e6ea-4bb9-b24e-31040399ac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:55.396653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d67308-ce0b-473a-94c7-a5969b056a3f service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:55.406264 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3721/7441] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:25:55.506561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86dfe-e6ea-4bb9-b24e-31040399ac3a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:55.508445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cef86dfe-e6ea-4bb9-b24e-31040399ac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:55.561829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d67308-ce0b-473a-94c7-a5969b056a3f service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:55.573160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:55.573824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:55.574262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:55.574684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] PATH_INFO: `/v3/users/0cd0d1278d3f40359f4d8fba38ead646` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:55.578480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd0d1278d3f40359f4d8fba38ead646)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:55.580584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:55.593717 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:55.666927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef86dfe-e6ea-4bb9-b24e-31040399ac3a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:55.674169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:55.675319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:55.675627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:55.675894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:55.678225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:55.680959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd0d1278d3f40359f4d8fba38ead646'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:55.713384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd0d1278d3f40359f4d8fba38ead646'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:55.714230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd0d1278d3f40359f4d8fba38ead646'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:55.730833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd0d1278d3f40359f4d8fba38ead646'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:55.741380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8dbfcf80-4ae3-4fe2-9d47-7a8e2d6ffd94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd0d1278d3f40359f4d8fba38ead646'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:55.755175 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3721/7442] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:55 2022] DELETE /identity/v3/users/0cd0d1278d3f40359f4d8fba38ead646 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:25:55.759911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691961-fa72-4c67-970b-3021fc58ae23 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:55.760379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691961-fa72-4c67-970b-3021fc58ae23 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:55.760802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be691961-fa72-4c67-970b-3021fc58ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:55.811006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-be691961-fa72-4c67-970b-3021fc58ae23 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:25:55.812497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-be691961-fa72-4c67-970b-3021fc58ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:55.821164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:55.822836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:55.861119 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3722/7443] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:55.863204 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:55.972394 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3722/7444] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:25:55.995414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:55.998785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:56.147591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16562f63-f3be-47cd-bf8d-af5a92fd8b03 service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:56.291961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0af41f-65f6-458b-9d88-4bf51a229edb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:56.291961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0af41f-65f6-458b-9d88-4bf51a229edb service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:56.296759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0af41f-65f6-458b-9d88-4bf51a229edb service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:56.297260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0af41f-65f6-458b-9d88-4bf51a229edb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:56.339255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0af41f-65f6-458b-9d88-4bf51a229edb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:56.341008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0af41f-65f6-458b-9d88-4bf51a229edb service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:56.364716 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3723/7445] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:57.017463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691961-fa72-4c67-970b-3021fc58ae23 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:57.022781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-be691961-fa72-4c67-970b-3021fc58ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:57.036579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be691961-fa72-4c67-970b-3021fc58ae23 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:57.052005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:57.052974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:57.053491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:57.053988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] PATH_INFO: `/v3/projects/655872e944fb4d1ca2b0f7e4fd25b45c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:57.056676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] RBAC: Authorizing `identity:delete_project(project_id=655872e944fb4d1ca2b0f7e4fd25b45c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:57.059845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:57.241956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655872e944fb4d1ca2b0f7e4fd25b45c', 'request_id': 'req-1488e42e-a8dc-4c2e-8062-a1fba5d76884'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.263067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0af41f-65f6-458b-9d88-4bf51a229edb service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:57.265387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bc0af41f-65f6-458b-9d88-4bf51a229edb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:57.266886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655872e944fb4d1ca2b0f7e4fd25b45c', 'request_id': 'req-1488e42e-a8dc-4c2e-8062-a1fba5d76884'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.286996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655872e944fb4d1ca2b0f7e4fd25b45c', 'request_id': 'req-1488e42e-a8dc-4c2e-8062-a1fba5d76884'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.296244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0af41f-65f6-458b-9d88-4bf51a229edb service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:57.359004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] The token cache is being invalidate because project 655872e944fb4d1ca2b0f7e4fd25b45c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:57.359293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.365123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.374355 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3723/7446] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:57 2022] DELETE /identity/v3/projects/655872e944fb4d1ca2b0f7e4fd25b45c => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:57.375700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:57.378991 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:57.386917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:57.425803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:57.426755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:57.427043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:57.427327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:57.434681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:57.454566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:57.456122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:57.477680 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3724/7447] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:25:57.554110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1488e42e-a8dc-4c2e-8062-a1fba5d76884 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:57.578838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:57.579764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:57.580047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:57.580326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] PATH_INFO: `/v3/users/27958c9254b443d4b77585f5fe73475b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:57.590329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] RBAC: Authorizing `identity:delete_user(user_id=27958c9254b443d4b77585f5fe73475b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:57.593016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:57.727721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '27958c9254b443d4b77585f5fe73475b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.731792 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:25:57.765331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '27958c9254b443d4b77585f5fe73475b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.767417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '27958c9254b443d4b77585f5fe73475b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.795363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '27958c9254b443d4b77585f5fe73475b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.806754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '27958c9254b443d4b77585f5fe73475b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:57.831785 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3724/7448] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:25:57 2022] DELETE /identity/v3/users/27958c9254b443d4b77585f5fe73475b => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:58.442749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:58.447429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:58.483556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9603e9-3c1e-4f08-929d-52b86e4e2bab service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:58.662374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa63970e-d082-4130-b579-6a36c64b7de5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:58.663418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63970e-d082-4130-b579-6a36c64b7de5 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:58.663418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63970e-d082-4130-b579-6a36c64b7de5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:58.663655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa63970e-d082-4130-b579-6a36c64b7de5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:58.681872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa63970e-d082-4130-b579-6a36c64b7de5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:58.913101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63970e-d082-4130-b579-6a36c64b7de5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:58.915550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa63970e-d082-4130-b579-6a36c64b7de5 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:58.957053 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3725/7449] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:25:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 515 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:25:59.337882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:25:59.339661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:25:59.643572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b553c790-ccc0-46b4-8a7f-7f11e2521522 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:25:59.668419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:25:59.669179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:59.669528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:59.669811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] PATH_INFO: `/v3/projects/27a9284412bc48b4b9f457811bf335a6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:25:59.677976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] RBAC: Authorizing `identity:delete_project(project_id=27a9284412bc48b4b9f457811bf335a6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:25:59.680037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:25:59.869604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27a9284412bc48b4b9f457811bf335a6', 'request_id': 'req-940df5f1-759f-4303-89dc-77e0a41da65b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:59.887623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27a9284412bc48b4b9f457811bf335a6', 'request_id': 'req-940df5f1-759f-4303-89dc-77e0a41da65b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:59.917103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27a9284412bc48b4b9f457811bf335a6', 'request_id': 'req-940df5f1-759f-4303-89dc-77e0a41da65b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:59.941256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] The token cache is being invalidate because project 27a9284412bc48b4b9f457811bf335a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:25:59.941811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:59.943446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-940df5f1-759f-4303-89dc-77e0a41da65b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:25:59.950078 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3725/7450] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:25:59 2022] DELETE /identity/v3/projects/27a9284412bc48b4b9f457811bf335a6 => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:25:59.952192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dada77-3980-4ea1-a56b-1b298fac41d4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:25:59.953507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dada77-3980-4ea1-a56b-1b298fac41d4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:25:59.954041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dada77-3980-4ea1-a56b-1b298fac41d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:00.005112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c9dada77-3980-4ea1-a56b-1b298fac41d4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:00.006961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c9dada77-3980-4ea1-a56b-1b298fac41d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:00.101961 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3726/7451] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:25:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:00.111273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86f20a-3e57-4423-8415-183126daa536 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:00.111563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86f20a-3e57-4423-8415-183126daa536 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:00.111840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b86f20a-3e57-4423-8415-183126daa536 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:00.162975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8b86f20a-3e57-4423-8415-183126daa536 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:00.164223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b86f20a-3e57-4423-8415-183126daa536 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:00.190159 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3726/7452] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:00.194863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dada77-3980-4ea1-a56b-1b298fac41d4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:00.207131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dada77-3980-4ea1-a56b-1b298fac41d4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:00.221351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7e029-61cd-43e1-b4ea-1a7fb0570833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:00.223971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7e029-61cd-43e1-b4ea-1a7fb0570833 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:00.224369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7e029-61cd-43e1-b4ea-1a7fb0570833 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:00.224703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b7e029-61cd-43e1-b4ea-1a7fb0570833 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:00.226937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7e029-61cd-43e1-b4ea-1a7fb0570833 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:26:00.227286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7e029-61cd-43e1-b4ea-1a7fb0570833 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:00.230590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b7e029-61cd-43e1-b4ea-1a7fb0570833 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:00.273123 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3727/7453] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:26:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:26:00.278297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86f20a-3e57-4423-8415-183126daa536 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:00.290523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b86f20a-3e57-4423-8415-183126daa536 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:00.302461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059de6b-7e59-4ebe-a9bd-9d71bd9e0895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:00.303090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059de6b-7e59-4ebe-a9bd-9d71bd9e0895 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:00.303427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059de6b-7e59-4ebe-a9bd-9d71bd9e0895 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:00.303707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b059de6b-7e59-4ebe-a9bd-9d71bd9e0895 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:00.304352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059de6b-7e59-4ebe-a9bd-9d71bd9e0895 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:00.306330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b059de6b-7e59-4ebe-a9bd-9d71bd9e0895 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:00.371177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7e029-61cd-43e1-b4ea-1a7fb0570833 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:00.378418 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3727/7454] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:00 2022] POST /identity/v3/projects => generated 371 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:00.378975 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:00.388127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b7e029-61cd-43e1-b4ea-1a7fb0570833 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:00.466950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a40fcc-cbf8-4755-8376-33f5d7ed9a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:00.467820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a40fcc-cbf8-4755-8376-33f5d7ed9a36 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:00.468276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a40fcc-cbf8-4755-8376-33f5d7ed9a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:00.468717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a40fcc-cbf8-4755-8376-33f5d7ed9a36 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:00.469537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a40fcc-cbf8-4755-8376-33f5d7ed9a36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:00.471626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a40fcc-cbf8-4755-8376-33f5d7ed9a36 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:00.511661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059de6b-7e59-4ebe-a9bd-9d71bd9e0895 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:00.513076 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3728/7455] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:00 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:00.525596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b059de6b-7e59-4ebe-a9bd-9d71bd9e0895 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:00.542051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1281e0-0d3d-40e3-be7b-2aece7e667df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:00.543022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1281e0-0d3d-40e3-be7b-2aece7e667df admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:00.543713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1281e0-0d3d-40e3-be7b-2aece7e667df admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:00.544149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1281e0-0d3d-40e3-be7b-2aece7e667df admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:00.546692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1281e0-0d3d-40e3-be7b-2aece7e667df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:00.550330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1281e0-0d3d-40e3-be7b-2aece7e667df admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:00.580638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a40fcc-cbf8-4755-8376-33f5d7ed9a36 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:00.588233 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3728/7456] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:00.596303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a40fcc-cbf8-4755-8376-33f5d7ed9a36 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:00.614467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50817df-5234-4208-ba4e-365f9e96d191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:00.615647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50817df-5234-4208-ba4e-365f9e96d191 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:00.616913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50817df-5234-4208-ba4e-365f9e96d191 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:00.617615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50817df-5234-4208-ba4e-365f9e96d191 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:00.618536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50817df-5234-4208-ba4e-365f9e96d191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:00.622477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50817df-5234-4208-ba4e-365f9e96d191 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:00.657781 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3729/7457] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:00 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:26:00.659338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1281e0-0d3d-40e3-be7b-2aece7e667df admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:00.676264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1281e0-0d3d-40e3-be7b-2aece7e667df admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:00.693742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049604-73b4-4e8b-a7de-249cce33e252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:00.694851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049604-73b4-4e8b-a7de-249cce33e252 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:00.695135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049604-73b4-4e8b-a7de-249cce33e252 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:00.695414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20049604-73b4-4e8b-a7de-249cce33e252 admin admin] PATH_INFO: `/v3/projects/36d827271fb5462b9271fa0aad666949/users/eff0a34acf48466689c201d876a0cda4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:00.761611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20049604-73b4-4e8b-a7de-249cce33e252 admin admin] RBAC: Authorizing `identity:create_grant(project_id=36d827271fb5462b9271fa0aad666949, user_id=eff0a34acf48466689c201d876a0cda4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:00.770241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20049604-73b4-4e8b-a7de-249cce33e252 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:00.781526 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:00.864173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c1533-f0ab-435f-be50-007dc11d7312 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:00.869390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3729/7458] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:00 2022] PUT /identity/v3/projects/36d827271fb5462b9271fa0aad666949/users/eff0a34acf48466689c201d876a0cda4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:00.870884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c1533-f0ab-435f-be50-007dc11d7312 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:00.871216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4c1533-f0ab-435f-be50-007dc11d7312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:00.941640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1c4c1533-f0ab-435f-be50-007dc11d7312 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:00.942975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1c4c1533-f0ab-435f-be50-007dc11d7312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:01.043561 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3730/7459] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:26:01.084156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049604-73b4-4e8b-a7de-249cce33e252 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:01.085875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20049604-73b4-4e8b-a7de-249cce33e252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:01.241245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20049604-73b4-4e8b-a7de-249cce33e252 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:01.250849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0f489-7718-4062-b0ea-c3d9493dfd2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:01.251880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0f489-7718-4062-b0ea-c3d9493dfd2b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:01.251880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0f489-7718-4062-b0ea-c3d9493dfd2b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:01.252406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0f489-7718-4062-b0ea-c3d9493dfd2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:01.284290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0f489-7718-4062-b0ea-c3d9493dfd2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:01.287562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0f489-7718-4062-b0ea-c3d9493dfd2b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:01.314576 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3730/7460] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:04.126973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa8f59-18b3-4e01-a245-995613d5edf1 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:04.127546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa8f59-18b3-4e01-a245-995613d5edf1 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:04.127546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa8f59-18b3-4e01-a245-995613d5edf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:04.204255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0bfa8f59-18b3-4e01-a245-995613d5edf1 None None] MFA Rules not processed for user `eff0a34acf48466689c201d876a0cda4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:04.208958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0bfa8f59-18b3-4e01-a245-995613d5edf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:04.376761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0f489-7718-4062-b0ea-c3d9493dfd2b service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:04.378878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-44e0f489-7718-4062-b0ea-c3d9493dfd2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:04.449132 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3731/7461] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:04.452864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa8f59-18b3-4e01-a245-995613d5edf1 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:04.518106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa8f59-18b3-4e01-a245-995613d5edf1 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:04.554252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc0835-a69e-42e9-af0f-068681a8bb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:04.559371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc0835-a69e-42e9-af0f-068681a8bb94 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:04.559656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc0835-a69e-42e9-af0f-068681a8bb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:04.569606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffc0835-a69e-42e9-af0f-068681a8bb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:04.576088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc0835-a69e-42e9-af0f-068681a8bb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:04.576088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffc0835-a69e-42e9-af0f-068681a8bb94 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:04.614586 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:04.666201 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3732/7462] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:04 2022] POST /identity/v3/projects => generated 373 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:04.667203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc0835-a69e-42e9-af0f-068681a8bb94 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:04.696800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0f489-7718-4062-b0ea-c3d9493dfd2b service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:04.916122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffc0835-a69e-42e9-af0f-068681a8bb94 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:04.937197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8e85b-6ca4-4554-ac55-47b5550202ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:04.937867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e85b-6ca4-4554-ac55-47b5550202ae admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:04.938155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e85b-6ca4-4554-ac55-47b5550202ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:04.938436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae8e85b-6ca4-4554-ac55-47b5550202ae admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:04.939086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8e85b-6ca4-4554-ac55-47b5550202ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:04.940912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b1b97-5dc5-4655-8e2a-bd4c26bc7703 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:04.941060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae8e85b-6ca4-4554-ac55-47b5550202ae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:04.941549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b1b97-5dc5-4655-8e2a-bd4c26bc7703 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:04.941825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b1b97-5dc5-4655-8e2a-bd4c26bc7703 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:04.942206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b1b97-5dc5-4655-8e2a-bd4c26bc7703 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:04.948249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-290b1b97-5dc5-4655-8e2a-bd4c26bc7703 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:05.010885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3733/7463] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:04 2022] POST /identity/v3/users => generated 293 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:05.017202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8e85b-6ca4-4554-ac55-47b5550202ae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:05.055412 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:05.116293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae8e85b-6ca4-4554-ac55-47b5550202ae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:05.153630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2afda7-ec8a-4526-8a36-1daa9c472037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:05.153630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2afda7-ec8a-4526-8a36-1daa9c472037 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:05.153630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2afda7-ec8a-4526-8a36-1daa9c472037 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:05.153630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2afda7-ec8a-4526-8a36-1daa9c472037 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:05.154436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2afda7-ec8a-4526-8a36-1daa9c472037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:05.155813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2afda7-ec8a-4526-8a36-1daa9c472037 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:05.210606 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3734/7464] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:05.212594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2afda7-ec8a-4526-8a36-1daa9c472037 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:05.254659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b1b97-5dc5-4655-8e2a-bd4c26bc7703 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:05.256819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290b1b97-5dc5-4655-8e2a-bd4c26bc7703 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:05.267722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2afda7-ec8a-4526-8a36-1daa9c472037 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:05.293162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c5bc-01ad-499b-8cde-6d7d7de74535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:05.294823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c5bc-01ad-499b-8cde-6d7d7de74535 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:05.294823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c5bc-01ad-499b-8cde-6d7d7de74535 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:05.295293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c3c5bc-01ad-499b-8cde-6d7d7de74535 admin admin] PATH_INFO: `/v3/projects/178d32b3c9d94f578e8eeb704c4f6d5e/users/fe233c29324741a683234ff65cea8d7b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:05.333599 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3731/7465] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:04 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 958 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:26:05.362251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3c5bc-01ad-499b-8cde-6d7d7de74535 admin admin] RBAC: Authorizing `identity:create_grant(project_id=178d32b3c9d94f578e8eeb704c4f6d5e, user_id=fe233c29324741a683234ff65cea8d7b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:05.365161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c3c5bc-01ad-499b-8cde-6d7d7de74535 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:05.410849 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3735/7466] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:05 2022] PUT /identity/v3/projects/178d32b3c9d94f578e8eeb704c4f6d5e/users/fe233c29324741a683234ff65cea8d7b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:05.415029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b1b97-5dc5-4655-8e2a-bd4c26bc7703 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:05.440996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b1b97-5dc5-4655-8e2a-bd4c26bc7703 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:05.638312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f876b0-4e37-4d48-b973-da07c4be2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:05.638913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f876b0-4e37-4d48-b973-da07c4be2671 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:05.639209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f876b0-4e37-4d48-b973-da07c4be2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:05.639492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f876b0-4e37-4d48-b973-da07c4be2671 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:05.640170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f876b0-4e37-4d48-b973-da07c4be2671 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:05.644710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f876b0-4e37-4d48-b973-da07c4be2671 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:05.681130 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3732/7467] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:05.686069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c5bc-01ad-499b-8cde-6d7d7de74535 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:05.704061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c3c5bc-01ad-499b-8cde-6d7d7de74535 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:05.718895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59dd0ef-92ee-4221-aa0d-f13e2445740f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:05.719878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd0ef-92ee-4221-aa0d-f13e2445740f admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:05.720335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd0ef-92ee-4221-aa0d-f13e2445740f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:05.720752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59dd0ef-92ee-4221-aa0d-f13e2445740f admin admin] PATH_INFO: `/v3/projects/178d32b3c9d94f578e8eeb704c4f6d5e/users/fe233c29324741a683234ff65cea8d7b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:05.724465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dd0ef-92ee-4221-aa0d-f13e2445740f admin admin] RBAC: Authorizing `identity:create_grant(project_id=178d32b3c9d94f578e8eeb704c4f6d5e, user_id=fe233c29324741a683234ff65cea8d7b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:05.734369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59dd0ef-92ee-4221-aa0d-f13e2445740f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:05.777908 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3736/7468] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:05 2022] PUT /identity/v3/projects/178d32b3c9d94f578e8eeb704c4f6d5e/users/fe233c29324741a683234ff65cea8d7b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:07.589989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f876b0-4e37-4d48-b973-da07c4be2671 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:07.613627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-52f876b0-4e37-4d48-b973-da07c4be2671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:07.731918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f876b0-4e37-4d48-b973-da07c4be2671 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:07.859836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06438555-6b38-441e-a6ea-18a8989f5962 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:07.860736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06438555-6b38-441e-a6ea-18a8989f5962 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:07.861239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06438555-6b38-441e-a6ea-18a8989f5962 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:07.861644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06438555-6b38-441e-a6ea-18a8989f5962 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:07.867460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06438555-6b38-441e-a6ea-18a8989f5962 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:07.894201 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:07.978930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06438555-6b38-441e-a6ea-18a8989f5962 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:07.980714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06438555-6b38-441e-a6ea-18a8989f5962 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:07.999872 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3733/7469] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:08.621697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82d54-c15c-4194-ae22-8f0baa76b2c6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:08.622612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82d54-c15c-4194-ae22-8f0baa76b2c6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:08.623151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e82d54-c15c-4194-ae22-8f0baa76b2c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:08.689506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-46e82d54-c15c-4194-ae22-8f0baa76b2c6 None None] MFA Rules not processed for user `fe233c29324741a683234ff65cea8d7b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:08.690763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-46e82d54-c15c-4194-ae22-8f0baa76b2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:08.920915 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3737/7470] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:08.931179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f196fc-4bad-496a-a312-63d63c6ed398 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:08.931675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f196fc-4bad-496a-a312-63d63c6ed398 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:08.931776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f196fc-4bad-496a-a312-63d63c6ed398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:08.969611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-65f196fc-4bad-496a-a312-63d63c6ed398 None None] MFA Rules not processed for user `eff0a34acf48466689c201d876a0cda4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:08.971285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-65f196fc-4bad-496a-a312-63d63c6ed398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:09.079128 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3734/7471] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:09.092360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e82d54-c15c-4194-ae22-8f0baa76b2c6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:09.094398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-46e82d54-c15c-4194-ae22-8f0baa76b2c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:09.135846 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:09.288627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e82d54-c15c-4194-ae22-8f0baa76b2c6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:09.307063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5017be-cce4-479e-a93c-2294fff2cf52 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:09.307836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5017be-cce4-479e-a93c-2294fff2cf52 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:09.308235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5017be-cce4-479e-a93c-2294fff2cf52 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:09.308624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5017be-cce4-479e-a93c-2294fff2cf52 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:09.330882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5017be-cce4-479e-a93c-2294fff2cf52 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:09.348920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5017be-cce4-479e-a93c-2294fff2cf52 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:09.385282 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3738/7472] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:13.816873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f196fc-4bad-496a-a312-63d63c6ed398 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:13.818442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-65f196fc-4bad-496a-a312-63d63c6ed398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:13.951418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f196fc-4bad-496a-a312-63d63c6ed398 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:13.988845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:13.990750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:13.991224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:13.991382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] PATH_INFO: `/v3/users/1e585612a71f4ca492e98865d0c0e606` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:13.993408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e585612a71f4ca492e98865d0c0e606)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:13.995474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:14.119932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e585612a71f4ca492e98865d0c0e606'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:14.138023 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:14.149583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e585612a71f4ca492e98865d0c0e606'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:14.149583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e585612a71f4ca492e98865d0c0e606'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:14.159377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e585612a71f4ca492e98865d0c0e606'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:14.177051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e585612a71f4ca492e98865d0c0e606'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:14.186907 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3735/7473] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:13 2022] DELETE /identity/v3/users/1e585612a71f4ca492e98865d0c0e606 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:14.191831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ac16-11db-445f-b498-ff3a76d03e22 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:14.192331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ac16-11db-445f-b498-ff3a76d03e22 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:14.192331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243ac16-11db-445f-b498-ff3a76d03e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:14.221014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c243ac16-11db-445f-b498-ff3a76d03e22 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:14.222295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c243ac16-11db-445f-b498-ff3a76d03e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:14.360040 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3739/7474] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:26:14.392749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:14.395066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:14.570901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c9a301-aa76-4e93-98d3-f04fee03d7a4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:14.582643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920476d-3272-47e1-ba77-fa879a236b86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:14.583528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920476d-3272-47e1-ba77-fa879a236b86 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:14.587918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920476d-3272-47e1-ba77-fa879a236b86 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:14.588440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920476d-3272-47e1-ba77-fa879a236b86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:14.608749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920476d-3272-47e1-ba77-fa879a236b86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:14.610661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920476d-3272-47e1-ba77-fa879a236b86 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:14.633730 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3736/7475] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:16.350733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ac16-11db-445f-b498-ff3a76d03e22 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:16.351191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c243ac16-11db-445f-b498-ff3a76d03e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:16.373201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243ac16-11db-445f-b498-ff3a76d03e22 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:16.383964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:16.385819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:16.386103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:16.386381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] PATH_INFO: `/v3/projects/5e80c415977641fea2e904d02d737356` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:16.390322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e80c415977641fea2e904d02d737356)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:16.397355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:16.514327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e80c415977641fea2e904d02d737356', 'request_id': 'req-98ba8f84-7d95-475b-ab61-882f81724762'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:16.536083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e80c415977641fea2e904d02d737356', 'request_id': 'req-98ba8f84-7d95-475b-ab61-882f81724762'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:16.548038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e80c415977641fea2e904d02d737356', 'request_id': 'req-98ba8f84-7d95-475b-ab61-882f81724762'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:16.585663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] The token cache is being invalidate because project 5e80c415977641fea2e904d02d737356 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:16.585965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:16.586674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:16.591654 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3740/7476] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:16 2022] DELETE /identity/v3/projects/5e80c415977641fea2e904d02d737356 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:16.592728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920476d-3272-47e1-ba77-fa879a236b86 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:16.611201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920476d-3272-47e1-ba77-fa879a236b86 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:16.747209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:16.747968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:16.750030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:16.750409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] PATH_INFO: `/v3/users/917681a698464618820d67e720bf22d6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:16.762374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=917681a698464618820d67e720bf22d6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:16.764587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:16.890022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917681a698464618820d67e720bf22d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:16.923718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917681a698464618820d67e720bf22d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:16.926647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917681a698464618820d67e720bf22d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:16.951185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917681a698464618820d67e720bf22d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:16.958658 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:16.962947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917681a698464618820d67e720bf22d6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:17.015765 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3737/7477] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:16 2022] DELETE /identity/v3/users/917681a698464618820d67e720bf22d6 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:18.285470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:18.287504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:18.318194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ba8f84-7d95-475b-ab61-882f81724762 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:18.393954 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:18.490491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:18.492531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:18.517169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:18.518071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:18.518524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:18.518968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] PATH_INFO: `/v3/projects/a99ce40ba8fb4012810c995749451d67` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:18.522766 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a99ce40ba8fb4012810c995749451d67)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:18.524871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:18.603166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f82fc0-90e4-4128-a8f6-d212f2c71bd0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:18.619432 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:18.620921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:18.621675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:18.622999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:18.625548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:18.644935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a99ce40ba8fb4012810c995749451d67', 'request_id': 'req-c0726608-85bf-4c1c-ab63-a11944b3e971'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:18.646222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:18.650119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:18.659187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a99ce40ba8fb4012810c995749451d67', 'request_id': 'req-c0726608-85bf-4c1c-ab63-a11944b3e971'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:18.671836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a99ce40ba8fb4012810c995749451d67', 'request_id': 'req-c0726608-85bf-4c1c-ab63-a11944b3e971'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:18.688878 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3738/7478] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:18.689976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] The token cache is being invalidate because project a99ce40ba8fb4012810c995749451d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:18.690390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:18.691178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:18.697529 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3741/7479] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:18 2022] DELETE /identity/v3/projects/a99ce40ba8fb4012810c995749451d67 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:18.698689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:18.700638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:18.728562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a95753-ac10-4917-916d-46af3197513c service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:18.845003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:18.847122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:18.852150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:18.853471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] PATH_INFO: `/v3/users/be7b7e5790ec4376b0e0765d2f9229be` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:18.858221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be7b7e5790ec4376b0e0765d2f9229be)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:18.863269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:18.961568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be7b7e5790ec4376b0e0765d2f9229be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:18.987463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be7b7e5790ec4376b0e0765d2f9229be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:18.989120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be7b7e5790ec4376b0e0765d2f9229be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:19.001956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be7b7e5790ec4376b0e0765d2f9229be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:19.013053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fcccd86f-555b-4cf0-9d58-1d6963dec7d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be7b7e5790ec4376b0e0765d2f9229be'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:19.021334 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3739/7480] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:18 2022] DELETE /identity/v3/users/be7b7e5790ec4376b0e0765d2f9229be => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:19.493457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:19.495356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:19.518907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0726608-85bf-4c1c-ab63-a11944b3e971 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:19.664522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:19.665589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:19.666093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:19.666585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] PATH_INFO: `/v3/projects/c1fdc622826b4e96bba6b3d51e3adba1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:19.670519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c1fdc622826b4e96bba6b3d51e3adba1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:19.674920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:19.764501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c1fdc622826b4e96bba6b3d51e3adba1', 'request_id': 'req-035e7ed8-9253-41b7-b832-e8365364f09b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:19.789399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c1fdc622826b4e96bba6b3d51e3adba1', 'request_id': 'req-035e7ed8-9253-41b7-b832-e8365364f09b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:19.793549 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:19.806485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c1fdc622826b4e96bba6b3d51e3adba1', 'request_id': 'req-035e7ed8-9253-41b7-b832-e8365364f09b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:19.835421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] The token cache is being invalidate because project c1fdc622826b4e96bba6b3d51e3adba1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:19.835795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:19.836693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-035e7ed8-9253-41b7-b832-e8365364f09b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:19.839859 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3742/7481] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:19 2022] DELETE /identity/v3/projects/c1fdc622826b4e96bba6b3d51e3adba1 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:19.846499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abdd7f-7738-4af1-8d5f-b7ccf624d1e7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:19.846990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abdd7f-7738-4af1-8d5f-b7ccf624d1e7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:19.847089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78abdd7f-7738-4af1-8d5f-b7ccf624d1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:19.897891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-78abdd7f-7738-4af1-8d5f-b7ccf624d1e7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:19.899157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-78abdd7f-7738-4af1-8d5f-b7ccf624d1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:19.927916 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:20.045198 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3740/7482] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:20.053585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551fe35-ff2a-4e54-9360-af2d23a05ef5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:20.054216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551fe35-ff2a-4e54-9360-af2d23a05ef5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:20.054216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0551fe35-ff2a-4e54-9360-af2d23a05ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:20.094347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0551fe35-ff2a-4e54-9360-af2d23a05ef5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:20.097636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0551fe35-ff2a-4e54-9360-af2d23a05ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:20.124069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abdd7f-7738-4af1-8d5f-b7ccf624d1e7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:20.135195 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3743/7483] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:20.140764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78abdd7f-7738-4af1-8d5f-b7ccf624d1e7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:20.156058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3a97-ad4e-4170-9597-1d5cad8f6f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:20.156694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3a97-ad4e-4170-9597-1d5cad8f6f46 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:20.156977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3a97-ad4e-4170-9597-1d5cad8f6f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:20.157254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc3a97-ad4e-4170-9597-1d5cad8f6f46 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:20.157985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3a97-ad4e-4170-9597-1d5cad8f6f46 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:26:20.158289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3a97-ad4e-4170-9597-1d5cad8f6f46 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:20.159916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc3a97-ad4e-4170-9597-1d5cad8f6f46 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:20.190527 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3741/7484] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:26:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:26:20.193669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551fe35-ff2a-4e54-9360-af2d23a05ef5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:20.206819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0551fe35-ff2a-4e54-9360-af2d23a05ef5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:20.220002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea350-498a-4b85-a9ed-6c26bf74c55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:20.220741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea350-498a-4b85-a9ed-6c26bf74c55d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:20.221032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea350-498a-4b85-a9ed-6c26bf74c55d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:20.221331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fea350-498a-4b85-a9ed-6c26bf74c55d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:20.222155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fea350-498a-4b85-a9ed-6c26bf74c55d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:20.224151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fea350-498a-4b85-a9ed-6c26bf74c55d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:20.302128 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3744/7485] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:20 2022] POST /identity/v3/projects => generated 371 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:20.306322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3a97-ad4e-4170-9597-1d5cad8f6f46 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:20.326029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc3a97-ad4e-4170-9597-1d5cad8f6f46 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:20.482968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe9d9-60d5-4723-9265-6df9336e69f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:20.483612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe9d9-60d5-4723-9265-6df9336e69f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:20.483968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe9d9-60d5-4723-9265-6df9336e69f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:20.484362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9fe9d9-60d5-4723-9265-6df9336e69f3 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:20.485076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fe9d9-60d5-4723-9265-6df9336e69f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:20.487537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9fe9d9-60d5-4723-9265-6df9336e69f3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:20.527799 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3742/7486] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:20 2022] POST /identity/v3/users => generated 286 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:26:20.533062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea350-498a-4b85-a9ed-6c26bf74c55d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:20.551198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fea350-498a-4b85-a9ed-6c26bf74c55d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:20.569318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008eebb-b67b-4d9e-bce8-0d8dc7cc3f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:20.569941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008eebb-b67b-4d9e-bce8-0d8dc7cc3f44 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:20.570399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008eebb-b67b-4d9e-bce8-0d8dc7cc3f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:20.570690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9008eebb-b67b-4d9e-bce8-0d8dc7cc3f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:20.571982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008eebb-b67b-4d9e-bce8-0d8dc7cc3f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:20.577020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9008eebb-b67b-4d9e-bce8-0d8dc7cc3f44 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:20.629412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3745/7487] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:20.630611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe9d9-60d5-4723-9265-6df9336e69f3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:20.654219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9fe9d9-60d5-4723-9265-6df9336e69f3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:20.670010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a49dd0-6830-4b9f-a7b9-a7abdc404d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:20.670793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a49dd0-6830-4b9f-a7b9-a7abdc404d14 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:20.671658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a49dd0-6830-4b9f-a7b9-a7abdc404d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:20.671953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a49dd0-6830-4b9f-a7b9-a7abdc404d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:20.672623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a49dd0-6830-4b9f-a7b9-a7abdc404d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:20.678178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a49dd0-6830-4b9f-a7b9-a7abdc404d14 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:20.710228 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3743/7488] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:20 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:20.711350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008eebb-b67b-4d9e-bce8-0d8dc7cc3f44 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:20.730541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9008eebb-b67b-4d9e-bce8-0d8dc7cc3f44 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:20.757590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb70af4-a230-4101-b4b5-dcab8ba88b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:20.758286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb70af4-a230-4101-b4b5-dcab8ba88b0d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:20.758565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb70af4-a230-4101-b4b5-dcab8ba88b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:20.758848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb70af4-a230-4101-b4b5-dcab8ba88b0d admin admin] PATH_INFO: `/v3/projects/37c9e5bc85ff4d28852f3ddc39607e48/users/7ed080f66a6942519886f5b2a399a8b4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:20.807094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb70af4-a230-4101-b4b5-dcab8ba88b0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c9e5bc85ff4d28852f3ddc39607e48, user_id=7ed080f66a6942519886f5b2a399a8b4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:20.813462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb70af4-a230-4101-b4b5-dcab8ba88b0d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:20.857782 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3746/7489] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:20 2022] PUT /identity/v3/projects/37c9e5bc85ff4d28852f3ddc39607e48/users/7ed080f66a6942519886f5b2a399a8b4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:20.863954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617f5d-42ec-4b81-a61d-0f9ba1f30e81 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:20.865384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617f5d-42ec-4b81-a61d-0f9ba1f30e81 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:20.866716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43617f5d-42ec-4b81-a61d-0f9ba1f30e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:20.908434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-43617f5d-42ec-4b81-a61d-0f9ba1f30e81 None None] MFA Rules not processed for user `7ed080f66a6942519886f5b2a399a8b4`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:20.910630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-43617f5d-42ec-4b81-a61d-0f9ba1f30e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:21.066654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3744/7490] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:21.079904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb70af4-a230-4101-b4b5-dcab8ba88b0d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:21.081771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9fb70af4-a230-4101-b4b5-dcab8ba88b0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:21.218335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb70af4-a230-4101-b4b5-dcab8ba88b0d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:21.223081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce5ddc-ea28-46bd-a5e4-27bc81693bc2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:21.224140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce5ddc-ea28-46bd-a5e4-27bc81693bc2 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:21.224586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce5ddc-ea28-46bd-a5e4-27bc81693bc2 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:21.225013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce5ddc-ea28-46bd-a5e4-27bc81693bc2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:21.245931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce5ddc-ea28-46bd-a5e4-27bc81693bc2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:21.248241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ce5ddc-ea28-46bd-a5e4-27bc81693bc2 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:21.272359 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3747/7491] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:21.286401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617f5d-42ec-4b81-a61d-0f9ba1f30e81 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:21.302825 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:21.367366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43617f5d-42ec-4b81-a61d-0f9ba1f30e81 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:21.374566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:21.375724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:21.376334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:21.376804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] PATH_INFO: `/v3/users/7ed080f66a6942519886f5b2a399a8b4` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:21.378372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ed080f66a6942519886f5b2a399a8b4)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:21.380979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:21.475174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ed080f66a6942519886f5b2a399a8b4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:21.493016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ed080f66a6942519886f5b2a399a8b4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:21.494363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ed080f66a6942519886f5b2a399a8b4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:21.508107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ed080f66a6942519886f5b2a399a8b4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:21.523470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ed080f66a6942519886f5b2a399a8b4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:21.531569 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3745/7492] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:21 2022] DELETE /identity/v3/users/7ed080f66a6942519886f5b2a399a8b4 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:26:21.536377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7cda5-1bc8-48c2-802e-854bd34d0685 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:21.537217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7cda5-1bc8-48c2-802e-854bd34d0685 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:21.537671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f7cda5-1bc8-48c2-802e-854bd34d0685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:21.569608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-35f7cda5-1bc8-48c2-802e-854bd34d0685 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:21.571758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-35f7cda5-1bc8-48c2-802e-854bd34d0685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:21.677245 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3748/7493] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:21.690651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:21.691639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:21.796926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71b32e8-c168-44d7-bdc7-7a17cdb15324 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:21.803634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609f44-a5dc-46fe-99a8-7330a91696da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:21.806164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609f44-a5dc-46fe-99a8-7330a91696da service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:21.806460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609f44-a5dc-46fe-99a8-7330a91696da service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:21.806829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5609f44-a5dc-46fe-99a8-7330a91696da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:21.822503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5609f44-a5dc-46fe-99a8-7330a91696da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:21.824499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5609f44-a5dc-46fe-99a8-7330a91696da service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:21.857364 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3746/7494] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:22.206433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7cda5-1bc8-48c2-802e-854bd34d0685 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:22.208083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-35f7cda5-1bc8-48c2-802e-854bd34d0685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:22.282522 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:22.345361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f7cda5-1bc8-48c2-802e-854bd34d0685 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:22.357145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa7f44f-4e93-40ee-b922-c6636d3de953 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:22.357803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f44f-4e93-40ee-b922-c6636d3de953 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:22.358089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f44f-4e93-40ee-b922-c6636d3de953 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:22.358366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7f44f-4e93-40ee-b922-c6636d3de953 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:22.362965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-daa7f44f-4e93-40ee-b922-c6636d3de953 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:22.474560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7f44f-4e93-40ee-b922-c6636d3de953 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:22.478921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa7f44f-4e93-40ee-b922-c6636d3de953 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:22.504961 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3749/7495] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:22 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:22.774117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609f44-a5dc-46fe-99a8-7330a91696da service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:22.775630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f5609f44-a5dc-46fe-99a8-7330a91696da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:22.806932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5609f44-a5dc-46fe-99a8-7330a91696da service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:22.811998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:22.812651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:22.812931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:22.813223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] PATH_INFO: `/v3/projects/37c9e5bc85ff4d28852f3ddc39607e48` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:22.818423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c9e5bc85ff4d28852f3ddc39607e48)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:22.820201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:22.922524 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:22.950155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c9e5bc85ff4d28852f3ddc39607e48', 'request_id': 'req-b8c4e3a7-b512-4853-bc0f-e54799db6848'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:22.964568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c9e5bc85ff4d28852f3ddc39607e48', 'request_id': 'req-b8c4e3a7-b512-4853-bc0f-e54799db6848'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:22.992472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c9e5bc85ff4d28852f3ddc39607e48', 'request_id': 'req-b8c4e3a7-b512-4853-bc0f-e54799db6848'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:23.010444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] The token cache is being invalidate because project 37c9e5bc85ff4d28852f3ddc39607e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:23.010741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:23.014126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b8c4e3a7-b512-4853-bc0f-e54799db6848 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:23.022290 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3747/7496] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:22 2022] DELETE /identity/v3/projects/37c9e5bc85ff4d28852f3ddc39607e48 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:23.022855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aacd0b-8c3f-4079-ae4f-e4f7e8cc6e70 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:23.023333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aacd0b-8c3f-4079-ae4f-e4f7e8cc6e70 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:23.023525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aacd0b-8c3f-4079-ae4f-e4f7e8cc6e70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:23.060647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-54aacd0b-8c3f-4079-ae4f-e4f7e8cc6e70 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:23.063421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-54aacd0b-8c3f-4079-ae4f-e4f7e8cc6e70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:23.204498 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3750/7497] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:26:23.217195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec00e5-f0a8-4fcb-8434-b83d99338416 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:23.217606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec00e5-f0a8-4fcb-8434-b83d99338416 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:23.218147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec00e5-f0a8-4fcb-8434-b83d99338416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:23.270093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-73ec00e5-f0a8-4fcb-8434-b83d99338416 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:23.271458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-73ec00e5-f0a8-4fcb-8434-b83d99338416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:23.298560 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3748/7498] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:23.299712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aacd0b-8c3f-4079-ae4f-e4f7e8cc6e70 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:23.316336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aacd0b-8c3f-4079-ae4f-e4f7e8cc6e70 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:23.322387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99a35f-091c-44db-b981-5a285c710aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:23.323411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a35f-091c-44db-b981-5a285c710aa0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:23.323917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a35f-091c-44db-b981-5a285c710aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:23.324357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99a35f-091c-44db-b981-5a285c710aa0 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:23.326378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a35f-091c-44db-b981-5a285c710aa0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:26:23.326869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a35f-091c-44db-b981-5a285c710aa0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:23.329940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99a35f-091c-44db-b981-5a285c710aa0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:23.346981 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3751/7499] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:26:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:26:23.351171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec00e5-f0a8-4fcb-8434-b83d99338416 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:23.361226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec00e5-f0a8-4fcb-8434-b83d99338416 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:23.366580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e4ad9-06fb-4629-8577-bed2ac580dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:23.367431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e4ad9-06fb-4629-8577-bed2ac580dbe admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:23.367929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e4ad9-06fb-4629-8577-bed2ac580dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:23.368418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e4ad9-06fb-4629-8577-bed2ac580dbe admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:23.369289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e4ad9-06fb-4629-8577-bed2ac580dbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:23.371486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e4ad9-06fb-4629-8577-bed2ac580dbe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:23.412534 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3749/7500] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:23 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:23.413157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99a35f-091c-44db-b981-5a285c710aa0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:23.427842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99a35f-091c-44db-b981-5a285c710aa0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:23.514495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d25a7-8807-4b83-8584-3ba8ae3dc4e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:23.515344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d25a7-8807-4b83-8584-3ba8ae3dc4e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:23.515871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d25a7-8807-4b83-8584-3ba8ae3dc4e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:23.516432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d25a7-8807-4b83-8584-3ba8ae3dc4e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:23.518406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d25a7-8807-4b83-8584-3ba8ae3dc4e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:23.520748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d25a7-8807-4b83-8584-3ba8ae3dc4e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:23.535852 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:23.560844 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3752/7501] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:23 2022] POST /identity/v3/users => generated 288 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:26:23.566139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e4ad9-06fb-4629-8577-bed2ac580dbe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:23.580244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e4ad9-06fb-4629-8577-bed2ac580dbe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:23.585794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0120e9-3b56-4d35-b599-c38baa0df9a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:23.586297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0120e9-3b56-4d35-b599-c38baa0df9a4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:23.586580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0120e9-3b56-4d35-b599-c38baa0df9a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:23.587187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0120e9-3b56-4d35-b599-c38baa0df9a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:23.587497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0120e9-3b56-4d35-b599-c38baa0df9a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:23.589258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0120e9-3b56-4d35-b599-c38baa0df9a4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:23.605219 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3750/7502] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:23.606832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d25a7-8807-4b83-8584-3ba8ae3dc4e0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:23.630055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d25a7-8807-4b83-8584-3ba8ae3dc4e0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:23.645577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26b5999-cb94-479d-b723-d684361f70b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:23.646881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5999-cb94-479d-b723-d684361f70b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:23.647335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5999-cb94-479d-b723-d684361f70b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:23.647775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26b5999-cb94-479d-b723-d684361f70b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:23.649874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b5999-cb94-479d-b723-d684361f70b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:23.657562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26b5999-cb94-479d-b723-d684361f70b1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:23.684549 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3753/7503] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:23 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:26:23.689010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0120e9-3b56-4d35-b599-c38baa0df9a4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:23.717072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0120e9-3b56-4d35-b599-c38baa0df9a4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:23.722949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9f521-06b5-4a14-8fa2-67095a0544e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:23.723762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9f521-06b5-4a14-8fa2-67095a0544e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:23.724167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9f521-06b5-4a14-8fa2-67095a0544e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:23.724642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c9f521-06b5-4a14-8fa2-67095a0544e0 admin admin] PATH_INFO: `/v3/projects/87e84726038d4f29b2ca64c98c277cd1/users/6d1d1698b77946f0ade2ef335a15a1dd/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:23.759796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9f521-06b5-4a14-8fa2-67095a0544e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e84726038d4f29b2ca64c98c277cd1, user_id=6d1d1698b77946f0ade2ef335a15a1dd, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:23.763405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c9f521-06b5-4a14-8fa2-67095a0544e0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:23.789409 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3751/7504] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:23 2022] PUT /identity/v3/projects/87e84726038d4f29b2ca64c98c277cd1/users/6d1d1698b77946f0ade2ef335a15a1dd/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:23.800991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0f237-c888-44be-9297-99b25d25df2b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:23.801574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0f237-c888-44be-9297-99b25d25df2b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:23.803585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca0f237-c888-44be-9297-99b25d25df2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:23.914887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5ca0f237-c888-44be-9297-99b25d25df2b None None] MFA Rules not processed for user `6d1d1698b77946f0ade2ef335a15a1dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:23.917832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5ca0f237-c888-44be-9297-99b25d25df2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:24.082745 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3754/7505] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:24.098807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9f521-06b5-4a14-8fa2-67095a0544e0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:24.100613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-90c9f521-06b5-4a14-8fa2-67095a0544e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:24.206816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c9f521-06b5-4a14-8fa2-67095a0544e0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:24.218733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dad09-41d3-44f0-a86c-ee21a5f8cc2c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:24.219722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dad09-41d3-44f0-a86c-ee21a5f8cc2c service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:24.220646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dad09-41d3-44f0-a86c-ee21a5f8cc2c service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:24.222789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485dad09-41d3-44f0-a86c-ee21a5f8cc2c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:24.240977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485dad09-41d3-44f0-a86c-ee21a5f8cc2c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:24.243406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485dad09-41d3-44f0-a86c-ee21a5f8cc2c service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:24.259549 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3752/7506] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:31.567314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0f237-c888-44be-9297-99b25d25df2b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:31.568772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5ca0f237-c888-44be-9297-99b25d25df2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:31.633138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dad09-41d3-44f0-a86c-ee21a5f8cc2c service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:31.634982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-485dad09-41d3-44f0-a86c-ee21a5f8cc2c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:31.692266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca0f237-c888-44be-9297-99b25d25df2b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:31.698202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:31.699063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:31.699420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:31.700316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] PATH_INFO: `/v3/users/87885223d7ec43df8521c7a8b98df77a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:31.701893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87885223d7ec43df8521c7a8b98df77a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:31.704326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:31.737794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485dad09-41d3-44f0-a86c-ee21a5f8cc2c service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:31.747651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:31.749131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:31.749928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:31.750650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:31.753901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:31.773743 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:31.792673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87885223d7ec43df8521c7a8b98df77a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:31.810844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87885223d7ec43df8521c7a8b98df77a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:31.811599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87885223d7ec43df8521c7a8b98df77a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:31.824125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87885223d7ec43df8521c7a8b98df77a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:31.829169 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:31.842838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1432e5ca-74bd-4d29-a1cf-77a1bf6fe268 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87885223d7ec43df8521c7a8b98df77a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:31.858844 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3755/7507] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:31 2022] DELETE /identity/v3/users/87885223d7ec43df8521c7a8b98df77a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:31.864593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d7061-a6f0-46b4-8959-394e447ca34f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:31.864907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d7061-a6f0-46b4-8959-394e447ca34f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:31.865160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d7061-a6f0-46b4-8959-394e447ca34f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:31.896857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-224d7061-a6f0-46b4-8959-394e447ca34f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:31.898183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-224d7061-a6f0-46b4-8959-394e447ca34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:31.911817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:31.916374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:31.944675 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3753/7508] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:31 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:26:31.986422 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3756/7509] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:26:31.999089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:32.000705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:32.110167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01000a35-e26e-42fd-96c1-943b4d1e502a service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:32.188308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e28250f-d24b-4725-b847-8a72991bf951 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:32.188925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28250f-d24b-4725-b847-8a72991bf951 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:32.189207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28250f-d24b-4725-b847-8a72991bf951 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:32.189526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e28250f-d24b-4725-b847-8a72991bf951 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:32.201091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28250f-d24b-4725-b847-8a72991bf951 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:32.202580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e28250f-d24b-4725-b847-8a72991bf951 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:32.213755 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3754/7510] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:26:32.417418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d7061-a6f0-46b4-8959-394e447ca34f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:32.419409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-224d7061-a6f0-46b4-8959-394e447ca34f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:32.436295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d7061-a6f0-46b4-8959-394e447ca34f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:32.441256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:32.442158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:32.442451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:32.442728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] PATH_INFO: `/v3/projects/9513e7c72eef4692a5205c580ec88a8b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:32.444084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9513e7c72eef4692a5205c580ec88a8b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:32.445894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:32.527437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9513e7c72eef4692a5205c580ec88a8b', 'request_id': 'req-7eacc31f-cc97-4696-b12a-ba6e00651946'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:32.540543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9513e7c72eef4692a5205c580ec88a8b', 'request_id': 'req-7eacc31f-cc97-4696-b12a-ba6e00651946'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:32.553082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9513e7c72eef4692a5205c580ec88a8b', 'request_id': 'req-7eacc31f-cc97-4696-b12a-ba6e00651946'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:32.582223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] The token cache is being invalidate because project 9513e7c72eef4692a5205c580ec88a8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:32.582831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:32.583755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7eacc31f-cc97-4696-b12a-ba6e00651946 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:32.585718 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3757/7511] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:32 2022] DELETE /identity/v3/projects/9513e7c72eef4692a5205c580ec88a8b => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:32.592997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f871-31a4-40b4-b86b-21d12c235bd1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:32.593606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f871-31a4-40b4-b86b-21d12c235bd1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:32.595047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c23f871-31a4-40b4-b86b-21d12c235bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:32.635270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6c23f871-31a4-40b4-b86b-21d12c235bd1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:32.637582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c23f871-31a4-40b4-b86b-21d12c235bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:32.713621 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3755/7512] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:32.722582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad5459-49e3-4325-9a51-7ae0b79efd3f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:32.722874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad5459-49e3-4325-9a51-7ae0b79efd3f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:32.723149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cad5459-49e3-4325-9a51-7ae0b79efd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:32.745142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5cad5459-49e3-4325-9a51-7ae0b79efd3f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:32.746521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5cad5459-49e3-4325-9a51-7ae0b79efd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:32.756301 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3758/7513] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:26:32.761145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f871-31a4-40b4-b86b-21d12c235bd1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:32.776624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c23f871-31a4-40b4-b86b-21d12c235bd1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:32.795767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9fa1d-976a-4de9-9cfb-0ae3b99394ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:32.796393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9fa1d-976a-4de9-9cfb-0ae3b99394ac admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:32.796668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9fa1d-976a-4de9-9cfb-0ae3b99394ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:32.796939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a9fa1d-976a-4de9-9cfb-0ae3b99394ac admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:32.797627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9fa1d-976a-4de9-9cfb-0ae3b99394ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:26:32.797927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9fa1d-976a-4de9-9cfb-0ae3b99394ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:32.799551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a9fa1d-976a-4de9-9cfb-0ae3b99394ac admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:32.801581 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:32.816820 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3756/7514] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:26:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:26:32.821284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad5459-49e3-4325-9a51-7ae0b79efd3f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:32.832129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cad5459-49e3-4325-9a51-7ae0b79efd3f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:32.837475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab3645-54fe-4c6f-9887-dd655c53b8ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:32.838345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab3645-54fe-4c6f-9887-dd655c53b8ca admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:32.838977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab3645-54fe-4c6f-9887-dd655c53b8ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:32.840117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ab3645-54fe-4c6f-9887-dd655c53b8ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:32.841998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab3645-54fe-4c6f-9887-dd655c53b8ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:32.844409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ab3645-54fe-4c6f-9887-dd655c53b8ca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:32.884841 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3759/7515] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:32 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:26:32.888783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9fa1d-976a-4de9-9cfb-0ae3b99394ac admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:32.904056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a9fa1d-976a-4de9-9cfb-0ae3b99394ac admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:32.999456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96299873-6d0c-4848-9738-cd12f4b0f21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:33.000261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96299873-6d0c-4848-9738-cd12f4b0f21f admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:33.000552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96299873-6d0c-4848-9738-cd12f4b0f21f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:33.000918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96299873-6d0c-4848-9738-cd12f4b0f21f admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:33.001670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96299873-6d0c-4848-9738-cd12f4b0f21f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:33.004277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96299873-6d0c-4848-9738-cd12f4b0f21f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:33.052664 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3757/7516] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:32 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:33.057746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab3645-54fe-4c6f-9887-dd655c53b8ca admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:33.071589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ab3645-54fe-4c6f-9887-dd655c53b8ca admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:33.079397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807e16b-9102-4882-ae0c-2a4394f63c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:33.080188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807e16b-9102-4882-ae0c-2a4394f63c32 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:33.080616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807e16b-9102-4882-ae0c-2a4394f63c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:33.081189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5807e16b-9102-4882-ae0c-2a4394f63c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:33.081960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807e16b-9102-4882-ae0c-2a4394f63c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:33.084009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5807e16b-9102-4882-ae0c-2a4394f63c32 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:33.101330 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3760/7517] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:26:33.103492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96299873-6d0c-4848-9738-cd12f4b0f21f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:33.120139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96299873-6d0c-4848-9738-cd12f4b0f21f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:33.127734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c4c551-297e-49d2-b8a9-664fcc2d9d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:33.128455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4c551-297e-49d2-b8a9-664fcc2d9d33 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:33.128716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4c551-297e-49d2-b8a9-664fcc2d9d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:33.129049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c4c551-297e-49d2-b8a9-664fcc2d9d33 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:33.129757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4c551-297e-49d2-b8a9-664fcc2d9d33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:33.131641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c4c551-297e-49d2-b8a9-664fcc2d9d33 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:33.148278 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3758/7518] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:33.152085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807e16b-9102-4882-ae0c-2a4394f63c32 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:33.164253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5807e16b-9102-4882-ae0c-2a4394f63c32 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:33.171287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128e8a-e2c0-4882-9c0c-5c7c7c0a8584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:33.172414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128e8a-e2c0-4882-9c0c-5c7c7c0a8584 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:33.172414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128e8a-e2c0-4882-9c0c-5c7c7c0a8584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:33.172677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128e8a-e2c0-4882-9c0c-5c7c7c0a8584 admin admin] PATH_INFO: `/v3/projects/5c7ad1f8c5e44bc89b66fabe941bf116/users/94fbbcb961e74fae82d3d81189c31d33/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:33.196077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128e8a-e2c0-4882-9c0c-5c7c7c0a8584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c7ad1f8c5e44bc89b66fabe941bf116, user_id=94fbbcb961e74fae82d3d81189c31d33, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:33.200376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128e8a-e2c0-4882-9c0c-5c7c7c0a8584 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:33.235853 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3761/7519] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:33 2022] PUT /identity/v3/projects/5c7ad1f8c5e44bc89b66fabe941bf116/users/94fbbcb961e74fae82d3d81189c31d33/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:33.237979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b318a6-5cb6-4ac1-8989-82237af35a42 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:33.237979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b318a6-5cb6-4ac1-8989-82237af35a42 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:33.238164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b318a6-5cb6-4ac1-8989-82237af35a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:33.280555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e6b318a6-5cb6-4ac1-8989-82237af35a42 None None] MFA Rules not processed for user `94fbbcb961e74fae82d3d81189c31d33`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:33.282190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e6b318a6-5cb6-4ac1-8989-82237af35a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:33.361012 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3759/7520] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:33.373459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128e8a-e2c0-4882-9c0c-5c7c7c0a8584 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:33.375251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ba128e8a-e2c0-4882-9c0c-5c7c7c0a8584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:33.394373 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:33.454443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128e8a-e2c0-4882-9c0c-5c7c7c0a8584 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:33.460222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cedae3-35c1-4ba1-8f91-ae8c4fcccb0b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:33.460888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cedae3-35c1-4ba1-8f91-ae8c4fcccb0b service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:33.461175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cedae3-35c1-4ba1-8f91-ae8c4fcccb0b service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:33.461758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cedae3-35c1-4ba1-8f91-ae8c4fcccb0b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:33.471433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cedae3-35c1-4ba1-8f91-ae8c4fcccb0b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:33.473829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cedae3-35c1-4ba1-8f91-ae8c4fcccb0b service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:33.488519 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3762/7521] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:33 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:39.831771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b318a6-5cb6-4ac1-8989-82237af35a42 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:39.924960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b318a6-5cb6-4ac1-8989-82237af35a42 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:39.931768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:39.932647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:39.933109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:39.934375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] PATH_INFO: `/v3/users/94fbbcb961e74fae82d3d81189c31d33` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:39.935967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94fbbcb961e74fae82d3d81189c31d33)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:39.939079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:39.943546 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:40.015815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94fbbcb961e74fae82d3d81189c31d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.038979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94fbbcb961e74fae82d3d81189c31d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.039731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94fbbcb961e74fae82d3d81189c31d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.050653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94fbbcb961e74fae82d3d81189c31d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.062819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94fbbcb961e74fae82d3d81189c31d33'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.072792 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3760/7522] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:39 2022] DELETE /identity/v3/users/94fbbcb961e74fae82d3d81189c31d33 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:40.077252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e019-cce8-4521-8b4f-cbc752e72633 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:40.077754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e019-cce8-4521-8b4f-cbc752e72633 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:40.077890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a55e019-cce8-4521-8b4f-cbc752e72633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:40.098741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2a55e019-cce8-4521-8b4f-cbc752e72633 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:40.099948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a55e019-cce8-4521-8b4f-cbc752e72633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:40.210387 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3763/7523] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:40.218431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:40.220105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:40.314948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14387902-8757-4f37-804e-819c4471f353 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:40.319040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad743b1e-5de9-463c-83fc-1df63c953d16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:40.319739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743b1e-5de9-463c-83fc-1df63c953d16 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:40.320327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743b1e-5de9-463c-83fc-1df63c953d16 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:40.320655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad743b1e-5de9-463c-83fc-1df63c953d16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:40.332826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad743b1e-5de9-463c-83fc-1df63c953d16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:40.334727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad743b1e-5de9-463c-83fc-1df63c953d16 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:40.351481 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3761/7524] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:40.671347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e019-cce8-4521-8b4f-cbc752e72633 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:40.672890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a55e019-cce8-4521-8b4f-cbc752e72633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:40.693570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a55e019-cce8-4521-8b4f-cbc752e72633 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:40.707069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:40.709308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:40.709925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:40.720485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] PATH_INFO: `/v3/projects/5c7ad1f8c5e44bc89b66fabe941bf116` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:40.725562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c7ad1f8c5e44bc89b66fabe941bf116)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:40.735133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:40.891148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c7ad1f8c5e44bc89b66fabe941bf116', 'request_id': 'req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.907508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c7ad1f8c5e44bc89b66fabe941bf116', 'request_id': 'req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.921402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c7ad1f8c5e44bc89b66fabe941bf116', 'request_id': 'req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.948683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] The token cache is being invalidate because project 5c7ad1f8c5e44bc89b66fabe941bf116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:40.948683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.949057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-6a2b3fea-e67f-4c7e-b351-a6ba8fb44ff9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:40.952391 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3764/7525] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:40 2022] DELETE /identity/v3/projects/5c7ad1f8c5e44bc89b66fabe941bf116 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:40.957227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9812de-a873-47d9-bf25-5c080464a130 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:40.957659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9812de-a873-47d9-bf25-5c080464a130 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:40.957914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9812de-a873-47d9-bf25-5c080464a130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:40.999283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5a9812de-a873-47d9-bf25-5c080464a130 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:41.000510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5a9812de-a873-47d9-bf25-5c080464a130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:41.251790 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3762/7526] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:26:41.252726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7f1e1-8812-4084-8d6b-a7b3e48b5101 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:41.252726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7f1e1-8812-4084-8d6b-a7b3e48b5101 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:41.252726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7f1e1-8812-4084-8d6b-a7b3e48b5101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:41.265213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-49f7f1e1-8812-4084-8d6b-a7b3e48b5101 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:41.267322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-49f7f1e1-8812-4084-8d6b-a7b3e48b5101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:41.277120 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3765/7527] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:41.282273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9812de-a873-47d9-bf25-5c080464a130 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:41.301929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9812de-a873-47d9-bf25-5c080464a130 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:41.313381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ded1-8989-4f7c-80a3-98a74d51efaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:41.314613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ded1-8989-4f7c-80a3-98a74d51efaf admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:41.315290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ded1-8989-4f7c-80a3-98a74d51efaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:41.316200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2ded1-8989-4f7c-80a3-98a74d51efaf admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:41.317177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2ded1-8989-4f7c-80a3-98a74d51efaf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:26:41.317693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2ded1-8989-4f7c-80a3-98a74d51efaf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:41.319812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2ded1-8989-4f7c-80a3-98a74d51efaf admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:41.344937 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3763/7528] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:26:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:26:41.349009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7f1e1-8812-4084-8d6b-a7b3e48b5101 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:41.359867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7f1e1-8812-4084-8d6b-a7b3e48b5101 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:41.388443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f653a-9a91-4c7d-8ff8-81f27c311860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:41.389238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f653a-9a91-4c7d-8ff8-81f27c311860 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:41.389551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f653a-9a91-4c7d-8ff8-81f27c311860 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:41.389831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f653a-9a91-4c7d-8ff8-81f27c311860 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:41.390484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f653a-9a91-4c7d-8ff8-81f27c311860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:41.392480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f653a-9a91-4c7d-8ff8-81f27c311860 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:41.430869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3766/7529] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:41 2022] POST /identity/v3/projects => generated 367 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:41.435172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ded1-8989-4f7c-80a3-98a74d51efaf admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:41.445728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2ded1-8989-4f7c-80a3-98a74d51efaf admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:41.454775 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:41.544197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85dd8-7dd8-4a32-9392-4563335fba7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:41.545933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85dd8-7dd8-4a32-9392-4563335fba7b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:41.546689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85dd8-7dd8-4a32-9392-4563335fba7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:41.547213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c85dd8-7dd8-4a32-9392-4563335fba7b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:41.548106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c85dd8-7dd8-4a32-9392-4563335fba7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:41.551491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c85dd8-7dd8-4a32-9392-4563335fba7b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:41.601421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f653a-9a91-4c7d-8ff8-81f27c311860 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:41.610965 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3764/7530] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:41 2022] POST /identity/v3/users => generated 284 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:26:41.627992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f653a-9a91-4c7d-8ff8-81f27c311860 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:41.639969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ccc8e-efd0-4aa1-8a36-656e9b014239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:41.641465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ccc8e-efd0-4aa1-8a36-656e9b014239 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:41.642665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ccc8e-efd0-4aa1-8a36-656e9b014239 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:41.643174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7ccc8e-efd0-4aa1-8a36-656e9b014239 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:41.644855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ccc8e-efd0-4aa1-8a36-656e9b014239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:41.648889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7ccc8e-efd0-4aa1-8a36-656e9b014239 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:41.661405 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:41.670792 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3767/7531] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:41.674654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85dd8-7dd8-4a32-9392-4563335fba7b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:41.693516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c85dd8-7dd8-4a32-9392-4563335fba7b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:41.718980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8739f9-b0e2-46af-9386-a115db3bb198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:41.719865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8739f9-b0e2-46af-9386-a115db3bb198 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:41.725640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8739f9-b0e2-46af-9386-a115db3bb198 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:41.726228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8739f9-b0e2-46af-9386-a115db3bb198 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:41.727383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8739f9-b0e2-46af-9386-a115db3bb198 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:41.747230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8739f9-b0e2-46af-9386-a115db3bb198 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:41.772692 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3765/7532] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:41.776925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ccc8e-efd0-4aa1-8a36-656e9b014239 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:41.791214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7ccc8e-efd0-4aa1-8a36-656e9b014239 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:41.801641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0c4a-73e9-4f96-907d-5b218fcbd161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:41.808111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0c4a-73e9-4f96-907d-5b218fcbd161 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:41.808428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0c4a-73e9-4f96-907d-5b218fcbd161 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:41.812001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b0c4a-73e9-4f96-907d-5b218fcbd161 admin admin] PATH_INFO: `/v3/projects/7b2903d61e4f4af4afeee7891443b768/users/425a865f5c0646cf8d0c9e5a1b42ec30/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:41.840027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0c4a-73e9-4f96-907d-5b218fcbd161 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b2903d61e4f4af4afeee7891443b768, user_id=425a865f5c0646cf8d0c9e5a1b42ec30, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:41.843494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b0c4a-73e9-4f96-907d-5b218fcbd161 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:41.879610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3768/7533] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:41 2022] PUT /identity/v3/projects/7b2903d61e4f4af4afeee7891443b768/users/425a865f5c0646cf8d0c9e5a1b42ec30/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:41.890953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f304e48-8715-48d8-804b-b130a495ff89 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:41.891577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f304e48-8715-48d8-804b-b130a495ff89 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:41.892032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f304e48-8715-48d8-804b-b130a495ff89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:41.974891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8f304e48-8715-48d8-804b-b130a495ff89 None None] MFA Rules not processed for user `425a865f5c0646cf8d0c9e5a1b42ec30`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:41.981445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f304e48-8715-48d8-804b-b130a495ff89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:42.171711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3766/7534] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:42.176230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0c4a-73e9-4f96-907d-5b218fcbd161 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:42.361086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b0c4a-73e9-4f96-907d-5b218fcbd161 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:42.367104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202e818-5d71-493a-803a-d66fc555d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:42.367974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202e818-5d71-493a-803a-d66fc555d68a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:42.368357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202e818-5d71-493a-803a-d66fc555d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:42.368775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3202e818-5d71-493a-803a-d66fc555d68a admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:42.369551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202e818-5d71-493a-803a-d66fc555d68a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:42.374639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3202e818-5d71-493a-803a-d66fc555d68a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:42.456999 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3769/7535] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:42 2022] POST /identity/v3/projects => generated 367 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:42.459135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f304e48-8715-48d8-804b-b130a495ff89 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:42.476110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f304e48-8715-48d8-804b-b130a495ff89 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:42.552200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c62d-4f79-442d-adbb-0cd11ba16d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:42.553384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c62d-4f79-442d-adbb-0cd11ba16d69 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:42.554076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c62d-4f79-442d-adbb-0cd11ba16d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:42.554533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c925c62d-4f79-442d-adbb-0cd11ba16d69 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:42.555496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925c62d-4f79-442d-adbb-0cd11ba16d69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:42.558114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c925c62d-4f79-442d-adbb-0cd11ba16d69 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:42.593067 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3767/7536] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:42 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:42.597457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202e818-5d71-493a-803a-d66fc555d68a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:42.616511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3202e818-5d71-493a-803a-d66fc555d68a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:42.629312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a68db-8adc-497e-aab6-5e2327395cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:42.630038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a68db-8adc-497e-aab6-5e2327395cf7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:42.630496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a68db-8adc-497e-aab6-5e2327395cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:42.631490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a68db-8adc-497e-aab6-5e2327395cf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:42.631490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a68db-8adc-497e-aab6-5e2327395cf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:42.633560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a68db-8adc-497e-aab6-5e2327395cf7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:42.674592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c62d-4f79-442d-adbb-0cd11ba16d69 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:42.685213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c925c62d-4f79-442d-adbb-0cd11ba16d69 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:42.685610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3770/7537] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:42.697342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97173ab7-6353-4d1f-96fb-bb9eaab9dd7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:42.698022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97173ab7-6353-4d1f-96fb-bb9eaab9dd7b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:42.698305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97173ab7-6353-4d1f-96fb-bb9eaab9dd7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:42.698724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97173ab7-6353-4d1f-96fb-bb9eaab9dd7b admin admin] PATH_INFO: `/v3/projects/200e62cc1b654976b7a8a33882022bf7/users/330e41bc072b410da69d7cd7483a0c33/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:42.710089 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:42.734878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97173ab7-6353-4d1f-96fb-bb9eaab9dd7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=200e62cc1b654976b7a8a33882022bf7, user_id=330e41bc072b410da69d7cd7483a0c33, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:42.737590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97173ab7-6353-4d1f-96fb-bb9eaab9dd7b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:42.765222 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3768/7538] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:42 2022] PUT /identity/v3/projects/200e62cc1b654976b7a8a33882022bf7/users/330e41bc072b410da69d7cd7483a0c33/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:26:42.776657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a68db-8adc-497e-aab6-5e2327395cf7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:42.798894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a68db-8adc-497e-aab6-5e2327395cf7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:42.892870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ba1aef-8ead-45d3-aa21-940ebd70ee6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:42.894098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba1aef-8ead-45d3-aa21-940ebd70ee6c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:42.894860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba1aef-8ead-45d3-aa21-940ebd70ee6c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:42.895309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ba1aef-8ead-45d3-aa21-940ebd70ee6c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:42.896224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba1aef-8ead-45d3-aa21-940ebd70ee6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:42.898080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ba1aef-8ead-45d3-aa21-940ebd70ee6c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:42.910297 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3771/7539] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:42 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:26:42.914814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97173ab7-6353-4d1f-96fb-bb9eaab9dd7b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:42.939814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97173ab7-6353-4d1f-96fb-bb9eaab9dd7b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:42.960029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893f936-cd3e-4dcb-a01a-6708c73b063b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:42.972957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893f936-cd3e-4dcb-a01a-6708c73b063b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:42.973444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893f936-cd3e-4dcb-a01a-6708c73b063b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:42.973861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e893f936-cd3e-4dcb-a01a-6708c73b063b admin admin] PATH_INFO: `/v3/projects/200e62cc1b654976b7a8a33882022bf7/users/330e41bc072b410da69d7cd7483a0c33/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:42.981196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893f936-cd3e-4dcb-a01a-6708c73b063b admin admin] RBAC: Authorizing `identity:create_grant(project_id=200e62cc1b654976b7a8a33882022bf7, user_id=330e41bc072b410da69d7cd7483a0c33, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:42.984451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e893f936-cd3e-4dcb-a01a-6708c73b063b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:43.021754 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3769/7540] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:42 2022] PUT /identity/v3/projects/200e62cc1b654976b7a8a33882022bf7/users/330e41bc072b410da69d7cd7483a0c33/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:43.023745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de17a4f-0ee3-43d3-8fc2-fb7f910b4ae6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:43.024247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de17a4f-0ee3-43d3-8fc2-fb7f910b4ae6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:43.024862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de17a4f-0ee3-43d3-8fc2-fb7f910b4ae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:43.081545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0de17a4f-0ee3-43d3-8fc2-fb7f910b4ae6 None None] MFA Rules not processed for user `330e41bc072b410da69d7cd7483a0c33`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:43.083840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0de17a4f-0ee3-43d3-8fc2-fb7f910b4ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:43.164267 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:43.239869 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3772/7541] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:43.250371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893f936-cd3e-4dcb-a01a-6708c73b063b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:43.252155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e893f936-cd3e-4dcb-a01a-6708c73b063b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:43.460081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e893f936-cd3e-4dcb-a01a-6708c73b063b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:43.466955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fe9858-462b-4d16-a633-05e1d1baa238 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:43.467813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9858-462b-4d16-a633-05e1d1baa238 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:43.468293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9858-462b-4d16-a633-05e1d1baa238 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:43.468760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fe9858-462b-4d16-a633-05e1d1baa238 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:43.482776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe9858-462b-4d16-a633-05e1d1baa238 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:43.484861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fe9858-462b-4d16-a633-05e1d1baa238 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:43.507384 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3770/7542] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:46.263845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de17a4f-0ee3-43d3-8fc2-fb7f910b4ae6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:46.348269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de17a4f-0ee3-43d3-8fc2-fb7f910b4ae6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:46.359005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:46.359674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:46.359958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:46.360238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] PATH_INFO: `/v3/users/425a865f5c0646cf8d0c9e5a1b42ec30` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:46.361521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] RBAC: Authorizing `identity:delete_user(user_id=425a865f5c0646cf8d0c9e5a1b42ec30)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:46.363481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:46.486994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '425a865f5c0646cf8d0c9e5a1b42ec30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:46.518532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '425a865f5c0646cf8d0c9e5a1b42ec30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:46.520106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '425a865f5c0646cf8d0c9e5a1b42ec30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:46.532510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '425a865f5c0646cf8d0c9e5a1b42ec30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:46.541976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '425a865f5c0646cf8d0c9e5a1b42ec30'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:46.553192 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3773/7543] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:46 2022] DELETE /identity/v3/users/425a865f5c0646cf8d0c9e5a1b42ec30 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:46.557946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd423e-abe9-494b-904a-e33ca891c13b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:46.558347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd423e-abe9-494b-904a-e33ca891c13b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:46.559055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bd423e-abe9-494b-904a-e33ca891c13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:46.580277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-23bd423e-abe9-494b-904a-e33ca891c13b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:46.581766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-23bd423e-abe9-494b-904a-e33ca891c13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:46.678724 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3771/7544] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:46.689581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:46.691145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:46.859036 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:46.887313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84a993-df5f-4a43-a52f-db7202a87735 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:46.897518 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a1532-c886-4d6c-b63b-8fda8bc2900b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:46.898413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a1532-c886-4d6c-b63b-8fda8bc2900b service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:46.898849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a1532-c886-4d6c-b63b-8fda8bc2900b service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:46.899282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261a1532-c886-4d6c-b63b-8fda8bc2900b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:46.938086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a1532-c886-4d6c-b63b-8fda8bc2900b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:46.943049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261a1532-c886-4d6c-b63b-8fda8bc2900b service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:47.001105 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3774/7545] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:47.543029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd423e-abe9-494b-904a-e33ca891c13b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:47.544982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-23bd423e-abe9-494b-904a-e33ca891c13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:47.569579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bd423e-abe9-494b-904a-e33ca891c13b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:47.586808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:47.587460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:47.587751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:47.588012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] PATH_INFO: `/v3/projects/7b2903d61e4f4af4afeee7891443b768` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:47.589242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b2903d61e4f4af4afeee7891443b768)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:47.591356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:47.691919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b2903d61e4f4af4afeee7891443b768', 'request_id': 'req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:47.698750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b2903d61e4f4af4afeee7891443b768', 'request_id': 'req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:47.710407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b2903d61e4f4af4afeee7891443b768', 'request_id': 'req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:47.718698 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:47.724365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] The token cache is being invalidate because project 7b2903d61e4f4af4afeee7891443b768 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:47.725178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:47.726831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:47.732436 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3772/7546] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:47 2022] DELETE /identity/v3/projects/7b2903d61e4f4af4afeee7891443b768 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:47.733434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a1532-c886-4d6c-b63b-8fda8bc2900b service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:47.763797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261a1532-c886-4d6c-b63b-8fda8bc2900b service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:47.850822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:47.853502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:47.853917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:47.854212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] PATH_INFO: `/v3/users/330e41bc072b410da69d7cd7483a0c33` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:47.856672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=330e41bc072b410da69d7cd7483a0c33)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:47.861485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:47.962689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330e41bc072b410da69d7cd7483a0c33'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:47.981011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330e41bc072b410da69d7cd7483a0c33'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:47.982038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330e41bc072b410da69d7cd7483a0c33'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:47.993090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330e41bc072b410da69d7cd7483a0c33'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:48.004479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fc3c0d97-30dc-4a64-ad5a-63d60ecfab58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330e41bc072b410da69d7cd7483a0c33'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:48.013266 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3775/7547] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:47 2022] DELETE /identity/v3/users/330e41bc072b410da69d7cd7483a0c33 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:26:48.688921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:48.690739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:48.755579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8001f5-fd64-42b5-a7f8-cb410c52e9de admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:48.900572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:48.903685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:48.908510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:48.910159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] PATH_INFO: `/v3/projects/200e62cc1b654976b7a8a33882022bf7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:48.922922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=200e62cc1b654976b7a8a33882022bf7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:48.927566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:49.087701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '200e62cc1b654976b7a8a33882022bf7', 'request_id': 'req-0928ed37-1a3b-461c-a8d9-11722e5beca0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:49.099167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '200e62cc1b654976b7a8a33882022bf7', 'request_id': 'req-0928ed37-1a3b-461c-a8d9-11722e5beca0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:49.109278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '200e62cc1b654976b7a8a33882022bf7', 'request_id': 'req-0928ed37-1a3b-461c-a8d9-11722e5beca0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:49.123257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] The token cache is being invalidate because project 200e62cc1b654976b7a8a33882022bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:49.123616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:49.124322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0928ed37-1a3b-461c-a8d9-11722e5beca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:49.125863 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3773/7548] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:48 2022] DELETE /identity/v3/projects/200e62cc1b654976b7a8a33882022bf7 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:49.131499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa0cd5-e994-42ac-90f8-afee812e819f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:49.132016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa0cd5-e994-42ac-90f8-afee812e819f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:49.132344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41aa0cd5-e994-42ac-90f8-afee812e819f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:49.171114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-41aa0cd5-e994-42ac-90f8-afee812e819f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:49.174195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-41aa0cd5-e994-42ac-90f8-afee812e819f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:49.389379 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3776/7549] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:49.396859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292c7d4-133f-4100-b390-8d78004b6932 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:49.397410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292c7d4-133f-4100-b390-8d78004b6932 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:49.397840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7292c7d4-133f-4100-b390-8d78004b6932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:49.442011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7292c7d4-133f-4100-b390-8d78004b6932 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:49.443176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7292c7d4-133f-4100-b390-8d78004b6932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:49.453626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3774/7550] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:49.457685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa0cd5-e994-42ac-90f8-afee812e819f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:49.472071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41aa0cd5-e994-42ac-90f8-afee812e819f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:49.486737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4efd2f-5acd-406b-8cc4-2b290a38ec5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:49.487475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4efd2f-5acd-406b-8cc4-2b290a38ec5b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:49.487831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4efd2f-5acd-406b-8cc4-2b290a38ec5b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:49.488220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4efd2f-5acd-406b-8cc4-2b290a38ec5b admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:49.488960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4efd2f-5acd-406b-8cc4-2b290a38ec5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:26:49.489370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4efd2f-5acd-406b-8cc4-2b290a38ec5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:49.495101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4efd2f-5acd-406b-8cc4-2b290a38ec5b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:49.515325 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:49.521434 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3777/7551] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:26:49.526126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292c7d4-133f-4100-b390-8d78004b6932 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:49.538806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7292c7d4-133f-4100-b390-8d78004b6932 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:49.567033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d474cdf-8708-4072-bb77-438feaf38eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:49.568689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d474cdf-8708-4072-bb77-438feaf38eb9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:49.569124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d474cdf-8708-4072-bb77-438feaf38eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:49.569913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d474cdf-8708-4072-bb77-438feaf38eb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:49.570417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d474cdf-8708-4072-bb77-438feaf38eb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:49.572351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d474cdf-8708-4072-bb77-438feaf38eb9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:49.636582 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3775/7552] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:49 2022] POST /identity/v3/projects => generated 381 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:49.640404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4efd2f-5acd-406b-8cc4-2b290a38ec5b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:49.655426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4efd2f-5acd-406b-8cc4-2b290a38ec5b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:49.793954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b1671-f19f-42d3-b562-7e5ce2ad1e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:49.793954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b1671-f19f-42d3-b562-7e5ce2ad1e91 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:49.793954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b1671-f19f-42d3-b562-7e5ce2ad1e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:49.793954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b1671-f19f-42d3-b562-7e5ce2ad1e91 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:49.794992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b1671-f19f-42d3-b562-7e5ce2ad1e91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:49.794992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b1671-f19f-42d3-b562-7e5ce2ad1e91 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:49.851213 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3778/7553] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:49 2022] POST /identity/v3/users => generated 291 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:49.855973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d474cdf-8708-4072-bb77-438feaf38eb9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:49.873135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d474cdf-8708-4072-bb77-438feaf38eb9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:49.903582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441787-625b-45ec-9129-f683f0093173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:49.905062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441787-625b-45ec-9129-f683f0093173 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:49.905690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441787-625b-45ec-9129-f683f0093173 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:49.906562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c441787-625b-45ec-9129-f683f0093173 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:49.908689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441787-625b-45ec-9129-f683f0093173 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:49.912539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c441787-625b-45ec-9129-f683f0093173 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:49.944009 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3776/7554] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:49.947871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b1671-f19f-42d3-b562-7e5ce2ad1e91 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:49.968994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b1671-f19f-42d3-b562-7e5ce2ad1e91 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:49.982388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b2f219-a0c0-490e-8639-28856a4bfdef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:49.983265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2f219-a0c0-490e-8639-28856a4bfdef admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:49.983265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2f219-a0c0-490e-8639-28856a4bfdef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:49.983870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2f219-a0c0-490e-8639-28856a4bfdef admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:49.985569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2f219-a0c0-490e-8639-28856a4bfdef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:49.990386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b2f219-a0c0-490e-8639-28856a4bfdef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:50.038818 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3779/7555] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:49 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:50.040110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441787-625b-45ec-9129-f683f0093173 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:50.057013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c441787-625b-45ec-9129-f683f0093173 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:50.082929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e0d54-c098-4c6b-81c6-b6658b46b41d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:50.083906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e0d54-c098-4c6b-81c6-b6658b46b41d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:50.084418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e0d54-c098-4c6b-81c6-b6658b46b41d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:50.084881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e0d54-c098-4c6b-81c6-b6658b46b41d admin admin] PATH_INFO: `/v3/projects/ff39ebdd6963422d86acb71b7d2e2b85/users/5057faf19e9f4383bc06b474c7facb8d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:50.140757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e0d54-c098-4c6b-81c6-b6658b46b41d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff39ebdd6963422d86acb71b7d2e2b85, user_id=5057faf19e9f4383bc06b474c7facb8d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:50.152741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e0d54-c098-4c6b-81c6-b6658b46b41d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:50.196960 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3777/7556] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:50 2022] PUT /identity/v3/projects/ff39ebdd6963422d86acb71b7d2e2b85/users/5057faf19e9f4383bc06b474c7facb8d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:50.208026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ce32d-fd29-496a-a888-409b447547b8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:50.208641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ce32d-fd29-496a-a888-409b447547b8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:50.208641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133ce32d-fd29-496a-a888-409b447547b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:50.351264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-133ce32d-fd29-496a-a888-409b447547b8 None None] MFA Rules not processed for user `5057faf19e9f4383bc06b474c7facb8d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:50.352520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-133ce32d-fd29-496a-a888-409b447547b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:50.496496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e0d54-c098-4c6b-81c6-b6658b46b41d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:50.497081 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3780/7557] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:50.547005 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:50.675059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e0d54-c098-4c6b-81c6-b6658b46b41d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:50.687966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7c774-f7ad-449b-ab18-82577dc0093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:50.689237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7c774-f7ad-449b-ab18-82577dc0093b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:50.689768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7c774-f7ad-449b-ab18-82577dc0093b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:50.690271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b7c774-f7ad-449b-ab18-82577dc0093b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:50.691133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7c774-f7ad-449b-ab18-82577dc0093b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:50.695750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b7c774-f7ad-449b-ab18-82577dc0093b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:50.765148 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3778/7558] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:50 2022] POST /identity/v3/projects => generated 381 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:26:50.774983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ce32d-fd29-496a-a888-409b447547b8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:50.835601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133ce32d-fd29-496a-a888-409b447547b8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:51.019476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced5ba-c0af-4e11-8bed-bea723611bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:51.020296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced5ba-c0af-4e11-8bed-bea723611bfb admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:51.020685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced5ba-c0af-4e11-8bed-bea723611bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:51.021071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ced5ba-c0af-4e11-8bed-bea723611bfb admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:51.021851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ced5ba-c0af-4e11-8bed-bea723611bfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:51.035187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ced5ba-c0af-4e11-8bed-bea723611bfb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:51.071352 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:51.109507 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3781/7559] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:50 2022] POST /identity/v3/users => generated 297 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:51.111340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7c774-f7ad-449b-ab18-82577dc0093b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:51.153262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b7c774-f7ad-449b-ab18-82577dc0093b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:51.161071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99fb3a-cfaa-4cb5-98fc-f4ffb0f52cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:51.161980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99fb3a-cfaa-4cb5-98fc-f4ffb0f52cfe admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:51.162258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99fb3a-cfaa-4cb5-98fc-f4ffb0f52cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:51.162537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99fb3a-cfaa-4cb5-98fc-f4ffb0f52cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:51.163191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99fb3a-cfaa-4cb5-98fc-f4ffb0f52cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:51.165569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99fb3a-cfaa-4cb5-98fc-f4ffb0f52cfe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:51.191320 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3779/7560] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:51.194281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced5ba-c0af-4e11-8bed-bea723611bfb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:51.213316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ced5ba-c0af-4e11-8bed-bea723611bfb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:51.291503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63c16a-5058-4152-9438-21fd9e0ca8c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:51.292191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63c16a-5058-4152-9438-21fd9e0ca8c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:51.292583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63c16a-5058-4152-9438-21fd9e0ca8c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:51.295501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63c16a-5058-4152-9438-21fd9e0ca8c0 admin admin] PATH_INFO: `/v3/projects/e4d3b84717a846d5aa7f2fa32ae85d78/users/9fbb119bdc7d4f9781d5d523a869c981/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:51.331946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63c16a-5058-4152-9438-21fd9e0ca8c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3b84717a846d5aa7f2fa32ae85d78, user_id=9fbb119bdc7d4f9781d5d523a869c981, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:51.334727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63c16a-5058-4152-9438-21fd9e0ca8c0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:51.354753 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3782/7561] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:51 2022] PUT /identity/v3/projects/e4d3b84717a846d5aa7f2fa32ae85d78/users/9fbb119bdc7d4f9781d5d523a869c981/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:51.359294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99fb3a-cfaa-4cb5-98fc-f4ffb0f52cfe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:51.378077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99fb3a-cfaa-4cb5-98fc-f4ffb0f52cfe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:51.536912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c31be1-0fa8-4b66-9d85-f18040f30e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:51.537571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c31be1-0fa8-4b66-9d85-f18040f30e81 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:51.537839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c31be1-0fa8-4b66-9d85-f18040f30e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:51.538121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c31be1-0fa8-4b66-9d85-f18040f30e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:51.538778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c31be1-0fa8-4b66-9d85-f18040f30e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:51.540984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c31be1-0fa8-4b66-9d85-f18040f30e81 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:51.562440 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3780/7562] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:51 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:51.564919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63c16a-5058-4152-9438-21fd9e0ca8c0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:51.580275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63c16a-5058-4152-9438-21fd9e0ca8c0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:51.593515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcf80a-2235-464d-ae0c-66ca28b8889d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:51.594204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcf80a-2235-464d-ae0c-66ca28b8889d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:51.594482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcf80a-2235-464d-ae0c-66ca28b8889d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:51.594935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fcf80a-2235-464d-ae0c-66ca28b8889d admin admin] PATH_INFO: `/v3/projects/e4d3b84717a846d5aa7f2fa32ae85d78/users/9fbb119bdc7d4f9781d5d523a869c981/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:51.597328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcf80a-2235-464d-ae0c-66ca28b8889d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4d3b84717a846d5aa7f2fa32ae85d78, user_id=9fbb119bdc7d4f9781d5d523a869c981, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:51.601808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fcf80a-2235-464d-ae0c-66ca28b8889d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:51.618884 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3783/7563] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:51 2022] PUT /identity/v3/projects/e4d3b84717a846d5aa7f2fa32ae85d78/users/9fbb119bdc7d4f9781d5d523a869c981/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:51.629184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54000122-78f0-4ca1-af0e-8e415b635acc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:51.629991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54000122-78f0-4ca1-af0e-8e415b635acc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:51.630421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54000122-78f0-4ca1-af0e-8e415b635acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:51.705489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-54000122-78f0-4ca1-af0e-8e415b635acc None None] MFA Rules not processed for user `9fbb119bdc7d4f9781d5d523a869c981`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:51.706728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-54000122-78f0-4ca1-af0e-8e415b635acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:51.863335 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3781/7564] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:51.881621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcf80a-2235-464d-ae0c-66ca28b8889d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:51.886152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-93fcf80a-2235-464d-ae0c-66ca28b8889d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:52.091963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fcf80a-2235-464d-ae0c-66ca28b8889d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:52.102029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b3eb-ac51-4f86-aa01-8048a5cd8ee8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:52.102675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b3eb-ac51-4f86-aa01-8048a5cd8ee8 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:52.104470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b3eb-ac51-4f86-aa01-8048a5cd8ee8 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:52.105778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a5b3eb-ac51-4f86-aa01-8048a5cd8ee8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:52.138559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5b3eb-ac51-4f86-aa01-8048a5cd8ee8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:52.140596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a5b3eb-ac51-4f86-aa01-8048a5cd8ee8 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:52.175026 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3784/7565] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:53.008778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54000122-78f0-4ca1-af0e-8e415b635acc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:53.021849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54000122-78f0-4ca1-af0e-8e415b635acc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:53.038354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31869-c002-466c-80e8-ed55328483c3 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbb119bdc7d4f9781d5d523a869c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4d3b84717a846d5aa7f2fa32ae85d78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:53.039149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31869-c002-466c-80e8-ed55328483c3 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:53.039532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31869-c002-466c-80e8-ed55328483c3 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:53.040073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce31869-c002-466c-80e8-ed55328483c3 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:53.040869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce31869-c002-466c-80e8-ed55328483c3 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:26:53.041280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce31869-c002-466c-80e8-ed55328483c3 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:53.043646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce31869-c002-466c-80e8-ed55328483c3 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:53.077540 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3782/7566] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:26:53.081864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b3eb-ac51-4f86-aa01-8048a5cd8ee8 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:53.106806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a5b3eb-ac51-4f86-aa01-8048a5cd8ee8 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:53.131280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc37f-dc1d-4403-8c92-9cf1222ca815 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbb119bdc7d4f9781d5d523a869c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4d3b84717a846d5aa7f2fa32ae85d78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:53.134125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc37f-dc1d-4403-8c92-9cf1222ca815 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:53.134616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc37f-dc1d-4403-8c92-9cf1222ca815 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:53.135065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978dc37f-dc1d-4403-8c92-9cf1222ca815 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:53.136025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dc37f-dc1d-4403-8c92-9cf1222ca815 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:53.139819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978dc37f-dc1d-4403-8c92-9cf1222ca815 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:53.202654 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3785/7567] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:53 2022] POST /identity/v3/projects => generated 354 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:53.202792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31869-c002-466c-80e8-ed55328483c3 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:53.213224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce31869-c002-466c-80e8-ed55328483c3 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:53.234273 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:53.343178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbb119bdc7d4f9781d5d523a869c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4d3b84717a846d5aa7f2fa32ae85d78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:53.343974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:53.344069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:53.344342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:53.345013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:26:53.345327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:53.347167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:53.376513 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3783/7568] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:26:53.454451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc37f-dc1d-4403-8c92-9cf1222ca815 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:53.469701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978dc37f-dc1d-4403-8c92-9cf1222ca815 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:53.493878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9fbb119bdc7d4f9781d5d523a869c981', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4d3b84717a846d5aa7f2fa32ae85d78', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:53.494541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:53.495027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:53.495477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] PATH_INFO: `/v3/projects/5b721a2bea394c56bef33343d97e3887` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:53.513372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Authorizing `identity:delete_project(project_id=5b721a2bea394c56bef33343d97e3887)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:53.515520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:53.644816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b721a2bea394c56bef33343d97e3887', 'request_id': 'req-bf481d9f-116e-42e0-b355-a9301b38ca91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:53.659403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b721a2bea394c56bef33343d97e3887', 'request_id': 'req-bf481d9f-116e-42e0-b355-a9301b38ca91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:53.668346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b721a2bea394c56bef33343d97e3887', 'request_id': 'req-bf481d9f-116e-42e0-b355-a9301b38ca91'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:53.682822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] The token cache is being invalidate because project 5b721a2bea394c56bef33343d97e3887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:53.683776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:53.684961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bf481d9f-116e-42e0-b355-a9301b38ca91 tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:53.687993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3786/7569] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:53 2022] DELETE /identity/v3/projects/5b721a2bea394c56bef33343d97e3887 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:54.048937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:54.050912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:54.188909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445b4795-3305-4bd0-b07f-a9dc8ef514fe tempest-VolumeQuotaClassesTest-1189159874 tempest-VolumeQuotaClassesTest-1189159874-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:54.335941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:54.336950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:54.337475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:54.337996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] PATH_INFO: `/v3/users/5057faf19e9f4383bc06b474c7facb8d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:54.339883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5057faf19e9f4383bc06b474c7facb8d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:54.342163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:54.446188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5057faf19e9f4383bc06b474c7facb8d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:54.449071 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:54.464230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5057faf19e9f4383bc06b474c7facb8d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:54.466660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5057faf19e9f4383bc06b474c7facb8d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:54.487192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5057faf19e9f4383bc06b474c7facb8d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:54.498742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5057faf19e9f4383bc06b474c7facb8d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:54.529133 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3784/7570] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:54 2022] DELETE /identity/v3/users/5057faf19e9f4383bc06b474c7facb8d => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:54.534133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386099-ad89-4621-8d82-32b167a85132 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:54.535320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386099-ad89-4621-8d82-32b167a85132 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:54.535773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7386099-ad89-4621-8d82-32b167a85132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:54.590209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c7386099-ad89-4621-8d82-32b167a85132 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:54.592008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c7386099-ad89-4621-8d82-32b167a85132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:54.623565 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:54.736893 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3787/7571] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:54.760725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:54.762624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:54.990881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747a9621-3451-496e-b84d-ea1250275240 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:55.017188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661164ad-ddc7-4efa-adab-8472c655080a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:55.026439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661164ad-ddc7-4efa-adab-8472c655080a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:55.026716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661164ad-ddc7-4efa-adab-8472c655080a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:55.027540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661164ad-ddc7-4efa-adab-8472c655080a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:55.060642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661164ad-ddc7-4efa-adab-8472c655080a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:55.062158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661164ad-ddc7-4efa-adab-8472c655080a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:55.074737 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3785/7572] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:26:55.559755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386099-ad89-4621-8d82-32b167a85132 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:55.561333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c7386099-ad89-4621-8d82-32b167a85132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:55.579690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7386099-ad89-4621-8d82-32b167a85132 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:55.609625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:55.610301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:55.610585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:55.610859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] PATH_INFO: `/v3/projects/ff39ebdd6963422d86acb71b7d2e2b85` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:55.618112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff39ebdd6963422d86acb71b7d2e2b85)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:55.620072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:55.740594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff39ebdd6963422d86acb71b7d2e2b85', 'request_id': 'req-34566f77-1828-42b8-a36e-d90d0c2a5406'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:55.752394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff39ebdd6963422d86acb71b7d2e2b85', 'request_id': 'req-34566f77-1828-42b8-a36e-d90d0c2a5406'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:55.765575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff39ebdd6963422d86acb71b7d2e2b85', 'request_id': 'req-34566f77-1828-42b8-a36e-d90d0c2a5406'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:55.782706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] The token cache is being invalidate because project ff39ebdd6963422d86acb71b7d2e2b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:55.783806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:55.786041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:55.791421 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3788/7573] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:55 2022] DELETE /identity/v3/projects/ff39ebdd6963422d86acb71b7d2e2b85 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:55.792691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661164ad-ddc7-4efa-adab-8472c655080a service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:55.807008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661164ad-ddc7-4efa-adab-8472c655080a service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:55.940848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:55.941515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:55.941793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:55.942061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] PATH_INFO: `/v3/users/9fbb119bdc7d4f9781d5d523a869c981` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:55.943211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] RBAC: Authorizing `identity:delete_user(user_id=9fbb119bdc7d4f9781d5d523a869c981)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:55.945123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:56.054016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9fbb119bdc7d4f9781d5d523a869c981'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:56.084376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9fbb119bdc7d4f9781d5d523a869c981'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:56.086044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9fbb119bdc7d4f9781d5d523a869c981'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:56.100533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9fbb119bdc7d4f9781d5d523a869c981'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:56.102429 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:56.122849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-bcc10d2e-4672-48f6-9885-0af6791a181f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9fbb119bdc7d4f9781d5d523a869c981'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:56.194325 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3786/7574] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:26:55 2022] DELETE /identity/v3/users/9fbb119bdc7d4f9781d5d523a869c981 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:56.742775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:56.745164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:56.769247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34566f77-1828-42b8-a36e-d90d0c2a5406 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:56.892819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:56.893511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:56.893790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:56.894061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] PATH_INFO: `/v3/projects/e4d3b84717a846d5aa7f2fa32ae85d78` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:56.895758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4d3b84717a846d5aa7f2fa32ae85d78)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:56.900516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:56.999912 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:57.002982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4d3b84717a846d5aa7f2fa32ae85d78', 'request_id': 'req-b8384f50-68e5-4f44-a551-b06e151e4bb5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:57.017186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4d3b84717a846d5aa7f2fa32ae85d78', 'request_id': 'req-b8384f50-68e5-4f44-a551-b06e151e4bb5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:57.031346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4d3b84717a846d5aa7f2fa32ae85d78', 'request_id': 'req-b8384f50-68e5-4f44-a551-b06e151e4bb5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:57.062211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] The token cache is being invalidate because project e4d3b84717a846d5aa7f2fa32ae85d78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:26:57.062489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:57.063223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b8384f50-68e5-4f44-a551-b06e151e4bb5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:26:57.065528 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3789/7575] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:26:56 2022] DELETE /identity/v3/projects/e4d3b84717a846d5aa7f2fa32ae85d78 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:26:57.070963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d05ea-dcff-4088-961e-7e69de29e376 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:57.071390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d05ea-dcff-4088-961e-7e69de29e376 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:57.071853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96d05ea-dcff-4088-961e-7e69de29e376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:57.125606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c96d05ea-dcff-4088-961e-7e69de29e376 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:57.125606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c96d05ea-dcff-4088-961e-7e69de29e376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:57.340694 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3787/7576] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:57.455589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d29a-d5ce-4c72-97d7-d26b9caf1e83 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:57.455589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d29a-d5ce-4c72-97d7-d26b9caf1e83 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:57.455878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a771d29a-d5ce-4c72-97d7-d26b9caf1e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:57.502511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a771d29a-d5ce-4c72-97d7-d26b9caf1e83 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:57.503929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a771d29a-d5ce-4c72-97d7-d26b9caf1e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:57.529331 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3790/7577] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:57.532740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d05ea-dcff-4088-961e-7e69de29e376 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:57.549595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96d05ea-dcff-4088-961e-7e69de29e376 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:57.554891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f597b92-663d-4f80-becf-57ab6b10c1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:57.555564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f597b92-663d-4f80-becf-57ab6b10c1df admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:57.555845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f597b92-663d-4f80-becf-57ab6b10c1df admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:57.556117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f597b92-663d-4f80-becf-57ab6b10c1df admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:57.556764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f597b92-663d-4f80-becf-57ab6b10c1df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:26:57.557061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f597b92-663d-4f80-becf-57ab6b10c1df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:57.558769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f597b92-663d-4f80-becf-57ab6b10c1df admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:57.581144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3788/7578] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:26:57.591577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771d29a-d5ce-4c72-97d7-d26b9caf1e83 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:57.604155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a771d29a-d5ce-4c72-97d7-d26b9caf1e83 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:57.610453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13efffc-2d53-46d5-9a37-a7a2d396f1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:57.611165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13efffc-2d53-46d5-9a37-a7a2d396f1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:57.611611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13efffc-2d53-46d5-9a37-a7a2d396f1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:57.612016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13efffc-2d53-46d5-9a37-a7a2d396f1c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:57.612804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13efffc-2d53-46d5-9a37-a7a2d396f1c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:57.615148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13efffc-2d53-46d5-9a37-a7a2d396f1c9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:57.650491 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3791/7579] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:26:57 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:26:57.655415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f597b92-663d-4f80-becf-57ab6b10c1df admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:57.667262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f597b92-663d-4f80-becf-57ab6b10c1df admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:57.730365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfa96d-7fa3-4265-a8bd-e7bd3d28e95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:57.731124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfa96d-7fa3-4265-a8bd-e7bd3d28e95e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:57.731406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfa96d-7fa3-4265-a8bd-e7bd3d28e95e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:57.731698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bfa96d-7fa3-4265-a8bd-e7bd3d28e95e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:57.732325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfa96d-7fa3-4265-a8bd-e7bd3d28e95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:57.734311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bfa96d-7fa3-4265-a8bd-e7bd3d28e95e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:57.761661 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3789/7580] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:26:57 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:26:57.765219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13efffc-2d53-46d5-9a37-a7a2d396f1c9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:57.784320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13efffc-2d53-46d5-9a37-a7a2d396f1c9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:57.789282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34fe51-d08a-4445-8932-964320f41ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:57.790137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fe51-d08a-4445-8932-964320f41ea8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:57.790516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fe51-d08a-4445-8932-964320f41ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:57.790861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34fe51-d08a-4445-8932-964320f41ea8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:57.791573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34fe51-d08a-4445-8932-964320f41ea8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:57.793505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb34fe51-d08a-4445-8932-964320f41ea8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:57.808884 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3792/7581] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:57.811585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfa96d-7fa3-4265-a8bd-e7bd3d28e95e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:57.822715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bfa96d-7fa3-4265-a8bd-e7bd3d28e95e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:57.828444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9018e32-ab51-41ef-b63c-0efe72e3a8d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:57.829225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9018e32-ab51-41ef-b63c-0efe72e3a8d9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:57.829734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9018e32-ab51-41ef-b63c-0efe72e3a8d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:57.830163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9018e32-ab51-41ef-b63c-0efe72e3a8d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:57.830952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9018e32-ab51-41ef-b63c-0efe72e3a8d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:57.832724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9018e32-ab51-41ef-b63c-0efe72e3a8d9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:57.850712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34fe51-d08a-4445-8932-964320f41ea8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:57.861345 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3790/7582] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:26:57 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:26:57.864128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34fe51-d08a-4445-8932-964320f41ea8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:57.869540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f58e4-fd8f-438b-a66a-2974d0faee8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:57.870424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f58e4-fd8f-438b-a66a-2974d0faee8d admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:57.871415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f58e4-fd8f-438b-a66a-2974d0faee8d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:57.871841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2f58e4-fd8f-438b-a66a-2974d0faee8d admin admin] PATH_INFO: `/v3/projects/2ab9b110cb5f48ae9033bf7b46ff8af3/users/0330403b307f492b90519875fcb23c6b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:57.889718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f58e4-fd8f-438b-a66a-2974d0faee8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ab9b110cb5f48ae9033bf7b46ff8af3, user_id=0330403b307f492b90519875fcb23c6b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:57.892495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2f58e4-fd8f-438b-a66a-2974d0faee8d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:57.905938 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3793/7583] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:26:57 2022] PUT /identity/v3/projects/2ab9b110cb5f48ae9033bf7b46ff8af3/users/0330403b307f492b90519875fcb23c6b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:26:57.915964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07495026-9561-4129-b937-b6917157a069 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:57.916426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07495026-9561-4129-b937-b6917157a069 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:57.916705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07495026-9561-4129-b937-b6917157a069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:57.946452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-07495026-9561-4129-b937-b6917157a069 None None] MFA Rules not processed for user `0330403b307f492b90519875fcb23c6b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:26:57.947654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-07495026-9561-4129-b937-b6917157a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:57.994741 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:26:58.018592 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3791/7584] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:26:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:26:58.030141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f58e4-fd8f-438b-a66a-2974d0faee8d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:26:58.031866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ac2f58e4-fd8f-438b-a66a-2974d0faee8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:26:58.105708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2f58e4-fd8f-438b-a66a-2974d0faee8d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:26:58.109694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bff91c-30ce-4214-8374-398a7f11abfc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:26:58.110345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bff91c-30ce-4214-8374-398a7f11abfc service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:26:58.110625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bff91c-30ce-4214-8374-398a7f11abfc service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:26:58.110894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bff91c-30ce-4214-8374-398a7f11abfc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:26:58.120319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bff91c-30ce-4214-8374-398a7f11abfc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:26:58.125354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bff91c-30ce-4214-8374-398a7f11abfc service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:26:58.139781 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3794/7585] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:26:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:27:00.661446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07495026-9561-4129-b937-b6917157a069 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:00.664071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-07495026-9561-4129-b937-b6917157a069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:00.784279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07495026-9561-4129-b937-b6917157a069 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:00.791202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca62acb-4b08-4677-b983-f99ed9a00869 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:00.791833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca62acb-4b08-4677-b983-f99ed9a00869 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:00.792115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca62acb-4b08-4677-b983-f99ed9a00869 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:00.792926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca62acb-4b08-4677-b983-f99ed9a00869 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:00.794891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aca62acb-4b08-4677-b983-f99ed9a00869 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:00.817329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca62acb-4b08-4677-b983-f99ed9a00869 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:00.819219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca62acb-4b08-4677-b983-f99ed9a00869 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:00.839610 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3792/7586] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:01.233668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bff91c-30ce-4214-8374-398a7f11abfc service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:01.235166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-33bff91c-30ce-4214-8374-398a7f11abfc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:01.350349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bff91c-30ce-4214-8374-398a7f11abfc service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:01.353911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f79a74-5a80-4fb4-9844-f7212200b438 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:01.354577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f79a74-5a80-4fb4-9844-f7212200b438 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:01.354998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f79a74-5a80-4fb4-9844-f7212200b438 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:01.355425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f79a74-5a80-4fb4-9844-f7212200b438 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:01.357434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-47f79a74-5a80-4fb4-9844-f7212200b438 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:01.371151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f79a74-5a80-4fb4-9844-f7212200b438 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:01.372708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f79a74-5a80-4fb4-9844-f7212200b438 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:01.388964 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3795/7587] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:01.503175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca62acb-4b08-4677-b983-f99ed9a00869 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:01.520582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca62acb-4b08-4677-b983-f99ed9a00869 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:01.527746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:01.529489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:01.530101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:01.530599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:01.532926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:01.666498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:01.669404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:01.699008 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3793/7588] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:01.743600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f79a74-5a80-4fb4-9844-f7212200b438 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:01.761947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f79a74-5a80-4fb4-9844-f7212200b438 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:01.770720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074363fe-606c-4eec-8691-a6782d271468 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:01.772164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074363fe-606c-4eec-8691-a6782d271468 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:01.772759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074363fe-606c-4eec-8691-a6782d271468 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:01.773259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074363fe-606c-4eec-8691-a6782d271468 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:01.775818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-074363fe-606c-4eec-8691-a6782d271468 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:01.809527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074363fe-606c-4eec-8691-a6782d271468 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:01.811379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074363fe-606c-4eec-8691-a6782d271468 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:01.838280 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3796/7589] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:27:02.177472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:02.179031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:02.387168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209cb677-c482-46e7-8b2b-41da6e40e15c service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:02.397475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:02.398119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:02.398400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:02.398683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] PATH_INFO: `/v3/users/6d1d1698b77946f0ade2ef335a15a1dd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:02.399845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d1d1698b77946f0ade2ef335a15a1dd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:02.409959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:02.413001 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:02.497929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d1d1698b77946f0ade2ef335a15a1dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:02.521631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d1d1698b77946f0ade2ef335a15a1dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:02.523469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d1d1698b77946f0ade2ef335a15a1dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:02.543339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d1d1698b77946f0ade2ef335a15a1dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:02.581149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d1d1698b77946f0ade2ef335a15a1dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:02.593987 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3794/7590] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:02 2022] DELETE /identity/v3/users/6d1d1698b77946f0ade2ef335a15a1dd => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:02.598820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764465c9-cb80-46fc-be80-011baa3df080 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:02.599292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764465c9-cb80-46fc-be80-011baa3df080 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:02.599398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764465c9-cb80-46fc-be80-011baa3df080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:02.625905 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:02.670341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-764465c9-cb80-46fc-be80-011baa3df080 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:02.680366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-764465c9-cb80-46fc-be80-011baa3df080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:02.866828 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3797/7591] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:02.875385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:02.877268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:03.003949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6968a66-9b4f-422f-be9f-780832569dd8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:03.016162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d86714c-a289-49ad-9a40-007dbf672f41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:03.017077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86714c-a289-49ad-9a40-007dbf672f41 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:03.017538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86714c-a289-49ad-9a40-007dbf672f41 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:03.017982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d86714c-a289-49ad-9a40-007dbf672f41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:03.047717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86714c-a289-49ad-9a40-007dbf672f41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:03.050227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d86714c-a289-49ad-9a40-007dbf672f41 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:03.073405 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3795/7592] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:03.832074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764465c9-cb80-46fc-be80-011baa3df080 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:03.833791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-764465c9-cb80-46fc-be80-011baa3df080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:03.871138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764465c9-cb80-46fc-be80-011baa3df080 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:03.893608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:03.894265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:03.894542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:03.894815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] PATH_INFO: `/v3/projects/87e84726038d4f29b2ca64c98c277cd1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:03.902419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e84726038d4f29b2ca64c98c277cd1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:03.905383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:04.008460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e84726038d4f29b2ca64c98c277cd1', 'request_id': 'req-171949f7-2ea7-49e0-a3a9-ef99e849fd17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:04.025173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e84726038d4f29b2ca64c98c277cd1', 'request_id': 'req-171949f7-2ea7-49e0-a3a9-ef99e849fd17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:04.043841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e84726038d4f29b2ca64c98c277cd1', 'request_id': 'req-171949f7-2ea7-49e0-a3a9-ef99e849fd17'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:04.082956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] The token cache is being invalidate because project 87e84726038d4f29b2ca64c98c277cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:04.083349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:04.085939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-171949f7-2ea7-49e0-a3a9-ef99e849fd17 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:04.091046 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3798/7593] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:03 2022] DELETE /identity/v3/projects/87e84726038d4f29b2ca64c98c277cd1 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:04.096529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc770e7b-9641-483b-9777-6758c8d1317c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:04.097527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc770e7b-9641-483b-9777-6758c8d1317c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:04.097955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc770e7b-9641-483b-9777-6758c8d1317c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:04.137002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bc770e7b-9641-483b-9777-6758c8d1317c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:04.140633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bc770e7b-9641-483b-9777-6758c8d1317c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:04.285066 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3796/7594] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:04.293606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4602-a794-4ed9-a9c4-5fb06b1ffb31 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:04.293953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4602-a794-4ed9-a9c4-5fb06b1ffb31 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:04.294184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54e4602-a794-4ed9-a9c4-5fb06b1ffb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:04.383198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f54e4602-a794-4ed9-a9c4-5fb06b1ffb31 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:04.384887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f54e4602-a794-4ed9-a9c4-5fb06b1ffb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:04.416482 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3799/7595] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:04.421175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc770e7b-9641-483b-9777-6758c8d1317c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:04.431790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc770e7b-9641-483b-9777-6758c8d1317c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:04.450207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7a084-114d-43de-80d2-61edfc2d0f8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:04.450994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7a084-114d-43de-80d2-61edfc2d0f8e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:04.451381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7a084-114d-43de-80d2-61edfc2d0f8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:04.451756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f7a084-114d-43de-80d2-61edfc2d0f8e admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:04.452561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7a084-114d-43de-80d2-61edfc2d0f8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:27:04.453009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7a084-114d-43de-80d2-61edfc2d0f8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:04.455734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f7a084-114d-43de-80d2-61edfc2d0f8e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:04.483664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4602-a794-4ed9-a9c4-5fb06b1ffb31 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:04.489591 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3797/7596] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:27:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:27:04.501245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54e4602-a794-4ed9-a9c4-5fb06b1ffb31 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:04.507111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe52112-65a6-4ee1-a75c-98f3e147d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:04.507375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe52112-65a6-4ee1-a75c-98f3e147d797 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:04.507631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe52112-65a6-4ee1-a75c-98f3e147d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:04.507911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe52112-65a6-4ee1-a75c-98f3e147d797 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:04.508748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe52112-65a6-4ee1-a75c-98f3e147d797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:04.510503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe52112-65a6-4ee1-a75c-98f3e147d797 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:04.570284 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3800/7597] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:27:04 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:27:04.574510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7a084-114d-43de-80d2-61edfc2d0f8e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:04.590038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f7a084-114d-43de-80d2-61edfc2d0f8e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:04.610851 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:04.831500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d836cf-adea-4db0-9cdd-ea5f8ce6e0ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:04.832205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d836cf-adea-4db0-9cdd-ea5f8ce6e0ab admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:04.832482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d836cf-adea-4db0-9cdd-ea5f8ce6e0ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:04.832808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d836cf-adea-4db0-9cdd-ea5f8ce6e0ab admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:04.833568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d836cf-adea-4db0-9cdd-ea5f8ce6e0ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:04.835765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d836cf-adea-4db0-9cdd-ea5f8ce6e0ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:04.899062 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3798/7598] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:27:04 2022] POST /identity/v3/users => generated 292 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:04.902958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe52112-65a6-4ee1-a75c-98f3e147d797 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:04.919244 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe52112-65a6-4ee1-a75c-98f3e147d797 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:04.928914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637ae2c-4f03-4906-8df1-63c82e2261c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:04.931253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ae2c-4f03-4906-8df1-63c82e2261c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:04.932604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ae2c-4f03-4906-8df1-63c82e2261c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:04.933980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7637ae2c-4f03-4906-8df1-63c82e2261c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:04.934656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637ae2c-4f03-4906-8df1-63c82e2261c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:04.938469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7637ae2c-4f03-4906-8df1-63c82e2261c7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:04.964466 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3801/7599] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:04.965917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d836cf-adea-4db0-9cdd-ea5f8ce6e0ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:04.987799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d836cf-adea-4db0-9cdd-ea5f8ce6e0ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:04.993515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19fba18-d113-44bd-9173-9cc96608472e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:04.994464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fba18-d113-44bd-9173-9cc96608472e admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:04.994960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fba18-d113-44bd-9173-9cc96608472e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:04.995986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19fba18-d113-44bd-9173-9cc96608472e admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:04.996871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fba18-d113-44bd-9173-9cc96608472e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:04.998755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19fba18-d113-44bd-9173-9cc96608472e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:05.039032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637ae2c-4f03-4906-8df1-63c82e2261c7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:05.049480 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3799/7600] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:04 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:05.052039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7637ae2c-4f03-4906-8df1-63c82e2261c7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:05.071781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da145fbc-f31d-460a-ad96-85421de3c3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:05.073395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da145fbc-f31d-460a-ad96-85421de3c3ef admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:05.074549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da145fbc-f31d-460a-ad96-85421de3c3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:05.075035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da145fbc-f31d-460a-ad96-85421de3c3ef admin admin] PATH_INFO: `/v3/projects/68a1578264e3402a91a4e300ac4f950e/users/8ea5a6e672124374b7d2e904eefa9a6a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:05.138828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da145fbc-f31d-460a-ad96-85421de3c3ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a1578264e3402a91a4e300ac4f950e, user_id=8ea5a6e672124374b7d2e904eefa9a6a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:05.143104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da145fbc-f31d-460a-ad96-85421de3c3ef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:05.182248 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3802/7601] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:27:05 2022] PUT /identity/v3/projects/68a1578264e3402a91a4e300ac4f950e/users/8ea5a6e672124374b7d2e904eefa9a6a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:27:05.184761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cd746-f86f-4f6a-8fb8-fbbad5a9fd51 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:05.185713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cd746-f86f-4f6a-8fb8-fbbad5a9fd51 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:05.186316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1cd746-f86f-4f6a-8fb8-fbbad5a9fd51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:05.215733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da145fbc-f31d-460a-ad96-85421de3c3ef admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:05.217656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-da145fbc-f31d-460a-ad96-85421de3c3ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:05.237093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1f1cd746-f86f-4f6a-8fb8-fbbad5a9fd51 None None] MFA Rules not processed for user `8ea5a6e672124374b7d2e904eefa9a6a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:05.238498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f1cd746-f86f-4f6a-8fb8-fbbad5a9fd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:05.278987 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:05.354546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da145fbc-f31d-460a-ad96-85421de3c3ef admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:05.359533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:05.361111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:05.361679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:05.362333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:05.364515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:05.379738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:05.381682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:05.384700 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3800/7602] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:05.398934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cd746-f86f-4f6a-8fb8-fbbad5a9fd51 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:05.400350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f1cd746-f86f-4f6a-8fb8-fbbad5a9fd51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:05.400657 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3803/7603] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:27:05.475972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1cd746-f86f-4f6a-8fb8-fbbad5a9fd51 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:05.487627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd46ab-7922-4eab-9b59-c32524981333 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:05.488486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd46ab-7922-4eab-9b59-c32524981333 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:05.488953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd46ab-7922-4eab-9b59-c32524981333 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:05.489473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cd46ab-7922-4eab-9b59-c32524981333 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:05.513043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd46ab-7922-4eab-9b59-c32524981333 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:05.515036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cd46ab-7922-4eab-9b59-c32524981333 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:05.526586 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3801/7604] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:09.120250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:09.121733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:09.292216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a66bfbc-86e4-4d5c-b288-94a980057413 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:09.305772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:09.306443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:09.306729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:09.307013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:09.317505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:09.478469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:09.483668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:09.528795 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3804/7605] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:27:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 734 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:27:13.536347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd46ab-7922-4eab-9b59-c32524981333 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:13.538590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-75cd46ab-7922-4eab-9b59-c32524981333 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:13.576499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cd46ab-7922-4eab-9b59-c32524981333 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:13.599275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8a5a-b8a0-46e2-ba59-ff7e848f4dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:13.603232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8a5a-b8a0-46e2-ba59-ff7e848f4dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:13.603712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8a5a-b8a0-46e2-ba59-ff7e848f4dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:13.604969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7e8a5a-b8a0-46e2-ba59-ff7e848f4dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:13.613320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a7e8a5a-b8a0-46e2-ba59-ff7e848f4dc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:13.655783 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:13.726757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e8a5a-b8a0-46e2-ba59-ff7e848f4dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:13.728363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7e8a5a-b8a0-46e2-ba59-ff7e848f4dc6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:13.743548 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3802/7606] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:19.505240 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=71 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:21.703399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:21.704879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:21.734695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df8a3cc-0235-42b9-9bf2-239b40b8b7e0 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:21.760929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:21.761235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:21.761728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:21.762941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] PATH_INFO: `/v3/users/eff0a34acf48466689c201d876a0cda4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:21.764149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=eff0a34acf48466689c201d876a0cda4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:21.769770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:21.875084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eff0a34acf48466689c201d876a0cda4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:21.958073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eff0a34acf48466689c201d876a0cda4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:21.961999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eff0a34acf48466689c201d876a0cda4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:21.980984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eff0a34acf48466689c201d876a0cda4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:22.004751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eff0a34acf48466689c201d876a0cda4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:22.028749 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3805/7607] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:21 2022] DELETE /identity/v3/users/eff0a34acf48466689c201d876a0cda4 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:22.919742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8a5a-b8a0-46e2-ba59-ff7e848f4dc6 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:22.939255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7e8a5a-b8a0-46e2-ba59-ff7e848f4dc6 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:23.057410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:23.058230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:23.061807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:23.062283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] PATH_INFO: `/v3/projects/36d827271fb5462b9271fa0aad666949` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:23.064479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] RBAC: Authorizing `identity:delete_project(project_id=36d827271fb5462b9271fa0aad666949)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:23.067248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:23.191557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '36d827271fb5462b9271fa0aad666949', 'request_id': 'req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.206806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '36d827271fb5462b9271fa0aad666949', 'request_id': 'req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.232087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '36d827271fb5462b9271fa0aad666949', 'request_id': 'req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.249626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] The token cache is being invalidate because project 36d827271fb5462b9271fa0aad666949 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:23.250286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.252905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.257135 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3803/7608] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:22 2022] DELETE /identity/v3/projects/36d827271fb5462b9271fa0aad666949 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:23.263765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:23.266056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:23.296134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7481a-39c6-4b23-b375-b83925d7ccbb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:23.488870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:23.491004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:23.491295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:23.491580 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] PATH_INFO: `/v3/users/fe233c29324741a683234ff65cea8d7b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:23.494418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe233c29324741a683234ff65cea8d7b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:23.496994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:23.629258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe233c29324741a683234ff65cea8d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.673471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe233c29324741a683234ff65cea8d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.674245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe233c29324741a683234ff65cea8d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.695550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:23.697561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:23.699943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe233c29324741a683234ff65cea8d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.702964 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:23.711741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-94143415-6c5d-46cc-aac8-44966b8e39e0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe233c29324741a683234ff65cea8d7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:23.728782 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3806/7609] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:23 2022] DELETE /identity/v3/users/fe233c29324741a683234ff65cea8d7b => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:23.733778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309fc1f0-55a8-46b0-bb3d-b55d8fbef813 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:23.863441 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:23.894686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:23.895352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:23.895630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:23.895902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] PATH_INFO: `/v3/users/8ea5a6e672124374b7d2e904eefa9a6a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:23.901822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ea5a6e672124374b7d2e904eefa9a6a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:23.904016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:24.013887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ea5a6e672124374b7d2e904eefa9a6a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.053506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ea5a6e672124374b7d2e904eefa9a6a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.062491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ea5a6e672124374b7d2e904eefa9a6a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.079491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ea5a6e672124374b7d2e904eefa9a6a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.093902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ea5a6e672124374b7d2e904eefa9a6a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.117424 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3804/7610] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:23 2022] DELETE /identity/v3/users/8ea5a6e672124374b7d2e904eefa9a6a => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:24.119263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18dd8-52ae-4cae-be3a-db21f4731195 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:24.119562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18dd8-52ae-4cae-be3a-db21f4731195 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:24.120408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b18dd8-52ae-4cae-be3a-db21f4731195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:24.171494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-01b18dd8-52ae-4cae-be3a-db21f4731195 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:24.176665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-01b18dd8-52ae-4cae-be3a-db21f4731195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:24.230386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:24.232137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:24.356254 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3807/7611] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:24.402917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b18dd8-52ae-4cae-be3a-db21f4731195 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:24.411446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-01b18dd8-52ae-4cae-be3a-db21f4731195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:24.422081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2f72c9-8dc9-4c0c-a389-dce86dee1b5d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:24.428154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:24.428789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:24.429068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:24.430534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] PATH_INFO: `/v3/projects/178d32b3c9d94f578e8eeb704c4f6d5e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:24.431716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=178d32b3c9d94f578e8eeb704c4f6d5e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:24.434944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:24.562347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '178d32b3c9d94f578e8eeb704c4f6d5e', 'request_id': 'req-49b4833c-45b3-409c-a9a5-e9e51ca0e703'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.577156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b18dd8-52ae-4cae-be3a-db21f4731195 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:24.587310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '178d32b3c9d94f578e8eeb704c4f6d5e', 'request_id': 'req-49b4833c-45b3-409c-a9a5-e9e51ca0e703'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.611476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '178d32b3c9d94f578e8eeb704c4f6d5e', 'request_id': 'req-49b4833c-45b3-409c-a9a5-e9e51ca0e703'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.619420 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:24.630461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] The token cache is being invalidate because project 178d32b3c9d94f578e8eeb704c4f6d5e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:24.631246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.632278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-49b4833c-45b3-409c-a9a5-e9e51ca0e703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:24.634354 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3805/7612] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:24 2022] DELETE /identity/v3/projects/178d32b3c9d94f578e8eeb704c4f6d5e => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:24.640735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5956f1-6203-48ab-95e1-a104d4ed8131 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:24.641631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5956f1-6203-48ab-95e1-a104d4ed8131 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:24.642192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5956f1-6203-48ab-95e1-a104d4ed8131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:24.688336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5e5956f1-6203-48ab-95e1-a104d4ed8131 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:24.695464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5e5956f1-6203-48ab-95e1-a104d4ed8131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:24.759257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a7060-a71f-4cfb-a838-f58427f43485 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:24.759896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a7060-a71f-4cfb-a838-f58427f43485 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:24.760176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a7060-a71f-4cfb-a838-f58427f43485 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:24.760483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65a7060-a71f-4cfb-a838-f58427f43485 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:24.769909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b65a7060-a71f-4cfb-a838-f58427f43485 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:24.924912 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3806/7613] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:24.926814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50477edc-b4e0-42c1-9a0a-ab37ad891ef8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:24.927271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50477edc-b4e0-42c1-9a0a-ab37ad891ef8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:24.927387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50477edc-b4e0-42c1-9a0a-ab37ad891ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:24.942095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a7060-a71f-4cfb-a838-f58427f43485 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:24.952039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-50477edc-b4e0-42c1-9a0a-ab37ad891ef8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:24.953666 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50477edc-b4e0-42c1-9a0a-ab37ad891ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:24.958811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65a7060-a71f-4cfb-a838-f58427f43485 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:24.964269 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:24.969550 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3807/7614] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:24.970604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50477edc-b4e0-42c1-9a0a-ab37ad891ef8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:24.987466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50477edc-b4e0-42c1-9a0a-ab37ad891ef8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:24.995535 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3808/7615] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:27:24.996743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89859-92d9-43de-bc80-b71e9d6efceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:24.997462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89859-92d9-43de-bc80-b71e9d6efceb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:24.997744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89859-92d9-43de-bc80-b71e9d6efceb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:24.998068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb89859-92d9-43de-bc80-b71e9d6efceb admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:24.998767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb89859-92d9-43de-bc80-b71e9d6efceb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:27:24.999073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb89859-92d9-43de-bc80-b71e9d6efceb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:25.001121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb89859-92d9-43de-bc80-b71e9d6efceb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:25.019942 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3808/7616] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:27:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:27:25.020813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a7060-a71f-4cfb-a838-f58427f43485 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:25.039433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65a7060-a71f-4cfb-a838-f58427f43485 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:25.053661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3cee2-c808-4fdd-a861-28b3404ea9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:25.054471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3cee2-c808-4fdd-a861-28b3404ea9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:25.054763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3cee2-c808-4fdd-a861-28b3404ea9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:25.055046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa3cee2-c808-4fdd-a861-28b3404ea9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:25.055691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3cee2-c808-4fdd-a861-28b3404ea9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:25.057686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa3cee2-c808-4fdd-a861-28b3404ea9d9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:25.132127 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3809/7617] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:27:25 2022] POST /identity/v3/projects => generated 381 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:25.137268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89859-92d9-43de-bc80-b71e9d6efceb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:25.166347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb89859-92d9-43de-bc80-b71e9d6efceb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:25.250915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3cee2-c808-4fdd-a861-28b3404ea9d9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:25.253029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aaa3cee2-c808-4fdd-a861-28b3404ea9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:25.334969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f6942-7831-46d9-88f6-0e9bec60c581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:25.335596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f6942-7831-46d9-88f6-0e9bec60c581 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:25.335882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f6942-7831-46d9-88f6-0e9bec60c581 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:25.336161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50f6942-7831-46d9-88f6-0e9bec60c581 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:25.336803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f6942-7831-46d9-88f6-0e9bec60c581 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:25.355796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50f6942-7831-46d9-88f6-0e9bec60c581 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:25.407887 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3809/7618] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:27:25 2022] POST /identity/v3/users => generated 291 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:25.412125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f6942-7831-46d9-88f6-0e9bec60c581 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:25.443542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50f6942-7831-46d9-88f6-0e9bec60c581 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:25.461984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e2960-8e61-441c-a415-90299a1db301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:25.472694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2960-8e61-441c-a415-90299a1db301 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:25.472694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2960-8e61-441c-a415-90299a1db301 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:25.472694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e2960-8e61-441c-a415-90299a1db301 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:25.472694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e2960-8e61-441c-a415-90299a1db301 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:25.472694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e2960-8e61-441c-a415-90299a1db301 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:25.500793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa3cee2-c808-4fdd-a861-28b3404ea9d9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:25.511449 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3810/7619] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:25.512421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e2960-8e61-441c-a415-90299a1db301 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:25.524321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8d5fe1-78f6-499d-b108-6f5bbae4631e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:25.524956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d5fe1-78f6-499d-b108-6f5bbae4631e service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:25.525245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d5fe1-78f6-499d-b108-6f5bbae4631e service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:25.525567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8d5fe1-78f6-499d-b108-6f5bbae4631e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:25.533887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0e8d5fe1-78f6-499d-b108-6f5bbae4631e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:25.539753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e2960-8e61-441c-a415-90299a1db301 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:25.568654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16eafa-f644-4a25-9cf6-160e17e4468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:25.569020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16eafa-f644-4a25-9cf6-160e17e4468c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:25.569327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16eafa-f644-4a25-9cf6-160e17e4468c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:25.569606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16eafa-f644-4a25-9cf6-160e17e4468c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:25.570638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16eafa-f644-4a25-9cf6-160e17e4468c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:25.571887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16eafa-f644-4a25-9cf6-160e17e4468c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:25.575233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d5fe1-78f6-499d-b108-6f5bbae4631e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:25.576648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8d5fe1-78f6-499d-b108-6f5bbae4631e service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:25.605220 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3811/7620] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:25 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:25.606170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16eafa-f644-4a25-9cf6-160e17e4468c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:25.620984 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3810/7621] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:27:25.632322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16eafa-f644-4a25-9cf6-160e17e4468c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:25.646671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1c37-e87e-47a6-9941-32d1caa40e33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:25.647288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1c37-e87e-47a6-9941-32d1caa40e33 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:25.647570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1c37-e87e-47a6-9941-32d1caa40e33 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:25.647852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06eb1c37-e87e-47a6-9941-32d1caa40e33 admin admin] PATH_INFO: `/v3/projects/5ffa591ecfaa48ada907a639b45d07f7/users/e2fc124049504d579f6513b5cac00bdf/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:25.710987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1c37-e87e-47a6-9941-32d1caa40e33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ffa591ecfaa48ada907a639b45d07f7, user_id=e2fc124049504d579f6513b5cac00bdf, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:25.711622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06eb1c37-e87e-47a6-9941-32d1caa40e33 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:25.750268 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3812/7622] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:27:25 2022] PUT /identity/v3/projects/5ffa591ecfaa48ada907a639b45d07f7/users/e2fc124049504d579f6513b5cac00bdf/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:25.755118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4216a-6857-4980-9b38-69b691db3328 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:25.755412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4216a-6857-4980-9b38-69b691db3328 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:25.755967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f4216a-6857-4980-9b38-69b691db3328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:25.795941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1c37-e87e-47a6-9941-32d1caa40e33 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:25.798186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-06eb1c37-e87e-47a6-9941-32d1caa40e33 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:25.826719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-98f4216a-6857-4980-9b38-69b691db3328 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:25.827971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-98f4216a-6857-4980-9b38-69b691db3328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:25.840440 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:25.960968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06eb1c37-e87e-47a6-9941-32d1caa40e33 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:25.967187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:25.967878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:25.968162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:25.969257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] PATH_INFO: `/v3/projects/68a1578264e3402a91a4e300ac4f950e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:25.970609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a1578264e3402a91a4e300ac4f950e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:25.972540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:25.999615 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3811/7623] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:26.029673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4216a-6857-4980-9b38-69b691db3328 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:26.036125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-98f4216a-6857-4980-9b38-69b691db3328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:26.089878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a1578264e3402a91a4e300ac4f950e', 'request_id': 'req-5e8987fe-fbe1-459f-8384-82559ae25a18'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:26.098011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a1578264e3402a91a4e300ac4f950e', 'request_id': 'req-5e8987fe-fbe1-459f-8384-82559ae25a18'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:26.116367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a1578264e3402a91a4e300ac4f950e', 'request_id': 'req-5e8987fe-fbe1-459f-8384-82559ae25a18'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:26.131747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] The token cache is being invalidate because project 68a1578264e3402a91a4e300ac4f950e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:26.132312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:26.133097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5e8987fe-fbe1-459f-8384-82559ae25a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:26.134798 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3813/7624] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:25 2022] DELETE /identity/v3/projects/68a1578264e3402a91a4e300ac4f950e => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:27:26.140052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2bec5-5614-46eb-942a-2d88dfb985c7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:26.141537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2bec5-5614-46eb-942a-2d88dfb985c7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:26.141942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c2bec5-5614-46eb-942a-2d88dfb985c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:26.194440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-19c2bec5-5614-46eb-942a-2d88dfb985c7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:26.196294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-19c2bec5-5614-46eb-942a-2d88dfb985c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:26.239930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f4216a-6857-4980-9b38-69b691db3328 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:26.278556 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:26.426945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce73c41-2492-4fde-ab72-73a5220724ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:26.429394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce73c41-2492-4fde-ab72-73a5220724ab service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:26.429781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce73c41-2492-4fde-ab72-73a5220724ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:26.431410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce73c41-2492-4fde-ab72-73a5220724ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:26.439220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5ce73c41-2492-4fde-ab72-73a5220724ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:26.458417 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3814/7625] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:26.464072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cea7c-e86d-48fe-a024-1b76d45dfd80 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:26.464511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cea7c-e86d-48fe-a024-1b76d45dfd80 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:26.464883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cea7c-e86d-48fe-a024-1b76d45dfd80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:26.493726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce73c41-2492-4fde-ab72-73a5220724ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:26.500829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce73c41-2492-4fde-ab72-73a5220724ab service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:26.560031 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3812/7626] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:26.563190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a97cea7c-e86d-48fe-a024-1b76d45dfd80 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:26.564752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a97cea7c-e86d-48fe-a024-1b76d45dfd80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:26.574645 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3815/7627] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:26.578624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce73c41-2492-4fde-ab72-73a5220724ab service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:26.591247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce73c41-2492-4fde-ab72-73a5220724ab service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:26.607474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bef83-b5bc-48c7-b5fa-7fdce019cf64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:26.608564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bef83-b5bc-48c7-b5fa-7fdce019cf64 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:26.615501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bef83-b5bc-48c7-b5fa-7fdce019cf64 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:26.616155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bef83-b5bc-48c7-b5fa-7fdce019cf64 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:26.618091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bef83-b5bc-48c7-b5fa-7fdce019cf64 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:27:26.618650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bef83-b5bc-48c7-b5fa-7fdce019cf64 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:26.631088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387bef83-b5bc-48c7-b5fa-7fdce019cf64 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:26.663411 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3813/7628] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:27:26.669278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cea7c-e86d-48fe-a024-1b76d45dfd80 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:26.684087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cea7c-e86d-48fe-a024-1b76d45dfd80 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:26.693393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164424b-c730-4f18-9025-42815d3e63c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:26.694292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164424b-c730-4f18-9025-42815d3e63c6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:26.694968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164424b-c730-4f18-9025-42815d3e63c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:26.695468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3164424b-c730-4f18-9025-42815d3e63c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:26.696317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164424b-c730-4f18-9025-42815d3e63c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:26.699771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3164424b-c730-4f18-9025-42815d3e63c6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:26.795369 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3816/7629] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:27:26 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:26.799096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bef83-b5bc-48c7-b5fa-7fdce019cf64 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:26.811687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bef83-b5bc-48c7-b5fa-7fdce019cf64 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:27.031613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea39ac-c4be-4f32-909d-9293f5cbbaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:27.033471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea39ac-c4be-4f32-909d-9293f5cbbaae admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:27.033831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea39ac-c4be-4f32-909d-9293f5cbbaae admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:27.034793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbea39ac-c4be-4f32-909d-9293f5cbbaae admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:27.037764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea39ac-c4be-4f32-909d-9293f5cbbaae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:27.042871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbea39ac-c4be-4f32-909d-9293f5cbbaae admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:27.097634 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3814/7630] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:27:26 2022] POST /identity/v3/users => generated 293 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:27.101359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164424b-c730-4f18-9025-42815d3e63c6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:27.128919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3164424b-c730-4f18-9025-42815d3e63c6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:27.147872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbd56-731b-4a3e-9e78-6759c08fa0ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:27.154198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbd56-731b-4a3e-9e78-6759c08fa0ae admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:27.155754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbd56-731b-4a3e-9e78-6759c08fa0ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:27.156872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbbd56-731b-4a3e-9e78-6759c08fa0ae admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:27.159461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbbd56-731b-4a3e-9e78-6759c08fa0ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:27.163052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbbbd56-731b-4a3e-9e78-6759c08fa0ae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:27.204450 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3817/7631] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:27.208534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea39ac-c4be-4f32-909d-9293f5cbbaae admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:27.227018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbea39ac-c4be-4f32-909d-9293f5cbbaae admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:27.247309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3984e87-c19e-4899-9960-c7660996382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:27.247680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3984e87-c19e-4899-9960-c7660996382a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:27.248046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3984e87-c19e-4899-9960-c7660996382a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:27.248236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3984e87-c19e-4899-9960-c7660996382a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:27.248957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3984e87-c19e-4899-9960-c7660996382a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:27.250511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3984e87-c19e-4899-9960-c7660996382a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:27.283632 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3815/7632] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:27.284838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbd56-731b-4a3e-9e78-6759c08fa0ae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:27.302354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbbd56-731b-4a3e-9e78-6759c08fa0ae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:27.315092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d400f1-66fa-49b6-ac9d-c0c1c3883163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:27.316028 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d400f1-66fa-49b6-ac9d-c0c1c3883163 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:27.316501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d400f1-66fa-49b6-ac9d-c0c1c3883163 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:27.316796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d400f1-66fa-49b6-ac9d-c0c1c3883163 admin admin] PATH_INFO: `/v3/projects/852afe431a4d44f5ab9b9e3f392e6bcb/users/9e13e99508d44d49b962cedc431fe21b/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:27.326126 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:27.360418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d400f1-66fa-49b6-ac9d-c0c1c3883163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=852afe431a4d44f5ab9b9e3f392e6bcb, user_id=9e13e99508d44d49b962cedc431fe21b, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:27.363180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d400f1-66fa-49b6-ac9d-c0c1c3883163 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:27.401379 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3818/7633] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:27:27 2022] PUT /identity/v3/projects/852afe431a4d44f5ab9b9e3f392e6bcb/users/9e13e99508d44d49b962cedc431fe21b/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:27.410726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de536a3c-66fb-4ff5-8db2-b2c33523cd9f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:27.411017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de536a3c-66fb-4ff5-8db2-b2c33523cd9f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:27.411586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de536a3c-66fb-4ff5-8db2-b2c33523cd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:27.477121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-de536a3c-66fb-4ff5-8db2-b2c33523cd9f None None] MFA Rules not processed for user `9e13e99508d44d49b962cedc431fe21b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:27.483894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-de536a3c-66fb-4ff5-8db2-b2c33523cd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:27.706637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d400f1-66fa-49b6-ac9d-c0c1c3883163 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:27.706823 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3816/7634] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:27.912200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d400f1-66fa-49b6-ac9d-c0c1c3883163 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:27.937709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caedac5-5333-459b-928f-d8a4a5b36937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:27.938349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caedac5-5333-459b-928f-d8a4a5b36937 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:27.938636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caedac5-5333-459b-928f-d8a4a5b36937 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:27.956407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caedac5-5333-459b-928f-d8a4a5b36937 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:27.957195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caedac5-5333-459b-928f-d8a4a5b36937 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:27.959150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caedac5-5333-459b-928f-d8a4a5b36937 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:28.121516 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3819/7635] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:27:27 2022] POST /identity/v3/projects => generated 383 bytes in 415 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:27:28.126004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de536a3c-66fb-4ff5-8db2-b2c33523cd9f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:28.143164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de536a3c-66fb-4ff5-8db2-b2c33523cd9f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:28.162280 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:28.250301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82c495-48bc-4e91-862b-450f54ac3d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:28.251840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82c495-48bc-4e91-862b-450f54ac3d51 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:28.252277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82c495-48bc-4e91-862b-450f54ac3d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:28.252705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c82c495-48bc-4e91-862b-450f54ac3d51 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:28.253794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82c495-48bc-4e91-862b-450f54ac3d51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:28.258278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c82c495-48bc-4e91-862b-450f54ac3d51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:28.305086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caedac5-5333-459b-928f-d8a4a5b36937 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:28.318657 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3817/7636] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:27:28 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:28.320329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caedac5-5333-459b-928f-d8a4a5b36937 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:28.328291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36adc3d-6854-4874-9b35-b66cf4885ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:28.329197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36adc3d-6854-4874-9b35-b66cf4885ea0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:28.362641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36adc3d-6854-4874-9b35-b66cf4885ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:28.366416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36adc3d-6854-4874-9b35-b66cf4885ea0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:28.371075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36adc3d-6854-4874-9b35-b66cf4885ea0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:28.380264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36adc3d-6854-4874-9b35-b66cf4885ea0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:28.445853 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3820/7637] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:28.447960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82c495-48bc-4e91-862b-450f54ac3d51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:28.470985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c82c495-48bc-4e91-862b-450f54ac3d51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:28.481207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc80da4-9d78-4391-96c4-f0f9e31a919d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:28.481880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc80da4-9d78-4391-96c4-f0f9e31a919d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:28.482166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc80da4-9d78-4391-96c4-f0f9e31a919d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:28.482444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc80da4-9d78-4391-96c4-f0f9e31a919d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:28.483106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc80da4-9d78-4391-96c4-f0f9e31a919d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:28.484745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc80da4-9d78-4391-96c4-f0f9e31a919d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:28.504625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36adc3d-6854-4874-9b35-b66cf4885ea0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:28.518986 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3818/7638] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:28.519870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36adc3d-6854-4874-9b35-b66cf4885ea0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:28.525991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d0a44-daf5-4a72-8d1d-7581c6c23eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:28.526875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d0a44-daf5-4a72-8d1d-7581c6c23eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:28.527026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d0a44-daf5-4a72-8d1d-7581c6c23eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:28.527401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15d0a44-daf5-4a72-8d1d-7581c6c23eb3 admin admin] PATH_INFO: `/v3/projects/e95bbda7d1774cd68410e049f7fbd3dd/users/d5a115720bf4421f995b5ec5aca16cf1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:28.551304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d0a44-daf5-4a72-8d1d-7581c6c23eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e95bbda7d1774cd68410e049f7fbd3dd, user_id=d5a115720bf4421f995b5ec5aca16cf1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:28.555074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15d0a44-daf5-4a72-8d1d-7581c6c23eb3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:28.583374 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3821/7639] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:27:28 2022] PUT /identity/v3/projects/e95bbda7d1774cd68410e049f7fbd3dd/users/d5a115720bf4421f995b5ec5aca16cf1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:28.598128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4234e2-2c17-4ac3-9ee2-5b067cffea84 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:28.598421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4234e2-2c17-4ac3-9ee2-5b067cffea84 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:28.599073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4234e2-2c17-4ac3-9ee2-5b067cffea84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:28.672834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0c4234e2-2c17-4ac3-9ee2-5b067cffea84 None None] MFA Rules not processed for user `d5a115720bf4421f995b5ec5aca16cf1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:28.675397 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0c4234e2-2c17-4ac3-9ee2-5b067cffea84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:28.770700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d0a44-daf5-4a72-8d1d-7581c6c23eb3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:28.780435 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3819/7640] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:28.860766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15d0a44-daf5-4a72-8d1d-7581c6c23eb3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:28.878353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a079779-ac8b-45c7-819c-9ef1d5c1efb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:28.878988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a079779-ac8b-45c7-819c-9ef1d5c1efb8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:28.879288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a079779-ac8b-45c7-819c-9ef1d5c1efb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:28.879544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a079779-ac8b-45c7-819c-9ef1d5c1efb8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:28.881227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a079779-ac8b-45c7-819c-9ef1d5c1efb8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:28.883540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a079779-ac8b-45c7-819c-9ef1d5c1efb8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:28.941440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4234e2-2c17-4ac3-9ee2-5b067cffea84 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:28.943541 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3822/7641] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:27:28 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:27:28.963098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4199e38-ac29-4bd2-bfb8-5bf41462d1db None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:28.964001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4199e38-ac29-4bd2-bfb8-5bf41462d1db None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:28.969684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4199e38-ac29-4bd2-bfb8-5bf41462d1db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:28.984356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4234e2-2c17-4ac3-9ee2-5b067cffea84 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:29.083180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a4199e38-ac29-4bd2-bfb8-5bf41462d1db None None] MFA Rules not processed for user `e2fc124049504d579f6513b5cac00bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:29.084800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a4199e38-ac29-4bd2-bfb8-5bf41462d1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:29.108961 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:29.152733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67a688-84a1-42a7-9995-41ba026fcc8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:29.153614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67a688-84a1-42a7-9995-41ba026fcc8c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:29.154163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67a688-84a1-42a7-9995-41ba026fcc8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:29.154622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb67a688-84a1-42a7-9995-41ba026fcc8c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:29.155492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67a688-84a1-42a7-9995-41ba026fcc8c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:29.157872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb67a688-84a1-42a7-9995-41ba026fcc8c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:29.193397 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3823/7642] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:27:29.208223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4199e38-ac29-4bd2-bfb8-5bf41462d1db None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:29.209869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a4199e38-ac29-4bd2-bfb8-5bf41462d1db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:29.215412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3820/7643] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:27:28 2022] POST /identity/v3/users => generated 298 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:27:29.216946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67a688-84a1-42a7-9995-41ba026fcc8c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:29.238920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb67a688-84a1-42a7-9995-41ba026fcc8c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:29.252524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccf724-d5e8-48c7-a44b-cc160dab3fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:29.253157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccf724-d5e8-48c7-a44b-cc160dab3fa6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:29.262159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccf724-d5e8-48c7-a44b-cc160dab3fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:29.262505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ccf724-d5e8-48c7-a44b-cc160dab3fa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:29.263208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccf724-d5e8-48c7-a44b-cc160dab3fa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:29.264859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ccf724-d5e8-48c7-a44b-cc160dab3fa6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:29.287465 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3821/7644] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:27:29.292800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccf724-d5e8-48c7-a44b-cc160dab3fa6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:29.303272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4199e38-ac29-4bd2-bfb8-5bf41462d1db None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:29.306253 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:29.312718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc000b-97c9-4e9f-87b5-97cc49affdc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:29.313791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc000b-97c9-4e9f-87b5-97cc49affdc3 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:29.314652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc000b-97c9-4e9f-87b5-97cc49affdc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:29.315172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc000b-97c9-4e9f-87b5-97cc49affdc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:29.320007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ccf724-d5e8-48c7-a44b-cc160dab3fa6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:29.327992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc000b-97c9-4e9f-87b5-97cc49affdc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:29.330362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4dc000b-97c9-4e9f-87b5-97cc49affdc3 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:29.335647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59947398-e9c2-4ec7-b4cd-f91e687538a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:29.336348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59947398-e9c2-4ec7-b4cd-f91e687538a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:29.336804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59947398-e9c2-4ec7-b4cd-f91e687538a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:29.337272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59947398-e9c2-4ec7-b4cd-f91e687538a2 admin admin] PATH_INFO: `/v3/projects/daa79efa50bb4cd592524025c415826f/users/23fca8e463264505bcaebcac2e4c9dde/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:29.352136 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3824/7645] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:27:29.376664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59947398-e9c2-4ec7-b4cd-f91e687538a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa79efa50bb4cd592524025c415826f, user_id=23fca8e463264505bcaebcac2e4c9dde, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:29.380269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59947398-e9c2-4ec7-b4cd-f91e687538a2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:29.402682 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3822/7646] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:27:29 2022] PUT /identity/v3/projects/daa79efa50bb4cd592524025c415826f/users/23fca8e463264505bcaebcac2e4c9dde/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:29.406483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc000b-97c9-4e9f-87b5-97cc49affdc3 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:29.433846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc000b-97c9-4e9f-87b5-97cc49affdc3 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:29.567324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67bb5003-4798-4984-b207-06270f397512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:29.567963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb5003-4798-4984-b207-06270f397512 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:29.568241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb5003-4798-4984-b207-06270f397512 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:29.568582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67bb5003-4798-4984-b207-06270f397512 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:29.569150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb5003-4798-4984-b207-06270f397512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:29.570856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67bb5003-4798-4984-b207-06270f397512 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:29.600776 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3825/7647] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:27:29.602081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59947398-e9c2-4ec7-b4cd-f91e687538a2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:29.620962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59947398-e9c2-4ec7-b4cd-f91e687538a2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:29.635384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02169d29-120a-49b8-be3a-b173805fd45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:29.638384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02169d29-120a-49b8-be3a-b173805fd45b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:29.642262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02169d29-120a-49b8-be3a-b173805fd45b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:29.642660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02169d29-120a-49b8-be3a-b173805fd45b admin admin] PATH_INFO: `/v3/projects/daa79efa50bb4cd592524025c415826f/users/23fca8e463264505bcaebcac2e4c9dde/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:29.645137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02169d29-120a-49b8-be3a-b173805fd45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=daa79efa50bb4cd592524025c415826f, user_id=23fca8e463264505bcaebcac2e4c9dde, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:29.652731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02169d29-120a-49b8-be3a-b173805fd45b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:29.702943 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3823/7648] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:27:29 2022] PUT /identity/v3/projects/daa79efa50bb4cd592524025c415826f/users/23fca8e463264505bcaebcac2e4c9dde/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:29.714833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fc230-792d-47df-a156-6c14ca396973 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:29.715272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fc230-792d-47df-a156-6c14ca396973 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:29.715484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410fc230-792d-47df-a156-6c14ca396973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:29.808882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-410fc230-792d-47df-a156-6c14ca396973 None None] MFA Rules not processed for user `23fca8e463264505bcaebcac2e4c9dde`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:29.810188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-410fc230-792d-47df-a156-6c14ca396973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:29.950089 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:30.047292 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3826/7649] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:29 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:30.063891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02169d29-120a-49b8-be3a-b173805fd45b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:30.179917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02169d29-120a-49b8-be3a-b173805fd45b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:30.190483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5a176-5a73-4962-a05b-fa3e7eca52ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:30.191127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a176-5a73-4962-a05b-fa3e7eca52ca service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:30.191771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a176-5a73-4962-a05b-fa3e7eca52ca service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:30.192209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5a176-5a73-4962-a05b-fa3e7eca52ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:30.333714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5a176-5a73-4962-a05b-fa3e7eca52ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:30.335417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5a176-5a73-4962-a05b-fa3e7eca52ca service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:30.381203 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3824/7650] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:30 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:31.351607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fc230-792d-47df-a156-6c14ca396973 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:31.353182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-410fc230-792d-47df-a156-6c14ca396973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:31.498631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410fc230-792d-47df-a156-6c14ca396973 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:31.526151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:31.527218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:31.527506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:31.527777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] PATH_INFO: `/v3/users/e1fd438c83414de8b742cfc444739fd8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:31.529311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1fd438c83414de8b742cfc444739fd8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:31.531282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:31.612480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1fd438c83414de8b742cfc444739fd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:31.630450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1fd438c83414de8b742cfc444739fd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:31.631860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1fd438c83414de8b742cfc444739fd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:31.645804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1fd438c83414de8b742cfc444739fd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:31.658101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1fd438c83414de8b742cfc444739fd8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:31.676193 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3827/7651] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:31 2022] DELETE /identity/v3/users/e1fd438c83414de8b742cfc444739fd8 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:32.062748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5a176-5a73-4962-a05b-fa3e7eca52ca service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:32.082538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5a176-5a73-4962-a05b-fa3e7eca52ca service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:32.260216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:32.261197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:32.261665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:32.262096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] PATH_INFO: `/v3/projects/49837016a43847f0b145aa177b5bc08d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:32.263529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=49837016a43847f0b145aa177b5bc08d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:32.265709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:32.345571 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:32.448439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49837016a43847f0b145aa177b5bc08d', 'request_id': 'req-7c2864cf-70cb-41c0-a650-a34ed16284bf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:32.488206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49837016a43847f0b145aa177b5bc08d', 'request_id': 'req-7c2864cf-70cb-41c0-a650-a34ed16284bf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:32.506265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49837016a43847f0b145aa177b5bc08d', 'request_id': 'req-7c2864cf-70cb-41c0-a650-a34ed16284bf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:32.543459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] The token cache is being invalidate because project 49837016a43847f0b145aa177b5bc08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:32.543999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:32.547171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:32.550006 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3825/7652] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:32 2022] DELETE /identity/v3/projects/49837016a43847f0b145aa177b5bc08d => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:32.554713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:32.557469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:32.608496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f976535-b898-4ef1-8e79-2f3598980494 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:32.765581 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:32.787180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:32.788090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:32.789591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:32.790090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] PATH_INFO: `/v3/users/2f12eb63d7194738b3272197d4894871` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:32.836972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f12eb63d7194738b3272197d4894871)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:32.846430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:32.961795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f12eb63d7194738b3272197d4894871'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:32.985644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f12eb63d7194738b3272197d4894871'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:32.988108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f12eb63d7194738b3272197d4894871'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:33.006206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f12eb63d7194738b3272197d4894871'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:33.021369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f12eb63d7194738b3272197d4894871'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:33.037365 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3828/7653] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:32 2022] DELETE /identity/v3/users/2f12eb63d7194738b3272197d4894871 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:33.401421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:33.403893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:33.434698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2864cf-70cb-41c0-a650-a34ed16284bf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:33.507257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:33.508171 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:33.508543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:33.509008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] PATH_INFO: `/v3/projects/9f3b4ec019854618be7a2b1ff515bff6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:33.546054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f3b4ec019854618be7a2b1ff515bff6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:33.550923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:33.616606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:33.618176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:33.701471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927650f3-31d2-479e-b5d5-412bb05f893d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:33.722532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f3b4ec019854618be7a2b1ff515bff6', 'request_id': 'req-b59eb4f7-711b-4951-8f12-00078acf8d70'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:33.739719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f3b4ec019854618be7a2b1ff515bff6', 'request_id': 'req-b59eb4f7-711b-4951-8f12-00078acf8d70'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:33.751119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f3b4ec019854618be7a2b1ff515bff6', 'request_id': 'req-b59eb4f7-711b-4951-8f12-00078acf8d70'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:33.784332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] The token cache is being invalidate because project 9f3b4ec019854618be7a2b1ff515bff6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:33.784693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:33.785325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b59eb4f7-711b-4951-8f12-00078acf8d70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:33.787272 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3826/7654] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:33 2022] DELETE /identity/v3/projects/9f3b4ec019854618be7a2b1ff515bff6 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:33.792262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e14b23-e7da-4dda-877f-76ad3b37aa86 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:33.792433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e14b23-e7da-4dda-877f-76ad3b37aa86 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:33.792705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e14b23-e7da-4dda-877f-76ad3b37aa86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:33.850152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a6aa71-d2d7-4ca5-8f82-261a0cd78cab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:33.851161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6aa71-d2d7-4ca5-8f82-261a0cd78cab service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:33.851646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6aa71-d2d7-4ca5-8f82-261a0cd78cab service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:33.852139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a6aa71-d2d7-4ca5-8f82-261a0cd78cab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:33.852405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a3e14b23-e7da-4dda-877f-76ad3b37aa86 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:33.857649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a3e14b23-e7da-4dda-877f-76ad3b37aa86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:33.858350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50a6aa71-d2d7-4ca5-8f82-261a0cd78cab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:33.936085 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:33.955233 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:34.023114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6aa71-d2d7-4ca5-8f82-261a0cd78cab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:34.025668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a6aa71-d2d7-4ca5-8f82-261a0cd78cab service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:34.038530 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3829/7655] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:34.050965 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3827/7656] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:34.060243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1972-44d0-43c2-9975-6fa5f41fc86f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:34.060973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1972-44d0-43c2-9975-6fa5f41fc86f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:34.061695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2b1972-44d0-43c2-9975-6fa5f41fc86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:34.109415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cc2b1972-44d0-43c2-9975-6fa5f41fc86f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:34.111288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cc2b1972-44d0-43c2-9975-6fa5f41fc86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:34.136144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3830/7657] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:34.147148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e14b23-e7da-4dda-877f-76ad3b37aa86 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:34.176483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e14b23-e7da-4dda-877f-76ad3b37aa86 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:34.184752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a763f1-eacb-4c8c-a3ed-15036c26b5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:34.185785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a763f1-eacb-4c8c-a3ed-15036c26b5dc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:34.186463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a763f1-eacb-4c8c-a3ed-15036c26b5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:34.186941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a763f1-eacb-4c8c-a3ed-15036c26b5dc admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:34.191001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a763f1-eacb-4c8c-a3ed-15036c26b5dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:27:34.191542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a763f1-eacb-4c8c-a3ed-15036c26b5dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:34.195464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a763f1-eacb-4c8c-a3ed-15036c26b5dc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:34.226178 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3828/7658] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:27:34.230815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1972-44d0-43c2-9975-6fa5f41fc86f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:34.245464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2b1972-44d0-43c2-9975-6fa5f41fc86f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:34.275253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848ae4-04f9-455d-a291-5054a6c332ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:34.275815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848ae4-04f9-455d-a291-5054a6c332ef admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:34.276098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848ae4-04f9-455d-a291-5054a6c332ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:34.276371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94848ae4-04f9-455d-a291-5054a6c332ef admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:34.277023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94848ae4-04f9-455d-a291-5054a6c332ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:34.279018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94848ae4-04f9-455d-a291-5054a6c332ef admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:34.373042 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3831/7659] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:27:34 2022] POST /identity/v3/projects => generated 397 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:34.373522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a763f1-eacb-4c8c-a3ed-15036c26b5dc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:34.397925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a763f1-eacb-4c8c-a3ed-15036c26b5dc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:34.586698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c07a-5802-4767-9930-2ca0d8ded63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:34.587381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c07a-5802-4767-9930-2ca0d8ded63d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:34.587642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c07a-5802-4767-9930-2ca0d8ded63d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:34.587889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a84c07a-5802-4767-9930-2ca0d8ded63d admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:34.588596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84c07a-5802-4767-9930-2ca0d8ded63d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:34.591660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a84c07a-5802-4767-9930-2ca0d8ded63d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:34.633767 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3829/7660] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:27:34 2022] POST /identity/v3/users => generated 299 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:34.637581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848ae4-04f9-455d-a291-5054a6c332ef admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:34.660748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94848ae4-04f9-455d-a291-5054a6c332ef admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:34.671133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841a22d-5ce9-4160-bd8e-53d2489532fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:34.677612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841a22d-5ce9-4160-bd8e-53d2489532fd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:34.679874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841a22d-5ce9-4160-bd8e-53d2489532fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:34.680528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7841a22d-5ce9-4160-bd8e-53d2489532fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:34.683045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841a22d-5ce9-4160-bd8e-53d2489532fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:34.685680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7841a22d-5ce9-4160-bd8e-53d2489532fd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:34.718498 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3832/7661] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:34.723084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c07a-5802-4767-9930-2ca0d8ded63d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:34.740103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a84c07a-5802-4767-9930-2ca0d8ded63d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:34.760370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214d2eb-3a17-4683-82e4-fa3f3032fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:34.760780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d2eb-3a17-4683-82e4-fa3f3032fabd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:34.761015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d2eb-3a17-4683-82e4-fa3f3032fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:34.761288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214d2eb-3a17-4683-82e4-fa3f3032fabd admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:34.762917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d2eb-3a17-4683-82e4-fa3f3032fabd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:34.763560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214d2eb-3a17-4683-82e4-fa3f3032fabd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:34.800893 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3830/7662] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:34 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:34.805273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841a22d-5ce9-4160-bd8e-53d2489532fd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:34.819752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7841a22d-5ce9-4160-bd8e-53d2489532fd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:34.830952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3fb844-4465-4a42-a081-ca51987fd2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:34.832241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb844-4465-4a42-a081-ca51987fd2e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:34.832241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb844-4465-4a42-a081-ca51987fd2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:34.832241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fb844-4465-4a42-a081-ca51987fd2e3 admin admin] PATH_INFO: `/v3/projects/5fc73d09f98c45aaae7504eda24392e0/users/7eca02d78b1c406098b67617d072ee0c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:34.865693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb844-4465-4a42-a081-ca51987fd2e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fc73d09f98c45aaae7504eda24392e0, user_id=7eca02d78b1c406098b67617d072ee0c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:34.868499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3fb844-4465-4a42-a081-ca51987fd2e3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:34.902649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3833/7663] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:27:34 2022] PUT /identity/v3/projects/5fc73d09f98c45aaae7504eda24392e0/users/7eca02d78b1c406098b67617d072ee0c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:34.915853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb28a6-87f6-45fa-8c68-9d1377426cc2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:34.916257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb28a6-87f6-45fa-8c68-9d1377426cc2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:34.917048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abb28a6-87f6-45fa-8c68-9d1377426cc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:34.971329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4abb28a6-87f6-45fa-8c68-9d1377426cc2 None None] MFA Rules not processed for user `7eca02d78b1c406098b67617d072ee0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:34.972544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4abb28a6-87f6-45fa-8c68-9d1377426cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:35.153003 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3831/7664] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:34 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:35.162222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e8aeb-ce4c-4bbf-9836-a8c80fbdb007 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:35.162790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e8aeb-ce4c-4bbf-9836-a8c80fbdb007 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:35.163389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6e8aeb-ce4c-4bbf-9836-a8c80fbdb007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:35.170325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb28a6-87f6-45fa-8c68-9d1377426cc2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:35.172921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4abb28a6-87f6-45fa-8c68-9d1377426cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:35.202364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8f6e8aeb-ce4c-4bbf-9836-a8c80fbdb007 None None] MFA Rules not processed for user `7eca02d78b1c406098b67617d072ee0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:35.203978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f6e8aeb-ce4c-4bbf-9836-a8c80fbdb007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:35.209710 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:35.238708 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3834/7665] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:35.239687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e8aeb-ce4c-4bbf-9836-a8c80fbdb007 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:35.244240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f6e8aeb-ce4c-4bbf-9836-a8c80fbdb007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:35.288517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abb28a6-87f6-45fa-8c68-9d1377426cc2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:35.295099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a14bc2-78e1-4d3a-be63-394f04fbc1ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:35.295448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a14bc2-78e1-4d3a-be63-394f04fbc1ee service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:35.295731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a14bc2-78e1-4d3a-be63-394f04fbc1ee service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:35.296011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a14bc2-78e1-4d3a-be63-394f04fbc1ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:35.305200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-02a14bc2-78e1-4d3a-be63-394f04fbc1ee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:35.458293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6e8aeb-ce4c-4bbf-9836-a8c80fbdb007 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:35.466515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365b5b95-6914-415a-8fcd-f9b63dcf0242 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:35.466714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b5b95-6914-415a-8fcd-f9b63dcf0242 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:35.466970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b5b95-6914-415a-8fcd-f9b63dcf0242 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:35.467246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365b5b95-6914-415a-8fcd-f9b63dcf0242 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:35.505145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a14bc2-78e1-4d3a-be63-394f04fbc1ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:35.507636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b5b95-6914-415a-8fcd-f9b63dcf0242 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:35.512970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a14bc2-78e1-4d3a-be63-394f04fbc1ee service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:35.515002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365b5b95-6914-415a-8fcd-f9b63dcf0242 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:35.549223 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3835/7666] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:35 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:35.563483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3832/7667] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:35 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:35.577841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64725c8-8fc1-4481-8c1d-056b07b3d67e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:35.578170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64725c8-8fc1-4481-8c1d-056b07b3d67e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:35.579994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d64725c8-8fc1-4481-8c1d-056b07b3d67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:35.629750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d64725c8-8fc1-4481-8c1d-056b07b3d67e None None] MFA Rules not processed for user `7eca02d78b1c406098b67617d072ee0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:35.631312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d64725c8-8fc1-4481-8c1d-056b07b3d67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:35.642401 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3836/7668] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:35.681868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d5ff-8922-4deb-8565-703504b3662b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:35.682338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d5ff-8922-4deb-8565-703504b3662b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:35.682594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf6d5ff-8922-4deb-8565-703504b3662b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:35.730791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cdf6d5ff-8922-4deb-8565-703504b3662b None None] MFA Rules not processed for user `7eca02d78b1c406098b67617d072ee0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:35.733911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cdf6d5ff-8922-4deb-8565-703504b3662b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:35.752596 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3833/7669] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:35.801068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e404c8-b202-4dc5-b4b8-53cddccccca6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:35.801193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e404c8-b202-4dc5-b4b8-53cddccccca6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:35.801501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e404c8-b202-4dc5-b4b8-53cddccccca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:35.841768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-07e404c8-b202-4dc5-b4b8-53cddccccca6 None None] MFA Rules not processed for user `7eca02d78b1c406098b67617d072ee0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:35.844523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-07e404c8-b202-4dc5-b4b8-53cddccccca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:35.858416 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3837/7670] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:35.899907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cbce8-a1d6-483b-8b2b-f7d087c0faa0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:35.899907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cbce8-a1d6-483b-8b2b-f7d087c0faa0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:35.899907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cbce8-a1d6-483b-8b2b-f7d087c0faa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:35.933009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-960cbce8-a1d6-483b-8b2b-f7d087c0faa0 None None] MFA Rules not processed for user `7eca02d78b1c406098b67617d072ee0c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:35.936296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-960cbce8-a1d6-483b-8b2b-f7d087c0faa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:35.966357 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3834/7671] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:35 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:36.024247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e404c8-b202-4dc5-b4b8-53cddccccca6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:36.151549 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:36.234741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e404c8-b202-4dc5-b4b8-53cddccccca6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:36.252242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:36.252904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:36.253185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:36.253487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] PATH_INFO: `/v3/users/7eca02d78b1c406098b67617d072ee0c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:36.261926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eca02d78b1c406098b67617d072ee0c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:36.266356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:36.385608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eca02d78b1c406098b67617d072ee0c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:36.415381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eca02d78b1c406098b67617d072ee0c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:36.425553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eca02d78b1c406098b67617d072ee0c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:36.445228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eca02d78b1c406098b67617d072ee0c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:36.466266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eca02d78b1c406098b67617d072ee0c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:36.533201 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3838/7672] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:36 2022] DELETE /identity/v3/users/7eca02d78b1c406098b67617d072ee0c => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:36.536265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75185b84-7cb6-42a1-b015-871cae47883c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:36.536585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75185b84-7cb6-42a1-b015-871cae47883c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:36.536875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75185b84-7cb6-42a1-b015-871cae47883c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:36.600131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-75185b84-7cb6-42a1-b015-871cae47883c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:36.600754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75185b84-7cb6-42a1-b015-871cae47883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:36.808201 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3835/7673] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:36.820377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:36.823983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:37.019818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbafad68-16f3-4c94-8e7e-0914f5092a1b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:37.033703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dc70a5-2fe0-4e31-92c2-39398631701c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:37.034336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc70a5-2fe0-4e31-92c2-39398631701c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:37.034619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc70a5-2fe0-4e31-92c2-39398631701c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:37.034889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc70a5-2fe0-4e31-92c2-39398631701c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:37.083304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc70a5-2fe0-4e31-92c2-39398631701c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:37.112470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dc70a5-2fe0-4e31-92c2-39398631701c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:37.157916 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3839/7674] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:37.930786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75185b84-7cb6-42a1-b015-871cae47883c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:37.936904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75185b84-7cb6-42a1-b015-871cae47883c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:37.985738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75185b84-7cb6-42a1-b015-871cae47883c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:38.022104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:38.022983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:38.025869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:38.026345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] PATH_INFO: `/v3/projects/5fc73d09f98c45aaae7504eda24392e0` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:38.028415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fc73d09f98c45aaae7504eda24392e0)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:38.033138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:38.213823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fc73d09f98c45aaae7504eda24392e0', 'request_id': 'req-7d985e5d-6e4d-4803-b474-4c681e300794'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:38.244278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fc73d09f98c45aaae7504eda24392e0', 'request_id': 'req-7d985e5d-6e4d-4803-b474-4c681e300794'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:38.249544 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:38.259125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fc73d09f98c45aaae7504eda24392e0', 'request_id': 'req-7d985e5d-6e4d-4803-b474-4c681e300794'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:38.284607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] The token cache is being invalidate because project 5fc73d09f98c45aaae7504eda24392e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:38.285783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:38.286106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7d985e5d-6e4d-4803-b474-4c681e300794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:38.293926 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3836/7675] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:37 2022] DELETE /identity/v3/projects/5fc73d09f98c45aaae7504eda24392e0 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:38.295934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c04e0-6fa4-42f2-a352-9d767a5a207d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:38.296429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c04e0-6fa4-42f2-a352-9d767a5a207d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:38.296532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881c04e0-6fa4-42f2-a352-9d767a5a207d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:38.335083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-881c04e0-6fa4-42f2-a352-9d767a5a207d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:38.336427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-881c04e0-6fa4-42f2-a352-9d767a5a207d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:38.657690 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:38.691570 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3840/7676] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:38.700930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc2aa-9f54-43cc-a5c1-24ffa5e74e47 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:38.701148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc2aa-9f54-43cc-a5c1-24ffa5e74e47 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:38.701499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7bc2aa-9f54-43cc-a5c1-24ffa5e74e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:38.748063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2c7bc2aa-9f54-43cc-a5c1-24ffa5e74e47 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:38.749522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2c7bc2aa-9f54-43cc-a5c1-24ffa5e74e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:38.782210 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3837/7677] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:38.787258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c04e0-6fa4-42f2-a352-9d767a5a207d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:38.800026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881c04e0-6fa4-42f2-a352-9d767a5a207d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:38.828590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c028f-6a02-40ae-83a0-8c4c77db0f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:38.829322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c028f-6a02-40ae-83a0-8c4c77db0f99 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:38.829639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c028f-6a02-40ae-83a0-8c4c77db0f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:38.829918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228c028f-6a02-40ae-83a0-8c4c77db0f99 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:38.830616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c028f-6a02-40ae-83a0-8c4c77db0f99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:27:38.830898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c028f-6a02-40ae-83a0-8c4c77db0f99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:38.832565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228c028f-6a02-40ae-83a0-8c4c77db0f99 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:38.900805 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3841/7678] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:27:38.906126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bc2aa-9f54-43cc-a5c1-24ffa5e74e47 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:38.919273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7bc2aa-9f54-43cc-a5c1-24ffa5e74e47 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:38.942202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c87d0-b0a8-4ac1-824d-199c4e58e17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:38.943722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c87d0-b0a8-4ac1-824d-199c4e58e17d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:38.944158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c87d0-b0a8-4ac1-824d-199c4e58e17d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:38.944616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5c87d0-b0a8-4ac1-824d-199c4e58e17d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:38.945446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c87d0-b0a8-4ac1-824d-199c4e58e17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:38.947919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5c87d0-b0a8-4ac1-824d-199c4e58e17d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:39.108708 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3838/7679] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:27:38 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:27:39.113511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c028f-6a02-40ae-83a0-8c4c77db0f99 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:39.148428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228c028f-6a02-40ae-83a0-8c4c77db0f99 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:39.411097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a7396-8e41-4381-95f0-d6bc2f5b78be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:39.412167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a7396-8e41-4381-95f0-d6bc2f5b78be admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:39.413533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a7396-8e41-4381-95f0-d6bc2f5b78be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:39.415503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a7396-8e41-4381-95f0-d6bc2f5b78be admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:39.417465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a7396-8e41-4381-95f0-d6bc2f5b78be admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:39.422881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a7396-8e41-4381-95f0-d6bc2f5b78be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:39.494230 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3842/7680] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:27:39 2022] POST /identity/v3/users => generated 290 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:27:39.495455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c87d0-b0a8-4ac1-824d-199c4e58e17d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:39.530122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5c87d0-b0a8-4ac1-824d-199c4e58e17d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:39.547485 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aaf0b-7576-48b8-b79f-c3c3c6a8afa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:39.548730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aaf0b-7576-48b8-b79f-c3c3c6a8afa6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:39.551040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aaf0b-7576-48b8-b79f-c3c3c6a8afa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:39.552048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474aaf0b-7576-48b8-b79f-c3c3c6a8afa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:39.554685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474aaf0b-7576-48b8-b79f-c3c3c6a8afa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:39.560117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474aaf0b-7576-48b8-b79f-c3c3c6a8afa6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:39.597361 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3839/7681] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:39.599711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a7396-8e41-4381-95f0-d6bc2f5b78be admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:39.633581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a7396-8e41-4381-95f0-d6bc2f5b78be admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:39.660108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bcbe0d-a7b3-4f6c-ab81-8af8391daa06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:39.661141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcbe0d-a7b3-4f6c-ab81-8af8391daa06 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:39.661141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcbe0d-a7b3-4f6c-ab81-8af8391daa06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:39.662242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bcbe0d-a7b3-4f6c-ab81-8af8391daa06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:39.663332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcbe0d-a7b3-4f6c-ab81-8af8391daa06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:39.664965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bcbe0d-a7b3-4f6c-ab81-8af8391daa06 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:39.705605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aaf0b-7576-48b8-b79f-c3c3c6a8afa6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:39.710997 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3843/7682] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:27:39.733815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474aaf0b-7576-48b8-b79f-c3c3c6a8afa6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:39.755001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d9e8f-0cd4-4a6a-9646-83c737175913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:39.757741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d9e8f-0cd4-4a6a-9646-83c737175913 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:39.761548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d9e8f-0cd4-4a6a-9646-83c737175913 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:39.762072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d9e8f-0cd4-4a6a-9646-83c737175913 admin admin] PATH_INFO: `/v3/projects/db7dde4daed04adab9bcfc786c9ac13a/users/070aabe58ef941449e499ba6eccf5c48/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:39.825486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d9e8f-0cd4-4a6a-9646-83c737175913 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db7dde4daed04adab9bcfc786c9ac13a, user_id=070aabe58ef941449e499ba6eccf5c48, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:39.837280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d9e8f-0cd4-4a6a-9646-83c737175913 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:39.909466 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3840/7683] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:27:39 2022] PUT /identity/v3/projects/db7dde4daed04adab9bcfc786c9ac13a/users/070aabe58ef941449e499ba6eccf5c48/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:27:39.914398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20430785-844c-4ab1-baa9-a8e91ae582ae None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:39.914956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20430785-844c-4ab1-baa9-a8e91ae582ae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:39.915318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20430785-844c-4ab1-baa9-a8e91ae582ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:39.976743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-20430785-844c-4ab1-baa9-a8e91ae582ae None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:39.978286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20430785-844c-4ab1-baa9-a8e91ae582ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:40.239594 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3844/7684] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:40.250953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d9e8f-0cd4-4a6a-9646-83c737175913 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:40.254002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ce3d9e8f-0cd4-4a6a-9646-83c737175913 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:40.438513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d9e8f-0cd4-4a6a-9646-83c737175913 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:40.441808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8232cc8-0205-44cb-81cf-495307aedab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:40.442508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232cc8-0205-44cb-81cf-495307aedab4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:40.443061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232cc8-0205-44cb-81cf-495307aedab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:40.443493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8232cc8-0205-44cb-81cf-495307aedab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:40.480316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8232cc8-0205-44cb-81cf-495307aedab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:40.482467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8232cc8-0205-44cb-81cf-495307aedab4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:40.519923 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3841/7685] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:49.980345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20430785-844c-4ab1-baa9-a8e91ae582ae None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:49.981813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-20430785-844c-4ab1-baa9-a8e91ae582ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:50.001090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20430785-844c-4ab1-baa9-a8e91ae582ae None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:50.024339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:50.025065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:50.025380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:50.027075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] PATH_INFO: `/v3/users/9e13e99508d44d49b962cedc431fe21b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:50.028299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e13e99508d44d49b962cedc431fe21b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:50.030275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:50.266867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e13e99508d44d49b962cedc431fe21b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:50.302559 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:50.330488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e13e99508d44d49b962cedc431fe21b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:50.332824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e13e99508d44d49b962cedc431fe21b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:50.377489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e13e99508d44d49b962cedc431fe21b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:50.491579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e13e99508d44d49b962cedc431fe21b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:50.498233 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=57,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:50.554951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a96e-cca5-4817-89e3-15cc7fe646b0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:50.555548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a96e-cca5-4817-89e3-15cc7fe646b0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:50.556115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9a96e-cca5-4817-89e3-15cc7fe646b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:50.556960 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3845/7686] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:49 2022] DELETE /identity/v3/users/9e13e99508d44d49b962cedc431fe21b => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:50.627388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f2e9a96e-cca5-4817-89e3-15cc7fe646b0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:50.630866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f2e9a96e-cca5-4817-89e3-15cc7fe646b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:50.850597 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3842/7687] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:51.130457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:51.132321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:51.387518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cd89ab-f05e-4680-8114-e900325e1b31 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:51.412559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c606366-32ca-4277-a018-4004f9a9a0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:51.413196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606366-32ca-4277-a018-4004f9a9a0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:51.413536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606366-32ca-4277-a018-4004f9a9a0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:51.413795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c606366-32ca-4277-a018-4004f9a9a0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:51.445721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c606366-32ca-4277-a018-4004f9a9a0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:51.447800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c606366-32ca-4277-a018-4004f9a9a0e5 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:51.511032 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3846/7688] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:53.249002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a96e-cca5-4817-89e3-15cc7fe646b0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:53.253242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f2e9a96e-cca5-4817-89e3-15cc7fe646b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:53.284467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9a96e-cca5-4817-89e3-15cc7fe646b0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:53.299886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:53.300559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:53.300846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:53.301123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] PATH_INFO: `/v3/projects/852afe431a4d44f5ab9b9e3f392e6bcb` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:53.302780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] RBAC: Authorizing `identity:delete_project(project_id=852afe431a4d44f5ab9b9e3f392e6bcb)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:53.304932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:53.431102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '852afe431a4d44f5ab9b9e3f392e6bcb', 'request_id': 'req-2650b837-eeb5-4a8b-8238-031024cc5aee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:53.472011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '852afe431a4d44f5ab9b9e3f392e6bcb', 'request_id': 'req-2650b837-eeb5-4a8b-8238-031024cc5aee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:53.474069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d654191-741c-4b9c-b7af-d5193d8a705b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:53.474906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d654191-741c-4b9c-b7af-d5193d8a705b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:53.475367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d654191-741c-4b9c-b7af-d5193d8a705b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:53.483382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '852afe431a4d44f5ab9b9e3f392e6bcb', 'request_id': 'req-2650b837-eeb5-4a8b-8238-031024cc5aee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:53.537455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] The token cache is being invalidate because project 852afe431a4d44f5ab9b9e3f392e6bcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:53.538220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:53.539283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:53.540132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0d654191-741c-4b9c-b7af-d5193d8a705b None None] MFA Rules not processed for user `070aabe58ef941449e499ba6eccf5c48`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:53.542151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0d654191-741c-4b9c-b7af-d5193d8a705b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:53.542934 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3843/7689] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:53 2022] DELETE /identity/v3/projects/852afe431a4d44f5ab9b9e3f392e6bcb => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:53.547241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:53.551159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:53.726688 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3847/7690] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:27:53.741683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b2a7-72e7-42e5-8b2a-1643fdb43820 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:53.742152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b2a7-72e7-42e5-8b2a-1643fdb43820 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:53.742437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e79b2a7-72e7-42e5-8b2a-1643fdb43820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:53.801593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2650b837-eeb5-4a8b-8238-031024cc5aee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:53.828962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:53.829478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:53.829762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:53.830040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] PATH_INFO: `/v3/users/d5a115720bf4421f995b5ec5aca16cf1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:53.838933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d5a115720bf4421f995b5ec5aca16cf1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:53.839078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7e79b2a7-72e7-42e5-8b2a-1643fdb43820 None None] MFA Rules not processed for user `070aabe58ef941449e499ba6eccf5c48`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:53.840351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e79b2a7-72e7-42e5-8b2a-1643fdb43820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:53.840949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:53.894053 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3848/7691] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:53 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:53.912022 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:53.915262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b2a7-72e7-42e5-8b2a-1643fdb43820 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:53.922848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e79b2a7-72e7-42e5-8b2a-1643fdb43820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:53.954312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd5a115720bf4421f995b5ec5aca16cf1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:53.984419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd5a115720bf4421f995b5ec5aca16cf1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:53.985175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd5a115720bf4421f995b5ec5aca16cf1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:54.016660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd5a115720bf4421f995b5ec5aca16cf1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:54.049080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd5a115720bf4421f995b5ec5aca16cf1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:54.073791 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3844/7692] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:53 2022] DELETE /identity/v3/users/d5a115720bf4421f995b5ec5aca16cf1 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:54.146334 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:54.217124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e79b2a7-72e7-42e5-8b2a-1643fdb43820 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:54.396603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0da5-dc2d-4c5c-a802-1834c9f64bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:54.399490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0da5-dc2d-4c5c-a802-1834c9f64bf8 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:54.399781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0da5-dc2d-4c5c-a802-1834c9f64bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:54.400591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052c0da5-dc2d-4c5c-a802-1834c9f64bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:54.405693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-052c0da5-dc2d-4c5c-a802-1834c9f64bf8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:54.598881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c0da5-dc2d-4c5c-a802-1834c9f64bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:54.600531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052c0da5-dc2d-4c5c-a802-1834c9f64bf8 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:54.625338 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3849/7693] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:54.785362 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:54.786962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:55.036016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39632d30-1841-479b-a68b-d59beb641893 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:55.044561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:55.068227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:55.068669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:55.069503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] PATH_INFO: `/v3/projects/e95bbda7d1774cd68410e049f7fbd3dd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:55.071430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e95bbda7d1774cd68410e049f7fbd3dd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:55.075404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:55.206517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e95bbda7d1774cd68410e049f7fbd3dd', 'request_id': 'req-95bdbae6-1ffa-4cef-a20a-6405206859b6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.225763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e95bbda7d1774cd68410e049f7fbd3dd', 'request_id': 'req-95bdbae6-1ffa-4cef-a20a-6405206859b6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.242441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e95bbda7d1774cd68410e049f7fbd3dd', 'request_id': 'req-95bdbae6-1ffa-4cef-a20a-6405206859b6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.269387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] The token cache is being invalidate because project e95bbda7d1774cd68410e049f7fbd3dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:55.270288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.271284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-95bdbae6-1ffa-4cef-a20a-6405206859b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.274112 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3845/7694] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:54 2022] DELETE /identity/v3/projects/e95bbda7d1774cd68410e049f7fbd3dd => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:55.283409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0da5-dc2d-4c5c-a802-1834c9f64bf8 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:55.310885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052c0da5-dc2d-4c5c-a802-1834c9f64bf8 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:55.548380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179631-dbc2-4d3f-afa0-74307b89099b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:55.548675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179631-dbc2-4d3f-afa0-74307b89099b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:55.548959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8179631-dbc2-4d3f-afa0-74307b89099b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:55.571343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:55.572194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:55.572745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:55.573126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] PATH_INFO: `/v3/users/23fca8e463264505bcaebcac2e4c9dde` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:55.577965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=23fca8e463264505bcaebcac2e4c9dde)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:55.580043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:55.590867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c8179631-dbc2-4d3f-afa0-74307b89099b None None] MFA Rules not processed for user `b62fde68e8c747bfbea881c71421c5ae`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:55.592266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8179631-dbc2-4d3f-afa0-74307b89099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:55.668103 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:55.699028 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:55.711948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23fca8e463264505bcaebcac2e4c9dde'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.746031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23fca8e463264505bcaebcac2e4c9dde'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.748888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23fca8e463264505bcaebcac2e4c9dde'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.761118 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3846/7695] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:27:55.771520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23fca8e463264505bcaebcac2e4c9dde'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.785569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23fca8e463264505bcaebcac2e4c9dde'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:55.808996 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3850/7696] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:27:55 2022] DELETE /identity/v3/users/23fca8e463264505bcaebcac2e4c9dde => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:57.204698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179631-dbc2-4d3f-afa0-74307b89099b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:57.206263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8179631-dbc2-4d3f-afa0-74307b89099b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:57.240726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8179631-dbc2-4d3f-afa0-74307b89099b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:57.266264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:57.268332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:57.525896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2feff5c-5cb6-4599-9fbb-abb621cbb5ea admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:57.534187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:57.534860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:57.535144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:57.535419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] PATH_INFO: `/v3/projects/daa79efa50bb4cd592524025c415826f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:57.540119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=daa79efa50bb4cd592524025c415826f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:57.542176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:57.544543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b439f25-3dc5-496f-9662-a91b93240103 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:57.550007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b439f25-3dc5-496f-9662-a91b93240103 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:57.550302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b439f25-3dc5-496f-9662-a91b93240103 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:57.554684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b439f25-3dc5-496f-9662-a91b93240103 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:57.566773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0b439f25-3dc5-496f-9662-a91b93240103 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:57.617738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b439f25-3dc5-496f-9662-a91b93240103 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:57.622388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b439f25-3dc5-496f-9662-a91b93240103 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:57.669334 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3851/7697] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:27:57.741962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'daa79efa50bb4cd592524025c415826f', 'request_id': 'req-61f74706-c301-4844-8227-c8fd53b79d37'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:57.764936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'daa79efa50bb4cd592524025c415826f', 'request_id': 'req-61f74706-c301-4844-8227-c8fd53b79d37'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:57.782103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'daa79efa50bb4cd592524025c415826f', 'request_id': 'req-61f74706-c301-4844-8227-c8fd53b79d37'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:57.836217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] The token cache is being invalidate because project daa79efa50bb4cd592524025c415826f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:27:57.836769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:57.837669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-61f74706-c301-4844-8227-c8fd53b79d37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:27:57.841097 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3847/7698] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:27:57 2022] DELETE /identity/v3/projects/daa79efa50bb4cd592524025c415826f => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:57.846222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94892e-77ac-49cb-9697-cf556b158005 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:57.846515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94892e-77ac-49cb-9697-cf556b158005 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:57.846790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf94892e-77ac-49cb-9697-cf556b158005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:57.889827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bf94892e-77ac-49cb-9697-cf556b158005 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:57.893521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bf94892e-77ac-49cb-9697-cf556b158005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:58.117618 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3852/7699] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:58.125526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0661-8e99-498a-ac79-d187ecad24bc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:58.126012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0661-8e99-498a-ac79-d187ecad24bc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:58.126770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b0661-8e99-498a-ac79-d187ecad24bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:58.169797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7d4b0661-8e99-498a-ac79-d187ecad24bc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:58.171009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7d4b0661-8e99-498a-ac79-d187ecad24bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:58.180396 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3848/7700] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:58.184995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94892e-77ac-49cb-9697-cf556b158005 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:58.217503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf94892e-77ac-49cb-9697-cf556b158005 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:58.230671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67683ac-0dc3-40ba-b703-64aded4f7be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:58.231474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67683ac-0dc3-40ba-b703-64aded4f7be3 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:58.231824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67683ac-0dc3-40ba-b703-64aded4f7be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:58.232186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67683ac-0dc3-40ba-b703-64aded4f7be3 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:58.232914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67683ac-0dc3-40ba-b703-64aded4f7be3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:27:58.233313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67683ac-0dc3-40ba-b703-64aded4f7be3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:58.235047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67683ac-0dc3-40ba-b703-64aded4f7be3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:58.253520 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3853/7701] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:27:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:27:58.258266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b0661-8e99-498a-ac79-d187ecad24bc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:58.273420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b0661-8e99-498a-ac79-d187ecad24bc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:58.282981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af796b7-c0a6-49db-9663-768b7416238f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:58.284172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af796b7-c0a6-49db-9663-768b7416238f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:58.285253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af796b7-c0a6-49db-9663-768b7416238f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:58.285820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af796b7-c0a6-49db-9663-768b7416238f admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:58.286733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af796b7-c0a6-49db-9663-768b7416238f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:58.292032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af796b7-c0a6-49db-9663-768b7416238f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:58.354870 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3849/7702] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:27:58 2022] POST /identity/v3/projects => generated 371 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:58.359272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67683ac-0dc3-40ba-b703-64aded4f7be3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:58.372506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67683ac-0dc3-40ba-b703-64aded4f7be3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:58.496849 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:58.539320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a229c1-6b51-4243-b2d1-bba14aa9a073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:58.542652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a229c1-6b51-4243-b2d1-bba14aa9a073 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:58.543446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a229c1-6b51-4243-b2d1-bba14aa9a073 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:58.544523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a229c1-6b51-4243-b2d1-bba14aa9a073 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:58.548927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a229c1-6b51-4243-b2d1-bba14aa9a073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:58.552389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a229c1-6b51-4243-b2d1-bba14aa9a073 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:58.640725 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3854/7703] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:27:58 2022] POST /identity/v3/users => generated 286 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:27:58.642924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af796b7-c0a6-49db-9663-768b7416238f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:58.671741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af796b7-c0a6-49db-9663-768b7416238f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:58.692411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d0fd4-acdc-4120-b586-ca4ffac864e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:58.693261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d0fd4-acdc-4120-b586-ca4ffac864e9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:58.693649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d0fd4-acdc-4120-b586-ca4ffac864e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:58.693933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d0fd4-acdc-4120-b586-ca4ffac864e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:58.694592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d0fd4-acdc-4120-b586-ca4ffac864e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:58.707346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d0fd4-acdc-4120-b586-ca4ffac864e9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:58.742421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a229c1-6b51-4243-b2d1-bba14aa9a073 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:58.754124 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3850/7704] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:58.757694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a229c1-6b51-4243-b2d1-bba14aa9a073 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:58.778831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb62c34-caec-4f96-ae1d-0da5c1b8c526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:58.779462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb62c34-caec-4f96-ae1d-0da5c1b8c526 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:58.779743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb62c34-caec-4f96-ae1d-0da5c1b8c526 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:58.780019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb62c34-caec-4f96-ae1d-0da5c1b8c526 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:58.780672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb62c34-caec-4f96-ae1d-0da5c1b8c526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:58.782325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb62c34-caec-4f96-ae1d-0da5c1b8c526 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:58.833985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d0fd4-acdc-4120-b586-ca4ffac864e9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:58.838125 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3855/7705] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:27:58.854337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d0fd4-acdc-4120-b586-ca4ffac864e9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:58.866871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494788-dce1-458b-b3a9-a54dfabfb8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:58.867774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494788-dce1-458b-b3a9-a54dfabfb8aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:58.868061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494788-dce1-458b-b3a9-a54dfabfb8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:58.868418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba494788-dce1-458b-b3a9-a54dfabfb8aa admin admin] PATH_INFO: `/v3/projects/da1a94dd119e49ce96801f1a73cfe31d/users/88764310cfd74578976cca63fd41458f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:58.909309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba494788-dce1-458b-b3a9-a54dfabfb8aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1a94dd119e49ce96801f1a73cfe31d, user_id=88764310cfd74578976cca63fd41458f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:58.921114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba494788-dce1-458b-b3a9-a54dfabfb8aa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:58.975788 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3851/7706] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:27:58 2022] PUT /identity/v3/projects/da1a94dd119e49ce96801f1a73cfe31d/users/88764310cfd74578976cca63fd41458f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:27:58.980868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01712-706a-48d8-be62-26b010e570e4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:58.981151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01712-706a-48d8-be62-26b010e570e4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:58.981469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd01712-706a-48d8-be62-26b010e570e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:59.106143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1fd01712-706a-48d8-be62-26b010e570e4 None None] MFA Rules not processed for user `88764310cfd74578976cca63fd41458f`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:27:59.116267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1fd01712-706a-48d8-be62-26b010e570e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:59.389481 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3856/7707] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:27:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 410 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:27:59.402318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494788-dce1-458b-b3a9-a54dfabfb8aa admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:27:59.404101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ba494788-dce1-458b-b3a9-a54dfabfb8aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:27:59.411687 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:27:59.616718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba494788-dce1-458b-b3a9-a54dfabfb8aa admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:27:59.638959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2448347-ed76-406b-82b3-33a79553a2d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:27:59.639863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2448347-ed76-406b-82b3-33a79553a2d9 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:27:59.640304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2448347-ed76-406b-82b3-33a79553a2d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:27:59.640735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2448347-ed76-406b-82b3-33a79553a2d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:27:59.668851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2448347-ed76-406b-82b3-33a79553a2d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:27:59.670652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2448347-ed76-406b-82b3-33a79553a2d9 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:27:59.703272 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3852/7708] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:27:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:28:02.619267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd01712-706a-48d8-be62-26b010e570e4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:02.621405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1fd01712-706a-48d8-be62-26b010e570e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:02.817836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd01712-706a-48d8-be62-26b010e570e4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:02.826594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:02.828210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:02.828660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:02.829029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] PATH_INFO: `/v3/users/0330403b307f492b90519875fcb23c6b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:02.830669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0330403b307f492b90519875fcb23c6b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:02.833239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:02.919205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0330403b307f492b90519875fcb23c6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:02.934427 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:02.955435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0330403b307f492b90519875fcb23c6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:02.956188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0330403b307f492b90519875fcb23c6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:02.973978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0330403b307f492b90519875fcb23c6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:02.986111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0330403b307f492b90519875fcb23c6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:03.008521 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3857/7709] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:28:02 2022] DELETE /identity/v3/users/0330403b307f492b90519875fcb23c6b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:28:03.013361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f8b7e-a8b6-488e-9aaf-e890f6386f28 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:03.013846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f8b7e-a8b6-488e-9aaf-e890f6386f28 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:03.013943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602f8b7e-a8b6-488e-9aaf-e890f6386f28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:03.066005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-602f8b7e-a8b6-488e-9aaf-e890f6386f28 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:03.067630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-602f8b7e-a8b6-488e-9aaf-e890f6386f28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:03.326084 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3853/7710] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:03.434308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:03.435771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:03.565234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2101514d-1b64-4905-98c2-186a10d493a4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:03.572313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cdc0c-9469-4740-9ab4-5943f90a9357 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:03.572951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cdc0c-9469-4740-9ab4-5943f90a9357 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:03.573233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cdc0c-9469-4740-9ab4-5943f90a9357 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:03.573543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26cdc0c-9469-4740-9ab4-5943f90a9357 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:03.633205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cdc0c-9469-4740-9ab4-5943f90a9357 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:03.635961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26cdc0c-9469-4740-9ab4-5943f90a9357 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:03.680642 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3858/7711] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:28:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:28:03.919412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba85607-5547-48fe-a656-bacd537b54aa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:03.920528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba85607-5547-48fe-a656-bacd537b54aa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:03.921011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba85607-5547-48fe-a656-bacd537b54aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:04.001956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0ba85607-5547-48fe-a656-bacd537b54aa None None] MFA Rules not processed for user `88764310cfd74578976cca63fd41458f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:04.003195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0ba85607-5547-48fe-a656-bacd537b54aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:04.158787 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3854/7712] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:05.448401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cdc0c-9469-4740-9ab4-5943f90a9357 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:05.459089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c26cdc0c-9469-4740-9ab4-5943f90a9357 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:05.504659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26cdc0c-9469-4740-9ab4-5943f90a9357 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:05.527181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:05.528093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:05.528530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:05.528959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] PATH_INFO: `/v3/projects/2ab9b110cb5f48ae9033bf7b46ff8af3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:05.534764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ab9b110cb5f48ae9033bf7b46ff8af3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:05.539289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:05.714769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ab9b110cb5f48ae9033bf7b46ff8af3', 'request_id': 'req-fbf7686a-532c-4dd3-9d63-5d64d278be77'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:05.774369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ab9b110cb5f48ae9033bf7b46ff8af3', 'request_id': 'req-fbf7686a-532c-4dd3-9d63-5d64d278be77'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:05.809288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ab9b110cb5f48ae9033bf7b46ff8af3', 'request_id': 'req-fbf7686a-532c-4dd3-9d63-5d64d278be77'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:05.830529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] The token cache is being invalidate because project 2ab9b110cb5f48ae9033bf7b46ff8af3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:28:05.833409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:05.834128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbf7686a-532c-4dd3-9d63-5d64d278be77 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:05.839062 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3859/7713] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:28:05 2022] DELETE /identity/v3/projects/2ab9b110cb5f48ae9033bf7b46ff8af3 => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:05.844379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0e42-5f00-422b-958c-e68f7c4259bc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:05.844872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0e42-5f00-422b-958c-e68f7c4259bc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:05.844966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b0e42-5f00-422b-958c-e68f7c4259bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:05.892584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b27b0e42-5f00-422b-958c-e68f7c4259bc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:05.895174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b27b0e42-5f00-422b-958c-e68f7c4259bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:06.022402 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:06.073596 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3855/7714] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:06.076182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa751cc-6de6-420a-af8c-b2d708d02b07 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:06.076473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa751cc-6de6-420a-af8c-b2d708d02b07 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:06.076708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa751cc-6de6-420a-af8c-b2d708d02b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:06.159155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-daa751cc-6de6-420a-af8c-b2d708d02b07 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:06.160416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-daa751cc-6de6-420a-af8c-b2d708d02b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:06.211758 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3860/7715] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:06.217142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0e42-5f00-422b-958c-e68f7c4259bc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:06.229149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b0e42-5f00-422b-958c-e68f7c4259bc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:06.241594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71337b7-1cea-4e03-a072-78e4792ced51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:06.242246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71337b7-1cea-4e03-a072-78e4792ced51 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:06.243289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71337b7-1cea-4e03-a072-78e4792ced51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:06.243583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71337b7-1cea-4e03-a072-78e4792ced51 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:06.244249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71337b7-1cea-4e03-a072-78e4792ced51 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:28:06.246757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71337b7-1cea-4e03-a072-78e4792ced51 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:06.248446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71337b7-1cea-4e03-a072-78e4792ced51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:06.276661 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3856/7716] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:28:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:28:06.280333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa751cc-6de6-420a-af8c-b2d708d02b07 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:06.295547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa751cc-6de6-420a-af8c-b2d708d02b07 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:06.309862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd96c49-3b2b-4053-92a4-f37960f2bb8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:06.311391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd96c49-3b2b-4053-92a4-f37960f2bb8b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:06.311678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd96c49-3b2b-4053-92a4-f37960f2bb8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:06.312889 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd96c49-3b2b-4053-92a4-f37960f2bb8b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:06.316326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd96c49-3b2b-4053-92a4-f37960f2bb8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:06.322165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd96c49-3b2b-4053-92a4-f37960f2bb8b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:06.426485 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3861/7717] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:28:06 2022] POST /identity/v3/projects => generated 373 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:28:06.430948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71337b7-1cea-4e03-a072-78e4792ced51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:06.444900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71337b7-1cea-4e03-a072-78e4792ced51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:06.534230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd96c49-3b2b-4053-92a4-f37960f2bb8b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:06.537729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cfd96c49-3b2b-4053-92a4-f37960f2bb8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:06.662334 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:06.713368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42c32c-f416-45e4-b81e-f0a2f252551a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:06.729976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42c32c-f416-45e4-b81e-f0a2f252551a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:06.729976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42c32c-f416-45e4-b81e-f0a2f252551a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:06.729976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42c32c-f416-45e4-b81e-f0a2f252551a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:06.730464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42c32c-f416-45e4-b81e-f0a2f252551a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:06.735296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de42c32c-f416-45e4-b81e-f0a2f252551a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:06.820269 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3857/7718] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:28:06 2022] POST /identity/v3/users => generated 287 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:28:06.821234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42c32c-f416-45e4-b81e-f0a2f252551a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:06.849246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de42c32c-f416-45e4-b81e-f0a2f252551a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:06.868037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd96c49-3b2b-4053-92a4-f37960f2bb8b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:06.888561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939b384-78cc-4b17-be69-2d5dcd2aafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:06.889040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcab6c-b1e6-4a24-953d-2dd4a08408a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:06.889234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939b384-78cc-4b17-be69-2d5dcd2aafca admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:06.889936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcab6c-b1e6-4a24-953d-2dd4a08408a6 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:06.890318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcab6c-b1e6-4a24-953d-2dd4a08408a6 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:06.890699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bcab6c-b1e6-4a24-953d-2dd4a08408a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:06.894058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939b384-78cc-4b17-be69-2d5dcd2aafca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:06.894350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e939b384-78cc-4b17-be69-2d5dcd2aafca admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:06.895046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939b384-78cc-4b17-be69-2d5dcd2aafca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:06.895320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-74bcab6c-b1e6-4a24-953d-2dd4a08408a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:06.902951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e939b384-78cc-4b17-be69-2d5dcd2aafca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:06.930024 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3858/7719] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:28:06.950884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939b384-78cc-4b17-be69-2d5dcd2aafca admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:06.956114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcab6c-b1e6-4a24-953d-2dd4a08408a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:06.961888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bcab6c-b1e6-4a24-953d-2dd4a08408a6 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:06.993510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e939b384-78cc-4b17-be69-2d5dcd2aafca admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:07.008448 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3862/7720] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:28:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:28:07.037729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba17f254-e3c5-45be-9d1d-cf26c2f4f41a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:07.038946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17f254-e3c5-45be-9d1d-cf26c2f4f41a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:07.039229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17f254-e3c5-45be-9d1d-cf26c2f4f41a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:07.041194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba17f254-e3c5-45be-9d1d-cf26c2f4f41a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:07.042497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17f254-e3c5-45be-9d1d-cf26c2f4f41a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:07.049245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba17f254-e3c5-45be-9d1d-cf26c2f4f41a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:07.102287 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3859/7721] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:28:07.104176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcab6c-b1e6-4a24-953d-2dd4a08408a6 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:07.126440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bcab6c-b1e6-4a24-953d-2dd4a08408a6 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:07.148700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24bc48-287a-43df-a3b9-1e123fa300a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:07.150020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24bc48-287a-43df-a3b9-1e123fa300a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:07.152860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24bc48-287a-43df-a3b9-1e123fa300a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:07.153144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be24bc48-287a-43df-a3b9-1e123fa300a9 admin admin] PATH_INFO: `/v3/projects/f9c0c3da8adb499a9546eb1fa1941b7c/users/371b4ff9d48d48dfaa4b0529372a2ab0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:07.244772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24bc48-287a-43df-a3b9-1e123fa300a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9c0c3da8adb499a9546eb1fa1941b7c, user_id=371b4ff9d48d48dfaa4b0529372a2ab0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:07.246024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be24bc48-287a-43df-a3b9-1e123fa300a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:07.282782 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3863/7722] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:28:07 2022] PUT /identity/v3/projects/f9c0c3da8adb499a9546eb1fa1941b7c/users/371b4ff9d48d48dfaa4b0529372a2ab0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:07.288275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c3465-83fe-4c04-8c09-77b7d0f3673d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:07.288643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c3465-83fe-4c04-8c09-77b7d0f3673d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:07.288992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1c3465-83fe-4c04-8c09-77b7d0f3673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:07.334532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3d1c3465-83fe-4c04-8c09-77b7d0f3673d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:07.335793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3d1c3465-83fe-4c04-8c09-77b7d0f3673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:07.553740 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3860/7723] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:07.591893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24bc48-287a-43df-a3b9-1e123fa300a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:07.594117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-be24bc48-287a-43df-a3b9-1e123fa300a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:07.744661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be24bc48-287a-43df-a3b9-1e123fa300a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:07.755789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131f3b5-b2f8-4313-9ad0-c23f9efdc5ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:07.757158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131f3b5-b2f8-4313-9ad0-c23f9efdc5ac service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:07.758047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131f3b5-b2f8-4313-9ad0-c23f9efdc5ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:07.758529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c131f3b5-b2f8-4313-9ad0-c23f9efdc5ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:07.773793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131f3b5-b2f8-4313-9ad0-c23f9efdc5ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:07.775612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c131f3b5-b2f8-4313-9ad0-c23f9efdc5ac service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:07.799128 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3864/7724] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:28:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:28:08.423884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c3465-83fe-4c04-8c09-77b7d0f3673d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:08.425290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3d1c3465-83fe-4c04-8c09-77b7d0f3673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:08.547016 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:08.596865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1c3465-83fe-4c04-8c09-77b7d0f3673d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:08.622368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e1a8d-d112-452d-9d84-185cda8d732d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:08.624294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1a8d-d112-452d-9d84-185cda8d732d service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:08.638356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1a8d-d112-452d-9d84-185cda8d732d service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:08.640414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e1a8d-d112-452d-9d84-185cda8d732d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:08.646881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-330e1a8d-d112-452d-9d84-185cda8d732d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:08.678807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1a8d-d112-452d-9d84-185cda8d732d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:08.680439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e1a8d-d112-452d-9d84-185cda8d732d service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:08.709413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3861/7725] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:28:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:28:09.416972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131f3b5-b2f8-4313-9ad0-c23f9efdc5ac service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:09.418502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c131f3b5-b2f8-4313-9ad0-c23f9efdc5ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:09.551565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c131f3b5-b2f8-4313-9ad0-c23f9efdc5ac service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:09.557894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc511ab-be64-4e61-8108-114801a6632f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:09.558986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc511ab-be64-4e61-8108-114801a6632f service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:09.559422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc511ab-be64-4e61-8108-114801a6632f service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:09.559869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc511ab-be64-4e61-8108-114801a6632f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:09.564577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5cc511ab-be64-4e61-8108-114801a6632f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:09.636581 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:09.726204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc511ab-be64-4e61-8108-114801a6632f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:09.728415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc511ab-be64-4e61-8108-114801a6632f service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:09.753561 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3865/7726] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:28:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 667 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:28:18.698845 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=12 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:18.964938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa199-4ac6-441a-a229-d38eb66e5b96 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:18.965230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa199-4ac6-441a-a229-d38eb66e5b96 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:18.965555 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75daa199-4ac6-441a-a229-d38eb66e5b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:19.043578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-75daa199-4ac6-441a-a229-d38eb66e5b96 None None] MFA Rules not processed for user `371b4ff9d48d48dfaa4b0529372a2ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:19.044807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-75daa199-4ac6-441a-a229-d38eb66e5b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:19.254369 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3862/7727] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:19.259855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc511ab-be64-4e61-8108-114801a6632f service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:19.271167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc511ab-be64-4e61-8108-114801a6632f service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:19.284546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39745f50-7450-49ef-a761-90d195a38da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:19.285632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39745f50-7450-49ef-a761-90d195a38da0 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:19.286312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39745f50-7450-49ef-a761-90d195a38da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:19.286779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39745f50-7450-49ef-a761-90d195a38da0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:19.289741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39745f50-7450-49ef-a761-90d195a38da0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:19.292920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39745f50-7450-49ef-a761-90d195a38da0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:19.374787 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3866/7728] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:28:19 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:28:19.379176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa199-4ac6-441a-a229-d38eb66e5b96 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:19.396872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75daa199-4ac6-441a-a229-d38eb66e5b96 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:19.537688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4063d2b-9d88-4cfe-862c-0e0e56ebfd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:19.537688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4063d2b-9d88-4cfe-862c-0e0e56ebfd7a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:19.537688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4063d2b-9d88-4cfe-862c-0e0e56ebfd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:19.537688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4063d2b-9d88-4cfe-862c-0e0e56ebfd7a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:19.538800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4063d2b-9d88-4cfe-862c-0e0e56ebfd7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:19.540893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4063d2b-9d88-4cfe-862c-0e0e56ebfd7a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:19.602312 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3863/7729] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:28:19 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:28:19.605957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39745f50-7450-49ef-a761-90d195a38da0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:19.622587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39745f50-7450-49ef-a761-90d195a38da0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:19.628261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a138-b2da-4f07-965b-68f806f3d35c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:19.629249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a138-b2da-4f07-965b-68f806f3d35c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:19.629843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a138-b2da-4f07-965b-68f806f3d35c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:19.630354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d396a138-b2da-4f07-965b-68f806f3d35c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:19.631561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a138-b2da-4f07-965b-68f806f3d35c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:19.634143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d396a138-b2da-4f07-965b-68f806f3d35c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:19.645976 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3867/7730] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:28:19.651188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4063d2b-9d88-4cfe-862c-0e0e56ebfd7a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:19.663685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4063d2b-9d88-4cfe-862c-0e0e56ebfd7a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:19.670403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d799fa-18b7-4d69-bd26-f0bed9f3ba08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:19.671323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d799fa-18b7-4d69-bd26-f0bed9f3ba08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:19.671871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d799fa-18b7-4d69-bd26-f0bed9f3ba08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:19.672310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d799fa-18b7-4d69-bd26-f0bed9f3ba08 admin admin] PATH_INFO: `/v3/projects/26367ce15733448f9ef5df16108e6e0d/users/de34d05a20f44bc5a79cceb18813433b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:19.693902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d799fa-18b7-4d69-bd26-f0bed9f3ba08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=26367ce15733448f9ef5df16108e6e0d, user_id=de34d05a20f44bc5a79cceb18813433b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:19.697915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d799fa-18b7-4d69-bd26-f0bed9f3ba08 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:19.719705 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3864/7731] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:28:19 2022] PUT /identity/v3/projects/26367ce15733448f9ef5df16108e6e0d/users/de34d05a20f44bc5a79cceb18813433b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:28:19.725648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a138-b2da-4f07-965b-68f806f3d35c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:19.745335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d396a138-b2da-4f07-965b-68f806f3d35c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:19.885953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0977a-abd0-4382-b85d-27aa89b4de41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:19.886604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0977a-abd0-4382-b85d-27aa89b4de41 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:19.886962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0977a-abd0-4382-b85d-27aa89b4de41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:19.887249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b0977a-abd0-4382-b85d-27aa89b4de41 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:19.888173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0977a-abd0-4382-b85d-27aa89b4de41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:19.890873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b0977a-abd0-4382-b85d-27aa89b4de41 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:19.905447 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3868/7732] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:28:19 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:28:19.909001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d799fa-18b7-4d69-bd26-f0bed9f3ba08 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:19.920737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d799fa-18b7-4d69-bd26-f0bed9f3ba08 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:19.937657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e6d69-90ca-45e9-9206-1eeaca15a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:19.939143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e6d69-90ca-45e9-9206-1eeaca15a94b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:19.939435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e6d69-90ca-45e9-9206-1eeaca15a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:19.939713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3e6d69-90ca-45e9-9206-1eeaca15a94b admin admin] PATH_INFO: `/v3/projects/26367ce15733448f9ef5df16108e6e0d/users/de34d05a20f44bc5a79cceb18813433b/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:19.943151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e6d69-90ca-45e9-9206-1eeaca15a94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=26367ce15733448f9ef5df16108e6e0d, user_id=de34d05a20f44bc5a79cceb18813433b, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:19.951343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3e6d69-90ca-45e9-9206-1eeaca15a94b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:19.979720 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3865/7733] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:28:19 2022] PUT /identity/v3/projects/26367ce15733448f9ef5df16108e6e0d/users/de34d05a20f44bc5a79cceb18813433b/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:29.898767 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=55,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:29.963007 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=76,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:30.829474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0977a-abd0-4382-b85d-27aa89b4de41 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:30.834285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f9b0977a-abd0-4382-b85d-27aa89b4de41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:30.858830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b0977a-abd0-4382-b85d-27aa89b4de41 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:30.983846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:30.986191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:30.986637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:30.987306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] PATH_INFO: `/v3/users/070aabe58ef941449e499ba6eccf5c48` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:30.988840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=070aabe58ef941449e499ba6eccf5c48)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:30.991587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:31.094305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '070aabe58ef941449e499ba6eccf5c48'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:31.115736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '070aabe58ef941449e499ba6eccf5c48'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:31.117123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '070aabe58ef941449e499ba6eccf5c48'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:31.145500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '070aabe58ef941449e499ba6eccf5c48'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:31.165779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-59063e18-4cba-42e1-846b-d6b51ba6cb4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '070aabe58ef941449e499ba6eccf5c48'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:31.176347 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3869/7734] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:28:30 2022] DELETE /identity/v3/users/070aabe58ef941449e499ba6eccf5c48 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:31.558416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e6d69-90ca-45e9-9206-1eeaca15a94b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:31.560325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7e3e6d69-90ca-45e9-9206-1eeaca15a94b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:31.582851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3e6d69-90ca-45e9-9206-1eeaca15a94b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:31.734687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:31.736007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:31.736307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:31.736591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] PATH_INFO: `/v3/projects/db7dde4daed04adab9bcfc786c9ac13a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:31.737890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=db7dde4daed04adab9bcfc786c9ac13a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:31.740498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:31.926119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db7dde4daed04adab9bcfc786c9ac13a', 'request_id': 'req-4acb913c-d7e7-45b4-814e-b19557234dc6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:31.953632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db7dde4daed04adab9bcfc786c9ac13a', 'request_id': 'req-4acb913c-d7e7-45b4-814e-b19557234dc6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:31.971625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db7dde4daed04adab9bcfc786c9ac13a', 'request_id': 'req-4acb913c-d7e7-45b4-814e-b19557234dc6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:32.038948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] The token cache is being invalidate because project db7dde4daed04adab9bcfc786c9ac13a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:28:32.039903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:32.040867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4acb913c-d7e7-45b4-814e-b19557234dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:32.051417 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3866/7735] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:28:31 2022] DELETE /identity/v3/projects/db7dde4daed04adab9bcfc786c9ac13a => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:32.056928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcdd13-3ff1-457c-9c32-78e66c99c4ff None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.057850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcdd13-3ff1-457c-9c32-78e66c99c4ff None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.058312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fcdd13-3ff1-457c-9c32-78e66c99c4ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.102320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-92fcdd13-3ff1-457c-9c32-78e66c99c4ff None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:32.103657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-92fcdd13-3ff1-457c-9c32-78e66c99c4ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:32.261672 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3870/7736] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:32.270254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3a31-b356-490d-9680-af17636345a4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.271533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3a31-b356-490d-9680-af17636345a4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.271990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b3a31-b356-490d-9680-af17636345a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.318306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5a1b3a31-b356-490d-9680-af17636345a4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:32.322467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a1b3a31-b356-490d-9680-af17636345a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:32.387929 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3867/7737] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:32.392289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcdd13-3ff1-457c-9c32-78e66c99c4ff None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:32.407878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fcdd13-3ff1-457c-9c32-78e66c99c4ff None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:32.417082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f8690-4a10-4726-ae68-af574f4c7378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:32.418167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8690-4a10-4726-ae68-af574f4c7378 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.418782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8690-4a10-4726-ae68-af574f4c7378 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.419243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0f8690-4a10-4726-ae68-af574f4c7378 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.420336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f8690-4a10-4726-ae68-af574f4c7378 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:28:32.420839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f8690-4a10-4726-ae68-af574f4c7378 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:32.422687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0f8690-4a10-4726-ae68-af574f4c7378 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:32.452983 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3871/7738] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:28:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:28:32.460969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b3a31-b356-490d-9680-af17636345a4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:32.473262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b3a31-b356-490d-9680-af17636345a4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:32.486130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c77fb0-4c18-4cd0-adfe-b48d5889195c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:32.486848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c77fb0-4c18-4cd0-adfe-b48d5889195c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.487141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c77fb0-4c18-4cd0-adfe-b48d5889195c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.487422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c77fb0-4c18-4cd0-adfe-b48d5889195c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.488075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c77fb0-4c18-4cd0-adfe-b48d5889195c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:32.490082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c77fb0-4c18-4cd0-adfe-b48d5889195c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:32.556374 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3868/7739] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:28:32 2022] POST /identity/v3/projects => generated 373 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:28:32.557683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f8690-4a10-4726-ae68-af574f4c7378 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:32.568591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0f8690-4a10-4726-ae68-af574f4c7378 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:32.574443 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:32.616587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3660-9c39-4589-897c-cf822e2074c9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.617043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3660-9c39-4589-897c-cf822e2074c9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.617126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cd3660-9c39-4589-897c-cf822e2074c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.670791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf859edc-e5bf-4aef-9658-6806f07636fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:32.671852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf859edc-e5bf-4aef-9658-6806f07636fb admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.672372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf859edc-e5bf-4aef-9658-6806f07636fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.672960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf859edc-e5bf-4aef-9658-6806f07636fb admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.673882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-14cd3660-9c39-4589-897c-cf822e2074c9 None None] MFA Rules not processed for user `de34d05a20f44bc5a79cceb18813433b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:32.674115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf859edc-e5bf-4aef-9658-6806f07636fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:32.675113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-14cd3660-9c39-4589-897c-cf822e2074c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:32.676852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf859edc-e5bf-4aef-9658-6806f07636fb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:32.713390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3872/7740] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:28:32 2022] POST /identity/v3/users => generated 287 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:28:32.717079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf859edc-e5bf-4aef-9658-6806f07636fb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:32.730332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf859edc-e5bf-4aef-9658-6806f07636fb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:32.736211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b73015-71c8-4b01-97ce-b4497b7b148d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:32.736839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b73015-71c8-4b01-97ce-b4497b7b148d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.737224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b73015-71c8-4b01-97ce-b4497b7b148d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.737452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b73015-71c8-4b01-97ce-b4497b7b148d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.739168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b73015-71c8-4b01-97ce-b4497b7b148d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:32.739982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b73015-71c8-4b01-97ce-b4497b7b148d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:32.754881 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:32.756629 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3873/7741] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:28:32.759862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b73015-71c8-4b01-97ce-b4497b7b148d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:32.773025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b73015-71c8-4b01-97ce-b4497b7b148d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:32.780053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05456a9d-a1bb-4237-ba03-70254e8fc6eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:32.780698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05456a9d-a1bb-4237-ba03-70254e8fc6eb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.781083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05456a9d-a1bb-4237-ba03-70254e8fc6eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.781458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05456a9d-a1bb-4237-ba03-70254e8fc6eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.782004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05456a9d-a1bb-4237-ba03-70254e8fc6eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:32.783652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05456a9d-a1bb-4237-ba03-70254e8fc6eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:32.791798 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3869/7742] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:32.796932 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3874/7743] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:28:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:28:32.802334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd3660-9c39-4589-897c-cf822e2074c9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:32.807551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05456a9d-a1bb-4237-ba03-70254e8fc6eb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:32.810206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-05456a9d-a1bb-4237-ba03-70254e8fc6eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:32.815221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cd3660-9c39-4589-897c-cf822e2074c9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:32.820078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e8ddae-ab6d-4750-b246-f7ea0d53099e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:32.821488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8ddae-ab6d-4750-b246-f7ea0d53099e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.821777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8ddae-ab6d-4750-b246-f7ea0d53099e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.822052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e8ddae-ab6d-4750-b246-f7ea0d53099e admin admin] PATH_INFO: `/v3/projects/3553c0c16fe44590b3fa8a2b35a2bf5a/users/5d7a7f0f195d400c983cf3fdc0834ad2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.841647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8ddae-ab6d-4750-b246-f7ea0d53099e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3553c0c16fe44590b3fa8a2b35a2bf5a, user_id=5d7a7f0f195d400c983cf3fdc0834ad2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:32.844636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e8ddae-ab6d-4750-b246-f7ea0d53099e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:32.862339 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3870/7744] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:28:32 2022] PUT /identity/v3/projects/3553c0c16fe44590b3fa8a2b35a2bf5a/users/5d7a7f0f195d400c983cf3fdc0834ad2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:32.876367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d4d8f-e21a-458d-93dc-c89835120235 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:32.876918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d4d8f-e21a-458d-93dc-c89835120235 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:32.877626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d4d8f-e21a-458d-93dc-c89835120235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:32.918135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05456a9d-a1bb-4237-ba03-70254e8fc6eb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:32.919689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-de9d4d8f-e21a-458d-93dc-c89835120235 None None] MFA Rules not processed for user `5d7a7f0f195d400c983cf3fdc0834ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:32.921132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-de9d4d8f-e21a-458d-93dc-c89835120235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:33.014458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e65487e-2362-4a15-955f-77ce63c37e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:33.014995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65487e-2362-4a15-955f-77ce63c37e78 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:33.015280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65487e-2362-4a15-955f-77ce63c37e78 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:33.015556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e65487e-2362-4a15-955f-77ce63c37e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:33.016410 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3871/7745] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:33.029224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087255e7-f5ca-4ed0-802a-ed3c59c17d01 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:33.029502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087255e7-f5ca-4ed0-802a-ed3c59c17d01 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:33.029787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087255e7-f5ca-4ed0-802a-ed3c59c17d01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:33.038590 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:33.071689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-087255e7-f5ca-4ed0-802a-ed3c59c17d01 None None] MFA Rules not processed for user `5d7a7f0f195d400c983cf3fdc0834ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:33.077324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-087255e7-f5ca-4ed0-802a-ed3c59c17d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:33.093350 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3872/7746] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:28:33.107233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087255e7-f5ca-4ed0-802a-ed3c59c17d01 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:33.110232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-087255e7-f5ca-4ed0-802a-ed3c59c17d01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:33.147477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087255e7-f5ca-4ed0-802a-ed3c59c17d01 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:33.161626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fac0dd-c31a-4684-8df1-d6de6eaa38f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:33.166402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65487e-2362-4a15-955f-77ce63c37e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:33.167571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac0dd-c31a-4684-8df1-d6de6eaa38f8 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:33.168929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e65487e-2362-4a15-955f-77ce63c37e78 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:33.170286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac0dd-c31a-4684-8df1-d6de6eaa38f8 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:33.170675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fac0dd-c31a-4684-8df1-d6de6eaa38f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:33.194074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fac0dd-c31a-4684-8df1-d6de6eaa38f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:33.195145 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3875/7747] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:28:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:28:33.196561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fac0dd-c31a-4684-8df1-d6de6eaa38f8 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:33.220858 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3873/7748] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:28:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:28:33.265144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5785d74-ab09-478b-b6ab-27b4314c9dbb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:33.270224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5785d74-ab09-478b-b6ab-27b4314c9dbb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:33.270799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5785d74-ab09-478b-b6ab-27b4314c9dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:33.311158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c5785d74-ab09-478b-b6ab-27b4314c9dbb None None] MFA Rules not processed for user `371b4ff9d48d48dfaa4b0529372a2ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:33.313186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c5785d74-ab09-478b-b6ab-27b4314c9dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:33.419516 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3876/7749] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:43.207893 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:43.408044 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=50 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:48.067752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383276c-fc7d-41f6-9cc4-41d101e8e660 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:48.067752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383276c-fc7d-41f6-9cc4-41d101e8e660 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:48.067752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1383276c-fc7d-41f6-9cc4-41d101e8e660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:48.115654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1383276c-fc7d-41f6-9cc4-41d101e8e660 None None] MFA Rules not processed for user `371b4ff9d48d48dfaa4b0529372a2ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:48.117728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1383276c-fc7d-41f6-9cc4-41d101e8e660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:48.134942 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3874/7750] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:53.599931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5785d74-ab09-478b-b6ab-27b4314c9dbb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:53.602015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c5785d74-ab09-478b-b6ab-27b4314c9dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:53.734233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5785d74-ab09-478b-b6ab-27b4314c9dbb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:53.740053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:53.741062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:53.741606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:53.742176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] PATH_INFO: `/v3/users/95e222b5282446348a7572dd8493eff9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:53.743611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] RBAC: Authorizing `identity:delete_user(user_id=95e222b5282446348a7572dd8493eff9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:53.745910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:53.802355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95e222b5282446348a7572dd8493eff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:53.817762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95e222b5282446348a7572dd8493eff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:53.818712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95e222b5282446348a7572dd8493eff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:53.832606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95e222b5282446348a7572dd8493eff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:53.847488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95e222b5282446348a7572dd8493eff9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:53.857680 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3877/7751] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:28:53 2022] DELETE /identity/v3/users/95e222b5282446348a7572dd8493eff9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:53.859528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c777c-d7a3-497c-bee8-33d09bee9a79 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:53.859981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c777c-d7a3-497c-bee8-33d09bee9a79 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:53.860376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c777c-d7a3-497c-bee8-33d09bee9a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:53.886187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2f6c777c-d7a3-497c-bee8-33d09bee9a79 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:53.887698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2f6c777c-d7a3-497c-bee8-33d09bee9a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:53.975610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3875/7752] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:53.985767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:53.987639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:54.074502 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:54.118158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ff4e4f-c48b-42ea-830f-1268f5a2143e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:54.121918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83e30-4795-4a1f-8137-32da5d4b9529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:54.122685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83e30-4795-4a1f-8137-32da5d4b9529 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:54.122972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83e30-4795-4a1f-8137-32da5d4b9529 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:54.123250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f83e30-4795-4a1f-8137-32da5d4b9529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:54.133887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83e30-4795-4a1f-8137-32da5d4b9529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:54.135367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f83e30-4795-4a1f-8137-32da5d4b9529 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:54.163149 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3878/7753] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:28:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:28:54.648928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c777c-d7a3-497c-bee8-33d09bee9a79 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:54.650762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2f6c777c-d7a3-497c-bee8-33d09bee9a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:54.729011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c777c-d7a3-497c-bee8-33d09bee9a79 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:54.749188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:54.750434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:54.750887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:54.751323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] PATH_INFO: `/v3/projects/848d43c65aba4eb1925cf89b2cbc2719` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:54.762166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=848d43c65aba4eb1925cf89b2cbc2719)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:54.764596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:54.880975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '848d43c65aba4eb1925cf89b2cbc2719', 'request_id': 'req-cff20c50-ded7-4900-a4be-dbd41c8995cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:54.899915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '848d43c65aba4eb1925cf89b2cbc2719', 'request_id': 'req-cff20c50-ded7-4900-a4be-dbd41c8995cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:54.907510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '848d43c65aba4eb1925cf89b2cbc2719', 'request_id': 'req-cff20c50-ded7-4900-a4be-dbd41c8995cc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:54.934749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] The token cache is being invalidate because project 848d43c65aba4eb1925cf89b2cbc2719 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:28:54.935320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:54.936178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:54.937986 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3876/7754] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:28:54 2022] DELETE /identity/v3/projects/848d43c65aba4eb1925cf89b2cbc2719 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:54.942828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83e30-4795-4a1f-8137-32da5d4b9529 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:54.957641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f83e30-4795-4a1f-8137-32da5d4b9529 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:55.095704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:55.096316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:55.096664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:55.097286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] PATH_INFO: `/v3/users/2613c659b737462182cacbae68de611e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:55.098956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2613c659b737462182cacbae68de611e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:55.102058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:55.176443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2613c659b737462182cacbae68de611e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.193535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2613c659b737462182cacbae68de611e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.194419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2613c659b737462182cacbae68de611e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.203935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2613c659b737462182cacbae68de611e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.214629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-06ecd6e0-bb39-4f45-951b-9f9d83a32732 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2613c659b737462182cacbae68de611e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.223163 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3879/7755] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:28:54 2022] DELETE /identity/v3/users/2613c659b737462182cacbae68de611e => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:55.713113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:55.714771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:55.735510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff20c50-ded7-4900-a4be-dbd41c8995cc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:55.849411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:55.850058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:55.850348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:55.850672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] PATH_INFO: `/v3/projects/a1407d42bd10439fb42979bd323c889a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:55.852990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1407d42bd10439fb42979bd323c889a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:55.854944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:55.886125 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:55.938387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1407d42bd10439fb42979bd323c889a', 'request_id': 'req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.950099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1407d42bd10439fb42979bd323c889a', 'request_id': 'req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.959802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1407d42bd10439fb42979bd323c889a', 'request_id': 'req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.971749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] The token cache is being invalidate because project a1407d42bd10439fb42979bd323c889a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:28:55.972047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.972731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-52f8d8d8-3aeb-4fc3-8724-c41627cbf822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:28:55.974281 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3877/7756] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:28:55 2022] DELETE /identity/v3/projects/a1407d42bd10439fb42979bd323c889a => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:55.980245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c363f9-5b99-463b-b999-02503d199d64 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:55.980771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c363f9-5b99-463b-b999-02503d199d64 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:55.980771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c363f9-5b99-463b-b999-02503d199d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.001934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-45c363f9-5b99-463b-b999-02503d199d64 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:56.003321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-45c363f9-5b99-463b-b999-02503d199d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:56.080861 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:28:56.100696 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3880/7757] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:28:56.109964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d6e71-08fa-44e7-b695-9a0e06b4c7ac None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:56.110689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d6e71-08fa-44e7-b695-9a0e06b4c7ac None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:56.110689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829d6e71-08fa-44e7-b695-9a0e06b4c7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.140011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-829d6e71-08fa-44e7-b695-9a0e06b4c7ac None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:56.141570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-829d6e71-08fa-44e7-b695-9a0e06b4c7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:56.151870 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3878/7758] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:56.156201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c363f9-5b99-463b-b999-02503d199d64 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:56.167122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c363f9-5b99-463b-b999-02503d199d64 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:56.172368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e2d0-6421-41f1-8226-44f546a70287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:56.173112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e2d0-6421-41f1-8226-44f546a70287 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:56.173535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e2d0-6421-41f1-8226-44f546a70287 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:56.173918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2491e2d0-6421-41f1-8226-44f546a70287 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.174712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e2d0-6421-41f1-8226-44f546a70287 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:28:56.175114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e2d0-6421-41f1-8226-44f546a70287 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:56.176823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2491e2d0-6421-41f1-8226-44f546a70287 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:56.192785 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3881/7759] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:28:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:28:56.193975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d6e71-08fa-44e7-b695-9a0e06b4c7ac None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:56.205077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829d6e71-08fa-44e7-b695-9a0e06b4c7ac None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:56.210396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bb6d8-9f44-4fce-b145-8fa2523b975d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:56.211534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bb6d8-9f44-4fce-b145-8fa2523b975d admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:56.211862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bb6d8-9f44-4fce-b145-8fa2523b975d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:56.212086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037bb6d8-9f44-4fce-b145-8fa2523b975d admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.212964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bb6d8-9f44-4fce-b145-8fa2523b975d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:56.214922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-037bb6d8-9f44-4fce-b145-8fa2523b975d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:56.249501 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3879/7760] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:28:56 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:28:56.250645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e2d0-6421-41f1-8226-44f546a70287 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:56.261576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2491e2d0-6421-41f1-8226-44f546a70287 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:56.317693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca0f8d-5a84-440b-8284-343c77b2f17e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:56.318296 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca0f8d-5a84-440b-8284-343c77b2f17e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:56.318584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca0f8d-5a84-440b-8284-343c77b2f17e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:56.318861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ca0f8d-5a84-440b-8284-343c77b2f17e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.319497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca0f8d-5a84-440b-8284-343c77b2f17e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:56.321975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ca0f8d-5a84-440b-8284-343c77b2f17e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:56.344425 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3882/7761] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:28:56 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:28:56.348754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bb6d8-9f44-4fce-b145-8fa2523b975d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:56.359579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037bb6d8-9f44-4fce-b145-8fa2523b975d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:56.364421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45776f4-7aec-4036-b284-0d9478e06ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:56.364971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45776f4-7aec-4036-b284-0d9478e06ca2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:56.365259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45776f4-7aec-4036-b284-0d9478e06ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:56.365565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45776f4-7aec-4036-b284-0d9478e06ca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.366202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45776f4-7aec-4036-b284-0d9478e06ca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:56.367837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45776f4-7aec-4036-b284-0d9478e06ca2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:56.378087 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3880/7762] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:28:56.382779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca0f8d-5a84-440b-8284-343c77b2f17e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:56.392989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ca0f8d-5a84-440b-8284-343c77b2f17e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:56.397657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8424bc12-2be2-471f-bf5b-5e4cf70b0aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:56.398852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424bc12-2be2-471f-bf5b-5e4cf70b0aec admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:56.399132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424bc12-2be2-471f-bf5b-5e4cf70b0aec admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:56.399407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8424bc12-2be2-471f-bf5b-5e4cf70b0aec admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.400045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424bc12-2be2-471f-bf5b-5e4cf70b0aec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:56.401662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8424bc12-2be2-471f-bf5b-5e4cf70b0aec admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:56.412394 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3883/7763] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:28:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:28:56.416656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45776f4-7aec-4036-b284-0d9478e06ca2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:56.427078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45776f4-7aec-4036-b284-0d9478e06ca2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:56.431738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6266-cec3-4b34-a244-95237d77c757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:56.432380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6266-cec3-4b34-a244-95237d77c757 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:56.432662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6266-cec3-4b34-a244-95237d77c757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:56.432939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ea6266-cec3-4b34-a244-95237d77c757 admin admin] PATH_INFO: `/v3/projects/443fff9b40fc43118f2747b04cc319c9/users/4eef162278a345a88864ed6b4d09df43/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.448914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea6266-cec3-4b34-a244-95237d77c757 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443fff9b40fc43118f2747b04cc319c9, user_id=4eef162278a345a88864ed6b4d09df43, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:56.451567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ea6266-cec3-4b34-a244-95237d77c757 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:56.465743 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3881/7764] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:28:56 2022] PUT /identity/v3/projects/443fff9b40fc43118f2747b04cc319c9/users/4eef162278a345a88864ed6b4d09df43/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:28:56.476134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58e4a2-690a-4cd6-8106-921654ac9847 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:56.476555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58e4a2-690a-4cd6-8106-921654ac9847 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:56.476838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b58e4a2-690a-4cd6-8106-921654ac9847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.508622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3b58e4a2-690a-4cd6-8106-921654ac9847 None None] MFA Rules not processed for user `4eef162278a345a88864ed6b4d09df43`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:28:56.509872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3b58e4a2-690a-4cd6-8106-921654ac9847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:56.576599 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3884/7765] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:28:56 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:28:56.588075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6266-cec3-4b34-a244-95237d77c757 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:56.589909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a4ea6266-cec3-4b34-a244-95237d77c757 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:28:56.663322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ea6266-cec3-4b34-a244-95237d77c757 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:28:56.667117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090d662-a486-4f17-b34f-c58bc090f9e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:28:56.667727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090d662-a486-4f17-b34f-c58bc090f9e7 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:28:56.668009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090d662-a486-4f17-b34f-c58bc090f9e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:28:56.668284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6090d662-a486-4f17-b34f-c58bc090f9e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:28:56.677357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090d662-a486-4f17-b34f-c58bc090f9e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:28:56.678792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6090d662-a486-4f17-b34f-c58bc090f9e7 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:28:56.688258 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3882/7766] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:28:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:28:59.962274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58e4a2-690a-4cd6-8106-921654ac9847 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:28:59.963760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3b58e4a2-690a-4cd6-8106-921654ac9847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:00.018258 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:00.043253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b58e4a2-690a-4cd6-8106-921654ac9847 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:00.048754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554689b2-6bdf-4b3d-b08a-defbf32cfbb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:00.049399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554689b2-6bdf-4b3d-b08a-defbf32cfbb8 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:00.049667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554689b2-6bdf-4b3d-b08a-defbf32cfbb8 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:00.049945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554689b2-6bdf-4b3d-b08a-defbf32cfbb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:00.051781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-554689b2-6bdf-4b3d-b08a-defbf32cfbb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:00.124086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554689b2-6bdf-4b3d-b08a-defbf32cfbb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:00.126090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554689b2-6bdf-4b3d-b08a-defbf32cfbb8 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:00.135874 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3885/7767] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:28:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:29:00.471775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090d662-a486-4f17-b34f-c58bc090f9e7 service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:00.569252 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:00.614696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6090d662-a486-4f17-b34f-c58bc090f9e7 service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:00.627058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:00.628117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:00.628648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:00.629033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] PATH_INFO: `/v3/users/4eef162278a345a88864ed6b4d09df43` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:00.630871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4eef162278a345a88864ed6b4d09df43)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:00.640045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:00.716353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4eef162278a345a88864ed6b4d09df43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:00.732884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4eef162278a345a88864ed6b4d09df43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:00.734627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4eef162278a345a88864ed6b4d09df43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:00.747057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4eef162278a345a88864ed6b4d09df43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:00.763727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4eef162278a345a88864ed6b4d09df43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:00.781146 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3883/7768] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:00 2022] DELETE /identity/v3/users/4eef162278a345a88864ed6b4d09df43 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:00.785553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7d068-eeb6-4d7e-8a12-e0e3c35f2e61 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:00.785852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7d068-eeb6-4d7e-8a12-e0e3c35f2e61 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:00.786119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a7d068-eeb6-4d7e-8a12-e0e3c35f2e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:00.830327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-29a7d068-eeb6-4d7e-8a12-e0e3c35f2e61 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:00.831794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-29a7d068-eeb6-4d7e-8a12-e0e3c35f2e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:00.965042 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3886/7769] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:01.004028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:01.005792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:01.134224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da47a24-00b6-48d2-96af-e993c09c0723 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:01.139077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f46748e-93b3-4327-84c7-94192f9beb4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:01.139776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46748e-93b3-4327-84c7-94192f9beb4c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:01.140123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46748e-93b3-4327-84c7-94192f9beb4c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:01.140461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f46748e-93b3-4327-84c7-94192f9beb4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:01.157475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46748e-93b3-4327-84c7-94192f9beb4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:01.159427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f46748e-93b3-4327-84c7-94192f9beb4c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:01.171458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3884/7770] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:01.506925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7d068-eeb6-4d7e-8a12-e0e3c35f2e61 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:01.508437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-29a7d068-eeb6-4d7e-8a12-e0e3c35f2e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:01.531121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a7d068-eeb6-4d7e-8a12-e0e3c35f2e61 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:01.543078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:01.543729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:01.544009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:01.544288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] PATH_INFO: `/v3/projects/443fff9b40fc43118f2747b04cc319c9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:01.545455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] RBAC: Authorizing `identity:delete_project(project_id=443fff9b40fc43118f2747b04cc319c9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:01.547385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:01.640869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443fff9b40fc43118f2747b04cc319c9', 'request_id': 'req-495ba0f5-1e8c-4c88-ba06-5ed664980b31'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:01.655181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443fff9b40fc43118f2747b04cc319c9', 'request_id': 'req-495ba0f5-1e8c-4c88-ba06-5ed664980b31'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:01.677909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443fff9b40fc43118f2747b04cc319c9', 'request_id': 'req-495ba0f5-1e8c-4c88-ba06-5ed664980b31'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:01.702102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] The token cache is being invalidate because project 443fff9b40fc43118f2747b04cc319c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:01.702393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:01.703105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-495ba0f5-1e8c-4c88-ba06-5ed664980b31 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:01.710087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d70ea-8097-45ff-8f8c-0d824044299c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:01.711140 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3887/7771] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:01 2022] DELETE /identity/v3/projects/443fff9b40fc43118f2747b04cc319c9 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:01.711246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d70ea-8097-45ff-8f8c-0d824044299c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:01.711246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3d70ea-8097-45ff-8f8c-0d824044299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:01.776531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9d3d70ea-8097-45ff-8f8c-0d824044299c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:01.777799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9d3d70ea-8097-45ff-8f8c-0d824044299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:01.856112 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:01.887982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52e7c7-1da8-4f9d-b3c8-ebec5a2ae833 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:01.888268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52e7c7-1da8-4f9d-b3c8-ebec5a2ae833 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:01.888544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac52e7c7-1da8-4f9d-b3c8-ebec5a2ae833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:01.892001 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3885/7772] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:29:01.912497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ac52e7c7-1da8-4f9d-b3c8-ebec5a2ae833 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:01.914495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ac52e7c7-1da8-4f9d-b3c8-ebec5a2ae833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:01.922860 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3888/7773] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:01.927499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d70ea-8097-45ff-8f8c-0d824044299c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:01.939193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3d70ea-8097-45ff-8f8c-0d824044299c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:01.945393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8f3b9-444c-4d41-8037-d682aa8f43a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:01.946016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8f3b9-444c-4d41-8037-d682aa8f43a6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:01.946295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8f3b9-444c-4d41-8037-d682aa8f43a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:01.946570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8f3b9-444c-4d41-8037-d682aa8f43a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:01.947351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8f3b9-444c-4d41-8037-d682aa8f43a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:01.947660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8f3b9-444c-4d41-8037-d682aa8f43a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:01.949574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8f3b9-444c-4d41-8037-d682aa8f43a6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:01.969843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52e7c7-1da8-4f9d-b3c8-ebec5a2ae833 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:01.976880 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3886/7774] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:29:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:01.987758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac52e7c7-1da8-4f9d-b3c8-ebec5a2ae833 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:01.997503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7c359-87fd-4bea-8891-5a0b2dd823f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:01.998117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c359-87fd-4bea-8891-5a0b2dd823f3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:01.998400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c359-87fd-4bea-8891-5a0b2dd823f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:01.998676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c359-87fd-4bea-8891-5a0b2dd823f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:01.999330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7c359-87fd-4bea-8891-5a0b2dd823f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:02.001583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7c359-87fd-4bea-8891-5a0b2dd823f3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:02.007657 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:02.041545 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3889/7775] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:01 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:02.045606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8f3b9-444c-4d41-8037-d682aa8f43a6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:02.064731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8f3b9-444c-4d41-8037-d682aa8f43a6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:02.204023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53f65-d7cf-4421-aff3-5772f12325ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:02.204736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53f65-d7cf-4421-aff3-5772f12325ea admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:02.205086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53f65-d7cf-4421-aff3-5772f12325ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:02.205458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce53f65-d7cf-4421-aff3-5772f12325ea admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:02.210121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce53f65-d7cf-4421-aff3-5772f12325ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:02.214219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce53f65-d7cf-4421-aff3-5772f12325ea admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:02.252335 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3887/7776] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:02 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:02.254086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7c359-87fd-4bea-8891-5a0b2dd823f3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:02.267248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7c359-87fd-4bea-8891-5a0b2dd823f3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:02.282593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fcd77-ab30-4b42-b73c-c83c9434064a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:02.283365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fcd77-ab30-4b42-b73c-c83c9434064a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:02.283815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fcd77-ab30-4b42-b73c-c83c9434064a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:02.284180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4fcd77-ab30-4b42-b73c-c83c9434064a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:02.284908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fcd77-ab30-4b42-b73c-c83c9434064a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:02.289329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4fcd77-ab30-4b42-b73c-c83c9434064a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:02.301330 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3890/7777] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:02.303757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53f65-d7cf-4421-aff3-5772f12325ea admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:02.318754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce53f65-d7cf-4421-aff3-5772f12325ea admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:02.329492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15437f9b-7b4c-4794-91bd-c90b3b7ae9bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:02.330447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437f9b-7b4c-4794-91bd-c90b3b7ae9bf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:02.330870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437f9b-7b4c-4794-91bd-c90b3b7ae9bf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:02.331237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15437f9b-7b4c-4794-91bd-c90b3b7ae9bf admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:02.331980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15437f9b-7b4c-4794-91bd-c90b3b7ae9bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:02.335191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15437f9b-7b4c-4794-91bd-c90b3b7ae9bf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:02.369087 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3888/7778] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:02.369279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fcd77-ab30-4b42-b73c-c83c9434064a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:02.395989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4fcd77-ab30-4b42-b73c-c83c9434064a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:02.401935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0444e7-522f-4b15-853d-45e8df80a158 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:02.402610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0444e7-522f-4b15-853d-45e8df80a158 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:02.402892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0444e7-522f-4b15-853d-45e8df80a158 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:02.403170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0444e7-522f-4b15-853d-45e8df80a158 admin admin] PATH_INFO: `/v3/projects/443e55a070a345829f873546f6474ffe/users/79533b1e3d2049e69af8cf57a08ee1f3/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:02.421722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0444e7-522f-4b15-853d-45e8df80a158 admin admin] RBAC: Authorizing `identity:create_grant(project_id=443e55a070a345829f873546f6474ffe, user_id=79533b1e3d2049e69af8cf57a08ee1f3, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:02.424590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0444e7-522f-4b15-853d-45e8df80a158 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:02.456083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3891/7779] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:02 2022] PUT /identity/v3/projects/443e55a070a345829f873546f6474ffe/users/79533b1e3d2049e69af8cf57a08ee1f3/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:02.472291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81df8f-5704-4311-9af2-cca4736c20a3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:02.472291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81df8f-5704-4311-9af2-cca4736c20a3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:02.472291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81df8f-5704-4311-9af2-cca4736c20a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:02.538398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9e81df8f-5704-4311-9af2-cca4736c20a3 None None] MFA Rules not processed for user `79533b1e3d2049e69af8cf57a08ee1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:02.540266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e81df8f-5704-4311-9af2-cca4736c20a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:02.625631 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3889/7780] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:02.637288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0444e7-522f-4b15-853d-45e8df80a158 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:02.639266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d0444e7-522f-4b15-853d-45e8df80a158 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:02.739163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0444e7-522f-4b15-853d-45e8df80a158 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:02.754795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b332a4d-d128-4f16-a654-fa26c1334399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:02.755022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332a4d-d128-4f16-a654-fa26c1334399 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:02.756746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332a4d-d128-4f16-a654-fa26c1334399 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:02.757124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b332a4d-d128-4f16-a654-fa26c1334399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:02.775286 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332a4d-d128-4f16-a654-fa26c1334399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:02.777247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b332a4d-d128-4f16-a654-fa26c1334399 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:02.805059 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3892/7781] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:05.431963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b3b28-edeb-441e-9f52-4faaee23c152 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:05.433047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b3b28-edeb-441e-9f52-4faaee23c152 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:05.433780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62b3b28-edeb-441e-9f52-4faaee23c152 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:05.455848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e62b3b28-edeb-441e-9f52-4faaee23c152 None None] MFA Rules not processed for user `79533b1e3d2049e69af8cf57a08ee1f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:05.457618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e62b3b28-edeb-441e-9f52-4faaee23c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:05.474397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3890/7782] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:09.170026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b5d9-276f-427e-8f1a-9fdac2a1096c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:09.170956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b5d9-276f-427e-8f1a-9fdac2a1096c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:09.171236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e961b5d9-276f-427e-8f1a-9fdac2a1096c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:09.215693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e961b5d9-276f-427e-8f1a-9fdac2a1096c None None] MFA Rules not processed for user `e2fc124049504d579f6513b5cac00bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:09.217828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e961b5d9-276f-427e-8f1a-9fdac2a1096c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:09.310861 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3893/7783] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:09 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:14.513913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b3b28-edeb-441e-9f52-4faaee23c152 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:14.515519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e62b3b28-edeb-441e-9f52-4faaee23c152 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:14.575387 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:14.615724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62b3b28-edeb-441e-9f52-4faaee23c152 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:14.623476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:14.624303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:14.624712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:14.625139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] PATH_INFO: `/v3/users/5d7a7f0f195d400c983cf3fdc0834ad2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:14.627196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d7a7f0f195d400c983cf3fdc0834ad2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:14.629780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:14.752459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d7a7f0f195d400c983cf3fdc0834ad2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:14.773511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d7a7f0f195d400c983cf3fdc0834ad2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:14.774402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d7a7f0f195d400c983cf3fdc0834ad2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:14.786177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d7a7f0f195d400c983cf3fdc0834ad2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:14.796977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d7a7f0f195d400c983cf3fdc0834ad2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:14.807252 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3891/7784] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:14 2022] DELETE /identity/v3/users/5d7a7f0f195d400c983cf3fdc0834ad2 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:14.811743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afac96-26a4-40e1-b816-e572ce03609e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:14.812285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afac96-26a4-40e1-b816-e572ce03609e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:14.812285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0afac96-26a4-40e1-b816-e572ce03609e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:14.847335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f0afac96-26a4-40e1-b816-e572ce03609e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:14.849600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f0afac96-26a4-40e1-b816-e572ce03609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:14.955046 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:14.969329 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3894/7785] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:15.001848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:15.001848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:15.119782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aecd06b-e7ef-4bda-9d9c-fcca04b810bd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:15.123670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c2845-11c2-4f70-9a09-1a1867a51499 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:15.124381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c2845-11c2-4f70-9a09-1a1867a51499 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:15.124732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c2845-11c2-4f70-9a09-1a1867a51499 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:15.125078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c2845-11c2-4f70-9a09-1a1867a51499 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:15.135859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c2845-11c2-4f70-9a09-1a1867a51499 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:15.137523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c2845-11c2-4f70-9a09-1a1867a51499 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:15.148922 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3892/7786] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:16.202086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afac96-26a4-40e1-b816-e572ce03609e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:16.204488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f0afac96-26a4-40e1-b816-e572ce03609e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:16.228241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0afac96-26a4-40e1-b816-e572ce03609e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:16.240688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:16.241681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:16.242155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:16.242590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] PATH_INFO: `/v3/projects/3553c0c16fe44590b3fa8a2b35a2bf5a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:16.244217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3553c0c16fe44590b3fa8a2b35a2bf5a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:16.247681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:16.353384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'request_id': 'req-50b1a6df-e559-4102-bbf1-d91269b1b79b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:16.361713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'request_id': 'req-50b1a6df-e559-4102-bbf1-d91269b1b79b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:16.377689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3553c0c16fe44590b3fa8a2b35a2bf5a', 'request_id': 'req-50b1a6df-e559-4102-bbf1-d91269b1b79b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:16.408051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] The token cache is being invalidate because project 3553c0c16fe44590b3fa8a2b35a2bf5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:16.410089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:16.411065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50b1a6df-e559-4102-bbf1-d91269b1b79b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:16.413892 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3895/7787] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:16 2022] DELETE /identity/v3/projects/3553c0c16fe44590b3fa8a2b35a2bf5a => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:16.425496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a086e6-13c1-4b47-b448-ccc9a0d5e2d6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:16.426022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a086e6-13c1-4b47-b448-ccc9a0d5e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:16.426022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a086e6-13c1-4b47-b448-ccc9a0d5e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:16.470528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a7a086e6-13c1-4b47-b448-ccc9a0d5e2d6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:16.472052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7a086e6-13c1-4b47-b448-ccc9a0d5e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:16.570003 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:16.599681 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3893/7788] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:16.601522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820302-b774-4621-b1d0-e57d0d4bf7a0 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:16.601817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820302-b774-4621-b1d0-e57d0d4bf7a0 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:16.602116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98820302-b774-4621-b1d0-e57d0d4bf7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:16.650300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-98820302-b774-4621-b1d0-e57d0d4bf7a0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:16.652698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-98820302-b774-4621-b1d0-e57d0d4bf7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:16.671198 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3896/7789] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:16.675517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a086e6-13c1-4b47-b448-ccc9a0d5e2d6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:16.688765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a086e6-13c1-4b47-b448-ccc9a0d5e2d6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:16.696290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ec250-b432-4328-a561-df0209775cd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:16.697009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ec250-b432-4328-a561-df0209775cd5 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:16.698519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ec250-b432-4328-a561-df0209775cd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:16.698807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166ec250-b432-4328-a561-df0209775cd5 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:16.699486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ec250-b432-4328-a561-df0209775cd5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:16.699979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ec250-b432-4328-a561-df0209775cd5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:16.701596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166ec250-b432-4328-a561-df0209775cd5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:16.723227 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3894/7790] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:29:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:16.728604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98820302-b774-4621-b1d0-e57d0d4bf7a0 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:16.744062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98820302-b774-4621-b1d0-e57d0d4bf7a0 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:16.749997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458e58f-fc46-4114-98c3-f80e0657b358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:16.751431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458e58f-fc46-4114-98c3-f80e0657b358 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:16.752770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458e58f-fc46-4114-98c3-f80e0657b358 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:16.753068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e458e58f-fc46-4114-98c3-f80e0657b358 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:16.753750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458e58f-fc46-4114-98c3-f80e0657b358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:16.759683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e458e58f-fc46-4114-98c3-f80e0657b358 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:16.835491 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3897/7791] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:16 2022] POST /identity/v3/projects => generated 367 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:16.840193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ec250-b432-4328-a561-df0209775cd5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:16.867250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166ec250-b432-4328-a561-df0209775cd5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:16.969933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10998aef-23ec-4524-8900-d86584c905b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:16.971611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10998aef-23ec-4524-8900-d86584c905b0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:16.972861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10998aef-23ec-4524-8900-d86584c905b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:16.973404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10998aef-23ec-4524-8900-d86584c905b0 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:16.974273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10998aef-23ec-4524-8900-d86584c905b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:16.976980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10998aef-23ec-4524-8900-d86584c905b0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:17.015034 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3895/7792] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:16 2022] POST /identity/v3/users => generated 284 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:17.019006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458e58f-fc46-4114-98c3-f80e0657b358 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:17.031582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e458e58f-fc46-4114-98c3-f80e0657b358 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:17.038924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d02b4-f579-45cf-9096-2568e46a6aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:17.042013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d02b4-f579-45cf-9096-2568e46a6aba admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:17.042473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d02b4-f579-45cf-9096-2568e46a6aba admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:17.042936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d02b4-f579-45cf-9096-2568e46a6aba admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:17.043778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d02b4-f579-45cf-9096-2568e46a6aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:17.051149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d02b4-f579-45cf-9096-2568e46a6aba admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:17.080849 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3898/7793] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:17.085732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10998aef-23ec-4524-8900-d86584c905b0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:17.102680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10998aef-23ec-4524-8900-d86584c905b0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:17.117385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7a9728-76fc-4441-b498-7348f78cd190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:17.118606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a9728-76fc-4441-b498-7348f78cd190 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:17.118970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a9728-76fc-4441-b498-7348f78cd190 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:17.119322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a9728-76fc-4441-b498-7348f78cd190 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:17.120057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a9728-76fc-4441-b498-7348f78cd190 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:17.121839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7a9728-76fc-4441-b498-7348f78cd190 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:17.159248 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3896/7794] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:17.165907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d02b4-f579-45cf-9096-2568e46a6aba admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:17.186628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d02b4-f579-45cf-9096-2568e46a6aba admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:17.199406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd4357-958e-4402-8e37-ad3cf6bc01a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:17.200255 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd4357-958e-4402-8e37-ad3cf6bc01a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:17.203198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd4357-958e-4402-8e37-ad3cf6bc01a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:17.204394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd4357-958e-4402-8e37-ad3cf6bc01a2 admin admin] PATH_INFO: `/v3/projects/39a90c69870345729299dc5437652de4/users/edb5746c41eb4392aa2e7efc6eb2f86f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:17.242969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd4357-958e-4402-8e37-ad3cf6bc01a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39a90c69870345729299dc5437652de4, user_id=edb5746c41eb4392aa2e7efc6eb2f86f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:17.246328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd4357-958e-4402-8e37-ad3cf6bc01a2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:17.262957 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3899/7795] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:17 2022] PUT /identity/v3/projects/39a90c69870345729299dc5437652de4/users/edb5746c41eb4392aa2e7efc6eb2f86f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:17.275359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60014b5-d1c8-4a62-a86b-ec25160d9a1c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:17.275658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60014b5-d1c8-4a62-a86b-ec25160d9a1c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:17.275926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60014b5-d1c8-4a62-a86b-ec25160d9a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:17.312792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d60014b5-d1c8-4a62-a86b-ec25160d9a1c None None] MFA Rules not processed for user `edb5746c41eb4392aa2e7efc6eb2f86f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:17.315145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d60014b5-d1c8-4a62-a86b-ec25160d9a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:17.435042 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3897/7796] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:17 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:17.439640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd4357-958e-4402-8e37-ad3cf6bc01a2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:17.579911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd4357-958e-4402-8e37-ad3cf6bc01a2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:17.593887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e859797-c7b3-451f-a880-871140c9b15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:17.594791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e859797-c7b3-451f-a880-871140c9b15b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:17.596327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e859797-c7b3-451f-a880-871140c9b15b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:17.596784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e859797-c7b3-451f-a880-871140c9b15b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:17.597760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e859797-c7b3-451f-a880-871140c9b15b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:17.603067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e859797-c7b3-451f-a880-871140c9b15b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:17.690447 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3900/7797] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:17 2022] POST /identity/v3/projects => generated 367 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:17.691687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60014b5-d1c8-4a62-a86b-ec25160d9a1c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:17.704486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60014b5-d1c8-4a62-a86b-ec25160d9a1c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:17.829975 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:17.849282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94baef-fe7c-416b-b5d4-c38fe6a8888a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:17.849282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94baef-fe7c-416b-b5d4-c38fe6a8888a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:17.849282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94baef-fe7c-416b-b5d4-c38fe6a8888a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:17.849282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94baef-fe7c-416b-b5d4-c38fe6a8888a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:17.849795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94baef-fe7c-416b-b5d4-c38fe6a8888a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:17.850230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94baef-fe7c-416b-b5d4-c38fe6a8888a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:17.894823 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3898/7798] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:17 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:17.900147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e859797-c7b3-451f-a880-871140c9b15b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:17.910565 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:17.920908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e859797-c7b3-451f-a880-871140c9b15b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:17.928585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1d55-899f-42c7-bb90-06fa075ca0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:17.929609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1d55-899f-42c7-bb90-06fa075ca0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:17.930277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1d55-899f-42c7-bb90-06fa075ca0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:17.931080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f1d55-899f-42c7-bb90-06fa075ca0d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:17.932716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f1d55-899f-42c7-bb90-06fa075ca0d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:17.936420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f1d55-899f-42c7-bb90-06fa075ca0d8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:17.952097 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3901/7799] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:17 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:17.956497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94baef-fe7c-416b-b5d4-c38fe6a8888a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:17.973165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94baef-fe7c-416b-b5d4-c38fe6a8888a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:17.989897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c016f-91b1-49d2-9df2-17ce4fe72bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:17.990574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c016f-91b1-49d2-9df2-17ce4fe72bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:17.990996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c016f-91b1-49d2-9df2-17ce4fe72bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:17.991697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c016f-91b1-49d2-9df2-17ce4fe72bc3 admin admin] PATH_INFO: `/v3/projects/e3a96f41b9c94ed7ab01a5d10480c91b/users/ef05e86d01d942b7a7211fc80bd8cc64/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:18.024782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c016f-91b1-49d2-9df2-17ce4fe72bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a96f41b9c94ed7ab01a5d10480c91b, user_id=ef05e86d01d942b7a7211fc80bd8cc64, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:18.028765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c016f-91b1-49d2-9df2-17ce4fe72bc3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:18.073542 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3899/7800] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:17 2022] PUT /identity/v3/projects/e3a96f41b9c94ed7ab01a5d10480c91b/users/ef05e86d01d942b7a7211fc80bd8cc64/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:18.074795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1d55-899f-42c7-bb90-06fa075ca0d8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:18.102123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f1d55-899f-42c7-bb90-06fa075ca0d8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:18.218366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0081779-83bc-4242-9675-d74d3d39c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:18.219132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081779-83bc-4242-9675-d74d3d39c109 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:18.219650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081779-83bc-4242-9675-d74d3d39c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:18.220020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0081779-83bc-4242-9675-d74d3d39c109 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:18.220761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081779-83bc-4242-9675-d74d3d39c109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:18.222497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0081779-83bc-4242-9675-d74d3d39c109 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:18.235124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3902/7801] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:18 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:18.238556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c016f-91b1-49d2-9df2-17ce4fe72bc3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:18.249089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c016f-91b1-49d2-9df2-17ce4fe72bc3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:18.254806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c22be-3239-44be-91e2-1f7babcd8e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:18.255065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c22be-3239-44be-91e2-1f7babcd8e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:18.255320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c22be-3239-44be-91e2-1f7babcd8e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:18.255909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6c22be-3239-44be-91e2-1f7babcd8e8e admin admin] PATH_INFO: `/v3/projects/e3a96f41b9c94ed7ab01a5d10480c91b/users/ef05e86d01d942b7a7211fc80bd8cc64/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:18.257899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c22be-3239-44be-91e2-1f7babcd8e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3a96f41b9c94ed7ab01a5d10480c91b, user_id=ef05e86d01d942b7a7211fc80bd8cc64, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:18.260871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6c22be-3239-44be-91e2-1f7babcd8e8e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:18.273910 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3900/7802] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:18 2022] PUT /identity/v3/projects/e3a96f41b9c94ed7ab01a5d10480c91b/users/ef05e86d01d942b7a7211fc80bd8cc64/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:18.284110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6c7bb-43c2-4dda-973e-5f3461ef802c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:18.284399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6c7bb-43c2-4dda-973e-5f3461ef802c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:18.284700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6c7bb-43c2-4dda-973e-5f3461ef802c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:18.314772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-eef6c7bb-43c2-4dda-973e-5f3461ef802c None None] MFA Rules not processed for user `ef05e86d01d942b7a7211fc80bd8cc64`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:18.315993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eef6c7bb-43c2-4dda-973e-5f3461ef802c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:18.394077 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3903/7803] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:29:18.399777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c22be-3239-44be-91e2-1f7babcd8e8e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:18.416231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6c22be-3239-44be-91e2-1f7babcd8e8e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:18.440059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f11ac8-a5cb-4bb6-bbb5-9b6c95f3175a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:18.441825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f11ac8-a5cb-4bb6-bbb5-9b6c95f3175a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:18.442273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f11ac8-a5cb-4bb6-bbb5-9b6c95f3175a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:18.442705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f11ac8-a5cb-4bb6-bbb5-9b6c95f3175a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:18.443682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f11ac8-a5cb-4bb6-bbb5-9b6c95f3175a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:18.446109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f11ac8-a5cb-4bb6-bbb5-9b6c95f3175a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:18.473859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6c7bb-43c2-4dda-973e-5f3461ef802c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:18.482205 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3901/7804] 10.222.0.25 () {60 vars in 1150 bytes} [Mon Oct 24 09:29:18 2022] POST /identity/v3/domains => generated 276 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:18.486095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6c7bb-43c2-4dda-973e-5f3461ef802c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:18.569728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a310ce7-4481-41b8-8e9a-888581a7f29a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:18.570899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310ce7-4481-41b8-8e9a-888581a7f29a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:18.571345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310ce7-4481-41b8-8e9a-888581a7f29a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:18.571808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a310ce7-4481-41b8-8e9a-888581a7f29a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:18.572639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a310ce7-4481-41b8-8e9a-888581a7f29a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:18.574707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a310ce7-4481-41b8-8e9a-888581a7f29a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:18.597782 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3904/7805] 10.222.0.25 () {60 vars in 1150 bytes} [Mon Oct 24 09:29:18 2022] POST /identity/v3/domains => generated 277 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:18.602618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f11ac8-a5cb-4bb6-bbb5-9b6c95f3175a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:18.620713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f11ac8-a5cb-4bb6-bbb5-9b6c95f3175a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:18.691373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7950-3719-4e6c-a431-e36b676106f0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:18.697828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7950-3719-4e6c-a431-e36b676106f0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:18.698859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7950-3719-4e6c-a431-e36b676106f0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:18.699138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dd7950-3719-4e6c-a431-e36b676106f0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:18.699860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd7950-3719-4e6c-a431-e36b676106f0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:18.701898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dd7950-3719-4e6c-a431-e36b676106f0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:18.724260 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3902/7806] 10.222.0.25 () {60 vars in 1150 bytes} [Mon Oct 24 09:29:18 2022] POST /identity/v3/domains => generated 276 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:18.726329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a310ce7-4481-41b8-8e9a-888581a7f29a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:18.742545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a310ce7-4481-41b8-8e9a-888581a7f29a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:18.747380 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:18.808115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dc2c5-315c-47d7-9735-3277b4b5d9fe tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:18.808997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dc2c5-315c-47d7-9735-3277b4b5d9fe tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:18.809363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dc2c5-315c-47d7-9735-3277b4b5d9fe tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:18.809648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8dc2c5-315c-47d7-9735-3277b4b5d9fe tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:18.810379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dc2c5-315c-47d7-9735-3277b4b5d9fe tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:18.812057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8dc2c5-315c-47d7-9735-3277b4b5d9fe tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:18.834292 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3905/7807] 10.222.0.25 () {60 vars in 1150 bytes} [Mon Oct 24 09:29:18 2022] POST /identity/v3/domains => generated 280 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:18.835575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7950-3719-4e6c-a431-e36b676106f0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:18.863371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dd7950-3719-4e6c-a431-e36b676106f0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:18.983893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:18.984721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:18.985068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:18.985434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/9536c0fde9504c2d8ae078d255afdf43` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:19.000936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=9536c0fde9504c2d8ae078d255afdf43)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:19.002765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:19.035292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '9536c0fde9504c2d8ae078d255afdf43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.036136 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:19.040460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '9536c0fde9504c2d8ae078d255afdf43'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.200293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9536c0fde9504c2d8ae078d255afdf43', 'request_id': 'req-983e2970-3a5f-41fa-bbd1-e4796a44469a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.211786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9536c0fde9504c2d8ae078d255afdf43', 'request_id': 'req-983e2970-3a5f-41fa-bbd1-e4796a44469a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.239618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9536c0fde9504c2d8ae078d255afdf43', 'request_id': 'req-983e2970-3a5f-41fa-bbd1-e4796a44469a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.271693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] The token cache is being invalidate because project 9536c0fde9504c2d8ae078d255afdf43 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:19.272921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.278343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.315422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '9536c0fde9504c2d8ae078d255afdf43', 'request_id': 'req-983e2970-3a5f-41fa-bbd1-e4796a44469a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.317101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '9536c0fde9504c2d8ae078d255afdf43', 'request_id': 'req-983e2970-3a5f-41fa-bbd1-e4796a44469a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.318747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '9536c0fde9504c2d8ae078d255afdf43', 'request_id': 'req-983e2970-3a5f-41fa-bbd1-e4796a44469a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.354099 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3903/7808] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:18 2022] DELETE /identity/v3/domains/9536c0fde9504c2d8ae078d255afdf43 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:19.359519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dc2c5-315c-47d7-9735-3277b4b5d9fe tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:19.361377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4f8dc2c5-315c-47d7-9735-3277b4b5d9fe tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:19.386843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8dc2c5-315c-47d7-9735-3277b4b5d9fe tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:19.525192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79356e08-8ec2-4424-9e39-e52049e3616f tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:19.525945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79356e08-8ec2-4424-9e39-e52049e3616f tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:19.526230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79356e08-8ec2-4424-9e39-e52049e3616f tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:19.526509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79356e08-8ec2-4424-9e39-e52049e3616f tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:19.527208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79356e08-8ec2-4424-9e39-e52049e3616f tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:19.530226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79356e08-8ec2-4424-9e39-e52049e3616f tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:19.570346 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3906/7809] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:29:19 2022] POST /identity/v3/domains => generated 249 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:19.574820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:19.591725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983e2970-3a5f-41fa-bbd1-e4796a44469a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:19.795924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:19.796734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:19.797027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:19.797332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/0b2e812ec3124e5b898b54c632687bbd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:19.827199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=0b2e812ec3124e5b898b54c632687bbd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:19.829512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:19.898033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.899061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.958595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.959514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:19.963023 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3904/7810] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:29:19 2022] PATCH /identity/v3/domains/0b2e812ec3124e5b898b54c632687bbd => generated 250 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:19.966923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79356e08-8ec2-4424-9e39-e52049e3616f tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:19.968758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-79356e08-8ec2-4424-9e39-e52049e3616f tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:20.004517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79356e08-8ec2-4424-9e39-e52049e3616f tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:20.084936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:20.085944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:20.086414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:20.086873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/0b2e812ec3124e5b898b54c632687bbd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:20.108137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=0b2e812ec3124e5b898b54c632687bbd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:20.109922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:20.136961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.141204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.144089 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:20.219360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd', 'request_id': 'req-9228923d-6a09-42e1-b86a-31d89981c534'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.233458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd', 'request_id': 'req-9228923d-6a09-42e1-b86a-31d89981c534'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.244664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd', 'request_id': 'req-9228923d-6a09-42e1-b86a-31d89981c534'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.257089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] The token cache is being invalidate because project 0b2e812ec3124e5b898b54c632687bbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:20.257574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.258230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.267501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd', 'request_id': 'req-9228923d-6a09-42e1-b86a-31d89981c534'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.268330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd', 'request_id': 'req-9228923d-6a09-42e1-b86a-31d89981c534'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.269120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '0b2e812ec3124e5b898b54c632687bbd', 'request_id': 'req-9228923d-6a09-42e1-b86a-31d89981c534'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.280748 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3907/7811] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:19 2022] DELETE /identity/v3/domains/0b2e812ec3124e5b898b54c632687bbd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:20.285576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:20.298548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412c7c6-5c38-47a2-8af4-06900cca7cb4 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:20.325204 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:20.392927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a77f2-7fff-4406-b17e-ef0172d3015a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:20.394365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a77f2-7fff-4406-b17e-ef0172d3015a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:20.394655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a77f2-7fff-4406-b17e-ef0172d3015a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:20.395029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78a77f2-7fff-4406-b17e-ef0172d3015a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:20.395769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a77f2-7fff-4406-b17e-ef0172d3015a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:20.397591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78a77f2-7fff-4406-b17e-ef0172d3015a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:20.419801 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3905/7812] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:29:20 2022] POST /identity/v3/domains => generated 277 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:20.425649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:20.427904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:20.442705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228923d-6a09-42e1-b86a-31d89981c534 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:20.504723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:20.505665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:20.505958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:20.506233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/cfc97a38ecaa44f79e931be70b59e9d5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:20.518518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=cfc97a38ecaa44f79e931be70b59e9d5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:20.520533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:20.549456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.550618 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.586102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.587001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.590380 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3908/7813] 10.222.0.25 () {60 vars in 1250 bytes} [Mon Oct 24 09:29:20 2022] PATCH /identity/v3/domains/cfc97a38ecaa44f79e931be70b59e9d5 => generated 277 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:20.594666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a77f2-7fff-4406-b17e-ef0172d3015a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:20.598942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c78a77f2-7fff-4406-b17e-ef0172d3015a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:20.617782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78a77f2-7fff-4406-b17e-ef0172d3015a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:20.694151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691b49-41ec-41ae-b945-3b76d2cd30af tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:20.695071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691b49-41ec-41ae-b945-3b76d2cd30af tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:20.695530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691b49-41ec-41ae-b945-3b76d2cd30af tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:20.695963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f691b49-41ec-41ae-b945-3b76d2cd30af tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/cfc97a38ecaa44f79e931be70b59e9d5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:20.713005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f691b49-41ec-41ae-b945-3b76d2cd30af tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=cfc97a38ecaa44f79e931be70b59e9d5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:20.715605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f691b49-41ec-41ae-b945-3b76d2cd30af tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:20.718068 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3906/7814] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:29:20 2022] GET /identity/v3/domains/cfc97a38ecaa44f79e931be70b59e9d5 => generated 277 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:20.722182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:20.738644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295a62b4-e956-43be-9616-f3dcb08876ed tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:20.743591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:20.744237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:20.744520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:20.744794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/cfc97a38ecaa44f79e931be70b59e9d5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:20.746884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=cfc97a38ecaa44f79e931be70b59e9d5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:20.748976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:20.799379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.808125 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=1,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:20.811813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.894061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5', 'request_id': 'req-10383ebe-a071-4dfd-b664-3f5558fbc921'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.907217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5', 'request_id': 'req-10383ebe-a071-4dfd-b664-3f5558fbc921'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.929882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5', 'request_id': 'req-10383ebe-a071-4dfd-b664-3f5558fbc921'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.973218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] The token cache is being invalidate because project cfc97a38ecaa44f79e931be70b59e9d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:20.973577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:20.976623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:21.015351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5', 'request_id': 'req-10383ebe-a071-4dfd-b664-3f5558fbc921'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:21.016636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5', 'request_id': 'req-10383ebe-a071-4dfd-b664-3f5558fbc921'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:21.017760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'cfc97a38ecaa44f79e931be70b59e9d5', 'request_id': 'req-10383ebe-a071-4dfd-b664-3f5558fbc921'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:21.032931 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3909/7815] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:20 2022] DELETE /identity/v3/domains/cfc97a38ecaa44f79e931be70b59e9d5 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:21.036659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691b49-41ec-41ae-b945-3b76d2cd30af tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:21.039044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0f691b49-41ec-41ae-b945-3b76d2cd30af tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:21.089897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f691b49-41ec-41ae-b945-3b76d2cd30af tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:21.216434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d811-f6c3-40c7-9f44-ebd3e74d4e24 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:21.217012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d811-f6c3-40c7-9f44-ebd3e74d4e24 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:21.217321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d811-f6c3-40c7-9f44-ebd3e74d4e24 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:21.217611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9958d811-f6c3-40c7-9f44-ebd3e74d4e24 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:21.218228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958d811-f6c3-40c7-9f44-ebd3e74d4e24 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:21.219919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9958d811-f6c3-40c7-9f44-ebd3e74d4e24 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:21.238496 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3907/7816] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 09:29:21 2022] GET /identity/v3/domains => generated 1347 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:21.240317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:21.255313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10383ebe-a071-4dfd-b664-3f5558fbc921 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:21.268974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57947e1-02f0-4651-b559-459c5f2182d0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:21.270506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57947e1-02f0-4651-b559-459c5f2182d0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:21.270506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57947e1-02f0-4651-b559-459c5f2182d0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:21.270506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57947e1-02f0-4651-b559-459c5f2182d0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/cfc97a38ecaa44f79e931be70b59e9d5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:21.286462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57947e1-02f0-4651-b559-459c5f2182d0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-c57947e1-02f0-4651-b559-459c5f2182d0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Could not find domain: cfc97a38ecaa44f79e931be70b59e9d5.: keystone.exception.DomainNotFound: Could not find domain: cfc97a38ecaa44f79e931be70b59e9d5. Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: cfc97a38ecaa44f79e931be70b59e9d5. Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:21.295130 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:21.296137 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: cfc97a38ecaa44f79e931be70b59e9d5. Oct 24 09:29:21.297543 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:21.298615 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3910/7817] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:29:21 2022] PATCH /identity/v3/domains/cfc97a38ecaa44f79e931be70b59e9d5 => generated 112 bytes in 57 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:21.301522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d811-f6c3-40c7-9f44-ebd3e74d4e24 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:21.329740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9958d811-f6c3-40c7-9f44-ebd3e74d4e24 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:21.338980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b51789-5577-4132-907f-0e7e9c4a5b90 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:21.339264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b51789-5577-4132-907f-0e7e9c4a5b90 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:21.339557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b51789-5577-4132-907f-0e7e9c4a5b90 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:21.339837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b51789-5577-4132-907f-0e7e9c4a5b90 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:21.340810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b51789-5577-4132-907f-0e7e9c4a5b90 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:21.342543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b51789-5577-4132-907f-0e7e9c4a5b90 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:21.376311 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3908/7818] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:29:21 2022] POST /identity/v3/domains => generated 277 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:21.380961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57947e1-02f0-4651-b559-459c5f2182d0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:21.396860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57947e1-02f0-4651-b559-459c5f2182d0 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:21.470676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce140-5809-498f-a16b-15107c31a00a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:21.471329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce140-5809-498f-a16b-15107c31a00a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:21.471655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce140-5809-498f-a16b-15107c31a00a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:21.472005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883ce140-5809-498f-a16b-15107c31a00a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:21.472965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ce140-5809-498f-a16b-15107c31a00a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:21.476299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883ce140-5809-498f-a16b-15107c31a00a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:21.530581 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3911/7819] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:21 2022] POST /identity/v3/users => generated 346 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:21.531743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b51789-5577-4132-907f-0e7e9c4a5b90 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:21.549734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b51789-5577-4132-907f-0e7e9c4a5b90 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:21.556185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ae8e9-4319-4294-8d43-07a36964a9b5 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:21.556968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae8e9-4319-4294-8d43-07a36964a9b5 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:21.557370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae8e9-4319-4294-8d43-07a36964a9b5 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:21.557723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ae8e9-4319-4294-8d43-07a36964a9b5 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/groups` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:21.558491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ae8e9-4319-4294-8d43-07a36964a9b5 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:create_group()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:21.560651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ae8e9-4319-4294-8d43-07a36964a9b5 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:21.581653 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3909/7820] 10.222.0.25 () {60 vars in 1147 bytes} [Mon Oct 24 09:29:21 2022] POST /identity/v3/groups => generated 325 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:21.586300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce140-5809-498f-a16b-15107c31a00a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:21.610806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883ce140-5809-498f-a16b-15107c31a00a tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:21.624603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:21.626897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:21.628189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:21.628189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:21.631161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=11eb1bf70eec460c9bf01ae9c61907a2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:21.633613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:21.685214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:21.686345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:21.719702 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84,keystone:DELETE=11,keystone:INSERT=4,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:21.726314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:21.727751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:21.735049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ae8e9-4319-4294-8d43-07a36964a9b5 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:21.735718 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3912/7821] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:29:21 2022] PATCH /identity/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2 => generated 278 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:29:21.736915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-071ae8e9-4319-4294-8d43-07a36964a9b5 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:21.753627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ae8e9-4319-4294-8d43-07a36964a9b5 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:21.769200 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:21.828938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:21.829975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:21.830324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:21.831017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:21.843809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=11eb1bf70eec460c9bf01ae9c61907a2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:21.845602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:21.869923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:21.873681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.045676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175e69f8468941849a4949dbab43cd8c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.059929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175e69f8468941849a4949dbab43cd8c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.060773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175e69f8468941849a4949dbab43cd8c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.073066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175e69f8468941849a4949dbab43cd8c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.097216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175e69f8468941849a4949dbab43cd8c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.098623 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:22.166298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2', 'request_id': 'req-9097bf5e-0285-4578-af52-2add7c3d7a28'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.175586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2', 'request_id': 'req-9097bf5e-0285-4578-af52-2add7c3d7a28'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.185929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2', 'request_id': 'req-9097bf5e-0285-4578-af52-2add7c3d7a28'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.207197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] The token cache is being invalidate because project 11eb1bf70eec460c9bf01ae9c61907a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:22.208260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.209061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.220505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2', 'request_id': 'req-9097bf5e-0285-4578-af52-2add7c3d7a28'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.221600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2', 'request_id': 'req-9097bf5e-0285-4578-af52-2add7c3d7a28'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.222343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '11eb1bf70eec460c9bf01ae9c61907a2', 'request_id': 'req-9097bf5e-0285-4578-af52-2add7c3d7a28'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:22.241349 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3910/7822] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:21 2022] DELETE /identity/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:22.242704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.254099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c34331d-d903-4416-8192-0db5548797de tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.331532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445109f-6da8-4850-a75a-3877fd2ac8cb tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.332206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445109f-6da8-4850-a75a-3877fd2ac8cb tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.333071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445109f-6da8-4850-a75a-3877fd2ac8cb tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.333394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a445109f-6da8-4850-a75a-3877fd2ac8cb tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.343739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445109f-6da8-4850-a75a-3877fd2ac8cb tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:get_domain(domain_id=11eb1bf70eec460c9bf01ae9c61907a2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:22.345815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a445109f-6da8-4850-a75a-3877fd2ac8cb tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-a445109f-6da8-4850-a75a-3877fd2ac8cb tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Could not find domain: 11eb1bf70eec460c9bf01ae9c61907a2.: keystone.exception.DomainNotFound: Could not find domain: 11eb1bf70eec460c9bf01ae9c61907a2. Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 11eb1bf70eec460c9bf01ae9c61907a2. Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:22.359099 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:29:22.360150 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 11eb1bf70eec460c9bf01ae9c61907a2. Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:22.361178 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3913/7823] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:29:22 2022] GET /identity/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2 => generated 112 bytes in 118 msecs (HTTP/1.1 404) 5 headers in 184 bytes (2 switches on core 0) Oct 24 09:29:22.365539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.370492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:22.397648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097bf5e-0285-4578-af52-2add7c3d7a28 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.408480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed80079-16a4-4329-a752-e3c736552533 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.409187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed80079-16a4-4329-a752-e3c736552533 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.409506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed80079-16a4-4329-a752-e3c736552533 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.410565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed80079-16a4-4329-a752-e3c736552533 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/users/175e69f8468941849a4949dbab43cd8c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.441431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed80079-16a4-4329-a752-e3c736552533 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:get_user(user_id=175e69f8468941849a4949dbab43cd8c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:22.447735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed80079-16a4-4329-a752-e3c736552533 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-aed80079-16a4-4329-a752-e3c736552533 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Could not find user: 175e69f8468941849a4949dbab43cd8c.: keystone.exception.UserNotFound: Could not find user: 175e69f8468941849a4949dbab43cd8c. Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 24 09:29:22.472560 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:29:22.473884 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 175e69f8468941849a4949dbab43cd8c. Oct 24 09:29:22.475077 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:29:22.476856 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3911/7824] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:29:22 2022] GET /identity/v3/users/175e69f8468941849a4949dbab43cd8c => generated 110 bytes in 112 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:22.479559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445109f-6da8-4850-a75a-3877fd2ac8cb tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.492761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a445109f-6da8-4850-a75a-3877fd2ac8cb tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.507971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da3b2-6fda-42b4-a24f-0eb092f3f7c8 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.514408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da3b2-6fda-42b4-a24f-0eb092f3f7c8 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.514933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da3b2-6fda-42b4-a24f-0eb092f3f7c8 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.515411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3da3b2-6fda-42b4-a24f-0eb092f3f7c8 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/groups/40e4a7ba3e5141edb1baff520f72c756` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.523146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3da3b2-6fda-42b4-a24f-0eb092f3f7c8 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:get_group(group_id=40e4a7ba3e5141edb1baff520f72c756)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:22.525274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3da3b2-6fda-42b4-a24f-0eb092f3f7c8 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-3e3da3b2-6fda-42b4-a24f-0eb092f3f7c8 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Could not find group: 40e4a7ba3e5141edb1baff520f72c756.: keystone.exception.GroupNotFound: Could not find group: 40e4a7ba3e5141edb1baff520f72c756. Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 58, in get Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_group(group_id) Oct 24 09:29:22.548783 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 70, in _get_group Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.identity_api.get_group(group_id)) Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:29:22.549913 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 40e4a7ba3e5141edb1baff520f72c756. Oct 24 09:29:22.550927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:22.563890 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3914/7825] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:22 2022] GET /identity/v3/groups/40e4a7ba3e5141edb1baff520f72c756 => generated 111 bytes in 85 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:22.568165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed80079-16a4-4329-a752-e3c736552533 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.579359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed80079-16a4-4329-a752-e3c736552533 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.584604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260374d4-44bb-4646-996b-8d94a3c379cd tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.585428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260374d4-44bb-4646-996b-8d94a3c379cd tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.585637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260374d4-44bb-4646-996b-8d94a3c379cd tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.585828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260374d4-44bb-4646-996b-8d94a3c379cd tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/groups/40e4a7ba3e5141edb1baff520f72c756` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.594088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260374d4-44bb-4646-996b-8d94a3c379cd tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-260374d4-44bb-4646-996b-8d94a3c379cd tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Could not find group: 40e4a7ba3e5141edb1baff520f72c756.: keystone.exception.GroupNotFound: Could not find group: 40e4a7ba3e5141edb1baff520f72c756. Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/groups.py", line 133, in delete Oct 24 09:29:22.599710 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_group') Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:29:22.601219 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1262, in get_group Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ref = driver.get_group(entity_id) Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 417, in get_group Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_group(session, group_id).to_dict() Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 412, in _get_group Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.GroupNotFound(group_id=group_id) Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.GroupNotFound: Could not find group: 40e4a7ba3e5141edb1baff520f72c756. Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:29:22.605543 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3912/7826] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:29:22 2022] DELETE /identity/v3/groups/40e4a7ba3e5141edb1baff520f72c756 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:22.606707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da3b2-6fda-42b4-a24f-0eb092f3f7c8 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.622540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3da3b2-6fda-42b4-a24f-0eb092f3f7c8 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.631812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48a578-50dd-40e7-803f-d71b9f46eb13 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.632514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a578-50dd-40e7-803f-d71b9f46eb13 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.632738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a578-50dd-40e7-803f-d71b9f46eb13 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.633567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a578-50dd-40e7-803f-d71b9f46eb13 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/users/175e69f8468941849a4949dbab43cd8c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.645170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48a578-50dd-40e7-803f-d71b9f46eb13 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:delete_user(user_id=175e69f8468941849a4949dbab43cd8c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:22.647979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48a578-50dd-40e7-803f-d71b9f46eb13 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-1c48a578-50dd-40e7-803f-d71b9f46eb13 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Could not find user: 175e69f8468941849a4949dbab43cd8c.: keystone.exception.UserNotFound: Could not find user: 175e69f8468941849a4949dbab43cd8c. Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 275, in delete Oct 24 09:29:22.662586 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application PROVIDERS.identity_api.delete_user(user_id) Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1207, in delete_user Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application user_old = self.get_user(user_id) Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:29:22.664182 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: 175e69f8468941849a4949dbab43cd8c. Oct 24 09:29:22.665862 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:22.667254 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3915/7827] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:22 2022] DELETE /identity/v3/users/175e69f8468941849a4949dbab43cd8c => generated 110 bytes in 59 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:22.668760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260374d4-44bb-4646-996b-8d94a3c379cd tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.691483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260374d4-44bb-4646-996b-8d94a3c379cd tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.703965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e749b-9c9a-447f-af1d-330f579e2d57 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.706138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e749b-9c9a-447f-af1d-330f579e2d57 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.706451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e749b-9c9a-447f-af1d-330f579e2d57 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.706735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e749b-9c9a-447f-af1d-330f579e2d57 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.717154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e749b-9c9a-447f-af1d-330f579e2d57 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-662e749b-9c9a-447f-af1d-330f579e2d57 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Could not find domain: 11eb1bf70eec460c9bf01ae9c61907a2.: keystone.exception.DomainNotFound: Could not find domain: 11eb1bf70eec460c9bf01ae9c61907a2. Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 11eb1bf70eec460c9bf01ae9c61907a2. Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:22.731809 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:22.732921 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 11eb1bf70eec460c9bf01ae9c61907a2. Oct 24 09:29:22.733929 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:29:22.745636 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3913/7828] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:29:22 2022] PATCH /identity/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2 => generated 112 bytes in 74 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:22.750147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48a578-50dd-40e7-803f-d71b9f46eb13 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.762373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48a578-50dd-40e7-803f-d71b9f46eb13 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.767351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d668a-d42d-4551-be56-96b60cc5df05 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.768035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d668a-d42d-4551-be56-96b60cc5df05 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.768390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d668a-d42d-4551-be56-96b60cc5df05 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.768733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d668a-d42d-4551-be56-96b60cc5df05 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.769603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d668a-d42d-4551-be56-96b60cc5df05 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:22.771274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d668a-d42d-4551-be56-96b60cc5df05 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:22.793106 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3916/7829] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 09:29:22 2022] GET /identity/v3/domains => generated 1347 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:22.798491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e749b-9c9a-447f-af1d-330f579e2d57 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.811764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e749b-9c9a-447f-af1d-330f579e2d57 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.823431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbb280-cdc4-47b0-9f20-37b6de2308e9 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.824261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbb280-cdc4-47b0-9f20-37b6de2308e9 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.824513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbb280-cdc4-47b0-9f20-37b6de2308e9 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.824869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbb280-cdc4-47b0-9f20-37b6de2308e9 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.825843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbb280-cdc4-47b0-9f20-37b6de2308e9 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Adding query filter params (enabled=True) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:22.826025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbb280-cdc4-47b0-9f20-37b6de2308e9 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:22.831484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbb280-cdc4-47b0-9f20-37b6de2308e9 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:22.877202 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3914/7830] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:29:22 2022] GET /identity/v3/domains?enabled=True => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:22.879647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d668a-d42d-4551-be56-96b60cc5df05 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.892097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d668a-d42d-4551-be56-96b60cc5df05 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.897157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80302543-79c0-41dd-9dde-3f1d166fb88b tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.897722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80302543-79c0-41dd-9dde-3f1d166fb88b tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.900041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80302543-79c0-41dd-9dde-3f1d166fb88b tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.900355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80302543-79c0-41dd-9dde-3f1d166fb88b tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.901267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80302543-79c0-41dd-9dde-3f1d166fb88b tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Adding query filter params (name=tempest-test_domain-906329931) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:22.901608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80302543-79c0-41dd-9dde-3f1d166fb88b tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:22.905888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80302543-79c0-41dd-9dde-3f1d166fb88b tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:22.930227 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3917/7831] 10.222.0.25 () {58 vars in 1197 bytes} [Mon Oct 24 09:29:22 2022] GET /identity/v3/domains?name=tempest-test_domain-906329931 => generated 407 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:22.931893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbb280-cdc4-47b0-9f20-37b6de2308e9 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.950089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbb280-cdc4-47b0-9f20-37b6de2308e9 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:22.958031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c1361-1475-434b-8deb-51a457c3fbe1 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:22.958700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c1361-1475-434b-8deb-51a457c3fbe1 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:22.958985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c1361-1475-434b-8deb-51a457c3fbe1 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:22.959265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c1361-1475-434b-8deb-51a457c3fbe1 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:22.967803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c1361-1475-434b-8deb-51a457c3fbe1 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-6a9c1361-1475-434b-8deb-51a457c3fbe1 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Could not find domain: 11eb1bf70eec460c9bf01ae9c61907a2.: keystone.exception.DomainNotFound: Could not find domain: 11eb1bf70eec460c9bf01ae9c61907a2. Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: 11eb1bf70eec460c9bf01ae9c61907a2. Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:22.974570 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 137, in patch Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:update_domain') Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:22.975703 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application with Lock( Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: 11eb1bf70eec460c9bf01ae9c61907a2. Oct 24 09:29:22.976671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:29:22.982227 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3915/7832] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:29:22 2022] PATCH /identity/v3/domains/11eb1bf70eec460c9bf01ae9c61907a2 => generated 112 bytes in 48 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:22.983234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80302543-79c0-41dd-9dde-3f1d166fb88b tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:22.994934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80302543-79c0-41dd-9dde-3f1d166fb88b tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:23.002691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548fead-654f-4e6b-8e83-78b2b951f101 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:23.002691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548fead-654f-4e6b-8e83-78b2b951f101 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:23.003723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548fead-654f-4e6b-8e83-78b2b951f101 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:23.004085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f548fead-654f-4e6b-8e83-78b2b951f101 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/630e15a4244444808627b3fb489f61f1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:23.025803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548fead-654f-4e6b-8e83-78b2b951f101 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=630e15a4244444808627b3fb489f61f1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:23.028059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f548fead-654f-4e6b-8e83-78b2b951f101 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:23.207729 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3918/7833] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:29:22 2022] PATCH /identity/v3/domains/630e15a4244444808627b3fb489f61f1 => generated 276 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:23.211737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c1361-1475-434b-8deb-51a457c3fbe1 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:23.230983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c1361-1475-434b-8deb-51a457c3fbe1 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:23.260665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:23.261279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:23.261593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:23.261880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/630e15a4244444808627b3fb489f61f1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:23.289179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=630e15a4244444808627b3fb489f61f1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:23.290338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:23.361215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': '630e15a4244444808627b3fb489f61f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.365400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': '630e15a4244444808627b3fb489f61f1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.451181 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:23.462145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '630e15a4244444808627b3fb489f61f1', 'request_id': 'req-55fdb589-37af-43fa-ab13-bfc6bace8624'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.479583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '630e15a4244444808627b3fb489f61f1', 'request_id': 'req-55fdb589-37af-43fa-ab13-bfc6bace8624'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.495283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '630e15a4244444808627b3fb489f61f1', 'request_id': 'req-55fdb589-37af-43fa-ab13-bfc6bace8624'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.509005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] The token cache is being invalidate because project 630e15a4244444808627b3fb489f61f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:23.509325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.509997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.519645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': '630e15a4244444808627b3fb489f61f1', 'request_id': 'req-55fdb589-37af-43fa-ab13-bfc6bace8624'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.520399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': '630e15a4244444808627b3fb489f61f1', 'request_id': 'req-55fdb589-37af-43fa-ab13-bfc6bace8624'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.521328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': '630e15a4244444808627b3fb489f61f1', 'request_id': 'req-55fdb589-37af-43fa-ab13-bfc6bace8624'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.561192 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3916/7834] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:23 2022] DELETE /identity/v3/domains/630e15a4244444808627b3fb489f61f1 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:23.567325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548fead-654f-4e6b-8e83-78b2b951f101 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:23.570982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f548fead-654f-4e6b-8e83-78b2b951f101 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:23.593690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f548fead-654f-4e6b-8e83-78b2b951f101 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:23.699048 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:23.730058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:23.731819 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:23.732325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:23.732813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/d252a76de55442f28def2ad9e53fb635` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:23.762950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d252a76de55442f28def2ad9e53fb635)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:23.765108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:23.848038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd252a76de55442f28def2ad9e53fb635'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.849119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd252a76de55442f28def2ad9e53fb635'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.923324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd252a76de55442f28def2ad9e53fb635'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.927390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd252a76de55442f28def2ad9e53fb635'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:23.935881 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3919/7835] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:29:23 2022] PATCH /identity/v3/domains/d252a76de55442f28def2ad9e53fb635 => generated 278 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:23.939737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:23.966298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fdb589-37af-43fa-ab13-bfc6bace8624 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:24.134139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:24.135816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:24.136094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:24.136384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/d252a76de55442f28def2ad9e53fb635` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:24.176832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d252a76de55442f28def2ad9e53fb635)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:24.181097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:24.246866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:24.249769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:24.251776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd252a76de55442f28def2ad9e53fb635'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.255352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd252a76de55442f28def2ad9e53fb635'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.335072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd252a76de55442f28def2ad9e53fb635', 'request_id': 'req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.346435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd252a76de55442f28def2ad9e53fb635', 'request_id': 'req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.360372 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd252a76de55442f28def2ad9e53fb635', 'request_id': 'req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.380117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e394a1-985d-4b65-ab90-6923e909fb86 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:24.383648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] The token cache is being invalidate because project d252a76de55442f28def2ad9e53fb635 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:24.384025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.385888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.403023 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:24.404577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd252a76de55442f28def2ad9e53fb635', 'request_id': 'req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.405598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd252a76de55442f28def2ad9e53fb635', 'request_id': 'req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.406637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd252a76de55442f28def2ad9e53fb635', 'request_id': 'req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.441660 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3917/7836] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:23 2022] DELETE /identity/v3/domains/d252a76de55442f28def2ad9e53fb635 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:24.444863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:24.446435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:24.466423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e68e79-889b-4492-a82c-d8ca64c6f882 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:24.467699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e68e79-889b-4492-a82c-d8ca64c6f882 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:24.468054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e68e79-889b-4492-a82c-d8ca64c6f882 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:24.468650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e68e79-889b-4492-a82c-d8ca64c6f882 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:24.470943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d6e68e79-889b-4492-a82c-d8ca64c6f882 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:24.494144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e68e79-889b-4492-a82c-d8ca64c6f882 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:24.497818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e68e79-889b-4492-a82c-d8ca64c6f882 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:24.527875 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3920/7837] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:29:24.572687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d3f2d8-fba7-47d3-b4ac-d7ca15a2f250 tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:24.580092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:24.580764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:24.581039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:24.581350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/d93a549c95854bf88f30c5c0117b0a7b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:24.610482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:update_domain(domain_id=d93a549c95854bf88f30c5c0117b0a7b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:24.612331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:24.643536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity project disabled for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.645769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity project disabled for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.683326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain disabled for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.684436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain disabled for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.686825 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3918/7838] 10.222.0.25 () {60 vars in 1249 bytes} [Mon Oct 24 09:29:24 2022] PATCH /identity/v3/domains/d93a549c95854bf88f30c5c0117b0a7b => generated 277 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:24.690696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e68e79-889b-4492-a82c-d8ca64c6f882 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:24.703495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e68e79-889b-4492-a82c-d8ca64c6f882 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:24.769934 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:24.831936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ef05e86d01d942b7a7211fc80bd8cc64', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:24.832694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:24.833091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:24.833502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] PATH_INFO: `/v3/domains/d93a549c95854bf88f30c5c0117b0a7b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:24.847899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorizing `identity:delete_domain(domain_id=d93a549c95854bf88f30c5c0117b0a7b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:24.851105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:24.880099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _cleanup_identity_provider for event identity domain_deleted internal for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.884761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _domain_deleted for event identity domain_deleted internal for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.976941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b', 'request_id': 'req-643e2db5-8d32-4448-bf98-f8e8328a61cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:24.989571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b', 'request_id': 'req-643e2db5-8d32-4448-bf98-f8e8328a61cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.002670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b', 'request_id': 'req-643e2db5-8d32-4448-bf98-f8e8328a61cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.038321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] The token cache is being invalidate because project d93a549c95854bf88f30c5c0117b0a7b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:25.038321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.038321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.057010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_token_cache for event identity domain deleted for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b', 'request_id': 'req-643e2db5-8d32-4448-bf98-f8e8328a61cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.057976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _drop_receipt_cache for event identity domain deleted for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b', 'request_id': 'req-643e2db5-8d32-4448-bf98-f8e8328a61cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.058765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-643e2db5-8d32-4448-bf98-f8e8328a61cc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Invoking callback _delete_domain_assignments for event identity domain deleted for {'resource_info': 'd93a549c95854bf88f30c5c0117b0a7b', 'request_id': 'req-643e2db5-8d32-4448-bf98-f8e8328a61cc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.079785 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3921/7839] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:24 2022] DELETE /identity/v3/domains/d93a549c95854bf88f30c5c0117b0a7b => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:25.084086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:25.086363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:25.282205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda1c88e-b49a-4cb2-815d-1bf0eada61fc tempest-DomainsTestJSON-1158603356 tempest-DomainsTestJSON-1158603356-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:25.457457 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:UPDATE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:25.492148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:25.493077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:25.493497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:25.493935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] PATH_INFO: `/v3/users/edb5746c41eb4392aa2e7efc6eb2f86f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:25.495472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edb5746c41eb4392aa2e7efc6eb2f86f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:25.499899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:25.599203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edb5746c41eb4392aa2e7efc6eb2f86f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.621443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edb5746c41eb4392aa2e7efc6eb2f86f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.622247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edb5746c41eb4392aa2e7efc6eb2f86f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.642262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edb5746c41eb4392aa2e7efc6eb2f86f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.657956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edb5746c41eb4392aa2e7efc6eb2f86f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:25.672422 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3919/7840] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:25 2022] DELETE /identity/v3/users/edb5746c41eb4392aa2e7efc6eb2f86f => generated 0 bytes in 589 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:25.676996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca078d-69dd-4642-8243-cb931e24a544 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:25.677264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca078d-69dd-4642-8243-cb931e24a544 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:25.677627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ca078d-69dd-4642-8243-cb931e24a544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:25.733461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e6ca078d-69dd-4642-8243-cb931e24a544 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:25.735352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e6ca078d-69dd-4642-8243-cb931e24a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:25.845348 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3922/7841] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:25.855021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:25.856887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:25.961559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d8069-cabc-4208-a854-609a39b5e847 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:25.965842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c1755-5d80-4ce9-b393-1d0580db6939 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:25.967619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c1755-5d80-4ce9-b393-1d0580db6939 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:25.967619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c1755-5d80-4ce9-b393-1d0580db6939 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:25.967831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381c1755-5d80-4ce9-b393-1d0580db6939 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:25.979094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c1755-5d80-4ce9-b393-1d0580db6939 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:25.980792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381c1755-5d80-4ce9-b393-1d0580db6939 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:25.993254 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3920/7842] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:26.148842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca078d-69dd-4642-8243-cb931e24a544 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:26.148842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e6ca078d-69dd-4642-8243-cb931e24a544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:26.164186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ca078d-69dd-4642-8243-cb931e24a544 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:26.183446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:26.184101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:26.184386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:26.184664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] PATH_INFO: `/v3/users/371b4ff9d48d48dfaa4b0529372a2ab0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:26.187981 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] RBAC: Authorizing `identity:delete_user(user_id=371b4ff9d48d48dfaa4b0529372a2ab0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:26.203978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:26.206176 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:26.294250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '371b4ff9d48d48dfaa4b0529372a2ab0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.323880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '371b4ff9d48d48dfaa4b0529372a2ab0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.324642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '371b4ff9d48d48dfaa4b0529372a2ab0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.337038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '371b4ff9d48d48dfaa4b0529372a2ab0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.362388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '371b4ff9d48d48dfaa4b0529372a2ab0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.370369 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3923/7843] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:26 2022] DELETE /identity/v3/users/371b4ff9d48d48dfaa4b0529372a2ab0 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:26.501474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c1755-5d80-4ce9-b393-1d0580db6939 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:26.502983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-381c1755-5d80-4ce9-b393-1d0580db6939 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:26.521828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381c1755-5d80-4ce9-b393-1d0580db6939 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:26.627798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:26.629217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:26.738975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:26.740788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:26.741326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:26.743050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] PATH_INFO: `/v3/projects/39a90c69870345729299dc5437652de4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:26.744943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39a90c69870345729299dc5437652de4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:26.748168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:26.792511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2aadcc-0b48-4cf2-9ffe-07c007f9c730 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:26.795960 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:26.806064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:26.806806 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:26.807094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:26.807399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] PATH_INFO: `/v3/projects/f9c0c3da8adb499a9546eb1fa1941b7c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:26.809788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9c0c3da8adb499a9546eb1fa1941b7c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:26.814671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:26.872235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39a90c69870345729299dc5437652de4', 'request_id': 'req-819b0c0c-f2be-4c02-8874-bb2aa02778b5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.887836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39a90c69870345729299dc5437652de4', 'request_id': 'req-819b0c0c-f2be-4c02-8874-bb2aa02778b5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.896675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39a90c69870345729299dc5437652de4', 'request_id': 'req-819b0c0c-f2be-4c02-8874-bb2aa02778b5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.906577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9c0c3da8adb499a9546eb1fa1941b7c', 'request_id': 'req-ee545b75-1a49-46dd-9543-6cc16b50b53f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.913880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] The token cache is being invalidate because project 39a90c69870345729299dc5437652de4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:26.914760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.915233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9c0c3da8adb499a9546eb1fa1941b7c', 'request_id': 'req-ee545b75-1a49-46dd-9543-6cc16b50b53f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.918145 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-819b0c0c-f2be-4c02-8874-bb2aa02778b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.920471 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3921/7844] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:26 2022] DELETE /identity/v3/projects/39a90c69870345729299dc5437652de4 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:26.923903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8536b-e5e3-4af8-b6ff-1bb861aa1679 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:26.924565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8536b-e5e3-4af8-b6ff-1bb861aa1679 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:26.925055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e8536b-e5e3-4af8-b6ff-1bb861aa1679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:26.929003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9c0c3da8adb499a9546eb1fa1941b7c', 'request_id': 'req-ee545b75-1a49-46dd-9543-6cc16b50b53f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.947941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] The token cache is being invalidate because project f9c0c3da8adb499a9546eb1fa1941b7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:26.948477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.949376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:26.951096 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3924/7845] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:26 2022] DELETE /identity/v3/projects/f9c0c3da8adb499a9546eb1fa1941b7c => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:26.951904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:26.953218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:26.960153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-11e8536b-e5e3-4af8-b6ff-1bb861aa1679 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:26.961484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-11e8536b-e5e3-4af8-b6ff-1bb861aa1679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:26.965767 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:27.045257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee545b75-1a49-46dd-9543-6cc16b50b53f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:27.050600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:27.051251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:27.051536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:27.052134 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3922/7846] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:29:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:27.053031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8536b-e5e3-4af8-b6ff-1bb861aa1679 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:27.054391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] PATH_INFO: `/v3/users/ef05e86d01d942b7a7211fc80bd8cc64` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:27.054513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-11e8536b-e5e3-4af8-b6ff-1bb861aa1679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:27.057147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef05e86d01d942b7a7211fc80bd8cc64)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:27.060008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:27.105763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e8536b-e5e3-4af8-b6ff-1bb861aa1679 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:27.112991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:27.113901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:27.118600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:27.120439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] PATH_INFO: `/v3/users/de34d05a20f44bc5a79cceb18813433b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:27.127095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=de34d05a20f44bc5a79cceb18813433b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:27.129214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:27.152476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef05e86d01d942b7a7211fc80bd8cc64'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.174023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef05e86d01d942b7a7211fc80bd8cc64'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.179811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef05e86d01d942b7a7211fc80bd8cc64'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.189675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef05e86d01d942b7a7211fc80bd8cc64'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.206194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef05e86d01d942b7a7211fc80bd8cc64'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.217423 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3925/7847] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:26 2022] DELETE /identity/v3/users/ef05e86d01d942b7a7211fc80bd8cc64 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:27.224180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:27.225952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:27.268484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de34d05a20f44bc5a79cceb18813433b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.330039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de34d05a20f44bc5a79cceb18813433b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.333124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de34d05a20f44bc5a79cceb18813433b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.349851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de34d05a20f44bc5a79cceb18813433b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.360882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de34d05a20f44bc5a79cceb18813433b'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:27.375994 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3923/7848] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:27 2022] DELETE /identity/v3/users/de34d05a20f44bc5a79cceb18813433b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:27.443269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d757a-67ed-4db9-ad19-abdecf50d099 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:27.550204 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:27.641743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:27.642378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:27.642661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:27.642936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:27.645420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:27.699696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:27.713382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:27.769149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:27.770840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:27.780844 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3926/7849] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:29:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:29:27.785629 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:27.879538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:27.882558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:27.884026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369e9d7e-78c6-4a10-bfe6-d64f583c1a2b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:27.897431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:27.898874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:27.899889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:27.901052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] PATH_INFO: `/v3/projects/e3a96f41b9c94ed7ab01a5d10480c91b` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:27.903187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3a96f41b9c94ed7ab01a5d10480c91b)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:27.907006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:27.910732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1978f-3d7e-42b9-a79b-5507a8dbc7e6 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:27.920716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:27.921670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:27.922154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:27.922644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] PATH_INFO: `/v3/projects/26367ce15733448f9ef5df16108e6e0d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:27.924525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=26367ce15733448f9ef5df16108e6e0d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:27.926788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:28.018795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26367ce15733448f9ef5df16108e6e0d', 'request_id': 'req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.030079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26367ce15733448f9ef5df16108e6e0d', 'request_id': 'req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.034420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'request_id': 'req-1597b841-66fd-4aba-b422-fdfe1737d824'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.039680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26367ce15733448f9ef5df16108e6e0d', 'request_id': 'req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.049877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'request_id': 'req-1597b841-66fd-4aba-b422-fdfe1737d824'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.054985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] The token cache is being invalidate because project 26367ce15733448f9ef5df16108e6e0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:28.056009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.059919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d9f0432c-bb7d-4f36-ab3c-db69df2946ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.077327 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3927/7850] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:27 2022] DELETE /identity/v3/projects/26367ce15733448f9ef5df16108e6e0d => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:28.078492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3a96f41b9c94ed7ab01a5d10480c91b', 'request_id': 'req-1597b841-66fd-4aba-b422-fdfe1737d824'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.091831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] The token cache is being invalidate because project e3a96f41b9c94ed7ab01a5d10480c91b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:28.092172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.092944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1597b841-66fd-4aba-b422-fdfe1737d824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:28.130105 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3924/7851] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:27 2022] DELETE /identity/v3/projects/e3a96f41b9c94ed7ab01a5d10480c91b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:28.135905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27fe1-c900-42a8-81e8-6c67c34a78e6 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:28.136659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27fe1-c900-42a8-81e8-6c67c34a78e6 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:28.137264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b27fe1-c900-42a8-81e8-6c67c34a78e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:28.177960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-31b27fe1-c900-42a8-81e8-6c67c34a78e6 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:28.179884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31b27fe1-c900-42a8-81e8-6c67c34a78e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:28.300842 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:28.341436 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3928/7852] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:28.344630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eff2f-ff48-4b02-9837-f81edf7082f4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:28.345119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eff2f-ff48-4b02-9837-f81edf7082f4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:28.345596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6eff2f-ff48-4b02-9837-f81edf7082f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:28.389907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7d6eff2f-ff48-4b02-9837-f81edf7082f4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:28.391222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7d6eff2f-ff48-4b02-9837-f81edf7082f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:28.404138 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3925/7853] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:28.405467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27fe1-c900-42a8-81e8-6c67c34a78e6 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:28.418796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b27fe1-c900-42a8-81e8-6c67c34a78e6 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:28.425599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931895ee-001b-4658-8d3a-12805e4af698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:28.426348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931895ee-001b-4658-8d3a-12805e4af698 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:28.426699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931895ee-001b-4658-8d3a-12805e4af698 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:28.426963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931895ee-001b-4658-8d3a-12805e4af698 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:28.427641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931895ee-001b-4658-8d3a-12805e4af698 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:28.428014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931895ee-001b-4658-8d3a-12805e4af698 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:28.434176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931895ee-001b-4658-8d3a-12805e4af698 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:28.454114 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3929/7854] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:29:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:28.455281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eff2f-ff48-4b02-9837-f81edf7082f4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:28.468096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6eff2f-ff48-4b02-9837-f81edf7082f4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:28.484319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4346e-43ff-425d-afca-e511ea886aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:28.484963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4346e-43ff-425d-afca-e511ea886aca admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:28.485247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4346e-43ff-425d-afca-e511ea886aca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:28.485552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4346e-43ff-425d-afca-e511ea886aca admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:28.486220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4346e-43ff-425d-afca-e511ea886aca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:28.491566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4346e-43ff-425d-afca-e511ea886aca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:28.587804 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3926/7855] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:28 2022] POST /identity/v3/projects => generated 371 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:28.589335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931895ee-001b-4658-8d3a-12805e4af698 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:28.608473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931895ee-001b-4658-8d3a-12805e4af698 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:28.737450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae21a34-06e5-4a4b-9301-8c7eb2e3a848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:28.738446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae21a34-06e5-4a4b-9301-8c7eb2e3a848 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:28.738963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae21a34-06e5-4a4b-9301-8c7eb2e3a848 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:28.739465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae21a34-06e5-4a4b-9301-8c7eb2e3a848 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:28.740409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae21a34-06e5-4a4b-9301-8c7eb2e3a848 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:28.743494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae21a34-06e5-4a4b-9301-8c7eb2e3a848 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:28.788659 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3930/7856] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:28 2022] POST /identity/v3/users => generated 286 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:28.790148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4346e-43ff-425d-afca-e511ea886aca admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:28.808297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4346e-43ff-425d-afca-e511ea886aca admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:28.822637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b1b8-5649-4465-b5dc-6fb7637524b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:28.823891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b1b8-5649-4465-b5dc-6fb7637524b9 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:28.826721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b1b8-5649-4465-b5dc-6fb7637524b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:28.827355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b1b8-5649-4465-b5dc-6fb7637524b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:28.828257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50b1b8-5649-4465-b5dc-6fb7637524b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:28.834669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50b1b8-5649-4465-b5dc-6fb7637524b9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:28.851804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82322e8e-7e30-416d-906b-bcadbbbfc8ca None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:28.852205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82322e8e-7e30-416d-906b-bcadbbbfc8ca None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:28.852751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82322e8e-7e30-416d-906b-bcadbbbfc8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:28.854378 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3927/7857] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:28.858317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b1b8-5649-4465-b5dc-6fb7637524b9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:28.876101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-82322e8e-7e30-416d-906b-bcadbbbfc8ca None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:28.876765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b1b8-5649-4465-b5dc-6fb7637524b9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:28.877967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82322e8e-7e30-416d-906b-bcadbbbfc8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:28.883918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d784a49-32dc-405b-a305-baf99cee4945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:28.884778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d784a49-32dc-405b-a305-baf99cee4945 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:28.885126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d784a49-32dc-405b-a305-baf99cee4945 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:28.885126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d784a49-32dc-405b-a305-baf99cee4945 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:28.885850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d784a49-32dc-405b-a305-baf99cee4945 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:28.887391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d784a49-32dc-405b-a305-baf99cee4945 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:28.909350 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3928/7858] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:28.914457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d784a49-32dc-405b-a305-baf99cee4945 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:28.925018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d784a49-32dc-405b-a305-baf99cee4945 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:28.930651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fa566-5643-47c5-9fc7-3a6a3cebc98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:28.931065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fa566-5643-47c5-9fc7-3a6a3cebc98a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:28.931414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fa566-5643-47c5-9fc7-3a6a3cebc98a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:28.931768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fa566-5643-47c5-9fc7-3a6a3cebc98a admin admin] PATH_INFO: `/v3/projects/a22997c307824e22aff9af64ccd8b91c/users/5f6ca466ac7047c98c7c48c84c02e98f/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:28.948601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fa566-5643-47c5-9fc7-3a6a3cebc98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a22997c307824e22aff9af64ccd8b91c, user_id=5f6ca466ac7047c98c7c48c84c02e98f, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:28.951866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fa566-5643-47c5-9fc7-3a6a3cebc98a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:28.983093 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3931/7859] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:29:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:28.983667 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3929/7860] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:28 2022] PUT /identity/v3/projects/a22997c307824e22aff9af64ccd8b91c/users/5f6ca466ac7047c98c7c48c84c02e98f/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:29.008871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82322e8e-7e30-416d-906b-bcadbbbfc8ca None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:29.010693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-82322e8e-7e30-416d-906b-bcadbbbfc8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:29.081657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f4a8f-20d5-4ae7-b6cb-c0185443a892 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.082002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f4a8f-20d5-4ae7-b6cb-c0185443a892 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.082218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f4a8f-20d5-4ae7-b6cb-c0185443a892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.117024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ac4f4a8f-20d5-4ae7-b6cb-c0185443a892 None None] MFA Rules not processed for user `5f6ca466ac7047c98c7c48c84c02e98f`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:29.118519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ac4f4a8f-20d5-4ae7-b6cb-c0185443a892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:29.131022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82322e8e-7e30-416d-906b-bcadbbbfc8ca None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:29.164354 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:29.168289 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:29.229574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defb67f-1e27-44e1-95a3-390ebcdf71b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:29.230242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defb67f-1e27-44e1-95a3-390ebcdf71b6 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.230523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defb67f-1e27-44e1-95a3-390ebcdf71b6 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.230804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0defb67f-1e27-44e1-95a3-390ebcdf71b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.249423 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3930/7861] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:29:29.253527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f4a8f-20d5-4ae7-b6cb-c0185443a892 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:29.300486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defb67f-1e27-44e1-95a3-390ebcdf71b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:29.302401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0defb67f-1e27-44e1-95a3-390ebcdf71b6 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:29.317051 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3932/7862] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:29:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:29:29.352268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f4a8f-20d5-4ae7-b6cb-c0185443a892 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:29.359293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e224b-55cb-46c6-a8cd-864a6151c307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:29.359940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e224b-55cb-46c6-a8cd-864a6151c307 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.360223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e224b-55cb-46c6-a8cd-864a6151c307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.360525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e224b-55cb-46c6-a8cd-864a6151c307 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.361113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e224b-55cb-46c6-a8cd-864a6151c307 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:29.363056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582e224b-55cb-46c6-a8cd-864a6151c307 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:29.410295 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3931/7863] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:29 2022] POST /identity/v3/projects => generated 371 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:29.414170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defb67f-1e27-44e1-95a3-390ebcdf71b6 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:29.426743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0defb67f-1e27-44e1-95a3-390ebcdf71b6 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:29.513006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252927c6-e36e-4a7c-96af-85a6a1077f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:29.513677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252927c6-e36e-4a7c-96af-85a6a1077f7a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.513947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252927c6-e36e-4a7c-96af-85a6a1077f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.514221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252927c6-e36e-4a7c-96af-85a6a1077f7a admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.514848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252927c6-e36e-4a7c-96af-85a6a1077f7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:29.516769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252927c6-e36e-4a7c-96af-85a6a1077f7a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:29.550880 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3933/7864] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:29 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:29.556168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e224b-55cb-46c6-a8cd-864a6151c307 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:29.571624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e224b-55cb-46c6-a8cd-864a6151c307 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:29.594904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d8d92d-c2bc-4472-99b3-c39793de05cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:29.595547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d92d-c2bc-4472-99b3-c39793de05cb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.595835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d92d-c2bc-4472-99b3-c39793de05cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.596117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d8d92d-c2bc-4472-99b3-c39793de05cb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.596787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8d92d-c2bc-4472-99b3-c39793de05cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:29.598600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d8d92d-c2bc-4472-99b3-c39793de05cb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:29.612164 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3932/7865] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:29.617911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252927c6-e36e-4a7c-96af-85a6a1077f7a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:29.635472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252927c6-e36e-4a7c-96af-85a6a1077f7a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:29.642843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6d6fa-a78a-4a98-8151-d7ae60499522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:29.643535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6d6fa-a78a-4a98-8151-d7ae60499522 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.645197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6d6fa-a78a-4a98-8151-d7ae60499522 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.645563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6d6fa-a78a-4a98-8151-d7ae60499522 admin admin] PATH_INFO: `/v3/projects/313dd7e348f64adb88d225f7480fe191/users/3f609619417a4c61959745b9ef92eecd/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.678939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9860c-51e8-44ba-b10d-9c7f8ecb299e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.679365 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9860c-51e8-44ba-b10d-9c7f8ecb299e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.679758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf9860c-51e8-44ba-b10d-9c7f8ecb299e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.681660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6d6fa-a78a-4a98-8151-d7ae60499522 admin admin] RBAC: Authorizing `identity:create_grant(project_id=313dd7e348f64adb88d225f7480fe191, user_id=3f609619417a4c61959745b9ef92eecd, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:29.687154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6d6fa-a78a-4a98-8151-d7ae60499522 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:29.711681 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3934/7866] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:29 2022] PUT /identity/v3/projects/313dd7e348f64adb88d225f7480fe191/users/3f609619417a4c61959745b9ef92eecd/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:29.712712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6d6fa-a78a-4a98-8151-d7ae60499522 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:29.719762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-acf9860c-51e8-44ba-b10d-9c7f8ecb299e None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:29.722253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-acf9860c-51e8-44ba-b10d-9c7f8ecb299e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:29.761196 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:29.811057 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3933/7867] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:29.813957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6d6fa-a78a-4a98-8151-d7ae60499522 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:29.819988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb979dfd-5fd2-4216-9aa4-302d7211449a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:29.820897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb979dfd-5fd2-4216-9aa4-302d7211449a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.821510 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb979dfd-5fd2-4216-9aa4-302d7211449a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.822132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb979dfd-5fd2-4216-9aa4-302d7211449a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.824523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb979dfd-5fd2-4216-9aa4-302d7211449a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:29.828803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb979dfd-5fd2-4216-9aa4-302d7211449a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:29.829403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9860c-51e8-44ba-b10d-9c7f8ecb299e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:29.853997 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3935/7868] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:29 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:29.858587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb979dfd-5fd2-4216-9aa4-302d7211449a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:29.874503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb979dfd-5fd2-4216-9aa4-302d7211449a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:29.880895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8bb728-5fed-418d-a2e3-0e27191b798c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:29.881780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb728-5fed-418d-a2e3-0e27191b798c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.882474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb728-5fed-418d-a2e3-0e27191b798c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.882833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8bb728-5fed-418d-a2e3-0e27191b798c admin admin] PATH_INFO: `/v3/projects/313dd7e348f64adb88d225f7480fe191/users/3f609619417a4c61959745b9ef92eecd/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.885671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb728-5fed-418d-a2e3-0e27191b798c admin admin] RBAC: Authorizing `identity:create_grant(project_id=313dd7e348f64adb88d225f7480fe191, user_id=3f609619417a4c61959745b9ef92eecd, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:29.889657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8bb728-5fed-418d-a2e3-0e27191b798c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:29.905437 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:29.910321 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3936/7869] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:29 2022] PUT /identity/v3/projects/313dd7e348f64adb88d225f7480fe191/users/3f609619417a4c61959745b9ef92eecd/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:29.911646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32239d7b-e3c8-4507-819f-c1401bbcd6e1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:29.911940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32239d7b-e3c8-4507-819f-c1401bbcd6e1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:29.912221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32239d7b-e3c8-4507-819f-c1401bbcd6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:29.938396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf9860c-51e8-44ba-b10d-9c7f8ecb299e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:29.957354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-32239d7b-e3c8-4507-819f-c1401bbcd6e1 None None] MFA Rules not processed for user `3f609619417a4c61959745b9ef92eecd`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:29.957354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-32239d7b-e3c8-4507-819f-c1401bbcd6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:30.025791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bb6f6-fe17-4007-9a2a-992a611910da service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.026511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bb6f6-fe17-4007-9a2a-992a611910da service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.026902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bb6f6-fe17-4007-9a2a-992a611910da service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.027287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63bb6f6-fe17-4007-9a2a-992a611910da service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.038730 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3937/7870] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:30.041835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32239d7b-e3c8-4507-819f-c1401bbcd6e1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.057548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32239d7b-e3c8-4507-819f-c1401bbcd6e1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.081373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec04898-4d1b-4dea-a57f-9eb0c1553c64 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.090913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04898-4d1b-4dea-a57f-9eb0c1553c64 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.091277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04898-4d1b-4dea-a57f-9eb0c1553c64 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.091693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec04898-4d1b-4dea-a57f-9eb0c1553c64 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.092405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec04898-4d1b-4dea-a57f-9eb0c1553c64 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.094378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec04898-4d1b-4dea-a57f-9eb0c1553c64 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.108071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bb6f6-fe17-4007-9a2a-992a611910da service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.110250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63bb6f6-fe17-4007-9a2a-992a611910da service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.113917 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3938/7871] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:30 2022] POST /identity/v3/services => generated 286 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:30.118348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec04898-4d1b-4dea-a57f-9eb0c1553c64 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.121041 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3934/7872] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:29:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:29:30.163339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec04898-4d1b-4dea-a57f-9eb0c1553c64 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.169227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b92f9-7083-4ba7-9b47-12739c4d9d38 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.170055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b92f9-7083-4ba7-9b47-12739c4d9d38 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.170384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b92f9-7083-4ba7-9b47-12739c4d9d38 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.171304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b92f9-7083-4ba7-9b47-12739c4d9d38 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.171977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b92f9-7083-4ba7-9b47-12739c4d9d38 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.177444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b92f9-7083-4ba7-9b47-12739c4d9d38 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.203525 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-040b92f9-7083-4ba7-9b47-12739c4d9d38 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1633824861. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:29:30.203525 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:29:30.203525 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:29:30.248604 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3939/7873] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:29:30 2022] POST /identity/v3/endpoints => generated 360 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:30.249860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bb6f6-fe17-4007-9a2a-992a611910da service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.275859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63bb6f6-fe17-4007-9a2a-992a611910da service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.296647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19670ab-45d1-4183-8cf9-6ca552acdafd tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.296647 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19670ab-45d1-4183-8cf9-6ca552acdafd tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.296917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19670ab-45d1-4183-8cf9-6ca552acdafd tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.297170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19670ab-45d1-4183-8cf9-6ca552acdafd tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-1633824861` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.297817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19670ab-45d1-4183-8cf9-6ca552acdafd tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1633824861)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.299032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19670ab-45d1-4183-8cf9-6ca552acdafd tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.305839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b92f9-7083-4ba7-9b47-12739c4d9d38 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.314217 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3935/7874] 10.222.0.25 () {58 vars in 1206 bytes} [Mon Oct 24 09:29:30 2022] GET /identity/v3/regions/tempest-region-1633824861 => generated 180 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:30.329242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b92f9-7083-4ba7-9b47-12739c4d9d38 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.334878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46c670-4546-4ee6-b13c-f629a4c2ff71 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.335492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46c670-4546-4ee6-b13c-f629a4c2ff71 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.335777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46c670-4546-4ee6-b13c-f629a4c2ff71 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.336052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a46c670-4546-4ee6-b13c-f629a4c2ff71 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/services` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.336835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46c670-4546-4ee6-b13c-f629a4c2ff71 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.338475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a46c670-4546-4ee6-b13c-f629a4c2ff71 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.356049 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3940/7875] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:30 2022] POST /identity/v3/services => generated 289 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:30.360257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19670ab-45d1-4183-8cf9-6ca552acdafd tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.374627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19670ab-45d1-4183-8cf9-6ca552acdafd tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.409777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f68e7c-0be9-41aa-90fa-5497a5b30022 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.410708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f68e7c-0be9-41aa-90fa-5497a5b30022 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.410997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f68e7c-0be9-41aa-90fa-5497a5b30022 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.411363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f68e7c-0be9-41aa-90fa-5497a5b30022 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.412100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f68e7c-0be9-41aa-90fa-5497a5b30022 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.419177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f68e7c-0be9-41aa-90fa-5497a5b30022 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.447984 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-34f68e7c-0be9-41aa-90fa-5497a5b30022 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-160802212. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:29:30.447984 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:29:30.447984 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:29:30.500872 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3936/7876] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:29:30 2022] POST /identity/v3/endpoints => generated 360 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:30.502169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46c670-4546-4ee6-b13c-f629a4c2ff71 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.515914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a46c670-4546-4ee6-b13c-f629a4c2ff71 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.533590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5974fc4-2f1b-4f4a-9fed-0ef015b96896 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.534227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974fc4-2f1b-4f4a-9fed-0ef015b96896 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.534572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974fc4-2f1b-4f4a-9fed-0ef015b96896 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.534860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5974fc4-2f1b-4f4a-9fed-0ef015b96896 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-160802212` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.535449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5974fc4-2f1b-4f4a-9fed-0ef015b96896 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-160802212)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.536534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5974fc4-2f1b-4f4a-9fed-0ef015b96896 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.543202 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3941/7877] 10.222.0.25 () {58 vars in 1203 bytes} [Mon Oct 24 09:29:30 2022] GET /identity/v3/regions/tempest-region-160802212 => generated 178 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:30.544072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f68e7c-0be9-41aa-90fa-5497a5b30022 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.561353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f68e7c-0be9-41aa-90fa-5497a5b30022 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.571488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e6d2d-94b2-4c5c-8b48-25e5b9a288a6 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.572126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e6d2d-94b2-4c5c-8b48-25e5b9a288a6 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.572416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e6d2d-94b2-4c5c-8b48-25e5b9a288a6 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.572696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e6d2d-94b2-4c5c-8b48-25e5b9a288a6 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.573432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e6d2d-94b2-4c5c-8b48-25e5b9a288a6 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.575446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78e6d2d-94b2-4c5c-8b48-25e5b9a288a6 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.606292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda73b8-40bb-4138-b435-f8b2f20eee2a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.606626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda73b8-40bb-4138-b435-f8b2f20eee2a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.606997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda73b8-40bb-4138-b435-f8b2f20eee2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.614911 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-a78e6d2d-94b2-4c5c-8b48-25e5b9a288a6 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1841181191. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:29:30.614911 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:29:30.614911 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:29:30.627883 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:30.636552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0dda73b8-40bb-4138-b435-f8b2f20eee2a None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:30.640202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0dda73b8-40bb-4138-b435-f8b2f20eee2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:30.650536 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:30.661737 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3942/7878] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:29:30 2022] POST /identity/v3/auth/tokens => generated 3826 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:30.672413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3937/7879] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:29:30 2022] POST /identity/v3/endpoints => generated 360 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:30.676374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e6d2d-94b2-4c5c-8b48-25e5b9a288a6 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.677009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda73b8-40bb-4138-b435-f8b2f20eee2a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.708060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda73b8-40bb-4138-b435-f8b2f20eee2a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.709082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78e6d2d-94b2-4c5c-8b48-25e5b9a288a6 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.721732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e64d-e1d9-43d3-9c1f-726fc9fff2f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.722355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e64d-e1d9-43d3-9c1f-726fc9fff2f1 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.722636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e64d-e1d9-43d3-9c1f-726fc9fff2f1 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.722911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e64d-e1d9-43d3-9c1f-726fc9fff2f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.726615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d49a5-3ccd-4956-8d9c-5ee599c57378 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.727394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d49a5-3ccd-4956-8d9c-5ee599c57378 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.727754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d49a5-3ccd-4956-8d9c-5ee599c57378 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.728119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4d49a5-3ccd-4956-8d9c-5ee599c57378 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-1841181191` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.728898 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d49a5-3ccd-4956-8d9c-5ee599c57378 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1841181191)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.730108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4d49a5-3ccd-4956-8d9c-5ee599c57378 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.733042 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3943/7880] 10.222.0.25 () {58 vars in 1206 bytes} [Mon Oct 24 09:29:30 2022] GET /identity/v3/regions/tempest-region-1841181191 => generated 180 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:30.736928 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d49a5-3ccd-4956-8d9c-5ee599c57378 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.739011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e64d-e1d9-43d3-9c1f-726fc9fff2f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.740796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4e64d-e1d9-43d3-9c1f-726fc9fff2f1 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.755227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4d49a5-3ccd-4956-8d9c-5ee599c57378 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.759873 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3938/7881] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:29:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:29:30.762103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1e84-9074-4ab4-914a-feec96e55806 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.762829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1e84-9074-4ab4-914a-feec96e55806 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.763165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1e84-9074-4ab4-914a-feec96e55806 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.763165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf1e84-9074-4ab4-914a-feec96e55806 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.764079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf1e84-9074-4ab4-914a-feec96e55806 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.764767 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-77cf1e84-9074-4ab4-914a-feec96e55806 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:29:30.764767 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:29:30.764767 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:29:30.765717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cf1e84-9074-4ab4-914a-feec96e55806 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.775936 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3944/7882] 10.222.0.25 () {58 vars in 1134 bytes} [Mon Oct 24 09:29:30 2022] GET /identity/v3/endpoints => generated 4394 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:29:30.781811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e64d-e1d9-43d3-9c1f-726fc9fff2f1 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.810350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e64d-e1d9-43d3-9c1f-726fc9fff2f1 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.817567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107b5cb-f630-4a52-8633-6374fa5fc90f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.818427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b5cb-f630-4a52-8633-6374fa5fc90f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.819529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b5cb-f630-4a52-8633-6374fa5fc90f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.819529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0107b5cb-f630-4a52-8633-6374fa5fc90f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints/17c056738816431c9d25de98dbab0b82` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.826811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107b5cb-f630-4a52-8633-6374fa5fc90f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:get_endpoint(endpoint_id=17c056738816431c9d25de98dbab0b82)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.827913 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-0107b5cb-f630-4a52-8633-6374fa5fc90f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_endpoint": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:29:30.827913 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:29:30.827913 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:29:30.831393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0107b5cb-f630-4a52-8633-6374fa5fc90f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.835596 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3939/7883] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:30 2022] GET /identity/v3/endpoints/17c056738816431c9d25de98dbab0b82 => generated 360 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:30.841738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1e84-9074-4ab4-914a-feec96e55806 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.878244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf1e84-9074-4ab4-914a-feec96e55806 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.887748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57804e3-cc99-42e0-b0d1-dc249416a556 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.888641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57804e3-cc99-42e0-b0d1-dc249416a556 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.889094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57804e3-cc99-42e0-b0d1-dc249416a556 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.889540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57804e3-cc99-42e0-b0d1-dc249416a556 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints/17c056738816431c9d25de98dbab0b82` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.891390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57804e3-cc99-42e0-b0d1-dc249416a556 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=17c056738816431c9d25de98dbab0b82)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.895202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57804e3-cc99-42e0-b0d1-dc249416a556 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:30.910072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a57804e3-cc99-42e0-b0d1-dc249416a556 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '17c056738816431c9d25de98dbab0b82', 'request_id': 'req-a57804e3-cc99-42e0-b0d1-dc249416a556'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:30.927717 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3945/7884] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:30 2022] DELETE /identity/v3/endpoints/17c056738816431c9d25de98dbab0b82 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:30.934240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107b5cb-f630-4a52-8633-6374fa5fc90f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:30.957642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0107b5cb-f630-4a52-8633-6374fa5fc90f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:30.994520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e1366-7836-4c00-a5b0-e425eaf5f7a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:30.995684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e1366-7836-4c00-a5b0-e425eaf5f7a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:30.996443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e1366-7836-4c00-a5b0-e425eaf5f7a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:30.997549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e1366-7836-4c00-a5b0-e425eaf5f7a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:30.998343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e1366-7836-4c00-a5b0-e425eaf5f7a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:30.999558 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-d78e1366-7836-4c00-a5b0-e425eaf5f7a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_endpoints": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:29:30.999558 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:29:30.999558 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:29:31.000767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e1366-7836-4c00-a5b0-e425eaf5f7a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.014633 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3940/7885] 10.222.0.25 () {58 vars in 1134 bytes} [Mon Oct 24 09:29:30 2022] GET /identity/v3/endpoints => generated 4047 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:31.021428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57804e3-cc99-42e0-b0d1-dc249416a556 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.038726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57804e3-cc99-42e0-b0d1-dc249416a556 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.048229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5f9c6-141b-4718-ba76-bf5569cb993a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.050098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f9c6-141b-4718-ba76-bf5569cb993a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.050577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f9c6-141b-4718-ba76-bf5569cb993a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.051151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef5f9c6-141b-4718-ba76-bf5569cb993a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints/17c056738816431c9d25de98dbab0b82` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.058037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef5f9c6-141b-4718-ba76-bf5569cb993a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-0ef5f9c6-141b-4718-ba76-bf5569cb993a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Could not find endpoint: 17c056738816431c9d25de98dbab0b82.: keystone.exception.EndpointNotFound: Could not find endpoint: 17c056738816431c9d25de98dbab0b82. Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 236, in _get_endpoint Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return session.query(Endpoint).filter_by(id=endpoint_id).one() Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/query.py", line 2869, in one Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._iter().one() Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 1476, in one Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._only_one_row( Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/result.py", line 562, in _only_one_row Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exc.NoResultFound( Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application sqlalchemy.exc.NoResultFound: No row was found when one was required Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:31.072814 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 228, in get_endpoint Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.driver.get_endpoint(endpoint_id) Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 242, in get_endpoint Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._get_endpoint(session, endpoint_id).to_dict() Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 238, in _get_endpoint Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 17c056738816431c9d25de98dbab0b82. Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:31.074000 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/endpoints.py", line 113, in delete Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:delete_endpoint') Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.get_or_create( Oct 24 09:29:31.075038 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application with Lock( Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self._enter() Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.creator() Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application created_value = creator( Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 230, in get_endpoint Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.EndpointNotFound(endpoint_id=endpoint_id) Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.EndpointNotFound: Could not find endpoint: 17c056738816431c9d25de98dbab0b82. Oct 24 09:29:31.076047 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:31.089571 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3946/7886] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:31 2022] DELETE /identity/v3/endpoints/17c056738816431c9d25de98dbab0b82 => generated 114 bytes in 69 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:31.090777 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e1366-7836-4c00-a5b0-e425eaf5f7a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.108061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e1366-7836-4c00-a5b0-e425eaf5f7a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.113089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a53cf-f3ee-446e-a2f2-ab48681d4171 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.113958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a53cf-f3ee-446e-a2f2-ab48681d4171 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.114283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a53cf-f3ee-446e-a2f2-ab48681d4171 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.114563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a53cf-f3ee-446e-a2f2-ab48681d4171 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-1841181191` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.117350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a53cf-f3ee-446e-a2f2-ab48681d4171 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1841181191)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.119072 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a53cf-f3ee-446e-a2f2-ab48681d4171 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.143701 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3941/7887] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 09:29:31 2022] DELETE /identity/v3/regions/tempest-region-1841181191 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:31.147643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5f9c6-141b-4718-ba76-bf5569cb993a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.161277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef5f9c6-141b-4718-ba76-bf5569cb993a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.185106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453c105-8cf6-4d29-b9df-3adec44db905 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.185741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453c105-8cf6-4d29-b9df-3adec44db905 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.186080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453c105-8cf6-4d29-b9df-3adec44db905 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.186299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c453c105-8cf6-4d29-b9df-3adec44db905 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.187233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453c105-8cf6-4d29-b9df-3adec44db905 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.189009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c453c105-8cf6-4d29-b9df-3adec44db905 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.212192 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3947/7888] 10.222.0.25 () {58 vars in 1134 bytes} [Mon Oct 24 09:29:31 2022] GET /identity/v3/endpoints => generated 4047 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:31.215534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a53cf-f3ee-446e-a2f2-ab48681d4171 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.238710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a53cf-f3ee-446e-a2f2-ab48681d4171 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.255312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830017-2149-4d50-ac5e-3f24e9aec654 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.255312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830017-2149-4d50-ac5e-3f24e9aec654 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.255312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830017-2149-4d50-ac5e-3f24e9aec654 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.255902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03830017-2149-4d50-ac5e-3f24e9aec654 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.255902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830017-2149-4d50-ac5e-3f24e9aec654 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Adding query filter params (service_id=a6a0254902b647a99af579de5221c582) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:31.259168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830017-2149-4d50-ac5e-3f24e9aec654 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.260795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03830017-2149-4d50-ac5e-3f24e9aec654 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.269119 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3942/7889] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:29:31 2022] GET /identity/v3/endpoints?service_id=a6a0254902b647a99af579de5221c582 => generated 502 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:31.273692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453c105-8cf6-4d29-b9df-3adec44db905 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.299240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c453c105-8cf6-4d29-b9df-3adec44db905 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.305333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241c02-d6e4-4b15-bf8b-1eb8f4110c7a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.305993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241c02-d6e4-4b15-bf8b-1eb8f4110c7a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.306288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241c02-d6e4-4b15-bf8b-1eb8f4110c7a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.306596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd241c02-d6e4-4b15-bf8b-1eb8f4110c7a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.307559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd241c02-d6e4-4b15-bf8b-1eb8f4110c7a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Adding query filter params (service_id=4550154c48304a73855fcc4ee0d91db7) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:31.307845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd241c02-d6e4-4b15-bf8b-1eb8f4110c7a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.313582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd241c02-d6e4-4b15-bf8b-1eb8f4110c7a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.325362 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3948/7890] 10.222.0.25 () {58 vars in 1221 bytes} [Mon Oct 24 09:29:31 2022] GET /identity/v3/endpoints?service_id=4550154c48304a73855fcc4ee0d91db7 => generated 502 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:31.329158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830017-2149-4d50-ac5e-3f24e9aec654 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.343161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03830017-2149-4d50-ac5e-3f24e9aec654 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.366543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ceca0-5404-4d2e-869c-f1f35e7b8175 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.368828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ceca0-5404-4d2e-869c-f1f35e7b8175 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.369238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ceca0-5404-4d2e-869c-f1f35e7b8175 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.369634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1ceca0-5404-4d2e-869c-f1f35e7b8175 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.370377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ceca0-5404-4d2e-869c-f1f35e7b8175 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Adding query filter params (interface=public) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:31.370686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ceca0-5404-4d2e-869c-f1f35e7b8175 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.372384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1ceca0-5404-4d2e-869c-f1f35e7b8175 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.383652 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3943/7891] 10.222.0.25 () {58 vars in 1167 bytes} [Mon Oct 24 09:29:31 2022] GET /identity/v3/endpoints?interface=public => generated 3405 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:29:31.390627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241c02-d6e4-4b15-bf8b-1eb8f4110c7a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.404371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd241c02-d6e4-4b15-bf8b-1eb8f4110c7a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.411409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893bbd9-e815-4e77-ae9d-ef5173000db7 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.412907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893bbd9-e815-4e77-ae9d-ef5173000db7 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.413309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893bbd9-e815-4e77-ae9d-ef5173000db7 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.413724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1893bbd9-e815-4e77-ae9d-ef5173000db7 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.414748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893bbd9-e815-4e77-ae9d-ef5173000db7 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Adding query filter params (interface=internal) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:31.415159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893bbd9-e815-4e77-ae9d-ef5173000db7 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.417546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1893bbd9-e815-4e77-ae9d-ef5173000db7 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.426484 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3949/7892] 10.222.0.25 () {58 vars in 1171 bytes} [Mon Oct 24 09:29:31 2022] GET /identity/v3/endpoints?interface=internal => generated 477 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:31.432742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ceca0-5404-4d2e-869c-f1f35e7b8175 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.449498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1ceca0-5404-4d2e-869c-f1f35e7b8175 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.454750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa866a02-8614-4e12-90d6-056305ef07c0 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.455363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa866a02-8614-4e12-90d6-056305ef07c0 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.455649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa866a02-8614-4e12-90d6-056305ef07c0 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.456112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa866a02-8614-4e12-90d6-056305ef07c0 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/services` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.456571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa866a02-8614-4e12-90d6-056305ef07c0 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:create_service()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.458629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa866a02-8614-4e12-90d6-056305ef07c0 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.493336 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3944/7893] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:31 2022] POST /identity/v3/services => generated 288 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:31.495948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893bbd9-e815-4e77-ae9d-ef5173000db7 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.511946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1893bbd9-e815-4e77-ae9d-ef5173000db7 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.531941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a95a8-3703-4a7e-8c59-6e13e13e9743 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.532874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a95a8-3703-4a7e-8c59-6e13e13e9743 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.533537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a95a8-3703-4a7e-8c59-6e13e13e9743 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.533891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a95a8-3703-4a7e-8c59-6e13e13e9743 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.534629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a95a8-3703-4a7e-8c59-6e13e13e9743 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.536838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a95a8-3703-4a7e-8c59-6e13e13e9743 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.564606 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-652a95a8-3703-4a7e-8c59-6e13e13e9743 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-885027039. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:29:31.564606 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:29:31.564606 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:29:31.598204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3950/7894] 10.222.0.25 () {60 vars in 1156 bytes} [Mon Oct 24 09:29:31 2022] POST /identity/v3/endpoints => generated 358 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:31.602179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa866a02-8614-4e12-90d6-056305ef07c0 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.632383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa866a02-8614-4e12-90d6-056305ef07c0 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.690914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d48a-81d4-4b7e-9da2-2ee5546cad8a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.692813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d48a-81d4-4b7e-9da2-2ee5546cad8a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.693289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d48a-81d4-4b7e-9da2-2ee5546cad8a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.694345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91d48a-81d4-4b7e-9da2-2ee5546cad8a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-885027039` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.695220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91d48a-81d4-4b7e-9da2-2ee5546cad8a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-885027039)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.696538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91d48a-81d4-4b7e-9da2-2ee5546cad8a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.700536 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3945/7895] 10.222.0.25 () {58 vars in 1203 bytes} [Mon Oct 24 09:29:31 2022] GET /identity/v3/regions/tempest-region-885027039 => generated 178 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:31.704744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a95a8-3703-4a7e-8c59-6e13e13e9743 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.723069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a95a8-3703-4a7e-8c59-6e13e13e9743 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.760766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85146-7f9f-4253-829d-a31d0f116530 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.760766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85146-7f9f-4253-829d-a31d0f116530 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.760766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85146-7f9f-4253-829d-a31d0f116530 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.761206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d85146-7f9f-4253-829d-a31d0f116530 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints/2c4d4f1f8ec14df3adf4359de8c76384` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.761607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d85146-7f9f-4253-829d-a31d0f116530 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:update_endpoint(endpoint_id=2c4d4f1f8ec14df3adf4359de8c76384)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.763725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d85146-7f9f-4253-829d-a31d0f116530 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.800386 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-e0d85146-7f9f-4253-829d-a31d0f116530 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1596216436. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:29:31.800386 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:29:31.800386 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:29:31.868340 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3951/7896] 10.222.0.25 () {60 vars in 1256 bytes} [Mon Oct 24 09:29:31 2022] PATCH /identity/v3/endpoints/2c4d4f1f8ec14df3adf4359de8c76384 => generated 364 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:29:31.872056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d48a-81d4-4b7e-9da2-2ee5546cad8a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.894011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91d48a-81d4-4b7e-9da2-2ee5546cad8a tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.930375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec0ef0-3e41-4e88-a022-07bafaf047a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.934901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec0ef0-3e41-4e88-a022-07bafaf047a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.935447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec0ef0-3e41-4e88-a022-07bafaf047a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.935948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ec0ef0-3e41-4e88-a022-07bafaf047a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-1596216436` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.938331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec0ef0-3e41-4e88-a022-07bafaf047a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:get_region(region_id=tempest-region-1596216436)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.942210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ec0ef0-3e41-4e88-a022-07bafaf047a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.949194 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3946/7897] 10.222.0.25 () {58 vars in 1206 bytes} [Mon Oct 24 09:29:31 2022] GET /identity/v3/regions/tempest-region-1596216436 => generated 180 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:29:31.951973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85146-7f9f-4253-829d-a31d0f116530 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:31.966157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d85146-7f9f-4253-829d-a31d0f116530 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:31.970988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616fe18-e74c-4bab-9c49-2383faf9d7e9 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:31.971623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616fe18-e74c-4bab-9c49-2383faf9d7e9 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:31.971910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616fe18-e74c-4bab-9c49-2383faf9d7e9 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:31.972188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6616fe18-e74c-4bab-9c49-2383faf9d7e9 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints/2c4d4f1f8ec14df3adf4359de8c76384` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:31.978907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616fe18-e74c-4bab-9c49-2383faf9d7e9 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=2c4d4f1f8ec14df3adf4359de8c76384)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:31.980597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6616fe18-e74c-4bab-9c49-2383faf9d7e9 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:31.995271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6616fe18-e74c-4bab-9c49-2383faf9d7e9 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '2c4d4f1f8ec14df3adf4359de8c76384', 'request_id': 'req-6616fe18-e74c-4bab-9c49-2383faf9d7e9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:32.017072 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3952/7898] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:31 2022] DELETE /identity/v3/endpoints/2c4d4f1f8ec14df3adf4359de8c76384 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:32.020980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec0ef0-3e41-4e88-a022-07bafaf047a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.041131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ec0ef0-3e41-4e88-a022-07bafaf047a8 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.082266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4140f58-3d1c-450b-9de6-98396f0c15b3 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.082929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4140f58-3d1c-450b-9de6-98396f0c15b3 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.083214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4140f58-3d1c-450b-9de6-98396f0c15b3 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.083493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4140f58-3d1c-450b-9de6-98396f0c15b3 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-1596216436` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.084459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4140f58-3d1c-450b-9de6-98396f0c15b3 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1596216436)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.086144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4140f58-3d1c-450b-9de6-98396f0c15b3 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:32.114694 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-a4140f58-3d1c-450b-9de6-98396f0c15b3 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] /usr/local/lib/python3.8/dist-packages/pycadf/identifier.py:71: UserWarning: Invalid uuid: tempest-region-1596216436. To ensure interoperability, identifiers should be a valid uuid. Oct 24 09:29:32.114694 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(('Invalid uuid: %s. To ensure interoperability, ' Oct 24 09:29:32.114694 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:29:32.128971 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3947/7899] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/regions/tempest-region-1596216436 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:32.130805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616fe18-e74c-4bab-9c49-2383faf9d7e9 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.136249 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=3,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:32.154617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6616fe18-e74c-4bab-9c49-2383faf9d7e9 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.184697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8ae1-cfd7-4989-aa6c-993f73b0ac9f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.185267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8ae1-cfd7-4989-aa6c-993f73b0ac9f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.185595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8ae1-cfd7-4989-aa6c-993f73b0ac9f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.185882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f8ae1-cfd7-4989-aa6c-993f73b0ac9f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-885027039` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.186470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f8ae1-cfd7-4989-aa6c-993f73b0ac9f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-885027039)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.188316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f8ae1-cfd7-4989-aa6c-993f73b0ac9f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:32.213355 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3953/7900] 10.222.0.25 () {58 vars in 1206 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/regions/tempest-region-885027039 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:32.216928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4140f58-3d1c-450b-9de6-98396f0c15b3 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.236387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4140f58-3d1c-450b-9de6-98396f0c15b3 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.265140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea3d3d-d7b3-4d4f-942d-6302776bfb02 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.265812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea3d3d-d7b3-4d4f-942d-6302776bfb02 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.266096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea3d3d-d7b3-4d4f-942d-6302776bfb02 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.266374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cea3d3d-d7b3-4d4f-942d-6302776bfb02 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/services/b008447f27f34e08af48d25b0c4d6060` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.266964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea3d3d-d7b3-4d4f-942d-6302776bfb02 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_service(service_id=b008447f27f34e08af48d25b0c4d6060)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.268569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cea3d3d-d7b3-4d4f-942d-6302776bfb02 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:32.309728 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3948/7901] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/services/b008447f27f34e08af48d25b0c4d6060 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:32.311252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8ae1-cfd7-4989-aa6c-993f73b0ac9f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.341745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f8ae1-cfd7-4989-aa6c-993f73b0ac9f tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.365058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.366348 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.366814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.367101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints/6e6afe9df1714c2cb552caba10a0a345` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.385851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=6e6afe9df1714c2cb552caba10a0a345)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.399125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:32.399125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': '6e6afe9df1714c2cb552caba10a0a345', 'request_id': 'req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:32.416739 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3954/7902] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/endpoints/6e6afe9df1714c2cb552caba10a0a345 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:32.417666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea3d3d-d7b3-4d4f-942d-6302776bfb02 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.430093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cea3d3d-d7b3-4d4f-942d-6302776bfb02 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.450258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c58f0-09ac-4b5f-972c-dc8d7a027217 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.451147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c58f0-09ac-4b5f-972c-dc8d7a027217 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.451454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c58f0-09ac-4b5f-972c-dc8d7a027217 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.451818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73c58f0-09ac-4b5f-972c-dc8d7a027217 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-160802212` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.452591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c58f0-09ac-4b5f-972c-dc8d7a027217 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-160802212)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.455498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73c58f0-09ac-4b5f-972c-dc8d7a027217 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:32.463851 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=2,keystone:SELECT=94,keystone:DELETE=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:32.497979 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3949/7903] 10.222.0.25 () {58 vars in 1206 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/regions/tempest-region-160802212 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:32.510052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.527632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8882b5a-7bcb-4ca8-8ba6-067b6d3d23b4 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.550454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c6fd6-fa48-4018-8108-ac87a3fa7060 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.551968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c6fd6-fa48-4018-8108-ac87a3fa7060 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.552462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c6fd6-fa48-4018-8108-ac87a3fa7060 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.553507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0c6fd6-fa48-4018-8108-ac87a3fa7060 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/services/4550154c48304a73855fcc4ee0d91db7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.554330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c6fd6-fa48-4018-8108-ac87a3fa7060 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_service(service_id=4550154c48304a73855fcc4ee0d91db7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.556692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0c6fd6-fa48-4018-8108-ac87a3fa7060 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:32.587124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3955/7904] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/services/4550154c48304a73855fcc4ee0d91db7 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:32.590780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c58f0-09ac-4b5f-972c-dc8d7a027217 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.603013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73c58f0-09ac-4b5f-972c-dc8d7a027217 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.622380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8e73a-b212-4084-802b-de85b10bda55 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.623300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8e73a-b212-4084-802b-de85b10bda55 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.623570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8e73a-b212-4084-802b-de85b10bda55 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.627150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce8e73a-b212-4084-802b-de85b10bda55 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/endpoints/f245c99e4dfd41b8bb4fe559c55875cc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.634948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8e73a-b212-4084-802b-de85b10bda55 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_endpoint(endpoint_id=f245c99e4dfd41b8bb4fe559c55875cc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.636758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce8e73a-b212-4084-802b-de85b10bda55 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:32.650078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4ce8e73a-b212-4084-802b-de85b10bda55 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity endpoint deleted for {'resource_info': 'f245c99e4dfd41b8bb4fe559c55875cc', 'request_id': 'req-4ce8e73a-b212-4084-802b-de85b10bda55'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:32.665769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3950/7905] 10.222.0.25 () {58 vars in 1236 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/endpoints/f245c99e4dfd41b8bb4fe559c55875cc => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:32.666740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c6fd6-fa48-4018-8108-ac87a3fa7060 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.686419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0c6fd6-fa48-4018-8108-ac87a3fa7060 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.727507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b649f-92e8-46eb-8fbd-a282bc4f50d1 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.728070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b649f-92e8-46eb-8fbd-a282bc4f50d1 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.728411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b649f-92e8-46eb-8fbd-a282bc4f50d1 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.728698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96b649f-92e8-46eb-8fbd-a282bc4f50d1 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/regions/tempest-region-1633824861` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.729365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b649f-92e8-46eb-8fbd-a282bc4f50d1 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_region(region_id=tempest-region-1633824861)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.731823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96b649f-92e8-46eb-8fbd-a282bc4f50d1 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:32.761157 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3956/7906] 10.222.0.25 () {58 vars in 1209 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/regions/tempest-region-1633824861 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:32.764873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8e73a-b212-4084-802b-de85b10bda55 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.784639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce8e73a-b212-4084-802b-de85b10bda55 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.808828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742164b1-b6f4-4900-9811-167ef7435593 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3f609619417a4c61959745b9ef92eecd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '313dd7e348f64adb88d225f7480fe191', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.809503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742164b1-b6f4-4900-9811-167ef7435593 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.810522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742164b1-b6f4-4900-9811-167ef7435593 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.810790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742164b1-b6f4-4900-9811-167ef7435593 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] PATH_INFO: `/v3/services/a6a0254902b647a99af579de5221c582` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.811366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742164b1-b6f4-4900-9811-167ef7435593 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorizing `identity:delete_service(service_id=a6a0254902b647a99af579de5221c582)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.825381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742164b1-b6f4-4900-9811-167ef7435593 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:32.848746 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3951/7907] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/services/a6a0254902b647a99af579de5221c582 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:32.853000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b649f-92e8-46eb-8fbd-a282bc4f50d1 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:32.955972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96b649f-92e8-46eb-8fbd-a282bc4f50d1 tempest-EndPointsTestJSON-1430104340 tempest-EndPointsTestJSON-1430104340-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:32.972287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:32.973367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:32.973883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:32.974371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] PATH_INFO: `/v3/users/5f6ca466ac7047c98c7c48c84c02e98f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:32.976662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f6ca466ac7047c98c7c48c84c02e98f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:32.979521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:33.008370 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:33.059214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f6ca466ac7047c98c7c48c84c02e98f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.079528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f6ca466ac7047c98c7c48c84c02e98f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.080288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f6ca466ac7047c98c7c48c84c02e98f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.089289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f6ca466ac7047c98c7c48c84c02e98f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.097530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f6ca466ac7047c98c7c48c84c02e98f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.103886 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3957/7908] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:32 2022] DELETE /identity/v3/users/5f6ca466ac7047c98c7c48c84c02e98f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:33.108195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98007209-e8d8-4114-a2ad-d3c53ebfe77a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:33.108738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98007209-e8d8-4114-a2ad-d3c53ebfe77a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:33.108738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98007209-e8d8-4114-a2ad-d3c53ebfe77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:33.131646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-98007209-e8d8-4114-a2ad-d3c53ebfe77a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:33.132887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-98007209-e8d8-4114-a2ad-d3c53ebfe77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:33.212523 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3952/7909] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:33.223148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:33.224654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:33.312718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d17db1-e362-438c-a554-f8a24ec6dd13 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:33.316612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca516-e76b-4858-8f5b-8602e3c18241 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:33.317412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca516-e76b-4858-8f5b-8602e3c18241 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:33.317700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca516-e76b-4858-8f5b-8602e3c18241 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:33.317980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fca516-e76b-4858-8f5b-8602e3c18241 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:33.339582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca516-e76b-4858-8f5b-8602e3c18241 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:33.341323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fca516-e76b-4858-8f5b-8602e3c18241 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:33.360328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3958/7910] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:33.772851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98007209-e8d8-4114-a2ad-d3c53ebfe77a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:33.774294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-98007209-e8d8-4114-a2ad-d3c53ebfe77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:33.788573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98007209-e8d8-4114-a2ad-d3c53ebfe77a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:33.794632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:33.796062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:33.796727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:33.797018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] PATH_INFO: `/v3/projects/a22997c307824e22aff9af64ccd8b91c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:33.798240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a22997c307824e22aff9af64ccd8b91c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:33.800650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:33.886559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a22997c307824e22aff9af64ccd8b91c', 'request_id': 'req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.904863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a22997c307824e22aff9af64ccd8b91c', 'request_id': 'req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.930436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a22997c307824e22aff9af64ccd8b91c', 'request_id': 'req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.943163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] The token cache is being invalidate because project a22997c307824e22aff9af64ccd8b91c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:33.943466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.944176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:33.950805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca516-e76b-4858-8f5b-8602e3c18241 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:33.951045 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3953/7911] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:33 2022] DELETE /identity/v3/projects/a22997c307824e22aff9af64ccd8b91c => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:33.973488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fca516-e76b-4858-8f5b-8602e3c18241 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:34.058796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:34.059350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:34.059632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:34.059906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] PATH_INFO: `/v3/users/3f609619417a4c61959745b9ef92eecd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:34.061036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f609619417a4c61959745b9ef92eecd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:34.063074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:34.121536 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:34.142706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f609619417a4c61959745b9ef92eecd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.160921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f609619417a4c61959745b9ef92eecd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.161962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f609619417a4c61959745b9ef92eecd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.174527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f609619417a4c61959745b9ef92eecd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.185151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f4d6b0ac-8357-49a2-adfc-1004136461c5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f609619417a4c61959745b9ef92eecd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.196664 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3959/7912] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:33 2022] DELETE /identity/v3/users/3f609619417a4c61959745b9ef92eecd => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:34.538392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:34.540617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:34.554502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca78b5-7ac8-4a6a-9abe-1ebdc1dfb300 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:34.578836 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:34.677350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:34.682029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:34.682029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:34.682029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] PATH_INFO: `/v3/projects/313dd7e348f64adb88d225f7480fe191` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:34.682029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=313dd7e348f64adb88d225f7480fe191)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:34.685928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:34.758747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '313dd7e348f64adb88d225f7480fe191', 'request_id': 'req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.768569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '313dd7e348f64adb88d225f7480fe191', 'request_id': 'req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.777348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '313dd7e348f64adb88d225f7480fe191', 'request_id': 'req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.793183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] The token cache is being invalidate because project 313dd7e348f64adb88d225f7480fe191 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:34.793513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.794179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a3f95c4d-fb76-4ccd-8fa0-730c606744f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:34.795690 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3954/7913] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:34 2022] DELETE /identity/v3/projects/313dd7e348f64adb88d225f7480fe191 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:34.800480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c385a-16f0-41f9-9aee-45a57642cc86 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:34.800975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c385a-16f0-41f9-9aee-45a57642cc86 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:34.801195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576c385a-16f0-41f9-9aee-45a57642cc86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:34.829983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-576c385a-16f0-41f9-9aee-45a57642cc86 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:34.832107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-576c385a-16f0-41f9-9aee-45a57642cc86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:34.912384 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3960/7914] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:29:34.920706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c895d5-aa88-490c-9059-9d25d6389b31 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:34.921105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c895d5-aa88-490c-9059-9d25d6389b31 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:34.921689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c895d5-aa88-490c-9059-9d25d6389b31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:34.968055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-33c895d5-aa88-490c-9059-9d25d6389b31 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:34.970913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-33c895d5-aa88-490c-9059-9d25d6389b31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:34.994285 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3955/7915] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:34.998551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c385a-16f0-41f9-9aee-45a57642cc86 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:35.026170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576c385a-16f0-41f9-9aee-45a57642cc86 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:35.031237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4604-98ef-4b1a-b286-ac3fbec82533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:35.031874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4604-98ef-4b1a-b286-ac3fbec82533 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.032147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4604-98ef-4b1a-b286-ac3fbec82533 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.032418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7c4604-98ef-4b1a-b286-ac3fbec82533 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.033061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c4604-98ef-4b1a-b286-ac3fbec82533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:35.033475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c4604-98ef-4b1a-b286-ac3fbec82533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:35.035687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7c4604-98ef-4b1a-b286-ac3fbec82533 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:35.054342 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3961/7916] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:29:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:35.058447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c895d5-aa88-490c-9059-9d25d6389b31 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:35.070402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c895d5-aa88-490c-9059-9d25d6389b31 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:35.076137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029af1b-f75d-4a26-b94f-03160fcfa869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:35.076928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029af1b-f75d-4a26-b94f-03160fcfa869 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.077107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029af1b-f75d-4a26-b94f-03160fcfa869 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.077591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029af1b-f75d-4a26-b94f-03160fcfa869 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.078314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029af1b-f75d-4a26-b94f-03160fcfa869 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:35.080357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d029af1b-f75d-4a26-b94f-03160fcfa869 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:35.136745 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3956/7917] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:35 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:35.140780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4604-98ef-4b1a-b286-ac3fbec82533 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:35.162979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7c4604-98ef-4b1a-b286-ac3fbec82533 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:35.249232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d7beb-6823-4d94-b69f-de7352fb0ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:35.249959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7beb-6823-4d94-b69f-de7352fb0ffe admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.250303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7beb-6823-4d94-b69f-de7352fb0ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.250606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478d7beb-6823-4d94-b69f-de7352fb0ffe admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.251280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d7beb-6823-4d94-b69f-de7352fb0ffe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:35.253514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478d7beb-6823-4d94-b69f-de7352fb0ffe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:35.301356 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3962/7918] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:35 2022] POST /identity/v3/users => generated 292 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:35.301564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029af1b-f75d-4a26-b94f-03160fcfa869 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:35.314983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029af1b-f75d-4a26-b94f-03160fcfa869 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:35.333087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992f13-df3f-4deb-8533-48e66bc3b9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:35.334136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992f13-df3f-4deb-8533-48e66bc3b9f0 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.334590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992f13-df3f-4deb-8533-48e66bc3b9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.335029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92992f13-df3f-4deb-8533-48e66bc3b9f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.336534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92992f13-df3f-4deb-8533-48e66bc3b9f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:35.339133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92992f13-df3f-4deb-8533-48e66bc3b9f0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:35.358627 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3957/7919] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:29:35.360848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d7beb-6823-4d94-b69f-de7352fb0ffe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:35.372643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478d7beb-6823-4d94-b69f-de7352fb0ffe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:35.377723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b561193e-e2b8-4a16-a4ba-c460a02310d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:35.378474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561193e-e2b8-4a16-a4ba-c460a02310d5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.378835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561193e-e2b8-4a16-a4ba-c460a02310d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.379302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b561193e-e2b8-4a16-a4ba-c460a02310d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.380083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561193e-e2b8-4a16-a4ba-c460a02310d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:35.382916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b561193e-e2b8-4a16-a4ba-c460a02310d5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:35.403904 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3963/7920] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:35.408052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992f13-df3f-4deb-8533-48e66bc3b9f0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:35.419905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92992f13-df3f-4deb-8533-48e66bc3b9f0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:35.425729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51911d-6020-4209-bc2d-a2f71ccb7b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:35.426460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51911d-6020-4209-bc2d-a2f71ccb7b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.426816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51911d-6020-4209-bc2d-a2f71ccb7b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.427202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c51911d-6020-4209-bc2d-a2f71ccb7b81 admin admin] PATH_INFO: `/v3/projects/0eecc32e97b342248111ea97211cc825/users/e7e5ee95128f4f988bf9c8ae28f158d6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.444879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51911d-6020-4209-bc2d-a2f71ccb7b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eecc32e97b342248111ea97211cc825, user_id=e7e5ee95128f4f988bf9c8ae28f158d6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:35.447618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c51911d-6020-4209-bc2d-a2f71ccb7b81 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:35.464233 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3958/7921] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:35 2022] PUT /identity/v3/projects/0eecc32e97b342248111ea97211cc825/users/e7e5ee95128f4f988bf9c8ae28f158d6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:35.475364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc122b-4ff0-4fe4-b36e-1a543d6d70e3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.475813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc122b-4ff0-4fe4-b36e-1a543d6d70e3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.476118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffc122b-4ff0-4fe4-b36e-1a543d6d70e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.522995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cffc122b-4ff0-4fe4-b36e-1a543d6d70e3 None None] MFA Rules not processed for user `e7e5ee95128f4f988bf9c8ae28f158d6`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:35.525338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cffc122b-4ff0-4fe4-b36e-1a543d6d70e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:35.538146 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:35.644180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51911d-6020-4209-bc2d-a2f71ccb7b81 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:35.648121 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3964/7922] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:35.703428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc122b-4ff0-4fe4-b36e-1a543d6d70e3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:35.704948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cffc122b-4ff0-4fe4-b36e-1a543d6d70e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:35.712332 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:35.739645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c51911d-6020-4209-bc2d-a2f71ccb7b81 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:35.745182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed0153-9c8d-4fed-abe8-ad276f8e902b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:35.745954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed0153-9c8d-4fed-abe8-ad276f8e902b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.746445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed0153-9c8d-4fed-abe8-ad276f8e902b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.746789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bed0153-9c8d-4fed-abe8-ad276f8e902b admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.747496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed0153-9c8d-4fed-abe8-ad276f8e902b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:35.749978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bed0153-9c8d-4fed-abe8-ad276f8e902b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:35.785030 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3959/7923] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:35 2022] POST /identity/v3/projects => generated 385 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:35.789764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed0153-9c8d-4fed-abe8-ad276f8e902b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:35.827640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffc122b-4ff0-4fe4-b36e-1a543d6d70e3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:35.907182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bed0153-9c8d-4fed-abe8-ad276f8e902b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:35.914059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd0583-a8a7-4372-ab14-8b582a7ea675 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:35.914958 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd0583-a8a7-4372-ab14-8b582a7ea675 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.915248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd0583-a8a7-4372-ab14-8b582a7ea675 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.915529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fd0583-a8a7-4372-ab14-8b582a7ea675 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.916168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd0583-a8a7-4372-ab14-8b582a7ea675 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:35.919200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fd0583-a8a7-4372-ab14-8b582a7ea675 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:35.934434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:35.935119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:35.935397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:35.935715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] PATH_INFO: `/v3/users/79533b1e3d2049e69af8cf57a08ee1f3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:35.936901 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=79533b1e3d2049e69af8cf57a08ee1f3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:35.939135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:36.000595 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3960/7924] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:35 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:36.010612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd0583-a8a7-4372-ab14-8b582a7ea675 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:36.036966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fd0583-a8a7-4372-ab14-8b582a7ea675 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:36.043793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3cd96-5838-4d0a-a3fd-53b3bfb1016b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:36.044549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cd96-5838-4d0a-a3fd-53b3bfb1016b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:36.044941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cd96-5838-4d0a-a3fd-53b3bfb1016b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:36.045349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f3cd96-5838-4d0a-a3fd-53b3bfb1016b admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:36.046197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3cd96-5838-4d0a-a3fd-53b3bfb1016b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:36.048233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f3cd96-5838-4d0a-a3fd-53b3bfb1016b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:36.096308 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3961/7925] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:36.110579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3cd96-5838-4d0a-a3fd-53b3bfb1016b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:36.134683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f3cd96-5838-4d0a-a3fd-53b3bfb1016b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:36.136371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cde77-aed0-4bf5-ba20-80a024a5a95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:36.137198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cde77-aed0-4bf5-ba20-80a024a5a95f admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:36.137582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cde77-aed0-4bf5-ba20-80a024a5a95f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:36.137989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cde77-aed0-4bf5-ba20-80a024a5a95f admin admin] PATH_INFO: `/v3/projects/30e0235abedb4c38bb6dc7311b6a7ef0/users/c33d43713b7347c88c554b9676bea549/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:36.163721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79533b1e3d2049e69af8cf57a08ee1f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:36.170543 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:36.182968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79533b1e3d2049e69af8cf57a08ee1f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:36.184024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79533b1e3d2049e69af8cf57a08ee1f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:36.191552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cde77-aed0-4bf5-ba20-80a024a5a95f admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e0235abedb4c38bb6dc7311b6a7ef0, user_id=c33d43713b7347c88c554b9676bea549, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:36.195101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066cde77-aed0-4bf5-ba20-80a024a5a95f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:36.201674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79533b1e3d2049e69af8cf57a08ee1f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:36.215355 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3962/7926] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:36 2022] PUT /identity/v3/projects/30e0235abedb4c38bb6dc7311b6a7ef0/users/c33d43713b7347c88c554b9676bea549/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:36.220220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cde77-aed0-4bf5-ba20-80a024a5a95f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:36.225215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-066cde77-aed0-4bf5-ba20-80a024a5a95f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:36.226828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9f556b5b-29ce-4ac8-8e38-cc4188b305ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79533b1e3d2049e69af8cf57a08ee1f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:36.235590 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3965/7927] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:35 2022] DELETE /identity/v3/users/79533b1e3d2049e69af8cf57a08ee1f3 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:36.242334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb534370-248c-4818-993b-e10d2b13d5af None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:36.242723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb534370-248c-4818-993b-e10d2b13d5af None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:36.243075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb534370-248c-4818-993b-e10d2b13d5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:36.276005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bb534370-248c-4818-993b-e10d2b13d5af None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:36.277244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bb534370-248c-4818-993b-e10d2b13d5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:36.346676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066cde77-aed0-4bf5-ba20-80a024a5a95f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:36.398319 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3966/7928] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:36.404712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb534370-248c-4818-993b-e10d2b13d5af None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:36.406180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bb534370-248c-4818-993b-e10d2b13d5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:36.411556 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:36.468266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44751c2d-9c17-47f8-9a51-791d61056521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:36.468902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44751c2d-9c17-47f8-9a51-791d61056521 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:36.469520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44751c2d-9c17-47f8-9a51-791d61056521 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:36.469881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44751c2d-9c17-47f8-9a51-791d61056521 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:36.471389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44751c2d-9c17-47f8-9a51-791d61056521 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:36.473458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44751c2d-9c17-47f8-9a51-791d61056521 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:36.489817 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3963/7929] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:36 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:36.491431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44751c2d-9c17-47f8-9a51-791d61056521 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:36.505242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44751c2d-9c17-47f8-9a51-791d61056521 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:36.518437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb534370-248c-4818-993b-e10d2b13d5af None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:36.522743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09c6732-0e76-4423-b712-167d17f9b0a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:36.523272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b611e0-66cb-4557-991d-d396089b9271 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:36.523534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c6732-0e76-4423-b712-167d17f9b0a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:36.523943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c6732-0e76-4423-b712-167d17f9b0a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:36.524280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09c6732-0e76-4423-b712-167d17f9b0a2 admin admin] PATH_INFO: `/v3/projects/30e0235abedb4c38bb6dc7311b6a7ef0/users/c33d43713b7347c88c554b9676bea549/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:36.524594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b611e0-66cb-4557-991d-d396089b9271 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:36.525037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b611e0-66cb-4557-991d-d396089b9271 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:36.525500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b611e0-66cb-4557-991d-d396089b9271 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:36.526731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c6732-0e76-4423-b712-167d17f9b0a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30e0235abedb4c38bb6dc7311b6a7ef0, user_id=c33d43713b7347c88c554b9676bea549, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:36.529740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09c6732-0e76-4423-b712-167d17f9b0a2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:36.542794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b611e0-66cb-4557-991d-d396089b9271 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:36.544551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b611e0-66cb-4557-991d-d396089b9271 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:36.547477 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3964/7930] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:36 2022] PUT /identity/v3/projects/30e0235abedb4c38bb6dc7311b6a7ef0/users/c33d43713b7347c88c554b9676bea549/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:36.560092 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3967/7931] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:29:36.562919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3d354-2f15-4e1b-9714-a66fc86d4193 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:36.563301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3d354-2f15-4e1b-9714-a66fc86d4193 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:36.563696 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c3d354-2f15-4e1b-9714-a66fc86d4193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:36.602430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d0c3d354-2f15-4e1b-9714-a66fc86d4193 None None] MFA Rules not processed for user `c33d43713b7347c88c554b9676bea549`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:36.604081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0c3d354-2f15-4e1b-9714-a66fc86d4193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:36.707224 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3965/7932] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:36 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:36.712827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b611e0-66cb-4557-991d-d396089b9271 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:36.814599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b611e0-66cb-4557-991d-d396089b9271 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:36.820630 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde123d-0e3c-4d76-9946-1f42005d9ea2 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33d43713b7347c88c554b9676bea549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e0235abedb4c38bb6dc7311b6a7ef0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:36.821273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde123d-0e3c-4d76-9946-1f42005d9ea2 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:36.821584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde123d-0e3c-4d76-9946-1f42005d9ea2 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:36.821866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde123d-0e3c-4d76-9946-1f42005d9ea2 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:36.822599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde123d-0e3c-4d76-9946-1f42005d9ea2 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:36.825052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dde123d-0e3c-4d76-9946-1f42005d9ea2 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:36.853132 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:36.865080 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3968/7933] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:36 2022] POST /identity/v3/projects => generated 358 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:36.870092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3d354-2f15-4e1b-9714-a66fc86d4193 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:36.873378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0c3d354-2f15-4e1b-9714-a66fc86d4193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:36.983270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c3d354-2f15-4e1b-9714-a66fc86d4193 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:37.039180 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:37.074899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e517dfc-3243-4ae2-8faf-923b75829e75 tempest-ProjectsNegativeTestJSON-194699791 tempest-ProjectsNegativeTestJSON-194699791-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e7e5ee95128f4f988bf9c8ae28f158d6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0eecc32e97b342248111ea97211cc825', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:37.075753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517dfc-3243-4ae2-8faf-923b75829e75 tempest-ProjectsNegativeTestJSON-194699791 tempest-ProjectsNegativeTestJSON-194699791-project] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:37.076241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517dfc-3243-4ae2-8faf-923b75829e75 tempest-ProjectsNegativeTestJSON-194699791 tempest-ProjectsNegativeTestJSON-194699791-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:37.076530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e517dfc-3243-4ae2-8faf-923b75829e75 tempest-ProjectsNegativeTestJSON-194699791 tempest-ProjectsNegativeTestJSON-194699791-project] PATH_INFO: `/v3/projects/ad7f5670959a4cb5a7a1d2256791eabd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:37.080163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e517dfc-3243-4ae2-8faf-923b75829e75 tempest-ProjectsNegativeTestJSON-194699791 tempest-ProjectsNegativeTestJSON-194699791-project] RBAC: Authorizing `identity:delete_project(project_id=ad7f5670959a4cb5a7a1d2256791eabd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application [None req-5e517dfc-3243-4ae2-8faf-923b75829e75 tempest-ProjectsNegativeTestJSON-194699791 tempest-ProjectsNegativeTestJSON-194699791-project] You are not authorized to perform the requested action: identity:delete_project.: keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 207, in delete Oct 24 09:29:37.089371 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application ENFORCER.enforce_call( Oct 24 09:29:37.090671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 455, in enforce_call Oct 24 09:29:37.090671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application enforcer_obj._enforce( Oct 24 09:29:37.090671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 125, in _enforce Oct 24 09:29:37.090671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application result = self._enforcer.enforce( Oct 24 09:29:37.090671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py", line 1088, in enforce Oct 24 09:29:37.090671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application raise exc(*args, **kwargs) Oct 24 09:29:37.090671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application keystone.exception.ForbiddenAction: You are not authorized to perform the requested action: identity:delete_project. Oct 24 09:29:37.090671 n-d-master-1 devstack@keystone.service[88312]: ERROR keystone.server.flask.application Oct 24 09:29:37.090671 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3966/7934] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:36 2022] DELETE /identity/v3/projects/ad7f5670959a4cb5a7a1d2256791eabd => generated 136 bytes in 220 msecs (HTTP/1.1 403) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:37.093699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde123d-0e3c-4d76-9946-1f42005d9ea2 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:37.094706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e517dfc-3243-4ae2-8faf-923b75829e75 tempest-ProjectsNegativeTestJSON-194699791 tempest-ProjectsNegativeTestJSON-194699791-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:37.096878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5e517dfc-3243-4ae2-8faf-923b75829e75 tempest-ProjectsNegativeTestJSON-194699791 tempest-ProjectsNegativeTestJSON-194699791-project] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:37.202709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e517dfc-3243-4ae2-8faf-923b75829e75 tempest-ProjectsNegativeTestJSON-194699791 tempest-ProjectsNegativeTestJSON-194699791-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:37.207756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:37.208381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:37.208658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:37.208931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] PATH_INFO: `/v3/projects/443e55a070a345829f873546f6474ffe` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:37.210628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] RBAC: Authorizing `identity:delete_project(project_id=443e55a070a345829f873546f6474ffe)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:37.212533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:37.225478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde123d-0e3c-4d76-9946-1f42005d9ea2 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:37.243664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c33d43713b7347c88c554b9676bea549', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '30e0235abedb4c38bb6dc7311b6a7ef0', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:37.244586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:37.244883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:37.245237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] PATH_INFO: `/v3/projects/ad7f5670959a4cb5a7a1d2256791eabd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:37.246888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] RBAC: Authorizing `identity:delete_project(project_id=ad7f5670959a4cb5a7a1d2256791eabd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:37.249921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:37.273370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '443e55a070a345829f873546f6474ffe', 'request_id': 'req-d0a960f4-51ed-4e44-85ee-4189b71bbcba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.282354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '443e55a070a345829f873546f6474ffe', 'request_id': 'req-d0a960f4-51ed-4e44-85ee-4189b71bbcba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.289582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '443e55a070a345829f873546f6474ffe', 'request_id': 'req-d0a960f4-51ed-4e44-85ee-4189b71bbcba'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.304116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] The token cache is being invalidate because project 443e55a070a345829f873546f6474ffe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:37.304467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.305166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.307145 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3967/7935] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:37 2022] DELETE /identity/v3/projects/443e55a070a345829f873546f6474ffe => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:37.308171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad7f5670959a4cb5a7a1d2256791eabd', 'request_id': 'req-76055bdb-9adf-49c3-8344-8e36bff57686'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.317263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad7f5670959a4cb5a7a1d2256791eabd', 'request_id': 'req-76055bdb-9adf-49c3-8344-8e36bff57686'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.329490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad7f5670959a4cb5a7a1d2256791eabd', 'request_id': 'req-76055bdb-9adf-49c3-8344-8e36bff57686'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.346646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] The token cache is being invalidate because project ad7f5670959a4cb5a7a1d2256791eabd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:37.349403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.350110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-76055bdb-9adf-49c3-8344-8e36bff57686 tempest-ProjectsNegativeTestJSON-1363014231 tempest-ProjectsNegativeTestJSON-1363014231-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.353334 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3969/7936] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:37 2022] DELETE /identity/v3/projects/ad7f5670959a4cb5a7a1d2256791eabd => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:37.358695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:37.360569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:37.456687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a960f4-51ed-4e44-85ee-4189b71bbcba admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:37.490994 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:37.537680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:37.538345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:37.538629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:37.538914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] PATH_INFO: `/v3/users/e7e5ee95128f4f988bf9c8ae28f158d6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:37.540782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7e5ee95128f4f988bf9c8ae28f158d6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:37.544361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:37.617704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7e5ee95128f4f988bf9c8ae28f158d6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.645773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7e5ee95128f4f988bf9c8ae28f158d6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.647635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7e5ee95128f4f988bf9c8ae28f158d6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.658548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7e5ee95128f4f988bf9c8ae28f158d6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.673219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7e5ee95128f4f988bf9c8ae28f158d6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:37.688143 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3968/7937] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:37 2022] DELETE /identity/v3/users/e7e5ee95128f4f988bf9c8ae28f158d6 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:37.692830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12815-0fa3-4bba-b52a-afa6aa1ec8c5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:37.694304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12815-0fa3-4bba-b52a-afa6aa1ec8c5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:37.694774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d12815-0fa3-4bba-b52a-afa6aa1ec8c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:37.731364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-57d12815-0fa3-4bba-b52a-afa6aa1ec8c5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:37.737339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57d12815-0fa3-4bba-b52a-afa6aa1ec8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:37.832348 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3970/7938] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:37.839560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:37.841264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:37.915934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391b7abd-6d99-4773-99ab-888992edec86 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:37.919767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4169a-d5fe-4c23-94df-98b1fd34f2de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:37.920386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4169a-d5fe-4c23-94df-98b1fd34f2de service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:37.920749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4169a-d5fe-4c23-94df-98b1fd34f2de service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:37.921329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4169a-d5fe-4c23-94df-98b1fd34f2de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:37.931611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4169a-d5fe-4c23-94df-98b1fd34f2de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:37.933081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4169a-d5fe-4c23-94df-98b1fd34f2de service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:37.944766 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3969/7939] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:38.254323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12815-0fa3-4bba-b52a-afa6aa1ec8c5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:38.258000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-57d12815-0fa3-4bba-b52a-afa6aa1ec8c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:38.285272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d12815-0fa3-4bba-b52a-afa6aa1ec8c5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:38.298821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:38.300116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:38.300404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:38.300684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] PATH_INFO: `/v3/projects/0eecc32e97b342248111ea97211cc825` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:38.302509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eecc32e97b342248111ea97211cc825)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:38.307529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:38.354232 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:38.378140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eecc32e97b342248111ea97211cc825', 'request_id': 'req-6610c195-decf-494e-b441-99a7b93d3640'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.387929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eecc32e97b342248111ea97211cc825', 'request_id': 'req-6610c195-decf-494e-b441-99a7b93d3640'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.397561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eecc32e97b342248111ea97211cc825', 'request_id': 'req-6610c195-decf-494e-b441-99a7b93d3640'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.414565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] The token cache is being invalidate because project 0eecc32e97b342248111ea97211cc825 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:38.414865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.415532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.417551 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3971/7940] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:38 2022] DELETE /identity/v3/projects/0eecc32e97b342248111ea97211cc825 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:38.421429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4169a-d5fe-4c23-94df-98b1fd34f2de service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:38.434132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4169a-d5fe-4c23-94df-98b1fd34f2de service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:38.488530 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:38.504314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:38.504994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:38.505623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:38.506004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] PATH_INFO: `/v3/users/c33d43713b7347c88c554b9676bea549` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:38.507285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c33d43713b7347c88c554b9676bea549)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:38.509355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:38.563305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c33d43713b7347c88c554b9676bea549'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.579896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c33d43713b7347c88c554b9676bea549'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.580636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c33d43713b7347c88c554b9676bea549'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.588613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c33d43713b7347c88c554b9676bea549'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.597159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-030b6eaf-1f8e-4ffe-84e1-4a5692702548 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c33d43713b7347c88c554b9676bea549'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:38.608232 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3970/7941] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:38 2022] DELETE /identity/v3/users/c33d43713b7347c88c554b9676bea549 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:38.934274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:38.935725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:38.981161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6610c195-decf-494e-b441-99a7b93d3640 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:39.052509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:39.053662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.054831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.055115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] PATH_INFO: `/v3/projects/30e0235abedb4c38bb6dc7311b6a7ef0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.062738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30e0235abedb4c38bb6dc7311b6a7ef0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:39.067420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:39.128746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30e0235abedb4c38bb6dc7311b6a7ef0', 'request_id': 'req-d6918007-58ce-4a2b-9167-818fde30d6b5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:39.137059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30e0235abedb4c38bb6dc7311b6a7ef0', 'request_id': 'req-d6918007-58ce-4a2b-9167-818fde30d6b5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:39.157373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30e0235abedb4c38bb6dc7311b6a7ef0', 'request_id': 'req-d6918007-58ce-4a2b-9167-818fde30d6b5'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:39.170165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] The token cache is being invalidate because project 30e0235abedb4c38bb6dc7311b6a7ef0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:39.170580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:39.171320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6918007-58ce-4a2b-9167-818fde30d6b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:39.176092 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3972/7942] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:38 2022] DELETE /identity/v3/projects/30e0235abedb4c38bb6dc7311b6a7ef0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:39.177808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfbe8b-158f-4b7c-92c8-4ac4465df551 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.178790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfbe8b-158f-4b7c-92c8-4ac4465df551 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.178903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfbe8b-158f-4b7c-92c8-4ac4465df551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.235673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2cbfbe8b-158f-4b7c-92c8-4ac4465df551 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:39.236921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2cbfbe8b-158f-4b7c-92c8-4ac4465df551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:39.306698 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3971/7943] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:39.315641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6eacd-a12b-47a4-84c5-a63e1d113a17 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.316201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6eacd-a12b-47a4-84c5-a63e1d113a17 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.316201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6eacd-a12b-47a4-84c5-a63e1d113a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.342641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4bf6eacd-a12b-47a4-84c5-a63e1d113a17 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:39.343845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4bf6eacd-a12b-47a4-84c5-a63e1d113a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:39.353677 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3973/7944] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:39.358107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfbe8b-158f-4b7c-92c8-4ac4465df551 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:39.373107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfbe8b-158f-4b7c-92c8-4ac4465df551 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:39.378597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd7584-e456-4e75-a473-1199916b0802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:39.379376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd7584-e456-4e75-a473-1199916b0802 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.379733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd7584-e456-4e75-a473-1199916b0802 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.380076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd7584-e456-4e75-a473-1199916b0802 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.381669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd7584-e456-4e75-a473-1199916b0802 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:39.382042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd7584-e456-4e75-a473-1199916b0802 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:39.383718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd7584-e456-4e75-a473-1199916b0802 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:39.401024 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3972/7945] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:29:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:39.405181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6eacd-a12b-47a4-84c5-a63e1d113a17 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:39.415641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6eacd-a12b-47a4-84c5-a63e1d113a17 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:39.423554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449051f-ec98-4a86-8144-ca255520b5ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:39.424165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449051f-ec98-4a86-8144-ca255520b5ab admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.424444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449051f-ec98-4a86-8144-ca255520b5ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.424724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6449051f-ec98-4a86-8144-ca255520b5ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.425585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449051f-ec98-4a86-8144-ca255520b5ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:39.427506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6449051f-ec98-4a86-8144-ca255520b5ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:39.445357 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:39.465648 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3974/7946] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:39 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:39.467146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd7584-e456-4e75-a473-1199916b0802 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:39.480512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd7584-e456-4e75-a473-1199916b0802 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:39.514793 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:39.549341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5ef22-e5d6-473b-b772-def1cbc2dc4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:39.549341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5ef22-e5d6-473b-b772-def1cbc2dc4c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.549677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5ef22-e5d6-473b-b772-def1cbc2dc4c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.550229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c5ef22-e5d6-473b-b772-def1cbc2dc4c admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.551031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5ef22-e5d6-473b-b772-def1cbc2dc4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:39.553179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c5ef22-e5d6-473b-b772-def1cbc2dc4c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:39.577106 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3973/7947] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:39 2022] POST /identity/v3/users => generated 283 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:39.581437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449051f-ec98-4a86-8144-ca255520b5ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:39.593672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6449051f-ec98-4a86-8144-ca255520b5ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:39.598848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2717229-a352-404c-82c5-fa95aa9a5a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:39.599465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2717229-a352-404c-82c5-fa95aa9a5a29 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.599773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2717229-a352-404c-82c5-fa95aa9a5a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.600048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2717229-a352-404c-82c5-fa95aa9a5a29 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.600831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2717229-a352-404c-82c5-fa95aa9a5a29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:39.602624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2717229-a352-404c-82c5-fa95aa9a5a29 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:39.613814 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3975/7948] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:29:39.617996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5ef22-e5d6-473b-b772-def1cbc2dc4c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:39.628616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c5ef22-e5d6-473b-b772-def1cbc2dc4c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:39.634632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081fc604-328b-45cb-b522-a1bebda2bff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:39.635292 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc604-328b-45cb-b522-a1bebda2bff2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.635578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc604-328b-45cb-b522-a1bebda2bff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.635852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081fc604-328b-45cb-b522-a1bebda2bff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.636487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc604-328b-45cb-b522-a1bebda2bff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:39.638172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081fc604-328b-45cb-b522-a1bebda2bff2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:39.652446 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3974/7949] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:39.656341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2717229-a352-404c-82c5-fa95aa9a5a29 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:39.666976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2717229-a352-404c-82c5-fa95aa9a5a29 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:39.671939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5433db9-5af1-44e4-92bb-2102310f286c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:39.674104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5433db9-5af1-44e4-92bb-2102310f286c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.674104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5433db9-5af1-44e4-92bb-2102310f286c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.674104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5433db9-5af1-44e4-92bb-2102310f286c admin admin] PATH_INFO: `/v3/projects/45b40ed58a97458db50a972938278d2b/users/cfb4a2d6cfaf40b4b4ca293a83815e3d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.690560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5433db9-5af1-44e4-92bb-2102310f286c admin admin] RBAC: Authorizing `identity:create_grant(project_id=45b40ed58a97458db50a972938278d2b, user_id=cfb4a2d6cfaf40b4b4ca293a83815e3d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:39.694002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5433db9-5af1-44e4-92bb-2102310f286c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:39.710171 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3976/7950] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:39 2022] PUT /identity/v3/projects/45b40ed58a97458db50a972938278d2b/users/cfb4a2d6cfaf40b4b4ca293a83815e3d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:39.720396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f232-48f6-4840-8615-752ec1035b85 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.720728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f232-48f6-4840-8615-752ec1035b85 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.720976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a691f232-48f6-4840-8615-752ec1035b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.754296 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a691f232-48f6-4840-8615-752ec1035b85 None None] MFA Rules not processed for user `cfb4a2d6cfaf40b4b4ca293a83815e3d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:39.755797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a691f232-48f6-4840-8615-752ec1035b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:39.848405 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3975/7951] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:39 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:39.853721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5433db9-5af1-44e4-92bb-2102310f286c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:39.933968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5433db9-5af1-44e4-92bb-2102310f286c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:39.940518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb1b9c-1f9f-4aa9-935b-171ed4c1a6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:39.941146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb1b9c-1f9f-4aa9-935b-171ed4c1a6ca admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:39.941511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb1b9c-1f9f-4aa9-935b-171ed4c1a6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:39.942163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15eb1b9c-1f9f-4aa9-935b-171ed4c1a6ca admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:39.942838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb1b9c-1f9f-4aa9-935b-171ed4c1a6ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:39.945638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15eb1b9c-1f9f-4aa9-935b-171ed4c1a6ca admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:39.985978 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3977/7952] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:39 2022] POST /identity/v3/projects => generated 367 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:39.987575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691f232-48f6-4840-8615-752ec1035b85 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:39.999905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a691f232-48f6-4840-8615-752ec1035b85 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.066101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba8e73-19f8-4634-9da7-c357b074e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.066920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8e73-19f8-4634-9da7-c357b074e3ad admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.067208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8e73-19f8-4634-9da7-c357b074e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.067536 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ba8e73-19f8-4634-9da7-c357b074e3ad admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.068193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba8e73-19f8-4634-9da7-c357b074e3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.070907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ba8e73-19f8-4634-9da7-c357b074e3ad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.097162 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3976/7953] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:39 2022] POST /identity/v3/users => generated 290 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:40.101073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb1b9c-1f9f-4aa9-935b-171ed4c1a6ca admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.112711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15eb1b9c-1f9f-4aa9-935b-171ed4c1a6ca admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.117966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda5a18-db55-4c04-88cc-73478f39e06c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.118581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda5a18-db55-4c04-88cc-73478f39e06c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.118851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda5a18-db55-4c04-88cc-73478f39e06c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.119129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffda5a18-db55-4c04-88cc-73478f39e06c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.119771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda5a18-db55-4c04-88cc-73478f39e06c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.121401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffda5a18-db55-4c04-88cc-73478f39e06c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.134176 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3978/7954] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:40.138314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba8e73-19f8-4634-9da7-c357b074e3ad admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.152925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ba8e73-19f8-4634-9da7-c357b074e3ad admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.159203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19d2e-0dff-4210-9884-bd75dab70632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.159870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19d2e-0dff-4210-9884-bd75dab70632 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.160153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19d2e-0dff-4210-9884-bd75dab70632 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.160430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c19d2e-0dff-4210-9884-bd75dab70632 admin admin] PATH_INFO: `/v3/projects/22227672d1a740b489107c5acc7619dd/users/4607e3d7191041cb9187bb9b330a9d4c/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.179812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19d2e-0dff-4210-9884-bd75dab70632 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22227672d1a740b489107c5acc7619dd, user_id=4607e3d7191041cb9187bb9b330a9d4c, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.182752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c19d2e-0dff-4210-9884-bd75dab70632 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.200182 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3977/7955] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:40 2022] PUT /identity/v3/projects/22227672d1a740b489107c5acc7619dd/users/4607e3d7191041cb9187bb9b330a9d4c/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:40.204107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda5a18-db55-4c04-88cc-73478f39e06c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.215087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffda5a18-db55-4c04-88cc-73478f39e06c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.283182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7c2227-2781-4f10-b332-cde7c14fd817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.283847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2227-2781-4f10-b332-cde7c14fd817 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.284139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2227-2781-4f10-b332-cde7c14fd817 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.284413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7c2227-2781-4f10-b332-cde7c14fd817 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.285068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2227-2781-4f10-b332-cde7c14fd817 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.286712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7c2227-2781-4f10-b332-cde7c14fd817 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.299536 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3979/7956] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:40 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:40.304134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19d2e-0dff-4210-9884-bd75dab70632 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.316761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c19d2e-0dff-4210-9884-bd75dab70632 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.322410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b6b3d-0ccf-45ac-8397-1176c8ada4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.323209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b6b3d-0ccf-45ac-8397-1176c8ada4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.323783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b6b3d-0ccf-45ac-8397-1176c8ada4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.324294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321b6b3d-0ccf-45ac-8397-1176c8ada4d3 admin admin] PATH_INFO: `/v3/projects/22227672d1a740b489107c5acc7619dd/users/4607e3d7191041cb9187bb9b330a9d4c/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.326374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b6b3d-0ccf-45ac-8397-1176c8ada4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22227672d1a740b489107c5acc7619dd, user_id=4607e3d7191041cb9187bb9b330a9d4c, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.329100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321b6b3d-0ccf-45ac-8397-1176c8ada4d3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.331550 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:40.346231 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3978/7957] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:40 2022] PUT /identity/v3/projects/22227672d1a740b489107c5acc7619dd/users/4607e3d7191041cb9187bb9b330a9d4c/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:40.356971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e99970-dd8a-4fac-8cf3-2dd5d312459d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.357514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e99970-dd8a-4fac-8cf3-2dd5d312459d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.357601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e99970-dd8a-4fac-8cf3-2dd5d312459d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.406090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-33e99970-dd8a-4fac-8cf3-2dd5d312459d None None] MFA Rules not processed for user `4607e3d7191041cb9187bb9b330a9d4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:40.407845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-33e99970-dd8a-4fac-8cf3-2dd5d312459d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:40.444343 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:40.507219 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3980/7958] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:40 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:40.508436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b6b3d-0ccf-45ac-8397-1176c8ada4d3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.519821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321b6b3d-0ccf-45ac-8397-1176c8ada4d3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.527434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68213211-fd43-4fef-baa3-6c51c59418e4 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.528374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68213211-fd43-4fef-baa3-6c51c59418e4 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.528974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68213211-fd43-4fef-baa3-6c51c59418e4 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.529349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68213211-fd43-4fef-baa3-6c51c59418e4 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.530338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68213211-fd43-4fef-baa3-6c51c59418e4 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.531488 n-d-master-1 devstack@keystone.service[88312]: WARNING py.warnings [None req-68213211-fd43-4fef-baa3-6c51c59418e4 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:29:40.531488 n-d-master-1 devstack@keystone.service[88312]: warnings.warn(msg) Oct 24 09:29:40.531488 n-d-master-1 devstack@keystone.service[88312]: Oct 24 09:29:40.532646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68213211-fd43-4fef-baa3-6c51c59418e4 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.555820 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3979/7959] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:29:40 2022] POST /identity/v3/regions => generated 222 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:29:40.559820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e99970-dd8a-4fac-8cf3-2dd5d312459d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.571086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e99970-dd8a-4fac-8cf3-2dd5d312459d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.589697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660c671-4266-4cf1-9340-564f464cc6a6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.590300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660c671-4266-4cf1-9340-564f464cc6a6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.590673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660c671-4266-4cf1-9340-564f464cc6a6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.590956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3660c671-4266-4cf1-9340-564f464cc6a6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.591596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660c671-4266-4cf1-9340-564f464cc6a6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.592674 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-3660c671-4266-4cf1-9340-564f464cc6a6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:29:40.592674 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:29:40.592674 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:29:40.593520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3660c671-4266-4cf1-9340-564f464cc6a6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.614270 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3981/7960] 10.222.0.25 () {60 vars in 1149 bytes} [Mon Oct 24 09:29:40 2022] POST /identity/v3/regions => generated 223 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:40.619070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68213211-fd43-4fef-baa3-6c51c59418e4 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.633113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68213211-fd43-4fef-baa3-6c51c59418e4 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.654464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb691336-e456-4954-9742-ce760347239b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.655688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb691336-e456-4954-9742-ce760347239b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.655976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb691336-e456-4954-9742-ce760347239b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.656257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb691336-e456-4954-9742-ce760347239b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions/5cd25376-4f9c-4d2f-a2bb-b39dc35f5996` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.656926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb691336-e456-4954-9742-ce760347239b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:create_region(region_id=5cd25376-4f9c-4d2f-a2bb-b39dc35f5996)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.659140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb691336-e456-4954-9742-ce760347239b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.684325 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3980/7961] 10.222.0.25 () {60 vars in 1259 bytes} [Mon Oct 24 09:29:40 2022] PUT /identity/v3/regions/5cd25376-4f9c-4d2f-a2bb-b39dc35f5996 => generated 230 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:40.688653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660c671-4266-4cf1-9340-564f464cc6a6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.699871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3660c671-4266-4cf1-9340-564f464cc6a6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.721480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fef3f-2bce-4dc5-87d5-12f91e76808c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.722285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fef3f-2bce-4dc5-87d5-12f91e76808c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.722680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fef3f-2bce-4dc5-87d5-12f91e76808c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.723066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876fef3f-2bce-4dc5-87d5-12f91e76808c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions/5cd25376-4f9c-4d2f-a2bb-b39dc35f5996` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.723701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fef3f-2bce-4dc5-87d5-12f91e76808c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=5cd25376-4f9c-4d2f-a2bb-b39dc35f5996)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.726431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876fef3f-2bce-4dc5-87d5-12f91e76808c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.747732 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3982/7962] 10.222.0.25 () {58 vars in 1242 bytes} [Mon Oct 24 09:29:40 2022] DELETE /identity/v3/regions/5cd25376-4f9c-4d2f-a2bb-b39dc35f5996 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:40.752733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb691336-e456-4954-9742-ce760347239b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.764623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb691336-e456-4954-9742-ce760347239b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.784740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc07724-624f-48cb-8a22-29d7a13edaf3 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.785602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc07724-624f-48cb-8a22-29d7a13edaf3 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.785983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc07724-624f-48cb-8a22-29d7a13edaf3 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.786368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc07724-624f-48cb-8a22-29d7a13edaf3 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.787249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc07724-624f-48cb-8a22-29d7a13edaf3 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.790458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc07724-624f-48cb-8a22-29d7a13edaf3 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.816228 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3981/7963] 10.222.0.25 () {60 vars in 1150 bytes} [Mon Oct 24 09:29:40 2022] POST /identity/v3/regions => generated 254 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:40.820825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fef3f-2bce-4dc5-87d5-12f91e76808c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.832154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876fef3f-2bce-4dc5-87d5-12f91e76808c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.852349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839446f-5379-4a94-94fa-62f706df0d3f tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.852986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839446f-5379-4a94-94fa-62f706df0d3f tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `PATCH` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.853263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839446f-5379-4a94-94fa-62f706df0d3f tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.853560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3839446f-5379-4a94-94fa-62f706df0d3f tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions/d8241f519eeb4359acafbb5e532319dd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.854233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839446f-5379-4a94-94fa-62f706df0d3f tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:update_region(region_id=d8241f519eeb4359acafbb5e532319dd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.855247 n-d-master-1 devstack@keystone.service[88311]: WARNING py.warnings [None req-3839446f-5379-4a94-94fa-62f706df0d3f tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:update_region": "role:admin and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 24 09:29:40.855247 n-d-master-1 devstack@keystone.service[88311]: warnings.warn(msg) Oct 24 09:29:40.855247 n-d-master-1 devstack@keystone.service[88311]: Oct 24 09:29:40.856137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3839446f-5379-4a94-94fa-62f706df0d3f tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.885763 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3983/7964] 10.222.0.25 () {60 vars in 1250 bytes} [Mon Oct 24 09:29:40 2022] PATCH /identity/v3/regions/d8241f519eeb4359acafbb5e532319dd => generated 254 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:29:40.887103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc07724-624f-48cb-8a22-29d7a13edaf3 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.902660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc07724-624f-48cb-8a22-29d7a13edaf3 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.920832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f52830-7dbf-4fbe-8cee-05c3fb3ba91b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.921497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f52830-7dbf-4fbe-8cee-05c3fb3ba91b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.921788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f52830-7dbf-4fbe-8cee-05c3fb3ba91b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.922066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f52830-7dbf-4fbe-8cee-05c3fb3ba91b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions/d8241f519eeb4359acafbb5e532319dd` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.922643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f52830-7dbf-4fbe-8cee-05c3fb3ba91b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:get_region(region_id=d8241f519eeb4359acafbb5e532319dd)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.923714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f52830-7dbf-4fbe-8cee-05c3fb3ba91b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.930912 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3982/7965] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:29:40 2022] GET /identity/v3/regions/d8241f519eeb4359acafbb5e532319dd => generated 254 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:40.934695 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839446f-5379-4a94-94fa-62f706df0d3f tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.945870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3839446f-5379-4a94-94fa-62f706df0d3f tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:40.950586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ab04-573a-420c-8145-c1d529c3a3f6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:40.951228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ab04-573a-420c-8145-c1d529c3a3f6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:40.951515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ab04-573a-420c-8145-c1d529c3a3f6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:40.951784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ab04-573a-420c-8145-c1d529c3a3f6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions/d8241f519eeb4359acafbb5e532319dd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:40.952372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ab04-573a-420c-8145-c1d529c3a3f6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d8241f519eeb4359acafbb5e532319dd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:40.954020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae2ab04-573a-420c-8145-c1d529c3a3f6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:40.977392 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3984/7966] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:40 2022] DELETE /identity/v3/regions/d8241f519eeb4359acafbb5e532319dd => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:40.981332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f52830-7dbf-4fbe-8cee-05c3fb3ba91b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:40.994195 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f52830-7dbf-4fbe-8cee-05c3fb3ba91b tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.013269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba5cc4-9938-494e-9eda-89a88c2e8180 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.014071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba5cc4-9938-494e-9eda-89a88c2e8180 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.014413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba5cc4-9938-494e-9eda-89a88c2e8180 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.014758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ba5cc4-9938-494e-9eda-89a88c2e8180 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.015472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba5cc4-9938-494e-9eda-89a88c2e8180 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.016609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ba5cc4-9938-494e-9eda-89a88c2e8180 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.025352 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3983/7967] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 09:29:40 2022] GET /identity/v3/regions => generated 667 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:29:41.029749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ab04-573a-420c-8145-c1d529c3a3f6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:41.042803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ab04-573a-420c-8145-c1d529c3a3f6 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.048180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc5e7a-982d-4d75-940d-7ebbca0f0f6e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.048821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc5e7a-982d-4d75-940d-7ebbca0f0f6e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.049762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc5e7a-982d-4d75-940d-7ebbca0f0f6e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.050045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc5e7a-982d-4d75-940d-7ebbca0f0f6e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions/d8241f519eeb4359acafbb5e532319dd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.050641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc5e7a-982d-4d75-940d-7ebbca0f0f6e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=d8241f519eeb4359acafbb5e532319dd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.052246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc5e7a-982d-4d75-940d-7ebbca0f0f6e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application [None req-50bc5e7a-982d-4d75-940d-7ebbca0f0f6e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Could not find region: d8241f519eeb4359acafbb5e532319dd.: keystone.exception.RegionNotFound: Could not find region: d8241f519eeb4359acafbb5e532319dd. Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 129, in delete_region Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ret = self.driver.delete_region(region_id) Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 152, in delete_region Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application ref = self._get_region(session, region_id) Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 103, in _get_region Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: d8241f519eeb4359acafbb5e532319dd. Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 24 09:29:41.079748 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/regions.py", line 92, in delete Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application return PROVIDERS.catalog_api.delete_region( Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 135, in delete_region Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application raise exception.RegionNotFound(region_id=region_id) Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application keystone.exception.RegionNotFound: Could not find region: d8241f519eeb4359acafbb5e532319dd. Oct 24 09:29:41.080927 n-d-master-1 devstack@keystone.service[88311]: ERROR keystone.server.flask.application Oct 24 09:29:41.086583 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3985/7968] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:41 2022] DELETE /identity/v3/regions/d8241f519eeb4359acafbb5e532319dd => generated 112 bytes in 52 msecs (HTTP/1.1 404) 5 headers in 184 bytes (1 switches on core 0) Oct 24 09:29:41.086683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba5cc4-9938-494e-9eda-89a88c2e8180 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:41.098257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ba5cc4-9938-494e-9eda-89a88c2e8180 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.103699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c9a3-6ad8-49ea-bec2-56d120b3f92c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.104345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c9a3-6ad8-49ea-bec2-56d120b3f92c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.104626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c9a3-6ad8-49ea-bec2-56d120b3f92c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.104902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04c9a3-6ad8-49ea-bec2-56d120b3f92c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.105513 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04c9a3-6ad8-49ea-bec2-56d120b3f92c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.106569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04c9a3-6ad8-49ea-bec2-56d120b3f92c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.115874 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3984/7969] 10.222.0.25 () {58 vars in 1128 bytes} [Mon Oct 24 09:29:41 2022] GET /identity/v3/regions => generated 667 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:41.116977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc5e7a-982d-4d75-940d-7ebbca0f0f6e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:41.131300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc5e7a-982d-4d75-940d-7ebbca0f0f6e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.136722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233ef6f-7939-4e18-a2f0-e607616e10b0 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.137365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233ef6f-7939-4e18-a2f0-e607616e10b0 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.137657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233ef6f-7939-4e18-a2f0-e607616e10b0 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.138080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1233ef6f-7939-4e18-a2f0-e607616e10b0 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.138734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233ef6f-7939-4e18-a2f0-e607616e10b0 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:create_region()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.140394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1233ef6f-7939-4e18-a2f0-e607616e10b0 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.168043 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3986/7970] 10.222.0.25 () {60 vars in 1150 bytes} [Mon Oct 24 09:29:41 2022] POST /identity/v3/regions => generated 254 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:41.172167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c9a3-6ad8-49ea-bec2-56d120b3f92c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:41.183212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04c9a3-6ad8-49ea-bec2-56d120b3f92c tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.201872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12bfb4-835c-47ae-a4c2-5d35d2de2904 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.203418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12bfb4-835c-47ae-a4c2-5d35d2de2904 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.203794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12bfb4-835c-47ae-a4c2-5d35d2de2904 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.204177 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12bfb4-835c-47ae-a4c2-5d35d2de2904 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.204914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12bfb4-835c-47ae-a4c2-5d35d2de2904 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Adding query filter params (parent_region_id=7de1b6214abd472381dd4a761a7cde3e) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:41.205289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12bfb4-835c-47ae-a4c2-5d35d2de2904 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:list_regions()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.206496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12bfb4-835c-47ae-a4c2-5d35d2de2904 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.212995 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3985/7971] 10.222.0.25 () {58 vars in 1227 bytes} [Mon Oct 24 09:29:41 2022] GET /identity/v3/regions?parent_region_id=7de1b6214abd472381dd4a761a7cde3e => generated 400 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:41.217088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233ef6f-7939-4e18-a2f0-e607616e10b0 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:41.229200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1233ef6f-7939-4e18-a2f0-e607616e10b0 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.236798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8ac8c-2ef3-4701-8615-fbfc2dfdc230 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.237651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8ac8c-2ef3-4701-8615-fbfc2dfdc230 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.238020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8ac8c-2ef3-4701-8615-fbfc2dfdc230 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.238385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a8ac8c-2ef3-4701-8615-fbfc2dfdc230 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions/7e03e0b6054846ed8672e8c2bd69bfa6` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.239254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8ac8c-2ef3-4701-8615-fbfc2dfdc230 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7e03e0b6054846ed8672e8c2bd69bfa6)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.241686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a8ac8c-2ef3-4701-8615-fbfc2dfdc230 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.263244 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3987/7972] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:41 2022] DELETE /identity/v3/regions/7e03e0b6054846ed8672e8c2bd69bfa6 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:41.268082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12bfb4-835c-47ae-a4c2-5d35d2de2904 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:41.278721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12bfb4-835c-47ae-a4c2-5d35d2de2904 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.301995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152c4cc-dad0-4184-9b53-eb11b8307891 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.303439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152c4cc-dad0-4184-9b53-eb11b8307891 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.303829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152c4cc-dad0-4184-9b53-eb11b8307891 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.304176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4152c4cc-dad0-4184-9b53-eb11b8307891 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions/37a9a21feece4b088f7e99a86c28668a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.304952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152c4cc-dad0-4184-9b53-eb11b8307891 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=37a9a21feece4b088f7e99a86c28668a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.306688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4152c4cc-dad0-4184-9b53-eb11b8307891 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.331395 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3986/7973] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:41 2022] DELETE /identity/v3/regions/37a9a21feece4b088f7e99a86c28668a => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:41.335155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8ac8c-2ef3-4701-8615-fbfc2dfdc230 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:41.346082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a8ac8c-2ef3-4701-8615-fbfc2dfdc230 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.363589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd98b38-b7be-4933-bbc0-fe18c2d7aa3e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4607e3d7191041cb9187bb9b330a9d4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '22227672d1a740b489107c5acc7619dd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.364214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd98b38-b7be-4933-bbc0-fe18c2d7aa3e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.364490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd98b38-b7be-4933-bbc0-fe18c2d7aa3e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.364761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd98b38-b7be-4933-bbc0-fe18c2d7aa3e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] PATH_INFO: `/v3/regions/7de1b6214abd472381dd4a761a7cde3e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.366036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd98b38-b7be-4933-bbc0-fe18c2d7aa3e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorizing `identity:delete_region(region_id=7de1b6214abd472381dd4a761a7cde3e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.367584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd98b38-b7be-4933-bbc0-fe18c2d7aa3e tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.370723 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=3,keystone:UPDATE=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:41.392035 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3988/7974] 10.222.0.25 () {58 vars in 1230 bytes} [Mon Oct 24 09:29:41 2022] DELETE /identity/v3/regions/7de1b6214abd472381dd4a761a7cde3e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:41.395828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152c4cc-dad0-4184-9b53-eb11b8307891 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:41.454110 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=4,keystone:SELECT=95,keystone:DELETE=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:41.486451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4152c4cc-dad0-4184-9b53-eb11b8307891 tempest-RegionsTestJSON-1795487268 tempest-RegionsTestJSON-1795487268-project-admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.508755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.509446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.509947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.510736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] PATH_INFO: `/v3/users/cfb4a2d6cfaf40b4b4ca293a83815e3d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.512202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cfb4a2d6cfaf40b4b4ca293a83815e3d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.514490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.567436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cfb4a2d6cfaf40b4b4ca293a83815e3d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:41.580230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cfb4a2d6cfaf40b4b4ca293a83815e3d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:41.580931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cfb4a2d6cfaf40b4b4ca293a83815e3d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:41.589887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cfb4a2d6cfaf40b4b4ca293a83815e3d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:41.598211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cfb4a2d6cfaf40b4b4ca293a83815e3d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:41.604862 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3987/7975] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:41 2022] DELETE /identity/v3/users/cfb4a2d6cfaf40b4b4ca293a83815e3d => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:41.609281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704e48-66b2-448d-a654-5af3753aa187 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.609667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704e48-66b2-448d-a654-5af3753aa187 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.610014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b704e48-66b2-448d-a654-5af3753aa187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.634675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1b704e48-66b2-448d-a654-5af3753aa187 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:41.636213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b704e48-66b2-448d-a654-5af3753aa187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:41.718958 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3989/7976] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:41.730922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:41.732368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:41.825560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c3b16c-c7ca-45e7-b5bf-0dc56a30abe0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:41.829283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c83cab-55e0-4ba7-8882-3adee7543ed0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:41.829925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83cab-55e0-4ba7-8882-3adee7543ed0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:41.830204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83cab-55e0-4ba7-8882-3adee7543ed0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:41.830473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c83cab-55e0-4ba7-8882-3adee7543ed0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:41.840358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c83cab-55e0-4ba7-8882-3adee7543ed0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:41.841827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c83cab-55e0-4ba7-8882-3adee7543ed0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:41.854111 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3988/7977] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:42.170349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b704e48-66b2-448d-a654-5af3753aa187 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:42.171801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1b704e48-66b2-448d-a654-5af3753aa187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:42.195858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b704e48-66b2-448d-a654-5af3753aa187 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:42.202852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:42.203484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:42.203764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:42.204052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] PATH_INFO: `/v3/projects/45b40ed58a97458db50a972938278d2b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:42.205174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45b40ed58a97458db50a972938278d2b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:42.207125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:42.259452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45b40ed58a97458db50a972938278d2b', 'request_id': 'req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.266664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45b40ed58a97458db50a972938278d2b', 'request_id': 'req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.275515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45b40ed58a97458db50a972938278d2b', 'request_id': 'req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.288100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] The token cache is being invalidate because project 45b40ed58a97458db50a972938278d2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:42.288512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.289229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.291053 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3990/7978] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:42 2022] DELETE /identity/v3/projects/45b40ed58a97458db50a972938278d2b => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:42.294797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c83cab-55e0-4ba7-8882-3adee7543ed0 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:42.305377 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c83cab-55e0-4ba7-8882-3adee7543ed0 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:42.339458 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:42.370811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:42.371455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:42.371737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:42.372016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] PATH_INFO: `/v3/users/4607e3d7191041cb9187bb9b330a9d4c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:42.373162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=4607e3d7191041cb9187bb9b330a9d4c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:42.375130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:42.426092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4607e3d7191041cb9187bb9b330a9d4c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.440193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4607e3d7191041cb9187bb9b330a9d4c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.440963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4607e3d7191041cb9187bb9b330a9d4c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.451387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4607e3d7191041cb9187bb9b330a9d4c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.461444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-223c2ac7-b68d-4c6c-b281-32b95010d4bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4607e3d7191041cb9187bb9b330a9d4c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.471829 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3989/7979] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:42 2022] DELETE /identity/v3/users/4607e3d7191041cb9187bb9b330a9d4c => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:42.811415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:42.812854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:42.846692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffc74e0-cf4d-4a17-9498-a079e13b7d7b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:42.916195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:42.916827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:42.917112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:42.917429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] PATH_INFO: `/v3/projects/22227672d1a740b489107c5acc7619dd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:42.918568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22227672d1a740b489107c5acc7619dd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:42.920485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:42.933988 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:42.984258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22227672d1a740b489107c5acc7619dd', 'request_id': 'req-da9bb611-3b68-4a61-aae9-e6ab13c103e6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:42.995792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22227672d1a740b489107c5acc7619dd', 'request_id': 'req-da9bb611-3b68-4a61-aae9-e6ab13c103e6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:43.007114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22227672d1a740b489107c5acc7619dd', 'request_id': 'req-da9bb611-3b68-4a61-aae9-e6ab13c103e6'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:43.035905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] The token cache is being invalidate because project 22227672d1a740b489107c5acc7619dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:43.036204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:43.038472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-da9bb611-3b68-4a61-aae9-e6ab13c103e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:43.053338 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3991/7980] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:42 2022] DELETE /identity/v3/projects/22227672d1a740b489107c5acc7619dd => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:43.057865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d522c9-7416-420b-9ef8-f58dbe8c3cd0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.057865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d522c9-7416-420b-9ef8-f58dbe8c3cd0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.057865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d522c9-7416-420b-9ef8-f58dbe8c3cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.081288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e6d522c9-7416-420b-9ef8-f58dbe8c3cd0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:43.082637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e6d522c9-7416-420b-9ef8-f58dbe8c3cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:43.174471 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3990/7981] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:43.183937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185f41-55f0-424f-b632-b07b0c0978ab None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.184310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185f41-55f0-424f-b632-b07b0c0978ab None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.184528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d185f41-55f0-424f-b632-b07b0c0978ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.207526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6d185f41-55f0-424f-b632-b07b0c0978ab None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:43.208775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6d185f41-55f0-424f-b632-b07b0c0978ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:43.221655 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3992/7982] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:43.222828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d522c9-7416-420b-9ef8-f58dbe8c3cd0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:43.239009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d522c9-7416-420b-9ef8-f58dbe8c3cd0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:43.249065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d982c-d91f-481a-9f36-3f4b436c7a92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:43.249865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d982c-d91f-481a-9f36-3f4b436c7a92 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.250219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d982c-d91f-481a-9f36-3f4b436c7a92 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.250568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d982c-d91f-481a-9f36-3f4b436c7a92 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.251307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d982c-d91f-481a-9f36-3f4b436c7a92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:43.251686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d982c-d91f-481a-9f36-3f4b436c7a92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:43.253588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d982c-d91f-481a-9f36-3f4b436c7a92 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:43.274898 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3991/7983] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:29:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:43.276360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185f41-55f0-424f-b632-b07b0c0978ab None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:43.291441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d185f41-55f0-424f-b632-b07b0c0978ab None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:43.303211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810b4e0-d5dd-4742-98ec-f981f46db3bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:43.303924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810b4e0-d5dd-4742-98ec-f981f46db3bb admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.304297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810b4e0-d5dd-4742-98ec-f981f46db3bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.304678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810b4e0-d5dd-4742-98ec-f981f46db3bb admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.305604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810b4e0-d5dd-4742-98ec-f981f46db3bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:43.307714 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810b4e0-d5dd-4742-98ec-f981f46db3bb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:43.357578 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3993/7984] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:43 2022] POST /identity/v3/projects => generated 393 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:43.361442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d982c-d91f-481a-9f36-3f4b436c7a92 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:43.374220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d982c-d91f-481a-9f36-3f4b436c7a92 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:43.429066 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:43.461826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b966-3ff7-47df-8ba4-59a2cc6aadfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:43.462716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b966-3ff7-47df-8ba4-59a2cc6aadfd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.463050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b966-3ff7-47df-8ba4-59a2cc6aadfd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.463336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a6b966-3ff7-47df-8ba4-59a2cc6aadfd admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.463981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6b966-3ff7-47df-8ba4-59a2cc6aadfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:43.466089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a6b966-3ff7-47df-8ba4-59a2cc6aadfd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:43.500910 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3992/7985] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:43 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:43.507043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810b4e0-d5dd-4742-98ec-f981f46db3bb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:43.531404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810b4e0-d5dd-4742-98ec-f981f46db3bb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:43.539750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938acc4-0ab2-4752-aeb3-26be792ae952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:43.540713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938acc4-0ab2-4752-aeb3-26be792ae952 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.541087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938acc4-0ab2-4752-aeb3-26be792ae952 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.541480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938acc4-0ab2-4752-aeb3-26be792ae952 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.542680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938acc4-0ab2-4752-aeb3-26be792ae952 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:43.544808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938acc4-0ab2-4752-aeb3-26be792ae952 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:43.571342 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3994/7986] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:43.575112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b966-3ff7-47df-8ba4-59a2cc6aadfd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:43.591212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a6b966-3ff7-47df-8ba4-59a2cc6aadfd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:43.597446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77d538c-a927-4927-90ac-88e2b6141db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:43.600143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d538c-a927-4927-90ac-88e2b6141db4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.600534 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d538c-a927-4927-90ac-88e2b6141db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.600906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77d538c-a927-4927-90ac-88e2b6141db4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.601710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d538c-a927-4927-90ac-88e2b6141db4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:43.603736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77d538c-a927-4927-90ac-88e2b6141db4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:43.622735 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3993/7987] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:43 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:29:43.626972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938acc4-0ab2-4752-aeb3-26be792ae952 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:43.649646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938acc4-0ab2-4752-aeb3-26be792ae952 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:43.667181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c51181-4994-4876-a7e9-d560674645a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:43.667919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c51181-4994-4876-a7e9-d560674645a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.668162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c51181-4994-4876-a7e9-d560674645a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.668436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c51181-4994-4876-a7e9-d560674645a2 admin admin] PATH_INFO: `/v3/projects/7c377f23e8fa4dbeae0f343d8f3811d4/users/947f708b91624a688b6834205670bfb1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.698583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c51181-4994-4876-a7e9-d560674645a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c377f23e8fa4dbeae0f343d8f3811d4, user_id=947f708b91624a688b6834205670bfb1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:43.704826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c51181-4994-4876-a7e9-d560674645a2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:43.733240 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3995/7988] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:43 2022] PUT /identity/v3/projects/7c377f23e8fa4dbeae0f343d8f3811d4/users/947f708b91624a688b6834205670bfb1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:43.745107 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de7b51-c61c-4988-9458-4fd90127fa2c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.745639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de7b51-c61c-4988-9458-4fd90127fa2c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.746077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39de7b51-c61c-4988-9458-4fd90127fa2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.790207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-39de7b51-c61c-4988-9458-4fd90127fa2c None None] MFA Rules not processed for user `947f708b91624a688b6834205670bfb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:43.791168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39de7b51-c61c-4988-9458-4fd90127fa2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:43.887740 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3994/7989] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:43 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:43.889024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c51181-4994-4876-a7e9-d560674645a2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:43.902857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c51181-4994-4876-a7e9-d560674645a2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:43.911786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e30ac7-edd5-4104-b43e-15dad6cba823 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:43.912480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30ac7-edd5-4104-b43e-15dad6cba823 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:43.912931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30ac7-edd5-4104-b43e-15dad6cba823 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:43.913463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e30ac7-edd5-4104-b43e-15dad6cba823 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:43.914313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e30ac7-edd5-4104-b43e-15dad6cba823 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:create_application_credential(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:43.915466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e30ac7-edd5-4104-b43e-15dad6cba823 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:44.036850 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3996/7990] 10.222.0.25 () {60 vars in 1314 bytes} [Mon Oct 24 09:29:43 2022] POST /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials => generated 789 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:44.038280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de7b51-c61c-4988-9458-4fd90127fa2c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:44.049947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39de7b51-c61c-4988-9458-4fd90127fa2c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:44.057424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79de214-2e7a-4ef2-8513-9918e222f836 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:44.057424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79de214-2e7a-4ef2-8513-9918e222f836 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:44.057424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79de214-2e7a-4ef2-8513-9918e222f836 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:44.057883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79de214-2e7a-4ef2-8513-9918e222f836 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/773b9b62de6a4cdd844bfa42bfd7af1c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:44.075880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79de214-2e7a-4ef2-8513-9918e222f836 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:get_application_credential(user_id=947f708b91624a688b6834205670bfb1, application_credential_id=773b9b62de6a4cdd844bfa42bfd7af1c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:44.078100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79de214-2e7a-4ef2-8513-9918e222f836 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:44.081340 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3995/7991] 10.222.0.25 () {58 vars in 1392 bytes} [Mon Oct 24 09:29:44 2022] GET /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/773b9b62de6a4cdd844bfa42bfd7af1c => generated 689 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:44.084766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cf7c4-5d8b-4302-9a2e-5169f1c7e3a4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:44.085051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cf7c4-5d8b-4302-9a2e-5169f1c7e3a4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:44.085353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cf7c4-5d8b-4302-9a2e-5169f1c7e3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:44.104935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d81cf7c4-5d8b-4302-9a2e-5169f1c7e3a4 None None] MFA Rules not processed for user `947f708b91624a688b6834205670bfb1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:44.106727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d81cf7c4-5d8b-4302-9a2e-5169f1c7e3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:44.155893 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:44.285692 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3997/7992] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:44 2022] POST /identity/v3/auth/tokens => generated 3427 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 406 bytes (1 switches on core 0) Oct 24 09:29:44.290154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79de214-2e7a-4ef2-8513-9918e222f836 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:44.301155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79de214-2e7a-4ef2-8513-9918e222f836 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:44.307528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5e03c-170d-4e41-a702-71c9d96b7656 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:44.308848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5e03c-170d-4e41-a702-71c9d96b7656 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:44.309845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5e03c-170d-4e41-a702-71c9d96b7656 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:44.310418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe5e03c-170d-4e41-a702-71c9d96b7656 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/773b9b62de6a4cdd844bfa42bfd7af1c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:44.314793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5e03c-170d-4e41-a702-71c9d96b7656 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:delete_application_credential(user_id=947f708b91624a688b6834205670bfb1, application_credential_id=773b9b62de6a4cdd844bfa42bfd7af1c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:44.319644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe5e03c-170d-4e41-a702-71c9d96b7656 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:44.352341 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3996/7993] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:29:44 2022] DELETE /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/773b9b62de6a4cdd844bfa42bfd7af1c => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:44.357526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cf7c4-5d8b-4302-9a2e-5169f1c7e3a4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:44.371077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cf7c4-5d8b-4302-9a2e-5169f1c7e3a4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:44.375584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628baf1a-875b-4ba8-abaf-a0f8ed5bd197 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:44.376229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628baf1a-875b-4ba8-abaf-a0f8ed5bd197 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:44.376643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628baf1a-875b-4ba8-abaf-a0f8ed5bd197 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:44.376973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628baf1a-875b-4ba8-abaf-a0f8ed5bd197 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:44.377699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628baf1a-875b-4ba8-abaf-a0f8ed5bd197 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:create_application_credential(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:44.378878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628baf1a-875b-4ba8-abaf-a0f8ed5bd197 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:44.482856 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3998/7994] 10.222.0.25 () {60 vars in 1315 bytes} [Mon Oct 24 09:29:44 2022] POST /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials => generated 921 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:44.484548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5e03c-170d-4e41-a702-71c9d96b7656 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:44.498682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe5e03c-170d-4e41-a702-71c9d96b7656 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:44.509419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603b5fe-7057-4904-9c3f-5149b0f48ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:44.510681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603b5fe-7057-4904-9c3f-5149b0f48ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:44.510999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603b5fe-7057-4904-9c3f-5149b0f48ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:44.511374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6603b5fe-7057-4904-9c3f-5149b0f48ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/af832df05b214c73b783e2f38c246245` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:44.525718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603b5fe-7057-4904-9c3f-5149b0f48ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:delete_application_credential(user_id=947f708b91624a688b6834205670bfb1, application_credential_id=af832df05b214c73b783e2f38c246245)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:44.528270 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6603b5fe-7057-4904-9c3f-5149b0f48ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:44.572682 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628baf1a-875b-4ba8-abaf-a0f8ed5bd197 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:44.574148 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3997/7995] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:29:44 2022] DELETE /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/af832df05b214c73b783e2f38c246245 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:44.598297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628baf1a-875b-4ba8-abaf-a0f8ed5bd197 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:44.604343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233083e7-b611-4656-b48a-c638356d7ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:44.605141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233083e7-b611-4656-b48a-c638356d7ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:44.605672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233083e7-b611-4656-b48a-c638356d7ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:44.605922 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233083e7-b611-4656-b48a-c638356d7ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:44.606694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233083e7-b611-4656-b48a-c638356d7ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:create_application_credential(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:44.607943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233083e7-b611-4656-b48a-c638356d7ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:44.725902 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 3999/7996] 10.222.0.25 () {60 vars in 1315 bytes} [Mon Oct 24 09:29:44 2022] POST /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials => generated 813 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:44.732554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603b5fe-7057-4904-9c3f-5149b0f48ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:44.750947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6603b5fe-7057-4904-9c3f-5149b0f48ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:44.762495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37734acc-986d-46c1-81ef-0f63f3a112d6 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:44.763605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37734acc-986d-46c1-81ef-0f63f3a112d6 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:44.764091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37734acc-986d-46c1-81ef-0f63f3a112d6 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:44.764578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37734acc-986d-46c1-81ef-0f63f3a112d6 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/d8bc689ee8504ab299e85fb5cf82efa7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:44.794301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37734acc-986d-46c1-81ef-0f63f3a112d6 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:delete_application_credential(user_id=947f708b91624a688b6834205670bfb1, application_credential_id=d8bc689ee8504ab299e85fb5cf82efa7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:44.796683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37734acc-986d-46c1-81ef-0f63f3a112d6 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:44.826226 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3998/7997] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:29:44 2022] DELETE /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/d8bc689ee8504ab299e85fb5cf82efa7 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:44.831013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233083e7-b611-4656-b48a-c638356d7ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:44.854627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233083e7-b611-4656-b48a-c638356d7ca2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:44.862228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ec7fe-4a6a-4900-b667-5f3edb33f79d tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:44.863503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ec7fe-4a6a-4900-b667-5f3edb33f79d tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:44.863890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ec7fe-4a6a-4900-b667-5f3edb33f79d tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:44.864384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48ec7fe-4a6a-4900-b667-5f3edb33f79d tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:44.866283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ec7fe-4a6a-4900-b667-5f3edb33f79d tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:create_application_credential(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:44.867640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48ec7fe-4a6a-4900-b667-5f3edb33f79d tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:44.875119 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:44.958256 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4000/7998] 10.222.0.25 () {60 vars in 1314 bytes} [Mon Oct 24 09:29:44 2022] POST /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials => generated 788 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:44.962556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37734acc-986d-46c1-81ef-0f63f3a112d6 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:44.975657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37734acc-986d-46c1-81ef-0f63f3a112d6 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:44.983420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20e9a1-23a0-4d5b-91e3-3e5a6a597617 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:44.985599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e9a1-23a0-4d5b-91e3-3e5a6a597617 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:44.985995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e9a1-23a0-4d5b-91e3-3e5a6a597617 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:44.986589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e9a1-23a0-4d5b-91e3-3e5a6a597617 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:44.987240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20e9a1-23a0-4d5b-91e3-3e5a6a597617 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:create_application_credential(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:44.988678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20e9a1-23a0-4d5b-91e3-3e5a6a597617 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:44.996306 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:45.087978 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 3999/7999] 10.222.0.25 () {60 vars in 1314 bytes} [Mon Oct 24 09:29:44 2022] POST /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials => generated 789 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:45.092153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ec7fe-4a6a-4900-b667-5f3edb33f79d tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:45.105046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48ec7fe-4a6a-4900-b667-5f3edb33f79d tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:45.110713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390b585-808f-4a85-a808-732e4b405971 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:45.111867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b585-808f-4a85-a808-732e4b405971 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:45.112373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b585-808f-4a85-a808-732e4b405971 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:45.112844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5390b585-808f-4a85-a808-732e4b405971 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:45.113974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390b585-808f-4a85-a808-732e4b405971 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:list_application_credentials(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:45.117873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5390b585-808f-4a85-a808-732e4b405971 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:45.138109 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4001/8000] 10.222.0.25 () {58 vars in 1293 bytes} [Mon Oct 24 09:29:45 2022] GET /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials => generated 1501 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:45.142922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20e9a1-23a0-4d5b-91e3-3e5a6a597617 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:45.157045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20e9a1-23a0-4d5b-91e3-3e5a6a597617 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:45.163103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356e664-fca4-4402-a372-873bb5e3737f tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:45.164179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356e664-fca4-4402-a372-873bb5e3737f tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:45.164576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356e664-fca4-4402-a372-873bb5e3737f tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:45.164955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356e664-fca4-4402-a372-873bb5e3737f tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/8cdc659b7f184e299b07e8f5d43ff645` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:45.176402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356e664-fca4-4402-a372-873bb5e3737f tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:delete_application_credential(user_id=947f708b91624a688b6834205670bfb1, application_credential_id=8cdc659b7f184e299b07e8f5d43ff645)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:45.181542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356e664-fca4-4402-a372-873bb5e3737f tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:45.209401 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4000/8001] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:29:45 2022] DELETE /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/8cdc659b7f184e299b07e8f5d43ff645 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:45.214171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390b585-808f-4a85-a808-732e4b405971 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:45.230042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5390b585-808f-4a85-a808-732e4b405971 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:45.245197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc3a4a-7990-4bae-96c5-6bb5102ffc4e tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:45.246037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc3a4a-7990-4bae-96c5-6bb5102ffc4e tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:45.246422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc3a4a-7990-4bae-96c5-6bb5102ffc4e tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:45.246856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebc3a4a-7990-4bae-96c5-6bb5102ffc4e tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/3dd5d01d089544419bd260d5127dbb76` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:45.258403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc3a4a-7990-4bae-96c5-6bb5102ffc4e tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:delete_application_credential(user_id=947f708b91624a688b6834205670bfb1, application_credential_id=3dd5d01d089544419bd260d5127dbb76)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:45.260125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebc3a4a-7990-4bae-96c5-6bb5102ffc4e tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:45.294690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356e664-fca4-4402-a372-873bb5e3737f tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:45.295221 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4002/8002] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:29:45 2022] DELETE /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/3dd5d01d089544419bd260d5127dbb76 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:45.307166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356e664-fca4-4402-a372-873bb5e3737f tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:45.311804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55fbc6-b11a-49c7-a1ce-ee2635d69a86 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:45.312625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55fbc6-b11a-49c7-a1ce-ee2635d69a86 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:45.313260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55fbc6-b11a-49c7-a1ce-ee2635d69a86 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:45.313672 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca55fbc6-b11a-49c7-a1ce-ee2635d69a86 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:45.315174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55fbc6-b11a-49c7-a1ce-ee2635d69a86 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:create_application_credential(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:45.316661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca55fbc6-b11a-49c7-a1ce-ee2635d69a86 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:45.455222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc3a4a-7990-4bae-96c5-6bb5102ffc4e tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:45.461684 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4001/8003] 10.222.0.25 () {60 vars in 1314 bytes} [Mon Oct 24 09:29:45 2022] POST /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials => generated 788 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:45.467823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebc3a4a-7990-4bae-96c5-6bb5102ffc4e tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:45.481217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ef746-8451-4624-95ad-406dea4fa666 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:45.482103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ef746-8451-4624-95ad-406dea4fa666 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:45.485380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ef746-8451-4624-95ad-406dea4fa666 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:45.485875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034ef746-8451-4624-95ad-406dea4fa666 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:45.486913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ef746-8451-4624-95ad-406dea4fa666 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:create_application_credential(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:45.488334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034ef746-8451-4624-95ad-406dea4fa666 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:45.683007 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4003/8004] 10.222.0.25 () {60 vars in 1314 bytes} [Mon Oct 24 09:29:45 2022] POST /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials => generated 788 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:45.686969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55fbc6-b11a-49c7-a1ce-ee2635d69a86 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:45.700092 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca55fbc6-b11a-49c7-a1ce-ee2635d69a86 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:45.707238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac2819-21e5-4207-bbeb-7c33a5877e85 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:45.708048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac2819-21e5-4207-bbeb-7c33a5877e85 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:45.710049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac2819-21e5-4207-bbeb-7c33a5877e85 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:45.710921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac2819-21e5-4207-bbeb-7c33a5877e85 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:45.711897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac2819-21e5-4207-bbeb-7c33a5877e85 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Adding query filter params (name=tempest-application_credential-639614630) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:45.712525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac2819-21e5-4207-bbeb-7c33a5877e85 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:list_application_credentials(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:45.715149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac2819-21e5-4207-bbeb-7c33a5877e85 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:45.741027 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4002/8005] 10.222.0.25 () {58 vars in 1384 bytes} [Mon Oct 24 09:29:45 2022] GET /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials?name=tempest-application_credential-639614630 => generated 885 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:45.745127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ef746-8451-4624-95ad-406dea4fa666 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:45.763018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034ef746-8451-4624-95ad-406dea4fa666 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:45.769607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25905b-b7ab-46aa-859c-0951d666e4af tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:45.770766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25905b-b7ab-46aa-859c-0951d666e4af tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:45.771541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25905b-b7ab-46aa-859c-0951d666e4af tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:45.772053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25905b-b7ab-46aa-859c-0951d666e4af tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/0587979a1f3443e4bc3c292aa7659222` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:45.786329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25905b-b7ab-46aa-859c-0951d666e4af tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:delete_application_credential(user_id=947f708b91624a688b6834205670bfb1, application_credential_id=0587979a1f3443e4bc3c292aa7659222)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:45.789660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25905b-b7ab-46aa-859c-0951d666e4af tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:45.844031 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4004/8006] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:29:45 2022] DELETE /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/0587979a1f3443e4bc3c292aa7659222 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:45.848016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac2819-21e5-4207-bbeb-7c33a5877e85 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:45.873971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac2819-21e5-4207-bbeb-7c33a5877e85 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:45.899466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538608a-4f0f-4380-ace4-a925fe327ef2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '947f708b91624a688b6834205670bfb1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7c377f23e8fa4dbeae0f343d8f3811d4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:45.900137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538608a-4f0f-4380-ace4-a925fe327ef2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:45.900412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538608a-4f0f-4380-ace4-a925fe327ef2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:45.900859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538608a-4f0f-4380-ace4-a925fe327ef2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/615ab6bcd2e345e29f52f74b9dfc9cd4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:45.917057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538608a-4f0f-4380-ace4-a925fe327ef2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorizing `identity:delete_application_credential(user_id=947f708b91624a688b6834205670bfb1, application_credential_id=615ab6bcd2e345e29f52f74b9dfc9cd4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:45.919460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538608a-4f0f-4380-ace4-a925fe327ef2 tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:45.949283 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4003/8007] 10.222.0.25 () {58 vars in 1395 bytes} [Mon Oct 24 09:29:45 2022] DELETE /identity/v3/users/947f708b91624a688b6834205670bfb1/application_credentials/615ab6bcd2e345e29f52f74b9dfc9cd4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:45.954475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25905b-b7ab-46aa-859c-0951d666e4af tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:46.003350 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:46.072043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25905b-b7ab-46aa-859c-0951d666e4af tempest-ApplicationCredentialsV3Test-1302275932 tempest-ApplicationCredentialsV3Test-1302275932-project] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:46.080956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:46.081651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:46.081931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:46.082221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] PATH_INFO: `/v3/users/947f708b91624a688b6834205670bfb1` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:46.083440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] RBAC: Authorizing `identity:delete_user(user_id=947f708b91624a688b6834205670bfb1)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:46.086697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:46.159236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '947f708b91624a688b6834205670bfb1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:46.184904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '947f708b91624a688b6834205670bfb1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:46.185763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '947f708b91624a688b6834205670bfb1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:46.196705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '947f708b91624a688b6834205670bfb1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:46.207308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '947f708b91624a688b6834205670bfb1'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:46.218032 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4005/8008] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:45 2022] DELETE /identity/v3/users/947f708b91624a688b6834205670bfb1 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:46.219492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5673f-d683-4583-88b2-2cc68e293299 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:46.219734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5673f-d683-4583-88b2-2cc68e293299 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:46.220017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c5673f-d683-4583-88b2-2cc68e293299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:46.261807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-40c5673f-d683-4583-88b2-2cc68e293299 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:46.267655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-40c5673f-d683-4583-88b2-2cc68e293299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:46.296547 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:INSERT=4,keystone:DELETE=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:46.351442 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4004/8009] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:46.357890 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:46.359683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:46.468879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de09c3f-5bd2-415c-88bd-c50e7228319e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:46.483366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de749a3-04c4-4175-97dd-e105e4dd49ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:46.484201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de749a3-04c4-4175-97dd-e105e4dd49ce service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:46.484670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de749a3-04c4-4175-97dd-e105e4dd49ce service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:46.485228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de749a3-04c4-4175-97dd-e105e4dd49ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:46.498687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de749a3-04c4-4175-97dd-e105e4dd49ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:46.500342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de749a3-04c4-4175-97dd-e105e4dd49ce service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:46.518721 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4006/8010] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:46.856918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5673f-d683-4583-88b2-2cc68e293299 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:46.859781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-40c5673f-d683-4583-88b2-2cc68e293299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:46.888786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c5673f-d683-4583-88b2-2cc68e293299 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:46.912505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:46.913214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:46.913537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:46.913990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] PATH_INFO: `/v3/projects/7c377f23e8fa4dbeae0f343d8f3811d4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:46.915302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c377f23e8fa4dbeae0f343d8f3811d4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:46.919049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:46.994376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c377f23e8fa4dbeae0f343d8f3811d4', 'request_id': 'req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:47.002457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c377f23e8fa4dbeae0f343d8f3811d4', 'request_id': 'req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:47.009352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c377f23e8fa4dbeae0f343d8f3811d4', 'request_id': 'req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:47.020321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] The token cache is being invalidate because project 7c377f23e8fa4dbeae0f343d8f3811d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:47.020616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:47.021936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9a7d240a-6235-4f9f-a4b3-8c92a36d00bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:47.023712 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4005/8011] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:46 2022] DELETE /identity/v3/projects/7c377f23e8fa4dbeae0f343d8f3811d4 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:47.032377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82fae9-e151-4c89-b2c0-dff82d339007 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.032916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82fae9-e151-4c89-b2c0-dff82d339007 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.033462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d82fae9-e151-4c89-b2c0-dff82d339007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.059356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5d82fae9-e151-4c89-b2c0-dff82d339007 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:47.061396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d82fae9-e151-4c89-b2c0-dff82d339007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:47.127121 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:47.172752 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4007/8012] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:29:47.181956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d60f4-1f70-4981-a8dd-89407645befa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.182248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d60f4-1f70-4981-a8dd-89407645befa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.182530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d60f4-1f70-4981-a8dd-89407645befa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.207488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cf3d60f4-1f70-4981-a8dd-89407645befa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:47.209781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cf3d60f4-1f70-4981-a8dd-89407645befa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:47.218655 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4006/8013] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:47.223548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82fae9-e151-4c89-b2c0-dff82d339007 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:47.235420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d82fae9-e151-4c89-b2c0-dff82d339007 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:47.241850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6b059-fe44-4ccf-b43b-da439725bda7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:47.242509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6b059-fe44-4ccf-b43b-da439725bda7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.243126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6b059-fe44-4ccf-b43b-da439725bda7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.243730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc6b059-fe44-4ccf-b43b-da439725bda7 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.244527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6b059-fe44-4ccf-b43b-da439725bda7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:47.244797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6b059-fe44-4ccf-b43b-da439725bda7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:47.246581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc6b059-fe44-4ccf-b43b-da439725bda7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:47.262995 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4008/8014] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:29:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:29:47.268052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d60f4-1f70-4981-a8dd-89407645befa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:47.281740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d60f4-1f70-4981-a8dd-89407645befa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:47.288412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b7e5-144a-474c-8289-8c0fdad274af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:47.288978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b7e5-144a-474c-8289-8c0fdad274af admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.289267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b7e5-144a-474c-8289-8c0fdad274af admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.289640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4173b7e5-144a-474c-8289-8c0fdad274af admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.290578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173b7e5-144a-474c-8289-8c0fdad274af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:47.292584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4173b7e5-144a-474c-8289-8c0fdad274af admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:47.332508 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4007/8015] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:47 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:47.337340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6b059-fe44-4ccf-b43b-da439725bda7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:47.354205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc6b059-fe44-4ccf-b43b-da439725bda7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:47.441634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56804-8f74-4875-8e75-314067ee7f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:47.442548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56804-8f74-4875-8e75-314067ee7f43 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.443010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56804-8f74-4875-8e75-314067ee7f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.444001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba56804-8f74-4875-8e75-314067ee7f43 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.445535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba56804-8f74-4875-8e75-314067ee7f43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:47.447790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba56804-8f74-4875-8e75-314067ee7f43 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:47.479211 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4009/8016] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:47 2022] POST /identity/v3/users => generated 286 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:47.483832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b7e5-144a-474c-8289-8c0fdad274af admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:47.501203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4173b7e5-144a-474c-8289-8c0fdad274af admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:47.509871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89286f2a-eefa-4c2b-83f5-bfcd98523e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:47.510525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286f2a-eefa-4c2b-83f5-bfcd98523e44 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.511154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286f2a-eefa-4c2b-83f5-bfcd98523e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.511440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89286f2a-eefa-4c2b-83f5-bfcd98523e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.512111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89286f2a-eefa-4c2b-83f5-bfcd98523e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:47.514062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89286f2a-eefa-4c2b-83f5-bfcd98523e44 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:47.529557 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4008/8017] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:47.531484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56804-8f74-4875-8e75-314067ee7f43 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:47.542830 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba56804-8f74-4875-8e75-314067ee7f43 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:47.548947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa9c15c-cf79-43c7-81fb-43090f6116eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:47.550045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c15c-cf79-43c7-81fb-43090f6116eb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.550337 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c15c-cf79-43c7-81fb-43090f6116eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.550616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa9c15c-cf79-43c7-81fb-43090f6116eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.551281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9c15c-cf79-43c7-81fb-43090f6116eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:47.561635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa9c15c-cf79-43c7-81fb-43090f6116eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:47.598907 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4010/8018] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:47 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:29:47.600321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89286f2a-eefa-4c2b-83f5-bfcd98523e44 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:47.620254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89286f2a-eefa-4c2b-83f5-bfcd98523e44 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:47.634755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e110b-d16b-46a0-9cb2-e24092c4e062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:47.636269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e110b-d16b-46a0-9cb2-e24092c4e062 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.636783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e110b-d16b-46a0-9cb2-e24092c4e062 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.637075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e110b-d16b-46a0-9cb2-e24092c4e062 admin admin] PATH_INFO: `/v3/projects/da886eefe5be4bde8d2620013b47df97/users/74357112a6c24b84b20431190a59238a/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.674076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e110b-d16b-46a0-9cb2-e24092c4e062 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da886eefe5be4bde8d2620013b47df97, user_id=74357112a6c24b84b20431190a59238a, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:47.678671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e110b-d16b-46a0-9cb2-e24092c4e062 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:47.707582 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4009/8019] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:47 2022] PUT /identity/v3/projects/da886eefe5be4bde8d2620013b47df97/users/74357112a6c24b84b20431190a59238a/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:47.719753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05885031-48ac-4f76-af1f-d928b83ad8c9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.720054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05885031-48ac-4f76-af1f-d928b83ad8c9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.720362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05885031-48ac-4f76-af1f-d928b83ad8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.769150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-05885031-48ac-4f76-af1f-d928b83ad8c9 None None] MFA Rules not processed for user `74357112a6c24b84b20431190a59238a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:47.770366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-05885031-48ac-4f76-af1f-d928b83ad8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:47.856656 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4011/8020] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:29:47.866388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e110b-d16b-46a0-9cb2-e24092c4e062 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:47.868237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-474e110b-d16b-46a0-9cb2-e24092c4e062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:47.929190 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:47.968211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e110b-d16b-46a0-9cb2-e24092c4e062 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:47.979321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ffc32-a4ca-4994-83e3-482b551556e7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:47.980018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ffc32-a4ca-4994-83e3-482b551556e7 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:47.980305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ffc32-a4ca-4994-83e3-482b551556e7 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:47.980586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ffc32-a4ca-4994-83e3-482b551556e7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:47.994891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ffc32-a4ca-4994-83e3-482b551556e7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:47.996729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ffc32-a4ca-4994-83e3-482b551556e7 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:48.011275 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4010/8021] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:48.129174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05885031-48ac-4f76-af1f-d928b83ad8c9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:48.186401 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:48.219909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05885031-48ac-4f76-af1f-d928b83ad8c9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:48.226100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:48.226740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:48.227018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:48.227290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] PATH_INFO: `/v3/users/74357112a6c24b84b20431190a59238a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:48.228412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74357112a6c24b84b20431190a59238a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:48.231755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:48.287883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74357112a6c24b84b20431190a59238a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:48.304113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74357112a6c24b84b20431190a59238a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:48.304999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74357112a6c24b84b20431190a59238a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:48.314344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74357112a6c24b84b20431190a59238a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:48.324381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74357112a6c24b84b20431190a59238a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:48.336964 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4012/8022] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:48 2022] DELETE /identity/v3/users/74357112a6c24b84b20431190a59238a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:48.342204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f15e-c9e0-4f03-8753-daa56020c39a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:48.342968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f15e-c9e0-4f03-8753-daa56020c39a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:48.343400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7999f15e-c9e0-4f03-8753-daa56020c39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:48.367039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7999f15e-c9e0-4f03-8753-daa56020c39a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:48.368380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7999f15e-c9e0-4f03-8753-daa56020c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:48.454646 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4011/8023] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:48.465965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:48.467343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:48.573713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bedbc70-4e49-4657-acc6-23603326abd3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:48.579599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a916b710-bf93-4da1-a357-7ad8725a45ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:48.580772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b710-bf93-4da1-a357-7ad8725a45ed service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:48.581059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b710-bf93-4da1-a357-7ad8725a45ed service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:48.581376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a916b710-bf93-4da1-a357-7ad8725a45ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:48.597205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916b710-bf93-4da1-a357-7ad8725a45ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:48.601644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a916b710-bf93-4da1-a357-7ad8725a45ed service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:48.633600 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4013/8024] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:49.218851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f15e-c9e0-4f03-8753-daa56020c39a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:49.221458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7999f15e-c9e0-4f03-8753-daa56020c39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:49.238834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7999f15e-c9e0-4f03-8753-daa56020c39a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:49.245331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:49.246173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.246657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.247036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] PATH_INFO: `/v3/projects/da886eefe5be4bde8d2620013b47df97` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.248550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da886eefe5be4bde8d2620013b47df97)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:49.251162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:49.324126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da886eefe5be4bde8d2620013b47df97', 'request_id': 'req-dd03d40b-4bde-4585-88fe-8405da0dffe5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:49.335283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da886eefe5be4bde8d2620013b47df97', 'request_id': 'req-dd03d40b-4bde-4585-88fe-8405da0dffe5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:49.344660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da886eefe5be4bde8d2620013b47df97', 'request_id': 'req-dd03d40b-4bde-4585-88fe-8405da0dffe5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:49.358701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] The token cache is being invalidate because project da886eefe5be4bde8d2620013b47df97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:49.359011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:49.359975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd03d40b-4bde-4585-88fe-8405da0dffe5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:49.361238 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4012/8025] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:49 2022] DELETE /identity/v3/projects/da886eefe5be4bde8d2620013b47df97 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:49.366899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2f1ba-57d7-4294-adfa-28cbda200667 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.367462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2f1ba-57d7-4294-adfa-28cbda200667 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.367462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad2f1ba-57d7-4294-adfa-28cbda200667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.389705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-bad2f1ba-57d7-4294-adfa-28cbda200667 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:49.390937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-bad2f1ba-57d7-4294-adfa-28cbda200667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:49.453026 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:49.466968 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4014/8026] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:49.474127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5939db-17b8-4684-9b39-69b6001d23ce None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.474612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5939db-17b8-4684-9b39-69b6001d23ce None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.474920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5939db-17b8-4684-9b39-69b6001d23ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.496618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8d5939db-17b8-4684-9b39-69b6001d23ce None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:49.498115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d5939db-17b8-4684-9b39-69b6001d23ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:49.507324 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4013/8027] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:29:49.511458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2f1ba-57d7-4294-adfa-28cbda200667 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:49.521955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad2f1ba-57d7-4294-adfa-28cbda200667 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:49.527946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cb3dc-f215-418d-be20-f643a549e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:49.528850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cb3dc-f215-418d-be20-f643a549e5ae admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.529236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cb3dc-f215-418d-be20-f643a549e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.529644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59cb3dc-f215-418d-be20-f643a549e5ae admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.530370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cb3dc-f215-418d-be20-f643a549e5ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:29:49.530747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cb3dc-f215-418d-be20-f643a549e5ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:49.532461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59cb3dc-f215-418d-be20-f643a549e5ae admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:49.546575 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4015/8028] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:29:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:29:49.550787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5939db-17b8-4684-9b39-69b6001d23ce None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:49.565654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5939db-17b8-4684-9b39-69b6001d23ce None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:49.570794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f2da-9017-4f57-ac83-b04396f7da99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:49.571399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f2da-9017-4f57-ac83-b04396f7da99 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.571682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f2da-9017-4f57-ac83-b04396f7da99 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.571957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e3f2da-9017-4f57-ac83-b04396f7da99 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.572594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3f2da-9017-4f57-ac83-b04396f7da99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:49.574542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e3f2da-9017-4f57-ac83-b04396f7da99 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:49.607373 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4014/8029] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:49 2022] POST /identity/v3/projects => generated 405 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:49.611381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cb3dc-f215-418d-be20-f643a549e5ae admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:49.623341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59cb3dc-f215-418d-be20-f643a549e5ae admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:49.692554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e1a8a-b276-48e8-9d9f-e39fbe61759e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:49.693826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1a8a-b276-48e8-9d9f-e39fbe61759e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.694111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1a8a-b276-48e8-9d9f-e39fbe61759e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.694445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e1a8a-b276-48e8-9d9f-e39fbe61759e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.695371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e1a8a-b276-48e8-9d9f-e39fbe61759e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:49.697358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e1a8a-b276-48e8-9d9f-e39fbe61759e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:49.721485 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4016/8030] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:49 2022] POST /identity/v3/users => generated 303 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:49.725667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f2da-9017-4f57-ac83-b04396f7da99 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:49.737261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e3f2da-9017-4f57-ac83-b04396f7da99 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:49.743242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad1ef0-9c76-47b7-8e55-1890684164e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:49.743849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad1ef0-9c76-47b7-8e55-1890684164e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.744134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad1ef0-9c76-47b7-8e55-1890684164e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.744417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad1ef0-9c76-47b7-8e55-1890684164e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.745059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad1ef0-9c76-47b7-8e55-1890684164e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:49.746753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad1ef0-9c76-47b7-8e55-1890684164e6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:49.757681 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4015/8031] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:29:49.762314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e1a8a-b276-48e8-9d9f-e39fbe61759e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:49.774371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e1a8a-b276-48e8-9d9f-e39fbe61759e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:49.779656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bd4c1b-6239-476c-8ff7-e4bff6f1cef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:49.780289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd4c1b-6239-476c-8ff7-e4bff6f1cef0 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.780574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd4c1b-6239-476c-8ff7-e4bff6f1cef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.780852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bd4c1b-6239-476c-8ff7-e4bff6f1cef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.781690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd4c1b-6239-476c-8ff7-e4bff6f1cef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:49.783314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bd4c1b-6239-476c-8ff7-e4bff6f1cef0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:49.800445 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4017/8032] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:49 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:29:49.804813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad1ef0-9c76-47b7-8e55-1890684164e6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:49.817875 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad1ef0-9c76-47b7-8e55-1890684164e6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:49.823124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55fb4-9816-4569-a5f1-6db104aebcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:49.824240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55fb4-9816-4569-a5f1-6db104aebcd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.824767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55fb4-9816-4569-a5f1-6db104aebcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.825425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d55fb4-9816-4569-a5f1-6db104aebcd3 admin admin] PATH_INFO: `/v3/projects/8526e214132f4cc99b7dbadba031a7de/users/af52ad4b0eb34b54bb5e09721b5d13d8/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.837192 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:49.846208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55fb4-9816-4569-a5f1-6db104aebcd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8526e214132f4cc99b7dbadba031a7de, user_id=af52ad4b0eb34b54bb5e09721b5d13d8, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:49.851350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d55fb4-9816-4569-a5f1-6db104aebcd3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:49.868217 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4016/8033] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:49 2022] PUT /identity/v3/projects/8526e214132f4cc99b7dbadba031a7de/users/af52ad4b0eb34b54bb5e09721b5d13d8/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:49.878903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be596-a60a-4be3-88ec-692703e310b9 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:49.879493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be596-a60a-4be3-88ec-692703e310b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:49.879842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1be596-a60a-4be3-88ec-692703e310b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:49.914877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ac1be596-a60a-4be3-88ec-692703e310b9 None None] MFA Rules not processed for user `af52ad4b0eb34b54bb5e09721b5d13d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:49.916093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ac1be596-a60a-4be3-88ec-692703e310b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:49.990141 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4018/8034] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:49 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:49.994644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55fb4-9816-4569-a5f1-6db104aebcd3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:50.082864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d55fb4-9816-4569-a5f1-6db104aebcd3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:50.088263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0110-3d74-4b8e-843a-68dfd23d6ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:50.088901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0110-3d74-4b8e-843a-68dfd23d6ad0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:50.089184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0110-3d74-4b8e-843a-68dfd23d6ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:50.089502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb0110-3d74-4b8e-843a-68dfd23d6ad0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:50.090176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb0110-3d74-4b8e-843a-68dfd23d6ad0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:50.092091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb0110-3d74-4b8e-843a-68dfd23d6ad0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:50.124475 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4017/8035] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:29:49 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:50.127756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1be596-a60a-4be3-88ec-692703e310b9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:50.141135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1be596-a60a-4be3-88ec-692703e310b9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:50.250963 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:50.262605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e705c-e7c7-4422-9f25-87e01aa8def5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:50.263663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e705c-e7c7-4422-9f25-87e01aa8def5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:50.264029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e705c-e7c7-4422-9f25-87e01aa8def5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:50.264530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491e705c-e7c7-4422-9f25-87e01aa8def5 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:50.265460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e705c-e7c7-4422-9f25-87e01aa8def5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:50.267712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491e705c-e7c7-4422-9f25-87e01aa8def5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:50.296835 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4019/8036] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:29:50 2022] POST /identity/v3/users => generated 308 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:29:50.301047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0110-3d74-4b8e-843a-68dfd23d6ad0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:50.312678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb0110-3d74-4b8e-843a-68dfd23d6ad0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:50.318620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd248d-996e-4eee-9872-0c8ae8dbc219 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:50.319329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd248d-996e-4eee-9872-0c8ae8dbc219 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:50.319670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd248d-996e-4eee-9872-0c8ae8dbc219 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:50.320016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd248d-996e-4eee-9872-0c8ae8dbc219 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:50.320883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd248d-996e-4eee-9872-0c8ae8dbc219 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:50.323707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd248d-996e-4eee-9872-0c8ae8dbc219 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:50.342519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e705c-e7c7-4422-9f25-87e01aa8def5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:50.343971 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4018/8037] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:50.362115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491e705c-e7c7-4422-9f25-87e01aa8def5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:50.373844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17127-c5dc-4b53-ac01-d99ed3b5a302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:50.375937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17127-c5dc-4b53-ac01-d99ed3b5a302 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:50.377244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17127-c5dc-4b53-ac01-d99ed3b5a302 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:50.378519 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c17127-c5dc-4b53-ac01-d99ed3b5a302 admin admin] PATH_INFO: `/v3/projects/91458014fdba4465adfcbb0ae9316a13/users/f0a0cbbc1a8041b7a11741b47bfcee76/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:50.408845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17127-c5dc-4b53-ac01-d99ed3b5a302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91458014fdba4465adfcbb0ae9316a13, user_id=f0a0cbbc1a8041b7a11741b47bfcee76, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:50.412036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c17127-c5dc-4b53-ac01-d99ed3b5a302 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:50.435504 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4020/8038] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:50 2022] PUT /identity/v3/projects/91458014fdba4465adfcbb0ae9316a13/users/f0a0cbbc1a8041b7a11741b47bfcee76/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:50.439544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd248d-996e-4eee-9872-0c8ae8dbc219 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:50.463282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd248d-996e-4eee-9872-0c8ae8dbc219 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:50.549570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc1060-4ed1-4fa3-aaf4-d02c316e05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:50.550706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc1060-4ed1-4fa3-aaf4-d02c316e05ad admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:50.551095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc1060-4ed1-4fa3-aaf4-d02c316e05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:50.551483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc1060-4ed1-4fa3-aaf4-d02c316e05ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:50.552949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc1060-4ed1-4fa3-aaf4-d02c316e05ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:50.555261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc1060-4ed1-4fa3-aaf4-d02c316e05ad admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:50.568776 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4019/8039] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:29:50 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:29:50.573171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17127-c5dc-4b53-ac01-d99ed3b5a302 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:50.587138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c17127-c5dc-4b53-ac01-d99ed3b5a302 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:50.593252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac28c45-43a9-44cc-af24-c097b4d8f65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:50.594106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac28c45-43a9-44cc-af24-c097b4d8f65f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:50.594670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac28c45-43a9-44cc-af24-c097b4d8f65f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:50.595058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac28c45-43a9-44cc-af24-c097b4d8f65f admin admin] PATH_INFO: `/v3/projects/91458014fdba4465adfcbb0ae9316a13/users/f0a0cbbc1a8041b7a11741b47bfcee76/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:50.597464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac28c45-43a9-44cc-af24-c097b4d8f65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=91458014fdba4465adfcbb0ae9316a13, user_id=f0a0cbbc1a8041b7a11741b47bfcee76, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:50.601413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac28c45-43a9-44cc-af24-c097b4d8f65f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:50.617147 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4021/8040] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:29:50 2022] PUT /identity/v3/projects/91458014fdba4465adfcbb0ae9316a13/users/f0a0cbbc1a8041b7a11741b47bfcee76/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:50.629448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4359-ec18-458f-8576-ac0363403aa3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:50.630033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4359-ec18-458f-8576-ac0363403aa3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:50.630982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4eb4359-ec18-458f-8576-ac0363403aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:50.669474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e4eb4359-ec18-458f-8576-ac0363403aa3 None None] MFA Rules not processed for user `f0a0cbbc1a8041b7a11741b47bfcee76`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:50.671542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4eb4359-ec18-458f-8576-ac0363403aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:50.742207 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:50.776194 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4020/8041] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:50 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:50.789261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac28c45-43a9-44cc-af24-c097b4d8f65f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:50.791146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dac28c45-43a9-44cc-af24-c097b4d8f65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:50.878579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac28c45-43a9-44cc-af24-c097b4d8f65f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:50.883436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec0de0-3651-45b8-9ff2-55372bcdd026 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:50.884556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec0de0-3651-45b8-9ff2-55372bcdd026 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:50.884992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec0de0-3651-45b8-9ff2-55372bcdd026 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:50.885231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec0de0-3651-45b8-9ff2-55372bcdd026 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:50.966980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec0de0-3651-45b8-9ff2-55372bcdd026 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:50.969621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec0de0-3651-45b8-9ff2-55372bcdd026 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:50.982724 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4022/8042] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:50 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:29:51.417832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4359-ec18-458f-8576-ac0363403aa3 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:51.419430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4eb4359-ec18-458f-8576-ac0363403aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:51.564450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4eb4359-ec18-458f-8576-ac0363403aa3 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:51.571789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1ef88-4a2a-4703-97c5-6f7d79e70e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:51.572507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ef88-4a2a-4703-97c5-6f7d79e70e97 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:51.572863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ef88-4a2a-4703-97c5-6f7d79e70e97 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:51.573215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f1ef88-4a2a-4703-97c5-6f7d79e70e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:51.582662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1ef88-4a2a-4703-97c5-6f7d79e70e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:51.584349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f1ef88-4a2a-4703-97c5-6f7d79e70e97 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:51.595484 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4021/8043] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:51 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:56.181546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec0de0-3651-45b8-9ff2-55372bcdd026 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:56.182954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0eec0de0-3651-45b8-9ff2-55372bcdd026 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:56.332769 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:56.367523 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec0de0-3651-45b8-9ff2-55372bcdd026 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:56.387701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474630c-d280-4bf7-b6ef-41616152538b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:56.388755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474630c-d280-4bf7-b6ef-41616152538b service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:56.389113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474630c-d280-4bf7-b6ef-41616152538b service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:56.390752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474630c-d280-4bf7-b6ef-41616152538b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:56.397848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a474630c-d280-4bf7-b6ef-41616152538b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:56.427055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474630c-d280-4bf7-b6ef-41616152538b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:56.433203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474630c-d280-4bf7-b6ef-41616152538b service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:56.451596 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4023/8044] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:58.545128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1ef88-4a2a-4703-97c5-6f7d79e70e97 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:58.670300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f1ef88-4a2a-4703-97c5-6f7d79e70e97 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:58.675032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:58.675707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:58.676609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:58.676840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] PATH_INFO: `/v3/users/af52ad4b0eb34b54bb5e09721b5d13d8` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:58.678087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af52ad4b0eb34b54bb5e09721b5d13d8)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:58.680061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:58.741751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af52ad4b0eb34b54bb5e09721b5d13d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:58.756658 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:58.759553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af52ad4b0eb34b54bb5e09721b5d13d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:58.760657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af52ad4b0eb34b54bb5e09721b5d13d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:58.771008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af52ad4b0eb34b54bb5e09721b5d13d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:58.781360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af52ad4b0eb34b54bb5e09721b5d13d8'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:58.788823 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4022/8045] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:58 2022] DELETE /identity/v3/users/af52ad4b0eb34b54bb5e09721b5d13d8 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:58.793132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61b21a-4911-42d5-bc8c-e12b9e5e2d73 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:58.793578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61b21a-4911-42d5-bc8c-e12b9e5e2d73 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:58.793749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e61b21a-4911-42d5-bc8c-e12b9e5e2d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:58.815883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0e61b21a-4911-42d5-bc8c-e12b9e5e2d73 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:58.817117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0e61b21a-4911-42d5-bc8c-e12b9e5e2d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:58.898276 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4024/8046] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:29:58.905101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:58.906822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:58.968250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde96c6b-dcbd-45fd-892a-9496a2534306 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:58.972164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e75112-c84f-4288-89aa-c58c0a6c1c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:58.972853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75112-c84f-4288-89aa-c58c0a6c1c14 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:58.973141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75112-c84f-4288-89aa-c58c0a6c1c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:58.973453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e75112-c84f-4288-89aa-c58c0a6c1c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:58.983030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e75112-c84f-4288-89aa-c58c0a6c1c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:58.984478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e75112-c84f-4288-89aa-c58c0a6c1c14 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:58.994725 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4023/8047] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:29:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:29:59.170180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61b21a-4911-42d5-bc8c-e12b9e5e2d73 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:59.171601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0e61b21a-4911-42d5-bc8c-e12b9e5e2d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:59.185960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e61b21a-4911-42d5-bc8c-e12b9e5e2d73 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:59.190513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:59.191644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:59.192342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:59.192628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] PATH_INFO: `/v3/projects/8526e214132f4cc99b7dbadba031a7de` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:59.194862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8526e214132f4cc99b7dbadba031a7de)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:59.196827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:59.270624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8526e214132f4cc99b7dbadba031a7de', 'request_id': 'req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.278560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8526e214132f4cc99b7dbadba031a7de', 'request_id': 'req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.288003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8526e214132f4cc99b7dbadba031a7de', 'request_id': 'req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.303923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] The token cache is being invalidate because project 8526e214132f4cc99b7dbadba031a7de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:59.304344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.305133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.307977 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4025/8048] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:59 2022] DELETE /identity/v3/projects/8526e214132f4cc99b7dbadba031a7de => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:59.311851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e75112-c84f-4288-89aa-c58c0a6c1c14 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:59.323563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e75112-c84f-4288-89aa-c58c0a6c1c14 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:59.392679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:59.393512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:59.393868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:59.394210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] PATH_INFO: `/v3/users/f0a0cbbc1a8041b7a11741b47bfcee76` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:59.395409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0a0cbbc1a8041b7a11741b47bfcee76)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:59.397604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:59.445689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0a0cbbc1a8041b7a11741b47bfcee76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.457690 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0a0cbbc1a8041b7a11741b47bfcee76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.458922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0a0cbbc1a8041b7a11741b47bfcee76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.466170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0a0cbbc1a8041b7a11741b47bfcee76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.473776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0a0cbbc1a8041b7a11741b47bfcee76'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.476494 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:59.481135 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4024/8049] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:59 2022] DELETE /identity/v3/users/f0a0cbbc1a8041b7a11741b47bfcee76 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:59.681478 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:59.682953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:59.713577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45ce8c7-6a5f-48f1-989b-b1c37a8e0d10 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:59.785470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:59.786317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:59.787468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:59.788113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] PATH_INFO: `/v3/projects/91458014fdba4465adfcbb0ae9316a13` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:59.788995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91458014fdba4465adfcbb0ae9316a13)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:59.791091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:59.796266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:29:59.799088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:59.800637 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:29:59.817434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d94ba-58bd-4b27-8c92-288bcc1b8504 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:29:59.822737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:29:59.823439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:59.823972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:59.824315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] PATH_INFO: `/v3/users/b62fde68e8c747bfbea881c71421c5ae` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:59.825906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b62fde68e8c747bfbea881c71421c5ae)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:29:59.828329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:29:59.859088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91458014fdba4465adfcbb0ae9316a13', 'request_id': 'req-5febea67-171c-402c-8be5-a5df7bdce5a8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.867950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91458014fdba4465adfcbb0ae9316a13', 'request_id': 'req-5febea67-171c-402c-8be5-a5df7bdce5a8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.878802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91458014fdba4465adfcbb0ae9316a13', 'request_id': 'req-5febea67-171c-402c-8be5-a5df7bdce5a8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.884122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b62fde68e8c747bfbea881c71421c5ae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.892561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] The token cache is being invalidate because project 91458014fdba4465adfcbb0ae9316a13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:29:59.893054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.893698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5febea67-171c-402c-8be5-a5df7bdce5a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.895603 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4026/8050] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:29:59 2022] DELETE /identity/v3/projects/91458014fdba4465adfcbb0ae9316a13 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:29:59.899217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b62fde68e8c747bfbea881c71421c5ae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.900146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b62fde68e8c747bfbea881c71421c5ae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.900556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c023f-5a59-419f-be09-0b3871f231c7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:59.900841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c023f-5a59-419f-be09-0b3871f231c7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:59.901117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c023f-5a59-419f-be09-0b3871f231c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:59.910983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b62fde68e8c747bfbea881c71421c5ae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.920699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-dd74e038-cf03-44d7-a275-d0283b3b0d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b62fde68e8c747bfbea881c71421c5ae'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:29:59.926013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e60c023f-5a59-419f-be09-0b3871f231c7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:59.927824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e60c023f-5a59-419f-be09-0b3871f231c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:59.929319 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4025/8051] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:29:59 2022] DELETE /identity/v3/users/b62fde68e8c747bfbea881c71421c5ae => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:29:59.933111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47fe2-6155-4032-b948-816415a8d05f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:29:59.934245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47fe2-6155-4032-b948-816415a8d05f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:29:59.934947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b47fe2-6155-4032-b948-816415a8d05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:29:59.957057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f7b47fe2-6155-4032-b948-816415a8d05f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:29:59.958560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7b47fe2-6155-4032-b948-816415a8d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:29:59.994458 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4027/8052] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:30:00.002339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be01ecb-7631-41bd-831d-acee58a64810 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.003130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be01ecb-7631-41bd-831d-acee58a64810 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.003130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be01ecb-7631-41bd-831d-acee58a64810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.023260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9be01ecb-7631-41bd-831d-acee58a64810 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:00.024460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9be01ecb-7631-41bd-831d-acee58a64810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:00.025366 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4026/8053] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:29:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:00.034894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b47fe2-6155-4032-b948-816415a8d05f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.035669 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4028/8054] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:30:00.036348 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7b47fe2-6155-4032-b948-816415a8d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:00.038799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be01ecb-7631-41bd-831d-acee58a64810 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.048159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be01ecb-7631-41bd-831d-acee58a64810 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.053858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2779a-bcbe-4d40-9d38-e1e53f361624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.054466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2779a-bcbe-4d40-9d38-e1e53f361624 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.054741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2779a-bcbe-4d40-9d38-e1e53f361624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.055013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad2779a-bcbe-4d40-9d38-e1e53f361624 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.055665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2779a-bcbe-4d40-9d38-e1e53f361624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:30:00.055963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2779a-bcbe-4d40-9d38-e1e53f361624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.057581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad2779a-bcbe-4d40-9d38-e1e53f361624 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.070144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4029/8055] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:30:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:30:00.074349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2779a-bcbe-4d40-9d38-e1e53f361624 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.085954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad2779a-bcbe-4d40-9d38-e1e53f361624 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.091434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46810d-8342-491d-add9-32e30b5f24bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.092110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46810d-8342-491d-add9-32e30b5f24bd admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.092479 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46810d-8342-491d-add9-32e30b5f24bd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.092825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a46810d-8342-491d-add9-32e30b5f24bd admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.093555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46810d-8342-491d-add9-32e30b5f24bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.097541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a46810d-8342-491d-add9-32e30b5f24bd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.102662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b47fe2-6155-4032-b948-816415a8d05f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.106320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d94ae0-2a44-4818-aaa7-99c740b60948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.106932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d94ae0-2a44-4818-aaa7-99c740b60948 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.107213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d94ae0-2a44-4818-aaa7-99c740b60948 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.107489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d94ae0-2a44-4818-aaa7-99c740b60948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.118112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d94ae0-2a44-4818-aaa7-99c740b60948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.119990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d94ae0-2a44-4818-aaa7-99c740b60948 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.130190 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4027/8056] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:30:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:30:00.137083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4030/8057] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:30:00 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:30:00.139406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d94ae0-2a44-4818-aaa7-99c740b60948 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.151108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d94ae0-2a44-4818-aaa7-99c740b60948 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.164350 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:00.225523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc7bfd-53c6-4430-b9d2-49dc3adf1be7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.226169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc7bfd-53c6-4430-b9d2-49dc3adf1be7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.226469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc7bfd-53c6-4430-b9d2-49dc3adf1be7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.226725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc7bfd-53c6-4430-b9d2-49dc3adf1be7 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.227415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc7bfd-53c6-4430-b9d2-49dc3adf1be7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.229445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc7bfd-53c6-4430-b9d2-49dc3adf1be7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.252060 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4028/8058] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:30:00 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:30:00.256372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46810d-8342-491d-add9-32e30b5f24bd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.267504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a46810d-8342-491d-add9-32e30b5f24bd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.272590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13002269-3ded-47a9-90d8-70145914c837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.273201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002269-3ded-47a9-90d8-70145914c837 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.273513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002269-3ded-47a9-90d8-70145914c837 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.273788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13002269-3ded-47a9-90d8-70145914c837 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.274506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13002269-3ded-47a9-90d8-70145914c837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.276091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13002269-3ded-47a9-90d8-70145914c837 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.290934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4031/8059] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:30:00.292128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc7bfd-53c6-4430-b9d2-49dc3adf1be7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.302762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc7bfd-53c6-4430-b9d2-49dc3adf1be7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.308987 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453c3d4-6e4f-4e48-a298-2b469b30789d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.309995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453c3d4-6e4f-4e48-a298-2b469b30789d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.310608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453c3d4-6e4f-4e48-a298-2b469b30789d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.311096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453c3d4-6e4f-4e48-a298-2b469b30789d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.312126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453c3d4-6e4f-4e48-a298-2b469b30789d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.314205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453c3d4-6e4f-4e48-a298-2b469b30789d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.330939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13002269-3ded-47a9-90d8-70145914c837 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.337510 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4029/8060] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:30:00.338715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453c3d4-6e4f-4e48-a298-2b469b30789d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.341087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2453c3d4-6e4f-4e48-a298-2b469b30789d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:00.342443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13002269-3ded-47a9-90d8-70145914c837 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.354617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acd85cb-b93b-431e-be0d-abe198621f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.355295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd85cb-b93b-431e-be0d-abe198621f1b admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.355573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd85cb-b93b-431e-be0d-abe198621f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.355849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acd85cb-b93b-431e-be0d-abe198621f1b admin admin] PATH_INFO: `/v3/projects/84a7cefb7b06420c8c5a6f010e82dd98/users/672ba8d96a9149c9ababd9084e044165/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.367757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453c3d4-6e4f-4e48-a298-2b469b30789d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.372916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.373586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.373871 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.374147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] PATH_INFO: `/v3/projects/d4ea2b64dfd8408292fe8b8d44c39b59` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.375316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] RBAC: Authorizing `identity:delete_project(project_id=d4ea2b64dfd8408292fe8b8d44c39b59)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.377437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.391558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd85cb-b93b-431e-be0d-abe198621f1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=84a7cefb7b06420c8c5a6f010e82dd98, user_id=672ba8d96a9149c9ababd9084e044165, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.394749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acd85cb-b93b-431e-be0d-abe198621f1b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.429818 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4032/8061] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:30:00 2022] PUT /identity/v3/projects/84a7cefb7b06420c8c5a6f010e82dd98/users/672ba8d96a9149c9ababd9084e044165/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:00.435629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d4791-a1bf-4433-adcc-fbf154ddf31d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.436467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d4791-a1bf-4433-adcc-fbf154ddf31d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.436938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d4791-a1bf-4433-adcc-fbf154ddf31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.450961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'request_id': 'req-747f46bb-0546-46f9-b023-477506a30dce'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.464161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'request_id': 'req-747f46bb-0546-46f9-b023-477506a30dce'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.473594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd4ea2b64dfd8408292fe8b8d44c39b59', 'request_id': 'req-747f46bb-0546-46f9-b023-477506a30dce'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.482362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f44d4791-a1bf-4433-adcc-fbf154ddf31d None None] MFA Rules not processed for user `672ba8d96a9149c9ababd9084e044165`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:00.483586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f44d4791-a1bf-4433-adcc-fbf154ddf31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:00.488012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] The token cache is being invalidate because project d4ea2b64dfd8408292fe8b8d44c39b59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:30:00.488420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.489336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.492125 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4030/8062] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:30:00 2022] DELETE /identity/v3/projects/d4ea2b64dfd8408292fe8b8d44c39b59 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:00.493289 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:00.496817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.498934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:00.575570 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4033/8063] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:00.576517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d4791-a1bf-4433-adcc-fbf154ddf31d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.578065 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f44d4791-a1bf-4433-adcc-fbf154ddf31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:00.579965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747f46bb-0546-46f9-b023-477506a30dce admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.589055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.589957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.590340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.590708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] PATH_INFO: `/v3/users/4f96808120954544b427ca58eea40de5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.592090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f96808120954544b427ca58eea40de5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.594151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.596480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d4791-a1bf-4433-adcc-fbf154ddf31d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.602125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bde50-b06a-4fee-85c3-c3048847a8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.602909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bde50-b06a-4fee-85c3-c3048847a8a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.603194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bde50-b06a-4fee-85c3-c3048847a8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.603471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994bde50-b06a-4fee-85c3-c3048847a8a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.604926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bde50-b06a-4fee-85c3-c3048847a8a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.607473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994bde50-b06a-4fee-85c3-c3048847a8a0 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.623455 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:00.640666 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4034/8064] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:30:00 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:30:00.644888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bde50-b06a-4fee-85c3-c3048847a8a0 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.677546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f96808120954544b427ca58eea40de5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.706660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f96808120954544b427ca58eea40de5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.717923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f96808120954544b427ca58eea40de5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.735851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f96808120954544b427ca58eea40de5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.747298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f96808120954544b427ca58eea40de5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:00.762287 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4031/8065] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:30:00 2022] DELETE /identity/v3/users/4f96808120954544b427ca58eea40de5 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:00.790368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994bde50-b06a-4fee-85c3-c3048847a8a0 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.870424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5278ae-4a06-4668-8846-faad7619ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.871042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5278ae-4a06-4668-8846-faad7619ad4e admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.871325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5278ae-4a06-4668-8846-faad7619ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.871600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5278ae-4a06-4668-8846-faad7619ad4e admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.872241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5278ae-4a06-4668-8846-faad7619ad4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.874487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5278ae-4a06-4668-8846-faad7619ad4e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.921668 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4035/8066] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:30:00 2022] POST /identity/v3/users => generated 299 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:30:00.923054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.925334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:00.939841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97cb77f-89e3-46d0-92b0-352a12322014 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.944893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17816b8-2c96-48c0-99ee-88f44e45a6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.945811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17816b8-2c96-48c0-99ee-88f44e45a6be admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.945973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17816b8-2c96-48c0-99ee-88f44e45a6be admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:00.946331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17816b8-2c96-48c0-99ee-88f44e45a6be admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:00.947410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17816b8-2c96-48c0-99ee-88f44e45a6be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:00.949515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17816b8-2c96-48c0-99ee-88f44e45a6be admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:00.961742 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4032/8067] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:30:00.965906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5278ae-4a06-4668-8846-faad7619ad4e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:00.992229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5278ae-4a06-4668-8846-faad7619ad4e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:00.997245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acd6f4-a00d-4664-b4bc-5dbb0619aa66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:00.997941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acd6f4-a00d-4664-b4bc-5dbb0619aa66 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:00.998221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acd6f4-a00d-4664-b4bc-5dbb0619aa66 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.001274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8acd6f4-a00d-4664-b4bc-5dbb0619aa66 admin admin] PATH_INFO: `/v3/projects/6bf2026dc5b04af09517ec99372ba922/users/a32020c6c6eb4d28b0ed6f4d2733003a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.002428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17816b8-2c96-48c0-99ee-88f44e45a6be admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.004225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d17816b8-2c96-48c0-99ee-88f44e45a6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:01.020462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17816b8-2c96-48c0-99ee-88f44e45a6be admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.035779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acd6f4-a00d-4664-b4bc-5dbb0619aa66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf2026dc5b04af09517ec99372ba922, user_id=a32020c6c6eb4d28b0ed6f4d2733003a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.037324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.038986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.039540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.040081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8acd6f4-a00d-4664-b4bc-5dbb0619aa66 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.040441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] PATH_INFO: `/v3/projects/7c3aab62168a49b1a803137e7e404d53` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.044168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c3aab62168a49b1a803137e7e404d53)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.048771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.059091 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:01.068105 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4036/8068] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:30:00 2022] PUT /identity/v3/projects/6bf2026dc5b04af09517ec99372ba922/users/a32020c6c6eb4d28b0ed6f4d2733003a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:01.072749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acd6f4-a00d-4664-b4bc-5dbb0619aa66 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.152267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c3aab62168a49b1a803137e7e404d53', 'request_id': 'req-604b8721-5102-4608-8e29-a0d57c4d6cbb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:01.164926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c3aab62168a49b1a803137e7e404d53', 'request_id': 'req-604b8721-5102-4608-8e29-a0d57c4d6cbb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:01.175083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c3aab62168a49b1a803137e7e404d53', 'request_id': 'req-604b8721-5102-4608-8e29-a0d57c4d6cbb'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:01.176331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8acd6f4-a00d-4664-b4bc-5dbb0619aa66 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.213437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] The token cache is being invalidate because project 7c3aab62168a49b1a803137e7e404d53 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:30:01.213797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:01.215479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-604b8721-5102-4608-8e29-a0d57c4d6cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:01.219795 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4033/8069] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:30:01 2022] DELETE /identity/v3/projects/7c3aab62168a49b1a803137e7e404d53 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:01.225191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7d45-061d-4046-8166-aad535a70547 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.225779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7d45-061d-4046-8166-aad535a70547 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.226067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf7d45-061d-4046-8166-aad535a70547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.248767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-20bf7d45-061d-4046-8166-aad535a70547 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:01.250378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-20bf7d45-061d-4046-8166-aad535a70547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:01.267214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caebbe-b443-4c49-a649-3d500f594b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.267961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caebbe-b443-4c49-a649-3d500f594b9a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.268330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caebbe-b443-4c49-a649-3d500f594b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.268811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97caebbe-b443-4c49-a649-3d500f594b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.269475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caebbe-b443-4c49-a649-3d500f594b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.272005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97caebbe-b443-4c49-a649-3d500f594b9a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.308633 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4037/8070] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:30:01.314103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caebbe-b443-4c49-a649-3d500f594b9a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.316437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-97caebbe-b443-4c49-a649-3d500f594b9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:01.339776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97caebbe-b443-4c49-a649-3d500f594b9a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.344444 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4034/8071] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:30:01.344606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02d08ef-a4bb-4f43-8d79-568d9be127b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.345364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d08ef-a4bb-4f43-8d79-568d9be127b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.345656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d08ef-a4bb-4f43-8d79-568d9be127b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.345936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02d08ef-a4bb-4f43-8d79-568d9be127b9 admin admin] PATH_INFO: `/v3/projects/6bf2026dc5b04af09517ec99372ba922/users/a32020c6c6eb4d28b0ed6f4d2733003a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.347990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d08ef-a4bb-4f43-8d79-568d9be127b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bf2026dc5b04af09517ec99372ba922, user_id=a32020c6c6eb4d28b0ed6f4d2733003a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.351271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02d08ef-a4bb-4f43-8d79-568d9be127b9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.354608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02ed41-9ed0-4790-9fd9-9b51b1aaa0d7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.354901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02ed41-9ed0-4790-9fd9-9b51b1aaa0d7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.355186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02ed41-9ed0-4790-9fd9-9b51b1aaa0d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.367854 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4038/8072] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:30:01 2022] PUT /identity/v3/projects/6bf2026dc5b04af09517ec99372ba922/users/a32020c6c6eb4d28b0ed6f4d2733003a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:01.378671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313f65-e43c-4f63-bed9-b8cfa6820fed None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.379251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313f65-e43c-4f63-bed9-b8cfa6820fed None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.379601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c313f65-e43c-4f63-bed9-b8cfa6820fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.379996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3e02ed41-9ed0-4790-9fd9-9b51b1aaa0d7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:01.381554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3e02ed41-9ed0-4790-9fd9-9b51b1aaa0d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:01.386132 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:01.417034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8c313f65-e43c-4f63-bed9-b8cfa6820fed None None] MFA Rules not processed for user `a32020c6c6eb4d28b0ed6f4d2733003a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:01.418278 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c313f65-e43c-4f63-bed9-b8cfa6820fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:01.464558 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4035/8073] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:01.470493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02ed41-9ed0-4790-9fd9-9b51b1aaa0d7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.491633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02ed41-9ed0-4790-9fd9-9b51b1aaa0d7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.497922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30078056-94ab-44bc-a4dd-03b7456e1c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.498634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30078056-94ab-44bc-a4dd-03b7456e1c43 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.498992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30078056-94ab-44bc-a4dd-03b7456e1c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.499591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30078056-94ab-44bc-a4dd-03b7456e1c43 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.500678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30078056-94ab-44bc-a4dd-03b7456e1c43 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:30:01.501045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30078056-94ab-44bc-a4dd-03b7456e1c43 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.502837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30078056-94ab-44bc-a4dd-03b7456e1c43 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.520749 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4036/8074] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:30:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:30:01.521966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30078056-94ab-44bc-a4dd-03b7456e1c43 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.523809 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4039/8075] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:30:01.535042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313f65-e43c-4f63-bed9-b8cfa6820fed None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.536200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8c313f65-e43c-4f63-bed9-b8cfa6820fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:01.544209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30078056-94ab-44bc-a4dd-03b7456e1c43 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.551318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69784287-6790-481d-a72e-49e1b71cb014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.552855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69784287-6790-481d-a72e-49e1b71cb014 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.553232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69784287-6790-481d-a72e-49e1b71cb014 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.553628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69784287-6790-481d-a72e-49e1b71cb014 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.554636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69784287-6790-481d-a72e-49e1b71cb014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.556085 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:01.558089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69784287-6790-481d-a72e-49e1b71cb014 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.600866 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4037/8076] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:30:01 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:30:01.605017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69784287-6790-481d-a72e-49e1b71cb014 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.630094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c313f65-e43c-4f63-bed9-b8cfa6820fed None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.711790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69784287-6790-481d-a72e-49e1b71cb014 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.718017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b286-a9ca-4c2f-bcc6-52dfb6a396e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.718837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b286-a9ca-4c2f-bcc6-52dfb6a396e0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.719262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b286-a9ca-4c2f-bcc6-52dfb6a396e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.719694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a79b286-a9ca-4c2f-bcc6-52dfb6a396e0 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.720442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79b286-a9ca-4c2f-bcc6-52dfb6a396e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.722853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a79b286-a9ca-4c2f-bcc6-52dfb6a396e0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.734123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e351e-cfa0-4dba-9e6e-96974430aef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.735035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e351e-cfa0-4dba-9e6e-96974430aef1 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.736242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e351e-cfa0-4dba-9e6e-96974430aef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.737362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52e351e-cfa0-4dba-9e6e-96974430aef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.755300 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4038/8077] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:30:01 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:30:01.756427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b286-a9ca-4c2f-bcc6-52dfb6a396e0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.768354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a79b286-a9ca-4c2f-bcc6-52dfb6a396e0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.796845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57fddc-2a8a-4765-a5e7-950ed884de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.797640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57fddc-2a8a-4765-a5e7-950ed884de7c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.798097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57fddc-2a8a-4765-a5e7-950ed884de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.798381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb57fddc-2a8a-4765-a5e7-950ed884de7c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.799038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57fddc-2a8a-4765-a5e7-950ed884de7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.800666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb57fddc-2a8a-4765-a5e7-950ed884de7c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.826697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e351e-cfa0-4dba-9e6e-96974430aef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.828097 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4039/8078] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:30:01.828454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52e351e-cfa0-4dba-9e6e-96974430aef1 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.829499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57fddc-2a8a-4765-a5e7-950ed884de7c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.844360 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4040/8079] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:30:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:30:01.856614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb57fddc-2a8a-4765-a5e7-950ed884de7c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.862730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0486d0a5-6d00-4f5f-96df-c3dcb85b5590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.863478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486d0a5-6d00-4f5f-96df-c3dcb85b5590 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.863786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486d0a5-6d00-4f5f-96df-c3dcb85b5590 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.864027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0486d0a5-6d00-4f5f-96df-c3dcb85b5590 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.864753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486d0a5-6d00-4f5f-96df-c3dcb85b5590 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.866379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0486d0a5-6d00-4f5f-96df-c3dcb85b5590 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.891690 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4040/8080] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:30:01.892470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e351e-cfa0-4dba-9e6e-96974430aef1 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:01.905737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52e351e-cfa0-4dba-9e6e-96974430aef1 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:01.916876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbd756-0673-4736-b45c-cb11783617fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:01.918394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbd756-0673-4736-b45c-cb11783617fe admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.918680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbd756-0673-4736-b45c-cb11783617fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.918960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cbd756-0673-4736-b45c-cb11783617fe admin admin] PATH_INFO: `/v3/projects/3914ae4ecd694d7ead85824e88749b39/users/1731f53174b745b19f6b8529f8681311/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:01.938595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbd756-0673-4736-b45c-cb11783617fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=3914ae4ecd694d7ead85824e88749b39, user_id=1731f53174b745b19f6b8529f8681311, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:01.941531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cbd756-0673-4736-b45c-cb11783617fe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:01.969414 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4041/8081] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:30:01 2022] PUT /identity/v3/projects/3914ae4ecd694d7ead85824e88749b39/users/1731f53174b745b19f6b8529f8681311/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:01.975571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546d2d-2017-4d67-aa0e-34a33de535b4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:01.976098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546d2d-2017-4d67-aa0e-34a33de535b4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:01.976302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8546d2d-2017-4d67-aa0e-34a33de535b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:02.005968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e8546d2d-2017-4d67-aa0e-34a33de535b4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:02.007507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e8546d2d-2017-4d67-aa0e-34a33de535b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:02.061671 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:02.091160 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4041/8082] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:02.098313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbd756-0673-4736-b45c-cb11783617fe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:02.100906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-76cbd756-0673-4736-b45c-cb11783617fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:02.175974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cbd756-0673-4736-b45c-cb11783617fe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:02.181182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827ea7c-b6a7-4186-a60e-5f8bfdab5f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:02.181926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827ea7c-b6a7-4186-a60e-5f8bfdab5f29 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:02.182873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827ea7c-b6a7-4186-a60e-5f8bfdab5f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:02.183215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827ea7c-b6a7-4186-a60e-5f8bfdab5f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:02.193343 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827ea7c-b6a7-4186-a60e-5f8bfdab5f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:02.194879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c827ea7c-b6a7-4186-a60e-5f8bfdab5f29 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:02.199102 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:02.208867 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4042/8083] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:30:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:30:05.330075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8546d2d-2017-4d67-aa0e-34a33de535b4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:05.344667 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8546d2d-2017-4d67-aa0e-34a33de535b4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:05.351537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:05.352310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:05.352954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:05.353357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] PATH_INFO: `/v3/users/672ba8d96a9149c9ababd9084e044165` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:05.354642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] RBAC: Authorizing `identity:delete_user(user_id=672ba8d96a9149c9ababd9084e044165)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:05.357089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:05.436169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '672ba8d96a9149c9ababd9084e044165'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:05.466683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '672ba8d96a9149c9ababd9084e044165'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:05.469671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '672ba8d96a9149c9ababd9084e044165'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:05.493692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '672ba8d96a9149c9ababd9084e044165'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:05.503755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '672ba8d96a9149c9ababd9084e044165'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:05.512736 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4042/8084] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:30:05 2022] DELETE /identity/v3/users/672ba8d96a9149c9ababd9084e044165 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:05.516980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8f715-2ae0-44fe-a582-02bdd2d85c22 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:05.518124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8f715-2ae0-44fe-a582-02bdd2d85c22 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:05.518411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e8f715-2ae0-44fe-a582-02bdd2d85c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:05.560122 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d1e8f715-2ae0-44fe-a582-02bdd2d85c22 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:05.561677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1e8f715-2ae0-44fe-a582-02bdd2d85c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:05.718404 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4043/8085] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:05.723505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:05.725789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:05.858089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bef6bc-aa5c-4926-9499-aef2a5fff52c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:05.875931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172d795-bf38-4dbb-9a7a-2a846e70cd9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:05.877287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172d795-bf38-4dbb-9a7a-2a846e70cd9c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:05.877287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172d795-bf38-4dbb-9a7a-2a846e70cd9c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:05.879057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e172d795-bf38-4dbb-9a7a-2a846e70cd9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:05.900000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172d795-bf38-4dbb-9a7a-2a846e70cd9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:05.901521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e172d795-bf38-4dbb-9a7a-2a846e70cd9c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:05.933483 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4043/8086] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:30:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:30:06.576454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8f715-2ae0-44fe-a582-02bdd2d85c22 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:06.580737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1e8f715-2ae0-44fe-a582-02bdd2d85c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:06.605766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e8f715-2ae0-44fe-a582-02bdd2d85c22 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:06.627512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:06.628112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:06.628441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:06.628662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] PATH_INFO: `/v3/projects/84a7cefb7b06420c8c5a6f010e82dd98` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:06.638125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84a7cefb7b06420c8c5a6f010e82dd98)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:06.640015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:06.810366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84a7cefb7b06420c8c5a6f010e82dd98', 'request_id': 'req-31da00c6-d7f1-4311-b3c3-4a2433466a18'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:06.841273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84a7cefb7b06420c8c5a6f010e82dd98', 'request_id': 'req-31da00c6-d7f1-4311-b3c3-4a2433466a18'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:06.860334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84a7cefb7b06420c8c5a6f010e82dd98', 'request_id': 'req-31da00c6-d7f1-4311-b3c3-4a2433466a18'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:06.894279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] The token cache is being invalidate because project 84a7cefb7b06420c8c5a6f010e82dd98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:30:06.894752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:06.897709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:06.902411 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4044/8087] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:30:06 2022] DELETE /identity/v3/projects/84a7cefb7b06420c8c5a6f010e82dd98 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:06.907023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172d795-bf38-4dbb-9a7a-2a846e70cd9c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:06.928600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e172d795-bf38-4dbb-9a7a-2a846e70cd9c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:07.030224 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:07.043022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:07.044158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:07.045531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:07.045983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] PATH_INFO: `/v3/users/a32020c6c6eb4d28b0ed6f4d2733003a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:07.047745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a32020c6c6eb4d28b0ed6f4d2733003a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:07.051282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:07.139686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a32020c6c6eb4d28b0ed6f4d2733003a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.172734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a32020c6c6eb4d28b0ed6f4d2733003a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.173519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a32020c6c6eb4d28b0ed6f4d2733003a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.192152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a32020c6c6eb4d28b0ed6f4d2733003a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.212927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-f1d7d2f8-2efc-4bcf-baf4-976f218b1ea7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a32020c6c6eb4d28b0ed6f4d2733003a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.230431 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4044/8088] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:30:06 2022] DELETE /identity/v3/users/a32020c6c6eb4d28b0ed6f4d2733003a => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:07.624425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:07.626299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:07.656737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31da00c6-d7f1-4311-b3c3-4a2433466a18 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:07.776107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:07.777349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:07.777761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:07.778184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] PATH_INFO: `/v3/projects/6bf2026dc5b04af09517ec99372ba922` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:07.779779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bf2026dc5b04af09517ec99372ba922)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:07.783365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:07.837903 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:07.877134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bf2026dc5b04af09517ec99372ba922', 'request_id': 'req-a270dc14-7463-43f8-8cf5-a7b30428e667'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.887019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bf2026dc5b04af09517ec99372ba922', 'request_id': 'req-a270dc14-7463-43f8-8cf5-a7b30428e667'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.911601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bf2026dc5b04af09517ec99372ba922', 'request_id': 'req-a270dc14-7463-43f8-8cf5-a7b30428e667'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.931987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] The token cache is being invalidate because project 6bf2026dc5b04af09517ec99372ba922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:30:07.932360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.933704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a270dc14-7463-43f8-8cf5-a7b30428e667 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:07.936232 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4045/8089] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:30:07 2022] DELETE /identity/v3/projects/6bf2026dc5b04af09517ec99372ba922 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:07.941125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3325cc1-a4d4-4d67-85ef-56fdcec3ffac None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:07.942083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3325cc1-a4d4-4d67-85ef-56fdcec3ffac None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:07.944384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3325cc1-a4d4-4d67-85ef-56fdcec3ffac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:07.965190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d3325cc1-a4d4-4d67-85ef-56fdcec3ffac None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:07.966914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d3325cc1-a4d4-4d67-85ef-56fdcec3ffac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:08.114372 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4045/8090] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:08.118271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879f2b3-feed-4936-b7f6-387ebe413779 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:08.118565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879f2b3-feed-4936-b7f6-387ebe413779 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:08.118849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0879f2b3-feed-4936-b7f6-387ebe413779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:08.163455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0879f2b3-feed-4936-b7f6-387ebe413779 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:08.171219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0879f2b3-feed-4936-b7f6-387ebe413779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:08.197453 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4046/8091] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:08.199649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3325cc1-a4d4-4d67-85ef-56fdcec3ffac None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:08.220026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3325cc1-a4d4-4d67-85ef-56fdcec3ffac None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:08.230602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845d11-78d7-42ec-b1d7-2a6973766b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:08.231232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845d11-78d7-42ec-b1d7-2a6973766b57 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:08.231514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845d11-78d7-42ec-b1d7-2a6973766b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:08.231784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b845d11-78d7-42ec-b1d7-2a6973766b57 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:08.232431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845d11-78d7-42ec-b1d7-2a6973766b57 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:30:08.232738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845d11-78d7-42ec-b1d7-2a6973766b57 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:08.234363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b845d11-78d7-42ec-b1d7-2a6973766b57 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:08.269971 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4046/8092] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:30:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:30:08.274883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879f2b3-feed-4936-b7f6-387ebe413779 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:08.290134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0879f2b3-feed-4936-b7f6-387ebe413779 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:08.303793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dfd75-f3f4-4ded-93a5-61857364a23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:08.304813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dfd75-f3f4-4ded-93a5-61857364a23d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:08.305080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dfd75-f3f4-4ded-93a5-61857364a23d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:08.305387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7dfd75-f3f4-4ded-93a5-61857364a23d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:08.306029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dfd75-f3f4-4ded-93a5-61857364a23d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:08.307980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7dfd75-f3f4-4ded-93a5-61857364a23d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:08.371045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4047/8093] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:30:08 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:30:08.372630 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845d11-78d7-42ec-b1d7-2a6973766b57 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:08.385623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b845d11-78d7-42ec-b1d7-2a6973766b57 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:08.511582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea9352-7547-4f9b-84e2-ebce3c399a94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:08.513341 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9352-7547-4f9b-84e2-ebce3c399a94 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:08.513842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9352-7547-4f9b-84e2-ebce3c399a94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:08.514881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea9352-7547-4f9b-84e2-ebce3c399a94 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:08.515966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea9352-7547-4f9b-84e2-ebce3c399a94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:08.519143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ea9352-7547-4f9b-84e2-ebce3c399a94 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:08.538397 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:08.563002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dfd75-f3f4-4ded-93a5-61857364a23d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:08.565714 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4047/8094] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:30:08 2022] POST /identity/v3/users => generated 297 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:30:08.580798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7dfd75-f3f4-4ded-93a5-61857364a23d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:08.587841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016adfc-fc7c-43be-9002-c15dab67896b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:08.588461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016adfc-fc7c-43be-9002-c15dab67896b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:08.588795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016adfc-fc7c-43be-9002-c15dab67896b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:08.589070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0016adfc-fc7c-43be-9002-c15dab67896b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:08.589746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016adfc-fc7c-43be-9002-c15dab67896b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:08.591645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0016adfc-fc7c-43be-9002-c15dab67896b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:08.613083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4048/8095] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:30:08.616811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea9352-7547-4f9b-84e2-ebce3c399a94 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:08.638768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea9352-7547-4f9b-84e2-ebce3c399a94 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:08.646202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a7c8ee-7415-4958-a962-e4525dc1855d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:08.646845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7c8ee-7415-4958-a962-e4525dc1855d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:08.647117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7c8ee-7415-4958-a962-e4525dc1855d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:08.647444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7c8ee-7415-4958-a962-e4525dc1855d admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:08.648095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7c8ee-7415-4958-a962-e4525dc1855d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:08.649885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a7c8ee-7415-4958-a962-e4525dc1855d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:08.668765 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4048/8096] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:30:08.670021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016adfc-fc7c-43be-9002-c15dab67896b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:08.694809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0016adfc-fc7c-43be-9002-c15dab67896b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:08.705330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661cc80-2435-4ac4-a9f9-cfc1e905359d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:08.706019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661cc80-2435-4ac4-a9f9-cfc1e905359d admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:08.706301 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661cc80-2435-4ac4-a9f9-cfc1e905359d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:08.706575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661cc80-2435-4ac4-a9f9-cfc1e905359d admin admin] PATH_INFO: `/v3/projects/77a50ad144f14bca978378cf6e12f047/users/5fae832c989d454fa15172bae58ab6f2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:08.736378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661cc80-2435-4ac4-a9f9-cfc1e905359d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77a50ad144f14bca978378cf6e12f047, user_id=5fae832c989d454fa15172bae58ab6f2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:08.740768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7661cc80-2435-4ac4-a9f9-cfc1e905359d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:08.768474 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4049/8097] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:30:08 2022] PUT /identity/v3/projects/77a50ad144f14bca978378cf6e12f047/users/5fae832c989d454fa15172bae58ab6f2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:08.783781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a5d86-9423-4e94-867b-3594f3fc4c6f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:08.784217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a5d86-9423-4e94-867b-3594f3fc4c6f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:08.784503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45a5d86-9423-4e94-867b-3594f3fc4c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:08.931824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e45a5d86-9423-4e94-867b-3594f3fc4c6f None None] MFA Rules not processed for user `5fae832c989d454fa15172bae58ab6f2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:08.933347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e45a5d86-9423-4e94-867b-3594f3fc4c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:09.064603 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4049/8098] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:09.076773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661cc80-2435-4ac4-a9f9-cfc1e905359d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:09.079275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7661cc80-2435-4ac4-a9f9-cfc1e905359d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:09.236697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661cc80-2435-4ac4-a9f9-cfc1e905359d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:09.246073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206d980-8a37-42d5-a102-daf74d37ea4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:09.248986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206d980-8a37-42d5-a102-daf74d37ea4e service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:09.249555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206d980-8a37-42d5-a102-daf74d37ea4e service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:09.250077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a206d980-8a37-42d5-a102-daf74d37ea4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:09.278669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206d980-8a37-42d5-a102-daf74d37ea4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:09.280189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a206d980-8a37-42d5-a102-daf74d37ea4e service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:09.302736 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4050/8099] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:30:09 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:30:09.533713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d3bf-431e-4f07-8027-17bf690c8615 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:09.533997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d3bf-431e-4f07-8027-17bf690c8615 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:09.534283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994d3bf-431e-4f07-8027-17bf690c8615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:09.606078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c994d3bf-431e-4f07-8027-17bf690c8615 None None] MFA Rules not processed for user `1731f53174b745b19f6b8529f8681311`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:09.607284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c994d3bf-431e-4f07-8027-17bf690c8615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:09.729209 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4050/8100] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:09.734440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206d980-8a37-42d5-a102-daf74d37ea4e service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:09.736248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a206d980-8a37-42d5-a102-daf74d37ea4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:09.862165 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:09.885796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a206d980-8a37-42d5-a102-daf74d37ea4e service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:09.892406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101d7df-70ec-43db-994d-a3e61fb65eaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:09.894077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101d7df-70ec-43db-994d-a3e61fb65eaa admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:09.894603 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101d7df-70ec-43db-994d-a3e61fb65eaa admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:09.895146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d101d7df-70ec-43db-994d-a3e61fb65eaa admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:09.896832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101d7df-70ec-43db-994d-a3e61fb65eaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:09.898978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d101d7df-70ec-43db-994d-a3e61fb65eaa admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:09.961502 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4051/8101] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:30:09 2022] POST /identity/v3/projects => generated 383 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:30:09.961986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994d3bf-431e-4f07-8027-17bf690c8615 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:09.983665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994d3bf-431e-4f07-8027-17bf690c8615 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:10.064954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84360f-1adc-4a4e-86a0-0db0a35bf1f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:10.069612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84360f-1adc-4a4e-86a0-0db0a35bf1f4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:10.069934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84360f-1adc-4a4e-86a0-0db0a35bf1f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:10.070218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f84360f-1adc-4a4e-86a0-0db0a35bf1f4 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:10.070894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84360f-1adc-4a4e-86a0-0db0a35bf1f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:10.072962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f84360f-1adc-4a4e-86a0-0db0a35bf1f4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:10.083480 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:10.100873 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4051/8102] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:30:09 2022] POST /identity/v3/users => generated 298 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:30:10.102101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101d7df-70ec-43db-994d-a3e61fb65eaa admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:10.112976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d101d7df-70ec-43db-994d-a3e61fb65eaa admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:10.123056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305905-daf6-4294-820e-47d1863e2c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:10.124362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305905-daf6-4294-820e-47d1863e2c90 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:10.127769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305905-daf6-4294-820e-47d1863e2c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:10.128390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305905-daf6-4294-820e-47d1863e2c90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:10.129332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305905-daf6-4294-820e-47d1863e2c90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:10.132149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305905-daf6-4294-820e-47d1863e2c90 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:10.149816 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4052/8103] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:30:10.155003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84360f-1adc-4a4e-86a0-0db0a35bf1f4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:10.170218 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f84360f-1adc-4a4e-86a0-0db0a35bf1f4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:10.179467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196aa21-7702-492f-ade6-88e229a545f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:10.180143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196aa21-7702-492f-ade6-88e229a545f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:10.180421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196aa21-7702-492f-ade6-88e229a545f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:10.180694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196aa21-7702-492f-ade6-88e229a545f3 admin admin] PATH_INFO: `/v3/projects/e37ea7e9b8fe4fcf843d8f2c0645db0b/users/9606a3fba4e04f30a37fbb060888d20e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:10.206202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196aa21-7702-492f-ade6-88e229a545f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37ea7e9b8fe4fcf843d8f2c0645db0b, user_id=9606a3fba4e04f30a37fbb060888d20e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:10.211521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196aa21-7702-492f-ade6-88e229a545f3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:10.235184 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4052/8104] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:30:10 2022] PUT /identity/v3/projects/e37ea7e9b8fe4fcf843d8f2c0645db0b/users/9606a3fba4e04f30a37fbb060888d20e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:10.244628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305905-daf6-4294-820e-47d1863e2c90 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:10.260440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305905-daf6-4294-820e-47d1863e2c90 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:10.357622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f27153-ba37-4b8d-9653-ed375dac3c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:10.358794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f27153-ba37-4b8d-9653-ed375dac3c05 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:10.359501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f27153-ba37-4b8d-9653-ed375dac3c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:10.359949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f27153-ba37-4b8d-9653-ed375dac3c05 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:10.361018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f27153-ba37-4b8d-9653-ed375dac3c05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:10.365564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f27153-ba37-4b8d-9653-ed375dac3c05 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:10.383519 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4053/8105] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:30:10.388279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196aa21-7702-492f-ade6-88e229a545f3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:10.408649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196aa21-7702-492f-ade6-88e229a545f3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:10.417358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b731-d353-4d44-85fe-7c51b6c96eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:10.418056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b731-d353-4d44-85fe-7c51b6c96eb5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:10.418440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b731-d353-4d44-85fe-7c51b6c96eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:10.418602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2301b731-d353-4d44-85fe-7c51b6c96eb5 admin admin] PATH_INFO: `/v3/projects/e37ea7e9b8fe4fcf843d8f2c0645db0b/users/9606a3fba4e04f30a37fbb060888d20e/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:10.422576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301b731-d353-4d44-85fe-7c51b6c96eb5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37ea7e9b8fe4fcf843d8f2c0645db0b, user_id=9606a3fba4e04f30a37fbb060888d20e, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:10.425267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2301b731-d353-4d44-85fe-7c51b6c96eb5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:10.468059 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4053/8106] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:30:10 2022] PUT /identity/v3/projects/e37ea7e9b8fe4fcf843d8f2c0645db0b/users/9606a3fba4e04f30a37fbb060888d20e/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:30:19.572141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d347d4-871f-44d1-a280-1b057ac42094 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:19.572751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d347d4-871f-44d1-a280-1b057ac42094 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:19.572751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d347d4-871f-44d1-a280-1b057ac42094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:19.621332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-27d347d4-871f-44d1-a280-1b057ac42094 None None] MFA Rules not processed for user `9606a3fba4e04f30a37fbb060888d20e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:19.622850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-27d347d4-871f-44d1-a280-1b057ac42094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:19.746944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b731-d353-4d44-85fe-7c51b6c96eb5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:19.781623 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4054/8107] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:19 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:19.795782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d347d4-871f-44d1-a280-1b057ac42094 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:19.797925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-27d347d4-871f-44d1-a280-1b057ac42094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:19.866324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2301b731-d353-4d44-85fe-7c51b6c96eb5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:19.874018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:19.875044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:19.875994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:19.875994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] PATH_INFO: `/v3/users/5fae832c989d454fa15172bae58ab6f2` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:19.878098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5fae832c989d454fa15172bae58ab6f2)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:19.881410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:19.900735 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:19.922216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d347d4-871f-44d1-a280-1b057ac42094 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:19.927655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b58df7-1f48-4a1c-b4a4-2746ff53221e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:19.929461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b58df7-1f48-4a1c-b4a4-2746ff53221e service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:19.930363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b58df7-1f48-4a1c-b4a4-2746ff53221e service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:19.930722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b58df7-1f48-4a1c-b4a4-2746ff53221e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:19.990024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5fae832c989d454fa15172bae58ab6f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:20.020815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5fae832c989d454fa15172bae58ab6f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:20.022460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5fae832c989d454fa15172bae58ab6f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:20.022687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b58df7-1f48-4a1c-b4a4-2746ff53221e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:20.024241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b58df7-1f48-4a1c-b4a4-2746ff53221e service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:20.039569 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4055/8108] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:30:19 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:30:20.053226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5fae832c989d454fa15172bae58ab6f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:20.081445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5fae832c989d454fa15172bae58ab6f2'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:20.101827 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4054/8109] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:30:19 2022] DELETE /identity/v3/users/5fae832c989d454fa15172bae58ab6f2 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:30:20.106589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a29566-7b77-4b6b-aabb-9aa6d761f6df None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:20.106875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a29566-7b77-4b6b-aabb-9aa6d761f6df None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:20.107150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a29566-7b77-4b6b-aabb-9aa6d761f6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:20.136405 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-35a29566-7b77-4b6b-aabb-9aa6d761f6df None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:20.137793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-35a29566-7b77-4b6b-aabb-9aa6d761f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:20.307103 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4056/8110] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:20.318870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:20.320312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:20.416178 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:INSERT=5,keystone:SELECT=85,keystone:DELETE=10 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:20.479691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46275b34-3886-470b-a159-3c318c87eb51 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:20.487808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75333b1d-89be-4b3d-a662-c6bbefc8f26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:20.488442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75333b1d-89be-4b3d-a662-c6bbefc8f26b service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:20.488731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75333b1d-89be-4b3d-a662-c6bbefc8f26b service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:20.489627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75333b1d-89be-4b3d-a662-c6bbefc8f26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:20.518514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75333b1d-89be-4b3d-a662-c6bbefc8f26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:20.520001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75333b1d-89be-4b3d-a662-c6bbefc8f26b service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:20.540782 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4055/8111] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:30:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:30:20.936986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a29566-7b77-4b6b-aabb-9aa6d761f6df None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:20.943990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-35a29566-7b77-4b6b-aabb-9aa6d761f6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:20.970529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a29566-7b77-4b6b-aabb-9aa6d761f6df None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:20.993029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:20.994758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:20.994955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:20.995435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] PATH_INFO: `/v3/projects/77a50ad144f14bca978378cf6e12f047` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:20.997936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=77a50ad144f14bca978378cf6e12f047)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:20.999879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:21.072883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77a50ad144f14bca978378cf6e12f047', 'request_id': 'req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:21.081812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77a50ad144f14bca978378cf6e12f047', 'request_id': 'req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:21.093558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77a50ad144f14bca978378cf6e12f047', 'request_id': 'req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:21.112743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] The token cache is being invalidate because project 77a50ad144f14bca978378cf6e12f047 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:30:21.113583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:21.115160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-353d2fd1-affd-4d6f-aca9-1f1ee3fbcb1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:30:21.117410 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4057/8112] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:30:20 2022] DELETE /identity/v3/projects/77a50ad144f14bca978378cf6e12f047 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:30:21.122176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029000d3-1f45-442b-85c8-f89f6c55fe0a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:21.122709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029000d3-1f45-442b-85c8-f89f6c55fe0a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:21.122709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029000d3-1f45-442b-85c8-f89f6c55fe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:21.156704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-029000d3-1f45-442b-85c8-f89f6c55fe0a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:21.158267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-029000d3-1f45-442b-85c8-f89f6c55fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:21.304117 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4056/8113] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:21.305648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80b48e-e57d-401e-aabd-1e3ba2ccf45d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:21.306130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80b48e-e57d-401e-aabd-1e3ba2ccf45d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:21.306256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80b48e-e57d-401e-aabd-1e3ba2ccf45d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:21.341556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8f80b48e-e57d-401e-aabd-1e3ba2ccf45d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:21.343252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8f80b48e-e57d-401e-aabd-1e3ba2ccf45d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:21.376838 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4058/8114] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:21.381553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029000d3-1f45-442b-85c8-f89f6c55fe0a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:21.408618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029000d3-1f45-442b-85c8-f89f6c55fe0a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:21.415282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c537a54-bea4-45da-8365-adfdffa966cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:21.416181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c537a54-bea4-45da-8365-adfdffa966cb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:21.416642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c537a54-bea4-45da-8365-adfdffa966cb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:21.417098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c537a54-bea4-45da-8365-adfdffa966cb admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:21.417858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c537a54-bea4-45da-8365-adfdffa966cb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:30:21.418168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c537a54-bea4-45da-8365-adfdffa966cb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:21.420074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c537a54-bea4-45da-8365-adfdffa966cb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:21.437531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80b48e-e57d-401e-aabd-1e3ba2ccf45d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:21.443823 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4057/8115] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:30:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:30:21.448292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80b48e-e57d-401e-aabd-1e3ba2ccf45d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:21.458589 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95559c4-5bea-4e64-b1e9-d34f3597acd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:21.459213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95559c4-5bea-4e64-b1e9-d34f3597acd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:21.459489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95559c4-5bea-4e64-b1e9-d34f3597acd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:21.459761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95559c4-5bea-4e64-b1e9-d34f3597acd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:21.460426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95559c4-5bea-4e64-b1e9-d34f3597acd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:21.462464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95559c4-5bea-4e64-b1e9-d34f3597acd4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:21.485678 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:21.517601 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4059/8116] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:30:21 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:30:21.519389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c537a54-bea4-45da-8365-adfdffa966cb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:21.531265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c537a54-bea4-45da-8365-adfdffa966cb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:21.659320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f716dc2-3b8f-4db7-ab36-be6ebb2438f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:21.660413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f716dc2-3b8f-4db7-ab36-be6ebb2438f2 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:21.661472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f716dc2-3b8f-4db7-ab36-be6ebb2438f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:21.662035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f716dc2-3b8f-4db7-ab36-be6ebb2438f2 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:21.662888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f716dc2-3b8f-4db7-ab36-be6ebb2438f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:21.665488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f716dc2-3b8f-4db7-ab36-be6ebb2438f2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:21.695103 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4058/8117] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:30:21 2022] POST /identity/v3/users => generated 287 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:30:21.695881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95559c4-5bea-4e64-b1e9-d34f3597acd4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:21.712552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95559c4-5bea-4e64-b1e9-d34f3597acd4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:21.735130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0544-ad6d-42d4-8a72-90268f922f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:21.736328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0544-ad6d-42d4-8a72-90268f922f1d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:21.736840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0544-ad6d-42d4-8a72-90268f922f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:21.737407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34dd0544-ad6d-42d4-8a72-90268f922f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:21.745871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd0544-ad6d-42d4-8a72-90268f922f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:21.754074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34dd0544-ad6d-42d4-8a72-90268f922f1d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:21.774919 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4060/8118] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:30:21.779596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f716dc2-3b8f-4db7-ab36-be6ebb2438f2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:21.796490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f716dc2-3b8f-4db7-ab36-be6ebb2438f2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:21.801436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba8a92-8f16-4a24-8475-f8d35e55bbc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:21.802057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba8a92-8f16-4a24-8475-f8d35e55bbc7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:21.802342 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba8a92-8f16-4a24-8475-f8d35e55bbc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:21.802614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba8a92-8f16-4a24-8475-f8d35e55bbc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:21.803266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba8a92-8f16-4a24-8475-f8d35e55bbc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:21.805451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fba8a92-8f16-4a24-8475-f8d35e55bbc7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:21.822643 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4059/8119] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:30:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:30:21.824106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0544-ad6d-42d4-8a72-90268f922f1d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:21.839155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34dd0544-ad6d-42d4-8a72-90268f922f1d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:21.853533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadeb2e-20a5-4e9e-84e7-9f33c0fc780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:21.855497 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadeb2e-20a5-4e9e-84e7-9f33c0fc780a admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:21.857219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadeb2e-20a5-4e9e-84e7-9f33c0fc780a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:21.858445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadeb2e-20a5-4e9e-84e7-9f33c0fc780a admin admin] PATH_INFO: `/v3/projects/35a1a13699b64297b3dec9dd9e979472/users/87cf1b1b4404460ea0196e7572afaee3/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:21.892681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadeb2e-20a5-4e9e-84e7-9f33c0fc780a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35a1a13699b64297b3dec9dd9e979472, user_id=87cf1b1b4404460ea0196e7572afaee3, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:21.899750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadeb2e-20a5-4e9e-84e7-9f33c0fc780a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:21.931693 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4061/8120] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:30:21 2022] PUT /identity/v3/projects/35a1a13699b64297b3dec9dd9e979472/users/87cf1b1b4404460ea0196e7572afaee3/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:30:21.942616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcefd14-1abb-42aa-8c25-8bad9f76e2b2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:21.942909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcefd14-1abb-42aa-8c25-8bad9f76e2b2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:21.943187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcefd14-1abb-42aa-8c25-8bad9f76e2b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:22.011481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-bdcefd14-1abb-42aa-8c25-8bad9f76e2b2 None None] MFA Rules not processed for user `87cf1b1b4404460ea0196e7572afaee3`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:22.016217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bdcefd14-1abb-42aa-8c25-8bad9f76e2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:22.100644 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:22.154710 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4060/8121] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:22.170956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadeb2e-20a5-4e9e-84e7-9f33c0fc780a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:22.173457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8eadeb2e-20a5-4e9e-84e7-9f33c0fc780a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:22.277620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadeb2e-20a5-4e9e-84e7-9f33c0fc780a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:22.281515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de703-0e7d-4444-b779-3f0757e06c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:22.282138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de703-0e7d-4444-b779-3f0757e06c5d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:22.282416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de703-0e7d-4444-b779-3f0757e06c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:22.282692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152de703-0e7d-4444-b779-3f0757e06c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:22.294448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de703-0e7d-4444-b779-3f0757e06c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:22.298192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152de703-0e7d-4444-b779-3f0757e06c5d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:22.312717 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4062/8122] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:30:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:30:32.151666 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=13 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:32.305330 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:30:42.859075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793397-6280-4cf7-8465-441bdf500daf None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:42.859498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793397-6280-4cf7-8465-441bdf500daf None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:42.859595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16793397-6280-4cf7-8465-441bdf500daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:42.882514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-16793397-6280-4cf7-8465-441bdf500daf None None] MFA Rules not processed for user `e2fc124049504d579f6513b5cac00bdf`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:30:42.884061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-16793397-6280-4cf7-8465-441bdf500daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:42.985404 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4061/8123] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:30:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:30:52.198795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de703-0e7d-4444-b779-3f0757e06c5d service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:30:52.200294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-152de703-0e7d-4444-b779-3f0757e06c5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:52.291720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152de703-0e7d-4444-b779-3f0757e06c5d service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:30:52.302068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02bfd3-07df-4ad3-a02e-f4b1fc02a086 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:30:52.303306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02bfd3-07df-4ad3-a02e-f4b1fc02a086 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:30:52.303306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02bfd3-07df-4ad3-a02e-f4b1fc02a086 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:30:52.303503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea02bfd3-07df-4ad3-a02e-f4b1fc02a086 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:30:52.305761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ea02bfd3-07df-4ad3-a02e-f4b1fc02a086 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:30:52.397433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02bfd3-07df-4ad3-a02e-f4b1fc02a086 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:30:52.399246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea02bfd3-07df-4ad3-a02e-f4b1fc02a086 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:30:52.410599 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4063/8124] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:30:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 669 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:30:52.977584 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=29 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:02.405224 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=58 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:08.693204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16793397-6280-4cf7-8465-441bdf500daf None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:08.695057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-16793397-6280-4cf7-8465-441bdf500daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:08.849833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16793397-6280-4cf7-8465-441bdf500daf None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:08.857071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7497919-f3b2-44ea-9c59-e718892445ac service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:08.858100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7497919-f3b2-44ea-9c59-e718892445ac service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:08.858617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7497919-f3b2-44ea-9c59-e718892445ac service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:08.859059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7497919-f3b2-44ea-9c59-e718892445ac service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:08.861091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7497919-f3b2-44ea-9c59-e718892445ac service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:08.893857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7497919-f3b2-44ea-9c59-e718892445ac service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:08.901400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7497919-f3b2-44ea-9c59-e718892445ac service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:08.932814 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4062/8125] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:31:14.935256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02bfd3-07df-4ad3-a02e-f4b1fc02a086 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:14.955797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea02bfd3-07df-4ad3-a02e-f4b1fc02a086 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:14.972952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db61389-ca46-4140-995c-88c4bad47d09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:14.973821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61389-ca46-4140-995c-88c4bad47d09 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:14.974492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61389-ca46-4140-995c-88c4bad47d09 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:14.974978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db61389-ca46-4140-995c-88c4bad47d09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:14.979637 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8db61389-ca46-4140-995c-88c4bad47d09 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:15.008629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db61389-ca46-4140-995c-88c4bad47d09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:15.010359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db61389-ca46-4140-995c-88c4bad47d09 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:15.043871 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4064/8126] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:31:15.063091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7497919-f3b2-44ea-9c59-e718892445ac service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:15.167303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7497919-f3b2-44ea-9c59-e718892445ac service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:15.174460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:15.176166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:15.176456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:15.187101 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] PATH_INFO: `/v3/users/87cf1b1b4404460ea0196e7572afaee3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:15.188679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87cf1b1b4404460ea0196e7572afaee3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:15.190707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:15.250941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87cf1b1b4404460ea0196e7572afaee3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.264768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87cf1b1b4404460ea0196e7572afaee3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.265592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87cf1b1b4404460ea0196e7572afaee3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.277139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87cf1b1b4404460ea0196e7572afaee3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.287441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87cf1b1b4404460ea0196e7572afaee3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.294927 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4063/8127] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:31:15 2022] DELETE /identity/v3/users/87cf1b1b4404460ea0196e7572afaee3 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:31:15.299814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716d699-a486-4379-8e79-ae0fcbd6b11a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:15.300365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716d699-a486-4379-8e79-ae0fcbd6b11a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:15.300829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1716d699-a486-4379-8e79-ae0fcbd6b11a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:15.326842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1716d699-a486-4379-8e79-ae0fcbd6b11a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:15.328599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1716d699-a486-4379-8e79-ae0fcbd6b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:15.419313 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4065/8128] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:15.429556 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:15.431185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:15.453254 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:15.542952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c135d88-84ae-4416-861f-cf1251f37c41 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:15.546887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f13bdc2-0158-46a6-aa68-d0e29d55792c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:15.547442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13bdc2-0158-46a6-aa68-d0e29d55792c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:15.547726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13bdc2-0158-46a6-aa68-d0e29d55792c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:15.548056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13bdc2-0158-46a6-aa68-d0e29d55792c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:15.559130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13bdc2-0158-46a6-aa68-d0e29d55792c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:15.561266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f13bdc2-0158-46a6-aa68-d0e29d55792c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:15.586932 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4064/8129] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:31:15.799305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716d699-a486-4379-8e79-ae0fcbd6b11a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:15.800946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1716d699-a486-4379-8e79-ae0fcbd6b11a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:15.828252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1716d699-a486-4379-8e79-ae0fcbd6b11a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:15.849677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:15.850508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:15.850974 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:15.851421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] PATH_INFO: `/v3/projects/35a1a13699b64297b3dec9dd9e979472` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:15.852737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35a1a13699b64297b3dec9dd9e979472)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:15.854872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:15.916060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35a1a13699b64297b3dec9dd9e979472', 'request_id': 'req-be7e8ead-cd7c-496a-9c7c-47cb08eec669'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.924587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35a1a13699b64297b3dec9dd9e979472', 'request_id': 'req-be7e8ead-cd7c-496a-9c7c-47cb08eec669'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.939351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35a1a13699b64297b3dec9dd9e979472', 'request_id': 'req-be7e8ead-cd7c-496a-9c7c-47cb08eec669'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.954953 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] The token cache is being invalidate because project 35a1a13699b64297b3dec9dd9e979472 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:31:15.955545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.957408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be7e8ead-cd7c-496a-9c7c-47cb08eec669 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:15.959928 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4066/8130] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:31:15 2022] DELETE /identity/v3/projects/35a1a13699b64297b3dec9dd9e979472 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:31:15.965184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f36f6-4039-4180-8e35-703a2949ceb8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:15.965832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f36f6-4039-4180-8e35-703a2949ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:15.967460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31f36f6-4039-4180-8e35-703a2949ceb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:15.998714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c31f36f6-4039-4180-8e35-703a2949ceb8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:16.000025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c31f36f6-4039-4180-8e35-703a2949ceb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:16.145355 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4065/8131] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:16.152996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5ca35-cdaa-498d-a276-a6dab2102f38 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:16.153361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5ca35-cdaa-498d-a276-a6dab2102f38 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:16.153642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b5ca35-cdaa-498d-a276-a6dab2102f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:16.175352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-59b5ca35-cdaa-498d-a276-a6dab2102f38 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:16.176483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-59b5ca35-cdaa-498d-a276-a6dab2102f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:16.191202 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4067/8132] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:16.196273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f36f6-4039-4180-8e35-703a2949ceb8 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:16.222578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31f36f6-4039-4180-8e35-703a2949ceb8 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:16.230015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155da3cb-b83b-4e33-ba93-a864a0fa4036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:16.230708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155da3cb-b83b-4e33-ba93-a864a0fa4036 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:16.231164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155da3cb-b83b-4e33-ba93-a864a0fa4036 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:16.231476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155da3cb-b83b-4e33-ba93-a864a0fa4036 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:16.233128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155da3cb-b83b-4e33-ba93-a864a0fa4036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:31:16.234361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155da3cb-b83b-4e33-ba93-a864a0fa4036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:16.236298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155da3cb-b83b-4e33-ba93-a864a0fa4036 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:16.250681 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4066/8133] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:31:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:31:16.255975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5ca35-cdaa-498d-a276-a6dab2102f38 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:16.265383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b5ca35-cdaa-498d-a276-a6dab2102f38 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:16.270221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e943ee-5131-4c0c-aa08-d033a44c8a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:16.270879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e943ee-5131-4c0c-aa08-d033a44c8a57 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:16.271371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e943ee-5131-4c0c-aa08-d033a44c8a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:16.271738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e943ee-5131-4c0c-aa08-d033a44c8a57 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:16.272440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e943ee-5131-4c0c-aa08-d033a44c8a57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:16.274435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e943ee-5131-4c0c-aa08-d033a44c8a57 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:16.314116 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4068/8134] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:31:16 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:31:16.315864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155da3cb-b83b-4e33-ba93-a864a0fa4036 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:16.328953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155da3cb-b83b-4e33-ba93-a864a0fa4036 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:16.427405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d33d4-6ca6-4879-ad15-c26942472c7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:16.428192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d33d4-6ca6-4879-ad15-c26942472c7f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:16.428479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d33d4-6ca6-4879-ad15-c26942472c7f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:16.429192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302d33d4-6ca6-4879-ad15-c26942472c7f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:16.429825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d33d4-6ca6-4879-ad15-c26942472c7f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:16.432232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302d33d4-6ca6-4879-ad15-c26942472c7f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:16.475701 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4067/8135] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:31:16 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:31:16.480484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e943ee-5131-4c0c-aa08-d033a44c8a57 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:16.497858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e943ee-5131-4c0c-aa08-d033a44c8a57 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:16.504132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45847fe-9143-435e-9eaa-fa2abe3516eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:16.504937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45847fe-9143-435e-9eaa-fa2abe3516eb admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:16.505702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45847fe-9143-435e-9eaa-fa2abe3516eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:16.506216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45847fe-9143-435e-9eaa-fa2abe3516eb admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:16.507213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45847fe-9143-435e-9eaa-fa2abe3516eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:16.509335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45847fe-9143-435e-9eaa-fa2abe3516eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:16.527179 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4069/8136] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:31:16.531333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d33d4-6ca6-4879-ad15-c26942472c7f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:16.544528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302d33d4-6ca6-4879-ad15-c26942472c7f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:16.550334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc51196a-187d-4103-ac4f-6d77bedb9f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:16.550944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51196a-187d-4103-ac4f-6d77bedb9f36 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:16.551606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51196a-187d-4103-ac4f-6d77bedb9f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:16.551606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc51196a-187d-4103-ac4f-6d77bedb9f36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:16.552160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51196a-187d-4103-ac4f-6d77bedb9f36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:16.554054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc51196a-187d-4103-ac4f-6d77bedb9f36 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:16.574048 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4068/8137] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:31:16 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:31:16.589250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45847fe-9143-435e-9eaa-fa2abe3516eb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:16.600155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45847fe-9143-435e-9eaa-fa2abe3516eb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:16.606012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bd544-8a1c-41aa-9171-5df9bf0e3985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:16.606938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bd544-8a1c-41aa-9171-5df9bf0e3985 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:16.607317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bd544-8a1c-41aa-9171-5df9bf0e3985 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:16.607820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2bd544-8a1c-41aa-9171-5df9bf0e3985 admin admin] PATH_INFO: `/v3/projects/9667caedcce14d63bcff94847dc5f131/users/dbbfbac08637460588de7e775662386c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:16.626836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bd544-8a1c-41aa-9171-5df9bf0e3985 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9667caedcce14d63bcff94847dc5f131, user_id=dbbfbac08637460588de7e775662386c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:16.630472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2bd544-8a1c-41aa-9171-5df9bf0e3985 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:16.649934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4070/8138] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:31:16 2022] PUT /identity/v3/projects/9667caedcce14d63bcff94847dc5f131/users/dbbfbac08637460588de7e775662386c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:31:16.661680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413fc21-26d0-454b-9021-29e56ff2ff83 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:16.662266 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413fc21-26d0-454b-9021-29e56ff2ff83 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:16.662641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413fc21-26d0-454b-9021-29e56ff2ff83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:16.691896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8413fc21-26d0-454b-9021-29e56ff2ff83 None None] MFA Rules not processed for user `dbbfbac08637460588de7e775662386c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:16.693192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8413fc21-26d0-454b-9021-29e56ff2ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:16.698526 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:16.776471 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4069/8139] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:16 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:16.783077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bd544-8a1c-41aa-9171-5df9bf0e3985 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:16.785803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2a2bd544-8a1c-41aa-9171-5df9bf0e3985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:16.797728 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:16.899705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2bd544-8a1c-41aa-9171-5df9bf0e3985 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:16.903655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799fd2a-96d0-4b66-af82-e3f7f580a867 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:16.904258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799fd2a-96d0-4b66-af82-e3f7f580a867 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:16.904534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799fd2a-96d0-4b66-af82-e3f7f580a867 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:16.904809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e799fd2a-96d0-4b66-af82-e3f7f580a867 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:16.914723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799fd2a-96d0-4b66-af82-e3f7f580a867 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:16.917781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e799fd2a-96d0-4b66-af82-e3f7f580a867 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:16.932813 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4071/8140] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:31:22.443302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413fc21-26d0-454b-9021-29e56ff2ff83 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:22.444746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8413fc21-26d0-454b-9021-29e56ff2ff83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:22.645873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8413fc21-26d0-454b-9021-29e56ff2ff83 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:22.660442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb269-9d06-419d-acf4-be0d404bbb4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:22.661088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb269-9d06-419d-acf4-be0d404bbb4c service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:22.661393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb269-9d06-419d-acf4-be0d404bbb4c service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:22.661674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7afb269-9d06-419d-acf4-be0d404bbb4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:22.663573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c7afb269-9d06-419d-acf4-be0d404bbb4c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:22.897887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb269-9d06-419d-acf4-be0d404bbb4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:22.899359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7afb269-9d06-419d-acf4-be0d404bbb4c service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:22.929910 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4070/8141] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:31:26.928077 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=23 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:32.733824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799fd2a-96d0-4b66-af82-e3f7f580a867 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:32.735307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e799fd2a-96d0-4b66-af82-e3f7f580a867 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:32.756786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e799fd2a-96d0-4b66-af82-e3f7f580a867 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:32.769215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7f0076-d328-4705-86dc-f6041a7809f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:32.769888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0076-d328-4705-86dc-f6041a7809f0 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:32.770173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0076-d328-4705-86dc-f6041a7809f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:32.770451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7f0076-d328-4705-86dc-f6041a7809f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:32.780833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-de7f0076-d328-4705-86dc-f6041a7809f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:32.821865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0076-d328-4705-86dc-f6041a7809f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:32.826269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7f0076-d328-4705-86dc-f6041a7809f0 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:32.861151 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4072/8142] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:31:32.911973 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:36.196548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb269-9d06-419d-acf4-be0d404bbb4c service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:36.269721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7afb269-9d06-419d-acf4-be0d404bbb4c service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:36.275469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:36.276217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:36.276783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:36.277158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] PATH_INFO: `/v3/users/dbbfbac08637460588de7e775662386c` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:36.278489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbbfbac08637460588de7e775662386c)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:36.280919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:36.343388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbbfbac08637460588de7e775662386c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:36.359020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbbfbac08637460588de7e775662386c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:36.359935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbbfbac08637460588de7e775662386c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:36.378406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbbfbac08637460588de7e775662386c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:36.390867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbbfbac08637460588de7e775662386c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:36.415265 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4071/8143] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:31:36 2022] DELETE /identity/v3/users/dbbfbac08637460588de7e775662386c => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:31:36.421473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10592ff8-c7d1-403c-90b5-b5e946cf6979 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:36.422392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10592ff8-c7d1-403c-90b5-b5e946cf6979 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:36.422867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10592ff8-c7d1-403c-90b5-b5e946cf6979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:36.454299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-10592ff8-c7d1-403c-90b5-b5e946cf6979 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:36.456772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-10592ff8-c7d1-403c-90b5-b5e946cf6979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:36.582164 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4073/8144] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:36.597327 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:36.597643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:36.745128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007ad088-1f88-404e-bf95-0eaff24f3410 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:36.764763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650c0f5a-b8b7-4578-a513-d1d0577c4092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:36.771730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0f5a-b8b7-4578-a513-d1d0577c4092 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:36.771730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0f5a-b8b7-4578-a513-d1d0577c4092 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:36.771730 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650c0f5a-b8b7-4578-a513-d1d0577c4092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:36.794566 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c0f5a-b8b7-4578-a513-d1d0577c4092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:36.796227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650c0f5a-b8b7-4578-a513-d1d0577c4092 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:36.825907 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4072/8145] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:31:37.022254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10592ff8-c7d1-403c-90b5-b5e946cf6979 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:37.024120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-10592ff8-c7d1-403c-90b5-b5e946cf6979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:37.042605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10592ff8-c7d1-403c-90b5-b5e946cf6979 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:37.049569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:37.052935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.053522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.054267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] PATH_INFO: `/v3/projects/9667caedcce14d63bcff94847dc5f131` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.055754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9667caedcce14d63bcff94847dc5f131)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:37.059463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:37.114524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9667caedcce14d63bcff94847dc5f131', 'request_id': 'req-89fa2745-323b-488d-b26d-fc456e706a79'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:37.121064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9667caedcce14d63bcff94847dc5f131', 'request_id': 'req-89fa2745-323b-488d-b26d-fc456e706a79'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:37.129453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9667caedcce14d63bcff94847dc5f131', 'request_id': 'req-89fa2745-323b-488d-b26d-fc456e706a79'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:37.147509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] The token cache is being invalidate because project 9667caedcce14d63bcff94847dc5f131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:31:37.147874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:37.148598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-89fa2745-323b-488d-b26d-fc456e706a79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:37.150355 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4074/8146] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:31:37 2022] DELETE /identity/v3/projects/9667caedcce14d63bcff94847dc5f131 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:31:37.155273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740bd95-1005-4ac8-b6ab-521e657479db None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.155642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740bd95-1005-4ac8-b6ab-521e657479db None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.156015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9740bd95-1005-4ac8-b6ab-521e657479db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.183139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9740bd95-1005-4ac8-b6ab-521e657479db None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:37.184363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9740bd95-1005-4ac8-b6ab-521e657479db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:37.209748 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:37.258660 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4073/8147] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:31:37.266483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c6799-5723-4e6e-9aae-7409de5d909a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.266777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c6799-5723-4e6e-9aae-7409de5d909a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.267057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8c6799-5723-4e6e-9aae-7409de5d909a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.289420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-ba8c6799-5723-4e6e-9aae-7409de5d909a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:37.290616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ba8c6799-5723-4e6e-9aae-7409de5d909a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:37.301888 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4075/8148] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:37.303449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740bd95-1005-4ac8-b6ab-521e657479db None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:37.316561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9740bd95-1005-4ac8-b6ab-521e657479db None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:37.322662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347e43b-9d0d-459c-8f5f-28ba28d38e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:37.323359 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347e43b-9d0d-459c-8f5f-28ba28d38e40 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.323714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347e43b-9d0d-459c-8f5f-28ba28d38e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.324063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0347e43b-9d0d-459c-8f5f-28ba28d38e40 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.324905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347e43b-9d0d-459c-8f5f-28ba28d38e40 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:31:37.325284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347e43b-9d0d-459c-8f5f-28ba28d38e40 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:37.327196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0347e43b-9d0d-459c-8f5f-28ba28d38e40 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:37.343859 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4074/8149] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:31:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:31:37.345063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c6799-5723-4e6e-9aae-7409de5d909a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:37.355985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8c6799-5723-4e6e-9aae-7409de5d909a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:37.361252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517b366-ac40-4551-9a0e-d4a16d09e949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:37.362493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517b366-ac40-4551-9a0e-d4a16d09e949 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.362848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517b366-ac40-4551-9a0e-d4a16d09e949 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.363198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d517b366-ac40-4551-9a0e-d4a16d09e949 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.363911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517b366-ac40-4551-9a0e-d4a16d09e949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:37.366172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d517b366-ac40-4551-9a0e-d4a16d09e949 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:37.406992 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4076/8150] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:31:37 2022] POST /identity/v3/projects => generated 361 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:31:37.412156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347e43b-9d0d-459c-8f5f-28ba28d38e40 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:37.424842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0347e43b-9d0d-459c-8f5f-28ba28d38e40 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:37.501417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679d743-72db-4968-977a-76044d61134b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:37.502841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679d743-72db-4968-977a-76044d61134b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.503200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679d743-72db-4968-977a-76044d61134b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.503666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679d743-72db-4968-977a-76044d61134b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.504388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679d743-72db-4968-977a-76044d61134b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:37.506700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679d743-72db-4968-977a-76044d61134b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:37.538862 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4075/8151] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:31:37 2022] POST /identity/v3/users => generated 281 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:31:37.540088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517b366-ac40-4551-9a0e-d4a16d09e949 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:37.552086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d517b366-ac40-4551-9a0e-d4a16d09e949 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:37.556856 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268963ca-91e9-4469-a832-d6aab25aee7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:37.557614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268963ca-91e9-4469-a832-d6aab25aee7b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.557909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268963ca-91e9-4469-a832-d6aab25aee7b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.558185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268963ca-91e9-4469-a832-d6aab25aee7b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.558827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268963ca-91e9-4469-a832-d6aab25aee7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:37.560429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268963ca-91e9-4469-a832-d6aab25aee7b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:37.576237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679d743-72db-4968-977a-76044d61134b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:37.576652 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4077/8152] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:31:37.587625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679d743-72db-4968-977a-76044d61134b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:37.592436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94f7a0d-70fd-45a3-ae5f-4d976c6ad774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:37.593043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7a0d-70fd-45a3-ae5f-4d976c6ad774 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.593363 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7a0d-70fd-45a3-ae5f-4d976c6ad774 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.593646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94f7a0d-70fd-45a3-ae5f-4d976c6ad774 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.594307 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f7a0d-70fd-45a3-ae5f-4d976c6ad774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:37.595947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94f7a0d-70fd-45a3-ae5f-4d976c6ad774 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:37.608335 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4076/8153] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:31:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:31:37.613027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268963ca-91e9-4469-a832-d6aab25aee7b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:37.628973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268963ca-91e9-4469-a832-d6aab25aee7b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:37.635388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5df45-0893-4a68-94cd-7dec07e3c14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:37.636072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5df45-0893-4a68-94cd-7dec07e3c14f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.636358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5df45-0893-4a68-94cd-7dec07e3c14f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.636638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5df45-0893-4a68-94cd-7dec07e3c14f admin admin] PATH_INFO: `/v3/projects/4fd52ccbb5eb485bb0f3945df901e582/users/9daebdeda63b43149fd0fa94c3a187e4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.654399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5df45-0893-4a68-94cd-7dec07e3c14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fd52ccbb5eb485bb0f3945df901e582, user_id=9daebdeda63b43149fd0fa94c3a187e4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:37.657548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5df45-0893-4a68-94cd-7dec07e3c14f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:37.667008 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:37.673893 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4078/8154] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:31:37 2022] PUT /identity/v3/projects/4fd52ccbb5eb485bb0f3945df901e582/users/9daebdeda63b43149fd0fa94c3a187e4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:31:37.686713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da54a8-3c64-4601-8276-48b75986c52b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.687014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da54a8-3c64-4601-8276-48b75986c52b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.690104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da54a8-3c64-4601-8276-48b75986c52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.725043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a7da54a8-3c64-4601-8276-48b75986c52b None None] MFA Rules not processed for user `9daebdeda63b43149fd0fa94c3a187e4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:37.726610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a7da54a8-3c64-4601-8276-48b75986c52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:37.798294 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4077/8155] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:31:37.809275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5df45-0893-4a68-94cd-7dec07e3c14f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:37.811091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fea5df45-0893-4a68-94cd-7dec07e3c14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:37.894924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5df45-0893-4a68-94cd-7dec07e3c14f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:37.901393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e819492-5e98-4f59-a498-fe3b8c5be8dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:37.902082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819492-5e98-4f59-a498-fe3b8c5be8dd service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:37.902438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819492-5e98-4f59-a498-fe3b8c5be8dd service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:37.902785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e819492-5e98-4f59-a498-fe3b8c5be8dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:37.914804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e819492-5e98-4f59-a498-fe3b8c5be8dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:37.916409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e819492-5e98-4f59-a498-fe3b8c5be8dd service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:37.928296 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4079/8156] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:31:47.795061 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:47.926976 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=27 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:48.437392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da54a8-3c64-4601-8276-48b75986c52b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:48.614590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da54a8-3c64-4601-8276-48b75986c52b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:48.623398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:48.624074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:48.624434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:48.624754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] PATH_INFO: `/v3/users/9daebdeda63b43149fd0fa94c3a187e4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:48.625923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9daebdeda63b43149fd0fa94c3a187e4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:48.628389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:48.713104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9daebdeda63b43149fd0fa94c3a187e4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:48.733878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9daebdeda63b43149fd0fa94c3a187e4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:48.734960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9daebdeda63b43149fd0fa94c3a187e4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:48.745795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9daebdeda63b43149fd0fa94c3a187e4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:48.758077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9daebdeda63b43149fd0fa94c3a187e4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:48.766554 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4078/8157] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:31:48 2022] DELETE /identity/v3/users/9daebdeda63b43149fd0fa94c3a187e4 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:31:48.781987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eb688-2d17-4ee9-8b21-7dae3bd48c97 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:48.782355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eb688-2d17-4ee9-8b21-7dae3bd48c97 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:48.782703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3eb688-2d17-4ee9-8b21-7dae3bd48c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:48.819277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1f3eb688-2d17-4ee9-8b21-7dae3bd48c97 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:48.824186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f3eb688-2d17-4ee9-8b21-7dae3bd48c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:48.981649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4080/8158] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:48.986820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:48.988433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:49.124285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126f1647-af15-45a3-ba08-69a9c17e7e40 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:49.127974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea13a13-7807-4387-95f9-cfb8bb2222c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:49.128720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea13a13-7807-4387-95f9-cfb8bb2222c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:49.128995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea13a13-7807-4387-95f9-cfb8bb2222c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:49.129274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea13a13-7807-4387-95f9-cfb8bb2222c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:49.139670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea13a13-7807-4387-95f9-cfb8bb2222c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:49.141197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea13a13-7807-4387-95f9-cfb8bb2222c4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:49.168990 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4079/8159] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:31:49.395354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3eb688-2d17-4ee9-8b21-7dae3bd48c97 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:49.397166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f3eb688-2d17-4ee9-8b21-7dae3bd48c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:49.433326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3eb688-2d17-4ee9-8b21-7dae3bd48c97 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:49.451735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:49.452388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:49.452667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:49.452940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] PATH_INFO: `/v3/projects/4fd52ccbb5eb485bb0f3945df901e582` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:49.454097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fd52ccbb5eb485bb0f3945df901e582)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:49.456061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:49.518566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fd52ccbb5eb485bb0f3945df901e582', 'request_id': 'req-9b83e302-16f0-4cf7-af5d-f876774101af'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:49.526608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fd52ccbb5eb485bb0f3945df901e582', 'request_id': 'req-9b83e302-16f0-4cf7-af5d-f876774101af'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:49.536950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fd52ccbb5eb485bb0f3945df901e582', 'request_id': 'req-9b83e302-16f0-4cf7-af5d-f876774101af'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:49.554993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] The token cache is being invalidate because project 4fd52ccbb5eb485bb0f3945df901e582 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:31:49.555293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:49.556030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9b83e302-16f0-4cf7-af5d-f876774101af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:31:49.565449 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4081/8160] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:31:49 2022] DELETE /identity/v3/projects/4fd52ccbb5eb485bb0f3945df901e582 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:31:49.565800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428f3dd-0d00-4071-9ac2-a0cabdcc2986 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:49.565800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428f3dd-0d00-4071-9ac2-a0cabdcc2986 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:49.565800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9428f3dd-0d00-4071-9ac2-a0cabdcc2986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:49.629417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9428f3dd-0d00-4071-9ac2-a0cabdcc2986 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:49.629417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9428f3dd-0d00-4071-9ac2-a0cabdcc2986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:49.662800 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:49.745905 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4080/8161] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:49.754105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb4ff-f234-4a75-aa25-039f4ab6f701 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:49.754105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb4ff-f234-4a75-aa25-039f4ab6f701 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:49.754930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6bb4ff-f234-4a75-aa25-039f4ab6f701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:49.782064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-be6bb4ff-f234-4a75-aa25-039f4ab6f701 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:49.783882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-be6bb4ff-f234-4a75-aa25-039f4ab6f701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:49.804922 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4082/8162] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:49.806023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428f3dd-0d00-4071-9ac2-a0cabdcc2986 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:49.823817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9428f3dd-0d00-4071-9ac2-a0cabdcc2986 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:49.836902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e9bfd-1e36-4e4e-8597-306cc5b1eeba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:49.837662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e9bfd-1e36-4e4e-8597-306cc5b1eeba admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:49.837946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e9bfd-1e36-4e4e-8597-306cc5b1eeba admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:49.838331 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3e9bfd-1e36-4e4e-8597-306cc5b1eeba admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:49.853360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e9bfd-1e36-4e4e-8597-306cc5b1eeba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:31:49.854217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e9bfd-1e36-4e4e-8597-306cc5b1eeba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:49.855966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3e9bfd-1e36-4e4e-8597-306cc5b1eeba admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:49.875542 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4081/8163] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:31:49.880947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bb4ff-f234-4a75-aa25-039f4ab6f701 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:49.895440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be6bb4ff-f234-4a75-aa25-039f4ab6f701 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:49.911183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55a551-217b-4333-96b3-9669c173c15d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:49.911816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55a551-217b-4333-96b3-9669c173c15d admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:49.912095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55a551-217b-4333-96b3-9669c173c15d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:49.912368 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff55a551-217b-4333-96b3-9669c173c15d admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:49.913010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55a551-217b-4333-96b3-9669c173c15d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:49.914994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff55a551-217b-4333-96b3-9669c173c15d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:49.966562 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4083/8164] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:31:49 2022] POST /identity/v3/projects => generated 355 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:31:49.970604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e9bfd-1e36-4e4e-8597-306cc5b1eeba admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:49.982356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3e9bfd-1e36-4e4e-8597-306cc5b1eeba admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:50.071503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec01760-e9dd-40fd-aeb4-f63ab16a8ddb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:50.072158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec01760-e9dd-40fd-aeb4-f63ab16a8ddb admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:50.072545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec01760-e9dd-40fd-aeb4-f63ab16a8ddb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:50.072889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec01760-e9dd-40fd-aeb4-f63ab16a8ddb admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:50.073636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec01760-e9dd-40fd-aeb4-f63ab16a8ddb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:50.075712 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec01760-e9dd-40fd-aeb4-f63ab16a8ddb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:50.108942 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4082/8165] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:31:49 2022] POST /identity/v3/users => generated 278 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:31:50.110215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55a551-217b-4333-96b3-9669c173c15d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:50.122282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff55a551-217b-4333-96b3-9669c173c15d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:50.132237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ba7ef-109d-471b-831f-e8ed143f82bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:50.132855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ba7ef-109d-471b-831f-e8ed143f82bc admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:50.133132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ba7ef-109d-471b-831f-e8ed143f82bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:50.133507 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ba7ef-109d-471b-831f-e8ed143f82bc admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:50.134062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ba7ef-109d-471b-831f-e8ed143f82bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:50.135787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ba7ef-109d-471b-831f-e8ed143f82bc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:50.158563 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4084/8166] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:31:50.159542 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec01760-e9dd-40fd-aeb4-f63ab16a8ddb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:50.180390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec01760-e9dd-40fd-aeb4-f63ab16a8ddb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:50.185910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ce20ae-8344-4beb-9c07-961fbdb49472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:50.186849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce20ae-8344-4beb-9c07-961fbdb49472 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:50.186849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce20ae-8344-4beb-9c07-961fbdb49472 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:50.187977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ce20ae-8344-4beb-9c07-961fbdb49472 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:50.187977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce20ae-8344-4beb-9c07-961fbdb49472 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:50.189817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ce20ae-8344-4beb-9c07-961fbdb49472 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:50.214875 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4083/8167] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:31:50.221329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ba7ef-109d-471b-831f-e8ed143f82bc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:50.258896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ba7ef-109d-471b-831f-e8ed143f82bc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:50.267124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd693c59-efb0-4883-a371-cd2835295c6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:50.270200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd693c59-efb0-4883-a371-cd2835295c6f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:50.270614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd693c59-efb0-4883-a371-cd2835295c6f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:50.273616 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd693c59-efb0-4883-a371-cd2835295c6f admin admin] PATH_INFO: `/v3/projects/6d029b9319174022a71e6f85951d16bd/users/61c033b6d26c4a9db7b4b934a6bde903/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:50.300827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd693c59-efb0-4883-a371-cd2835295c6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d029b9319174022a71e6f85951d16bd, user_id=61c033b6d26c4a9db7b4b934a6bde903, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:50.303832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd693c59-efb0-4883-a371-cd2835295c6f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:50.343147 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4085/8168] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:31:50 2022] PUT /identity/v3/projects/6d029b9319174022a71e6f85951d16bd/users/61c033b6d26c4a9db7b4b934a6bde903/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:31:50.355594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3ee6-c5b4-43af-b67c-feee0807cfdc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:50.355881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3ee6-c5b4-43af-b67c-feee0807cfdc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:50.356161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5c3ee6-c5b4-43af-b67c-feee0807cfdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:50.406434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5c5c3ee6-c5b4-43af-b67c-feee0807cfdc None None] MFA Rules not processed for user `61c033b6d26c4a9db7b4b934a6bde903`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:31:50.411374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5c5c3ee6-c5b4-43af-b67c-feee0807cfdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:50.521479 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4084/8169] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:31:50 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:31:50.533938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd693c59-efb0-4883-a371-cd2835295c6f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:31:50.535963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fd693c59-efb0-4883-a371-cd2835295c6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:31:50.562345 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:31:50.621647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd693c59-efb0-4883-a371-cd2835295c6f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:31:50.625756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3069c6d5-bd5b-43b1-88cc-80f61064502c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:31:50.626492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069c6d5-bd5b-43b1-88cc-80f61064502c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:31:50.627410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069c6d5-bd5b-43b1-88cc-80f61064502c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:31:50.627798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3069c6d5-bd5b-43b1-88cc-80f61064502c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:31:50.640677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069c6d5-bd5b-43b1-88cc-80f61064502c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:31:50.642588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3069c6d5-bd5b-43b1-88cc-80f61064502c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:31:50.670960 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4086/8170] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:31:50 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:32:00.518291 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:00.609231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3ee6-c5b4-43af-b67c-feee0807cfdc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:00.653861 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=17 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:00.701523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5c3ee6-c5b4-43af-b67c-feee0807cfdc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:00.707344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:00.707998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:00.708313 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:00.708595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] PATH_INFO: `/v3/users/61c033b6d26c4a9db7b4b934a6bde903` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:00.709833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c033b6d26c4a9db7b4b934a6bde903)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:00.711794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:00.789393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c033b6d26c4a9db7b4b934a6bde903'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:00.803071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c033b6d26c4a9db7b4b934a6bde903'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:00.804006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c033b6d26c4a9db7b4b934a6bde903'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:00.813062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c033b6d26c4a9db7b4b934a6bde903'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:00.823294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c033b6d26c4a9db7b4b934a6bde903'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:00.830439 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4085/8171] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:32:00 2022] DELETE /identity/v3/users/61c033b6d26c4a9db7b4b934a6bde903 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:00.836378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78465859-c395-44db-a52e-c06d188f6357 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:00.836878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78465859-c395-44db-a52e-c06d188f6357 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:00.837195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78465859-c395-44db-a52e-c06d188f6357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:00.869660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-78465859-c395-44db-a52e-c06d188f6357 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:00.870865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-78465859-c395-44db-a52e-c06d188f6357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:00.941019 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4087/8172] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:00.954111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:00.956204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:01.071511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89b308-ce5a-429f-941d-bef688fefdc0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:01.075692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca44ff1-b26e-4542-a863-68455ed05ee4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:01.076436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca44ff1-b26e-4542-a863-68455ed05ee4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:01.077090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca44ff1-b26e-4542-a863-68455ed05ee4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:01.077642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca44ff1-b26e-4542-a863-68455ed05ee4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:01.090924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca44ff1-b26e-4542-a863-68455ed05ee4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:01.093257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca44ff1-b26e-4542-a863-68455ed05ee4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:01.125919 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4086/8173] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:01.356456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78465859-c395-44db-a52e-c06d188f6357 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:01.358985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-78465859-c395-44db-a52e-c06d188f6357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:01.401565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78465859-c395-44db-a52e-c06d188f6357 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:01.408457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:01.409282 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:01.410158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:01.410608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] PATH_INFO: `/v3/projects/6d029b9319174022a71e6f85951d16bd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:01.412059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d029b9319174022a71e6f85951d16bd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:01.415074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:01.487303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d029b9319174022a71e6f85951d16bd', 'request_id': 'req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:01.496643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d029b9319174022a71e6f85951d16bd', 'request_id': 'req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:01.508917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d029b9319174022a71e6f85951d16bd', 'request_id': 'req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:01.523004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] The token cache is being invalidate because project 6d029b9319174022a71e6f85951d16bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:32:01.523654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:01.524677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3557bbdc-ba03-4b5f-ba5e-1c8f67f60e7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:01.526518 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4088/8174] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:32:01 2022] DELETE /identity/v3/projects/6d029b9319174022a71e6f85951d16bd => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:01.532158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef42cf-4c49-4a70-8d29-e82962c7e688 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:01.534318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef42cf-4c49-4a70-8d29-e82962c7e688 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:01.534658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef42cf-4c49-4a70-8d29-e82962c7e688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:01.559704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-32ef42cf-4c49-4a70-8d29-e82962c7e688 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:01.561175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-32ef42cf-4c49-4a70-8d29-e82962c7e688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:01.585182 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:01.655468 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4087/8175] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:01.665820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b14cd9-1c0d-4ad9-b6c4-3e34c68f4aa3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:01.666393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b14cd9-1c0d-4ad9-b6c4-3e34c68f4aa3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:01.666393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b14cd9-1c0d-4ad9-b6c4-3e34c68f4aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:01.707141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-61b14cd9-1c0d-4ad9-b6c4-3e34c68f4aa3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:01.708470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-61b14cd9-1c0d-4ad9-b6c4-3e34c68f4aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:01.717215 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4089/8176] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:01.723110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef42cf-4c49-4a70-8d29-e82962c7e688 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:01.735112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef42cf-4c49-4a70-8d29-e82962c7e688 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:01.740765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7ca5-d62b-4b14-8e7e-235d09de4839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:01.741680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7ca5-d62b-4b14-8e7e-235d09de4839 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:01.742030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7ca5-d62b-4b14-8e7e-235d09de4839 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:01.742371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a7ca5-d62b-4b14-8e7e-235d09de4839 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:01.743094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7ca5-d62b-4b14-8e7e-235d09de4839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:32:01.743466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7ca5-d62b-4b14-8e7e-235d09de4839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:01.746724 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469a7ca5-d62b-4b14-8e7e-235d09de4839 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:01.766626 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4088/8177] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:32:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:32:01.768251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b14cd9-1c0d-4ad9-b6c4-3e34c68f4aa3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:01.780246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b14cd9-1c0d-4ad9-b6c4-3e34c68f4aa3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:01.787927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4efa9-c2e8-4117-85d0-32390a8e10a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:01.791243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4efa9-c2e8-4117-85d0-32390a8e10a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:01.791527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4efa9-c2e8-4117-85d0-32390a8e10a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:01.791808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a4efa9-c2e8-4117-85d0-32390a8e10a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:01.792456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4efa9-c2e8-4117-85d0-32390a8e10a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:01.796983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a4efa9-c2e8-4117-85d0-32390a8e10a5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:01.852827 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4090/8178] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:32:01 2022] POST /identity/v3/projects => generated 377 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:01.853866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7ca5-d62b-4b14-8e7e-235d09de4839 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:01.866114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a7ca5-d62b-4b14-8e7e-235d09de4839 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:01.978256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8192192-67fe-474a-ba5f-5b8ef694a62a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:01.979199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8192192-67fe-474a-ba5f-5b8ef694a62a admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:01.979576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8192192-67fe-474a-ba5f-5b8ef694a62a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:01.979978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8192192-67fe-474a-ba5f-5b8ef694a62a admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:01.980842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8192192-67fe-474a-ba5f-5b8ef694a62a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:01.982916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8192192-67fe-474a-ba5f-5b8ef694a62a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.013361 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4089/8179] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:32:01 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:32:02.018693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4efa9-c2e8-4117-85d0-32390a8e10a5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:02.040291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a4efa9-c2e8-4117-85d0-32390a8e10a5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:02.046261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e99c6-6454-4d2e-b24b-0da4361809be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:02.048923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e99c6-6454-4d2e-b24b-0da4361809be admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.049821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e99c6-6454-4d2e-b24b-0da4361809be admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.049821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8e99c6-6454-4d2e-b24b-0da4361809be admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.050569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e99c6-6454-4d2e-b24b-0da4361809be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:02.052723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8e99c6-6454-4d2e-b24b-0da4361809be admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.072494 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4091/8180] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:02.076295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8192192-67fe-474a-ba5f-5b8ef694a62a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:02.088459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8192192-67fe-474a-ba5f-5b8ef694a62a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:02.100384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa271f5-4e91-484f-828f-ca47a8e5dfe8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:02.101114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa271f5-4e91-484f-828f-ca47a8e5dfe8 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.101497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa271f5-4e91-484f-828f-ca47a8e5dfe8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.101858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa271f5-4e91-484f-828f-ca47a8e5dfe8 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.102575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa271f5-4e91-484f-828f-ca47a8e5dfe8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:02.104346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa271f5-4e91-484f-828f-ca47a8e5dfe8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.120509 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4090/8181] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:02.121652 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e99c6-6454-4d2e-b24b-0da4361809be admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:02.136691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8e99c6-6454-4d2e-b24b-0da4361809be admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:02.153951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ae294-c24d-4eb6-84f3-0c0e0f40ac08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:02.154969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae294-c24d-4eb6-84f3-0c0e0f40ac08 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.155445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae294-c24d-4eb6-84f3-0c0e0f40ac08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.155885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750ae294-c24d-4eb6-84f3-0c0e0f40ac08 admin admin] PATH_INFO: `/v3/projects/866896823da942cc982c47f0eb9b8694/users/bb7651295a1d4d25a4baadc45fdd12cd/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.175626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ae294-c24d-4eb6-84f3-0c0e0f40ac08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=866896823da942cc982c47f0eb9b8694, user_id=bb7651295a1d4d25a4baadc45fdd12cd, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:02.178770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750ae294-c24d-4eb6-84f3-0c0e0f40ac08 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.198846 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4092/8182] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:02 2022] PUT /identity/v3/projects/866896823da942cc982c47f0eb9b8694/users/bb7651295a1d4d25a4baadc45fdd12cd/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:02.209043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0fc4-1cdd-4d9d-b0db-c728ddcd06e4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.210462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0fc4-1cdd-4d9d-b0db-c728ddcd06e4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.210989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ca0fc4-1cdd-4d9d-b0db-c728ddcd06e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.250085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c3ca0fc4-1cdd-4d9d-b0db-c728ddcd06e4 None None] MFA Rules not processed for user `bb7651295a1d4d25a4baadc45fdd12cd`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:02.251906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c3ca0fc4-1cdd-4d9d-b0db-c728ddcd06e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:02.340057 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4091/8183] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:32:02.343866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ae294-c24d-4eb6-84f3-0c0e0f40ac08 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:02.373382 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:02.433001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750ae294-c24d-4eb6-84f3-0c0e0f40ac08 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:02.438019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495a703-b141-4fbe-bb05-86c20a18c1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:02.439239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a703-b141-4fbe-bb05-86c20a18c1c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.439515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a703-b141-4fbe-bb05-86c20a18c1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.439798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f495a703-b141-4fbe-bb05-86c20a18c1c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.440736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495a703-b141-4fbe-bb05-86c20a18c1c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:02.442748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f495a703-b141-4fbe-bb05-86c20a18c1c3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.484226 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4093/8184] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:32:02 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:02.488733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0fc4-1cdd-4d9d-b0db-c728ddcd06e4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:02.502677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ca0fc4-1cdd-4d9d-b0db-c728ddcd06e4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:02.518359 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:02.584383 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10feb5f-d65e-48c5-9064-130116835cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:02.584951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10feb5f-d65e-48c5-9064-130116835cdf admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.588103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10feb5f-d65e-48c5-9064-130116835cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.588405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10feb5f-d65e-48c5-9064-130116835cdf admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.589185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10feb5f-d65e-48c5-9064-130116835cdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:02.591803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10feb5f-d65e-48c5-9064-130116835cdf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.623712 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4092/8185] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:32:02 2022] POST /identity/v3/users => generated 294 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:02.627614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495a703-b141-4fbe-bb05-86c20a18c1c3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:02.642399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f495a703-b141-4fbe-bb05-86c20a18c1c3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:02.648574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3fc8-001d-41c0-aad9-8e2953230d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:02.649274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3fc8-001d-41c0-aad9-8e2953230d44 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.649820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3fc8-001d-41c0-aad9-8e2953230d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.650171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77db3fc8-001d-41c0-aad9-8e2953230d44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.651127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3fc8-001d-41c0-aad9-8e2953230d44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:02.653165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77db3fc8-001d-41c0-aad9-8e2953230d44 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.669512 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4094/8186] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:32:02.673271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10feb5f-d65e-48c5-9064-130116835cdf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:02.697703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10feb5f-d65e-48c5-9064-130116835cdf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:02.703742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92012b5-4daf-4327-b0a4-a4aa1344f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:02.705062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92012b5-4daf-4327-b0a4-a4aa1344f9aa admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.705464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92012b5-4daf-4327-b0a4-a4aa1344f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.705808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92012b5-4daf-4327-b0a4-a4aa1344f9aa admin admin] PATH_INFO: `/v3/projects/7b0482330058439d81f04a9958563d59/users/470a3ded1b184f56ac98b3b6df8efab8/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.731352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92012b5-4daf-4327-b0a4-a4aa1344f9aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0482330058439d81f04a9958563d59, user_id=470a3ded1b184f56ac98b3b6df8efab8, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:02.734552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92012b5-4daf-4327-b0a4-a4aa1344f9aa admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.754774 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4093/8187] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:02 2022] PUT /identity/v3/projects/7b0482330058439d81f04a9958563d59/users/470a3ded1b184f56ac98b3b6df8efab8/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:32:02.755885 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3fc8-001d-41c0-aad9-8e2953230d44 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:02.768558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77db3fc8-001d-41c0-aad9-8e2953230d44 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:02.846149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb8a412-94d5-48ab-9ada-09e0ad37d7e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:02.846761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8a412-94d5-48ab-9ada-09e0ad37d7e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.847190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8a412-94d5-48ab-9ada-09e0ad37d7e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.847605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb8a412-94d5-48ab-9ada-09e0ad37d7e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.848341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8a412-94d5-48ab-9ada-09e0ad37d7e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:02.850181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb8a412-94d5-48ab-9ada-09e0ad37d7e5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.864981 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4095/8188] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:02 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:02.868838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92012b5-4daf-4327-b0a4-a4aa1344f9aa admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:02.884146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92012b5-4daf-4327-b0a4-a4aa1344f9aa admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:02.914080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da16585-9739-42a2-b099-aff14996e4ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:02.914820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16585-9739-42a2-b099-aff14996e4ed admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:02.915040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16585-9739-42a2-b099-aff14996e4ed admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:02.915414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da16585-9739-42a2-b099-aff14996e4ed admin admin] PATH_INFO: `/v3/projects/7b0482330058439d81f04a9958563d59/users/470a3ded1b184f56ac98b3b6df8efab8/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:02.917330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da16585-9739-42a2-b099-aff14996e4ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b0482330058439d81f04a9958563d59, user_id=470a3ded1b184f56ac98b3b6df8efab8, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:02.920528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da16585-9739-42a2-b099-aff14996e4ed admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:02.953833 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4094/8189] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:02 2022] PUT /identity/v3/projects/7b0482330058439d81f04a9958563d59/users/470a3ded1b184f56ac98b3b6df8efab8/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:03.038007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fb532-f985-4a10-a2b6-3902ab96923b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:03.038445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fb532-f985-4a10-a2b6-3902ab96923b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:03.039128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fb532-f985-4a10-a2b6-3902ab96923b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:03.143218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3c5fb532-f985-4a10-a2b6-3902ab96923b None None] MFA Rules not processed for user `470a3ded1b184f56ac98b3b6df8efab8`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:03.145322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3c5fb532-f985-4a10-a2b6-3902ab96923b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:03.231119 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4096/8190] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:03 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:03.239508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da16585-9739-42a2-b099-aff14996e4ed admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:03.241426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8da16585-9739-42a2-b099-aff14996e4ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:03.309017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da16585-9739-42a2-b099-aff14996e4ed admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:03.313065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4278dd-a4ce-4bd5-a7b0-424c0011672e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:03.314318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4278dd-a4ce-4bd5-a7b0-424c0011672e service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:03.314684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4278dd-a4ce-4bd5-a7b0-424c0011672e service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:03.314969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4278dd-a4ce-4bd5-a7b0-424c0011672e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:03.403036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4278dd-a4ce-4bd5-a7b0-424c0011672e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:03.405167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4278dd-a4ce-4bd5-a7b0-424c0011672e service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:03.432220 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4095/8191] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:08.479400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fb532-f985-4a10-a2b6-3902ab96923b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:08.509992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fb532-f985-4a10-a2b6-3902ab96923b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:08.514691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9158a4-07b9-45c4-9ebd-237c5bc4b943 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:08.515387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9158a4-07b9-45c4-9ebd-237c5bc4b943 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:08.515774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9158a4-07b9-45c4-9ebd-237c5bc4b943 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:08.516143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9158a4-07b9-45c4-9ebd-237c5bc4b943 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:08.538056 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9158a4-07b9-45c4-9ebd-237c5bc4b943 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:08.539710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9158a4-07b9-45c4-9ebd-237c5bc4b943 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:08.557497 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4097/8192] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:13.419487 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:18.545982 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:30.220950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4278dd-a4ce-4bd5-a7b0-424c0011672e service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:30.222382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5b4278dd-a4ce-4bd5-a7b0-424c0011672e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:30.238789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4278dd-a4ce-4bd5-a7b0-424c0011672e service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:30.242855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d850ff73-db7e-473f-9738-c2183855d500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:30.243461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850ff73-db7e-473f-9738-c2183855d500 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:30.243753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850ff73-db7e-473f-9738-c2183855d500 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:30.244287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850ff73-db7e-473f-9738-c2183855d500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:30.246371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d850ff73-db7e-473f-9738-c2183855d500 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:30.416267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850ff73-db7e-473f-9738-c2183855d500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:30.416267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d850ff73-db7e-473f-9738-c2183855d500 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:30.441659 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4096/8193] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:30 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:32:35.186084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9158a4-07b9-45c4-9ebd-237c5bc4b943 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:35.311192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9158a4-07b9-45c4-9ebd-237c5bc4b943 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:35.341991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:35.342701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:35.342984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:35.343265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] PATH_INFO: `/v3/users/bb7651295a1d4d25a4baadc45fdd12cd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:35.344927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb7651295a1d4d25a4baadc45fdd12cd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:35.348100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:35.415431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb7651295a1d4d25a4baadc45fdd12cd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:35.430146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb7651295a1d4d25a4baadc45fdd12cd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:35.431060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb7651295a1d4d25a4baadc45fdd12cd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:35.441238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb7651295a1d4d25a4baadc45fdd12cd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:35.461702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb7651295a1d4d25a4baadc45fdd12cd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:35.478564 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4098/8194] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:32:35 2022] DELETE /identity/v3/users/bb7651295a1d4d25a4baadc45fdd12cd => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:35.483312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c20a2-5127-44eb-b5ad-9e8cbdfb49be None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:35.483794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c20a2-5127-44eb-b5ad-9e8cbdfb49be None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:35.484198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981c20a2-5127-44eb-b5ad-9e8cbdfb49be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:35.518176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-981c20a2-5127-44eb-b5ad-9e8cbdfb49be None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:35.519645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-981c20a2-5127-44eb-b5ad-9e8cbdfb49be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:35.589868 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4097/8195] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:35.600976 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:35.602635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:35.730136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf48c6-42e6-4108-8fa1-3fb2facfade9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:35.734077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c93333-9f8f-4422-ac8a-4fa2245b2692 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:35.734761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c93333-9f8f-4422-ac8a-4fa2245b2692 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:35.735063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c93333-9f8f-4422-ac8a-4fa2245b2692 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:35.735351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c93333-9f8f-4422-ac8a-4fa2245b2692 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:35.753219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c93333-9f8f-4422-ac8a-4fa2245b2692 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:35.754535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c93333-9f8f-4422-ac8a-4fa2245b2692 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:35.766353 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4099/8196] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:36.584456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c20a2-5127-44eb-b5ad-9e8cbdfb49be None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:36.586691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-981c20a2-5127-44eb-b5ad-9e8cbdfb49be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:36.603561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981c20a2-5127-44eb-b5ad-9e8cbdfb49be None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:36.612373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:36.613228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:36.614311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:36.614907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] PATH_INFO: `/v3/projects/866896823da942cc982c47f0eb9b8694` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:36.616931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=866896823da942cc982c47f0eb9b8694)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:36.619435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:36.690264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '866896823da942cc982c47f0eb9b8694', 'request_id': 'req-791684f2-1894-4b9f-b80c-892f716b5f74'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.700453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '866896823da942cc982c47f0eb9b8694', 'request_id': 'req-791684f2-1894-4b9f-b80c-892f716b5f74'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.711165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '866896823da942cc982c47f0eb9b8694', 'request_id': 'req-791684f2-1894-4b9f-b80c-892f716b5f74'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.726573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] The token cache is being invalidate because project 866896823da942cc982c47f0eb9b8694 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:32:36.727133 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.728113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.730268 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4098/8197] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:32:36 2022] DELETE /identity/v3/projects/866896823da942cc982c47f0eb9b8694 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:36.735651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c93333-9f8f-4422-ac8a-4fa2245b2692 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:36.758171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c93333-9f8f-4422-ac8a-4fa2245b2692 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:36.785241 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:36.839048 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:36.839870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:36.840745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:36.841149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] PATH_INFO: `/v3/users/470a3ded1b184f56ac98b3b6df8efab8` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:36.842733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=470a3ded1b184f56ac98b3b6df8efab8)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:36.845687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:36.929171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '470a3ded1b184f56ac98b3b6df8efab8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.946389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '470a3ded1b184f56ac98b3b6df8efab8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.947356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '470a3ded1b184f56ac98b3b6df8efab8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.959654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '470a3ded1b184f56ac98b3b6df8efab8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.987677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5132f8a0-ab22-4ab3-bc01-cf30a1db0a0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '470a3ded1b184f56ac98b3b6df8efab8'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:36.999624 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4100/8198] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:32:36 2022] DELETE /identity/v3/users/470a3ded1b184f56ac98b3b6df8efab8 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:37.452279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:37.455051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:37.482215 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791684f2-1894-4b9f-b80c-892f716b5f74 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:37.523934 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:37.612982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:37.613677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:37.614209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:37.614637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] PATH_INFO: `/v3/projects/7b0482330058439d81f04a9958563d59` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:37.615799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b0482330058439d81f04a9958563d59)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:37.617840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:37.694823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b0482330058439d81f04a9958563d59', 'request_id': 'req-e54a2799-a65b-48fb-a38d-80739d4cb225'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:37.709433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b0482330058439d81f04a9958563d59', 'request_id': 'req-e54a2799-a65b-48fb-a38d-80739d4cb225'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:37.731480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b0482330058439d81f04a9958563d59', 'request_id': 'req-e54a2799-a65b-48fb-a38d-80739d4cb225'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:37.757700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] The token cache is being invalidate because project 7b0482330058439d81f04a9958563d59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:32:37.758324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:37.760030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e54a2799-a65b-48fb-a38d-80739d4cb225 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:37.763012 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4099/8199] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:32:37 2022] DELETE /identity/v3/projects/7b0482330058439d81f04a9958563d59 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:37.769271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29410716-9e58-406e-8fad-0b63cc67757a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:37.770139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29410716-9e58-406e-8fad-0b63cc67757a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:37.770592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29410716-9e58-406e-8fad-0b63cc67757a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:37.798312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-29410716-9e58-406e-8fad-0b63cc67757a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:37.799754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-29410716-9e58-406e-8fad-0b63cc67757a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:37.923148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94ccc-c740-4817-9c5b-d687a98de1a9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:37.923999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94ccc-c740-4817-9c5b-d687a98de1a9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:37.924671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb94ccc-c740-4817-9c5b-d687a98de1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:37.929735 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4101/8200] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:37.984999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fdb94ccc-c740-4817-9c5b-d687a98de1a9 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:37.989039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fdb94ccc-c740-4817-9c5b-d687a98de1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:38.011274 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4100/8201] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:38.015916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29410716-9e58-406e-8fad-0b63cc67757a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:38.028504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29410716-9e58-406e-8fad-0b63cc67757a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:38.053171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f7a6f-7ace-46f2-a1db-528d9bbe6aa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:38.054977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f7a6f-7ace-46f2-a1db-528d9bbe6aa2 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:38.055469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f7a6f-7ace-46f2-a1db-528d9bbe6aa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:38.055897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f7a6f-7ace-46f2-a1db-528d9bbe6aa2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:38.056760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f7a6f-7ace-46f2-a1db-528d9bbe6aa2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:32:38.057223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f7a6f-7ace-46f2-a1db-528d9bbe6aa2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:38.061834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583f7a6f-7ace-46f2-a1db-528d9bbe6aa2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:38.080285 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4102/8202] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:32:38.086693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94ccc-c740-4817-9c5b-d687a98de1a9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:38.101743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb94ccc-c740-4817-9c5b-d687a98de1a9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:38.108152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe644b-e0aa-4336-b0b7-d30051b25543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:38.109044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe644b-e0aa-4336-b0b7-d30051b25543 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:38.110147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe644b-e0aa-4336-b0b7-d30051b25543 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:38.110626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebe644b-e0aa-4336-b0b7-d30051b25543 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:38.111461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe644b-e0aa-4336-b0b7-d30051b25543 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:38.113699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebe644b-e0aa-4336-b0b7-d30051b25543 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:38.167157 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4101/8203] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:32:38 2022] POST /identity/v3/projects => generated 389 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:32:38.171365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f7a6f-7ace-46f2-a1db-528d9bbe6aa2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:38.218484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583f7a6f-7ace-46f2-a1db-528d9bbe6aa2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:38.265449 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:38.351730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc80cb0-cc6e-45c0-9d37-ef505c108466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:38.352829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc80cb0-cc6e-45c0-9d37-ef505c108466 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:38.353208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc80cb0-cc6e-45c0-9d37-ef505c108466 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:38.353593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc80cb0-cc6e-45c0-9d37-ef505c108466 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:38.354437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc80cb0-cc6e-45c0-9d37-ef505c108466 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:38.356462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc80cb0-cc6e-45c0-9d37-ef505c108466 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:38.392869 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4103/8204] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:32:38 2022] POST /identity/v3/users => generated 295 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:38.393716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe644b-e0aa-4336-b0b7-d30051b25543 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:38.404827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebe644b-e0aa-4336-b0b7-d30051b25543 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:38.411873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd9ec9-6ce7-40ed-aa6f-322caeb68e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:38.412489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd9ec9-6ce7-40ed-aa6f-322caeb68e45 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:38.412911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd9ec9-6ce7-40ed-aa6f-322caeb68e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:38.413590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bd9ec9-6ce7-40ed-aa6f-322caeb68e45 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:38.414453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd9ec9-6ce7-40ed-aa6f-322caeb68e45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:38.416268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bd9ec9-6ce7-40ed-aa6f-322caeb68e45 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:38.430893 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4102/8205] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:32:38.434779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc80cb0-cc6e-45c0-9d37-ef505c108466 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:38.446385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc80cb0-cc6e-45c0-9d37-ef505c108466 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:38.451832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9db890-a7e4-45b6-8570-78364f20b47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:38.452563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9db890-a7e4-45b6-8570-78364f20b47d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:38.452915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9db890-a7e4-45b6-8570-78364f20b47d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:38.453818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9db890-a7e4-45b6-8570-78364f20b47d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:38.454541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9db890-a7e4-45b6-8570-78364f20b47d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:38.456299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9db890-a7e4-45b6-8570-78364f20b47d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:38.472953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd9ec9-6ce7-40ed-aa6f-322caeb68e45 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:38.477433 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4104/8206] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:38.503939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bd9ec9-6ce7-40ed-aa6f-322caeb68e45 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:38.508873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47e1b-5dab-491a-82f0-a6961b122b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:38.509619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47e1b-5dab-491a-82f0-a6961b122b77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:38.509942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47e1b-5dab-491a-82f0-a6961b122b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:38.510103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e47e1b-5dab-491a-82f0-a6961b122b77 admin admin] PATH_INFO: `/v3/projects/ca5deda367244ed89553f1383b267571/users/05f08729cb8342c69e4fd9fd4e909be6/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:38.539479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e47e1b-5dab-491a-82f0-a6961b122b77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca5deda367244ed89553f1383b267571, user_id=05f08729cb8342c69e4fd9fd4e909be6, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:38.556122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e47e1b-5dab-491a-82f0-a6961b122b77 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:38.585402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4103/8207] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:38 2022] PUT /identity/v3/projects/ca5deda367244ed89553f1383b267571/users/05f08729cb8342c69e4fd9fd4e909be6/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:32:38.591504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ebd9f-9694-44ed-9df0-60d416da4012 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:38.591942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ebd9f-9694-44ed-9df0-60d416da4012 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:38.592429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38ebd9f-9694-44ed-9df0-60d416da4012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:38.632719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a38ebd9f-9694-44ed-9df0-60d416da4012 None None] MFA Rules not processed for user `05f08729cb8342c69e4fd9fd4e909be6`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:38.634923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a38ebd9f-9694-44ed-9df0-60d416da4012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:38.725555 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4105/8208] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:38 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:38.730905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47e1b-5dab-491a-82f0-a6961b122b77 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:38.815562 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:38.844176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e47e1b-5dab-491a-82f0-a6961b122b77 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:38.853103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f075519-a22e-4e1e-8d8c-abb545033f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:38.853937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f075519-a22e-4e1e-8d8c-abb545033f8c admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:38.854347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f075519-a22e-4e1e-8d8c-abb545033f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:38.854697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f075519-a22e-4e1e-8d8c-abb545033f8c admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:38.855430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f075519-a22e-4e1e-8d8c-abb545033f8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:38.858447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f075519-a22e-4e1e-8d8c-abb545033f8c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:38.894412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4104/8209] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:32:38 2022] POST /identity/v3/projects => generated 391 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:38.898633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ebd9f-9694-44ed-9df0-60d416da4012 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:38.913894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38ebd9f-9694-44ed-9df0-60d416da4012 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:39.012473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b46ee-83d7-44f7-b590-774204272405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:39.013391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b46ee-83d7-44f7-b590-774204272405 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:39.013732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b46ee-83d7-44f7-b590-774204272405 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:39.014013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b46ee-83d7-44f7-b590-774204272405 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:39.014717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b46ee-83d7-44f7-b590-774204272405 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:39.017005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b46ee-83d7-44f7-b590-774204272405 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:39.052277 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4106/8210] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:32:38 2022] POST /identity/v3/users => generated 302 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:39.053321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f075519-a22e-4e1e-8d8c-abb545033f8c admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:39.064190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f075519-a22e-4e1e-8d8c-abb545033f8c admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:39.069840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2560-8afd-45aa-91c4-5b654e1badaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:39.070742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2560-8afd-45aa-91c4-5b654e1badaf admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:39.071023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2560-8afd-45aa-91c4-5b654e1badaf admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:39.071294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2560-8afd-45aa-91c4-5b654e1badaf admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:39.071930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f2560-8afd-45aa-91c4-5b654e1badaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:39.074219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f2560-8afd-45aa-91c4-5b654e1badaf admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:39.097910 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4105/8211] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:32:39.106317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b46ee-83d7-44f7-b590-774204272405 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:39.119030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b46ee-83d7-44f7-b590-774204272405 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:39.126691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16d2af-0e3a-413d-915b-c71c6763e13c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:39.127471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d2af-0e3a-413d-915b-c71c6763e13c admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:39.127792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d2af-0e3a-413d-915b-c71c6763e13c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:39.128075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed16d2af-0e3a-413d-915b-c71c6763e13c admin admin] PATH_INFO: `/v3/projects/9b64e00a7ae949f9acd1f9892758629c/users/b5e4d5fe9bcd4861aadfbe1a04fe0f54/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:39.162882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16d2af-0e3a-413d-915b-c71c6763e13c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b64e00a7ae949f9acd1f9892758629c, user_id=b5e4d5fe9bcd4861aadfbe1a04fe0f54, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:39.167437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed16d2af-0e3a-413d-915b-c71c6763e13c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:39.183580 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4107/8212] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:39 2022] PUT /identity/v3/projects/9b64e00a7ae949f9acd1f9892758629c/users/b5e4d5fe9bcd4861aadfbe1a04fe0f54/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:39.187780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2560-8afd-45aa-91c4-5b654e1badaf admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:39.200818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2560-8afd-45aa-91c4-5b654e1badaf admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:39.274830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41efa02-384d-428d-97d7-7e15ec21cf02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:39.276014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41efa02-384d-428d-97d7-7e15ec21cf02 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:39.276310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41efa02-384d-428d-97d7-7e15ec21cf02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:39.276753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41efa02-384d-428d-97d7-7e15ec21cf02 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:39.277608 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41efa02-384d-428d-97d7-7e15ec21cf02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:39.280028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41efa02-384d-428d-97d7-7e15ec21cf02 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:39.293185 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4106/8213] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:39.303344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16d2af-0e3a-413d-915b-c71c6763e13c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:39.310486 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:39.318049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed16d2af-0e3a-413d-915b-c71c6763e13c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:39.326253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda77e8-eab2-409a-ba11-ccc25ccc327f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:39.327158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda77e8-eab2-409a-ba11-ccc25ccc327f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:39.327675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda77e8-eab2-409a-ba11-ccc25ccc327f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:39.328712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cda77e8-eab2-409a-ba11-ccc25ccc327f admin admin] PATH_INFO: `/v3/projects/9b64e00a7ae949f9acd1f9892758629c/users/b5e4d5fe9bcd4861aadfbe1a04fe0f54/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:39.350518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda77e8-eab2-409a-ba11-ccc25ccc327f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b64e00a7ae949f9acd1f9892758629c, user_id=b5e4d5fe9bcd4861aadfbe1a04fe0f54, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:39.354124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cda77e8-eab2-409a-ba11-ccc25ccc327f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:39.366416 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4108/8214] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:39 2022] PUT /identity/v3/projects/9b64e00a7ae949f9acd1f9892758629c/users/b5e4d5fe9bcd4861aadfbe1a04fe0f54/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:39.376843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc49c83-4edb-4d56-9d27-40d1b057dd64 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:39.377409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc49c83-4edb-4d56-9d27-40d1b057dd64 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:39.378033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc49c83-4edb-4d56-9d27-40d1b057dd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:39.397583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda77e8-eab2-409a-ba11-ccc25ccc327f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:39.400297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7cda77e8-eab2-409a-ba11-ccc25ccc327f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:39.435251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9bc49c83-4edb-4d56-9d27-40d1b057dd64 None None] MFA Rules not processed for user `b5e4d5fe9bcd4861aadfbe1a04fe0f54`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:39.436639 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9bc49c83-4edb-4d56-9d27-40d1b057dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:39.525475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cda77e8-eab2-409a-ba11-ccc25ccc327f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:39.531755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:39.532587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:39.533035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:39.533515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:39.536075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:39.568991 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4107/8215] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:39 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:39.583627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc49c83-4edb-4d56-9d27-40d1b057dd64 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:39.585591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9bc49c83-4edb-4d56-9d27-40d1b057dd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:39.635192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:39.637057 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:39.652851 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:39.663790 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4109/8216] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:39.677876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc49c83-4edb-4d56-9d27-40d1b057dd64 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:39.689869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f52e8-f0e1-4510-80b5-a70045bd7cdc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:39.690505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f52e8-f0e1-4510-80b5-a70045bd7cdc service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:39.690786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f52e8-f0e1-4510-80b5-a70045bd7cdc service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:39.691144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157f52e8-f0e1-4510-80b5-a70045bd7cdc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:39.711306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f52e8-f0e1-4510-80b5-a70045bd7cdc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:39.714263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157f52e8-f0e1-4510-80b5-a70045bd7cdc service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:39.726414 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4108/8217] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:39 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:32:39.811487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:39.814460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:39.834075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22681fca-9ac8-407d-86ae-2fa12b2e9cc6 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:39.838138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709d533-7191-42f2-a98b-c3be88776de1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:39.838755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709d533-7191-42f2-a98b-c3be88776de1 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:39.839035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709d533-7191-42f2-a98b-c3be88776de1 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:39.839353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c709d533-7191-42f2-a98b-c3be88776de1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:39.940484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709d533-7191-42f2-a98b-c3be88776de1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:39.943108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c709d533-7191-42f2-a98b-c3be88776de1 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:39.966334 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4110/8218] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:39 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:40.576104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f52e8-f0e1-4510-80b5-a70045bd7cdc service cinder] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:40.576104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-157f52e8-f0e1-4510-80b5-a70045bd7cdc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:40.603099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157f52e8-f0e1-4510-80b5-a70045bd7cdc service cinder] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:40.609506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:40.610850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:40.612525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:40.612975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] PATH_INFO: `/v3/users/e2fc124049504d579f6513b5cac00bdf` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:40.614934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2fc124049504d579f6513b5cac00bdf)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:40.617109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:40.686757 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2fc124049504d579f6513b5cac00bdf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:40.711655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2fc124049504d579f6513b5cac00bdf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:40.712913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2fc124049504d579f6513b5cac00bdf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:40.721643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2fc124049504d579f6513b5cac00bdf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:40.729333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2fc124049504d579f6513b5cac00bdf'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:40.736757 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4109/8219] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:32:40 2022] DELETE /identity/v3/users/e2fc124049504d579f6513b5cac00bdf => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:41.001845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709d533-7191-42f2-a98b-c3be88776de1 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:41.024101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c709d533-7191-42f2-a98b-c3be88776de1 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:41.087601 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:41.118288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:41.119674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:41.120120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:41.121421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] PATH_INFO: `/v3/projects/5ffa591ecfaa48ada907a639b45d07f7` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:41.123393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ffa591ecfaa48ada907a639b45d07f7)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:41.125659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:41.213090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ffa591ecfaa48ada907a639b45d07f7', 'request_id': 'req-a0e79d15-8c94-475d-9001-411235062b97'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:41.220688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ffa591ecfaa48ada907a639b45d07f7', 'request_id': 'req-a0e79d15-8c94-475d-9001-411235062b97'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:41.233560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ffa591ecfaa48ada907a639b45d07f7', 'request_id': 'req-a0e79d15-8c94-475d-9001-411235062b97'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:41.246606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] The token cache is being invalidate because project 5ffa591ecfaa48ada907a639b45d07f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:32:41.246978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:41.247840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-a0e79d15-8c94-475d-9001-411235062b97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:41.249490 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4111/8220] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:32:41 2022] DELETE /identity/v3/projects/5ffa591ecfaa48ada907a639b45d07f7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:44.911997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:44.913659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:44.931907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2280d7-11b9-4b67-98d2-fecc967e4639 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:45.022582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:45.023454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:45.023920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:45.024301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] PATH_INFO: `/v3/users/05f08729cb8342c69e4fd9fd4e909be6` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:45.025703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05f08729cb8342c69e4fd9fd4e909be6)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:45.027728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:45.083645 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05f08729cb8342c69e4fd9fd4e909be6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.095461 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:45.097860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05f08729cb8342c69e4fd9fd4e909be6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.098784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05f08729cb8342c69e4fd9fd4e909be6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.114035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05f08729cb8342c69e4fd9fd4e909be6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.124242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05f08729cb8342c69e4fd9fd4e909be6'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.138534 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4110/8221] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:32:44 2022] DELETE /identity/v3/users/05f08729cb8342c69e4fd9fd4e909be6 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:45.149579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f86e8-67cd-4c0c-9f93-6e67794298e1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:45.149579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f86e8-67cd-4c0c-9f93-6e67794298e1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:45.149579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3f86e8-67cd-4c0c-9f93-6e67794298e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:45.163935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5d3f86e8-67cd-4c0c-9f93-6e67794298e1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:45.165117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d3f86e8-67cd-4c0c-9f93-6e67794298e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:45.227922 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4112/8222] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:45.238071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:45.239657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:45.321280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c565d5f4-bed2-4a6b-aecc-424efe67ef54 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:45.325033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d796f-1442-48f8-a426-af7536b04395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:45.325710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d796f-1442-48f8-a426-af7536b04395 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:45.325991 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d796f-1442-48f8-a426-af7536b04395 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:45.326263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d796f-1442-48f8-a426-af7536b04395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:45.336931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d796f-1442-48f8-a426-af7536b04395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:45.338483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d796f-1442-48f8-a426-af7536b04395 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:45.349904 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4111/8223] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:45.678015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f86e8-67cd-4c0c-9f93-6e67794298e1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:45.679744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d3f86e8-67cd-4c0c-9f93-6e67794298e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:45.705914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3f86e8-67cd-4c0c-9f93-6e67794298e1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:45.718790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:45.719437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:45.719713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:45.719980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] PATH_INFO: `/v3/projects/ca5deda367244ed89553f1383b267571` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:45.721121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca5deda367244ed89553f1383b267571)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:45.723070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:45.792450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca5deda367244ed89553f1383b267571', 'request_id': 'req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.800937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca5deda367244ed89553f1383b267571', 'request_id': 'req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.811540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca5deda367244ed89553f1383b267571', 'request_id': 'req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.815096 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:45.828467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] The token cache is being invalidate because project ca5deda367244ed89553f1383b267571 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:32:45.828883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.829829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:45.833000 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4113/8224] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:32:45 2022] DELETE /identity/v3/projects/ca5deda367244ed89553f1383b267571 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:45.839465 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d796f-1442-48f8-a426-af7536b04395 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:45.853124 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d796f-1442-48f8-a426-af7536b04395 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:45.916788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:45.917509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:45.917752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:45.918024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] PATH_INFO: `/v3/users/b5e4d5fe9bcd4861aadfbe1a04fe0f54` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:45.919247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5e4d5fe9bcd4861aadfbe1a04fe0f54)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:45.921193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:45.992719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5e4d5fe9bcd4861aadfbe1a04fe0f54'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.010260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5e4d5fe9bcd4861aadfbe1a04fe0f54'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.011446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5e4d5fe9bcd4861aadfbe1a04fe0f54'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.025018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5e4d5fe9bcd4861aadfbe1a04fe0f54'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.034234 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d41d7d5c-6380-444a-8d65-21d43d84239f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5e4d5fe9bcd4861aadfbe1a04fe0f54'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.037741 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:46.043361 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4112/8225] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:32:45 2022] DELETE /identity/v3/users/b5e4d5fe9bcd4861aadfbe1a04fe0f54 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:46.392539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:46.394050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:46.407277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8851f3-4177-4e38-a4bf-f5ffcdab2a04 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:46.472170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:46.472914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:46.473325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:46.473678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] PATH_INFO: `/v3/projects/9b64e00a7ae949f9acd1f9892758629c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:46.474920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b64e00a7ae949f9acd1f9892758629c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:46.476990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:46.531588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b64e00a7ae949f9acd1f9892758629c', 'request_id': 'req-be8a639a-aa3f-4c5c-a53d-c0978f14979d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.538218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b64e00a7ae949f9acd1f9892758629c', 'request_id': 'req-be8a639a-aa3f-4c5c-a53d-c0978f14979d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.547500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b64e00a7ae949f9acd1f9892758629c', 'request_id': 'req-be8a639a-aa3f-4c5c-a53d-c0978f14979d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.558759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] The token cache is being invalidate because project 9b64e00a7ae949f9acd1f9892758629c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:32:46.559152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.559857 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-be8a639a-aa3f-4c5c-a53d-c0978f14979d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:46.561652 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4114/8226] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:32:46 2022] DELETE /identity/v3/projects/9b64e00a7ae949f9acd1f9892758629c => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:46.567021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705a6b-e459-4d47-beac-28ba584c1866 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:46.567706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705a6b-e459-4d47-beac-28ba584c1866 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:46.568207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e705a6b-e459-4d47-beac-28ba584c1866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:46.591399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9e705a6b-e459-4d47-beac-28ba584c1866 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:46.592856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e705a6b-e459-4d47-beac-28ba584c1866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:46.658731 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4113/8227] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:46.666382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db878948-84d9-45f6-a0d8-994ae0fcfff3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:46.666737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db878948-84d9-45f6-a0d8-994ae0fcfff3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:46.667076 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db878948-84d9-45f6-a0d8-994ae0fcfff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:46.688250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-db878948-84d9-45f6-a0d8-994ae0fcfff3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:46.689752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-db878948-84d9-45f6-a0d8-994ae0fcfff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:46.702019 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4115/8228] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:46.703623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705a6b-e459-4d47-beac-28ba584c1866 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:46.714805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e705a6b-e459-4d47-beac-28ba584c1866 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:46.720070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668692e-0592-4f8a-8844-8919bba6b1fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:46.720792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668692e-0592-4f8a-8844-8919bba6b1fc admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:46.721149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668692e-0592-4f8a-8844-8919bba6b1fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:46.721530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4668692e-0592-4f8a-8844-8919bba6b1fc admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:46.722264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668692e-0592-4f8a-8844-8919bba6b1fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:32:46.722641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668692e-0592-4f8a-8844-8919bba6b1fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:46.724334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4668692e-0592-4f8a-8844-8919bba6b1fc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:46.741612 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4114/8229] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:32:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:32:46.743518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db878948-84d9-45f6-a0d8-994ae0fcfff3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:46.754555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db878948-84d9-45f6-a0d8-994ae0fcfff3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:46.760354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5007a-b299-4d5b-960e-85c6ed207286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:46.761104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5007a-b299-4d5b-960e-85c6ed207286 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:46.761413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5007a-b299-4d5b-960e-85c6ed207286 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:46.761690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc5007a-b299-4d5b-960e-85c6ed207286 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:46.762403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5007a-b299-4d5b-960e-85c6ed207286 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:46.764398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc5007a-b299-4d5b-960e-85c6ed207286 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:46.793590 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4116/8230] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:32:46 2022] POST /identity/v3/projects => generated 367 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:46.797830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668692e-0592-4f8a-8844-8919bba6b1fc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:46.807899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4668692e-0592-4f8a-8844-8919bba6b1fc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:46.869202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf8f8d-f265-4468-b2b0-6b824e35f381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:46.869837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8f8d-f265-4468-b2b0-6b824e35f381 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:46.870119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8f8d-f265-4468-b2b0-6b824e35f381 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:46.870391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcf8f8d-f265-4468-b2b0-6b824e35f381 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:46.871017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf8f8d-f265-4468-b2b0-6b824e35f381 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:46.872931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcf8f8d-f265-4468-b2b0-6b824e35f381 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:46.896725 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4115/8231] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:32:46 2022] POST /identity/v3/users => generated 284 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:46.900465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5007a-b299-4d5b-960e-85c6ed207286 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:46.911825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc5007a-b299-4d5b-960e-85c6ed207286 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:46.916536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b745dd-8198-4612-bf18-ef071c4d7a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:46.917135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b745dd-8198-4612-bf18-ef071c4d7a87 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:46.917455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b745dd-8198-4612-bf18-ef071c4d7a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:46.917736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b745dd-8198-4612-bf18-ef071c4d7a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:46.918377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b745dd-8198-4612-bf18-ef071c4d7a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:46.919982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b745dd-8198-4612-bf18-ef071c4d7a87 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:46.930501 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4117/8232] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:46.934624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf8f8d-f265-4468-b2b0-6b824e35f381 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:46.946055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcf8f8d-f265-4468-b2b0-6b824e35f381 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:46.950700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf9767c2-501b-4b79-9c35-3cbfb847e1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:46.951299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9767c2-501b-4b79-9c35-3cbfb847e1de admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:46.951603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9767c2-501b-4b79-9c35-3cbfb847e1de admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:46.951876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf9767c2-501b-4b79-9c35-3cbfb847e1de admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:46.952503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9767c2-501b-4b79-9c35-3cbfb847e1de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:46.954654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf9767c2-501b-4b79-9c35-3cbfb847e1de admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:46.965468 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4116/8233] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:46.970475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b745dd-8198-4612-bf18-ef071c4d7a87 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:46.981007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b745dd-8198-4612-bf18-ef071c4d7a87 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:46.985761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b98752-7cef-44ca-9866-d3ba65eca998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:46.986476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b98752-7cef-44ca-9866-d3ba65eca998 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:46.986831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b98752-7cef-44ca-9866-d3ba65eca998 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:46.987181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b98752-7cef-44ca-9866-d3ba65eca998 admin admin] PATH_INFO: `/v3/projects/2b05e82866a04b1d9929d8272afea196/users/7e739381d4a947b880f162d8ee3fa9db/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.004132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b98752-7cef-44ca-9866-d3ba65eca998 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b05e82866a04b1d9929d8272afea196, user_id=7e739381d4a947b880f162d8ee3fa9db, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:47.007144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b98752-7cef-44ca-9866-d3ba65eca998 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:47.020844 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4118/8234] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:46 2022] PUT /identity/v3/projects/2b05e82866a04b1d9929d8272afea196/users/7e739381d4a947b880f162d8ee3fa9db/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:47.033464 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee464b10-f0e8-4298-bd3b-35a1669a1aca None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:47.033837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee464b10-f0e8-4298-bd3b-35a1669a1aca None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:47.034118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee464b10-f0e8-4298-bd3b-35a1669a1aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.064808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ee464b10-f0e8-4298-bd3b-35a1669a1aca None None] MFA Rules not processed for user `7e739381d4a947b880f162d8ee3fa9db`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:47.065986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ee464b10-f0e8-4298-bd3b-35a1669a1aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:47.123103 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:47.135091 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4117/8235] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:47 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:47.139320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b98752-7cef-44ca-9866-d3ba65eca998 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:47.161613 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:47.213985 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b98752-7cef-44ca-9866-d3ba65eca998 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:47.220398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f5241-0926-4e20-900a-a07f84e0032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:47.220398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f5241-0926-4e20-900a-a07f84e0032b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:47.220737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f5241-0926-4e20-900a-a07f84e0032b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:47.220979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f5241-0926-4e20-900a-a07f84e0032b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.221804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f5241-0926-4e20-900a-a07f84e0032b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:47.223514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f5241-0926-4e20-900a-a07f84e0032b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:47.259353 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4119/8236] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:32:47 2022] POST /identity/v3/projects => generated 367 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:47.260827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee464b10-f0e8-4298-bd3b-35a1669a1aca None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:47.272900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee464b10-f0e8-4298-bd3b-35a1669a1aca None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:47.332670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01349135-40a3-4ea3-bd5f-a0d7a132f127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:47.333326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349135-40a3-4ea3-bd5f-a0d7a132f127 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:47.333689 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349135-40a3-4ea3-bd5f-a0d7a132f127 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:47.333969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01349135-40a3-4ea3-bd5f-a0d7a132f127 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.334602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01349135-40a3-4ea3-bd5f-a0d7a132f127 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:47.336553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01349135-40a3-4ea3-bd5f-a0d7a132f127 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:47.364513 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4118/8237] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:32:47 2022] POST /identity/v3/users => generated 290 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:47.365850 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f5241-0926-4e20-900a-a07f84e0032b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:47.376729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f5241-0926-4e20-900a-a07f84e0032b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:47.385453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90786481-d464-4d50-8bd4-f7cde4ceb514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:47.386125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90786481-d464-4d50-8bd4-f7cde4ceb514 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:47.386470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90786481-d464-4d50-8bd4-f7cde4ceb514 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:47.386820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90786481-d464-4d50-8bd4-f7cde4ceb514 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.387696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90786481-d464-4d50-8bd4-f7cde4ceb514 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:47.389412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90786481-d464-4d50-8bd4-f7cde4ceb514 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:47.402991 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4120/8238] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:47.407909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01349135-40a3-4ea3-bd5f-a0d7a132f127 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:47.419189 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01349135-40a3-4ea3-bd5f-a0d7a132f127 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:47.425548 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef952f5-ffb0-49a6-b2fb-c58af1238fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:47.426208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef952f5-ffb0-49a6-b2fb-c58af1238fd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:47.426486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef952f5-ffb0-49a6-b2fb-c58af1238fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:47.426756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef952f5-ffb0-49a6-b2fb-c58af1238fd3 admin admin] PATH_INFO: `/v3/projects/0f4c52feb2b44089911cad1b07f0e1ea/users/90ff9ecca3844bbaa7485ed4ce2a37d9/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.444494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef952f5-ffb0-49a6-b2fb-c58af1238fd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4c52feb2b44089911cad1b07f0e1ea, user_id=90ff9ecca3844bbaa7485ed4ce2a37d9, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:47.447398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef952f5-ffb0-49a6-b2fb-c58af1238fd3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:47.462623 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4119/8239] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:47 2022] PUT /identity/v3/projects/0f4c52feb2b44089911cad1b07f0e1ea/users/90ff9ecca3844bbaa7485ed4ce2a37d9/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:47.466365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90786481-d464-4d50-8bd4-f7cde4ceb514 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:47.493945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90786481-d464-4d50-8bd4-f7cde4ceb514 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:47.565699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b298967-74c1-44f4-9962-bc0c87a2fca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:47.566379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b298967-74c1-44f4-9962-bc0c87a2fca1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:47.566853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b298967-74c1-44f4-9962-bc0c87a2fca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:47.567217 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b298967-74c1-44f4-9962-bc0c87a2fca1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.567929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b298967-74c1-44f4-9962-bc0c87a2fca1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:47.569641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b298967-74c1-44f4-9962-bc0c87a2fca1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:47.581504 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4121/8240] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:47 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:47.586062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef952f5-ffb0-49a6-b2fb-c58af1238fd3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:47.602643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef952f5-ffb0-49a6-b2fb-c58af1238fd3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:47.607650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5022801-bbde-43b1-9d71-bd31a0a696f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:47.608390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5022801-bbde-43b1-9d71-bd31a0a696f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:47.608776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5022801-bbde-43b1-9d71-bd31a0a696f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:47.609723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5022801-bbde-43b1-9d71-bd31a0a696f8 admin admin] PATH_INFO: `/v3/projects/0f4c52feb2b44089911cad1b07f0e1ea/users/90ff9ecca3844bbaa7485ed4ce2a37d9/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.612011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5022801-bbde-43b1-9d71-bd31a0a696f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f4c52feb2b44089911cad1b07f0e1ea, user_id=90ff9ecca3844bbaa7485ed4ce2a37d9, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:47.614814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5022801-bbde-43b1-9d71-bd31a0a696f8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:47.626969 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4120/8241] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:47 2022] PUT /identity/v3/projects/0f4c52feb2b44089911cad1b07f0e1ea/users/90ff9ecca3844bbaa7485ed4ce2a37d9/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:47.639207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36afeb8-6d74-4852-a864-75cfb561e72f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:47.639494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36afeb8-6d74-4852-a864-75cfb561e72f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:47.639772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36afeb8-6d74-4852-a864-75cfb561e72f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.674702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c36afeb8-6d74-4852-a864-75cfb561e72f None None] MFA Rules not processed for user `90ff9ecca3844bbaa7485ed4ce2a37d9`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:47.675972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c36afeb8-6d74-4852-a864-75cfb561e72f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:47.774633 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4122/8242] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:47 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:47.784682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5022801-bbde-43b1-9d71-bd31a0a696f8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:47.787716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d5022801-bbde-43b1-9d71-bd31a0a696f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:47.867159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5022801-bbde-43b1-9d71-bd31a0a696f8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:47.871405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db703149-c3fd-468d-9aa6-bb6c3c1c846d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:47.872228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db703149-c3fd-468d-9aa6-bb6c3c1c846d service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:47.872685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db703149-c3fd-468d-9aa6-bb6c3c1c846d service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:47.872963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db703149-c3fd-468d-9aa6-bb6c3c1c846d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:47.885067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db703149-c3fd-468d-9aa6-bb6c3c1c846d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:47.886550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db703149-c3fd-468d-9aa6-bb6c3c1c846d service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:47.899896 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4121/8243] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:47 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:32:48.010685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36afeb8-6d74-4852-a864-75cfb561e72f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:48.027706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36afeb8-6d74-4852-a864-75cfb561e72f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:48.033694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d572d3-5741-49b2-8e2a-5f87a2331253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:48.034329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d572d3-5741-49b2-8e2a-5f87a2331253 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:48.034607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d572d3-5741-49b2-8e2a-5f87a2331253 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:48.034881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d572d3-5741-49b2-8e2a-5f87a2331253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:48.047971 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:48.120078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d572d3-5741-49b2-8e2a-5f87a2331253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:48.121598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d572d3-5741-49b2-8e2a-5f87a2331253 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:48.133890 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4123/8244] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:48 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:48.754768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa9fdf-cad4-4740-b96a-07d924048346 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:48.755557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa9fdf-cad4-4740-b96a-07d924048346 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:48.755664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fa9fdf-cad4-4740-b96a-07d924048346 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:48.777126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b6fa9fdf-cad4-4740-b96a-07d924048346 None None] MFA Rules not processed for user `1731f53174b745b19f6b8529f8681311`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:48.778361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6fa9fdf-cad4-4740-b96a-07d924048346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:48.825648 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:48.838889 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4122/8245] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:49.219727 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d572d3-5741-49b2-8e2a-5f87a2331253 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:49.221169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-49d572d3-5741-49b2-8e2a-5f87a2331253 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:49.321281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d572d3-5741-49b2-8e2a-5f87a2331253 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:49.329677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:49.330531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:49.331017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:49.331572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:49.333602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:49.348436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:49.350222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:49.363258 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4124/8246] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:49.861553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa9fdf-cad4-4740-b96a-07d924048346 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:49.864336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b6fa9fdf-cad4-4740-b96a-07d924048346 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:49.972146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fa9fdf-cad4-4740-b96a-07d924048346 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:49.978823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:49.979650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:49.980008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:49.980355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:49.982233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:49.997848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:50.000399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:50.014203 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4123/8247] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:52.325845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:52.328584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:52.344506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c063a50-fd48-4e0f-94e9-da6b50d0fd7a service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:52.349418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa593335-b4ea-4935-aee6-b780762275e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:52.350841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593335-b4ea-4935-aee6-b780762275e9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:52.351289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593335-b4ea-4935-aee6-b780762275e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:52.351733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa593335-b4ea-4935-aee6-b780762275e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:52.353802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aa593335-b4ea-4935-aee6-b780762275e9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:52.395535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa593335-b4ea-4935-aee6-b780762275e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:52.397243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa593335-b4ea-4935-aee6-b780762275e9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:52.417444 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4125/8248] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:32:53.173379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:53.175839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:53.385918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4467823-6a53-48f3-a710-e665ce58d0cf service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:53.405895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39286b2-91f9-41ea-a9aa-c3f059f4d0ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:53.408854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39286b2-91f9-41ea-a9aa-c3f059f4d0ec service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:53.409253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39286b2-91f9-41ea-a9aa-c3f059f4d0ec service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:53.409684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39286b2-91f9-41ea-a9aa-c3f059f4d0ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:53.416957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d39286b2-91f9-41ea-a9aa-c3f059f4d0ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:53.448888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39286b2-91f9-41ea-a9aa-c3f059f4d0ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:53.451160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39286b2-91f9-41ea-a9aa-c3f059f4d0ec service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:53.479611 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4124/8249] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:55.702025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa593335-b4ea-4935-aee6-b780762275e9 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:55.779820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa593335-b4ea-4935-aee6-b780762275e9 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:55.784947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:55.788641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:55.788946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:55.789236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] PATH_INFO: `/v3/users/7e739381d4a947b880f162d8ee3fa9db` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:55.790483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e739381d4a947b880f162d8ee3fa9db)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:55.792577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:55.851720 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:55.855289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e739381d4a947b880f162d8ee3fa9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:55.887608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e739381d4a947b880f162d8ee3fa9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:55.888792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e739381d4a947b880f162d8ee3fa9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:55.914187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e739381d4a947b880f162d8ee3fa9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:55.925522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e739381d4a947b880f162d8ee3fa9db'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:55.933865 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4126/8250] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:32:55 2022] DELETE /identity/v3/users/7e739381d4a947b880f162d8ee3fa9db => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:55.939015 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13308249-a748-4928-9577-324203da61fa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:55.940469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13308249-a748-4928-9577-324203da61fa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:55.941130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13308249-a748-4928-9577-324203da61fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:55.966039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-13308249-a748-4928-9577-324203da61fa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:55.967288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-13308249-a748-4928-9577-324203da61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:56.030499 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4125/8251] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:56.040854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:56.044070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:56.122661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac25fee-be44-41a4-a6ac-305be4d27f03 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:56.126746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94148190-17e5-482f-804a-50c98b801c6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:56.127428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94148190-17e5-482f-804a-50c98b801c6b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:56.127780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94148190-17e5-482f-804a-50c98b801c6b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:56.128126 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94148190-17e5-482f-804a-50c98b801c6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:56.139696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94148190-17e5-482f-804a-50c98b801c6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:56.141620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94148190-17e5-482f-804a-50c98b801c6b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:56.154837 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4127/8252] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:32:56.529510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13308249-a748-4928-9577-324203da61fa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:56.531810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-13308249-a748-4928-9577-324203da61fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:56.546294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13308249-a748-4928-9577-324203da61fa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:56.552167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:56.552904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:56.553531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:56.554009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] PATH_INFO: `/v3/projects/2b05e82866a04b1d9929d8272afea196` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:56.555332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b05e82866a04b1d9929d8272afea196)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:56.557603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:56.566337 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:56.618370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b05e82866a04b1d9929d8272afea196', 'request_id': 'req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.628274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b05e82866a04b1d9929d8272afea196', 'request_id': 'req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.637412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b05e82866a04b1d9929d8272afea196', 'request_id': 'req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.649050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] The token cache is being invalidate because project 2b05e82866a04b1d9929d8272afea196 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:32:56.649364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.650330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.652266 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4126/8253] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:32:56 2022] DELETE /identity/v3/projects/2b05e82866a04b1d9929d8272afea196 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:56.656794 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94148190-17e5-482f-804a-50c98b801c6b service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:56.669118 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94148190-17e5-482f-804a-50c98b801c6b service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:56.733066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:56.734053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:56.734354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:56.734629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] PATH_INFO: `/v3/users/90ff9ecca3844bbaa7485ed4ce2a37d9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:56.735893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ff9ecca3844bbaa7485ed4ce2a37d9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:56.737862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:56.802317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ff9ecca3844bbaa7485ed4ce2a37d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.818943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ff9ecca3844bbaa7485ed4ce2a37d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.819741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ff9ecca3844bbaa7485ed4ce2a37d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.821876 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:56.834751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ff9ecca3844bbaa7485ed4ce2a37d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.843706 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6bf6f4a7-7a9c-4afd-92d0-8e22085971a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ff9ecca3844bbaa7485ed4ce2a37d9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:56.851534 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4128/8254] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:32:56 2022] DELETE /identity/v3/users/90ff9ecca3844bbaa7485ed4ce2a37d9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:57.174106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:57.175687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:57.190393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ad3059-a3db-4bb7-a4e2-030c94b58c2f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:57.249682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:57.250240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.250519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.250792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] PATH_INFO: `/v3/projects/0f4c52feb2b44089911cad1b07f0e1ea` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.251899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f4c52feb2b44089911cad1b07f0e1ea)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:57.253872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:57.310531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f4c52feb2b44089911cad1b07f0e1ea', 'request_id': 'req-2e574ad6-2027-4aa1-a582-90a430946764'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:57.322797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f4c52feb2b44089911cad1b07f0e1ea', 'request_id': 'req-2e574ad6-2027-4aa1-a582-90a430946764'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:57.330735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f4c52feb2b44089911cad1b07f0e1ea', 'request_id': 'req-2e574ad6-2027-4aa1-a582-90a430946764'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:57.351599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] The token cache is being invalidate because project 0f4c52feb2b44089911cad1b07f0e1ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:32:57.351876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:57.352716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2e574ad6-2027-4aa1-a582-90a430946764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:57.354728 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4127/8255] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:32:57 2022] DELETE /identity/v3/projects/0f4c52feb2b44089911cad1b07f0e1ea => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:57.359919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b4dc3-b111-4944-8717-6742f69e4d13 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.360199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b4dc3-b111-4944-8717-6742f69e4d13 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.360471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419b4dc3-b111-4944-8717-6742f69e4d13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.381659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-419b4dc3-b111-4944-8717-6742f69e4d13 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:57.382787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-419b4dc3-b111-4944-8717-6742f69e4d13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:57.449344 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4129/8256] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:57.457434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903a10c-cbea-40db-93ab-c82d7d39afe5 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.457918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903a10c-cbea-40db-93ab-c82d7d39afe5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.458140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d903a10c-cbea-40db-93ab-c82d7d39afe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.478825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d903a10c-cbea-40db-93ab-c82d7d39afe5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:57.480046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d903a10c-cbea-40db-93ab-c82d7d39afe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:57.488217 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4128/8257] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:57.492583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b4dc3-b111-4944-8717-6742f69e4d13 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:57.502504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419b4dc3-b111-4944-8717-6742f69e4d13 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:57.507265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04c45f-b0a8-4f07-8332-337c4e708530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:57.507859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04c45f-b0a8-4f07-8332-337c4e708530 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.508141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04c45f-b0a8-4f07-8332-337c4e708530 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.508413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae04c45f-b0a8-4f07-8332-337c4e708530 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.509052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04c45f-b0a8-4f07-8332-337c4e708530 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:32:57.509379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04c45f-b0a8-4f07-8332-337c4e708530 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:57.510970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae04c45f-b0a8-4f07-8332-337c4e708530 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:57.523291 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4130/8258] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:32:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:32:57.527578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903a10c-cbea-40db-93ab-c82d7d39afe5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:57.537598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d903a10c-cbea-40db-93ab-c82d7d39afe5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:57.542301 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2ab50-176c-40ca-828d-794f00df38a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:57.542902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2ab50-176c-40ca-828d-794f00df38a0 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.543185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2ab50-176c-40ca-828d-794f00df38a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.543461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2ab50-176c-40ca-828d-794f00df38a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.544123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2ab50-176c-40ca-828d-794f00df38a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:57.546435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2ab50-176c-40ca-828d-794f00df38a0 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:57.563882 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:57.578773 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4129/8259] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:32:57 2022] POST /identity/v3/projects => generated 381 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:57.582991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04c45f-b0a8-4f07-8332-337c4e708530 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:57.593495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae04c45f-b0a8-4f07-8332-337c4e708530 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:57.656036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d25084-bf38-4387-b3e4-71843ca3d6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:57.656687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25084-bf38-4387-b3e4-71843ca3d6db admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.657015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25084-bf38-4387-b3e4-71843ca3d6db admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.657410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d25084-bf38-4387-b3e4-71843ca3d6db admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.658051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d25084-bf38-4387-b3e4-71843ca3d6db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:57.660198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d25084-bf38-4387-b3e4-71843ca3d6db admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:57.683027 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4131/8260] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:32:57 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:57.687762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2ab50-176c-40ca-828d-794f00df38a0 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:57.698754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2ab50-176c-40ca-828d-794f00df38a0 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:57.704169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca4d55-e0d1-4aa6-b708-cd9567436609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:57.704743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca4d55-e0d1-4aa6-b708-cd9567436609 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.705024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca4d55-e0d1-4aa6-b708-cd9567436609 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.705322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ca4d55-e0d1-4aa6-b708-cd9567436609 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.705968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca4d55-e0d1-4aa6-b708-cd9567436609 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:57.707571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ca4d55-e0d1-4aa6-b708-cd9567436609 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:57.718607 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4130/8261] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:57.722673 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d25084-bf38-4387-b3e4-71843ca3d6db admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:57.732932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d25084-bf38-4387-b3e4-71843ca3d6db admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:57.737909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c787e66-16b9-407c-a0c0-16be756971a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:57.738626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c787e66-16b9-407c-a0c0-16be756971a1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.738886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c787e66-16b9-407c-a0c0-16be756971a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.739165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c787e66-16b9-407c-a0c0-16be756971a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.739804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c787e66-16b9-407c-a0c0-16be756971a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:57.741454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c787e66-16b9-407c-a0c0-16be756971a1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:57.753352 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4132/8262] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:57.758196 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca4d55-e0d1-4aa6-b708-cd9567436609 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:57.769290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ca4d55-e0d1-4aa6-b708-cd9567436609 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:57.774132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c6d7d-7f4a-4762-9b5d-30dbf96abf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:57.774784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6d7d-7f4a-4762-9b5d-30dbf96abf3f admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.775067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6d7d-7f4a-4762-9b5d-30dbf96abf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.775343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423c6d7d-7f4a-4762-9b5d-30dbf96abf3f admin admin] PATH_INFO: `/v3/projects/0bda1804baba4cec8f8763f26d751f80/users/8508b431dc54465697722e7fe08075ca/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.791267 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c6d7d-7f4a-4762-9b5d-30dbf96abf3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bda1804baba4cec8f8763f26d751f80, user_id=8508b431dc54465697722e7fe08075ca, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:57.794276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423c6d7d-7f4a-4762-9b5d-30dbf96abf3f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:57.809634 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4131/8263] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:57 2022] PUT /identity/v3/projects/0bda1804baba4cec8f8763f26d751f80/users/8508b431dc54465697722e7fe08075ca/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:57.820374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c127c51-c111-4520-a76d-bd1a277049ae None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:57.821200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c127c51-c111-4520-a76d-bd1a277049ae None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:57.821200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c127c51-c111-4520-a76d-bd1a277049ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:57.849989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5c127c51-c111-4520-a76d-bd1a277049ae None None] MFA Rules not processed for user `8508b431dc54465697722e7fe08075ca`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:57.852298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5c127c51-c111-4520-a76d-bd1a277049ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:57.903194 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:57.931637 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4133/8264] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:57 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:57.944279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c6d7d-7f4a-4762-9b5d-30dbf96abf3f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:57.946073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-423c6d7d-7f4a-4762-9b5d-30dbf96abf3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:58.006486 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423c6d7d-7f4a-4762-9b5d-30dbf96abf3f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:58.010073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b710b-a5c0-4705-be1a-7d3fc6e51c17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:58.010706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b710b-a5c0-4705-be1a-7d3fc6e51c17 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:58.010988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b710b-a5c0-4705-be1a-7d3fc6e51c17 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:58.011262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b710b-a5c0-4705-be1a-7d3fc6e51c17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:58.020201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b710b-a5c0-4705-be1a-7d3fc6e51c17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:58.021669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500b710b-a5c0-4705-be1a-7d3fc6e51c17 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:58.030348 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4132/8265] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:57 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:58.050543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c127c51-c111-4520-a76d-bd1a277049ae None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:58.119096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c127c51-c111-4520-a76d-bd1a277049ae None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:58.126431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:58.127085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:58.127367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:58.127643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] PATH_INFO: `/v3/users/8508b431dc54465697722e7fe08075ca` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:58.128828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8508b431dc54465697722e7fe08075ca)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:58.131073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:58.183899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8508b431dc54465697722e7fe08075ca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.196769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8508b431dc54465697722e7fe08075ca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.197490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8508b431dc54465697722e7fe08075ca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.204990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8508b431dc54465697722e7fe08075ca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.212550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8508b431dc54465697722e7fe08075ca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.218679 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4134/8266] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:32:58 2022] DELETE /identity/v3/users/8508b431dc54465697722e7fe08075ca => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:58.223309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614cf38-b3b9-41d3-9279-4e1243779ad0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:58.223719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614cf38-b3b9-41d3-9279-4e1243779ad0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:58.224056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5614cf38-b3b9-41d3-9279-4e1243779ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:58.243809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5614cf38-b3b9-41d3-9279-4e1243779ad0 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:58.245091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5614cf38-b3b9-41d3-9279-4e1243779ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:58.305373 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4133/8267] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:58.315373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:58.317006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:58.383671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cc2b93-aea7-4dea-8b60-ceb409aa2743 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:58.387358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c5a97-5a7c-4c51-8584-133169871ef6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:58.388004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5a97-5a7c-4c51-8584-133169871ef6 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:58.388281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5a97-5a7c-4c51-8584-133169871ef6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:58.388665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c5a97-5a7c-4c51-8584-133169871ef6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:58.398744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c5a97-5a7c-4c51-8584-133169871ef6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:58.400209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c5a97-5a7c-4c51-8584-133169871ef6 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:58.406771 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:58.412575 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4135/8268] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:58.755600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614cf38-b3b9-41d3-9279-4e1243779ad0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:58.757992 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5614cf38-b3b9-41d3-9279-4e1243779ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:58.772453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5614cf38-b3b9-41d3-9279-4e1243779ad0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:58.777582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:58.778743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:58.779352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:58.779848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] PATH_INFO: `/v3/projects/0bda1804baba4cec8f8763f26d751f80` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:58.781799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bda1804baba4cec8f8763f26d751f80)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:58.784102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:58.833959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bda1804baba4cec8f8763f26d751f80', 'request_id': 'req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.841409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bda1804baba4cec8f8763f26d751f80', 'request_id': 'req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.844658 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:58.849539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bda1804baba4cec8f8763f26d751f80', 'request_id': 'req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.863018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] The token cache is being invalidate because project 0bda1804baba4cec8f8763f26d751f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:32:58.863316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.863982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4a88b3b9-bb15-4559-84e2-c57811e2a7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:32:58.865598 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4134/8269] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:32:58 2022] DELETE /identity/v3/projects/0bda1804baba4cec8f8763f26d751f80 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:58.870585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d3171-1e3f-42bc-814a-e66382912cf2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:58.871094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d3171-1e3f-42bc-814a-e66382912cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:58.871987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72d3171-1e3f-42bc-814a-e66382912cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:58.893698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d72d3171-1e3f-42bc-814a-e66382912cf2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:58.895279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d72d3171-1e3f-42bc-814a-e66382912cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:58.963542 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4136/8270] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:58.971693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af866fe3-5d94-4e70-8ae8-dd8558897ed7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:58.972034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af866fe3-5d94-4e70-8ae8-dd8558897ed7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:58.972317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af866fe3-5d94-4e70-8ae8-dd8558897ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:58.991889 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-af866fe3-5d94-4e70-8ae8-dd8558897ed7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:58.993096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-af866fe3-5d94-4e70-8ae8-dd8558897ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:59.001028 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4135/8271] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:59.005567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d3171-1e3f-42bc-814a-e66382912cf2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:59.016070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72d3171-1e3f-42bc-814a-e66382912cf2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:59.020661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f8b83-bb14-4cf4-aa8b-eeb61a58c4db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:59.021446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f8b83-bb14-4cf4-aa8b-eeb61a58c4db admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:59.024039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f8b83-bb14-4cf4-aa8b-eeb61a58c4db admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:59.024330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791f8b83-bb14-4cf4-aa8b-eeb61a58c4db admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:59.025030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f8b83-bb14-4cf4-aa8b-eeb61a58c4db admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:32:59.025364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f8b83-bb14-4cf4-aa8b-eeb61a58c4db admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:59.027008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791f8b83-bb14-4cf4-aa8b-eeb61a58c4db admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:59.039923 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4137/8272] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:32:59.044059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af866fe3-5d94-4e70-8ae8-dd8558897ed7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:59.053859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af866fe3-5d94-4e70-8ae8-dd8558897ed7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:59.058761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac278a40-96e7-4d8e-93aa-284108f0d47b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:59.059422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac278a40-96e7-4d8e-93aa-284108f0d47b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:59.059679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac278a40-96e7-4d8e-93aa-284108f0d47b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:59.059935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac278a40-96e7-4d8e-93aa-284108f0d47b admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:59.060632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac278a40-96e7-4d8e-93aa-284108f0d47b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:59.063070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac278a40-96e7-4d8e-93aa-284108f0d47b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:59.095166 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4136/8273] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:32:59 2022] POST /identity/v3/projects => generated 369 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:59.096535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f8b83-bb14-4cf4-aa8b-eeb61a58c4db admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:59.110355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791f8b83-bb14-4cf4-aa8b-eeb61a58c4db admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:59.172423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c01e6-e593-470e-9544-97ab60baab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:59.173029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c01e6-e593-470e-9544-97ab60baab30 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:59.173319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c01e6-e593-470e-9544-97ab60baab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:59.173612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c01e6-e593-470e-9544-97ab60baab30 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:59.174240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c01e6-e593-470e-9544-97ab60baab30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:59.176155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4c01e6-e593-470e-9544-97ab60baab30 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:59.198906 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4138/8274] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:32:59 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:32:59.203685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac278a40-96e7-4d8e-93aa-284108f0d47b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:59.214408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac278a40-96e7-4d8e-93aa-284108f0d47b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:59.219126 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a822e5f-3981-458d-bb89-6b0f50579285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:59.219732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a822e5f-3981-458d-bb89-6b0f50579285 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:59.220012 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a822e5f-3981-458d-bb89-6b0f50579285 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:59.220283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a822e5f-3981-458d-bb89-6b0f50579285 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:59.220954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a822e5f-3981-458d-bb89-6b0f50579285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:59.222604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a822e5f-3981-458d-bb89-6b0f50579285 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:59.233186 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4137/8275] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:59.237423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c01e6-e593-470e-9544-97ab60baab30 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:59.247377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c01e6-e593-470e-9544-97ab60baab30 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:59.252466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c1796a-4b68-4b90-891b-b226465062ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:59.253050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1796a-4b68-4b90-891b-b226465062ff admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:59.253353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1796a-4b68-4b90-891b-b226465062ff admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:59.253628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c1796a-4b68-4b90-891b-b226465062ff admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:59.254254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1796a-4b68-4b90-891b-b226465062ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:59.256085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c1796a-4b68-4b90-891b-b226465062ff admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:59.267385 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4139/8276] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:32:59.271705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a822e5f-3981-458d-bb89-6b0f50579285 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:59.281830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a822e5f-3981-458d-bb89-6b0f50579285 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:59.286408 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a579c1-b6e5-40a6-b6ff-47fa7bcc7ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:59.287077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a579c1-b6e5-40a6-b6ff-47fa7bcc7ff2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:59.287354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a579c1-b6e5-40a6-b6ff-47fa7bcc7ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:59.287655 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a579c1-b6e5-40a6-b6ff-47fa7bcc7ff2 admin admin] PATH_INFO: `/v3/projects/f150cc8e16184031894ee0ff01ba8fd7/users/a67ee3d388da46189643fad999dd135c/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:59.303454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a579c1-b6e5-40a6-b6ff-47fa7bcc7ff2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f150cc8e16184031894ee0ff01ba8fd7, user_id=a67ee3d388da46189643fad999dd135c, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:59.306775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a579c1-b6e5-40a6-b6ff-47fa7bcc7ff2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:59.321846 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4138/8277] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:32:59 2022] PUT /identity/v3/projects/f150cc8e16184031894ee0ff01ba8fd7/users/a67ee3d388da46189643fad999dd135c/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:32:59.327341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc82896-2d51-4b5c-a53d-52c9196d6d7e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:59.328243 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc82896-2d51-4b5c-a53d-52c9196d6d7e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:59.328560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc82896-2d51-4b5c-a53d-52c9196d6d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:59.347376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9fc82896-2d51-4b5c-a53d-52c9196d6d7e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:32:59.348490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9fc82896-2d51-4b5c-a53d-52c9196d6d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:59.410112 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4140/8278] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:32:59.419859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a579c1-b6e5-40a6-b6ff-47fa7bcc7ff2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:59.421752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e7a579c1-b6e5-40a6-b6ff-47fa7bcc7ff2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:59.486509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a579c1-b6e5-40a6-b6ff-47fa7bcc7ff2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:59.490468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b77a0e5-8c60-4748-94dd-1c5cc780c6e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:59.491077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77a0e5-8c60-4748-94dd-1c5cc780c6e6 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:59.491356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77a0e5-8c60-4748-94dd-1c5cc780c6e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:59.491628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b77a0e5-8c60-4748-94dd-1c5cc780c6e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:59.501933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77a0e5-8c60-4748-94dd-1c5cc780c6e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:59.503385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b77a0e5-8c60-4748-94dd-1c5cc780c6e6 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:59.513531 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4139/8279] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:32:59.732430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc82896-2d51-4b5c-a53d-52c9196d6d7e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:32:59.734744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9fc82896-2d51-4b5c-a53d-52c9196d6d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:59.747723 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:32:59.819858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc82896-2d51-4b5c-a53d-52c9196d6d7e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:32:59.826177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:32:59.826733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:32:59.827154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:32:59.827635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:32:59.829659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:32:59.905079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:32:59.907615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:32:59.957740 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4141/8280] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:32:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:33:00.249389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dad136-0805-4a7f-aa44-c6d73c905b6a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:00.249929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dad136-0805-4a7f-aa44-c6d73c905b6a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:00.250138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dad136-0805-4a7f-aa44-c6d73c905b6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:00.287263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-52dad136-0805-4a7f-aa44-c6d73c905b6a None None] MFA Rules not processed for user `a67ee3d388da46189643fad999dd135c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:33:00.288694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-52dad136-0805-4a7f-aa44-c6d73c905b6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:00.371935 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4140/8281] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:33:00 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:33:00.382723 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:00.384191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:00.398870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc58347-c7d5-4204-89df-0f8ced72405c service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:00.403037 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f8e3f-8bb5-4f8a-8ee8-8fed79a1f552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:00.403897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f8e3f-8bb5-4f8a-8ee8-8fed79a1f552 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:00.404164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f8e3f-8bb5-4f8a-8ee8-8fed79a1f552 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:00.404508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76f8e3f-8bb5-4f8a-8ee8-8fed79a1f552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:00.416848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f8e3f-8bb5-4f8a-8ee8-8fed79a1f552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:00.419134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76f8e3f-8bb5-4f8a-8ee8-8fed79a1f552 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:00.442956 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4142/8282] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:33:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:33:01.813398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8605c14-8dca-485d-bff3-7afadde074be None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:01.813979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8605c14-8dca-485d-bff3-7afadde074be None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:01.813979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8605c14-8dca-485d-bff3-7afadde074be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:01.834129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c8605c14-8dca-485d-bff3-7afadde074be None None] MFA Rules not processed for user `a67ee3d388da46189643fad999dd135c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:33:01.835425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8605c14-8dca-485d-bff3-7afadde074be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:01.842406 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4141/8283] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:33:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:33:04.363550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f8e3f-8bb5-4f8a-8ee8-8fed79a1f552 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:04.365248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e76f8e3f-8bb5-4f8a-8ee8-8fed79a1f552 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:04.381549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76f8e3f-8bb5-4f8a-8ee8-8fed79a1f552 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:04.385578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:04.386175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:04.386551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:04.386710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:04.388551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:04.414719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:04.417631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:04.432069 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4143/8284] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:33:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:33:08.726349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8605c14-8dca-485d-bff3-7afadde074be None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:08.740052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8605c14-8dca-485d-bff3-7afadde074be None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:08.743866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:08.744549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:08.744899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:08.745420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:08.747233 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:08.754216 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:08.821013 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:08.822493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:08.832905 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4142/8285] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:33:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:33:10.487287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:10.489088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:10.600376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961481b-5e2b-4797-a96f-c51c83679ce3 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:10.606155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef488af-2f6c-4a56-b38f-4fc30ec12a6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:10.606758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef488af-2f6c-4a56-b38f-4fc30ec12a6a service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:10.607086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef488af-2f6c-4a56-b38f-4fc30ec12a6a service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:10.607361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef488af-2f6c-4a56-b38f-4fc30ec12a6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:10.609094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4ef488af-2f6c-4a56-b38f-4fc30ec12a6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:10.624381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef488af-2f6c-4a56-b38f-4fc30ec12a6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:10.626788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef488af-2f6c-4a56-b38f-4fc30ec12a6a service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:10.648814 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4144/8286] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:33:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:33:12.102272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:12.104364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:12.139143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e5a9bd-6e95-46d3-b1bf-ac6485889336 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:12.145469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c115c-792e-42a0-9b1b-d22164cbd535 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:12.146515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c115c-792e-42a0-9b1b-d22164cbd535 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:12.147146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c115c-792e-42a0-9b1b-d22164cbd535 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:12.147678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3c115c-792e-42a0-9b1b-d22164cbd535 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:12.149716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ad3c115c-792e-42a0-9b1b-d22164cbd535 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:12.166728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c115c-792e-42a0-9b1b-d22164cbd535 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:12.168872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3c115c-792e-42a0-9b1b-d22164cbd535 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:12.193762 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4143/8287] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:33:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:33:17.762849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9852e-34cf-4789-a632-f6901b92fd33 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:17.763442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9852e-34cf-4789-a632-f6901b92fd33 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:17.763442 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9852e-34cf-4789-a632-f6901b92fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:17.785192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8fd9852e-34cf-4789-a632-f6901b92fd33 None None] MFA Rules not processed for user `a67ee3d388da46189643fad999dd135c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:33:17.786375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8fd9852e-34cf-4789-a632-f6901b92fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:17.793827 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4145/8288] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:33:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:33:18.074104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c115c-792e-42a0-9b1b-d22164cbd535 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:18.086748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3c115c-792e-42a0-9b1b-d22164cbd535 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:18.090894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:18.091715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:18.092022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:18.093005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:18.095055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:18.109801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:18.111516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:18.124272 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4144/8289] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:33:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:33:27.779191 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:28.116722 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=38 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:33.723809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654031f-ca13-4856-aedc-69e6a01fa2bd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:33.724334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654031f-ca13-4856-aedc-69e6a01fa2bd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:33.724446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9654031f-ca13-4856-aedc-69e6a01fa2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:33.791694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9654031f-ca13-4856-aedc-69e6a01fa2bd None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:33:33.793108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9654031f-ca13-4856-aedc-69e6a01fa2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:33.862626 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4146/8290] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:33:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:33:33.911868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:33.913497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:34.004293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e842bf2-b373-4723-9caa-af133d6be5a1 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:34.010022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb96fc-fc04-429d-946b-3d3b76a7e754 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:34.010686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb96fc-fc04-429d-946b-3d3b76a7e754 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:34.011102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb96fc-fc04-429d-946b-3d3b76a7e754 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:34.011311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdb96fc-fc04-429d-946b-3d3b76a7e754 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:34.020527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb96fc-fc04-429d-946b-3d3b76a7e754 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:34.022260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdb96fc-fc04-429d-946b-3d3b76a7e754 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:34.031293 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4145/8291] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:33:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:33:43.859773 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=44 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:44.027432 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=37 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:53.932527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4860-a366-4d17-8814-479f7d46e99f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:53.933098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4860-a366-4d17-8814-479f7d46e99f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:53.933186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd4860-a366-4d17-8814-479f7d46e99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:53.955141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b2fd4860-a366-4d17-8814-479f7d46e99f None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:33:53.956372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b2fd4860-a366-4d17-8814-479f7d46e99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:53.963899 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4147/8292] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:33:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:33:53.977158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb96fc-fc04-429d-946b-3d3b76a7e754 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:53.991502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdb96fc-fc04-429d-946b-3d3b76a7e754 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:53.998388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613b86b-874e-4c0a-ac6b-0c7013ca1655 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:53.999059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b86b-874e-4c0a-ac6b-0c7013ca1655 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:53.999336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b86b-874e-4c0a-ac6b-0c7013ca1655 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:53.999605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7613b86b-874e-4c0a-ac6b-0c7013ca1655 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:54.008959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613b86b-874e-4c0a-ac6b-0c7013ca1655 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:54.010762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7613b86b-874e-4c0a-ac6b-0c7013ca1655 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:54.020215 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4146/8293] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:33:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:33:57.228844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4860-a366-4d17-8814-479f7d46e99f None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:57.258153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd4860-a366-4d17-8814-479f7d46e99f None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:57.272179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:57.273254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:57.273691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:57.274558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] PATH_INFO: `/v3/users/a67ee3d388da46189643fad999dd135c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:57.276389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a67ee3d388da46189643fad999dd135c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:57.280952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:57.357500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a67ee3d388da46189643fad999dd135c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.376647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a67ee3d388da46189643fad999dd135c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.377821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a67ee3d388da46189643fad999dd135c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.388841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a67ee3d388da46189643fad999dd135c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.398541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ad499639-b353-4d9b-8582-3fa023037763 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a67ee3d388da46189643fad999dd135c'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.406677 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4148/8294] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:33:57 2022] DELETE /identity/v3/users/a67ee3d388da46189643fad999dd135c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:33:57.655480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613b86b-874e-4c0a-ac6b-0c7013ca1655 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:57.672592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7613b86b-874e-4c0a-ac6b-0c7013ca1655 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:57.746384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:57.748868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:57.750601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:57.751161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] PATH_INFO: `/v3/projects/f150cc8e16184031894ee0ff01ba8fd7` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:57.752729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f150cc8e16184031894ee0ff01ba8fd7)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:57.754972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:57.838182 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f150cc8e16184031894ee0ff01ba8fd7', 'request_id': 'req-e26c3ad9-10ed-4756-9e00-f262df99b83f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.852975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f150cc8e16184031894ee0ff01ba8fd7', 'request_id': 'req-e26c3ad9-10ed-4756-9e00-f262df99b83f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.861564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f150cc8e16184031894ee0ff01ba8fd7', 'request_id': 'req-e26c3ad9-10ed-4756-9e00-f262df99b83f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.873416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] The token cache is being invalidate because project f150cc8e16184031894ee0ff01ba8fd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:33:57.873919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.874716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-e26c3ad9-10ed-4756-9e00-f262df99b83f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:33:57.876695 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4147/8295] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:33:57 2022] DELETE /identity/v3/projects/f150cc8e16184031894ee0ff01ba8fd7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:33:57.881660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba48ec-be91-4494-acc4-d120e9ff8147 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:57.882171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba48ec-be91-4494-acc4-d120e9ff8147 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:57.882646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ba48ec-be91-4494-acc4-d120e9ff8147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:57.914400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-95ba48ec-be91-4494-acc4-d120e9ff8147 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:33:57.916462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-95ba48ec-be91-4494-acc4-d120e9ff8147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:58.000283 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4149/8296] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:33:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:33:58.008583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b94c2-11ee-4c17-a97d-f6dd953d1c77 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:58.008878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b94c2-11ee-4c17-a97d-f6dd953d1c77 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:58.009160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5b94c2-11ee-4c17-a97d-f6dd953d1c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:58.037734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-fd5b94c2-11ee-4c17-a97d-f6dd953d1c77 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:33:58.039202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fd5b94c2-11ee-4c17-a97d-f6dd953d1c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:58.050053 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4148/8297] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:33:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:33:58.053975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba48ec-be91-4494-acc4-d120e9ff8147 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:58.067287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ba48ec-be91-4494-acc4-d120e9ff8147 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:58.073703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db79f-8f1e-4d09-9fa6-57c1ada58ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:58.075236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db79f-8f1e-4d09-9fa6-57c1ada58ada admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:58.075585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db79f-8f1e-4d09-9fa6-57c1ada58ada admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:58.075961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93db79f-8f1e-4d09-9fa6-57c1ada58ada admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:58.077844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db79f-8f1e-4d09-9fa6-57c1ada58ada admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:33:58.078747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db79f-8f1e-4d09-9fa6-57c1ada58ada admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:58.080918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93db79f-8f1e-4d09-9fa6-57c1ada58ada admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:58.109954 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4150/8298] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:33:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:33:58.114558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b94c2-11ee-4c17-a97d-f6dd953d1c77 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:58.135150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5b94c2-11ee-4c17-a97d-f6dd953d1c77 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:58.142905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07ba5-4aad-4db8-89ca-7dff1afcd9a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:58.143533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07ba5-4aad-4db8-89ca-7dff1afcd9a5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:58.143821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07ba5-4aad-4db8-89ca-7dff1afcd9a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:58.144099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a07ba5-4aad-4db8-89ca-7dff1afcd9a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:58.144761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a07ba5-4aad-4db8-89ca-7dff1afcd9a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:58.146721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a07ba5-4aad-4db8-89ca-7dff1afcd9a5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:58.182438 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4149/8299] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:33:58 2022] POST /identity/v3/projects => generated 369 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:33:58.183729 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db79f-8f1e-4d09-9fa6-57c1ada58ada admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:58.195046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93db79f-8f1e-4d09-9fa6-57c1ada58ada admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:58.255769 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:58.268448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98e8c6-ee96-434e-9bba-17c4c1519891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:58.269115 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98e8c6-ee96-434e-9bba-17c4c1519891 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:58.269425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98e8c6-ee96-434e-9bba-17c4c1519891 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:58.270451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da98e8c6-ee96-434e-9bba-17c4c1519891 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:58.270451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98e8c6-ee96-434e-9bba-17c4c1519891 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:58.272284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da98e8c6-ee96-434e-9bba-17c4c1519891 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:58.297205 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4151/8300] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:33:58 2022] POST /identity/v3/users => generated 285 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:33:58.302006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07ba5-4aad-4db8-89ca-7dff1afcd9a5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:58.314783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a07ba5-4aad-4db8-89ca-7dff1afcd9a5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:58.319735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ace59-e570-4497-b2c3-7d7bce8e8b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:58.320433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ace59-e570-4497-b2c3-7d7bce8e8b9a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:58.320614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ace59-e570-4497-b2c3-7d7bce8e8b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:58.320867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625ace59-e570-4497-b2c3-7d7bce8e8b9a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:58.321547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ace59-e570-4497-b2c3-7d7bce8e8b9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:58.323135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625ace59-e570-4497-b2c3-7d7bce8e8b9a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:58.338404 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4150/8301] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:33:58.342877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98e8c6-ee96-434e-9bba-17c4c1519891 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:58.355355 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da98e8c6-ee96-434e-9bba-17c4c1519891 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:58.361005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bbb12-625f-47a8-a02c-e6bfd491ae75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:58.361626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bbb12-625f-47a8-a02c-e6bfd491ae75 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:58.361911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bbb12-625f-47a8-a02c-e6bfd491ae75 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:58.362189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bbb12-625f-47a8-a02c-e6bfd491ae75 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:58.362862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bbb12-625f-47a8-a02c-e6bfd491ae75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:58.364512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bbb12-625f-47a8-a02c-e6bfd491ae75 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:58.379504 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4152/8302] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:33:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:33:58.383701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ace59-e570-4497-b2c3-7d7bce8e8b9a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:58.395100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625ace59-e570-4497-b2c3-7d7bce8e8b9a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:58.400977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa8617-14e4-4d59-9da6-1a6a04e7a03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:58.401968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa8617-14e4-4d59-9da6-1a6a04e7a03e admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:58.402335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa8617-14e4-4d59-9da6-1a6a04e7a03e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:58.402626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54aa8617-14e4-4d59-9da6-1a6a04e7a03e admin admin] PATH_INFO: `/v3/projects/0874c5dcb092416a894e5e9200eb8e12/users/f4460b32169b4fe382bb6df46db2be4d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:58.423954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa8617-14e4-4d59-9da6-1a6a04e7a03e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0874c5dcb092416a894e5e9200eb8e12, user_id=f4460b32169b4fe382bb6df46db2be4d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:58.426694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54aa8617-14e4-4d59-9da6-1a6a04e7a03e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:58.440748 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4151/8303] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:33:58 2022] PUT /identity/v3/projects/0874c5dcb092416a894e5e9200eb8e12/users/f4460b32169b4fe382bb6df46db2be4d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:33:58.451131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80b1c-9f8d-4809-9500-e72a6c57e6bc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:58.451493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80b1c-9f8d-4809-9500-e72a6c57e6bc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:58.451776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c80b1c-9f8d-4809-9500-e72a6c57e6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:58.489380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d2c80b1c-9f8d-4809-9500-e72a6c57e6bc None None] MFA Rules not processed for user `f4460b32169b4fe382bb6df46db2be4d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:33:58.491038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2c80b1c-9f8d-4809-9500-e72a6c57e6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:58.624679 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4153/8304] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:33:58 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:33:58.635282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa8617-14e4-4d59-9da6-1a6a04e7a03e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:33:58.642354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-54aa8617-14e4-4d59-9da6-1a6a04e7a03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:33:58.670421 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:33:58.747113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54aa8617-14e4-4d59-9da6-1a6a04e7a03e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:33:58.754582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc679f02-56a2-4d9d-867c-bb322cd98b74 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:33:58.755912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc679f02-56a2-4d9d-867c-bb322cd98b74 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:33:58.756403 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc679f02-56a2-4d9d-867c-bb322cd98b74 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:33:58.756860 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc679f02-56a2-4d9d-867c-bb322cd98b74 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:33:58.770867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc679f02-56a2-4d9d-867c-bb322cd98b74 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:33:58.772636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc679f02-56a2-4d9d-867c-bb322cd98b74 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:33:58.813778 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4152/8305] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:33:58 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:34:03.361234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80b1c-9f8d-4809-9500-e72a6c57e6bc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:03.363395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2c80b1c-9f8d-4809-9500-e72a6c57e6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:03.493411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c80b1c-9f8d-4809-9500-e72a6c57e6bc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:03.501438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f0459-37b1-4fbb-ac7e-971b0917ffe1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:03.503303 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f0459-37b1-4fbb-ac7e-971b0917ffe1 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:03.503758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f0459-37b1-4fbb-ac7e-971b0917ffe1 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:03.504176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665f0459-37b1-4fbb-ac7e-971b0917ffe1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:03.506954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-665f0459-37b1-4fbb-ac7e-971b0917ffe1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:03.617495 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f0459-37b1-4fbb-ac7e-971b0917ffe1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:03.619346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665f0459-37b1-4fbb-ac7e-971b0917ffe1 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:03.629778 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4154/8306] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:34:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 657 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:34:08.800581 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=20 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:10.713635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc679f02-56a2-4d9d-867c-bb322cd98b74 service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:10.715856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fc679f02-56a2-4d9d-867c-bb322cd98b74 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:10.806887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc679f02-56a2-4d9d-867c-bb322cd98b74 service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:10.813418 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:10.814071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:10.814361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:10.814642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] PATH_INFO: `/v3/users/1731f53174b745b19f6b8529f8681311` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:10.816295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1731f53174b745b19f6b8529f8681311)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:10.818320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:10.879692 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1731f53174b745b19f6b8529f8681311'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:10.897258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1731f53174b745b19f6b8529f8681311'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:10.898059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1731f53174b745b19f6b8529f8681311'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:10.910260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1731f53174b745b19f6b8529f8681311'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:10.922565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1731f53174b745b19f6b8529f8681311'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:10.930374 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4153/8307] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:34:10 2022] DELETE /identity/v3/users/1731f53174b745b19f6b8529f8681311 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:11.127209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f0459-37b1-4fbb-ac7e-971b0917ffe1 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:11.133605 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:11.148667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665f0459-37b1-4fbb-ac7e-971b0917ffe1 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:11.238125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:11.238877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:11.239165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:11.239443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] PATH_INFO: `/v3/projects/3914ae4ecd694d7ead85824e88749b39` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:11.240628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3914ae4ecd694d7ead85824e88749b39)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:11.242583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:11.321399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3914ae4ecd694d7ead85824e88749b39', 'request_id': 'req-86d21880-ac87-4826-abe7-c143fb91ded7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.328335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3914ae4ecd694d7ead85824e88749b39', 'request_id': 'req-86d21880-ac87-4826-abe7-c143fb91ded7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.339438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3914ae4ecd694d7ead85824e88749b39', 'request_id': 'req-86d21880-ac87-4826-abe7-c143fb91ded7'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.353896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] The token cache is being invalidate because project 3914ae4ecd694d7ead85824e88749b39 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:34:11.354191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.357373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.359644 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4155/8308] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:34:11 2022] DELETE /identity/v3/projects/3914ae4ecd694d7ead85824e88749b39 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:11.363527 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:11.364935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:11.379076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76004d-e028-40c0-a7c3-5f3259a2134e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:11.442044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:11.442680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:11.442960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:11.443231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] PATH_INFO: `/v3/users/9606a3fba4e04f30a37fbb060888d20e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:11.444367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9606a3fba4e04f30a37fbb060888d20e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:11.446325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:11.472692 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:11.501756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9606a3fba4e04f30a37fbb060888d20e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.516440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9606a3fba4e04f30a37fbb060888d20e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.517398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9606a3fba4e04f30a37fbb060888d20e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.527258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9606a3fba4e04f30a37fbb060888d20e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.535932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3f0283ff-5023-45f3-b044-75b750e1b749 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9606a3fba4e04f30a37fbb060888d20e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.543258 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4154/8309] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:34:11 2022] DELETE /identity/v3/users/9606a3fba4e04f30a37fbb060888d20e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:11.738998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:11.740539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:11.770837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d21880-ac87-4826-abe7-c143fb91ded7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:11.840947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:11.841681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:11.841960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:11.842228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] PATH_INFO: `/v3/projects/e37ea7e9b8fe4fcf843d8f2c0645db0b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:11.843615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37ea7e9b8fe4fcf843d8f2c0645db0b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:11.845640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:11.895480 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:11.909688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37ea7e9b8fe4fcf843d8f2c0645db0b', 'request_id': 'req-65e44eb0-42eb-47da-be38-61fbd1b1309e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.918496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37ea7e9b8fe4fcf843d8f2c0645db0b', 'request_id': 'req-65e44eb0-42eb-47da-be38-61fbd1b1309e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.927102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37ea7e9b8fe4fcf843d8f2c0645db0b', 'request_id': 'req-65e44eb0-42eb-47da-be38-61fbd1b1309e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.940532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] The token cache is being invalidate because project e37ea7e9b8fe4fcf843d8f2c0645db0b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:34:11.940895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.941709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-65e44eb0-42eb-47da-be38-61fbd1b1309e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:11.943759 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4156/8310] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:34:11 2022] DELETE /identity/v3/projects/e37ea7e9b8fe4fcf843d8f2c0645db0b => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:11.949260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d494f30-1c5a-4307-b1cb-286b7412ac21 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:11.949858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d494f30-1c5a-4307-b1cb-286b7412ac21 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:11.950825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d494f30-1c5a-4307-b1cb-286b7412ac21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:11.990424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1d494f30-1c5a-4307-b1cb-286b7412ac21 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:11.992956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d494f30-1c5a-4307-b1cb-286b7412ac21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:12.073354 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4155/8311] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:12.081595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caca372-6c9c-49e0-8ce8-35cea6796fbb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:12.081893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caca372-6c9c-49e0-8ce8-35cea6796fbb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:12.082163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caca372-6c9c-49e0-8ce8-35cea6796fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:12.103685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7caca372-6c9c-49e0-8ce8-35cea6796fbb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:12.105165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7caca372-6c9c-49e0-8ce8-35cea6796fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:12.116500 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4157/8312] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:12.118390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d494f30-1c5a-4307-b1cb-286b7412ac21 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:12.132078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d494f30-1c5a-4307-b1cb-286b7412ac21 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:12.138089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6e6dd-c118-49c8-826d-28b0685c4567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:12.138770 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e6dd-c118-49c8-826d-28b0685c4567 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:12.139058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e6dd-c118-49c8-826d-28b0685c4567 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:12.139339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd6e6dd-c118-49c8-826d-28b0685c4567 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:12.140066 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6e6dd-c118-49c8-826d-28b0685c4567 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:34:12.140375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6e6dd-c118-49c8-826d-28b0685c4567 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:12.149241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd6e6dd-c118-49c8-826d-28b0685c4567 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:12.160915 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4156/8313] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:34:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:34:12.164768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caca372-6c9c-49e0-8ce8-35cea6796fbb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:12.175586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caca372-6c9c-49e0-8ce8-35cea6796fbb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:12.181508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f9ce-26e0-4774-9222-a8d2c66d4fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:12.182250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f9ce-26e0-4774-9222-a8d2c66d4fa6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:12.182851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f9ce-26e0-4774-9222-a8d2c66d4fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:12.182851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68f9ce-26e0-4774-9222-a8d2c66d4fa6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:12.183642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68f9ce-26e0-4774-9222-a8d2c66d4fa6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:12.186274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68f9ce-26e0-4774-9222-a8d2c66d4fa6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:12.225647 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4158/8314] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:34:12 2022] POST /identity/v3/projects => generated 379 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:12.229445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6e6dd-c118-49c8-826d-28b0685c4567 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:12.242535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd6e6dd-c118-49c8-826d-28b0685c4567 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:12.318278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c1b9e-a648-4fe7-adda-3e17b9155bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:12.319831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c1b9e-a648-4fe7-adda-3e17b9155bbc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:12.320113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c1b9e-a648-4fe7-adda-3e17b9155bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:12.320386 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729c1b9e-a648-4fe7-adda-3e17b9155bbc admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:12.321033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c1b9e-a648-4fe7-adda-3e17b9155bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:12.334563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729c1b9e-a648-4fe7-adda-3e17b9155bbc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:12.382691 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4157/8315] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:34:12 2022] POST /identity/v3/users => generated 290 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:12.387148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f9ce-26e0-4774-9222-a8d2c66d4fa6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:12.410807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68f9ce-26e0-4774-9222-a8d2c66d4fa6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:12.416006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcdc66-ac36-42ba-a219-015d22164d2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:12.416780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcdc66-ac36-42ba-a219-015d22164d2b admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:12.417703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcdc66-ac36-42ba-a219-015d22164d2b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:12.418153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afcdc66-ac36-42ba-a219-015d22164d2b admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:12.418940 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcdc66-ac36-42ba-a219-015d22164d2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:12.421224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afcdc66-ac36-42ba-a219-015d22164d2b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:12.432231 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4159/8316] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:34:12.436279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c1b9e-a648-4fe7-adda-3e17b9155bbc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:12.448832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729c1b9e-a648-4fe7-adda-3e17b9155bbc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:12.455162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b92892d-36ab-4a93-b2d4-8f671a522ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:12.455899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92892d-36ab-4a93-b2d4-8f671a522ece admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:12.456254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92892d-36ab-4a93-b2d4-8f671a522ece admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:12.456801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b92892d-36ab-4a93-b2d4-8f671a522ece admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:12.457491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92892d-36ab-4a93-b2d4-8f671a522ece admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:12.459625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b92892d-36ab-4a93-b2d4-8f671a522ece admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:12.478194 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4158/8317] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:34:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:34:12.479591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcdc66-ac36-42ba-a219-015d22164d2b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:12.493391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afcdc66-ac36-42ba-a219-015d22164d2b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:12.498956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762dcba-9b69-48dc-b59f-a1c09e5fa9a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:12.499619 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762dcba-9b69-48dc-b59f-a1c09e5fa9a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:12.499894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762dcba-9b69-48dc-b59f-a1c09e5fa9a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:12.500172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762dcba-9b69-48dc-b59f-a1c09e5fa9a9 admin admin] PATH_INFO: `/v3/projects/ec0e7acf72144b558f1ba2f863244f89/users/db0afba834c04bdc92565bf8e9a57ee9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:12.519480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762dcba-9b69-48dc-b59f-a1c09e5fa9a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec0e7acf72144b558f1ba2f863244f89, user_id=db0afba834c04bdc92565bf8e9a57ee9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:12.522423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9762dcba-9b69-48dc-b59f-a1c09e5fa9a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:12.553220 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4160/8318] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:34:12 2022] PUT /identity/v3/projects/ec0e7acf72144b558f1ba2f863244f89/users/db0afba834c04bdc92565bf8e9a57ee9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:34:12.558425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110963b5-d149-4fc5-88b4-68197b1d0fb4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:12.558715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110963b5-d149-4fc5-88b4-68197b1d0fb4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:12.558993 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110963b5-d149-4fc5-88b4-68197b1d0fb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:12.569003 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:12.587026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-110963b5-d149-4fc5-88b4-68197b1d0fb4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:12.588943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-110963b5-d149-4fc5-88b4-68197b1d0fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:12.656651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4159/8319] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:12.668080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762dcba-9b69-48dc-b59f-a1c09e5fa9a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:12.670132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9762dcba-9b69-48dc-b59f-a1c09e5fa9a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:12.748516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762dcba-9b69-48dc-b59f-a1c09e5fa9a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:12.754506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5577bc0a-28ba-4bea-8a53-3ca81dab8c8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:12.755123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577bc0a-28ba-4bea-8a53-3ca81dab8c8e service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:12.755400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577bc0a-28ba-4bea-8a53-3ca81dab8c8e service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:12.756702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5577bc0a-28ba-4bea-8a53-3ca81dab8c8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:12.767749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577bc0a-28ba-4bea-8a53-3ca81dab8c8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:12.769351 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5577bc0a-28ba-4bea-8a53-3ca81dab8c8e service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:12.780669 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4161/8320] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:34:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:34:15.458122 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110963b5-d149-4fc5-88b4-68197b1d0fb4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:15.459584 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-110963b5-d149-4fc5-88b4-68197b1d0fb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:15.484519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110963b5-d149-4fc5-88b4-68197b1d0fb4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:15.505844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:15.509842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:15.511495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:15.514027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] PATH_INFO: `/v3/users/88764310cfd74578976cca63fd41458f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:15.518612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=88764310cfd74578976cca63fd41458f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:15.521222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:15.643460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88764310cfd74578976cca63fd41458f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:15.686629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88764310cfd74578976cca63fd41458f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:15.689768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88764310cfd74578976cca63fd41458f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:15.701843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88764310cfd74578976cca63fd41458f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:15.714089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88764310cfd74578976cca63fd41458f'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:15.740937 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4160/8321] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:34:15 2022] DELETE /identity/v3/users/88764310cfd74578976cca63fd41458f => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:15.745767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1fa16-07db-4922-97d9-16388319963e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:15.746621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1fa16-07db-4922-97d9-16388319963e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:15.747170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1fa16-07db-4922-97d9-16388319963e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:15.814528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6ad1fa16-07db-4922-97d9-16388319963e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:15.815908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6ad1fa16-07db-4922-97d9-16388319963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:15.951660 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4162/8322] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:15.961416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:15.962995 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:16.127402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4ef4e5-89bc-45fd-b83d-7cfd06d77f7a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:16.152984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e036c67b-2ba7-4477-827c-e804bc91935e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:16.153844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036c67b-2ba7-4477-827c-e804bc91935e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:16.154924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036c67b-2ba7-4477-827c-e804bc91935e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:16.155332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e036c67b-2ba7-4477-827c-e804bc91935e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:16.168801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036c67b-2ba7-4477-827c-e804bc91935e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:16.173998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e036c67b-2ba7-4477-827c-e804bc91935e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:16.195374 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4161/8323] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:34:16.790570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1fa16-07db-4922-97d9-16388319963e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:16.791999 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6ad1fa16-07db-4922-97d9-16388319963e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:16.800521 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:16.812033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1fa16-07db-4922-97d9-16388319963e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:16.838029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:16.838703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:16.838986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:16.839258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] PATH_INFO: `/v3/projects/da1a94dd119e49ce96801f1a73cfe31d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:16.840475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1a94dd119e49ce96801f1a73cfe31d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:16.842585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:16.952448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1a94dd119e49ce96801f1a73cfe31d', 'request_id': 'req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:16.962937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1a94dd119e49ce96801f1a73cfe31d', 'request_id': 'req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:16.973104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1a94dd119e49ce96801f1a73cfe31d', 'request_id': 'req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:16.991602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] The token cache is being invalidate because project da1a94dd119e49ce96801f1a73cfe31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:34:16.992413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:16.993260 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-48cc04e5-3ca8-4c7d-828b-09f77ea7c42a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:17.000097 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4163/8324] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:34:16 2022] DELETE /identity/v3/projects/da1a94dd119e49ce96801f1a73cfe31d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:34:17.001752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51a9e-ca61-4339-a494-61676d281def None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:17.002225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51a9e-ca61-4339-a494-61676d281def None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:17.002345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf51a9e-ca61-4339-a494-61676d281def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:17.042498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-dcf51a9e-ca61-4339-a494-61676d281def None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:17.043745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-dcf51a9e-ca61-4339-a494-61676d281def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:17.066852 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:17.151605 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4162/8325] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:17.161514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6fba1-269a-4c5a-8eab-632ac11a6877 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:17.161514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6fba1-269a-4c5a-8eab-632ac11a6877 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:17.161680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6fba1-269a-4c5a-8eab-632ac11a6877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:17.184674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-09a6fba1-269a-4c5a-8eab-632ac11a6877 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:17.185602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-09a6fba1-269a-4c5a-8eab-632ac11a6877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:17.201179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51a9e-ca61-4339-a494-61676d281def None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:17.201739 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4164/8326] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:17.221744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf51a9e-ca61-4339-a494-61676d281def None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:17.230963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c06d3d-4474-4abe-a567-2ec7d7d165e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:17.231635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c06d3d-4474-4abe-a567-2ec7d7d165e2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:17.231916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c06d3d-4474-4abe-a567-2ec7d7d165e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:17.232217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c06d3d-4474-4abe-a567-2ec7d7d165e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:17.233104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c06d3d-4474-4abe-a567-2ec7d7d165e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:34:17.233488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c06d3d-4474-4abe-a567-2ec7d7d165e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:17.235110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c06d3d-4474-4abe-a567-2ec7d7d165e2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:17.252168 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4163/8327] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:34:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:34:17.258593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6fba1-269a-4c5a-8eab-632ac11a6877 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:17.278877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6fba1-269a-4c5a-8eab-632ac11a6877 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:17.283872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b77e29-4b8e-45eb-ae70-2943e42f6ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:17.284493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b77e29-4b8e-45eb-ae70-2943e42f6ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:17.284777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b77e29-4b8e-45eb-ae70-2943e42f6ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:17.285053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b77e29-4b8e-45eb-ae70-2943e42f6ca8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:17.285768 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b77e29-4b8e-45eb-ae70-2943e42f6ca8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:17.289163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b77e29-4b8e-45eb-ae70-2943e42f6ca8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:17.325912 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4165/8328] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:34:17 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:17.330878 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c06d3d-4474-4abe-a567-2ec7d7d165e2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:17.357454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c06d3d-4474-4abe-a567-2ec7d7d165e2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:17.460295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee072fb4-0139-4068-bfa1-4dc714e21dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:17.461353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee072fb4-0139-4068-bfa1-4dc714e21dca admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:17.461842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee072fb4-0139-4068-bfa1-4dc714e21dca admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:17.462459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee072fb4-0139-4068-bfa1-4dc714e21dca admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:17.463416 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee072fb4-0139-4068-bfa1-4dc714e21dca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:17.466157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee072fb4-0139-4068-bfa1-4dc714e21dca admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:17.520648 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4164/8329] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:34:17 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:17.524509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b77e29-4b8e-45eb-ae70-2943e42f6ca8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:17.539207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b77e29-4b8e-45eb-ae70-2943e42f6ca8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:17.548935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e45e5-3abe-44a4-a77c-2c941f3c4483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:17.549804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e45e5-3abe-44a4-a77c-2c941f3c4483 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:17.551093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e45e5-3abe-44a4-a77c-2c941f3c4483 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:17.552107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4e45e5-3abe-44a4-a77c-2c941f3c4483 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:17.553011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e45e5-3abe-44a4-a77c-2c941f3c4483 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:17.556025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4e45e5-3abe-44a4-a77c-2c941f3c4483 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:17.574738 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4166/8330] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:34:17.576606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee072fb4-0139-4068-bfa1-4dc714e21dca admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:17.587235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee072fb4-0139-4068-bfa1-4dc714e21dca admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:17.593405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b8eaed-7dde-464d-b0df-fb799db44d53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:17.594370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8eaed-7dde-464d-b0df-fb799db44d53 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:17.594370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8eaed-7dde-464d-b0df-fb799db44d53 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:17.594663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b8eaed-7dde-464d-b0df-fb799db44d53 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:17.596078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8eaed-7dde-464d-b0df-fb799db44d53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:17.597594 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b8eaed-7dde-464d-b0df-fb799db44d53 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:17.613354 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4165/8331] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:34:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:34:17.616138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e45e5-3abe-44a4-a77c-2c941f3c4483 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:17.626581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4e45e5-3abe-44a4-a77c-2c941f3c4483 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:17.633693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a44ac-ac93-4409-bbb9-7e7b10d7c35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:17.634335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a44ac-ac93-4409-bbb9-7e7b10d7c35e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:17.634615 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a44ac-ac93-4409-bbb9-7e7b10d7c35e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:17.634914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9a44ac-ac93-4409-bbb9-7e7b10d7c35e admin admin] PATH_INFO: `/v3/projects/8334619765fd4036b64157de12307805/users/9cbc4b6effc94a019bd503dd19b8fcf9/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:17.666912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a44ac-ac93-4409-bbb9-7e7b10d7c35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8334619765fd4036b64157de12307805, user_id=9cbc4b6effc94a019bd503dd19b8fcf9, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:17.669665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9a44ac-ac93-4409-bbb9-7e7b10d7c35e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:17.708997 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4167/8332] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:34:17 2022] PUT /identity/v3/projects/8334619765fd4036b64157de12307805/users/9cbc4b6effc94a019bd503dd19b8fcf9/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:17.720168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3511aa-b893-408a-838f-d1a81b2d0ec7 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:17.720459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3511aa-b893-408a-838f-d1a81b2d0ec7 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:17.720744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3511aa-b893-408a-838f-d1a81b2d0ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:17.769845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-ea3511aa-b893-408a-838f-d1a81b2d0ec7 None None] MFA Rules not processed for user `9cbc4b6effc94a019bd503dd19b8fcf9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:17.773216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ea3511aa-b893-408a-838f-d1a81b2d0ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:17.934728 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4166/8333] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:17.936587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a44ac-ac93-4409-bbb9-7e7b10d7c35e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:18.087133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9a44ac-ac93-4409-bbb9-7e7b10d7c35e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:18.094015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23d961-9acd-4e14-82d0-e6d770d74789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:18.094882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23d961-9acd-4e14-82d0-e6d770d74789 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.095173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23d961-9acd-4e14-82d0-e6d770d74789 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.095453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23d961-9acd-4e14-82d0-e6d770d74789 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.096107 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23d961-9acd-4e14-82d0-e6d770d74789 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:18.098431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23d961-9acd-4e14-82d0-e6d770d74789 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:18.163562 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4168/8334] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:34:17 2022] POST /identity/v3/projects => generated 387 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:18.167392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3511aa-b893-408a-838f-d1a81b2d0ec7 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:18.183276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3511aa-b893-408a-838f-d1a81b2d0ec7 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:18.205132 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:18.294228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b03aa-ac84-43c4-985b-72be6c0b8be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:18.295396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b03aa-ac84-43c4-985b-72be6c0b8be8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.295686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b03aa-ac84-43c4-985b-72be6c0b8be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.295960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067b03aa-ac84-43c4-985b-72be6c0b8be8 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.296611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b03aa-ac84-43c4-985b-72be6c0b8be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:18.298968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067b03aa-ac84-43c4-985b-72be6c0b8be8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:18.325412 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4167/8335] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:34:18 2022] POST /identity/v3/users => generated 301 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:18.329552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23d961-9acd-4e14-82d0-e6d770d74789 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:18.341400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23d961-9acd-4e14-82d0-e6d770d74789 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:18.346764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb7e3ac-cf3e-4958-b9df-ffa36f85f485 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:18.347494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e3ac-cf3e-4958-b9df-ffa36f85f485 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.347778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e3ac-cf3e-4958-b9df-ffa36f85f485 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.348055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb7e3ac-cf3e-4958-b9df-ffa36f85f485 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.348704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7e3ac-cf3e-4958-b9df-ffa36f85f485 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:18.350486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb7e3ac-cf3e-4958-b9df-ffa36f85f485 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:18.352128 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:18.370470 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4169/8336] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:34:18.371623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b03aa-ac84-43c4-985b-72be6c0b8be8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:18.384022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08ce29-e458-4d41-ab00-2336061f1ee4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.385193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08ce29-e458-4d41-ab00-2336061f1ee4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.385193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c08ce29-e458-4d41-ab00-2336061f1ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.389516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067b03aa-ac84-43c4-985b-72be6c0b8be8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:18.402018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5388880f-af7b-4dad-8af9-21ba209d328b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:18.403035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388880f-af7b-4dad-8af9-21ba209d328b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.404287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388880f-af7b-4dad-8af9-21ba209d328b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.404808 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5388880f-af7b-4dad-8af9-21ba209d328b admin admin] PATH_INFO: `/v3/projects/d60eb081fe9749beaf0d621fdaebe271/users/0df1e000dbab49c89306c5b99f58e319/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.425187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3c08ce29-e458-4d41-ab00-2336061f1ee4 None None] MFA Rules not processed for user `db0afba834c04bdc92565bf8e9a57ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:18.426535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3c08ce29-e458-4d41-ab00-2336061f1ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:18.432846 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388880f-af7b-4dad-8af9-21ba209d328b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d60eb081fe9749beaf0d621fdaebe271, user_id=0df1e000dbab49c89306c5b99f58e319, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:18.436414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5388880f-af7b-4dad-8af9-21ba209d328b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:18.456956 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4168/8337] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:34:18 2022] PUT /identity/v3/projects/d60eb081fe9749beaf0d621fdaebe271/users/0df1e000dbab49c89306c5b99f58e319/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:18.469144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe135e-445b-42c1-b97f-2e0bd1b95dd9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.469358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe135e-445b-42c1-b97f-2e0bd1b95dd9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.469640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebe135e-445b-42c1-b97f-2e0bd1b95dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.501583 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-aebe135e-445b-42c1-b97f-2e0bd1b95dd9 None None] MFA Rules not processed for user `0df1e000dbab49c89306c5b99f58e319`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:18.503186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aebe135e-445b-42c1-b97f-2e0bd1b95dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:18.530069 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4170/8338] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:34:18.534024 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08ce29-e458-4d41-ab00-2336061f1ee4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:18.536467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3c08ce29-e458-4d41-ab00-2336061f1ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:18.567288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c08ce29-e458-4d41-ab00-2336061f1ee4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:18.607874 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4169/8339] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:18 2022] POST /identity/v3/auth/tokens => generated 3271 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:18.644338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2e94-6a36-46c8-90e1-42cddec0ebd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:18.645063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2e94-6a36-46c8-90e1-42cddec0ebd6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.645381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2e94-6a36-46c8-90e1-42cddec0ebd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.645663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbd2e94-6a36-46c8-90e1-42cddec0ebd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.646304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd2e94-6a36-46c8-90e1-42cddec0ebd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:18.649268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbd2e94-6a36-46c8-90e1-42cddec0ebd6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:18.652459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe135e-445b-42c1-b97f-2e0bd1b95dd9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:18.654528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-aebe135e-445b-42c1-b97f-2e0bd1b95dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:18.682460 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4171/8340] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:34:18 2022] POST /identity/v3/projects => generated 379 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:18.686873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2e94-6a36-46c8-90e1-42cddec0ebd6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:18.792339 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebe135e-445b-42c1-b97f-2e0bd1b95dd9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:18.802322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbd2e94-6a36-46c8-90e1-42cddec0ebd6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:18.805587 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:18.808756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fd06f-63cc-4a08-93d7-f84bdd052a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:18.809881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fd06f-63cc-4a08-93d7-f84bdd052a59 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.813050 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fd06f-63cc-4a08-93d7-f84bdd052a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.813359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8fd06f-63cc-4a08-93d7-f84bdd052a59 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.814143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fd06f-63cc-4a08-93d7-f84bdd052a59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:18.816522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8fd06f-63cc-4a08-93d7-f84bdd052a59 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:18.838302 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:18.851919 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4172/8341] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:34:18 2022] POST /identity/v3/users => generated 296 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:18.854692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fd06f-63cc-4a08-93d7-f84bdd052a59 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:18.866381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8fd06f-63cc-4a08-93d7-f84bdd052a59 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:18.880982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c67be-914e-4556-b2db-a1a227ee46e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:18.881935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c67be-914e-4556-b2db-a1a227ee46e5 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.882178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c67be-914e-4556-b2db-a1a227ee46e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.882452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2c67be-914e-4556-b2db-a1a227ee46e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.883101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c67be-914e-4556-b2db-a1a227ee46e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:18.884724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2c67be-914e-4556-b2db-a1a227ee46e5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:18.923464 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4173/8342] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:34:18 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:34:18.924416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c67be-914e-4556-b2db-a1a227ee46e5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:18.930783 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd992a-d30c-4cfd-b9aa-63681f0f1133 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:18.931450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd992a-d30c-4cfd-b9aa-63681f0f1133 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.931738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd992a-d30c-4cfd-b9aa-63681f0f1133 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.932023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bd992a-d30c-4cfd-b9aa-63681f0f1133 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.952598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2c67be-914e-4556-b2db-a1a227ee46e5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:18.952598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4102b8b-daf5-4957-b1cf-1a24e18017f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:18.952598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4102b8b-daf5-4957-b1cf-1a24e18017f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:18.952598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4102b8b-daf5-4957-b1cf-1a24e18017f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:18.953314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4102b8b-daf5-4957-b1cf-1a24e18017f3 admin admin] PATH_INFO: `/v3/projects/ec17e170fb8e46f3a4fd390b972485ce/users/51b2e08c29cb4414ba141da7bff0691a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:18.970716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4102b8b-daf5-4957-b1cf-1a24e18017f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec17e170fb8e46f3a4fd390b972485ce, user_id=51b2e08c29cb4414ba141da7bff0691a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:18.979339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4102b8b-daf5-4957-b1cf-1a24e18017f3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:18.998928 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4174/8343] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:34:18 2022] PUT /identity/v3/projects/ec17e170fb8e46f3a4fd390b972485ce/users/51b2e08c29cb4414ba141da7bff0691a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:19.002908 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4102b8b-daf5-4957-b1cf-1a24e18017f3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:19.019732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd992a-d30c-4cfd-b9aa-63681f0f1133 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:19.021683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bd992a-d30c-4cfd-b9aa-63681f0f1133 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:19.030609 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4170/8344] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:34:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 680 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:34:19.077573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4102b8b-daf5-4957-b1cf-1a24e18017f3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:19.083676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacc92c-f0c2-4596-9474-d9dafb91f2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:19.084371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacc92c-f0c2-4596-9474-d9dafb91f2fe admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:19.084728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacc92c-f0c2-4596-9474-d9dafb91f2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:19.085071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdacc92c-f0c2-4596-9474-d9dafb91f2fe admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:19.085809 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacc92c-f0c2-4596-9474-d9dafb91f2fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:19.087638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdacc92c-f0c2-4596-9474-d9dafb91f2fe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:19.113445 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4175/8345] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:34:19 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:34:19.118030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd992a-d30c-4cfd-b9aa-63681f0f1133 service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:19.129607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bd992a-d30c-4cfd-b9aa-63681f0f1133 service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:19.137149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060dd7bc-a2c7-4f84-b8a0-5f6946b8af78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:19.137149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dd7bc-a2c7-4f84-b8a0-5f6946b8af78 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:19.137149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dd7bc-a2c7-4f84-b8a0-5f6946b8af78 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:19.137149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060dd7bc-a2c7-4f84-b8a0-5f6946b8af78 admin admin] PATH_INFO: `/v3/projects/ec17e170fb8e46f3a4fd390b972485ce/users/51b2e08c29cb4414ba141da7bff0691a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:19.139472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dd7bc-a2c7-4f84-b8a0-5f6946b8af78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec17e170fb8e46f3a4fd390b972485ce, user_id=51b2e08c29cb4414ba141da7bff0691a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:19.143048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060dd7bc-a2c7-4f84-b8a0-5f6946b8af78 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:19.162300 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4171/8346] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:34:19 2022] PUT /identity/v3/projects/ec17e170fb8e46f3a4fd390b972485ce/users/51b2e08c29cb4414ba141da7bff0691a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:19.830094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacc92c-f0c2-4596-9474-d9dafb91f2fe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:19.843583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdacc92c-f0c2-4596-9474-d9dafb91f2fe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:19.949103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:19.954474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:19.955984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:19.956375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] PATH_INFO: `/v3/users/9cbc4b6effc94a019bd503dd19b8fcf9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:19.957896 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cbc4b6effc94a019bd503dd19b8fcf9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:19.960696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:20.036062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cbc4b6effc94a019bd503dd19b8fcf9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:20.066442 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:20.069357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cbc4b6effc94a019bd503dd19b8fcf9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:20.070390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cbc4b6effc94a019bd503dd19b8fcf9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:20.082765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cbc4b6effc94a019bd503dd19b8fcf9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:20.093072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cbc4b6effc94a019bd503dd19b8fcf9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:20.101514 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4176/8347] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:34:19 2022] DELETE /identity/v3/users/9cbc4b6effc94a019bd503dd19b8fcf9 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:20.105140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623854c8-600f-4120-846d-d83083d5b4ac None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:20.105656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623854c8-600f-4120-846d-d83083d5b4ac None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:20.105773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623854c8-600f-4120-846d-d83083d5b4ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:20.133283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-623854c8-600f-4120-846d-d83083d5b4ac None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:20.134775 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-623854c8-600f-4120-846d-d83083d5b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:20.257072 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4172/8348] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:20.266512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:20.267970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:20.350744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11592008-0fe2-4991-ad88-d445422562dc admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:20.361074 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b65aa-a55d-4427-9fcd-adfd45bd94a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:20.362965 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b65aa-a55d-4427-9fcd-adfd45bd94a4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:20.363701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b65aa-a55d-4427-9fcd-adfd45bd94a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:20.365047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18b65aa-a55d-4427-9fcd-adfd45bd94a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:20.383480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b65aa-a55d-4427-9fcd-adfd45bd94a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:20.386677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18b65aa-a55d-4427-9fcd-adfd45bd94a4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:20.411702 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4177/8349] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:34:20.860108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623854c8-600f-4120-846d-d83083d5b4ac None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:20.862308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-623854c8-600f-4120-846d-d83083d5b4ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:20.886791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623854c8-600f-4120-846d-d83083d5b4ac None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:20.898890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:20.900220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:20.900716 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:20.901204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] PATH_INFO: `/v3/projects/8334619765fd4036b64157de12307805` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:20.903321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] RBAC: Authorizing `identity:delete_project(project_id=8334619765fd4036b64157de12307805)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:20.906629 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:21.013660 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:21.032419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8334619765fd4036b64157de12307805', 'request_id': 'req-62e8d026-322e-4daa-8fc7-62c0c28743be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.055788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8334619765fd4036b64157de12307805', 'request_id': 'req-62e8d026-322e-4daa-8fc7-62c0c28743be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.070545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8334619765fd4036b64157de12307805', 'request_id': 'req-62e8d026-322e-4daa-8fc7-62c0c28743be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.089842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] The token cache is being invalidate because project 8334619765fd4036b64157de12307805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:34:21.090176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.090845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.093378 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4173/8350] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:34:20 2022] DELETE /identity/v3/projects/8334619765fd4036b64157de12307805 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:21.097287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b65aa-a55d-4427-9fcd-adfd45bd94a4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:21.113420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18b65aa-a55d-4427-9fcd-adfd45bd94a4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:21.266211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:21.267895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:21.268298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:21.268578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] PATH_INFO: `/v3/users/0df1e000dbab49c89306c5b99f58e319` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:21.270798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0df1e000dbab49c89306c5b99f58e319)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:21.273798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:21.472384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0df1e000dbab49c89306c5b99f58e319'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.544503 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0df1e000dbab49c89306c5b99f58e319'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.550989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0df1e000dbab49c89306c5b99f58e319'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.570188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0df1e000dbab49c89306c5b99f58e319'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.607486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-c8fee582-cb76-4fed-8ff0-e3303e93a2a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0df1e000dbab49c89306c5b99f58e319'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:21.635832 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4178/8351] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:34:21 2022] DELETE /identity/v3/users/0df1e000dbab49c89306c5b99f58e319 => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:22.251793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:22.253495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:22.278615 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8d026-322e-4daa-8fc7-62c0c28743be admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:22.400213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:22.401224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:22.401754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:22.406793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] PATH_INFO: `/v3/projects/d60eb081fe9749beaf0d621fdaebe271` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:22.410402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] RBAC: Authorizing `identity:delete_project(project_id=d60eb081fe9749beaf0d621fdaebe271)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:22.416193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:22.526612 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd60eb081fe9749beaf0d621fdaebe271', 'request_id': 'req-3a51be5f-701d-4e69-9e42-0ccf18128fff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:22.544643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd60eb081fe9749beaf0d621fdaebe271', 'request_id': 'req-3a51be5f-701d-4e69-9e42-0ccf18128fff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:22.565768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd60eb081fe9749beaf0d621fdaebe271', 'request_id': 'req-3a51be5f-701d-4e69-9e42-0ccf18128fff'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:22.602190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] The token cache is being invalidate because project d60eb081fe9749beaf0d621fdaebe271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:34:22.602496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:22.603979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:22.617332 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4174/8352] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:34:22 2022] DELETE /identity/v3/projects/d60eb081fe9749beaf0d621fdaebe271 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:25.499655 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d5e97-755d-4d3c-b310-c6c7d867cf97 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:25.500130 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d5e97-755d-4d3c-b310-c6c7d867cf97 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:25.500220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d5e97-755d-4d3c-b310-c6c7d867cf97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:25.514444 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:25.549480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f79d5e97-755d-4d3c-b310-c6c7d867cf97 None None] MFA Rules not processed for user `51b2e08c29cb4414ba141da7bff0691a`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:25.550804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f79d5e97-755d-4d3c-b310-c6c7d867cf97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:25.631265 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4179/8353] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:25 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:34:25.642998 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:25.644815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:25.713722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a51be5f-701d-4e69-9e42-0ccf18128fff admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:25.719112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb7088-5797-4b99-b2f6-f81991df3cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:25.719745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb7088-5797-4b99-b2f6-f81991df3cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:25.720031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb7088-5797-4b99-b2f6-f81991df3cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:25.720309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb7088-5797-4b99-b2f6-f81991df3cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:25.731185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb7088-5797-4b99-b2f6-f81991df3cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:25.732684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb7088-5797-4b99-b2f6-f81991df3cd7 service cinder] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:25.737283 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:25.757722 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4175/8354] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:34:25 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:34:25.850700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d5e97-755d-4d3c-b310-c6c7d867cf97 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:25.887379 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d5e97-755d-4d3c-b310-c6c7d867cf97 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:25.894280 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:25.894913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:25.895193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:25.895471 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:25.897579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:26.000350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:26.002207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:26.015098 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4180/8355] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:34:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:34:27.521838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123aa9c-a963-4938-9c29-54cf6dbd2127 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:27.522364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123aa9c-a963-4938-9c29-54cf6dbd2127 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:27.522453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2123aa9c-a963-4938-9c29-54cf6dbd2127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:27.547239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2123aa9c-a963-4938-9c29-54cf6dbd2127 None None] MFA Rules not processed for user `db0afba834c04bdc92565bf8e9a57ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:27.548466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2123aa9c-a963-4938-9c29-54cf6dbd2127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:27.555591 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4176/8356] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:36.009317 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=61 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:36.552756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:36.554331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:36.625982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc680eb-1bd0-438d-8954-5cbe97f5fb4f service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:36.630989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c94da8d-90ed-4c7b-a0ae-40516d3aeb4c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:36.631590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94da8d-90ed-4c7b-a0ae-40516d3aeb4c service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:36.632123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94da8d-90ed-4c7b-a0ae-40516d3aeb4c service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:36.632407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c94da8d-90ed-4c7b-a0ae-40516d3aeb4c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:36.634150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c94da8d-90ed-4c7b-a0ae-40516d3aeb4c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:36.647943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94da8d-90ed-4c7b-a0ae-40516d3aeb4c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:36.649667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c94da8d-90ed-4c7b-a0ae-40516d3aeb4c service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:36.662441 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4181/8357] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:34:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:34:37.537508 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:46.656147 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=32 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:58.135268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123aa9c-a963-4938-9c29-54cf6dbd2127 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:58.136747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2123aa9c-a963-4938-9c29-54cf6dbd2127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:58.211288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2123aa9c-a963-4938-9c29-54cf6dbd2127 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:58.216142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:58.216782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:58.217165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:58.217471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] PATH_INFO: `/v3/users/f4460b32169b4fe382bb6df46db2be4d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:58.218769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4460b32169b4fe382bb6df46db2be4d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:58.221199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:58.275075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4460b32169b4fe382bb6df46db2be4d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:58.290595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4460b32169b4fe382bb6df46db2be4d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:58.292156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4460b32169b4fe382bb6df46db2be4d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:58.301867 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4460b32169b4fe382bb6df46db2be4d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:58.310748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4460b32169b4fe382bb6df46db2be4d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:58.321133 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4177/8358] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:34:58 2022] DELETE /identity/v3/users/f4460b32169b4fe382bb6df46db2be4d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:58.323006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3191-b027-4e73-83e4-913034541be3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:58.323436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3191-b027-4e73-83e4-913034541be3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:58.323621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18a3191-b027-4e73-83e4-913034541be3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:58.345400 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e18a3191-b027-4e73-83e4-913034541be3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:58.346604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e18a3191-b027-4e73-83e4-913034541be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:58.418774 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4182/8359] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:58.427062 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:58.428565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:58.493123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d6de3-9fdb-4019-9388-d27bc4db7f37 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:58.496838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44638df-9d6b-4408-966c-f067dbaf7e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:58.497478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44638df-9d6b-4408-966c-f067dbaf7e30 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:58.497790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44638df-9d6b-4408-966c-f067dbaf7e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:58.498065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44638df-9d6b-4408-966c-f067dbaf7e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:58.507373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44638df-9d6b-4408-966c-f067dbaf7e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:58.509070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44638df-9d6b-4408-966c-f067dbaf7e30 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:58.519343 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4178/8360] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:34:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:34:58.891135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a3191-b027-4e73-83e4-913034541be3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:58.892696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e18a3191-b027-4e73-83e4-913034541be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:58.912691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18a3191-b027-4e73-83e4-913034541be3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:58.922477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:58.924536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:58.925473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:58.934375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] PATH_INFO: `/v3/projects/0874c5dcb092416a894e5e9200eb8e12` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:58.935879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=0874c5dcb092416a894e5e9200eb8e12)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:58.937808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:59.021262 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0874c5dcb092416a894e5e9200eb8e12', 'request_id': 'req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:59.032684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0874c5dcb092416a894e5e9200eb8e12', 'request_id': 'req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:59.042907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0874c5dcb092416a894e5e9200eb8e12', 'request_id': 'req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:59.065903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] The token cache is being invalidate because project 0874c5dcb092416a894e5e9200eb8e12 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:34:59.067066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:59.068101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3bcd6190-55fe-4fe4-b425-ddae6b3c34ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:34:59.072036 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4183/8361] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:34:58 2022] DELETE /identity/v3/projects/0874c5dcb092416a894e5e9200eb8e12 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:59.076973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d78a9-e664-4c57-8966-65bfafa3899d None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.078191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d78a9-e664-4c57-8966-65bfafa3899d None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.079506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701d78a9-e664-4c57-8966-65bfafa3899d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.104483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-701d78a9-e664-4c57-8966-65bfafa3899d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:59.105899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-701d78a9-e664-4c57-8966-65bfafa3899d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:59.144796 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:59.213701 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4179/8362] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:59.220588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2570b-bb12-4673-85fa-77a1637f43db None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.220874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2570b-bb12-4673-85fa-77a1637f43db None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.221151 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c2570b-bb12-4673-85fa-77a1637f43db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.242215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b3c2570b-bb12-4673-85fa-77a1637f43db None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:59.243409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b3c2570b-bb12-4673-85fa-77a1637f43db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:59.253366 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4184/8363] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:59.257252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d78a9-e664-4c57-8966-65bfafa3899d None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:59.268352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701d78a9-e664-4c57-8966-65bfafa3899d None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:59.273905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74900cd-9fad-4cf3-bc20-48e61f1a48fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:59.274525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74900cd-9fad-4cf3-bc20-48e61f1a48fb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.274804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74900cd-9fad-4cf3-bc20-48e61f1a48fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.275077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74900cd-9fad-4cf3-bc20-48e61f1a48fb admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.275736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74900cd-9fad-4cf3-bc20-48e61f1a48fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:34:59.276039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74900cd-9fad-4cf3-bc20-48e61f1a48fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:59.277784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74900cd-9fad-4cf3-bc20-48e61f1a48fb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:59.292531 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4180/8364] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:34:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:34:59.296931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2570b-bb12-4673-85fa-77a1637f43db None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:59.306955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c2570b-bb12-4673-85fa-77a1637f43db None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:59.312668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ef222-8c77-4e05-98b2-e3280f6c0e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:59.313441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ef222-8c77-4e05-98b2-e3280f6c0e02 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.313793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ef222-8c77-4e05-98b2-e3280f6c0e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.314135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ef222-8c77-4e05-98b2-e3280f6c0e02 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.314845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ef222-8c77-4e05-98b2-e3280f6c0e02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:59.316832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2ef222-8c77-4e05-98b2-e3280f6c0e02 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:59.363299 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4185/8365] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:34:59 2022] POST /identity/v3/projects => generated 369 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:59.364490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74900cd-9fad-4cf3-bc20-48e61f1a48fb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:59.375660 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74900cd-9fad-4cf3-bc20-48e61f1a48fb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:59.437805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a717bc1-14f6-408a-a28d-ce52c82a4367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:59.438358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a717bc1-14f6-408a-a28d-ce52c82a4367 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.438634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a717bc1-14f6-408a-a28d-ce52c82a4367 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.438902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a717bc1-14f6-408a-a28d-ce52c82a4367 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.439530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a717bc1-14f6-408a-a28d-ce52c82a4367 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:59.441493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a717bc1-14f6-408a-a28d-ce52c82a4367 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:59.466721 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4181/8366] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:34:59 2022] POST /identity/v3/users => generated 285 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:34:59.471571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ef222-8c77-4e05-98b2-e3280f6c0e02 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:59.485759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ef222-8c77-4e05-98b2-e3280f6c0e02 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:59.490779 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471044c-407a-4def-a2cf-5b1414afc911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:59.491403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471044c-407a-4def-a2cf-5b1414afc911 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.491689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471044c-407a-4def-a2cf-5b1414afc911 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.491959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471044c-407a-4def-a2cf-5b1414afc911 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.492607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471044c-407a-4def-a2cf-5b1414afc911 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:59.494361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e471044c-407a-4def-a2cf-5b1414afc911 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:59.506231 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4186/8367] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:34:59.510450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a717bc1-14f6-408a-a28d-ce52c82a4367 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:59.521503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a717bc1-14f6-408a-a28d-ce52c82a4367 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:59.526463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afc6eb-84b7-420b-8bd0-455185f6d2fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:59.527235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc6eb-84b7-420b-8bd0-455185f6d2fd admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.527610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc6eb-84b7-420b-8bd0-455185f6d2fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.527980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afc6eb-84b7-420b-8bd0-455185f6d2fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.528740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc6eb-84b7-420b-8bd0-455185f6d2fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:59.531024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afc6eb-84b7-420b-8bd0-455185f6d2fd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:59.542746 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4182/8368] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:34:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:34:59.547098 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471044c-407a-4def-a2cf-5b1414afc911 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:59.565692 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471044c-407a-4def-a2cf-5b1414afc911 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:59.571565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927d559-4a69-4892-b8b5-a73a0c3fc98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:59.572457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927d559-4a69-4892-b8b5-a73a0c3fc98f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.572738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927d559-4a69-4892-b8b5-a73a0c3fc98f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.573012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8927d559-4a69-4892-b8b5-a73a0c3fc98f admin admin] PATH_INFO: `/v3/projects/5feb070132264035ad7467c0ac297a4e/users/14bc652052e24997b7ab19fc36392b66/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.589878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927d559-4a69-4892-b8b5-a73a0c3fc98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5feb070132264035ad7467c0ac297a4e, user_id=14bc652052e24997b7ab19fc36392b66, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:59.592453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8927d559-4a69-4892-b8b5-a73a0c3fc98f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:59.606137 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4187/8369] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:34:59 2022] PUT /identity/v3/projects/5feb070132264035ad7467c0ac297a4e/users/14bc652052e24997b7ab19fc36392b66/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:34:59.617792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f16ced-fd5a-4bed-86c9-2302fa82116f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.618076 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f16ced-fd5a-4bed-86c9-2302fa82116f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.618345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f16ced-fd5a-4bed-86c9-2302fa82116f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.647414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-85f16ced-fd5a-4bed-86c9-2302fa82116f None None] MFA Rules not processed for user `14bc652052e24997b7ab19fc36392b66`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:34:59.648704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-85f16ced-fd5a-4bed-86c9-2302fa82116f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:59.713867 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4183/8370] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:34:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:34:59.725071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927d559-4a69-4892-b8b5-a73a0c3fc98f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:34:59.726835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8927d559-4a69-4892-b8b5-a73a0c3fc98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:34:59.750236 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:34:59.790087 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8927d559-4a69-4892-b8b5-a73a0c3fc98f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:34:59.793834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdf0c-1949-45be-9518-ccaff80828f2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:34:59.794436 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdf0c-1949-45be-9518-ccaff80828f2 service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:34:59.794717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdf0c-1949-45be-9518-ccaff80828f2 service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:34:59.794991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdf0c-1949-45be-9518-ccaff80828f2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:34:59.803882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bdf0c-1949-45be-9518-ccaff80828f2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:34:59.805389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0bdf0c-1949-45be-9518-ccaff80828f2 service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:34:59.814794 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4188/8371] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:34:59 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:35:00.370026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403757-2c72-44e2-b22f-89bae50fe249 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:00.370592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403757-2c72-44e2-b22f-89bae50fe249 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:00.370815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e403757-2c72-44e2-b22f-89bae50fe249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:00.390578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9e403757-2c72-44e2-b22f-89bae50fe249 None None] MFA Rules not processed for user `db0afba834c04bdc92565bf8e9a57ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:00.391717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9e403757-2c72-44e2-b22f-89bae50fe249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:00.403860 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:00.450244 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4184/8372] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:00 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:01.691534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdf0c-1949-45be-9518-ccaff80828f2 service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:01.692992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7f0bdf0c-1949-45be-9518-ccaff80828f2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:01.778846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdf0c-1949-45be-9518-ccaff80828f2 service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:01.785815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eed440e-0df5-4c28-a1d9-216600cd8230 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:01.786426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed440e-0df5-4c28-a1d9-216600cd8230 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:01.786700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed440e-0df5-4c28-a1d9-216600cd8230 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:01.786969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eed440e-0df5-4c28-a1d9-216600cd8230 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:01.788730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5eed440e-0df5-4c28-a1d9-216600cd8230 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:01.805703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed440e-0df5-4c28-a1d9-216600cd8230 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:01.807319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eed440e-0df5-4c28-a1d9-216600cd8230 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:01.820702 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4189/8373] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:35:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:35:10.443502 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=17 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:11.814008 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=49 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:33.163025 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e403757-2c72-44e2-b22f-89bae50fe249 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:33.241825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e403757-2c72-44e2-b22f-89bae50fe249 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:33.246680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:33.247318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:33.247606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:33.247873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] PATH_INFO: `/v3/users/14bc652052e24997b7ab19fc36392b66` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:33.249030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14bc652052e24997b7ab19fc36392b66)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:33.251032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:33.305202 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14bc652052e24997b7ab19fc36392b66'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.322180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14bc652052e24997b7ab19fc36392b66'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.323216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14bc652052e24997b7ab19fc36392b66'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.333522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14bc652052e24997b7ab19fc36392b66'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.341952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14bc652052e24997b7ab19fc36392b66'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.351621 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4185/8374] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:35:33 2022] DELETE /identity/v3/users/14bc652052e24997b7ab19fc36392b66 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:35:33.356104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd660b-88dc-4b04-9de3-e083baf442cb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:33.356574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd660b-88dc-4b04-9de3-e083baf442cb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:33.356677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd660b-88dc-4b04-9de3-e083baf442cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:33.375577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d9dd660b-88dc-4b04-9de3-e083baf442cb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:33.377052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d9dd660b-88dc-4b04-9de3-e083baf442cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:33.447652 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4190/8375] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:33.458165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:33.459943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:33.527526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3dcfc7-01e4-4255-9c52-4e82ec4d8291 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:33.531469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f80f81-26b3-4644-b00d-b0b20ff1c7dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:33.532097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80f81-26b3-4644-b00d-b0b20ff1c7dc service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:33.532437 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80f81-26b3-4644-b00d-b0b20ff1c7dc service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:33.532721 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f80f81-26b3-4644-b00d-b0b20ff1c7dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:33.542954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f80f81-26b3-4644-b00d-b0b20ff1c7dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:33.544578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f80f81-26b3-4644-b00d-b0b20ff1c7dc service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:33.557666 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4186/8376] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:35:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:35:33.860158 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd660b-88dc-4b04-9de3-e083baf442cb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:33.861696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d9dd660b-88dc-4b04-9de3-e083baf442cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:33.877581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd660b-88dc-4b04-9de3-e083baf442cb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:33.882936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:33.883578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:33.883859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:33.884131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] PATH_INFO: `/v3/projects/5feb070132264035ad7467c0ac297a4e` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:33.885740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=5feb070132264035ad7467c0ac297a4e)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:33.887873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:33.941022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5feb070132264035ad7467c0ac297a4e', 'request_id': 'req-705593b0-466b-404b-8726-88efa1a13b4b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.949937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5feb070132264035ad7467c0ac297a4e', 'request_id': 'req-705593b0-466b-404b-8726-88efa1a13b4b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.964034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5feb070132264035ad7467c0ac297a4e', 'request_id': 'req-705593b0-466b-404b-8726-88efa1a13b4b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.976686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] The token cache is being invalidate because project 5feb070132264035ad7467c0ac297a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:35:33.977210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.980152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-705593b0-466b-404b-8726-88efa1a13b4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:33.982124 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4191/8377] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:35:33 2022] DELETE /identity/v3/projects/5feb070132264035ad7467c0ac297a4e => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:35:33.987578 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa84dd-7463-4a26-b3cf-a09faabe692c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:33.987895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa84dd-7463-4a26-b3cf-a09faabe692c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:33.988224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa84dd-7463-4a26-b3cf-a09faabe692c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.012816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-68fa84dd-7463-4a26-b3cf-a09faabe692c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:34.014737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-68fa84dd-7463-4a26-b3cf-a09faabe692c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:34.033484 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:34.086902 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4187/8378] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:35:34.094293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bc775-7f14-4690-ba53-fb046f86930b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:34.095182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bc775-7f14-4690-ba53-fb046f86930b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:34.096119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7bc775-7f14-4690-ba53-fb046f86930b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.118705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1f7bc775-7f14-4690-ba53-fb046f86930b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:34.120075 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1f7bc775-7f14-4690-ba53-fb046f86930b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:34.132357 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4192/8379] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:34.133853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa84dd-7463-4a26-b3cf-a09faabe692c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:34.147698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa84dd-7463-4a26-b3cf-a09faabe692c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:34.154963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf76d7-c839-407f-b732-594c48876307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:34.155595 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf76d7-c839-407f-b732-594c48876307 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:34.155883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf76d7-c839-407f-b732-594c48876307 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:34.156158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbf76d7-c839-407f-b732-594c48876307 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.156813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf76d7-c839-407f-b732-594c48876307 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:35:34.157119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf76d7-c839-407f-b732-594c48876307 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:34.159111 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbf76d7-c839-407f-b732-594c48876307 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:34.175734 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4188/8380] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:35:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:35:34.176814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bc775-7f14-4690-ba53-fb046f86930b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:34.186815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7bc775-7f14-4690-ba53-fb046f86930b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:34.191955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82be248-b43e-43fc-a9e7-022a82893bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:34.192558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82be248-b43e-43fc-a9e7-022a82893bf9 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:34.192837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82be248-b43e-43fc-a9e7-022a82893bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:34.193112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82be248-b43e-43fc-a9e7-022a82893bf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.193814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82be248-b43e-43fc-a9e7-022a82893bf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:34.196010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82be248-b43e-43fc-a9e7-022a82893bf9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:34.230591 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4193/8381] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:35:34 2022] POST /identity/v3/projects => generated 399 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:35:34.234665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf76d7-c839-407f-b732-594c48876307 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:34.245188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbf76d7-c839-407f-b732-594c48876307 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:34.312650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59d1af-baac-4647-98c2-a0519491d327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:34.313425 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59d1af-baac-4647-98c2-a0519491d327 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:34.313805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59d1af-baac-4647-98c2-a0519491d327 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:34.314115 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc59d1af-baac-4647-98c2-a0519491d327 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.314761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59d1af-baac-4647-98c2-a0519491d327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:34.317045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc59d1af-baac-4647-98c2-a0519491d327 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:34.341410 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4189/8382] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:35:34 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:35:34.344661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82be248-b43e-43fc-a9e7-022a82893bf9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:34.356354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82be248-b43e-43fc-a9e7-022a82893bf9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:34.361089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96c86b-d3a1-4d74-a1b8-572e50fb8e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:34.361725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96c86b-d3a1-4d74-a1b8-572e50fb8e40 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:34.362007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96c86b-d3a1-4d74-a1b8-572e50fb8e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:34.362283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee96c86b-d3a1-4d74-a1b8-572e50fb8e40 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.362919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96c86b-d3a1-4d74-a1b8-572e50fb8e40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:34.364508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee96c86b-d3a1-4d74-a1b8-572e50fb8e40 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:34.374976 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4194/8383] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:35:34.379586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59d1af-baac-4647-98c2-a0519491d327 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:34.390385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc59d1af-baac-4647-98c2-a0519491d327 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:34.395664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380b34bb-d481-467a-8a2b-c95a4dabea71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:34.396531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b34bb-d481-467a-8a2b-c95a4dabea71 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:34.396818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b34bb-d481-467a-8a2b-c95a4dabea71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:34.398570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380b34bb-d481-467a-8a2b-c95a4dabea71 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.399254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b34bb-d481-467a-8a2b-c95a4dabea71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:34.400915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380b34bb-d481-467a-8a2b-c95a4dabea71 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:34.416311 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4190/8384] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:35:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:35:34.417764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96c86b-d3a1-4d74-a1b8-572e50fb8e40 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:34.431066 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee96c86b-d3a1-4d74-a1b8-572e50fb8e40 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:34.436102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ec3a9-f7a2-4591-87db-2b43a9d17e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:34.436851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ec3a9-f7a2-4591-87db-2b43a9d17e3e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:34.437219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ec3a9-f7a2-4591-87db-2b43a9d17e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:34.437611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ec3a9-f7a2-4591-87db-2b43a9d17e3e admin admin] PATH_INFO: `/v3/projects/1e597d16c49144d1913b39961d9ec22c/users/6dd309d2696a4e22859aec233cdd0da4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.456433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ec3a9-f7a2-4591-87db-2b43a9d17e3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e597d16c49144d1913b39961d9ec22c, user_id=6dd309d2696a4e22859aec233cdd0da4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:34.459321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ec3a9-f7a2-4591-87db-2b43a9d17e3e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:34.482871 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4195/8385] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:35:34 2022] PUT /identity/v3/projects/1e597d16c49144d1913b39961d9ec22c/users/6dd309d2696a4e22859aec233cdd0da4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:35:34.493748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8268-4ae8-4a0d-9994-6b42eaa9a46f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:34.494090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8268-4ae8-4a0d-9994-6b42eaa9a46f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:34.494366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d8268-4ae8-4a0d-9994-6b42eaa9a46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.526575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e78d8268-4ae8-4a0d-9994-6b42eaa9a46f None None] MFA Rules not processed for user `6dd309d2696a4e22859aec233cdd0da4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:34.527813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e78d8268-4ae8-4a0d-9994-6b42eaa9a46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:34.597827 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4191/8386] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:34 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:34.609730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ec3a9-f7a2-4591-87db-2b43a9d17e3e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:34.611482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-314ec3a9-f7a2-4591-87db-2b43a9d17e3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:34.634626 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:34.676215 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ec3a9-f7a2-4591-87db-2b43a9d17e3e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:34.680214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ace4cc-88dc-4bcd-a635-a3992c6b3d07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:34.680899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ace4cc-88dc-4bcd-a635-a3992c6b3d07 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:34.681178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ace4cc-88dc-4bcd-a635-a3992c6b3d07 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:34.681487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ace4cc-88dc-4bcd-a635-a3992c6b3d07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:34.691335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ace4cc-88dc-4bcd-a635-a3992c6b3d07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:34.692767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ace4cc-88dc-4bcd-a635-a3992c6b3d07 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:34.702410 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4196/8387] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:35:34 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:35:42.912158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d8268-4ae8-4a0d-9994-6b42eaa9a46f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:42.932805 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:42.982401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d8268-4ae8-4a0d-9994-6b42eaa9a46f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:42.987687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:42.988316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:42.988593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:42.988865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] PATH_INFO: `/v3/users/6dd309d2696a4e22859aec233cdd0da4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:42.990366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6dd309d2696a4e22859aec233cdd0da4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:42.992277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:43.042976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6dd309d2696a4e22859aec233cdd0da4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.058526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6dd309d2696a4e22859aec233cdd0da4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.059593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6dd309d2696a4e22859aec233cdd0da4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.068833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6dd309d2696a4e22859aec233cdd0da4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.078671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6dd309d2696a4e22859aec233cdd0da4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.092585 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4192/8388] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:35:42 2022] DELETE /identity/v3/users/6dd309d2696a4e22859aec233cdd0da4 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:35:43.094155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd9ccb-1e79-42c5-9950-07eacadf2a9c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:43.094664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd9ccb-1e79-42c5-9950-07eacadf2a9c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:43.094751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cd9ccb-1e79-42c5-9950-07eacadf2a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:43.115342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-56cd9ccb-1e79-42c5-9950-07eacadf2a9c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:43.116582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-56cd9ccb-1e79-42c5-9950-07eacadf2a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:43.183282 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4197/8389] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:43.193137 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:43.194643 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:43.257286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa3aa3f-4f47-4dd4-8e14-3475e3724902 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:43.261329 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dfb5f-4928-41e1-bdee-6e026fdaca71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:43.261925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dfb5f-4928-41e1-bdee-6e026fdaca71 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:43.262206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dfb5f-4928-41e1-bdee-6e026fdaca71 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:43.262500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dfb5f-4928-41e1-bdee-6e026fdaca71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:43.272142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dfb5f-4928-41e1-bdee-6e026fdaca71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:43.273611 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dfb5f-4928-41e1-bdee-6e026fdaca71 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:43.283734 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4193/8390] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:35:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:35:43.578872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd9ccb-1e79-42c5-9950-07eacadf2a9c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:43.580487 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-56cd9ccb-1e79-42c5-9950-07eacadf2a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:43.593793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cd9ccb-1e79-42c5-9950-07eacadf2a9c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:43.599698 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:43.600488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:43.600730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:43.601004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] PATH_INFO: `/v3/projects/1e597d16c49144d1913b39961d9ec22c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:43.602177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e597d16c49144d1913b39961d9ec22c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:43.604192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:43.662737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e597d16c49144d1913b39961d9ec22c', 'request_id': 'req-e313d181-b40b-4d17-9e71-6109e50b2821'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.668954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e597d16c49144d1913b39961d9ec22c', 'request_id': 'req-e313d181-b40b-4d17-9e71-6109e50b2821'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.680877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e597d16c49144d1913b39961d9ec22c', 'request_id': 'req-e313d181-b40b-4d17-9e71-6109e50b2821'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.694338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] The token cache is being invalidate because project 1e597d16c49144d1913b39961d9ec22c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:35:43.694846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.695515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-e313d181-b40b-4d17-9e71-6109e50b2821 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:35:43.697550 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4198/8391] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:35:43 2022] DELETE /identity/v3/projects/1e597d16c49144d1913b39961d9ec22c => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:35:43.705506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49203d73-01ed-45ba-b62b-e5e0e892848b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:43.705801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49203d73-01ed-45ba-b62b-e5e0e892848b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:43.706078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49203d73-01ed-45ba-b62b-e5e0e892848b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:43.727219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-49203d73-01ed-45ba-b62b-e5e0e892848b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:43.728571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-49203d73-01ed-45ba-b62b-e5e0e892848b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:43.767090 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:43.809369 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4194/8392] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:43.815807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f21c68-cfa5-4d10-b50c-9d35f8190b0e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:43.816326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f21c68-cfa5-4d10-b50c-9d35f8190b0e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:43.816798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f21c68-cfa5-4d10-b50c-9d35f8190b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:43.852903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b7f21c68-cfa5-4d10-b50c-9d35f8190b0e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:43.854728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b7f21c68-cfa5-4d10-b50c-9d35f8190b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:43.869368 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4199/8393] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:43.871758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49203d73-01ed-45ba-b62b-e5e0e892848b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:43.893822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49203d73-01ed-45ba-b62b-e5e0e892848b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:43.899309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0386b8-82c1-4206-b83f-fc02ffe4c81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:43.899624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0386b8-82c1-4206-b83f-fc02ffe4c81e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:43.899907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0386b8-82c1-4206-b83f-fc02ffe4c81e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:43.900183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0386b8-82c1-4206-b83f-fc02ffe4c81e admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:43.900837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0386b8-82c1-4206-b83f-fc02ffe4c81e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:35:43.901142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0386b8-82c1-4206-b83f-fc02ffe4c81e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:43.903276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0386b8-82c1-4206-b83f-fc02ffe4c81e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:43.919624 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4195/8394] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:35:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:35:43.924900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f21c68-cfa5-4d10-b50c-9d35f8190b0e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:43.934832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f21c68-cfa5-4d10-b50c-9d35f8190b0e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:43.940755 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548f08-bbd2-4f75-8ea0-04d967b667fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:43.941403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548f08-bbd2-4f75-8ea0-04d967b667fe admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:43.941687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548f08-bbd2-4f75-8ea0-04d967b667fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:43.941959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55548f08-bbd2-4f75-8ea0-04d967b667fe admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:43.942694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55548f08-bbd2-4f75-8ea0-04d967b667fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:43.944736 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55548f08-bbd2-4f75-8ea0-04d967b667fe admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:43.975385 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4200/8395] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:35:43 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:35:43.979441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0386b8-82c1-4206-b83f-fc02ffe4c81e admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:43.994963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0386b8-82c1-4206-b83f-fc02ffe4c81e admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.079507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e6c14-1737-4268-b455-e2681cdc7d4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.080251 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e6c14-1737-4268-b455-e2681cdc7d4b admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.080582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e6c14-1737-4268-b455-e2681cdc7d4b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.080912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8e6c14-1737-4268-b455-e2681cdc7d4b admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.081638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e6c14-1737-4268-b455-e2681cdc7d4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.083621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8e6c14-1737-4268-b455-e2681cdc7d4b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.108919 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4196/8396] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:35:43 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:35:44.113137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548f08-bbd2-4f75-8ea0-04d967b667fe admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.124102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55548f08-bbd2-4f75-8ea0-04d967b667fe admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.129224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51a8e6-1cca-4a8f-b3c6-1e6916be92fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.129943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a8e6-1cca-4a8f-b3c6-1e6916be92fd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.130300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a8e6-1cca-4a8f-b3c6-1e6916be92fd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.130649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51a8e6-1cca-4a8f-b3c6-1e6916be92fd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.131361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51a8e6-1cca-4a8f-b3c6-1e6916be92fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.133018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51a8e6-1cca-4a8f-b3c6-1e6916be92fd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.143812 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4201/8397] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:35:44.147968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e6c14-1737-4268-b455-e2681cdc7d4b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.160209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8e6c14-1737-4268-b455-e2681cdc7d4b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.165142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb79c43-3219-4548-bb7f-a76a91e2d231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.165786 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79c43-3219-4548-bb7f-a76a91e2d231 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.166070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79c43-3219-4548-bb7f-a76a91e2d231 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.166346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb79c43-3219-4548-bb7f-a76a91e2d231 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.166983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79c43-3219-4548-bb7f-a76a91e2d231 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.168601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb79c43-3219-4548-bb7f-a76a91e2d231 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.181857 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4197/8398] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:35:44.185664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51a8e6-1cca-4a8f-b3c6-1e6916be92fd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.195970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51a8e6-1cca-4a8f-b3c6-1e6916be92fd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.200737 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409d169-e942-4a9c-ba32-e09d89e76b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.201428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409d169-e942-4a9c-ba32-e09d89e76b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.201711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409d169-e942-4a9c-ba32-e09d89e76b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.201983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9409d169-e942-4a9c-ba32-e09d89e76b07 admin admin] PATH_INFO: `/v3/projects/92300bfd91834591a263b1080a2dbe0d/users/e46ce6c65db64efaa07525abce5420c1/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.204294 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:44.220873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409d169-e942-4a9c-ba32-e09d89e76b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92300bfd91834591a263b1080a2dbe0d, user_id=e46ce6c65db64efaa07525abce5420c1, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.223814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9409d169-e942-4a9c-ba32-e09d89e76b07 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.238967 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4202/8399] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:35:44 2022] PUT /identity/v3/projects/92300bfd91834591a263b1080a2dbe0d/users/e46ce6c65db64efaa07525abce5420c1/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:35:44.249337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f3206-a5ea-46f3-a085-170d8a8e7f67 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.249626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f3206-a5ea-46f3-a085-170d8a8e7f67 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.249900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929f3206-a5ea-46f3-a085-170d8a8e7f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.277508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-929f3206-a5ea-46f3-a085-170d8a8e7f67 None None] MFA Rules not processed for user `e46ce6c65db64efaa07525abce5420c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:44.278703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-929f3206-a5ea-46f3-a085-170d8a8e7f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:44.343042 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4198/8400] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:44.348121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409d169-e942-4a9c-ba32-e09d89e76b07 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.413259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9409d169-e942-4a9c-ba32-e09d89e76b07 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.417987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ab98-630d-4633-8dd8-d0605a8920ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.418592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ab98-630d-4633-8dd8-d0605a8920ab admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.418871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ab98-630d-4633-8dd8-d0605a8920ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.419142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29ab98-630d-4633-8dd8-d0605a8920ab admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.419781 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29ab98-630d-4633-8dd8-d0605a8920ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.421748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f29ab98-630d-4633-8dd8-d0605a8920ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.458751 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4203/8401] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:35:44 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:35:44.459894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f3206-a5ea-46f3-a085-170d8a8e7f67 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.470881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929f3206-a5ea-46f3-a085-170d8a8e7f67 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.504714 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:44.532693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6876c-9ad1-4085-9c87-5100b6eec7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.533448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6876c-9ad1-4085-9c87-5100b6eec7bc admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.533795 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6876c-9ad1-4085-9c87-5100b6eec7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.534079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed6876c-9ad1-4085-9c87-5100b6eec7bc admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.534710 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6876c-9ad1-4085-9c87-5100b6eec7bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.536670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed6876c-9ad1-4085-9c87-5100b6eec7bc admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.560817 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4199/8402] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:35:44 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:35:44.565427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ab98-630d-4633-8dd8-d0605a8920ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.577142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29ab98-630d-4633-8dd8-d0605a8920ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.582109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055d0bd-e8ca-48fa-a5f1-903e74bfd61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.582786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055d0bd-e8ca-48fa-a5f1-903e74bfd61d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.583135 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055d0bd-e8ca-48fa-a5f1-903e74bfd61d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.583474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b055d0bd-e8ca-48fa-a5f1-903e74bfd61d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.591350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055d0bd-e8ca-48fa-a5f1-903e74bfd61d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.593095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b055d0bd-e8ca-48fa-a5f1-903e74bfd61d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.608476 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4204/8403] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:35:44.609918 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6876c-9ad1-4085-9c87-5100b6eec7bc admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.621024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed6876c-9ad1-4085-9c87-5100b6eec7bc admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.626114 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0187cfe-5a3a-4aee-9a73-7101d671be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.626784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0187cfe-5a3a-4aee-9a73-7101d671be7a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.627061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0187cfe-5a3a-4aee-9a73-7101d671be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.627333 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0187cfe-5a3a-4aee-9a73-7101d671be7a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.627964 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0187cfe-5a3a-4aee-9a73-7101d671be7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.629616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0187cfe-5a3a-4aee-9a73-7101d671be7a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.640467 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4200/8404] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:35:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:35:44.645701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055d0bd-e8ca-48fa-a5f1-903e74bfd61d admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.656411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b055d0bd-e8ca-48fa-a5f1-903e74bfd61d admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.661894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6aa5f-d434-4276-99b9-17fca7707218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.662571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6aa5f-d434-4276-99b9-17fca7707218 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.662858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6aa5f-d434-4276-99b9-17fca7707218 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.663259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6aa5f-d434-4276-99b9-17fca7707218 admin admin] PATH_INFO: `/v3/projects/e08685001e4046f4ab73bcb1b0b554c0/users/5e04851c206349e7a1daba48a39e10c4/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.678492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6aa5f-d434-4276-99b9-17fca7707218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08685001e4046f4ab73bcb1b0b554c0, user_id=5e04851c206349e7a1daba48a39e10c4, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.681179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b6aa5f-d434-4276-99b9-17fca7707218 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.694729 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4205/8405] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:35:44 2022] PUT /identity/v3/projects/e08685001e4046f4ab73bcb1b0b554c0/users/5e04851c206349e7a1daba48a39e10c4/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:35:44.706577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bf244-f07d-4823-9dfb-b6cd0013d38f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.706864 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bf244-f07d-4823-9dfb-b6cd0013d38f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.707150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42bf244-f07d-4823-9dfb-b6cd0013d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.737060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a42bf244-f07d-4823-9dfb-b6cd0013d38f None None] MFA Rules not processed for user `5e04851c206349e7a1daba48a39e10c4`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:44.738375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a42bf244-f07d-4823-9dfb-b6cd0013d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:44.811449 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4201/8406] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:44.812904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6aa5f-d434-4276-99b9-17fca7707218 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.877088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6aa5f-d434-4276-99b9-17fca7707218 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.882124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9546-96d3-4bc0-b634-44af52e75427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.882708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9546-96d3-4bc0-b634-44af52e75427 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.883003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9546-96d3-4bc0-b634-44af52e75427 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.883272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976c9546-96d3-4bc0-b634-44af52e75427 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.883902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c9546-96d3-4bc0-b634-44af52e75427 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.886086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976c9546-96d3-4bc0-b634-44af52e75427 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:44.912343 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4206/8407] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:35:44 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:35:44.916404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bf244-f07d-4823-9dfb-b6cd0013d38f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:44.928094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42bf244-f07d-4823-9dfb-b6cd0013d38f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:44.987338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a2eb0-99f2-4ae2-8bb9-149d758b0931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:44.987942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a2eb0-99f2-4ae2-8bb9-149d758b0931 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:44.988221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a2eb0-99f2-4ae2-8bb9-149d758b0931 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:44.988494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448a2eb0-99f2-4ae2-8bb9-149d758b0931 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:44.989120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a2eb0-99f2-4ae2-8bb9-149d758b0931 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:44.991058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448a2eb0-99f2-4ae2-8bb9-149d758b0931 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:45.012423 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4202/8408] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:35:44 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:35:45.016597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9546-96d3-4bc0-b634-44af52e75427 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:45.027778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976c9546-96d3-4bc0-b634-44af52e75427 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:45.032319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e55228-cbaa-4082-9d0f-f874cd65b711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:45.032969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e55228-cbaa-4082-9d0f-f874cd65b711 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:45.033248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e55228-cbaa-4082-9d0f-f874cd65b711 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:45.033555 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e55228-cbaa-4082-9d0f-f874cd65b711 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:45.034184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e55228-cbaa-4082-9d0f-f874cd65b711 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:45.035765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e55228-cbaa-4082-9d0f-f874cd65b711 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:45.046468 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4207/8409] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:35:45.050653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a2eb0-99f2-4ae2-8bb9-149d758b0931 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:45.061077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448a2eb0-99f2-4ae2-8bb9-149d758b0931 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:45.066502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832f9e1-b20a-4a46-8d08-3ffa3434687b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:45.067194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832f9e1-b20a-4a46-8d08-3ffa3434687b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:45.067470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832f9e1-b20a-4a46-8d08-3ffa3434687b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:45.067741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832f9e1-b20a-4a46-8d08-3ffa3434687b admin admin] PATH_INFO: `/v3/projects/9cba41daa17f4dc7aabdd1ad10f8d053/users/4b5b00fe20674d28b449e2fdf1414db3/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:45.084399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832f9e1-b20a-4a46-8d08-3ffa3434687b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cba41daa17f4dc7aabdd1ad10f8d053, user_id=4b5b00fe20674d28b449e2fdf1414db3, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:45.087188 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5832f9e1-b20a-4a46-8d08-3ffa3434687b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:45.101393 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4203/8410] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:35:45 2022] PUT /identity/v3/projects/9cba41daa17f4dc7aabdd1ad10f8d053/users/4b5b00fe20674d28b449e2fdf1414db3/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:35:45.105564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e55228-cbaa-4082-9d0f-f874cd65b711 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:45.117414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e55228-cbaa-4082-9d0f-f874cd65b711 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:45.122971 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:45.197044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32117085-3d5e-4e86-82ac-45dfee8d9e8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:45.198019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117085-3d5e-4e86-82ac-45dfee8d9e8a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:45.198508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117085-3d5e-4e86-82ac-45dfee8d9e8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:45.198973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32117085-3d5e-4e86-82ac-45dfee8d9e8a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:45.199946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117085-3d5e-4e86-82ac-45dfee8d9e8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:45.202930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32117085-3d5e-4e86-82ac-45dfee8d9e8a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:45.219077 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4208/8411] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:35:45 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:35:45.223198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832f9e1-b20a-4a46-8d08-3ffa3434687b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:45.233835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832f9e1-b20a-4a46-8d08-3ffa3434687b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:45.238996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026905-3c05-4f86-bd64-09cf472ddb27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:45.239640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026905-3c05-4f86-bd64-09cf472ddb27 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:45.239922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026905-3c05-4f86-bd64-09cf472ddb27 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:45.240198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73026905-3c05-4f86-bd64-09cf472ddb27 admin admin] PATH_INFO: `/v3/projects/9cba41daa17f4dc7aabdd1ad10f8d053/users/4b5b00fe20674d28b449e2fdf1414db3/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:45.242168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73026905-3c05-4f86-bd64-09cf472ddb27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cba41daa17f4dc7aabdd1ad10f8d053, user_id=4b5b00fe20674d28b449e2fdf1414db3, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:45.244805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73026905-3c05-4f86-bd64-09cf472ddb27 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:45.248396 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:35:45.258098 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4204/8412] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:35:45 2022] PUT /identity/v3/projects/9cba41daa17f4dc7aabdd1ad10f8d053/users/4b5b00fe20674d28b449e2fdf1414db3/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:35:45.268607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19486253-cd4e-4c4e-9e40-c5b6d629ec61 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:45.268892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19486253-cd4e-4c4e-9e40-c5b6d629ec61 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:45.269166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19486253-cd4e-4c4e-9e40-c5b6d629ec61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:45.296986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-19486253-cd4e-4c4e-9e40-c5b6d629ec61 None None] MFA Rules not processed for user `4b5b00fe20674d28b449e2fdf1414db3`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:45.298724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-19486253-cd4e-4c4e-9e40-c5b6d629ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:45.368021 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4209/8413] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:45 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:45.385990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026905-3c05-4f86-bd64-09cf472ddb27 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:45.387986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-73026905-3c05-4f86-bd64-09cf472ddb27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:45.476091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73026905-3c05-4f86-bd64-09cf472ddb27 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:45.482586 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9a45d-2b04-4c19-bb5a-29e10e87f265 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:45.491097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9a45d-2b04-4c19-bb5a-29e10e87f265 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:45.491097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9a45d-2b04-4c19-bb5a-29e10e87f265 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:45.491097 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9a45d-2b04-4c19-bb5a-29e10e87f265 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:45.554680 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9a45d-2b04-4c19-bb5a-29e10e87f265 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:45.556452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9a45d-2b04-4c19-bb5a-29e10e87f265 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:45.567464 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4205/8414] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:35:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:35:47.658587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19486253-cd4e-4c4e-9e40-c5b6d629ec61 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:35:47.660197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-19486253-cd4e-4c4e-9e40-c5b6d629ec61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:47.739233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19486253-cd4e-4c4e-9e40-c5b6d629ec61 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:35:47.743968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5921db-6fe3-42a5-a92e-61b09f2e8f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:35:47.744575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5921db-6fe3-42a5-a92e-61b09f2e8f59 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:47.744854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5921db-6fe3-42a5-a92e-61b09f2e8f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:47.745124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5921db-6fe3-42a5-a92e-61b09f2e8f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:47.756601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5921db-6fe3-42a5-a92e-61b09f2e8f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:35:47.758291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5921db-6fe3-42a5-a92e-61b09f2e8f59 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:35:47.772349 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4210/8415] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:35:47 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:35:51.236634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2f666-d6e4-4f7b-bba1-cf562483613b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:51.237099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2f666-d6e4-4f7b-bba1-cf562483613b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:51.237581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d2f666-d6e4-4f7b-bba1-cf562483613b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:51.280496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-57d2f666-d6e4-4f7b-bba1-cf562483613b None None] MFA Rules not processed for user `db0afba834c04bdc92565bf8e9a57ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:51.281902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-57d2f666-d6e4-4f7b-bba1-cf562483613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:51.384047 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4206/8416] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:35:51.714467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4712f-85cc-4dec-8693-5f6a2869f732 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:35:51.715313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4712f-85cc-4dec-8693-5f6a2869f732 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:35:51.715739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d4712f-85cc-4dec-8693-5f6a2869f732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:35:51.735123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-81d4712f-85cc-4dec-8693-5f6a2869f732 None None] MFA Rules not processed for user `e46ce6c65db64efaa07525abce5420c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:35:51.737450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81d4712f-85cc-4dec-8693-5f6a2869f732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:35:51.744590 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4211/8417] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:35:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:36:01.362610 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=83 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:01.731372 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:22.314144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2f666-d6e4-4f7b-bba1-cf562483613b None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:36:22.315713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-57d2f666-d6e4-4f7b-bba1-cf562483613b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:36:22.330221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d2f666-d6e4-4f7b-bba1-cf562483613b None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:36:22.335320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:36:22.335920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:36:22.336199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:36:22.336473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:36:22.338187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:36:22.354902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:36:22.356326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:36:22.369627 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4207/8418] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:36:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:36:32.362352 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:36:47.315881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5bcf-319d-4ab7-bcff-bd60ca875230 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:36:47.316412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5bcf-319d-4ab7-bcff-bd60ca875230 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:36:47.316509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54e5bcf-319d-4ab7-bcff-bd60ca875230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:36:47.343950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-b54e5bcf-319d-4ab7-bcff-bd60ca875230 None None] MFA Rules not processed for user `e46ce6c65db64efaa07525abce5420c1`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:36:47.345137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b54e5bcf-319d-4ab7-bcff-bd60ca875230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:36:47.383043 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4212/8419] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:36:47 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:36:47.427483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:36:47.430865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:36:47.511032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646833f0-2ffb-4c3d-8c0a-c82b2e621719 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:36:47.517436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:36:47.518389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:36:47.518902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:36:47.519636 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:36:47.521913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:36:47.547144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:36:47.548789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:36:47.564984 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4208/8420] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:36:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:36:54.402356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d119d3f-7541-4de4-8fc7-1311ff9f38ad None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:36:54.402864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d119d3f-7541-4de4-8fc7-1311ff9f38ad None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:36:54.402864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d119d3f-7541-4de4-8fc7-1311ff9f38ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:36:54.423081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3d119d3f-7541-4de4-8fc7-1311ff9f38ad None None] MFA Rules not processed for user `db0afba834c04bdc92565bf8e9a57ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:36:54.424273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3d119d3f-7541-4de4-8fc7-1311ff9f38ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:36:54.433097 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4213/8421] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:36:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:36:57.556487 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=26 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:04.417260 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:05.293887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:05.295311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:05.368719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b92bad-2827-4c3d-bbee-cdce12df8373 service glance] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:05.377449 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4936-bfb4-46de-9cdf-4463ed7697db service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:05.378116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4936-bfb4-46de-9cdf-4463ed7697db service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:05.378407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4936-bfb4-46de-9cdf-4463ed7697db service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:05.378683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f4936-bfb4-46de-9cdf-4463ed7697db service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:05.380494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e29f4936-bfb4-46de-9cdf-4463ed7697db service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:05.395638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4936-bfb4-46de-9cdf-4463ed7697db service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:05.397219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f4936-bfb4-46de-9cdf-4463ed7697db service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:05.410431 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4209/8422] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:37:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:37:13.599663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d119d3f-7541-4de4-8fc7-1311ff9f38ad None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:13.617166 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d119d3f-7541-4de4-8fc7-1311ff9f38ad None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:13.623238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66351ad-a3b2-406a-a27f-84b53390e8b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:13.624092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66351ad-a3b2-406a-a27f-84b53390e8b8 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:13.624374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66351ad-a3b2-406a-a27f-84b53390e8b8 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:13.624658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66351ad-a3b2-406a-a27f-84b53390e8b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:13.626649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f66351ad-a3b2-406a-a27f-84b53390e8b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:13.644912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66351ad-a3b2-406a-a27f-84b53390e8b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:13.646668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66351ad-a3b2-406a-a27f-84b53390e8b8 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:13.661948 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4214/8423] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:37:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:37:13.726298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4936-bfb4-46de-9cdf-4463ed7697db service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:13.789192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f4936-bfb4-46de-9cdf-4463ed7697db service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:13.793780 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:13.794441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:13.794729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:13.795006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] PATH_INFO: `/v3/users/e46ce6c65db64efaa07525abce5420c1` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:13.796119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e46ce6c65db64efaa07525abce5420c1)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:13.798090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:13.843477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e46ce6c65db64efaa07525abce5420c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:13.855552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e46ce6c65db64efaa07525abce5420c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:13.856219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e46ce6c65db64efaa07525abce5420c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:13.863504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e46ce6c65db64efaa07525abce5420c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:13.870541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e46ce6c65db64efaa07525abce5420c1'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:13.876377 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4210/8424] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:37:13 2022] DELETE /identity/v3/users/e46ce6c65db64efaa07525abce5420c1 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:37:13.880944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bd13e-6a53-4b97-abe1-e6d5b0961fe1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:13.881228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bd13e-6a53-4b97-abe1-e6d5b0961fe1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:13.881606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318bd13e-6a53-4b97-abe1-e6d5b0961fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:13.901108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-318bd13e-6a53-4b97-abe1-e6d5b0961fe1 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:37:13.903007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-318bd13e-6a53-4b97-abe1-e6d5b0961fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:13.960650 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4215/8425] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:37:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:37:13.971981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:13.973569 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:13.984629 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:14.035625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fed4501-24aa-4677-b191-978b2b0bab16 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:14.039369 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6727c7-776c-49c0-b449-59b51cef79b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:14.039986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6727c7-776c-49c0-b449-59b51cef79b2 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:14.040275 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6727c7-776c-49c0-b449-59b51cef79b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:14.040553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6727c7-776c-49c0-b449-59b51cef79b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:14.050558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6727c7-776c-49c0-b449-59b51cef79b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:14.052181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6727c7-776c-49c0-b449-59b51cef79b2 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:14.064390 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4211/8426] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:37:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:37:14.237916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bd13e-6a53-4b97-abe1-e6d5b0961fe1 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:14.239335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-318bd13e-6a53-4b97-abe1-e6d5b0961fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:14.251415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318bd13e-6a53-4b97-abe1-e6d5b0961fe1 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:14.256005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:14.256634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:14.256921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:14.257201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] PATH_INFO: `/v3/projects/92300bfd91834591a263b1080a2dbe0d` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:14.258364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92300bfd91834591a263b1080a2dbe0d)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:14.260416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:14.307935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92300bfd91834591a263b1080a2dbe0d', 'request_id': 'req-41b7ec20-1ff0-4725-adea-8fe564046713'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.314703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92300bfd91834591a263b1080a2dbe0d', 'request_id': 'req-41b7ec20-1ff0-4725-adea-8fe564046713'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.322224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92300bfd91834591a263b1080a2dbe0d', 'request_id': 'req-41b7ec20-1ff0-4725-adea-8fe564046713'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.333267 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] The token cache is being invalidate because project 92300bfd91834591a263b1080a2dbe0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:37:14.333587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.334216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.335691 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4216/8427] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:37:14 2022] DELETE /identity/v3/projects/92300bfd91834591a263b1080a2dbe0d => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:37:14.339742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6727c7-776c-49c0-b449-59b51cef79b2 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:14.349952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6727c7-776c-49c0-b449-59b51cef79b2 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:14.406324 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:14.406953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:14.407232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:14.407509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] PATH_INFO: `/v3/users/5e04851c206349e7a1daba48a39e10c4` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:14.408614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e04851c206349e7a1daba48a39e10c4)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:14.410581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:14.456884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e04851c206349e7a1daba48a39e10c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.469080 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e04851c206349e7a1daba48a39e10c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.469779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e04851c206349e7a1daba48a39e10c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.478200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e04851c206349e7a1daba48a39e10c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.485626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e04851c206349e7a1daba48a39e10c4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:14.492244 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4212/8428] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:37:14 2022] DELETE /identity/v3/users/5e04851c206349e7a1daba48a39e10c4 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:37:14.862687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:14.864208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:14.879573 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b7ec20-1ff0-4725-adea-8fe564046713 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:14.942349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:14.942984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:14.943395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:14.943681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] PATH_INFO: `/v3/projects/e08685001e4046f4ab73bcb1b0b554c0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:14.944816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08685001e4046f4ab73bcb1b0b554c0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:14.946767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:14.958876 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:14.995450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08685001e4046f4ab73bcb1b0b554c0', 'request_id': 'req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.002102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08685001e4046f4ab73bcb1b0b554c0', 'request_id': 'req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.009248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08685001e4046f4ab73bcb1b0b554c0', 'request_id': 'req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.020782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] The token cache is being invalidate because project e08685001e4046f4ab73bcb1b0b554c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:37:15.021072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.021733 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.023222 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4217/8429] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:37:14 2022] DELETE /identity/v3/projects/e08685001e4046f4ab73bcb1b0b554c0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:37:15.027811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:15.029835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:15.042537 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282586ab-1c65-4887-af87-0684faa9d2a6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:15.071431 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:15.101390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:15.102026 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.102309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.102588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] PATH_INFO: `/v3/users/4b5b00fe20674d28b449e2fdf1414db3` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.103739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b5b00fe20674d28b449e2fdf1414db3)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:15.106387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:15.151772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b5b00fe20674d28b449e2fdf1414db3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.164504 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b5b00fe20674d28b449e2fdf1414db3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.165204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b5b00fe20674d28b449e2fdf1414db3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.173224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b5b00fe20674d28b449e2fdf1414db3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.180269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0419aa28-0bcc-4d00-810e-a11d2a042ac1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b5b00fe20674d28b449e2fdf1414db3'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.186291 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4213/8430] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:37:15 2022] DELETE /identity/v3/users/4b5b00fe20674d28b449e2fdf1414db3 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:37:15.357801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:15.359229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:15.372887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c5e643-0e4b-411d-b0e6-0db1d67465d3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:15.434193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:15.434826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.435105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.435378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] PATH_INFO: `/v3/projects/9cba41daa17f4dc7aabdd1ad10f8d053` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.436905 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cba41daa17f4dc7aabdd1ad10f8d053)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:15.439782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:15.487846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cba41daa17f4dc7aabdd1ad10f8d053', 'request_id': 'req-b86b1787-430c-43a2-be60-4edef122831e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.494203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cba41daa17f4dc7aabdd1ad10f8d053', 'request_id': 'req-b86b1787-430c-43a2-be60-4edef122831e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.502119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cba41daa17f4dc7aabdd1ad10f8d053', 'request_id': 'req-b86b1787-430c-43a2-be60-4edef122831e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.513306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] The token cache is being invalidate because project 9cba41daa17f4dc7aabdd1ad10f8d053 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:37:15.513612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.514237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-b86b1787-430c-43a2-be60-4edef122831e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:37:15.515721 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4218/8431] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:37:15 2022] DELETE /identity/v3/projects/9cba41daa17f4dc7aabdd1ad10f8d053 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:37:15.520610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d8008-fbb3-49e5-b742-8b9127479ef4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.520931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d8008-fbb3-49e5-b742-8b9127479ef4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.521213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18d8008-fbb3-49e5-b742-8b9127479ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.541641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a18d8008-fbb3-49e5-b742-8b9127479ef4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:37:15.542885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a18d8008-fbb3-49e5-b742-8b9127479ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:15.600850 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4214/8432] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:37:15.608498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d7e6e-0193-4339-b3aa-5ade423524ed None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.608792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d7e6e-0193-4339-b3aa-5ade423524ed None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.609080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049d7e6e-0193-4339-b3aa-5ade423524ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.628604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-049d7e6e-0193-4339-b3aa-5ade423524ed None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:37:15.629829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-049d7e6e-0193-4339-b3aa-5ade423524ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:15.638507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4219/8433] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:37:15.642744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d8008-fbb3-49e5-b742-8b9127479ef4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:15.653259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18d8008-fbb3-49e5-b742-8b9127479ef4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:15.658045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e85fcb-b53c-4f85-8b1f-8aac4b17403d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:15.658649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e85fcb-b53c-4f85-8b1f-8aac4b17403d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.658934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e85fcb-b53c-4f85-8b1f-8aac4b17403d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.659210 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e85fcb-b53c-4f85-8b1f-8aac4b17403d admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.659853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e85fcb-b53c-4f85-8b1f-8aac4b17403d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:37:15.660155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e85fcb-b53c-4f85-8b1f-8aac4b17403d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:15.661806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e85fcb-b53c-4f85-8b1f-8aac4b17403d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:15.673453 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4215/8434] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:37:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:37:15.677703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d7e6e-0193-4339-b3aa-5ade423524ed None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:15.687106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049d7e6e-0193-4339-b3aa-5ade423524ed None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:15.691749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0817cf5-da29-4939-82fa-b531b7d1fea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:15.692424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0817cf5-da29-4939-82fa-b531b7d1fea6 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.692720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0817cf5-da29-4939-82fa-b531b7d1fea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.693001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0817cf5-da29-4939-82fa-b531b7d1fea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.693659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0817cf5-da29-4939-82fa-b531b7d1fea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:15.695601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0817cf5-da29-4939-82fa-b531b7d1fea6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:15.722925 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4220/8435] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:37:15 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:37:15.727343 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e85fcb-b53c-4f85-8b1f-8aac4b17403d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:15.737638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e85fcb-b53c-4f85-8b1f-8aac4b17403d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:15.773228 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:15.801044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11836a51-c727-4a15-b4e1-2ff4ac468906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:15.801681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11836a51-c727-4a15-b4e1-2ff4ac468906 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.802074 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11836a51-c727-4a15-b4e1-2ff4ac468906 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.802350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11836a51-c727-4a15-b4e1-2ff4ac468906 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.803004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11836a51-c727-4a15-b4e1-2ff4ac468906 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:15.804959 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11836a51-c727-4a15-b4e1-2ff4ac468906 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:15.827671 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4216/8436] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:37:15 2022] POST /identity/v3/users => generated 286 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:37:15.831855 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0817cf5-da29-4939-82fa-b531b7d1fea6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:15.837801 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:15.843549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0817cf5-da29-4939-82fa-b531b7d1fea6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:15.850814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff004127-93b0-4261-91ad-2ccb929688b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:15.851851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff004127-93b0-4261-91ad-2ccb929688b7 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.852484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff004127-93b0-4261-91ad-2ccb929688b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.852758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff004127-93b0-4261-91ad-2ccb929688b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.853460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff004127-93b0-4261-91ad-2ccb929688b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:15.855102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff004127-93b0-4261-91ad-2ccb929688b7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:15.865348 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4221/8437] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:37:15.869407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11836a51-c727-4a15-b4e1-2ff4ac468906 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:15.880217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11836a51-c727-4a15-b4e1-2ff4ac468906 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:15.885619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74fb2dc-7bbf-4cef-8a6a-59913052aceb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:15.886224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fb2dc-7bbf-4cef-8a6a-59913052aceb admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.886511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fb2dc-7bbf-4cef-8a6a-59913052aceb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.887450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74fb2dc-7bbf-4cef-8a6a-59913052aceb admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.888507 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fb2dc-7bbf-4cef-8a6a-59913052aceb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:15.890159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74fb2dc-7bbf-4cef-8a6a-59913052aceb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:15.901674 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4217/8438] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:37:15.905881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff004127-93b0-4261-91ad-2ccb929688b7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:15.916104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff004127-93b0-4261-91ad-2ccb929688b7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:15.920823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124776bd-da71-4c18-b0a9-7a2604069397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:15.921553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124776bd-da71-4c18-b0a9-7a2604069397 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.921838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124776bd-da71-4c18-b0a9-7a2604069397 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.922336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124776bd-da71-4c18-b0a9-7a2604069397 admin admin] PATH_INFO: `/v3/projects/4ddfb35413e745a9b82e8716819bc513/users/f81e5d2ba9fc40398712a5d0531db7c2/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.937406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124776bd-da71-4c18-b0a9-7a2604069397 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ddfb35413e745a9b82e8716819bc513, user_id=f81e5d2ba9fc40398712a5d0531db7c2, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:15.940063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124776bd-da71-4c18-b0a9-7a2604069397 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:15.954138 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4222/8439] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:37:15 2022] PUT /identity/v3/projects/4ddfb35413e745a9b82e8716819bc513/users/f81e5d2ba9fc40398712a5d0531db7c2/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:37:15.960398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d0e4-d28a-4e9d-ae1b-4064d64f7603 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:15.960699 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d0e4-d28a-4e9d-ae1b-4064d64f7603 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:15.960982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d1d0e4-d28a-4e9d-ae1b-4064d64f7603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:15.982159 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-49d1d0e4-d28a-4e9d-ae1b-4064d64f7603 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:37:15.983551 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-49d1d0e4-d28a-4e9d-ae1b-4064d64f7603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:16.045341 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4218/8440] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:37:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:37:16.055194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124776bd-da71-4c18-b0a9-7a2604069397 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:16.056944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-124776bd-da71-4c18-b0a9-7a2604069397 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:16.119538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124776bd-da71-4c18-b0a9-7a2604069397 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:16.124295 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833ea43-f84a-447e-ac75-c629feb98249 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:16.125251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833ea43-f84a-447e-ac75-c629feb98249 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:16.125389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833ea43-f84a-447e-ac75-c629feb98249 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:16.126449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1833ea43-f84a-447e-ac75-c629feb98249 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:16.137946 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833ea43-f84a-447e-ac75-c629feb98249 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:16.139646 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1833ea43-f84a-447e-ac75-c629feb98249 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:16.150199 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4223/8441] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:37:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:37:16.866466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290d84e-f66e-4395-a7aa-80aab07243ab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:16.866866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290d84e-f66e-4395-a7aa-80aab07243ab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:16.867222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290d84e-f66e-4395-a7aa-80aab07243ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:16.893052 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5290d84e-f66e-4395-a7aa-80aab07243ab None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:37:16.894891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5290d84e-f66e-4395-a7aa-80aab07243ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:16.969427 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4219/8442] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:37:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:37:17.039627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833ea43-f84a-447e-ac75-c629feb98249 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:17.043069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1833ea43-f84a-447e-ac75-c629feb98249 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:17.157218 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1833ea43-f84a-447e-ac75-c629feb98249 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:17.166430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717599d1-d7e3-4ae7-bb1a-b1c4084f94b6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:17.167061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717599d1-d7e3-4ae7-bb1a-b1c4084f94b6 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:17.167342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717599d1-d7e3-4ae7-bb1a-b1c4084f94b6 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:17.167609 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717599d1-d7e3-4ae7-bb1a-b1c4084f94b6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:17.184883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717599d1-d7e3-4ae7-bb1a-b1c4084f94b6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:17.186782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717599d1-d7e3-4ae7-bb1a-b1c4084f94b6 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:17.196531 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4224/8443] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:37:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 09:37:18.575121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fcf9e-9f94-4c0e-bb45-74c60f131a09 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:18.575614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fcf9e-9f94-4c0e-bb45-74c60f131a09 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:18.575715 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17fcf9e-9f94-4c0e-bb45-74c60f131a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:18.595297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f17fcf9e-9f94-4c0e-bb45-74c60f131a09 None None] MFA Rules not processed for user `db0afba834c04bdc92565bf8e9a57ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:37:18.596910 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f17fcf9e-9f94-4c0e-bb45-74c60f131a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:18.691346 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4220/8444] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:37:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:37:20.591660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad165ab-eff4-4a2d-857e-5784c283f389 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:20.592208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad165ab-eff4-4a2d-857e-5784c283f389 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:20.592390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad165ab-eff4-4a2d-857e-5784c283f389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:20.625526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-8ad165ab-eff4-4a2d-857e-5784c283f389 None None] MFA Rules not processed for user `f81e5d2ba9fc40398712a5d0531db7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:37:20.626742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8ad165ab-eff4-4a2d-857e-5784c283f389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:20.700044 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:20.735267 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4225/8445] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:37:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:37:20.740166 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fcf9e-9f94-4c0e-bb45-74c60f131a09 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:20.753731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17fcf9e-9f94-4c0e-bb45-74c60f131a09 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:20.760119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09552f0-18a2-4eeb-b812-3af234acfcc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:20.762293 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09552f0-18a2-4eeb-b812-3af234acfcc6 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:20.763009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09552f0-18a2-4eeb-b812-3af234acfcc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:20.763009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09552f0-18a2-4eeb-b812-3af234acfcc6 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:20.763893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09552f0-18a2-4eeb-b812-3af234acfcc6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:20.765988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09552f0-18a2-4eeb-b812-3af234acfcc6 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:20.771073 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:20.815694 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4221/8446] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:37:20 2022] POST /identity/v3/projects => generated 371 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:37:20.817030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad165ab-eff4-4a2d-857e-5784c283f389 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:20.846532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad165ab-eff4-4a2d-857e-5784c283f389 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:20.959030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44862bd-2455-4d9d-8b28-b1e4b0044d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:20.959683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44862bd-2455-4d9d-8b28-b1e4b0044d16 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:20.960228 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44862bd-2455-4d9d-8b28-b1e4b0044d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:20.960508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44862bd-2455-4d9d-8b28-b1e4b0044d16 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:20.961145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44862bd-2455-4d9d-8b28-b1e4b0044d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:20.963370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44862bd-2455-4d9d-8b28-b1e4b0044d16 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:20.996055 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4226/8447] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:37:20 2022] POST /identity/v3/users => generated 292 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:37:20.999816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09552f0-18a2-4eeb-b812-3af234acfcc6 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:21.012950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09552f0-18a2-4eeb-b812-3af234acfcc6 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:21.018806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28875f-d9ec-453a-bd4c-0762a90ecb44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:21.021029 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28875f-d9ec-453a-bd4c-0762a90ecb44 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:21.022206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28875f-d9ec-453a-bd4c-0762a90ecb44 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:21.022601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28875f-d9ec-453a-bd4c-0762a90ecb44 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:21.023818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28875f-d9ec-453a-bd4c-0762a90ecb44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:21.026087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28875f-d9ec-453a-bd4c-0762a90ecb44 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:21.043436 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4222/8448] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:37:21.047472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44862bd-2455-4d9d-8b28-b1e4b0044d16 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:21.062595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44862bd-2455-4d9d-8b28-b1e4b0044d16 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:21.077638 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739d246-45e9-451a-8375-c7f9affe07ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:21.078388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739d246-45e9-451a-8375-c7f9affe07ac admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:21.078743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739d246-45e9-451a-8375-c7f9affe07ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:21.079088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739d246-45e9-451a-8375-c7f9affe07ac admin admin] PATH_INFO: `/v3/projects/f88d4e443ade4617ad39243f80cdc776/users/632175e54e7d41719b65c6188dcb3c0a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:21.108172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739d246-45e9-451a-8375-c7f9affe07ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88d4e443ade4617ad39243f80cdc776, user_id=632175e54e7d41719b65c6188dcb3c0a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:21.111396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3739d246-45e9-451a-8375-c7f9affe07ac admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:21.146048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28875f-d9ec-453a-bd4c-0762a90ecb44 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:21.150319 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4227/8449] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:37:21 2022] PUT /identity/v3/projects/f88d4e443ade4617ad39243f80cdc776/users/632175e54e7d41719b65c6188dcb3c0a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:37:21.164118 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28875f-d9ec-453a-bd4c-0762a90ecb44 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:21.275412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80689c9-8fea-4c02-8a5f-45b02e9cab36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:21.275951 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80689c9-8fea-4c02-8a5f-45b02e9cab36 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:21.276241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80689c9-8fea-4c02-8a5f-45b02e9cab36 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:21.276829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80689c9-8fea-4c02-8a5f-45b02e9cab36 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:21.277232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80689c9-8fea-4c02-8a5f-45b02e9cab36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:21.279525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80689c9-8fea-4c02-8a5f-45b02e9cab36 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:21.292500 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4223/8450] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:37:21.296407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739d246-45e9-451a-8375-c7f9affe07ac admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:21.310327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739d246-45e9-451a-8375-c7f9affe07ac admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:21.316936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5fbea-cd07-4b39-b7f5-6dd02c817f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:21.316936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5fbea-cd07-4b39-b7f5-6dd02c817f81 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:21.316936 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5fbea-cd07-4b39-b7f5-6dd02c817f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:21.317246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5fbea-cd07-4b39-b7f5-6dd02c817f81 admin admin] PATH_INFO: `/v3/projects/f88d4e443ade4617ad39243f80cdc776/users/632175e54e7d41719b65c6188dcb3c0a/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:21.319798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5fbea-cd07-4b39-b7f5-6dd02c817f81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f88d4e443ade4617ad39243f80cdc776, user_id=632175e54e7d41719b65c6188dcb3c0a, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:21.323180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b5fbea-cd07-4b39-b7f5-6dd02c817f81 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:21.341692 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4228/8451] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:37:21 2022] PUT /identity/v3/projects/f88d4e443ade4617ad39243f80cdc776/users/632175e54e7d41719b65c6188dcb3c0a/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:37:29.081616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cca7b-1383-4066-b5c1-bae077fb6914 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:29.082577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cca7b-1383-4066-b5c1-bae077fb6914 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:29.083016 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9cca7b-1383-4066-b5c1-bae077fb6914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:29.163668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0e9cca7b-1383-4066-b5c1-bae077fb6914 None None] MFA Rules not processed for user `632175e54e7d41719b65c6188dcb3c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:37:29.165059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0e9cca7b-1383-4066-b5c1-bae077fb6914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:29.327509 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4224/8452] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:37:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:37:29.345488 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5fbea-cd07-4b39-b7f5-6dd02c817f81 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:29.347235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-51b5fbea-cd07-4b39-b7f5-6dd02c817f81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:29.505149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5fbea-cd07-4b39-b7f5-6dd02c817f81 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:29.513203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8775f-6253-46d8-a3d8-b949a2a0720c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:29.514142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8775f-6253-46d8-a3d8-b949a2a0720c service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:29.514431 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8775f-6253-46d8-a3d8-b949a2a0720c service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:29.514697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8775f-6253-46d8-a3d8-b949a2a0720c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:29.563035 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:29.585734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8775f-6253-46d8-a3d8-b949a2a0720c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:29.587357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8775f-6253-46d8-a3d8-b949a2a0720c service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:29.596958 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4229/8453] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:37:29 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:37:30.926059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442b90-6104-4674-9d19-d0ec5b9acc7f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:30.926059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442b90-6104-4674-9d19-d0ec5b9acc7f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:30.927877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67442b90-6104-4674-9d19-d0ec5b9acc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:30.952225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-67442b90-6104-4674-9d19-d0ec5b9acc7f None None] MFA Rules not processed for user `f81e5d2ba9fc40398712a5d0531db7c2`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:37:30.953545 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-67442b90-6104-4674-9d19-d0ec5b9acc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:37:30.961316 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4225/8454] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:37:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:37:39.592346 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:40.944835 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=77,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:37:43.205367 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8775f-6253-46d8-a3d8-b949a2a0720c service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:37:43.268202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8775f-6253-46d8-a3d8-b949a2a0720c service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:37:43.272068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323434ee-8a2b-490f-ba4c-4055f87dcf97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:37:43.272670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323434ee-8a2b-490f-ba4c-4055f87dcf97 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:37:43.272962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323434ee-8a2b-490f-ba4c-4055f87dcf97 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:37:43.273231 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323434ee-8a2b-490f-ba4c-4055f87dcf97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:37:43.283103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323434ee-8a2b-490f-ba4c-4055f87dcf97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:37:43.284595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323434ee-8a2b-490f-ba4c-4055f87dcf97 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:37:43.295053 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4230/8455] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:37:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:37:53.289821 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=26 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:14.657516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5d5f-4f7d-4b77-8af7-f7749e3647d6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:14.658031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5d5f-4f7d-4b77-8af7-f7749e3647d6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:14.658136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b5d5f-4f7d-4b77-8af7-f7749e3647d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:14.678497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8b5b5d5f-4f7d-4b77-8af7-f7749e3647d6 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:38:14.679748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8b5b5d5f-4f7d-4b77-8af7-f7749e3647d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:14.736375 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4226/8456] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 09:38:14 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:38:14.749210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323434ee-8a2b-490f-ba4c-4055f87dcf97 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:14.836041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323434ee-8a2b-490f-ba4c-4055f87dcf97 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:14.841063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f3112-e27e-41fb-9c3a-907f29c7f9b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:14.841772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f3112-e27e-41fb-9c3a-907f29c7f9b8 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:14.842055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f3112-e27e-41fb-9c3a-907f29c7f9b8 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:14.842330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f3112-e27e-41fb-9c3a-907f29c7f9b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:14.850647 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f3112-e27e-41fb-9c3a-907f29c7f9b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:14.852232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f3112-e27e-41fb-9c3a-907f29c7f9b8 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:14.860242 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4231/8457] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:38:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:38:20.285028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b5d5f-4f7d-4b77-8af7-f7749e3647d6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:20.286590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8b5b5d5f-4f7d-4b77-8af7-f7749e3647d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:20.301835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b5d5f-4f7d-4b77-8af7-f7749e3647d6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:20.305820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723eb9e-61a7-426a-81cc-8e668d9a24ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:20.306621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723eb9e-61a7-426a-81cc-8e668d9a24ab service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:20.306906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723eb9e-61a7-426a-81cc-8e668d9a24ab service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:20.307185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3723eb9e-61a7-426a-81cc-8e668d9a24ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:20.308941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3723eb9e-61a7-426a-81cc-8e668d9a24ab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:20.322430 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723eb9e-61a7-426a-81cc-8e668d9a24ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:20.323926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3723eb9e-61a7-426a-81cc-8e668d9a24ab service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:20.337890 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4227/8458] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:38:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:38:20.489614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f3112-e27e-41fb-9c3a-907f29c7f9b8 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:20.503095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f3112-e27e-41fb-9c3a-907f29c7f9b8 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:20.506926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68beba5c-07a4-4384-9771-4fa18af044c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:20.507565 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68beba5c-07a4-4384-9771-4fa18af044c0 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:20.507849 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68beba5c-07a4-4384-9771-4fa18af044c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:20.508120 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68beba5c-07a4-4384-9771-4fa18af044c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:20.509897 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-68beba5c-07a4-4384-9771-4fa18af044c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:20.525749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68beba5c-07a4-4384-9771-4fa18af044c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:20.527197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68beba5c-07a4-4384-9771-4fa18af044c0 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:20.538348 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4232/8459] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:38:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:38:21.555895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723eb9e-61a7-426a-81cc-8e668d9a24ab service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:21.581053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3723eb9e-61a7-426a-81cc-8e668d9a24ab service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:21.597853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845142bd-d8c8-4ad4-93eb-7d7d9e7d0a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:21.598626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845142bd-d8c8-4ad4-93eb-7d7d9e7d0a54 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:21.599245 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845142bd-d8c8-4ad4-93eb-7d7d9e7d0a54 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:21.599600 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845142bd-d8c8-4ad4-93eb-7d7d9e7d0a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:21.601873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-845142bd-d8c8-4ad4-93eb-7d7d9e7d0a54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:21.620617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845142bd-d8c8-4ad4-93eb-7d7d9e7d0a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:21.622904 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845142bd-d8c8-4ad4-93eb-7d7d9e7d0a54 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:21.642831 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4228/8460] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:38:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:38:21.744359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68beba5c-07a4-4384-9771-4fa18af044c0 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:21.758774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68beba5c-07a4-4384-9771-4fa18af044c0 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:21.764586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfd146-f71c-4abf-aea5-3030e6f5ccbc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:21.765650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfd146-f71c-4abf-aea5-3030e6f5ccbc service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:21.766000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfd146-f71c-4abf-aea5-3030e6f5ccbc service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:21.766360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bfd146-f71c-4abf-aea5-3030e6f5ccbc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:21.768605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-48bfd146-f71c-4abf-aea5-3030e6f5ccbc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:21.806863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfd146-f71c-4abf-aea5-3030e6f5ccbc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:21.808536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bfd146-f71c-4abf-aea5-3030e6f5ccbc service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:21.831503 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4233/8461] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:38:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:38:31.631183 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=37 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:31.822768 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=44 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:32.563916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3df20d-0f55-417f-af61-ad5da7e9000c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:32.564239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3df20d-0f55-417f-af61-ad5da7e9000c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:32.564521 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3df20d-0f55-417f-af61-ad5da7e9000c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:32.587240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1d3df20d-0f55-417f-af61-ad5da7e9000c None None] MFA Rules not processed for user `db0afba834c04bdc92565bf8e9a57ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:38:32.588451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d3df20d-0f55-417f-af61-ad5da7e9000c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:32.672473 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4229/8462] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:38:32 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:38:32.724962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfd146-f71c-4abf-aea5-3030e6f5ccbc service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:32.833921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bfd146-f71c-4abf-aea5-3030e6f5ccbc service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:32.847093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:32.848060 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:32.848514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:32.848958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] PATH_INFO: `/v3/users/f81e5d2ba9fc40398712a5d0531db7c2` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:32.851221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f81e5d2ba9fc40398712a5d0531db7c2)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:32.853469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:32.921941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f81e5d2ba9fc40398712a5d0531db7c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:32.938778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f81e5d2ba9fc40398712a5d0531db7c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:32.940252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f81e5d2ba9fc40398712a5d0531db7c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:32.949718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f81e5d2ba9fc40398712a5d0531db7c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:32.958241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f81e5d2ba9fc40398712a5d0531db7c2'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:32.965372 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4234/8463] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:38:32 2022] DELETE /identity/v3/users/f81e5d2ba9fc40398712a5d0531db7c2 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:38:33.111469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3df20d-0f55-417f-af61-ad5da7e9000c None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:33.124506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3df20d-0f55-417f-af61-ad5da7e9000c None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:33.178990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9e56-9861-4535-aa6e-17ba219581cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:33.179601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9e56-9861-4535-aa6e-17ba219581cc service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:33.179882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9e56-9861-4535-aa6e-17ba219581cc service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:33.180157 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb9e56-9861-4535-aa6e-17ba219581cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:33.181956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ebdb9e56-9861-4535-aa6e-17ba219581cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:33.183428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:33.185223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:33.199817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb9e56-9861-4535-aa6e-17ba219581cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:33.202005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb9e56-9861-4535-aa6e-17ba219581cc service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:33.222715 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4230/8464] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:38:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:38:33.259599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daf7b92-d71c-4023-a25a-bc32b2052256 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:33.264441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:33.265012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:33.265304 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:33.265888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] PATH_INFO: `/v3/projects/4ddfb35413e745a9b82e8716819bc513` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:33.267063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ddfb35413e745a9b82e8716819bc513)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:33.268970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:33.292615 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:33.317817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ddfb35413e745a9b82e8716819bc513', 'request_id': 'req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.324010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ddfb35413e745a9b82e8716819bc513', 'request_id': 'req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.331813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ddfb35413e745a9b82e8716819bc513', 'request_id': 'req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.343140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] The token cache is being invalidate because project 4ddfb35413e745a9b82e8716819bc513 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:38:33.343425 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.344059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.345672 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4235/8465] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:38:33 2022] DELETE /identity/v3/projects/4ddfb35413e745a9b82e8716819bc513 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:38:33.349704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9e56-9861-4535-aa6e-17ba219581cc service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:33.361599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb9e56-9861-4535-aa6e-17ba219581cc service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:33.420779 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:33.421448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:33.421738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:33.422018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] PATH_INFO: `/v3/users/632175e54e7d41719b65c6188dcb3c0a` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:33.423718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] RBAC: Authorizing `identity:delete_user(user_id=632175e54e7d41719b65c6188dcb3c0a)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:33.425617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:33.473043 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '632175e54e7d41719b65c6188dcb3c0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.475303 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:33.486734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '632175e54e7d41719b65c6188dcb3c0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.487481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '632175e54e7d41719b65c6188dcb3c0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.497950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '632175e54e7d41719b65c6188dcb3c0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.505194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '632175e54e7d41719b65c6188dcb3c0a'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.511878 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4231/8466] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:38:33 2022] DELETE /identity/v3/users/632175e54e7d41719b65c6188dcb3c0a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:38:33.688199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:33.690606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:33.697424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:33.699495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:33.779996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9dbb78-b7d7-4c2d-8af5-aa71aca4429f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:33.785150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:33.785819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:33.786072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e40cc62-985d-4f93-9bcb-7ffa75c1b14e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:33.786176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:33.786380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] PATH_INFO: `/v3/projects/f88d4e443ade4617ad39243f80cdc776` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:33.787494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f88d4e443ade4617ad39243f80cdc776)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:33.789440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:33.842094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f88d4e443ade4617ad39243f80cdc776', 'request_id': 'req-db158ebb-0752-4973-8662-fe4ea5f05646'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.848220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:33.848920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:33.849201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:33.849504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:33.850398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f88d4e443ade4617ad39243f80cdc776', 'request_id': 'req-db158ebb-0752-4973-8662-fe4ea5f05646'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.851291 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:33.856941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f88d4e443ade4617ad39243f80cdc776', 'request_id': 'req-db158ebb-0752-4973-8662-fe4ea5f05646'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.865403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:33.867000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:33.867829 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] The token cache is being invalidate because project f88d4e443ade4617ad39243f80cdc776 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:38:33.868123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.868787 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:38:33.870315 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4232/8467] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:38:33 2022] DELETE /identity/v3/projects/f88d4e443ade4617ad39243f80cdc776 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:38:33.881465 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4236/8468] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:38:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:38:43.864720 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=62,keystone:DELETE=10,keystone:INSERT=2 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:43.872871 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=7,keystone:SELECT=73,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:38:51.570499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:38:51.572113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:51.650706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db158ebb-0752-4973-8662-fe4ea5f05646 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:38:51.656334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:38:51.656882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:38:51.657165 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:38:51.657496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:38:51.659225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:38:51.674253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:38:51.675831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:38:51.689473 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4233/8469] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:38:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:39:01.681854 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=34 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:39:42.602169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:39:42.603606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:39:42.680330 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88028bc5-7ac8-46dc-ac22-08ea7390a92f service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:39:42.738867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:39:42.739465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:39:42.739743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:39:42.740015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:39:42.741740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:39:42.755226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:39:42.756776 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:39:42.769730 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4237/8470] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:39:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:39:52.762797 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=59 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:40:34.803970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:40:34.805390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:40:34.880659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7ed055-2779-4971-af12-4b9cd25ccdb7 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:40:34.885749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a35bd7-e757-4fa2-8c1e-974c7a152448 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:40:34.886351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a35bd7-e757-4fa2-8c1e-974c7a152448 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:40:34.886628 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a35bd7-e757-4fa2-8c1e-974c7a152448 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:40:34.886900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a35bd7-e757-4fa2-8c1e-974c7a152448 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:40:34.888762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e8a35bd7-e757-4fa2-8c1e-974c7a152448 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:40:34.903117 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a35bd7-e757-4fa2-8c1e-974c7a152448 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:40:34.905198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a35bd7-e757-4fa2-8c1e-974c7a152448 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:40:34.917611 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4234/8471] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:40:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:40:44.910830 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=32 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:40:50.199441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:40:50.202526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:40:50.229744 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641bb43a-77c9-4c90-ba15-5bd607fa6af4 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:40:50.235162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcf72b-fe25-4279-a9fe-d41ac4b95907 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:40:50.235753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcf72b-fe25-4279-a9fe-d41ac4b95907 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:40:50.236034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcf72b-fe25-4279-a9fe-d41ac4b95907 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:40:50.236305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcf72b-fe25-4279-a9fe-d41ac4b95907 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:40:50.237986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7fcf72b-fe25-4279-a9fe-d41ac4b95907 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:40:50.294886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcf72b-fe25-4279-a9fe-d41ac4b95907 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:40:50.296470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcf72b-fe25-4279-a9fe-d41ac4b95907 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:40:50.305309 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4238/8472] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:40:50 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:40:58.403241 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53871896-a71c-40bf-b356-475ae34c34dc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:40:58.403740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53871896-a71c-40bf-b356-475ae34c34dc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:40:58.403740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53871896-a71c-40bf-b356-475ae34c34dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:40:58.424546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-53871896-a71c-40bf-b356-475ae34c34dc None None] MFA Rules not processed for user `db0afba834c04bdc92565bf8e9a57ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:40:58.425850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-53871896-a71c-40bf-b356-475ae34c34dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:40:58.432578 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4235/8473] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:40:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:40:58.752748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6a55-8ebd-46f1-be4a-339d2a401995 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:40:58.753190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6a55-8ebd-46f1-be4a-339d2a401995 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:40:58.753320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2d6a55-8ebd-46f1-be4a-339d2a401995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:40:58.816592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7e2d6a55-8ebd-46f1-be4a-339d2a401995 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:40:58.818241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7e2d6a55-8ebd-46f1-be4a-339d2a401995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:40:58.878112 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4239/8474] 10.222.0.25 () {58 vars in 1061 bytes} [Mon Oct 24 09:40:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:40:58.884240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53871896-a71c-40bf-b356-475ae34c34dc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:40:58.894090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53871896-a71c-40bf-b356-475ae34c34dc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:40:58.897828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db6566-6e9e-43e9-99a5-c0f278ec7c7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:40:58.898427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db6566-6e9e-43e9-99a5-c0f278ec7c7b service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:40:58.898705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db6566-6e9e-43e9-99a5-c0f278ec7c7b service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:40:58.898981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db6566-6e9e-43e9-99a5-c0f278ec7c7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:40:58.900687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b0db6566-6e9e-43e9-99a5-c0f278ec7c7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:40:58.913225 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db6566-6e9e-43e9-99a5-c0f278ec7c7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:40:58.914679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db6566-6e9e-43e9-99a5-c0f278ec7c7b service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:40:58.925593 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4236/8475] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:40:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:40:59.366730 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deee80-2f01-445d-bc1e-67d22351c84b None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:40:59.367023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deee80-2f01-445d-bc1e-67d22351c84b None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:40:59.367306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5deee80-2f01-445d-bc1e-67d22351c84b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:40:59.409309 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e5deee80-2f01-445d-bc1e-67d22351c84b None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:40:59.410545 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e5deee80-2f01-445d-bc1e-67d22351c84b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:40:59.420681 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4240/8476] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:40:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:40:59.432239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db6566-6e9e-43e9-99a5-c0f278ec7c7b service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:40:59.447380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db6566-6e9e-43e9-99a5-c0f278ec7c7b service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:40:59.452976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04e7ece-7dc0-4335-9668-add61765fb98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:40:59.453675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e7ece-7dc0-4335-9668-add61765fb98 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:40:59.453955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e7ece-7dc0-4335-9668-add61765fb98 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:40:59.454228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04e7ece-7dc0-4335-9668-add61765fb98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:40:59.462462 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e7ece-7dc0-4335-9668-add61765fb98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:40:59.464024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04e7ece-7dc0-4335-9668-add61765fb98 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:40:59.474014 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4237/8477] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:40:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:41:09.406558 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=83 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:41:09.470056 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=15 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:41:18.438543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deee80-2f01-445d-bc1e-67d22351c84b None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:41:18.447524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5deee80-2f01-445d-bc1e-67d22351c84b None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:41:18.451559 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:41:18.452145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:41:18.452424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:41:18.452694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:41:18.454396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:41:18.516094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:41:18.517558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:41:18.527145 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4241/8478] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:41:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:41:28.523011 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=30 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:42:58.354042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084b266-2ee0-4b12-8c2f-55b2dd88dd2a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:42:58.354499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084b266-2ee0-4b12-8c2f-55b2dd88dd2a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:42:58.354616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d084b266-2ee0-4b12-8c2f-55b2dd88dd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:42:58.373654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d084b266-2ee0-4b12-8c2f-55b2dd88dd2a None None] MFA Rules not processed for user `db0afba834c04bdc92565bf8e9a57ee9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:42:58.374841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d084b266-2ee0-4b12-8c2f-55b2dd88dd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:42:58.381587 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4238/8479] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:42:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:42:58.431009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:42:58.432393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:42:58.512345 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204ffae-56b4-4e7e-9b89-5af75cfc32db service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:42:58.515950 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb716bd8-949a-4205-b579-0f393b4c3d22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:42:58.516564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb716bd8-949a-4205-b579-0f393b4c3d22 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:42:58.516831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb716bd8-949a-4205-b579-0f393b4c3d22 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:42:58.517108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb716bd8-949a-4205-b579-0f393b4c3d22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:42:58.518843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-eb716bd8-949a-4205-b579-0f393b4c3d22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:42:58.553793 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb716bd8-949a-4205-b579-0f393b4c3d22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:42:58.555222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb716bd8-949a-4205-b579-0f393b4c3d22 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:42:58.569074 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4242/8480] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:42:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:42:59.282246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1224fa-8886-4f5d-ab9a-ff30dd70cdab None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:42:59.282564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1224fa-8886-4f5d-ab9a-ff30dd70cdab None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:42:59.282872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1224fa-8886-4f5d-ab9a-ff30dd70cdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:42:59.303396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8d1224fa-8886-4f5d-ab9a-ff30dd70cdab None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:42:59.304607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8d1224fa-8886-4f5d-ab9a-ff30dd70cdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:42:59.313821 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4239/8481] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:42:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:42:59.319370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408cab3-2938-49b1-89e2-46bc9267912c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:42:59.319715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408cab3-2938-49b1-89e2-46bc9267912c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:42:59.320023 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2408cab3-2938-49b1-89e2-46bc9267912c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:42:59.333322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1224fa-8886-4f5d-ab9a-ff30dd70cdab None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:42:59.341055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2408cab3-2938-49b1-89e2-46bc9267912c None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:42:59.342284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2408cab3-2938-49b1-89e2-46bc9267912c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:42:59.346523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1224fa-8886-4f5d-ab9a-ff30dd70cdab None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:42:59.348934 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4243/8482] 10.222.0.25 () {58 vars in 1061 bytes} [Mon Oct 24 09:42:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:42:59.351622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f410a4-33bc-4815-bc18-2cb98ee4d069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:42:59.352228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f410a4-33bc-4815-bc18-2cb98ee4d069 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:42:59.352511 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f410a4-33bc-4815-bc18-2cb98ee4d069 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:42:59.352789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f410a4-33bc-4815-bc18-2cb98ee4d069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:42:59.354971 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408cab3-2938-49b1-89e2-46bc9267912c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:42:59.362482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f410a4-33bc-4815-bc18-2cb98ee4d069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:42:59.363314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2408cab3-2938-49b1-89e2-46bc9267912c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:42:59.364065 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f410a4-33bc-4815-bc18-2cb98ee4d069 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:42:59.366954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a898e-c79b-4eca-a374-59d9c57f69b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:42:59.367525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a898e-c79b-4eca-a374-59d9c57f69b4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:42:59.367799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a898e-c79b-4eca-a374-59d9c57f69b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:42:59.368068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0a898e-c79b-4eca-a374-59d9c57f69b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:42:59.369769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6d0a898e-c79b-4eca-a374-59d9c57f69b4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:42:59.374185 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4240/8483] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:42:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:42:59.386052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a898e-c79b-4eca-a374-59d9c57f69b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:42:59.387973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0a898e-c79b-4eca-a374-59d9c57f69b4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:42:59.401578 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4244/8484] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:42:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:43:01.198821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f410a4-33bc-4815-bc18-2cb98ee4d069 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:43:01.208843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f410a4-33bc-4815-bc18-2cb98ee4d069 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:43:01.212530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3eddc-a3eb-4e7c-92f5-d62d767c5adb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:43:01.213151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3eddc-a3eb-4e7c-92f5-d62d767c5adb service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:43:01.213490 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3eddc-a3eb-4e7c-92f5-d62d767c5adb service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:43:01.213758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b3eddc-a3eb-4e7c-92f5-d62d767c5adb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:43:01.216164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f0b3eddc-a3eb-4e7c-92f5-d62d767c5adb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:43:01.229501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3eddc-a3eb-4e7c-92f5-d62d767c5adb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:43:01.231409 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b3eddc-a3eb-4e7c-92f5-d62d767c5adb service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:43:01.244326 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4241/8485] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:43:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:43:02.012741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a898e-c79b-4eca-a374-59d9c57f69b4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:43:02.035318 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0a898e-c79b-4eca-a374-59d9c57f69b4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:43:02.042116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:43:02.042892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:43:02.043273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:43:02.043866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:43:02.046749 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:43:02.065689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:43:02.067378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:43:02.084483 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4245/8486] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:43:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:43:11.236956 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=18 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:43:12.075625 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=58 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:43:45.473501 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3eddc-a3eb-4e7c-92f5-d62d767c5adb service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:43:45.482169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b3eddc-a3eb-4e7c-92f5-d62d767c5adb service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:43:45.485941 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed484-07e1-4a3a-aa90-1f9f1f97f167 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:43:45.486538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed484-07e1-4a3a-aa90-1f9f1f97f167 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:43:45.486820 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed484-07e1-4a3a-aa90-1f9f1f97f167 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:43:45.487094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08fed484-07e1-4a3a-aa90-1f9f1f97f167 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:43:45.488851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08fed484-07e1-4a3a-aa90-1f9f1f97f167 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:43:45.501593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fed484-07e1-4a3a-aa90-1f9f1f97f167 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:43:45.503020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08fed484-07e1-4a3a-aa90-1f9f1f97f167 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:43:45.514526 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4242/8487] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:43:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:43:55.507614 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:44:46.550720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:44:46.552624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:44:46.570235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa405de8-7690-457d-a58e-fc2ff078f2b3 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:44:46.577816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40243aa5-2a36-4ad6-949a-7e97e5adfc80 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:44:46.578455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40243aa5-2a36-4ad6-949a-7e97e5adfc80 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:44:46.578941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40243aa5-2a36-4ad6-949a-7e97e5adfc80 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:44:46.579081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40243aa5-2a36-4ad6-949a-7e97e5adfc80 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:44:46.592556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40243aa5-2a36-4ad6-949a-7e97e5adfc80 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:44:46.594241 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40243aa5-2a36-4ad6-949a-7e97e5adfc80 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:44:46.608431 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4246/8488] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:44:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:44:56.601016 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:44:59.586793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed484-07e1-4a3a-aa90-1f9f1f97f167 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:44:59.609968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08fed484-07e1-4a3a-aa90-1f9f1f97f167 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:44:59.616641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdd8b8-f4f7-4ce4-8904-b8f758e5dbbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:44:59.617260 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdd8b8-f4f7-4ce4-8904-b8f758e5dbbd service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:44:59.617585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdd8b8-f4f7-4ce4-8904-b8f758e5dbbd service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:44:59.617865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecdd8b8-f4f7-4ce4-8904-b8f758e5dbbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:44:59.619675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0ecdd8b8-f4f7-4ce4-8904-b8f758e5dbbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:44:59.635500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdd8b8-f4f7-4ce4-8904-b8f758e5dbbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:44:59.637087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecdd8b8-f4f7-4ce4-8904-b8f758e5dbbd service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:44:59.652465 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4243/8489] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:44:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:45:09.643784 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:24.299605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40243aa5-2a36-4ad6-949a-7e97e5adfc80 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:24.309947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40243aa5-2a36-4ad6-949a-7e97e5adfc80 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:24.313835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:24.314438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:24.314719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:24.314997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:24.316767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:24.404606 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:24.406086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:24.425677 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4247/8490] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:45:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:45:27.284491 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdd8b8-f4f7-4ce4-8904-b8f758e5dbbd service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:27.303665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecdd8b8-f4f7-4ce4-8904-b8f758e5dbbd service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:27.309640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec5185-83ab-4964-b72d-14dc9873dcdf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:27.310255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec5185-83ab-4964-b72d-14dc9873dcdf service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:27.310554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec5185-83ab-4964-b72d-14dc9873dcdf service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:27.310835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec5185-83ab-4964-b72d-14dc9873dcdf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:27.313129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-acec5185-83ab-4964-b72d-14dc9873dcdf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:27.330532 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec5185-83ab-4964-b72d-14dc9873dcdf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:27.332247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec5185-83ab-4964-b72d-14dc9873dcdf service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:27.355956 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4244/8491] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:45:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:45:30.625181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:30.627007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:30.647226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4162b1-7c80-495f-9c5c-670dd1c695a8 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:30.652144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:30.652769 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:30.653045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:30.653341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] PATH_INFO: `/v3/users/db0afba834c04bdc92565bf8e9a57ee9` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:30.667046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db0afba834c04bdc92565bf8e9a57ee9)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:30.668962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:30.716148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db0afba834c04bdc92565bf8e9a57ee9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:30.728527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db0afba834c04bdc92565bf8e9a57ee9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:30.729193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db0afba834c04bdc92565bf8e9a57ee9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:30.736381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db0afba834c04bdc92565bf8e9a57ee9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:30.743561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db0afba834c04bdc92565bf8e9a57ee9'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:30.749466 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4248/8492] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:45:30 2022] DELETE /identity/v3/users/db0afba834c04bdc92565bf8e9a57ee9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:30.928276 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec5185-83ab-4964-b72d-14dc9873dcdf service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:30.938950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec5185-83ab-4964-b72d-14dc9873dcdf service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:30.998054 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:30.998693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:30.998970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:30.999239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] PATH_INFO: `/v3/projects/ec0e7acf72144b558f1ba2f863244f89` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:31.011091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec0e7acf72144b558f1ba2f863244f89)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:31.013247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:31.060314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec0e7acf72144b558f1ba2f863244f89', 'request_id': 'req-ebf1ef3f-7ddb-4014-a420-57e304f66228'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.067759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec0e7acf72144b558f1ba2f863244f89', 'request_id': 'req-ebf1ef3f-7ddb-4014-a420-57e304f66228'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.075489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec0e7acf72144b558f1ba2f863244f89', 'request_id': 'req-ebf1ef3f-7ddb-4014-a420-57e304f66228'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.085858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] The token cache is being invalidate because project ec0e7acf72144b558f1ba2f863244f89 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:45:31.086147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.086785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.088337 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4245/8493] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:45:30 2022] DELETE /identity/v3/projects/ec0e7acf72144b558f1ba2f863244f89 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:31.092316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:31.093738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:31.106694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723d1a50-815f-4bb6-b9a7-c3a0046bcb2f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:31.131633 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:31.166089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:31.166716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:31.166994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:31.167265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] PATH_INFO: `/v3/users/51b2e08c29cb4414ba141da7bff0691a` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:31.180993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b2e08c29cb4414ba141da7bff0691a)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:31.182944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:31.233334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b2e08c29cb4414ba141da7bff0691a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.245711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b2e08c29cb4414ba141da7bff0691a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.246372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b2e08c29cb4414ba141da7bff0691a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.253839 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b2e08c29cb4414ba141da7bff0691a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.260951 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b2e08c29cb4414ba141da7bff0691a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.266686 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4249/8494] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:45:31 2022] DELETE /identity/v3/users/51b2e08c29cb4414ba141da7bff0691a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:31.441063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:31.442500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:31.455305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf1ef3f-7ddb-4014-a420-57e304f66228 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:31.512698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:31.513265 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:31.513609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:31.513888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] PATH_INFO: `/v3/projects/ec17e170fb8e46f3a4fd390b972485ce` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:31.525028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec17e170fb8e46f3a4fd390b972485ce)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:31.527024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:31.528415 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:31.573727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec17e170fb8e46f3a4fd390b972485ce', 'request_id': 'req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.580985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec17e170fb8e46f3a4fd390b972485ce', 'request_id': 'req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.588774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec17e170fb8e46f3a4fd390b972485ce', 'request_id': 'req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.599517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] The token cache is being invalidate because project ec17e170fb8e46f3a4fd390b972485ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:45:31.600302 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.600965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d6c2172f-f612-4aeb-b7fb-2610564d3c2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:31.602461 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4246/8495] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:45:31 2022] DELETE /identity/v3/projects/ec17e170fb8e46f3a4fd390b972485ce => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:39.726828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:39.728233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:39.801316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e1ad2-3b9a-4c8c-a5c9-5fd2becfa7a7 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:39.839100 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:39.871620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eafd4e2-dc8a-4ba4-88b1-b55adfee9423 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:39.872258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafd4e2-dc8a-4ba4-88b1-b55adfee9423 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:39.872560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafd4e2-dc8a-4ba4-88b1-b55adfee9423 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:39.872823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eafd4e2-dc8a-4ba4-88b1-b55adfee9423 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:39.874660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9eafd4e2-dc8a-4ba4-88b1-b55adfee9423 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:39.890771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafd4e2-dc8a-4ba4-88b1-b55adfee9423 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:39.892396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eafd4e2-dc8a-4ba4-88b1-b55adfee9423 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:39.906594 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4250/8496] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:45:39 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:45:41.596400 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=24,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:41.712728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6338b-5ce7-4273-84be-0af8de31b212 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:41.712946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6338b-5ce7-4273-84be-0af8de31b212 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:41.713200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6338b-5ce7-4273-84be-0af8de31b212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:41.759682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f6d6338b-5ce7-4273-84be-0af8de31b212 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:45:41.760885 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f6d6338b-5ce7-4273-84be-0af8de31b212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:41.819343 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4247/8497] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:45:41.830007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32284e12-b5e1-405b-8ec9-eb6494279cef None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:41.830484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32284e12-b5e1-405b-8ec9-eb6494279cef None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:41.830585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32284e12-b5e1-405b-8ec9-eb6494279cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:41.851607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-32284e12-b5e1-405b-8ec9-eb6494279cef None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:45:41.852801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-32284e12-b5e1-405b-8ec9-eb6494279cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:41.860708 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4251/8498] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:45:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:45:41.865336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6338b-5ce7-4273-84be-0af8de31b212 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:41.875089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d6338b-5ce7-4273-84be-0af8de31b212 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:41.879651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c2a71-e0ed-4007-81ac-1982eeef4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:41.880247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c2a71-e0ed-4007-81ac-1982eeef4208 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:41.881034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c2a71-e0ed-4007-81ac-1982eeef4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:41.881321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1c2a71-e0ed-4007-81ac-1982eeef4208 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:41.881981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c2a71-e0ed-4007-81ac-1982eeef4208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:45:41.882282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c2a71-e0ed-4007-81ac-1982eeef4208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:41.883873 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1c2a71-e0ed-4007-81ac-1982eeef4208 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:41.895215 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4248/8499] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:45:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:45:41.905624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32284e12-b5e1-405b-8ec9-eb6494279cef None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:41.914994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32284e12-b5e1-405b-8ec9-eb6494279cef None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:41.919614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b06eb2-fdea-46ca-a1e1-401d607d493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:41.920203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b06eb2-fdea-46ca-a1e1-401d607d493b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:41.920483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b06eb2-fdea-46ca-a1e1-401d607d493b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:41.920759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b06eb2-fdea-46ca-a1e1-401d607d493b admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:41.921576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b06eb2-fdea-46ca-a1e1-401d607d493b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:41.923466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b06eb2-fdea-46ca-a1e1-401d607d493b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:41.959834 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4252/8500] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:45:41 2022] POST /identity/v3/projects => generated 393 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:45:41.964134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c2a71-e0ed-4007-81ac-1982eeef4208 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:41.974082 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1c2a71-e0ed-4007-81ac-1982eeef4208 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.030767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9172f0-8a98-4d7d-9e28-0cdce2cbf32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.031373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9172f0-8a98-4d7d-9e28-0cdce2cbf32f admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.031658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9172f0-8a98-4d7d-9e28-0cdce2cbf32f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.031939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9172f0-8a98-4d7d-9e28-0cdce2cbf32f admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.032603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9172f0-8a98-4d7d-9e28-0cdce2cbf32f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.034558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9172f0-8a98-4d7d-9e28-0cdce2cbf32f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.058357 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4249/8501] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:45:41 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:45:42.059522 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b06eb2-fdea-46ca-a1e1-401d607d493b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:42.070388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b06eb2-fdea-46ca-a1e1-401d607d493b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.075356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd6917-3666-4c81-883d-5c3f5933fffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.075959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd6917-3666-4c81-883d-5c3f5933fffd admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.076250 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd6917-3666-4c81-883d-5c3f5933fffd admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.076526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd6917-3666-4c81-883d-5c3f5933fffd admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.077163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd6917-3666-4c81-883d-5c3f5933fffd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.078797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decd6917-3666-4c81-883d-5c3f5933fffd admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.088780 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4253/8502] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:45:42.092661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9172f0-8a98-4d7d-9e28-0cdce2cbf32f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:42.102687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9172f0-8a98-4d7d-9e28-0cdce2cbf32f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.107368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b813892d-5e7c-4c1d-829f-e147f6ef699c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.107996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813892d-5e7c-4c1d-829f-e147f6ef699c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.108281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813892d-5e7c-4c1d-829f-e147f6ef699c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.108560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b813892d-5e7c-4c1d-829f-e147f6ef699c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.109792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813892d-5e7c-4c1d-829f-e147f6ef699c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.111004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b813892d-5e7c-4c1d-829f-e147f6ef699c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.260006 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4250/8503] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:45:42.264239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd6917-3666-4c81-883d-5c3f5933fffd admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:42.274672 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decd6917-3666-4c81-883d-5c3f5933fffd admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.279281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28454a-89d8-4b38-9521-786f920588b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.279919 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28454a-89d8-4b38-9521-786f920588b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.280203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28454a-89d8-4b38-9521-786f920588b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.280481 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28454a-89d8-4b38-9521-786f920588b5 admin admin] PATH_INFO: `/v3/projects/09dab1ca22de47f6bcf5adb5e0356ae5/users/7b3312417ce54a57b8baec38c65338f0/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.295083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28454a-89d8-4b38-9521-786f920588b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09dab1ca22de47f6bcf5adb5e0356ae5, user_id=7b3312417ce54a57b8baec38c65338f0, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.297763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28454a-89d8-4b38-9521-786f920588b5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.310673 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4254/8504] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:45:42 2022] PUT /identity/v3/projects/09dab1ca22de47f6bcf5adb5e0356ae5/users/7b3312417ce54a57b8baec38c65338f0/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:42.322455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39b7b-e87c-42e4-913d-9bcbded1bd5f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.322743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39b7b-e87c-42e4-913d-9bcbded1bd5f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.323034 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc39b7b-e87c-42e4-913d-9bcbded1bd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.349836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-3bc39b7b-e87c-42e4-913d-9bcbded1bd5f None None] MFA Rules not processed for user `7b3312417ce54a57b8baec38c65338f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:45:42.351036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-3bc39b7b-e87c-42e4-913d-9bcbded1bd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:42.382880 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:42.415701 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4251/8505] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:45:42.420239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28454a-89d8-4b38-9521-786f920588b5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:42.480933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28454a-89d8-4b38-9521-786f920588b5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.485551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf838-da88-494c-8d2c-f9ffa00e85ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.486138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf838-da88-494c-8d2c-f9ffa00e85ee admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.486419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf838-da88-494c-8d2c-f9ffa00e85ee admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.486699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4cf838-da88-494c-8d2c-f9ffa00e85ee admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.487333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cf838-da88-494c-8d2c-f9ffa00e85ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.489222 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4cf838-da88-494c-8d2c-f9ffa00e85ee admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.516180 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4255/8506] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:45:42 2022] POST /identity/v3/projects => generated 391 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:45:42.519598 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc39b7b-e87c-42e4-913d-9bcbded1bd5f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:42.531023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc39b7b-e87c-42e4-913d-9bcbded1bd5f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.585934 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d540cb-f443-41ce-abf5-ea97fc8be879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.586533 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d540cb-f443-41ce-abf5-ea97fc8be879 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.586841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d540cb-f443-41ce-abf5-ea97fc8be879 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.587120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d540cb-f443-41ce-abf5-ea97fc8be879 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.587738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d540cb-f443-41ce-abf5-ea97fc8be879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.589671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d540cb-f443-41ce-abf5-ea97fc8be879 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.610666 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4252/8507] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:45:42 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:45:42.614829 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf838-da88-494c-8d2c-f9ffa00e85ee admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:42.625934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4cf838-da88-494c-8d2c-f9ffa00e85ee admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.630875 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c9ba-b84e-4abe-a4ff-5a0ef142b971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.631472 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c9ba-b84e-4abe-a4ff-5a0ef142b971 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.631756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c9ba-b84e-4abe-a4ff-5a0ef142b971 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.632034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2833c9ba-b84e-4abe-a4ff-5a0ef142b971 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.632674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c9ba-b84e-4abe-a4ff-5a0ef142b971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.634306 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2833c9ba-b84e-4abe-a4ff-5a0ef142b971 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.644811 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4256/8508] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:45:42.648854 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d540cb-f443-41ce-abf5-ea97fc8be879 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:42.659003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d540cb-f443-41ce-abf5-ea97fc8be879 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.664042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86ee2f-b8ae-4301-81bd-45bb1569a23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.664674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86ee2f-b8ae-4301-81bd-45bb1569a23b admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.664955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86ee2f-b8ae-4301-81bd-45bb1569a23b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.665232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b86ee2f-b8ae-4301-81bd-45bb1569a23b admin admin] PATH_INFO: `/v3/projects/2137dc40db0f410491537f42103e4fee/users/d742f2251653497b89e918066d35fa38/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.680373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86ee2f-b8ae-4301-81bd-45bb1569a23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2137dc40db0f410491537f42103e4fee, user_id=d742f2251653497b89e918066d35fa38, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.683046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b86ee2f-b8ae-4301-81bd-45bb1569a23b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.695557 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4253/8509] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:45:42 2022] PUT /identity/v3/projects/2137dc40db0f410491537f42103e4fee/users/d742f2251653497b89e918066d35fa38/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:42.699496 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c9ba-b84e-4abe-a4ff-5a0ef142b971 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:42.709560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2833c9ba-b84e-4abe-a4ff-5a0ef142b971 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.735646 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:42.766894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1cdb09-4070-437f-ba4b-8e1eaae7526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.767518 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cdb09-4070-437f-ba4b-8e1eaae7526a admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.767800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cdb09-4070-437f-ba4b-8e1eaae7526a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.768078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1cdb09-4070-437f-ba4b-8e1eaae7526a admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.768707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cdb09-4070-437f-ba4b-8e1eaae7526a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.770338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1cdb09-4070-437f-ba4b-8e1eaae7526a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.780594 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4257/8510] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:45:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:45:42.784801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86ee2f-b8ae-4301-81bd-45bb1569a23b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:42.795435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b86ee2f-b8ae-4301-81bd-45bb1569a23b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:42.799985 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f44c49-775d-45d2-b15b-9d4083b1e912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:42.800618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f44c49-775d-45d2-b15b-9d4083b1e912 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.800894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f44c49-775d-45d2-b15b-9d4083b1e912 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.801163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f44c49-775d-45d2-b15b-9d4083b1e912 admin admin] PATH_INFO: `/v3/projects/2137dc40db0f410491537f42103e4fee/users/d742f2251653497b89e918066d35fa38/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.803102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f44c49-775d-45d2-b15b-9d4083b1e912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2137dc40db0f410491537f42103e4fee, user_id=d742f2251653497b89e918066d35fa38, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:42.805740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f44c49-775d-45d2-b15b-9d4083b1e912 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:42.815564 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4254/8511] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:45:42 2022] PUT /identity/v3/projects/2137dc40db0f410491537f42103e4fee/users/d742f2251653497b89e918066d35fa38/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:42.825739 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae4a5-94de-4539-a2c7-a061b1ed6096 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.826053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae4a5-94de-4539-a2c7-a061b1ed6096 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.826328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ae4a5-94de-4539-a2c7-a061b1ed6096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.854741 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-407ae4a5-94de-4539-a2c7-a061b1ed6096 None None] MFA Rules not processed for user `d742f2251653497b89e918066d35fa38`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:45:42.855941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-407ae4a5-94de-4539-a2c7-a061b1ed6096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:42.922750 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4258/8512] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:45:42.935850 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c66f3-cac2-4562-8a44-5b6ab99e9cf2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:42.936136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c66f3-cac2-4562-8a44-5b6ab99e9cf2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:42.936407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481c66f3-cac2-4562-8a44-5b6ab99e9cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:42.954876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-481c66f3-cac2-4562-8a44-5b6ab99e9cf2 None None] MFA Rules not processed for user `7b3312417ce54a57b8baec38c65338f0`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:45:42.956060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-481c66f3-cac2-4562-8a44-5b6ab99e9cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:43.008590 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4255/8513] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:45:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:45:43.022415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ae4a5-94de-4539-a2c7-a061b1ed6096 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:43.024139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-407ae4a5-94de-4539-a2c7-a061b1ed6096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:43.101380 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ae4a5-94de-4539-a2c7-a061b1ed6096 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:43.106866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9447d2-eb93-47af-b7a4-52aba308d120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:43.107465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9447d2-eb93-47af-b7a4-52aba308d120 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:43.107746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9447d2-eb93-47af-b7a4-52aba308d120 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:43.108020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9447d2-eb93-47af-b7a4-52aba308d120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:43.115717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9447d2-eb93-47af-b7a4-52aba308d120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:43.117289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9447d2-eb93-47af-b7a4-52aba308d120 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:43.126231 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4259/8514] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:45:43 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:45:51.553470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c66f3-cac2-4562-8a44-5b6ab99e9cf2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:51.554862 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-481c66f3-cac2-4562-8a44-5b6ab99e9cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:51.574966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481c66f3-cac2-4562-8a44-5b6ab99e9cf2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:51.580678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629af19-9026-4b9d-99dd-b94c35589370 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:51.581289 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629af19-9026-4b9d-99dd-b94c35589370 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:51.581602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629af19-9026-4b9d-99dd-b94c35589370 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:51.581883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629af19-9026-4b9d-99dd-b94c35589370 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:51.584235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1629af19-9026-4b9d-99dd-b94c35589370 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:51.599158 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629af19-9026-4b9d-99dd-b94c35589370 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:51.601146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629af19-9026-4b9d-99dd-b94c35589370 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:51.615302 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4256/8515] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:45:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:45:53.122090 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=84 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:54.197136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9447d2-eb93-47af-b7a4-52aba308d120 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:54.211373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9447d2-eb93-47af-b7a4-52aba308d120 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:54.216834 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df190f-cf51-45ac-bd43-779bc4ad63be service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:54.217463 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df190f-cf51-45ac-bd43-779bc4ad63be service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:54.217743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df190f-cf51-45ac-bd43-779bc4ad63be service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:54.218013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9df190f-cf51-45ac-bd43-779bc4ad63be service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:54.226812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df190f-cf51-45ac-bd43-779bc4ad63be service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:54.228376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9df190f-cf51-45ac-bd43-779bc4ad63be service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:54.237932 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4260/8516] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:45:54.252741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fac9f-c41e-455d-91e0-7da6ed83f4c5 None None] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:54.253220 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fac9f-c41e-455d-91e0-7da6ed83f4c5 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:54.253364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fac9f-c41e-455d-91e0-7da6ed83f4c5 None None] PATH_INFO: `/` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:54.254693 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4257/8517] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:45:54.259148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df190f-cf51-45ac-bd43-779bc4ad63be service nova] Authenticating service token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:45:54.272997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df190f-cf51-45ac-bd43-779bc4ad63be service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:54.281551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9df190f-cf51-45ac-bd43-779bc4ad63be service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:54.286067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11574f5-7744-4e79-934c-08c0373ba83b tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd742f2251653497b89e918066d35fa38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2137dc40db0f410491537f42103e4fee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:54.287302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11574f5-7744-4e79-934c-08c0373ba83b tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:54.287567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11574f5-7744-4e79-934c-08c0373ba83b tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:54.287861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11574f5-7744-4e79-934c-08c0373ba83b tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] PATH_INFO: `/v3/projects/2137dc40db0f410491537f42103e4fee` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:54.288963 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11574f5-7744-4e79-934c-08c0373ba83b tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] RBAC: Authorizing `identity:get_project(project_id=2137dc40db0f410491537f42103e4fee)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:54.290758 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11574f5-7744-4e79-934c-08c0373ba83b tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:54.292340 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4261/8518] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:45:54 2022] GET /identity/v3/projects/2137dc40db0f410491537f42103e4fee => generated 391 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:45:54.447150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fac9f-c41e-455d-91e0-7da6ed83f4c5 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:54.448837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5c8fac9f-c41e-455d-91e0-7da6ed83f4c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:54.469515 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:54.507447 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fac9f-c41e-455d-91e0-7da6ed83f4c5 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:54.511169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:54.511762 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:54.512041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:54.512316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:54.514017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:54.526738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:54.528139 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:54.538588 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4258/8519] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:45:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:45:54.698996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c7a5-d701-401b-b17d-fb42de2709b9 None None] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:54.699305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c7a5-d701-401b-b17d-fb42de2709b9 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:54.699625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa1c7a5-d701-401b-b17d-fb42de2709b9 None None] PATH_INFO: `/` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:54.700946 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4262/8520] 10.222.0.25 () {54 vars in 912 bytes} [Mon Oct 24 09:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 24 09:45:54.705640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] Authenticating service token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:365}} Oct 24 09:45:54.721988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:54.732167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d833e6c1-e1cd-4dfa-ad38-c03ab83fded8 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:54.736737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b47ea3-ad6e-4729-b23b-42c451a36bc7 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd742f2251653497b89e918066d35fa38', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2137dc40db0f410491537f42103e4fee', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:54.737379 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b47ea3-ad6e-4729-b23b-42c451a36bc7 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:54.737670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b47ea3-ad6e-4729-b23b-42c451a36bc7 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:54.738037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b47ea3-ad6e-4729-b23b-42c451a36bc7 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] PATH_INFO: `/v3/projects/2137dc40db0f410491537f42103e4fee` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:54.739147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b47ea3-ad6e-4729-b23b-42c451a36bc7 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] RBAC: Authorizing `identity:get_project(project_id=2137dc40db0f410491537f42103e4fee)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:54.741006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b47ea3-ad6e-4729-b23b-42c451a36bc7 tempest-ServersAdminNegativeTestJSON-451551917 tempest-ServersAdminNegativeTestJSON-451551917-project-admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:54.742607 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4259/8521] 10.222.0.25 () {58 vars in 1443 bytes} [Mon Oct 24 09:45:54 2022] GET /identity/v3/projects/2137dc40db0f410491537f42103e4fee => generated 391 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:45:58.676909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c7a5-d701-401b-b17d-fb42de2709b9 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:58.740602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa1c7a5-d701-401b-b17d-fb42de2709b9 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:58.745716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:58.746332 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:58.746610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:58.746886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] PATH_INFO: `/v3/users/7b3312417ce54a57b8baec38c65338f0` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:58.748020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b3312417ce54a57b8baec38c65338f0)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:58.749969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:58.795853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b3312417ce54a57b8baec38c65338f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:58.808091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b3312417ce54a57b8baec38c65338f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:58.808747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b3312417ce54a57b8baec38c65338f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:58.816153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b3312417ce54a57b8baec38c65338f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:58.824623 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b3312417ce54a57b8baec38c65338f0'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:58.830888 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4263/8522] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:45:58 2022] DELETE /identity/v3/users/7b3312417ce54a57b8baec38c65338f0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:58.835493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5012b04-73bf-44c6-83ef-50dccadeb514 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:58.836008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5012b04-73bf-44c6-83ef-50dccadeb514 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:58.836119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5012b04-73bf-44c6-83ef-50dccadeb514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:58.855227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b5012b04-73bf-44c6-83ef-50dccadeb514 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:45:58.856401 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b5012b04-73bf-44c6-83ef-50dccadeb514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:58.915547 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4260/8523] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:45:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:45:58.925125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:58.926558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:58.982712 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49c3d8-752c-4bda-bb3d-71dd8737b16c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:58.986389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d2c07-5536-4e10-a47e-7d7b0945f8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:58.986986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d2c07-5536-4e10-a47e-7d7b0945f8ac service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:58.987269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d2c07-5536-4e10-a47e-7d7b0945f8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:58.987546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1d2c07-5536-4e10-a47e-7d7b0945f8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:58.997163 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d2c07-5536-4e10-a47e-7d7b0945f8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:58.998624 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1d2c07-5536-4e10-a47e-7d7b0945f8ac service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:59.003643 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:59.008470 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4264/8524] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:45:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:45:59.181360 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5012b04-73bf-44c6-83ef-50dccadeb514 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:59.183863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b5012b04-73bf-44c6-83ef-50dccadeb514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:59.204836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5012b04-73bf-44c6-83ef-50dccadeb514 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:59.210232 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:59.210924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:59.211205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:59.211482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] PATH_INFO: `/v3/projects/09dab1ca22de47f6bcf5adb5e0356ae5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:59.212654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09dab1ca22de47f6bcf5adb5e0356ae5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:59.214599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:59.260621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09dab1ca22de47f6bcf5adb5e0356ae5', 'request_id': 'req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.267729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09dab1ca22de47f6bcf5adb5e0356ae5', 'request_id': 'req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.274773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09dab1ca22de47f6bcf5adb5e0356ae5', 'request_id': 'req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.284827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] The token cache is being invalidate because project 09dab1ca22de47f6bcf5adb5e0356ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:45:59.285112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.285769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.287259 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4261/8525] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:45:59 2022] DELETE /identity/v3/projects/09dab1ca22de47f6bcf5adb5e0356ae5 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:59.291913 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d2c07-5536-4e10-a47e-7d7b0945f8ac service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:59.301728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1d2c07-5536-4e10-a47e-7d7b0945f8ac service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:59.359308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:59.359924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:59.360201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:59.360474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] PATH_INFO: `/v3/users/d742f2251653497b89e918066d35fa38` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:59.361595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d742f2251653497b89e918066d35fa38)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:59.363504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:59.409820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd742f2251653497b89e918066d35fa38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.422264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd742f2251653497b89e918066d35fa38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.422930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd742f2251653497b89e918066d35fa38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.430204 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd742f2251653497b89e918066d35fa38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.437232 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-701676de-0ae9-45c7-8c62-ca6322a51ffc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd742f2251653497b89e918066d35fa38'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.442998 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4265/8526] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:45:59 2022] DELETE /identity/v3/users/d742f2251653497b89e918066d35fa38 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:45:59.717830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:45:59.719303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:59.734168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd90ecea-e698-4bc2-82f0-ee2bd2dd9e46 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:45:59.768179 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:45:59.795175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:45:59.795803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:59.796078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:59.796347 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] PATH_INFO: `/v3/projects/2137dc40db0f410491537f42103e4fee` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:59.797476 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2137dc40db0f410491537f42103e4fee)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:45:59.799361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:45:59.844263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2137dc40db0f410491537f42103e4fee', 'request_id': 'req-966e7370-b4d0-4cd7-b55a-2f4ad3775165'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.850794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2137dc40db0f410491537f42103e4fee', 'request_id': 'req-966e7370-b4d0-4cd7-b55a-2f4ad3775165'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.856828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2137dc40db0f410491537f42103e4fee', 'request_id': 'req-966e7370-b4d0-4cd7-b55a-2f4ad3775165'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.866950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] The token cache is being invalidate because project 2137dc40db0f410491537f42103e4fee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:45:59.867237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.867912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-966e7370-b4d0-4cd7-b55a-2f4ad3775165 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:45:59.869377 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4262/8527] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:45:59 2022] DELETE /identity/v3/projects/2137dc40db0f410491537f42103e4fee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:45:59.875458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75b9e-ef8a-4212-93f0-a6c6ed390897 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:59.875926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75b9e-ef8a-4212-93f0-a6c6ed390897 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:59.876040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a75b9e-ef8a-4212-93f0-a6c6ed390897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:59.895884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-89a75b9e-ef8a-4212-93f0-a6c6ed390897 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:45:59.897077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-89a75b9e-ef8a-4212-93f0-a6c6ed390897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:59.955498 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4266/8528] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:45:59.964688 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db7652-e4f8-4ad1-89cf-ff253c7e0075 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:45:59.964980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db7652-e4f8-4ad1-89cf-ff253c7e0075 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:45:59.965254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db7652-e4f8-4ad1-89cf-ff253c7e0075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:45:59.984676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c5db7652-e4f8-4ad1-89cf-ff253c7e0075 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:45:59.985908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c5db7652-e4f8-4ad1-89cf-ff253c7e0075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:45:59.994327 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4263/8529] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:45:59.998428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75b9e-ef8a-4212-93f0-a6c6ed390897 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:00.008935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a75b9e-ef8a-4212-93f0-a6c6ed390897 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:00.013587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8a5e8-77f0-4632-8a66-373ade4f528c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:00.014180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8a5e8-77f0-4632-8a66-373ade4f528c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:00.014460 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8a5e8-77f0-4632-8a66-373ade4f528c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:00.014731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a8a5e8-77f0-4632-8a66-373ade4f528c admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:00.015390 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8a5e8-77f0-4632-8a66-373ade4f528c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:46:00.015693 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8a5e8-77f0-4632-8a66-373ade4f528c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:00.017277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a8a5e8-77f0-4632-8a66-373ade4f528c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:00.029023 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4267/8530] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:45:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 24 09:46:00.033120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db7652-e4f8-4ad1-89cf-ff253c7e0075 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:00.042214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db7652-e4f8-4ad1-89cf-ff253c7e0075 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:00.046781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6f3c8-781d-4294-b847-5b07e7f91dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:00.047364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6f3c8-781d-4294-b847-5b07e7f91dcd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:00.047642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6f3c8-781d-4294-b847-5b07e7f91dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:00.047914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd6f3c8-781d-4294-b847-5b07e7f91dcd admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:00.048539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6f3c8-781d-4294-b847-5b07e7f91dcd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:00.050469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd6f3c8-781d-4294-b847-5b07e7f91dcd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:00.078517 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4264/8531] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:46:00 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:46:00.082732 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8a5e8-77f0-4632-8a66-373ade4f528c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:00.092828 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a8a5e8-77f0-4632-8a66-373ade4f528c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:00.096343 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:00.151556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d8774-d3ee-4d92-a2dd-7982cdf871c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:00.152159 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8774-d3ee-4d92-a2dd-7982cdf871c3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:00.152438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8774-d3ee-4d92-a2dd-7982cdf871c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:00.152707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d8774-d3ee-4d92-a2dd-7982cdf871c3 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:00.153439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d8774-d3ee-4d92-a2dd-7982cdf871c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:00.155346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d8774-d3ee-4d92-a2dd-7982cdf871c3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:00.175781 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4268/8532] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:46:00 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:46:00.179901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6f3c8-781d-4294-b847-5b07e7f91dcd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:00.190172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd6f3c8-781d-4294-b847-5b07e7f91dcd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:00.194876 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bcbb8-a364-4f35-96e8-b116cd9e8e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:00.195540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bcbb8-a364-4f35-96e8-b116cd9e8e81 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:00.195819 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bcbb8-a364-4f35-96e8-b116cd9e8e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:00.196090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bcbb8-a364-4f35-96e8-b116cd9e8e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:00.196725 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bcbb8-a364-4f35-96e8-b116cd9e8e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:00.198351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bcbb8-a364-4f35-96e8-b116cd9e8e81 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:00.208224 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4265/8533] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:46:00.212470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d8774-d3ee-4d92-a2dd-7982cdf871c3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:00.222464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d8774-d3ee-4d92-a2dd-7982cdf871c3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:00.227649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b455ef0-7f31-4c85-81e8-10fc4b287f2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:00.228234 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b455ef0-7f31-4c85-81e8-10fc4b287f2c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:00.228516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b455ef0-7f31-4c85-81e8-10fc4b287f2c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:00.228892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b455ef0-7f31-4c85-81e8-10fc4b287f2c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:00.229570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b455ef0-7f31-4c85-81e8-10fc4b287f2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:00.231144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b455ef0-7f31-4c85-81e8-10fc4b287f2c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:00.241551 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4269/8534] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:46:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:46:00.245472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bcbb8-a364-4f35-96e8-b116cd9e8e81 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:00.255192 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bcbb8-a364-4f35-96e8-b116cd9e8e81 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:00.259765 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7d08c-2891-4eae-8a2e-7ed543379381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:00.260393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7d08c-2891-4eae-8a2e-7ed543379381 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:00.260671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7d08c-2891-4eae-8a2e-7ed543379381 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:00.260978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b7d08c-2891-4eae-8a2e-7ed543379381 admin admin] PATH_INFO: `/v3/projects/996a4beed0bd44c49c163fbac68e9687/users/516efdf9d07843a4a5605f94145c293d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:00.276181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7d08c-2891-4eae-8a2e-7ed543379381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=996a4beed0bd44c49c163fbac68e9687, user_id=516efdf9d07843a4a5605f94145c293d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:00.278886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b7d08c-2891-4eae-8a2e-7ed543379381 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:00.291717 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4266/8535] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:46:00 2022] PUT /identity/v3/projects/996a4beed0bd44c49c163fbac68e9687/users/516efdf9d07843a4a5605f94145c293d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:46:00.296665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2659ef-7c27-4f13-8641-26e84afa7509 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:00.296954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2659ef-7c27-4f13-8641-26e84afa7509 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:00.297268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2659ef-7c27-4f13-8641-26e84afa7509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:00.315711 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-7c2659ef-7c27-4f13-8641-26e84afa7509 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:46:00.316886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7c2659ef-7c27-4f13-8641-26e84afa7509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:00.375230 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4270/8536] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:46:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:46:00.385429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7d08c-2891-4eae-8a2e-7ed543379381 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:00.387112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c6b7d08c-2891-4eae-8a2e-7ed543379381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:00.441970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b7d08c-2891-4eae-8a2e-7ed543379381 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:00.446264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a79dff-bfea-456b-95b2-2a48da621aca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:00.446893 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a79dff-bfea-456b-95b2-2a48da621aca service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:00.447252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a79dff-bfea-456b-95b2-2a48da621aca service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:00.447553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a79dff-bfea-456b-95b2-2a48da621aca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:00.456840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a79dff-bfea-456b-95b2-2a48da621aca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:00.458346 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a79dff-bfea-456b-95b2-2a48da621aca service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:00.468209 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4267/8537] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:46:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:46:04.786540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8c7a-fa9f-4176-b477-e2b64c1ab983 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:04.787007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8c7a-fa9f-4176-b477-e2b64c1ab983 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:04.787090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd8c7a-fa9f-4176-b477-e2b64c1ab983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:04.820084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cfbd8c7a-fa9f-4176-b477-e2b64c1ab983 None None] MFA Rules not processed for user `516efdf9d07843a4a5605f94145c293d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:46:04.821482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cfbd8c7a-fa9f-4176-b477-e2b64c1ab983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:04.895678 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4271/8538] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:46:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:46:04.907571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e2c5c-412a-4c31-a681-df57fffa4b4a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:04.908024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e2c5c-412a-4c31-a681-df57fffa4b4a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:04.908140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e2c5c-412a-4c31-a681-df57fffa4b4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:04.916098 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:04.934179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d94e2c5c-412a-4c31-a681-df57fffa4b4a None None] MFA Rules not processed for user `516efdf9d07843a4a5605f94145c293d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:46:04.935392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d94e2c5c-412a-4c31-a681-df57fffa4b4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:04.942788 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4268/8539] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:46:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:46:04.956705 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8c7a-fa9f-4176-b477-e2b64c1ab983 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:04.958536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cfbd8c7a-fa9f-4176-b477-e2b64c1ab983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:04.978777 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:05.041725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd8c7a-fa9f-4176-b477-e2b64c1ab983 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:05.047289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d236887-dde4-46fc-955d-ca39581ffdf9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:05.047902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d236887-dde4-46fc-955d-ca39581ffdf9 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:05.048186 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d236887-dde4-46fc-955d-ca39581ffdf9 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:05.048465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d236887-dde4-46fc-955d-ca39581ffdf9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:05.058772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d236887-dde4-46fc-955d-ca39581ffdf9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:05.060404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d236887-dde4-46fc-955d-ca39581ffdf9 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:05.072144 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4272/8540] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:46:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:46:14.933690 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:15.066343 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=27 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:16.355264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e2c5c-412a-4c31-a681-df57fffa4b4a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:16.365278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e2c5c-412a-4c31-a681-df57fffa4b4a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:16.369420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:16.370031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:16.370312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:16.370587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:16.372315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:16.385800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:16.387311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:16.398757 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4269/8541] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:46:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:46:16.480418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b3f09-6864-4df1-983b-152d0a32de30 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:16.480899 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b3f09-6864-4df1-983b-152d0a32de30 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:16.481020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277b3f09-6864-4df1-983b-152d0a32de30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:16.510082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-277b3f09-6864-4df1-983b-152d0a32de30 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:46:16.511273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-277b3f09-6864-4df1-983b-152d0a32de30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:16.574910 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4273/8542] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:46:16 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:46:16.587406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:16.588790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:16.605911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8627b2-6c30-4520-bb6f-348f1f3b7409 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:16.611009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85c0cb-2706-4a05-9a65-9ff06a95a7a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:16.611593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85c0cb-2706-4a05-9a65-9ff06a95a7a4 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:16.611884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85c0cb-2706-4a05-9a65-9ff06a95a7a4 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:16.612144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d85c0cb-2706-4a05-9a65-9ff06a95a7a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:16.620468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85c0cb-2706-4a05-9a65-9ff06a95a7a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:16.622113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d85c0cb-2706-4a05-9a65-9ff06a95a7a4 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:16.632224 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4270/8543] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:46:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:46:16.803962 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b3f09-6864-4df1-983b-152d0a32de30 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:16.813236 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277b3f09-6864-4df1-983b-152d0a32de30 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:16.816754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0977eb7e-1d21-48c0-aec9-3bbc94bcb6cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:16.817364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977eb7e-1d21-48c0-aec9-3bbc94bcb6cb service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:16.817643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977eb7e-1d21-48c0-aec9-3bbc94bcb6cb service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:16.817934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0977eb7e-1d21-48c0-aec9-3bbc94bcb6cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:16.820182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0977eb7e-1d21-48c0-aec9-3bbc94bcb6cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:16.836403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977eb7e-1d21-48c0-aec9-3bbc94bcb6cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:16.837810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0977eb7e-1d21-48c0-aec9-3bbc94bcb6cb service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:16.851231 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4274/8544] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:46:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:46:16.912691 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85c0cb-2706-4a05-9a65-9ff06a95a7a4 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:16.925613 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d85c0cb-2706-4a05-9a65-9ff06a95a7a4 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:16.931175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:16.931764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:16.932046 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:16.932319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:16.934041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:16.945674 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:16.947350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:16.957253 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4271/8545] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:46:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:46:26.843826 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=39 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:26.952866 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=18 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:46:49.548980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebfb1f-28e5-49c7-ba9e-ceb3cf81df7c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:49.549602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebfb1f-28e5-49c7-ba9e-ceb3cf81df7c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:49.549602 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebfb1f-28e5-49c7-ba9e-ceb3cf81df7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:49.569067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-10ebfb1f-28e5-49c7-ba9e-ceb3cf81df7c None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:46:49.570882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-10ebfb1f-28e5-49c7-ba9e-ceb3cf81df7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:49.579604 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4275/8546] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Oct 24 09:46:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:46:49.626678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:49.628058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:49.643785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f587cefa-6848-4a63-bf51-2c9ab08e6070 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:49.649827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a37082-a88e-40a7-aba6-92906bbde46d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:49.650682 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37082-a88e-40a7-aba6-92906bbde46d service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:49.650963 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37082-a88e-40a7-aba6-92906bbde46d service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:49.651238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a37082-a88e-40a7-aba6-92906bbde46d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:49.659701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a37082-a88e-40a7-aba6-92906bbde46d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:49.661271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a37082-a88e-40a7-aba6-92906bbde46d service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:49.670686 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4272/8547] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:46:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:46:55.391579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42476-b67f-4187-866e-cd6dcb0b72bf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:55.392132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42476-b67f-4187-866e-cd6dcb0b72bf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:55.392132 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e42476-b67f-4187-866e-cd6dcb0b72bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:55.412196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-48e42476-b67f-4187-866e-cd6dcb0b72bf None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:46:55.414058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-48e42476-b67f-4187-866e-cd6dcb0b72bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:55.422529 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4276/8548] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Oct 24 09:46:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:46:55.434553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c842-dbff-42e7-8e17-d7d6e22396c9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:55.434973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c842-dbff-42e7-8e17-d7d6e22396c9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:55.435136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c8c842-dbff-42e7-8e17-d7d6e22396c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:55.454144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-36c8c842-dbff-42e7-8e17-d7d6e22396c9 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:46:55.455330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-36c8c842-dbff-42e7-8e17-d7d6e22396c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:46:55.464397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4273/8549] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 09:46:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:46:55.470230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e42476-b67f-4187-866e-cd6dcb0b72bf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:46:55.481127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e42476-b67f-4187-866e-cd6dcb0b72bf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:46:55.486168 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfae11-a29b-4580-87e6-a01eccdd9e78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:46:55.486752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfae11-a29b-4580-87e6-a01eccdd9e78 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:46:55.487030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfae11-a29b-4580-87e6-a01eccdd9e78 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:46:55.487305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdfae11-a29b-4580-87e6-a01eccdd9e78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:46:55.495581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfae11-a29b-4580-87e6-a01eccdd9e78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:46:55.497145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdfae11-a29b-4580-87e6-a01eccdd9e78 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:46:55.506713 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4277/8550] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:46:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:47:01.810663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8c842-dbff-42e7-8e17-d7d6e22396c9 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:01.822070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c8c842-dbff-42e7-8e17-d7d6e22396c9 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:01.826972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:01.827535 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:01.827813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:01.828105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] PATH_INFO: `/v3/users/516efdf9d07843a4a5605f94145c293d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:01.829186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=516efdf9d07843a4a5605f94145c293d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:01.831132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:01.875869 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '516efdf9d07843a4a5605f94145c293d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:01.888641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '516efdf9d07843a4a5605f94145c293d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:01.889355 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '516efdf9d07843a4a5605f94145c293d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:01.896824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '516efdf9d07843a4a5605f94145c293d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:01.904642 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-0f75d472-dd3f-4368-b296-5bcd7b70c355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '516efdf9d07843a4a5605f94145c293d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:01.910811 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4274/8551] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:47:01 2022] DELETE /identity/v3/users/516efdf9d07843a4a5605f94145c293d => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:47:02.085635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfae11-a29b-4580-87e6-a01eccdd9e78 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:02.097161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdfae11-a29b-4580-87e6-a01eccdd9e78 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:02.156777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:02.157440 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.157725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.157994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] PATH_INFO: `/v3/projects/996a4beed0bd44c49c163fbac68e9687` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.159105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] RBAC: Authorizing `identity:delete_project(project_id=996a4beed0bd44c49c163fbac68e9687)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:02.161007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:02.207701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '996a4beed0bd44c49c163fbac68e9687', 'request_id': 'req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:02.214240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '996a4beed0bd44c49c163fbac68e9687', 'request_id': 'req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:02.221644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '996a4beed0bd44c49c163fbac68e9687', 'request_id': 'req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:02.231827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] The token cache is being invalidate because project 996a4beed0bd44c49c163fbac68e9687 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:47:02.232110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:02.232719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-f639b1b5-b47a-4e06-bde5-f30e57ee9fab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:47:02.234327 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4278/8552] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:47:02 2022] DELETE /identity/v3/projects/996a4beed0bd44c49c163fbac68e9687 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:47:02.239262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40380144-089e-4d99-ad6c-d0250ac9f787 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.239546 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40380144-089e-4d99-ad6c-d0250ac9f787 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.239818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40380144-089e-4d99-ad6c-d0250ac9f787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.259807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-40380144-089e-4d99-ad6c-d0250ac9f787 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:47:02.260983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-40380144-089e-4d99-ad6c-d0250ac9f787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:02.318889 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4275/8553] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:47:02.327490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7eef9-6b9f-41af-948d-6485ffa8a9a3 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.327780 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7eef9-6b9f-41af-948d-6485ffa8a9a3 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.328061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d7eef9-6b9f-41af-948d-6485ffa8a9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.348777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-e3d7eef9-6b9f-41af-948d-6485ffa8a9a3 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:47:02.349943 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e3d7eef9-6b9f-41af-948d-6485ffa8a9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:02.358422 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4279/8554] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:47:02.362609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40380144-089e-4d99-ad6c-d0250ac9f787 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:02.372832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40380144-089e-4d99-ad6c-d0250ac9f787 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:02.377466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815502e0-eb60-4606-a751-86b168bbe3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:02.378085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815502e0-eb60-4606-a751-86b168bbe3ef admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.378364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815502e0-eb60-4606-a751-86b168bbe3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.378638 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815502e0-eb60-4606-a751-86b168bbe3ef admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.379274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815502e0-eb60-4606-a751-86b168bbe3ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:47:02.379603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815502e0-eb60-4606-a751-86b168bbe3ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:02.381178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815502e0-eb60-4606-a751-86b168bbe3ef admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:02.392401 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4276/8555] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:47:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:47:02.396664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7eef9-6b9f-41af-948d-6485ffa8a9a3 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:02.406182 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d7eef9-6b9f-41af-948d-6485ffa8a9a3 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:02.411189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c5cee-50ba-40a3-9afc-5e2b76fcde46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:02.411783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c5cee-50ba-40a3-9afc-5e2b76fcde46 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.412063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c5cee-50ba-40a3-9afc-5e2b76fcde46 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.412338 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790c5cee-50ba-40a3-9afc-5e2b76fcde46 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.413490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c5cee-50ba-40a3-9afc-5e2b76fcde46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:02.415392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-790c5cee-50ba-40a3-9afc-5e2b76fcde46 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:02.442204 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4280/8556] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:47:02 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:47:02.446471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815502e0-eb60-4606-a751-86b168bbe3ef admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:02.456354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815502e0-eb60-4606-a751-86b168bbe3ef admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:02.493056 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:02.514494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8fe59-bc38-49ad-815e-497ae6f44276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:02.515153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8fe59-bc38-49ad-815e-497ae6f44276 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.515434 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8fe59-bc38-49ad-815e-497ae6f44276 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.515703 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8fe59-bc38-49ad-815e-497ae6f44276 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.516320 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8fe59-bc38-49ad-815e-497ae6f44276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:02.518253 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8fe59-bc38-49ad-815e-497ae6f44276 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:02.539910 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4277/8557] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:47:02 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:47:02.544223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c5cee-50ba-40a3-9afc-5e2b76fcde46 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:02.554620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790c5cee-50ba-40a3-9afc-5e2b76fcde46 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:02.559198 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3964600-4433-43ed-b9a5-4ac1adf0ecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:02.559789 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3964600-4433-43ed-b9a5-4ac1adf0ecc1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.560071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3964600-4433-43ed-b9a5-4ac1adf0ecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.560349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3964600-4433-43ed-b9a5-4ac1adf0ecc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.561016 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3964600-4433-43ed-b9a5-4ac1adf0ecc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:02.562662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3964600-4433-43ed-b9a5-4ac1adf0ecc1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:02.572950 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4281/8558] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:47:02.576664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8fe59-bc38-49ad-815e-497ae6f44276 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:02.586474 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8fe59-bc38-49ad-815e-497ae6f44276 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:02.591047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f4c3ac-633d-4cb5-8a03-d9296057e628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:02.591624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4c3ac-633d-4cb5-8a03-d9296057e628 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.591903 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4c3ac-633d-4cb5-8a03-d9296057e628 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.592175 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f4c3ac-633d-4cb5-8a03-d9296057e628 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.592800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4c3ac-633d-4cb5-8a03-d9296057e628 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:02.594399 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f4c3ac-633d-4cb5-8a03-d9296057e628 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:02.604545 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4278/8559] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:47:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:47:02.608552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3964600-4433-43ed-b9a5-4ac1adf0ecc1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:02.619485 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3964600-4433-43ed-b9a5-4ac1adf0ecc1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:02.624171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0f57-cd09-4412-96af-93de525255b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:02.624812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0f57-cd09-4412-96af-93de525255b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.625090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0f57-cd09-4412-96af-93de525255b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.625399 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effb0f57-cd09-4412-96af-93de525255b5 admin admin] PATH_INFO: `/v3/projects/f426d2cfe5ba47c1b1fd9d625177e682/users/cafa00717a9c418ca48edeb2bfbf12dd/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.639734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0f57-cd09-4412-96af-93de525255b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f426d2cfe5ba47c1b1fd9d625177e682, user_id=cafa00717a9c418ca48edeb2bfbf12dd, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:02.642408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effb0f57-cd09-4412-96af-93de525255b5 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:02.651157 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:02.656122 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4282/8560] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:47:02 2022] PUT /identity/v3/projects/f426d2cfe5ba47c1b1fd9d625177e682/users/cafa00717a9c418ca48edeb2bfbf12dd/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:47:02.661147 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ca957-3947-490f-bde0-be15857fe084 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.661514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ca957-3947-490f-bde0-be15857fe084 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.661788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90ca957-3947-490f-bde0-be15857fe084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.681420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e90ca957-3947-490f-bde0-be15857fe084 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:47:02.682605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e90ca957-3947-490f-bde0-be15857fe084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:02.739770 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4279/8561] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:47:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:47:02.749535 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0f57-cd09-4412-96af-93de525255b5 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:02.751248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-effb0f57-cd09-4412-96af-93de525255b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:02.807226 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effb0f57-cd09-4412-96af-93de525255b5 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:02.810824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75200-6349-4ee2-a7c6-c8c172edd289 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:02.811441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75200-6349-4ee2-a7c6-c8c172edd289 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:02.811724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75200-6349-4ee2-a7c6-c8c172edd289 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:02.811997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75200-6349-4ee2-a7c6-c8c172edd289 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:02.820911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75200-6349-4ee2-a7c6-c8c172edd289 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:02.822383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75200-6349-4ee2-a7c6-c8c172edd289 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:02.831698 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4283/8562] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:47:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:47:06.551106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f99c36-ab59-4c7f-b656-0145b08b6ac0 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:06.551685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f99c36-ab59-4c7f-b656-0145b08b6ac0 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:06.551685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f99c36-ab59-4c7f-b656-0145b08b6ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:06.582592 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-39f99c36-ab59-4c7f-b656-0145b08b6ac0 None None] MFA Rules not processed for user `cafa00717a9c418ca48edeb2bfbf12dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:47:06.583728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39f99c36-ab59-4c7f-b656-0145b08b6ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:06.671556 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4280/8563] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:47:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:47:06.682628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47888395-8215-4534-9c48-c5be3b67a766 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:06.683170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47888395-8215-4534-9c48-c5be3b67a766 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:06.683170 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47888395-8215-4534-9c48-c5be3b67a766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:06.704150 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-47888395-8215-4534-9c48-c5be3b67a766 None None] MFA Rules not processed for user `cafa00717a9c418ca48edeb2bfbf12dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:47:06.705575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-47888395-8215-4534-9c48-c5be3b67a766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:06.713428 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4284/8564] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:47:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:47:06.725549 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f99c36-ab59-4c7f-b656-0145b08b6ac0 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:06.727498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-39f99c36-ab59-4c7f-b656-0145b08b6ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:06.810629 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:06.849096 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f99c36-ab59-4c7f-b656-0145b08b6ac0 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:06.858493 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff6a26-7dcb-4e14-b9f3-2d40ec3e0cc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:06.859272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff6a26-7dcb-4e14-b9f3-2d40ec3e0cc2 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:06.859607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff6a26-7dcb-4e14-b9f3-2d40ec3e0cc2 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:06.859884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff6a26-7dcb-4e14-b9f3-2d40ec3e0cc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:06.871036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff6a26-7dcb-4e14-b9f3-2d40ec3e0cc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:06.872650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff6a26-7dcb-4e14-b9f3-2d40ec3e0cc2 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:06.883000 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4281/8565] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:47:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:47:07.168473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47888395-8215-4534-9c48-c5be3b67a766 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:07.178866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47888395-8215-4534-9c48-c5be3b67a766 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:07.182538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc38e9d-eb3c-4ad2-ad55-ac8c930b2d6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:07.183263 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38e9d-eb3c-4ad2-ad55-ac8c930b2d6a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:07.183596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38e9d-eb3c-4ad2-ad55-ac8c930b2d6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:07.183937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc38e9d-eb3c-4ad2-ad55-ac8c930b2d6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:07.185761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4fc38e9d-eb3c-4ad2-ad55-ac8c930b2d6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:07.199061 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc38e9d-eb3c-4ad2-ad55-ac8c930b2d6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:07.200662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc38e9d-eb3c-4ad2-ad55-ac8c930b2d6a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:07.212945 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4285/8566] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:47:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:47:16.877991 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=12 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:17.205279 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=35 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:47:57.460221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa5be5-8cc8-4958-a706-58aef18c9f93 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:57.460806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa5be5-8cc8-4958-a706-58aef18c9f93 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:57.460806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fa5be5-8cc8-4958-a706-58aef18c9f93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:57.480274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e4fa5be5-8cc8-4958-a706-58aef18c9f93 None None] MFA Rules not processed for user `cafa00717a9c418ca48edeb2bfbf12dd`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:47:57.481429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4fa5be5-8cc8-4958-a706-58aef18c9f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:57.488264 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4282/8567] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:47:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:47:59.224162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc38e9d-eb3c-4ad2-ad55-ac8c930b2d6a service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:47:59.235771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc38e9d-eb3c-4ad2-ad55-ac8c930b2d6a service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:47:59.240735 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9731bed-140c-4f61-9338-d7dbf5d4d266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:47:59.241397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9731bed-140c-4f61-9338-d7dbf5d4d266 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:47:59.242592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9731bed-140c-4f61-9338-d7dbf5d4d266 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:47:59.242880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9731bed-140c-4f61-9338-d7dbf5d4d266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:47:59.259753 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d9731bed-140c-4f61-9338-d7dbf5d4d266 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:47:59.296413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9731bed-140c-4f61-9338-d7dbf5d4d266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:47:59.298370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9731bed-140c-4f61-9338-d7dbf5d4d266 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:47:59.327554 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4286/8568] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:47:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:48:00.484150 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa5be5-8cc8-4958-a706-58aef18c9f93 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:00.485917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e4fa5be5-8cc8-4958-a706-58aef18c9f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:00.499186 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fa5be5-8cc8-4958-a706-58aef18c9f93 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:00.502948 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcfcad-a5ae-451c-9947-943d172bff6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:00.503708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcfcad-a5ae-451c-9947-943d172bff6a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:00.503989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcfcad-a5ae-451c-9947-943d172bff6a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:00.504284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcfcad-a5ae-451c-9947-943d172bff6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:00.506657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4ebcfcad-a5ae-451c-9947-943d172bff6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:00.524304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcfcad-a5ae-451c-9947-943d172bff6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:00.525815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcfcad-a5ae-451c-9947-943d172bff6a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:00.540696 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4283/8569] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:48:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:48:02.124532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9731bed-140c-4f61-9338-d7dbf5d4d266 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:02.133686 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9731bed-140c-4f61-9338-d7dbf5d4d266 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:02.137396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fccf1-12a7-49da-8a48-9615887d4b05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:02.137986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fccf1-12a7-49da-8a48-9615887d4b05 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:02.138272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fccf1-12a7-49da-8a48-9615887d4b05 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:02.138548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45fccf1-12a7-49da-8a48-9615887d4b05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:02.140294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e45fccf1-12a7-49da-8a48-9615887d4b05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:02.154205 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fccf1-12a7-49da-8a48-9615887d4b05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:02.155677 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45fccf1-12a7-49da-8a48-9615887d4b05 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:02.168601 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4287/8570] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:48:02 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:48:10.532584 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=9 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:12.161214 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=12 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:36.277722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcfcad-a5ae-451c-9947-943d172bff6a service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:36.293526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcfcad-a5ae-451c-9947-943d172bff6a service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:36.299161 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104671e-8385-493d-992d-340030cff74f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:36.299764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104671e-8385-493d-992d-340030cff74f service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:36.300045 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104671e-8385-493d-992d-340030cff74f service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:36.300319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104671e-8385-493d-992d-340030cff74f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:36.302626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0104671e-8385-493d-992d-340030cff74f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:36.319235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104671e-8385-493d-992d-340030cff74f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:36.320835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104671e-8385-493d-992d-340030cff74f service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:36.334421 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4284/8571] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:48:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 09:48:46.327318 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:51.068302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fccf1-12a7-49da-8a48-9615887d4b05 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:51.080036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45fccf1-12a7-49da-8a48-9615887d4b05 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:51.085411 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:51.086634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.086634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.086634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] PATH_INFO: `/v3/users/cafa00717a9c418ca48edeb2bfbf12dd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.087846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cafa00717a9c418ca48edeb2bfbf12dd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:51.089805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:51.136167 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cafa00717a9c418ca48edeb2bfbf12dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.149395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cafa00717a9c418ca48edeb2bfbf12dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.149846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cafa00717a9c418ca48edeb2bfbf12dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.157773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cafa00717a9c418ca48edeb2bfbf12dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.167335 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-6a3983dc-193e-4ecc-8865-a71f1e0fd5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cafa00717a9c418ca48edeb2bfbf12dd'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.173987 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4288/8572] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:48:51 2022] DELETE /identity/v3/users/cafa00717a9c418ca48edeb2bfbf12dd => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:48:51.369906 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104671e-8385-493d-992d-340030cff74f service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:51.380877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104671e-8385-493d-992d-340030cff74f service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:51.445617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:51.446240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.446516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.446784 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] PATH_INFO: `/v3/projects/f426d2cfe5ba47c1b1fd9d625177e682` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.447916 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] RBAC: Authorizing `identity:delete_project(project_id=f426d2cfe5ba47c1b1fd9d625177e682)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:51.449923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:51.495004 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f426d2cfe5ba47c1b1fd9d625177e682', 'request_id': 'req-ab193ae6-932a-4b67-816f-773d492005be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.501562 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f426d2cfe5ba47c1b1fd9d625177e682', 'request_id': 'req-ab193ae6-932a-4b67-816f-773d492005be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.508791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f426d2cfe5ba47c1b1fd9d625177e682', 'request_id': 'req-ab193ae6-932a-4b67-816f-773d492005be'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.519221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] The token cache is being invalidate because project f426d2cfe5ba47c1b1fd9d625177e682 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:48:51.519505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.520148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-ab193ae6-932a-4b67-816f-773d492005be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:48:51.522189 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4285/8573] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:48:51 2022] DELETE /identity/v3/projects/f426d2cfe5ba47c1b1fd9d625177e682 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:48:51.527394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b45a-327a-48f8-912c-a5ef01521782 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.527710 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b45a-327a-48f8-912c-a5ef01521782 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.527987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8b45a-327a-48f8-912c-a5ef01521782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.547254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-46b8b45a-327a-48f8-912c-a5ef01521782 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:51.548415 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46b8b45a-327a-48f8-912c-a5ef01521782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:51.606722 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4289/8574] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:48:51.615226 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f78cc1-3f57-4c94-8de0-5effaee64ea2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.615516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f78cc1-3f57-4c94-8de0-5effaee64ea2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.615792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f78cc1-3f57-4c94-8de0-5effaee64ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.636374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-09f78cc1-3f57-4c94-8de0-5effaee64ea2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:51.637652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-09f78cc1-3f57-4c94-8de0-5effaee64ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:51.646168 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4286/8575] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:48:51.650294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8b45a-327a-48f8-912c-a5ef01521782 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:51.660397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8b45a-327a-48f8-912c-a5ef01521782 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:51.665010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ee86-2245-4a7f-8455-16823ee191a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:51.665634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ee86-2245-4a7f-8455-16823ee191a9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.665970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ee86-2245-4a7f-8455-16823ee191a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.666249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49ee86-2245-4a7f-8455-16823ee191a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.666888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ee86-2245-4a7f-8455-16823ee191a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:48:51.667190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ee86-2245-4a7f-8455-16823ee191a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:51.668775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49ee86-2245-4a7f-8455-16823ee191a9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:51.680099 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4290/8576] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:48:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:48:51.684305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f78cc1-3f57-4c94-8de0-5effaee64ea2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:51.694014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f78cc1-3f57-4c94-8de0-5effaee64ea2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:51.698666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe5f93-509e-499d-adc7-de67cb943de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:51.699256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe5f93-509e-499d-adc7-de67cb943de7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.699538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe5f93-509e-499d-adc7-de67cb943de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.699813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe5f93-509e-499d-adc7-de67cb943de7 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.700433 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe5f93-509e-499d-adc7-de67cb943de7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:51.702364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe5f93-509e-499d-adc7-de67cb943de7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:51.729565 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4287/8577] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:48:51 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:48:51.733702 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ee86-2245-4a7f-8455-16823ee191a9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:51.744001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49ee86-2245-4a7f-8455-16823ee191a9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:51.800554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5197897-e69b-4e7c-aeeb-9c1b93592671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:51.801077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5197897-e69b-4e7c-aeeb-9c1b93592671 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.801396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5197897-e69b-4e7c-aeeb-9c1b93592671 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.801699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5197897-e69b-4e7c-aeeb-9c1b93592671 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.802326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5197897-e69b-4e7c-aeeb-9c1b93592671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:51.804238 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5197897-e69b-4e7c-aeeb-9c1b93592671 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:51.812070 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:51.826232 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4291/8578] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:48:51 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:48:51.830353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe5f93-509e-499d-adc7-de67cb943de7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:51.841044 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe5f93-509e-499d-adc7-de67cb943de7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:51.845649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d0bdb-8fd0-4161-92db-35f9bb838042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:51.846243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d0bdb-8fd0-4161-92db-35f9bb838042 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.846524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d0bdb-8fd0-4161-92db-35f9bb838042 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.846799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4d0bdb-8fd0-4161-92db-35f9bb838042 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.847440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d0bdb-8fd0-4161-92db-35f9bb838042 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:51.849047 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4d0bdb-8fd0-4161-92db-35f9bb838042 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:51.858995 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4288/8579] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:48:51.862813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5197897-e69b-4e7c-aeeb-9c1b93592671 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:51.873101 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5197897-e69b-4e7c-aeeb-9c1b93592671 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:51.877685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454f3e37-cee0-46df-b68f-6039f7e1b98d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:51.878264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f3e37-cee0-46df-b68f-6039f7e1b98d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.878543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f3e37-cee0-46df-b68f-6039f7e1b98d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.878814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454f3e37-cee0-46df-b68f-6039f7e1b98d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.879437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f3e37-cee0-46df-b68f-6039f7e1b98d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:51.881613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454f3e37-cee0-46df-b68f-6039f7e1b98d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:51.891969 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4292/8580] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:48:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:48:51.895922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d0bdb-8fd0-4161-92db-35f9bb838042 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:51.905930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4d0bdb-8fd0-4161-92db-35f9bb838042 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:51.910616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d39c1-9515-43d3-a369-c1c6ae0f002a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:51.911309 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d39c1-9515-43d3-a369-c1c6ae0f002a admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.911631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d39c1-9515-43d3-a369-c1c6ae0f002a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.911945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d39c1-9515-43d3-a369-c1c6ae0f002a admin admin] PATH_INFO: `/v3/projects/deab71e5559a471cbe856a6360093250/users/afe39e1dac7e4a5eb5be30ac83fc748d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.926429 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d39c1-9515-43d3-a369-c1c6ae0f002a admin admin] RBAC: Authorizing `identity:create_grant(project_id=deab71e5559a471cbe856a6360093250, user_id=afe39e1dac7e4a5eb5be30ac83fc748d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:51.929625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d39c1-9515-43d3-a369-c1c6ae0f002a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:51.942136 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4289/8581] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:48:51 2022] PUT /identity/v3/projects/deab71e5559a471cbe856a6360093250/users/afe39e1dac7e4a5eb5be30ac83fc748d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:48:51.947073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5cc30-d03f-4169-9558-7fee0272f36f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:51.947364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5cc30-d03f-4169-9558-7fee0272f36f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:51.947639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f5cc30-d03f-4169-9558-7fee0272f36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:51.966846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-89f5cc30-d03f-4169-9558-7fee0272f36f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:51.968027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-89f5cc30-d03f-4169-9558-7fee0272f36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:52.029395 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4293/8582] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:48:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:48:52.039557 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d39c1-9515-43d3-a369-c1c6ae0f002a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:52.041243 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ac5d39c1-9515-43d3-a369-c1c6ae0f002a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:52.073152 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:52.102100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d39c1-9515-43d3-a369-c1c6ae0f002a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:52.105735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9befca7c-1fe5-4229-a0fa-db7384242573 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:52.106774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befca7c-1fe5-4229-a0fa-db7384242573 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:52.107056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befca7c-1fe5-4229-a0fa-db7384242573 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:52.107330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9befca7c-1fe5-4229-a0fa-db7384242573 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:52.116298 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befca7c-1fe5-4229-a0fa-db7384242573 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:52.117760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9befca7c-1fe5-4229-a0fa-db7384242573 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:52.127085 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4290/8583] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:48:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:48:55.885763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a57936-1ce8-4b98-9e4c-79cb55794834 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:55.886317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a57936-1ce8-4b98-9e4c-79cb55794834 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:55.886317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a57936-1ce8-4b98-9e4c-79cb55794834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:55.915697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-78a57936-1ce8-4b98-9e4c-79cb55794834 None None] MFA Rules not processed for user `afe39e1dac7e4a5eb5be30ac83fc748d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:55.916840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-78a57936-1ce8-4b98-9e4c-79cb55794834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:55.988066 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4294/8584] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:48:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:48:56.002609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83315-ae07-4494-a831-806e74a6db7a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:56.003669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83315-ae07-4494-a831-806e74a6db7a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:56.004138 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a83315-ae07-4494-a831-806e74a6db7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:56.045686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-50a83315-ae07-4494-a831-806e74a6db7a None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:56.046911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-50a83315-ae07-4494-a831-806e74a6db7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:56.120154 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4291/8585] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 09:48:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:48:56.126743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a57936-1ce8-4b98-9e4c-79cb55794834 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:56.139865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a57936-1ce8-4b98-9e4c-79cb55794834 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:56.148588 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31efcadd-c4bf-4a28-9aa7-df66225dbda4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:56.149025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efcadd-c4bf-4a28-9aa7-df66225dbda4 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:56.149329 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efcadd-c4bf-4a28-9aa7-df66225dbda4 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:56.149605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31efcadd-c4bf-4a28-9aa7-df66225dbda4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:56.158721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efcadd-c4bf-4a28-9aa7-df66225dbda4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:56.160319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31efcadd-c4bf-4a28-9aa7-df66225dbda4 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:56.170953 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4295/8586] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:48:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:48:57.432771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b3a0a-5f87-40ca-9e37-fd6e4cfaac1e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:57.433257 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b3a0a-5f87-40ca-9e37-fd6e4cfaac1e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:57.433388 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b3a0a-5f87-40ca-9e37-fd6e4cfaac1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:57.453135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e90b3a0a-5f87-40ca-9e37-fd6e4cfaac1e None None] MFA Rules not processed for user `afe39e1dac7e4a5eb5be30ac83fc748d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:57.454382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e90b3a0a-5f87-40ca-9e37-fd6e4cfaac1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:57.461279 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4292/8587] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:48:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:48:57.497689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ceece-fe6f-4c9a-8c41-167d79da545e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:57.498196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ceece-fe6f-4c9a-8c41-167d79da545e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:57.498299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ceece-fe6f-4c9a-8c41-167d79da545e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:57.520157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-176ceece-fe6f-4c9a-8c41-167d79da545e None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:57.521319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-176ceece-fe6f-4c9a-8c41-167d79da545e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:57.532569 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4296/8588] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 09:48:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:48:57.539084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd28d6-fdb4-40c5-aa35-b8cfaa412bbc None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:57.539588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd28d6-fdb4-40c5-aa35-b8cfaa412bbc None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:57.539937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd28d6-fdb4-40c5-aa35-b8cfaa412bbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:57.561091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-08cd28d6-fdb4-40c5-aa35-b8cfaa412bbc None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:57.562352 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-08cd28d6-fdb4-40c5-aa35-b8cfaa412bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:57.571662 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4293/8589] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:48:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:48:57.583391 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ee934-4ea3-4a0e-9c01-4b90800574ec None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:57.583788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ee934-4ea3-4a0e-9c01-4b90800574ec None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:57.584131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4ee934-4ea3-4a0e-9c01-4b90800574ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:57.639191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-3c4ee934-4ea3-4a0e-9c01-4b90800574ec None None] MFA Rules not processed for user `3a1cba9ba74946de8c58da91e59ddcfc`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:57.640530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3c4ee934-4ea3-4a0e-9c01-4b90800574ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:57.660170 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:48:57.706646 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4297/8590] 10.222.0.25 () {58 vars in 1059 bytes} [Mon Oct 24 09:48:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:48:57.713262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd28d6-fdb4-40c5-aa35-b8cfaa412bbc None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:57.722975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd28d6-fdb4-40c5-aa35-b8cfaa412bbc None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:57.727217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbf241d-cb28-4106-ac4d-6eba3bce19e9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:57.727811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf241d-cb28-4106-ac4d-6eba3bce19e9 service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:57.728091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf241d-cb28-4106-ac4d-6eba3bce19e9 service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:57.728361 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbf241d-cb28-4106-ac4d-6eba3bce19e9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:57.738793 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf241d-cb28-4106-ac4d-6eba3bce19e9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:57.740859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbf241d-cb28-4106-ac4d-6eba3bce19e9 service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:57.751967 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4294/8591] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:48:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:48:58.361382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ee934-4ea3-4a0e-9c01-4b90800574ec None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:58.363068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3c4ee934-4ea3-4a0e-9c01-4b90800574ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:58.376994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeec09-f9dc-46f4-babe-17755b87bafa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:58.377344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeec09-f9dc-46f4-babe-17755b87bafa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:58.377610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aeec09-f9dc-46f4-babe-17755b87bafa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:58.405884 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f4aeec09-f9dc-46f4-babe-17755b87bafa None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:48:58.407110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f4aeec09-f9dc-46f4-babe-17755b87bafa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:58.418281 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4295/8592] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:48:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:48:58.431311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeec09-f9dc-46f4-babe-17755b87bafa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:48:58.442789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aeec09-f9dc-46f4-babe-17755b87bafa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:58.449305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badda857-5633-4158-bb42-be606b11bd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:58.449942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badda857-5633-4158-bb42-be606b11bd92 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:58.450224 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badda857-5633-4158-bb42-be606b11bd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:58.450499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badda857-5633-4158-bb42-be606b11bd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:58.459011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4ee934-4ea3-4a0e-9c01-4b90800574ec None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:48:58.462155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badda857-5633-4158-bb42-be606b11bd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:58.463591 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badda857-5633-4158-bb42-be606b11bd92 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:58.464847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964549a-db9d-4629-8328-b49af1fac667 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:48:58.465548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964549a-db9d-4629-8328-b49af1fac667 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:48:58.465909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964549a-db9d-4629-8328-b49af1fac667 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:48:58.466249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964549a-db9d-4629-8328-b49af1fac667 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:48:58.468001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e964549a-db9d-4629-8328-b49af1fac667 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:48:58.475786 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4296/8593] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:48:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:48:58.480872 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964549a-db9d-4629-8328-b49af1fac667 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:48:58.482882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964549a-db9d-4629-8328-b49af1fac667 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:48:58.496290 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4298/8594] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:48:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:49:00.450378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badda857-5633-4158-bb42-be606b11bd92 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:49:00.459754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badda857-5633-4158-bb42-be606b11bd92 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:49:00.463487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaee6b-f3de-4d35-bf9d-18964d453742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:49:00.464086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaee6b-f3de-4d35-bf9d-18964d453742 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:49:00.464364 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaee6b-f3de-4d35-bf9d-18964d453742 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:49:00.464825 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aaee6b-f3de-4d35-bf9d-18964d453742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:49:00.469587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-04aaee6b-f3de-4d35-bf9d-18964d453742 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:49:00.484067 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aaee6b-f3de-4d35-bf9d-18964d453742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:49:00.485662 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aaee6b-f3de-4d35-bf9d-18964d453742 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:49:00.498025 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4297/8595] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:49:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:49:01.283298 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc89cd-5cab-48bc-aead-79d946a37527 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:49:01.283766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc89cd-5cab-48bc-aead-79d946a37527 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:49:01.283969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacc89cd-5cab-48bc-aead-79d946a37527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:49:01.305434 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-cacc89cd-5cab-48bc-aead-79d946a37527 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:49:01.306972 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-cacc89cd-5cab-48bc-aead-79d946a37527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:49:01.313357 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4299/8596] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Oct 24 09:49:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:49:01.325955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaee6b-f3de-4d35-bf9d-18964d453742 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:49:01.334654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aaee6b-f3de-4d35-bf9d-18964d453742 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:49:01.338240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad325c-1fe6-44dd-b108-c6b0d0285236 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:49:01.338830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad325c-1fe6-44dd-b108-c6b0d0285236 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:49:01.339112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad325c-1fe6-44dd-b108-c6b0d0285236 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:49:01.339387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ad325c-1fe6-44dd-b108-c6b0d0285236 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:49:01.346294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad325c-1fe6-44dd-b108-c6b0d0285236 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:49:01.347718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ad325c-1fe6-44dd-b108-c6b0d0285236 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:49:01.355904 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4298/8597] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:49:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:49:09.350000 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31c1d6-9a61-47fd-9c72-9645de94dff1 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:49:09.350470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31c1d6-9a61-47fd-9c72-9645de94dff1 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:49:09.350587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a31c1d6-9a61-47fd-9c72-9645de94dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:49:09.369916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2a31c1d6-9a61-47fd-9c72-9645de94dff1 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:49:09.371113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2a31c1d6-9a61-47fd-9c72-9645de94dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:49:09.380336 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4300/8598] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:49:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:49:09.394200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad325c-1fe6-44dd-b108-c6b0d0285236 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:49:09.407997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ad325c-1fe6-44dd-b108-c6b0d0285236 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:49:09.413968 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fde6b-9e35-4c44-9bcb-8196203f33c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:49:09.414568 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fde6b-9e35-4c44-9bcb-8196203f33c0 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:49:09.414855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fde6b-9e35-4c44-9bcb-8196203f33c0 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:49:09.415134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888fde6b-9e35-4c44-9bcb-8196203f33c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:49:09.424353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fde6b-9e35-4c44-9bcb-8196203f33c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:49:09.426467 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888fde6b-9e35-4c44-9bcb-8196203f33c0 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:49:09.436987 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4299/8599] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:49:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:49:19.364460 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=54 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:49:19.432563 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=90 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:49:58.171617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b450e11-d0ad-4499-8261-f47e449046c5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:49:58.172131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b450e11-d0ad-4499-8261-f47e449046c5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:49:58.172230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b450e11-d0ad-4499-8261-f47e449046c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:49:58.191840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-9b450e11-d0ad-4499-8261-f47e449046c5 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:49:58.193567 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9b450e11-d0ad-4499-8261-f47e449046c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:49:58.199941 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4301/8600] 10.222.0.52 () {58 vars in 1015 bytes} [Mon Oct 24 09:49:58 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:49:58.212838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fde6b-9e35-4c44-9bcb-8196203f33c0 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:49:58.214299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-888fde6b-9e35-4c44-9bcb-8196203f33c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:49:58.225982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888fde6b-9e35-4c44-9bcb-8196203f33c0 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:49:58.229519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b54249-45d4-4416-a5ff-4829af5b54e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:49:58.230100 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b54249-45d4-4416-a5ff-4829af5b54e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:49:58.230376 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b54249-45d4-4416-a5ff-4829af5b54e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:49:58.230644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b54249-45d4-4416-a5ff-4829af5b54e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:49:58.237411 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b54249-45d4-4416-a5ff-4829af5b54e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:49:58.238816 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b54249-45d4-4416-a5ff-4829af5b54e4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:49:58.246435 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4300/8601] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:49:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:50:03.110484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d62fc7-d240-4a94-ace1-80d1882ae48f None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:50:03.110973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d62fc7-d240-4a94-ace1-80d1882ae48f None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:50:03.111359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d62fc7-d240-4a94-ace1-80d1882ae48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:50:03.135383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-02d62fc7-d240-4a94-ace1-80d1882ae48f None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:50:03.136595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-02d62fc7-d240-4a94-ace1-80d1882ae48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:50:03.147111 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4302/8602] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:50:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:50:03.161531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b54249-45d4-4416-a5ff-4829af5b54e4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:50:03.175272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b54249-45d4-4416-a5ff-4829af5b54e4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:50:03.183011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549d9fbe-04cb-4744-9a6d-651fccc89a97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:50:03.183769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d9fbe-04cb-4744-9a6d-651fccc89a97 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:50:03.184211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d9fbe-04cb-4744-9a6d-651fccc89a97 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:50:03.184543 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549d9fbe-04cb-4744-9a6d-651fccc89a97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:50:03.194676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d9fbe-04cb-4744-9a6d-651fccc89a97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:50:03.196336 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549d9fbe-04cb-4744-9a6d-651fccc89a97 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:50:03.209009 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4301/8603] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:50:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:50:09.033554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a6ef9-e9bd-4c55-aac9-4295e32f4d71 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:50:09.034041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a6ef9-e9bd-4c55-aac9-4295e32f4d71 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:50:09.034138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1a6ef9-e9bd-4c55-aac9-4295e32f4d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:50:09.054459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fd1a6ef9-e9bd-4c55-aac9-4295e32f4d71 None None] MFA Rules not processed for user `afe39e1dac7e4a5eb5be30ac83fc748d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:50:09.055668 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fd1a6ef9-e9bd-4c55-aac9-4295e32f4d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:50:09.062598 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4303/8604] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:50:09 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:50:09.367541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9aee-69b1-4ac1-8e05-61a3fa0a3875 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:50:09.368089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9aee-69b1-4ac1-8e05-61a3fa0a3875 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:50:09.368089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60d9aee-69b1-4ac1-8e05-61a3fa0a3875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:50:09.386792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c60d9aee-69b1-4ac1-8e05-61a3fa0a3875 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:50:09.387957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c60d9aee-69b1-4ac1-8e05-61a3fa0a3875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:50:09.394302 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4302/8605] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:50:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:50:09.406468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a6ef9-e9bd-4c55-aac9-4295e32f4d71 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:50:09.416407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1a6ef9-e9bd-4c55-aac9-4295e32f4d71 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:50:09.419836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c97c9-7a0b-4cf0-995c-ef1cee5ce4ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:50:09.420423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c97c9-7a0b-4cf0-995c-ef1cee5ce4ee service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:50:09.420699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c97c9-7a0b-4cf0-995c-ef1cee5ce4ee service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:50:09.420969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c97c9-7a0b-4cf0-995c-ef1cee5ce4ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:50:09.427942 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c97c9-7a0b-4cf0-995c-ef1cee5ce4ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:50:09.429392 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e4c97c9-7a0b-4cf0-995c-ef1cee5ce4ee service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:50:09.436947 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4304/8606] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:50:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:50:12.257254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e1da-c2dd-41ce-a305-30c96266286a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:50:12.257831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e1da-c2dd-41ce-a305-30c96266286a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:50:12.258088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7e1da-c2dd-41ce-a305-30c96266286a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:50:12.284229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c8e7e1da-c2dd-41ce-a305-30c96266286a None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:50:12.286413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8e7e1da-c2dd-41ce-a305-30c96266286a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:50:12.297011 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4303/8607] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:50:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:50:12.313777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c97c9-7a0b-4cf0-995c-ef1cee5ce4ee service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:50:12.327279 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c97c9-7a0b-4cf0-995c-ef1cee5ce4ee service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:50:12.335032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a385b-7a18-4fbd-9ed4-05ee7238e552 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:50:12.335649 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a385b-7a18-4fbd-9ed4-05ee7238e552 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:50:12.335929 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a385b-7a18-4fbd-9ed4-05ee7238e552 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:50:12.336203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a385b-7a18-4fbd-9ed4-05ee7238e552 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:50:12.346029 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a385b-7a18-4fbd-9ed4-05ee7238e552 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:50:12.347643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a385b-7a18-4fbd-9ed4-05ee7238e552 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:50:12.360079 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4305/8608] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:50:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:50:22.278571 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=18 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:50:22.354802 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=21 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:51:25.675807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d0c80-5f99-4b13-9513-20a8434b02d6 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:51:25.676285 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d0c80-5f99-4b13-9513-20a8434b02d6 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:51:25.676395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01d0c80-5f99-4b13-9513-20a8434b02d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:51:25.705585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a01d0c80-5f99-4b13-9513-20a8434b02d6 None None] MFA Rules not processed for user `afe39e1dac7e4a5eb5be30ac83fc748d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:51:25.706776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a01d0c80-5f99-4b13-9513-20a8434b02d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:51:25.729357 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4304/8609] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:51:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:51:35.727583 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=15 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:51:52.546062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a385b-7a18-4fbd-9ed4-05ee7238e552 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:51:52.605515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a385b-7a18-4fbd-9ed4-05ee7238e552 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:51:52.610569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9259822-c5e2-475d-9c5b-ebf5c4c2a13c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:51:52.611161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9259822-c5e2-475d-9c5b-ebf5c4c2a13c service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:51:52.611465 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9259822-c5e2-475d-9c5b-ebf5c4c2a13c service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:51:52.611742 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9259822-c5e2-475d-9c5b-ebf5c4c2a13c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:51:52.613476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a9259822-c5e2-475d-9c5b-ebf5c4c2a13c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:51:52.637748 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9259822-c5e2-475d-9c5b-ebf5c4c2a13c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:51:52.639305 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9259822-c5e2-475d-9c5b-ebf5c4c2a13c service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:51:52.648865 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4306/8610] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:51:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:52:02.644863 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=32 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:10.121741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d0c80-5f99-4b13-9513-20a8434b02d6 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:52:10.146657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01d0c80-5f99-4b13-9513-20a8434b02d6 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:52:10.146657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d612fd-9d88-4cb1-bcd1-a71fb00fab60 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:52:10.146657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d612fd-9d88-4cb1-bcd1-a71fb00fab60 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:52:10.147088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d612fd-9d88-4cb1-bcd1-a71fb00fab60 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:52:10.147088 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d612fd-9d88-4cb1-bcd1-a71fb00fab60 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:52:10.149499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d2d612fd-9d88-4cb1-bcd1-a71fb00fab60 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:52:10.177358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d612fd-9d88-4cb1-bcd1-a71fb00fab60 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:52:10.179075 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d612fd-9d88-4cb1-bcd1-a71fb00fab60 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:52:10.189800 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4305/8611] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:52:10 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:52:10.268575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9259822-c5e2-475d-9c5b-ebf5c4c2a13c service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:52:10.279844 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9259822-c5e2-475d-9c5b-ebf5c4c2a13c service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:52:10.284777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92099ca-e332-4982-9784-8cde880ed000 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:52:10.285421 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92099ca-e332-4982-9784-8cde880ed000 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:52:10.285700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92099ca-e332-4982-9784-8cde880ed000 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:52:10.286002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92099ca-e332-4982-9784-8cde880ed000 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:52:10.287765 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c92099ca-e332-4982-9784-8cde880ed000 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:52:10.299377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92099ca-e332-4982-9784-8cde880ed000 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:52:10.300941 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92099ca-e332-4982-9784-8cde880ed000 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:52:10.310807 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4307/8612] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:52:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:52:10.482614 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d612fd-9d88-4cb1-bcd1-a71fb00fab60 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:52:10.491262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d612fd-9d88-4cb1-bcd1-a71fb00fab60 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:52:10.495523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18339e8-7a7c-4284-aa7b-0d594b3d8d6c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:52:10.496121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18339e8-7a7c-4284-aa7b-0d594b3d8d6c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:52:10.496422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18339e8-7a7c-4284-aa7b-0d594b3d8d6c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:52:10.496681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18339e8-7a7c-4284-aa7b-0d594b3d8d6c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:52:10.498469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d18339e8-7a7c-4284-aa7b-0d594b3d8d6c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:52:10.514279 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18339e8-7a7c-4284-aa7b-0d594b3d8d6c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:52:10.515697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18339e8-7a7c-4284-aa7b-0d594b3d8d6c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:52:10.538728 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4306/8613] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:52:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:52:10.600632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92099ca-e332-4982-9784-8cde880ed000 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:52:10.610997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92099ca-e332-4982-9784-8cde880ed000 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:52:10.616014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6f431-6a14-4e07-b117-f3a68d50f488 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:52:10.616621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6f431-6a14-4e07-b117-f3a68d50f488 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:52:10.616902 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6f431-6a14-4e07-b117-f3a68d50f488 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:52:10.617175 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d6f431-6a14-4e07-b117-f3a68d50f488 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:52:10.619393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46d6f431-6a14-4e07-b117-f3a68d50f488 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:52:10.630344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6f431-6a14-4e07-b117-f3a68d50f488 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:52:10.631906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d6f431-6a14-4e07-b117-f3a68d50f488 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:52:10.642091 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4308/8614] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:52:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:52:20.536295 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=25 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:20.638036 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=12 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:36.544581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91bb08-3945-42c3-9109-8687167f6f07 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:52:36.545085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91bb08-3945-42c3-9109-8687167f6f07 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:52:36.545197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91bb08-3945-42c3-9109-8687167f6f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:52:36.590809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-0e91bb08-3945-42c3-9109-8687167f6f07 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:52:36.591917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-0e91bb08-3945-42c3-9109-8687167f6f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:52:36.600346 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4307/8615] 10.222.0.25 () {58 vars in 1058 bytes} [Mon Oct 24 09:52:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:52:36.607049 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6f431-6a14-4e07-b117-f3a68d50f488 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:52:36.617153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d6f431-6a14-4e07-b117-f3a68d50f488 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:52:36.622504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65c78c2-b720-4ce6-8ea2-8ef53660c9a9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:52:36.623100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c78c2-b720-4ce6-8ea2-8ef53660c9a9 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:52:36.623374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c78c2-b720-4ce6-8ea2-8ef53660c9a9 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:52:36.623645 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65c78c2-b720-4ce6-8ea2-8ef53660c9a9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:52:36.625515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b65c78c2-b720-4ce6-8ea2-8ef53660c9a9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:52:36.638237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c78c2-b720-4ce6-8ea2-8ef53660c9a9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:52:36.639822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65c78c2-b720-4ce6-8ea2-8ef53660c9a9 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:52:36.649366 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4309/8616] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:52:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:52:44.448340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b28bd-6786-4908-8558-26dc98c31938 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:52:44.448828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b28bd-6786-4908-8558-26dc98c31938 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:52:44.448929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b28bd-6786-4908-8558-26dc98c31938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:52:44.467748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4d8b28bd-6786-4908-8558-26dc98c31938 None None] MFA Rules not processed for user `afe39e1dac7e4a5eb5be30ac83fc748d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:52:44.468923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4d8b28bd-6786-4908-8558-26dc98c31938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:52:44.475730 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4308/8617] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:52:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:52:44.774726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f4aea-1aee-45a2-ae2e-1ea8e57b4308 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:52:44.775333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f4aea-1aee-45a2-ae2e-1ea8e57b4308 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:52:44.775333 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11f4aea-1aee-45a2-ae2e-1ea8e57b4308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:52:44.814317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a11f4aea-1aee-45a2-ae2e-1ea8e57b4308 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:52:44.815427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a11f4aea-1aee-45a2-ae2e-1ea8e57b4308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:52:44.822371 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4310/8618] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:52:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:52:44.834587 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b28bd-6786-4908-8558-26dc98c31938 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:52:44.845033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b28bd-6786-4908-8558-26dc98c31938 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:52:44.848650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a086d3f-7f13-4f41-84fd-965792af0180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:52:44.849239 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086d3f-7f13-4f41-84fd-965792af0180 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:52:44.849541 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086d3f-7f13-4f41-84fd-965792af0180 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:52:44.849834 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a086d3f-7f13-4f41-84fd-965792af0180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:52:44.857387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a086d3f-7f13-4f41-84fd-965792af0180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:52:44.858815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a086d3f-7f13-4f41-84fd-965792af0180 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:52:44.866329 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4309/8619] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:52:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:52:54.811855 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=15 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:52:54.863086 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=22 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:42.522251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55763584-801e-4c7a-8e96-6ecf4d2080c7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:53:42.522833 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55763584-801e-4c7a-8e96-6ecf4d2080c7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:53:42.522957 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55763584-801e-4c7a-8e96-6ecf4d2080c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:53:42.543229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-55763584-801e-4c7a-8e96-6ecf4d2080c7 None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:53:42.544430 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-55763584-801e-4c7a-8e96-6ecf4d2080c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:53:42.550950 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4311/8620] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:53:42 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:53:42.562671 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a086d3f-7f13-4f41-84fd-965792af0180 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:53:42.571201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a086d3f-7f13-4f41-84fd-965792af0180 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:53:42.574965 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb899f9-261f-453b-bbd5-e995b01024c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:53:42.575540 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb899f9-261f-453b-bbd5-e995b01024c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:53:42.575866 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb899f9-261f-453b-bbd5-e995b01024c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:53:42.576144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb899f9-261f-453b-bbd5-e995b01024c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:53:42.583514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb899f9-261f-453b-bbd5-e995b01024c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:53:42.584935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb899f9-261f-453b-bbd5-e995b01024c4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:53:42.594746 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4310/8621] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:53:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:53:52.537726 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:52.590915 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:53:55.429874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55763584-801e-4c7a-8e96-6ecf4d2080c7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:53:55.449731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55763584-801e-4c7a-8e96-6ecf4d2080c7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:53:55.455013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4ffe-0a57-4d1d-98cb-342890bf9635 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:53:55.455600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4ffe-0a57-4d1d-98cb-342890bf9635 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:53:55.455884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4ffe-0a57-4d1d-98cb-342890bf9635 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:53:55.456160 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974b4ffe-0a57-4d1d-98cb-342890bf9635 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:53:55.463767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4ffe-0a57-4d1d-98cb-342890bf9635 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:53:55.465371 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974b4ffe-0a57-4d1d-98cb-342890bf9635 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:53:55.474562 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4312/8622] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:53:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:53:57.873217 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb899f9-261f-453b-bbd5-e995b01024c4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:53:57.881723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb899f9-261f-453b-bbd5-e995b01024c4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:53:57.885988 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af05c-c1fc-42d8-bb23-bf4bb0a4953c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:53:57.886577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af05c-c1fc-42d8-bb23-bf4bb0a4953c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:53:57.886887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af05c-c1fc-42d8-bb23-bf4bb0a4953c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:53:57.887194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941af05c-c1fc-42d8-bb23-bf4bb0a4953c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:53:57.896980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af05c-c1fc-42d8-bb23-bf4bb0a4953c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:53:57.898457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-941af05c-c1fc-42d8-bb23-bf4bb0a4953c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:53:57.909192 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4311/8623] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:53:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:53:59.089918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4ffe-0a57-4d1d-98cb-342890bf9635 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:53:59.099206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974b4ffe-0a57-4d1d-98cb-342890bf9635 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:53:59.103406 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60a99-a307-4faa-802b-1e2a2c824423 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:53:59.103988 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60a99-a307-4faa-802b-1e2a2c824423 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:53:59.104268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60a99-a307-4faa-802b-1e2a2c824423 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:53:59.104541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef60a99-a307-4faa-802b-1e2a2c824423 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:53:59.114536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60a99-a307-4faa-802b-1e2a2c824423 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:53:59.116001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef60a99-a307-4faa-802b-1e2a2c824423 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:53:59.126905 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4313/8624] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:53:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:54:03.551798 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af05c-c1fc-42d8-bb23-bf4bb0a4953c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:03.560914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941af05c-c1fc-42d8-bb23-bf4bb0a4953c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:03.564564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5dab97-b4f8-4fd9-987f-92ae7bce3d0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:03.565151 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dab97-b4f8-4fd9-987f-92ae7bce3d0e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:03.565473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dab97-b4f8-4fd9-987f-92ae7bce3d0e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:03.565749 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5dab97-b4f8-4fd9-987f-92ae7bce3d0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:03.572711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dab97-b4f8-4fd9-987f-92ae7bce3d0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:03.574162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5dab97-b4f8-4fd9-987f-92ae7bce3d0e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:03.581845 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4312/8625] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:54:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:54:09.122305 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=15 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:13.578533 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=12 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:50.162720 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60a99-a307-4faa-802b-1e2a2c824423 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:50.171931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef60a99-a307-4faa-802b-1e2a2c824423 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:50.175554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aff1d-2998-4a4f-9cf4-ee8fd73ed3a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:50.176138 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aff1d-2998-4a4f-9cf4-ee8fd73ed3a0 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:50.176414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aff1d-2998-4a4f-9cf4-ee8fd73ed3a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:50.176685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178aff1d-2998-4a4f-9cf4-ee8fd73ed3a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:50.185970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178aff1d-2998-4a4f-9cf4-ee8fd73ed3a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:50.187384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178aff1d-2998-4a4f-9cf4-ee8fd73ed3a0 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:50.196745 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4314/8626] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:54:53.367746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232edd9c-66e1-4e7a-8468-7c2318ebe060 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:53.368305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232edd9c-66e1-4e7a-8468-7c2318ebe060 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:53.368448 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232edd9c-66e1-4e7a-8468-7c2318ebe060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:53.392247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-232edd9c-66e1-4e7a-8468-7c2318ebe060 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:54:53.394006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-232edd9c-66e1-4e7a-8468-7c2318ebe060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:54:53.406769 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4313/8627] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:54:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:54:53.436848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aff1d-2998-4a4f-9cf4-ee8fd73ed3a0 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:53.451258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178aff1d-2998-4a4f-9cf4-ee8fd73ed3a0 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:53.465273 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523107c2-3138-4119-b507-49cd55230db5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:53.466621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523107c2-3138-4119-b507-49cd55230db5 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:53.466809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232edd9c-66e1-4e7a-8468-7c2318ebe060 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:53.466937 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523107c2-3138-4119-b507-49cd55230db5 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:53.467082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523107c2-3138-4119-b507-49cd55230db5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:53.478318 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232edd9c-66e1-4e7a-8468-7c2318ebe060 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:53.483814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:53.484590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:53.484989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523107c2-3138-4119-b507-49cd55230db5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:53.485112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:53.485424 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] PATH_INFO: `/v3/users/afe39e1dac7e4a5eb5be30ac83fc748d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:53.487004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523107c2-3138-4119-b507-49cd55230db5 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:53.487242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=afe39e1dac7e4a5eb5be30ac83fc748d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:53.489516 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:53.501146 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4315/8628] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:54:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:54:53.557774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afe39e1dac7e4a5eb5be30ac83fc748d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.569929 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afe39e1dac7e4a5eb5be30ac83fc748d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.571187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afe39e1dac7e4a5eb5be30ac83fc748d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.578839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afe39e1dac7e4a5eb5be30ac83fc748d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.586001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-19d71c0e-45ec-4396-8e19-c6a75e323c0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afe39e1dac7e4a5eb5be30ac83fc748d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.591814 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4314/8629] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:54:53 2022] DELETE /identity/v3/users/afe39e1dac7e4a5eb5be30ac83fc748d => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:54:53.766620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523107c2-3138-4119-b507-49cd55230db5 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:53.778832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523107c2-3138-4119-b507-49cd55230db5 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:53.839157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:53.839699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:53.839979 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:53.840256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] PATH_INFO: `/v3/projects/deab71e5559a471cbe856a6360093250` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:53.841397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] RBAC: Authorizing `identity:delete_project(project_id=deab71e5559a471cbe856a6360093250)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:53.843302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:53.889148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'deab71e5559a471cbe856a6360093250', 'request_id': 'req-d17c684e-c9dd-4d5f-9293-83e9936d420d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.896915 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'deab71e5559a471cbe856a6360093250', 'request_id': 'req-d17c684e-c9dd-4d5f-9293-83e9936d420d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.905944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'deab71e5559a471cbe856a6360093250', 'request_id': 'req-d17c684e-c9dd-4d5f-9293-83e9936d420d'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.916595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] The token cache is being invalidate because project deab71e5559a471cbe856a6360093250 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:54:53.916882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.917549 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d17c684e-c9dd-4d5f-9293-83e9936d420d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:54:53.919023 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4316/8630] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:54:53 2022] DELETE /identity/v3/projects/deab71e5559a471cbe856a6360093250 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:54:53.923962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dd279-9cdb-420a-b31d-9353347db786 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:53.924317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dd279-9cdb-420a-b31d-9353347db786 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:53.924658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9dd279-9cdb-420a-b31d-9353347db786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:53.943781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cb9dd279-9cdb-420a-b31d-9353347db786 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:54:53.944996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cb9dd279-9cdb-420a-b31d-9353347db786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:54:54.002743 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4315/8631] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:54:54.011184 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b272ab-1012-4659-94d8-415b0c0384dd None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:54.011477 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b272ab-1012-4659-94d8-415b0c0384dd None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:54.011760 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b272ab-1012-4659-94d8-415b0c0384dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:54.032704 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-25b272ab-1012-4659-94d8-415b0c0384dd None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:54:54.034021 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-25b272ab-1012-4659-94d8-415b0c0384dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:54:54.042113 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4317/8632] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:54:54.046445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dd279-9cdb-420a-b31d-9353347db786 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:54.056939 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9dd279-9cdb-420a-b31d-9353347db786 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:54.061818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426866e4-c956-488a-8dda-2c001e2bea6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:54.062428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426866e4-c956-488a-8dda-2c001e2bea6b admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:54.062729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426866e4-c956-488a-8dda-2c001e2bea6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:54.063009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426866e4-c956-488a-8dda-2c001e2bea6b admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:54.063678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426866e4-c956-488a-8dda-2c001e2bea6b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:54:54.063979 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426866e4-c956-488a-8dda-2c001e2bea6b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:54.065664 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426866e4-c956-488a-8dda-2c001e2bea6b admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:54.078221 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4316/8633] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:54:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:54:54.082662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b272ab-1012-4659-94d8-415b0c0384dd None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:54.092605 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b272ab-1012-4659-94d8-415b0c0384dd None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:54.097179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fef68-6a03-49c8-bcfa-6c1409acc17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:54.097804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fef68-6a03-49c8-bcfa-6c1409acc17c admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:54.098084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fef68-6a03-49c8-bcfa-6c1409acc17c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:54.098360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5fef68-6a03-49c8-bcfa-6c1409acc17c admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:54.098987 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fef68-6a03-49c8-bcfa-6c1409acc17c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:54.100881 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5fef68-6a03-49c8-bcfa-6c1409acc17c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:54.127840 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4318/8634] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:54:54 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:54:54.131977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426866e4-c956-488a-8dda-2c001e2bea6b admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:54.142402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426866e4-c956-488a-8dda-2c001e2bea6b admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:54.190212 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:54.201874 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1bc6a-c008-4da9-9ae6-1cee40fa9942 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:54.202517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1bc6a-c008-4da9-9ae6-1cee40fa9942 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:54.202799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1bc6a-c008-4da9-9ae6-1cee40fa9942 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:54.203077 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1bc6a-c008-4da9-9ae6-1cee40fa9942 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:54.203705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1bc6a-c008-4da9-9ae6-1cee40fa9942 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:54.205731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1bc6a-c008-4da9-9ae6-1cee40fa9942 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:54.226234 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4317/8635] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:54:54 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:54:54.230621 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fef68-6a03-49c8-bcfa-6c1409acc17c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:54.240980 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5fef68-6a03-49c8-bcfa-6c1409acc17c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:54.246268 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad26355-339e-4f0f-988c-fc8b681076e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:54.246865 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad26355-339e-4f0f-988c-fc8b681076e6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:54.247146 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad26355-339e-4f0f-988c-fc8b681076e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:54.247417 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad26355-339e-4f0f-988c-fc8b681076e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:54.248083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad26355-339e-4f0f-988c-fc8b681076e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:54.249977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad26355-339e-4f0f-988c-fc8b681076e6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:54.259900 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4319/8636] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:54:54.263832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1bc6a-c008-4da9-9ae6-1cee40fa9942 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:54.274235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1bc6a-c008-4da9-9ae6-1cee40fa9942 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:54.278769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cb441-bf07-41c7-b24c-6700c00cb610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:54.279381 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cb441-bf07-41c7-b24c-6700c00cb610 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:54.279909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cb441-bf07-41c7-b24c-6700c00cb610 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:54.280181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cb441-bf07-41c7-b24c-6700c00cb610 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:54.280807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cb441-bf07-41c7-b24c-6700c00cb610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:54.282422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cb441-bf07-41c7-b24c-6700c00cb610 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:54.293610 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4318/8637] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:54:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:54:54.297920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad26355-339e-4f0f-988c-fc8b681076e6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:54.308059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad26355-339e-4f0f-988c-fc8b681076e6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:54.312671 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685602f-3a5f-42e8-a26e-b3adaf276fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:54.313322 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685602f-3a5f-42e8-a26e-b3adaf276fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:54.313613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685602f-3a5f-42e8-a26e-b3adaf276fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:54.313888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685602f-3a5f-42e8-a26e-b3adaf276fa4 admin admin] PATH_INFO: `/v3/projects/7fb13907ffea4abdbc6ce84f83038f44/users/7a77edfe753f40daaa8b0c00ccb18b47/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:54.328145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685602f-3a5f-42e8-a26e-b3adaf276fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fb13907ffea4abdbc6ce84f83038f44, user_id=7a77edfe753f40daaa8b0c00ccb18b47, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:54.330832 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5685602f-3a5f-42e8-a26e-b3adaf276fa4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:54.340142 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:54.345381 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4320/8638] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:54:54 2022] PUT /identity/v3/projects/7fb13907ffea4abdbc6ce84f83038f44/users/7a77edfe753f40daaa8b0c00ccb18b47/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:54:54.350366 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ff438-cb02-4469-9ffa-a7651255616b None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:54.350663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ff438-cb02-4469-9ffa-a7651255616b None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:54.350970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ff438-cb02-4469-9ffa-a7651255616b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:54.370281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f47ff438-cb02-4469-9ffa-a7651255616b None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:54:54.371520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f47ff438-cb02-4469-9ffa-a7651255616b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:54:54.429517 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4319/8639] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:54:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:54:54.439070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685602f-3a5f-42e8-a26e-b3adaf276fa4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:54.440785 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5685602f-3a5f-42e8-a26e-b3adaf276fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:54:54.497960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685602f-3a5f-42e8-a26e-b3adaf276fa4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:54.501608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda8e39d-a4b3-4c67-be22-6fa1d944bcad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:54.502256 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8e39d-a4b3-4c67-be22-6fa1d944bcad service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:54.502544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8e39d-a4b3-4c67-be22-6fa1d944bcad service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:54.502818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda8e39d-a4b3-4c67-be22-6fa1d944bcad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:54.512480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8e39d-a4b3-4c67-be22-6fa1d944bcad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:54.513977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda8e39d-a4b3-4c67-be22-6fa1d944bcad service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:54.523662 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4321/8640] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:54:58.791599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb948-7c34-458f-9036-007110a0fa09 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:58.792194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb948-7c34-458f-9036-007110a0fa09 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:58.792194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23bb948-7c34-458f-9036-007110a0fa09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:58.821274 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e23bb948-7c34-458f-9036-007110a0fa09 None None] MFA Rules not processed for user `7a77edfe753f40daaa8b0c00ccb18b47`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:54:58.822563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e23bb948-7c34-458f-9036-007110a0fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:54:58.895440 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4320/8641] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:54:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:54:58.907429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a73d1-854d-45d9-8dd7-10b8537f473e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:58.907907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a73d1-854d-45d9-8dd7-10b8537f473e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:58.908043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a73d1-854d-45d9-8dd7-10b8537f473e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:58.928251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a71a73d1-854d-45d9-8dd7-10b8537f473e None None] MFA Rules not processed for user `7a77edfe753f40daaa8b0c00ccb18b47`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:54:58.929538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a71a73d1-854d-45d9-8dd7-10b8537f473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:54:58.936781 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4322/8642] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:54:58 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:54:58.948488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb948-7c34-458f-9036-007110a0fa09 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:54:58.949926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e23bb948-7c34-458f-9036-007110a0fa09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:54:59.018075 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:54:59.042197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23bb948-7c34-458f-9036-007110a0fa09 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:54:59.048179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fbc2f-a947-4a3f-905b-0a4553039772 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:54:59.048804 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fbc2f-a947-4a3f-905b-0a4553039772 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:54:59.049090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fbc2f-a947-4a3f-905b-0a4553039772 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:54:59.049404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fbc2f-a947-4a3f-905b-0a4553039772 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:54:59.060021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fbc2f-a947-4a3f-905b-0a4553039772 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:54:59.062168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40fbc2f-a947-4a3f-905b-0a4553039772 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:54:59.071885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4321/8643] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:54:58 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:00.703612 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a73d1-854d-45d9-8dd7-10b8537f473e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:00.705071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a71a73d1-854d-45d9-8dd7-10b8537f473e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:00.782189 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a73d1-854d-45d9-8dd7-10b8537f473e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:00.787187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6102e834-7d33-4922-9d76-6e58bda2d170 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:00.787831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102e834-7d33-4922-9d76-6e58bda2d170 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:00.788230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102e834-7d33-4922-9d76-6e58bda2d170 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:00.788521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6102e834-7d33-4922-9d76-6e58bda2d170 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:00.790791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6102e834-7d33-4922-9d76-6e58bda2d170 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:00.805350 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102e834-7d33-4922-9d76-6e58bda2d170 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:00.806970 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6102e834-7d33-4922-9d76-6e58bda2d170 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:00.817553 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4323/8644] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:09.067449 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=11 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:10.438368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fbc2f-a947-4a3f-905b-0a4553039772 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:10.441093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e40fbc2f-a947-4a3f-905b-0a4553039772 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:10.455872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40fbc2f-a947-4a3f-905b-0a4553039772 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:10.461924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:10.462523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:10.462805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:10.463094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:10.464813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:10.477905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:10.479478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:10.489821 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4322/8645] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:10.813584 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=61 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:12.414611 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a93b0-de71-4b3b-a522-579e9faa1542 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:12.415195 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a93b0-de71-4b3b-a522-579e9faa1542 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:12.415316 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6a93b0-de71-4b3b-a522-579e9faa1542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:12.434032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4a6a93b0-de71-4b3b-a522-579e9faa1542 None None] MFA Rules not processed for user `7a77edfe753f40daaa8b0c00ccb18b47`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:12.435290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a6a93b0-de71-4b3b-a522-579e9faa1542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:12.442050 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4324/8646] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:12.689740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:12.691154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:12.702303 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e86ae9-5c29-446c-82f5-8d58423830c1 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:12.705835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0c285-0642-485c-af15-451eef37e12a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:12.706420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0c285-0642-485c-af15-451eef37e12a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:12.706700 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0c285-0642-485c-af15-451eef37e12a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:12.706970 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0c285-0642-485c-af15-451eef37e12a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:12.708618 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ffb0c285-0642-485c-af15-451eef37e12a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:12.718463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0c285-0642-485c-af15-451eef37e12a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:12.719877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb0c285-0642-485c-af15-451eef37e12a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:12.728297 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4323/8647] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:14.929764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a93b0-de71-4b3b-a522-579e9faa1542 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:14.939927 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6a93b0-de71-4b3b-a522-579e9faa1542 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:14.943750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa75734-a734-4d55-969a-8c98c333470c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:14.944410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa75734-a734-4d55-969a-8c98c333470c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:14.944663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa75734-a734-4d55-969a-8c98c333470c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:14.945225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa75734-a734-4d55-969a-8c98c333470c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:14.947102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-baa75734-a734-4d55-969a-8c98c333470c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:14.958670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa75734-a734-4d55-969a-8c98c333470c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:14.960114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa75734-a734-4d55-969a-8c98c333470c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:14.969371 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4325/8648] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:14 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:15.621068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0c285-0642-485c-af15-451eef37e12a service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:15.637886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0c285-0642-485c-af15-451eef37e12a service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:15.644574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b63b0-e97a-4d6d-a7f7-23b9f8c570fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:15.645246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b63b0-e97a-4d6d-a7f7-23b9f8c570fc service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:15.645631 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b63b0-e97a-4d6d-a7f7-23b9f8c570fc service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:15.646136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b63b0-e97a-4d6d-a7f7-23b9f8c570fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:15.648581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-312b63b0-e97a-4d6d-a7f7-23b9f8c570fc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:15.661709 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b63b0-e97a-4d6d-a7f7-23b9f8c570fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:15.663308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b63b0-e97a-4d6d-a7f7-23b9f8c570fc service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:15.674914 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4324/8649] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:24.965742 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=9 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:25.671844 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=18 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:29.349884 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa75734-a734-4d55-969a-8c98c333470c service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:29.364777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa75734-a734-4d55-969a-8c98c333470c service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:29.371552 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a57180-2408-4228-8850-453a24b61bf0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:29.372370 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a57180-2408-4228-8850-453a24b61bf0 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:29.372814 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a57180-2408-4228-8850-453a24b61bf0 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:29.373419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a57180-2408-4228-8850-453a24b61bf0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:29.375860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d2a57180-2408-4228-8850-453a24b61bf0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:29.392191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a57180-2408-4228-8850-453a24b61bf0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:29.395128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a57180-2408-4228-8850-453a24b61bf0 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:29.408048 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4326/8650] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:34.046131 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e009a-d965-494d-9a34-969cbac6f9b2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.047056 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e009a-d965-494d-9a34-969cbac6f9b2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.047338 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73e009a-d965-494d-9a34-969cbac6f9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.067831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c73e009a-d965-494d-9a34-969cbac6f9b2 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:34.069022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c73e009a-d965-494d-9a34-969cbac6f9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:34.078805 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4325/8651] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:34.093818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a57180-2408-4228-8850-453a24b61bf0 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:34.106320 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a57180-2408-4228-8850-453a24b61bf0 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:34.112063 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a9417-ed4b-4ca6-9f4f-a2a4f09d32e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:34.116644 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a9417-ed4b-4ca6-9f4f-a2a4f09d32e4 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.116931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a9417-ed4b-4ca6-9f4f-a2a4f09d32e4 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.117209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404a9417-ed4b-4ca6-9f4f-a2a4f09d32e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.125858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e009a-d965-494d-9a34-969cbac6f9b2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:34.131537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a9417-ed4b-4ca6-9f4f-a2a4f09d32e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:34.133867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404a9417-ed4b-4ca6-9f4f-a2a4f09d32e4 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:34.145422 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4327/8652] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:34.164440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73e009a-d965-494d-9a34-969cbac6f9b2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:34.172468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:34.173109 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.173420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.173698 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] PATH_INFO: `/v3/users/7a77edfe753f40daaa8b0c00ccb18b47` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.174839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a77edfe753f40daaa8b0c00ccb18b47)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:34.176899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:34.224828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a77edfe753f40daaa8b0c00ccb18b47'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.238390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a77edfe753f40daaa8b0c00ccb18b47'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.239125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a77edfe753f40daaa8b0c00ccb18b47'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.247216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a77edfe753f40daaa8b0c00ccb18b47'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.255261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-457ab7bd-5d90-4e5e-9a1f-61173bc1423d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a77edfe753f40daaa8b0c00ccb18b47'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.262090 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4326/8653] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:55:34 2022] DELETE /identity/v3/users/7a77edfe753f40daaa8b0c00ccb18b47 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:55:34.436313 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a9417-ed4b-4ca6-9f4f-a2a4f09d32e4 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:34.450384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404a9417-ed4b-4ca6-9f4f-a2a4f09d32e4 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:34.507403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:34.508027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.508307 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.508583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] PATH_INFO: `/v3/projects/7fb13907ffea4abdbc6ce84f83038f44` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.509718 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fb13907ffea4abdbc6ce84f83038f44)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:34.511625 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:34.557448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fb13907ffea4abdbc6ce84f83038f44', 'request_id': 'req-d6e72816-0738-4f36-bdd6-ffd04af65fcc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.563433 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fb13907ffea4abdbc6ce84f83038f44', 'request_id': 'req-d6e72816-0738-4f36-bdd6-ffd04af65fcc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.570763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fb13907ffea4abdbc6ce84f83038f44', 'request_id': 'req-d6e72816-0738-4f36-bdd6-ffd04af65fcc'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.592984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] The token cache is being invalidate because project 7fb13907ffea4abdbc6ce84f83038f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:55:34.593271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.593925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d6e72816-0738-4f36-bdd6-ffd04af65fcc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:34.595615 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4328/8654] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:55:34 2022] DELETE /identity/v3/projects/7fb13907ffea4abdbc6ce84f83038f44 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:55:34.600665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a526f66-18c5-452f-b7c2-830cebfc4fec None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.600954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a526f66-18c5-452f-b7c2-830cebfc4fec None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.601236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a526f66-18c5-452f-b7c2-830cebfc4fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.620744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7a526f66-18c5-452f-b7c2-830cebfc4fec None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:34.621966 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7a526f66-18c5-452f-b7c2-830cebfc4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:34.679458 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4327/8655] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:34.687823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d84546-5f3b-4334-84fa-a220bd4cf34c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.688109 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d84546-5f3b-4334-84fa-a220bd4cf34c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.688384 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d84546-5f3b-4334-84fa-a220bd4cf34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.707960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d8d84546-5f3b-4334-84fa-a220bd4cf34c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:34.709148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d8d84546-5f3b-4334-84fa-a220bd4cf34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:34.716908 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4329/8656] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:34.721009 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a526f66-18c5-452f-b7c2-830cebfc4fec None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:34.731426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a526f66-18c5-452f-b7c2-830cebfc4fec None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:34.736091 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00560f94-6c66-4494-805e-be71690c99ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:34.736693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00560f94-6c66-4494-805e-be71690c99ab admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.736971 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00560f94-6c66-4494-805e-be71690c99ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.737242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00560f94-6c66-4494-805e-be71690c99ab admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.737925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00560f94-6c66-4494-805e-be71690c99ab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:55:34.738227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00560f94-6c66-4494-805e-be71690c99ab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:34.739818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00560f94-6c66-4494-805e-be71690c99ab admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:34.751222 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4328/8657] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:55:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:55:34.755534 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d84546-5f3b-4334-84fa-a220bd4cf34c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:34.765131 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d84546-5f3b-4334-84fa-a220bd4cf34c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:34.769764 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090f6f-2d0b-4b52-8bd4-8da240df2e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:34.770346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090f6f-2d0b-4b52-8bd4-8da240df2e6a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.770627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090f6f-2d0b-4b52-8bd4-8da240df2e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.770903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf090f6f-2d0b-4b52-8bd4-8da240df2e6a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.771536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf090f6f-2d0b-4b52-8bd4-8da240df2e6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:34.773539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf090f6f-2d0b-4b52-8bd4-8da240df2e6a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:34.802150 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4330/8658] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:55:34 2022] POST /identity/v3/projects => generated 369 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:55:34.806937 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00560f94-6c66-4494-805e-be71690c99ab admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:34.816891 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00560f94-6c66-4494-805e-be71690c99ab admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:34.848915 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:34.873883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194d13-1f59-4da2-a346-b353c4736ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:34.874475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194d13-1f59-4da2-a346-b353c4736ad3 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.874750 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194d13-1f59-4da2-a346-b353c4736ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.875017 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d194d13-1f59-4da2-a346-b353c4736ad3 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.875633 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194d13-1f59-4da2-a346-b353c4736ad3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:34.877564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d194d13-1f59-4da2-a346-b353c4736ad3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:34.897451 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4329/8659] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:55:34 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 09:55:34.901595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090f6f-2d0b-4b52-8bd4-8da240df2e6a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:34.912092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf090f6f-2d0b-4b52-8bd4-8da240df2e6a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:34.917224 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd31266-3afe-4b70-92d5-b26216dc1d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:34.917858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd31266-3afe-4b70-92d5-b26216dc1d1c admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.918136 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd31266-3afe-4b70-92d5-b26216dc1d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.918409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd31266-3afe-4b70-92d5-b26216dc1d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.919041 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd31266-3afe-4b70-92d5-b26216dc1d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:34.920656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd31266-3afe-4b70-92d5-b26216dc1d1c admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:34.931293 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4331/8660] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:55:34.935194 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194d13-1f59-4da2-a346-b353c4736ad3 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:34.945500 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d194d13-1f59-4da2-a346-b353c4736ad3 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:34.950570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51c0a23-c2cb-417e-8e63-a6d68e43fd8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:34.951250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0a23-c2cb-417e-8e63-a6d68e43fd8e admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.951559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0a23-c2cb-417e-8e63-a6d68e43fd8e admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.952033 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51c0a23-c2cb-417e-8e63-a6d68e43fd8e admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.952776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c0a23-c2cb-417e-8e63-a6d68e43fd8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:34.955211 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51c0a23-c2cb-417e-8e63-a6d68e43fd8e admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:34.965578 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4330/8661] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:55:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 09:55:34.969812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd31266-3afe-4b70-92d5-b26216dc1d1c admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:34.980413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd31266-3afe-4b70-92d5-b26216dc1d1c admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:34.984983 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd83ded-1750-44cc-9954-a15df3828426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:34.985684 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd83ded-1750-44cc-9954-a15df3828426 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:34.985967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd83ded-1750-44cc-9954-a15df3828426 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:34.986246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd83ded-1750-44cc-9954-a15df3828426 admin admin] PATH_INFO: `/v3/projects/6330a7f4a3c4465081215f3a6cd6bc03/users/bbf6f6cf1842466a9d8fcc8135016304/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:34.998121 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:35.002916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd83ded-1750-44cc-9954-a15df3828426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6330a7f4a3c4465081215f3a6cd6bc03, user_id=bbf6f6cf1842466a9d8fcc8135016304, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:35.006080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd83ded-1750-44cc-9954-a15df3828426 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:35.019591 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4332/8662] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:55:34 2022] PUT /identity/v3/projects/6330a7f4a3c4465081215f3a6cd6bc03/users/bbf6f6cf1842466a9d8fcc8135016304/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:55:35.029498 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b754-1dda-4092-917d-71b4979f5155 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:35.030185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b754-1dda-4092-917d-71b4979f5155 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:35.030460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193b754-1dda-4092-917d-71b4979f5155 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:35.058832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-4193b754-1dda-4092-917d-71b4979f5155 None None] MFA Rules not processed for user `bbf6f6cf1842466a9d8fcc8135016304`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:35.060201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4193b754-1dda-4092-917d-71b4979f5155 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:35.123152 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4331/8663] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:35 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:35.133372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd83ded-1750-44cc-9954-a15df3828426 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:35.135097 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0fd83ded-1750-44cc-9954-a15df3828426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:35.191448 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd83ded-1750-44cc-9954-a15df3828426 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:35.195594 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b5af18-1955-44a3-9da5-d2fd7248704a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:35.196180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5af18-1955-44a3-9da5-d2fd7248704a service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:35.196456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5af18-1955-44a3-9da5-d2fd7248704a service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:35.196726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b5af18-1955-44a3-9da5-d2fd7248704a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:35.205274 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5af18-1955-44a3-9da5-d2fd7248704a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:35.206743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b5af18-1955-44a3-9da5-d2fd7248704a service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:35.215642 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4333/8664] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:45.120301 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=49,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:45.211580 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:48.168597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b754-1dda-4092-917d-71b4979f5155 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:48.233475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193b754-1dda-4092-917d-71b4979f5155 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:48.238736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:48.239389 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:48.239675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:48.239980 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] PATH_INFO: `/v3/users/bbf6f6cf1842466a9d8fcc8135016304` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:48.241286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbf6f6cf1842466a9d8fcc8135016304)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:48.243325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:48.289326 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbf6f6cf1842466a9d8fcc8135016304'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.301162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbf6f6cf1842466a9d8fcc8135016304'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.301856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbf6f6cf1842466a9d8fcc8135016304'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.309356 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbf6f6cf1842466a9d8fcc8135016304'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.316306 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbf6f6cf1842466a9d8fcc8135016304'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.322932 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4332/8665] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:55:48 2022] DELETE /identity/v3/users/bbf6f6cf1842466a9d8fcc8135016304 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:55:48.327450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5bb0-971c-42b1-9f13-1de832a483fc None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:48.327923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5bb0-971c-42b1-9f13-1de832a483fc None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:48.328022 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c5bb0-971c-42b1-9f13-1de832a483fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:48.355475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-622c5bb0-971c-42b1-9f13-1de832a483fc None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:48.356665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-622c5bb0-971c-42b1-9f13-1de832a483fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:48.415062 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4334/8666] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:48.425246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:48.426708 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:48.485237 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6dd757-cbe8-4833-87cd-6dd4695e706d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:48.489001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7d156b-d96d-4326-b8c8-f4fa22be1915 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:48.489644 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d156b-d96d-4326-b8c8-f4fa22be1915 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:48.489950 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d156b-d96d-4326-b8c8-f4fa22be1915 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:48.490227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7d156b-d96d-4326-b8c8-f4fa22be1915 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:48.499469 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d156b-d96d-4326-b8c8-f4fa22be1915 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:48.500984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7d156b-d96d-4326-b8c8-f4fa22be1915 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:48.511151 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4333/8667] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:48.678938 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5bb0-971c-42b1-9f13-1de832a483fc None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:48.680480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-622c5bb0-971c-42b1-9f13-1de832a483fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:48.693564 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622c5bb0-971c-42b1-9f13-1de832a483fc None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:48.699364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:48.700114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:48.700457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:48.700804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] PATH_INFO: `/v3/projects/6330a7f4a3c4465081215f3a6cd6bc03` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:48.702046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] RBAC: Authorizing `identity:delete_project(project_id=6330a7f4a3c4465081215f3a6cd6bc03)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:48.704025 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:48.753174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6330a7f4a3c4465081215f3a6cd6bc03', 'request_id': 'req-5cc000fb-1771-434f-bb17-bec16601deca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.760180 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6330a7f4a3c4465081215f3a6cd6bc03', 'request_id': 'req-5cc000fb-1771-434f-bb17-bec16601deca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.768045 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6330a7f4a3c4465081215f3a6cd6bc03', 'request_id': 'req-5cc000fb-1771-434f-bb17-bec16601deca'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.779112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] The token cache is being invalidate because project 6330a7f4a3c4465081215f3a6cd6bc03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:55:48.779398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.780287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-5cc000fb-1771-434f-bb17-bec16601deca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:48.781840 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4335/8668] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:55:48 2022] DELETE /identity/v3/projects/6330a7f4a3c4465081215f3a6cd6bc03 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:55:48.787108 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199115f-a158-4527-a4cf-97f9320246b4 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:48.787489 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199115f-a158-4527-a4cf-97f9320246b4 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:48.787772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199115f-a158-4527-a4cf-97f9320246b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:48.822858 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:48.829169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9199115f-a158-4527-a4cf-97f9320246b4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:48.830840 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9199115f-a158-4527-a4cf-97f9320246b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:48.893399 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4334/8669] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:55:48.901106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46d3e8-9b6f-478a-8ab4-f813d3bd164a None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:48.901492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46d3e8-9b6f-478a-8ab4-f813d3bd164a None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:48.901845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb46d3e8-9b6f-478a-8ab4-f813d3bd164a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:48.923194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fb46d3e8-9b6f-478a-8ab4-f813d3bd164a None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:48.924401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fb46d3e8-9b6f-478a-8ab4-f813d3bd164a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:48.933443 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4336/8670] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:48.937654 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199115f-a158-4527-a4cf-97f9320246b4 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:48.947102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199115f-a158-4527-a4cf-97f9320246b4 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:48.951693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9a672-839b-499b-bff7-d134045c45d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:48.952277 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a672-839b-499b-bff7-d134045c45d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:48.952553 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a672-839b-499b-bff7-d134045c45d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:48.952823 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b9a672-839b-499b-bff7-d134045c45d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:48.953483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9a672-839b-499b-bff7-d134045c45d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:55:48.953781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9a672-839b-499b-bff7-d134045c45d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:48.955353 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b9a672-839b-499b-bff7-d134045c45d4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:48.967229 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4335/8671] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:55:48.971490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46d3e8-9b6f-478a-8ab4-f813d3bd164a None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:48.981402 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb46d3e8-9b6f-478a-8ab4-f813d3bd164a None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:48.986124 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ca6a3-fa3e-483f-afe2-2649bba7b2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:48.986715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca6a3-fa3e-483f-afe2-2649bba7b2ac admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:48.987094 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca6a3-fa3e-483f-afe2-2649bba7b2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:48.987372 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca6a3-fa3e-483f-afe2-2649bba7b2ac admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:48.988027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ca6a3-fa3e-483f-afe2-2649bba7b2ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:48.989969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ca6a3-fa3e-483f-afe2-2649bba7b2ac admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:49.026507 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4337/8672] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:55:48 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:55:49.030960 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9a672-839b-499b-bff7-d134045c45d4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:49.040805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b9a672-839b-499b-bff7-d134045c45d4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:49.096057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825ec6-6c1e-4047-a411-2b49b6ca6652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:49.096572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825ec6-6c1e-4047-a411-2b49b6ca6652 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:49.096847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825ec6-6c1e-4047-a411-2b49b6ca6652 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:49.097116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825ec6-6c1e-4047-a411-2b49b6ca6652 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:49.097767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825ec6-6c1e-4047-a411-2b49b6ca6652 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:49.099653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d825ec6-6c1e-4047-a411-2b49b6ca6652 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:49.120515 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4336/8673] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:55:49 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:55:49.124661 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ca6a3-fa3e-483f-afe2-2649bba7b2ac admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:49.137420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ca6a3-fa3e-483f-afe2-2649bba7b2ac admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:49.144697 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bf3ca-48b9-4ed5-9847-ead7fe8136d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:49.145339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bf3ca-48b9-4ed5-9847-ead7fe8136d1 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:49.145627 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bf3ca-48b9-4ed5-9847-ead7fe8136d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:49.145903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01bf3ca-48b9-4ed5-9847-ead7fe8136d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:49.146546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bf3ca-48b9-4ed5-9847-ead7fe8136d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:49.149916 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01bf3ca-48b9-4ed5-9847-ead7fe8136d1 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:49.160015 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4338/8674] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:55:49.164679 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825ec6-6c1e-4047-a411-2b49b6ca6652 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:49.174656 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825ec6-6c1e-4047-a411-2b49b6ca6652 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:49.179790 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae2af1e-e631-4784-a3e3-7c817a355c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:49.180380 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2af1e-e631-4784-a3e3-7c817a355c43 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:49.180653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2af1e-e631-4784-a3e3-7c817a355c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:49.180921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae2af1e-e631-4784-a3e3-7c817a355c43 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:49.181601 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2af1e-e631-4784-a3e3-7c817a355c43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:49.183185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae2af1e-e631-4784-a3e3-7c817a355c43 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:49.194508 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4337/8675] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:55:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:55:49.198783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bf3ca-48b9-4ed5-9847-ead7fe8136d1 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:49.212762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01bf3ca-48b9-4ed5-9847-ead7fe8136d1 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:49.217397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ee3ba-f391-4b9e-907c-34b8ec0d039f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:49.218047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ee3ba-f391-4b9e-907c-34b8ec0d039f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:49.218324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ee3ba-f391-4b9e-907c-34b8ec0d039f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:49.218596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92ee3ba-f391-4b9e-907c-34b8ec0d039f admin admin] PATH_INFO: `/v3/projects/ccdf35030598464cb37fac8b99be1c80/users/eac47bc2292341a8a59c43e7b7850882/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:49.235904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ee3ba-f391-4b9e-907c-34b8ec0d039f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdf35030598464cb37fac8b99be1c80, user_id=eac47bc2292341a8a59c43e7b7850882, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:49.238648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92ee3ba-f391-4b9e-907c-34b8ec0d039f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:49.253145 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4339/8676] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:55:49 2022] PUT /identity/v3/projects/ccdf35030598464cb37fac8b99be1c80/users/eac47bc2292341a8a59c43e7b7850882/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:55:49.263083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f510-9d2c-46a9-a8b9-8a1a7da429bb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:49.263354 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f510-9d2c-46a9-a8b9-8a1a7da429bb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:49.263632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2189f510-9d2c-46a9-a8b9-8a1a7da429bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:49.292090 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-2189f510-9d2c-46a9-a8b9-8a1a7da429bb None None] MFA Rules not processed for user `eac47bc2292341a8a59c43e7b7850882`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:49.293373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2189f510-9d2c-46a9-a8b9-8a1a7da429bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:49.368846 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4338/8677] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:49 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:49.378757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ee3ba-f391-4b9e-907c-34b8ec0d039f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:49.380458 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c92ee3ba-f391-4b9e-907c-34b8ec0d039f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:49.387199 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:49.438888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92ee3ba-f391-4b9e-907c-34b8ec0d039f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:49.442508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5353f91e-c28b-4f9b-b319-1decd55580c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:49.443105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353f91e-c28b-4f9b-b319-1decd55580c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:49.443385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353f91e-c28b-4f9b-b319-1decd55580c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:49.443681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5353f91e-c28b-4f9b-b319-1decd55580c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:49.451838 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353f91e-c28b-4f9b-b319-1decd55580c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:49.453265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5353f91e-c28b-4f9b-b319-1decd55580c4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:49.462491 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4340/8678] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:54.060924 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f510-9d2c-46a9-a8b9-8a1a7da429bb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:54.065206 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:54.123739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2189f510-9d2c-46a9-a8b9-8a1a7da429bb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:54.128482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:54.129162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.129415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.129693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] PATH_INFO: `/v3/users/eac47bc2292341a8a59c43e7b7850882` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.130897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eac47bc2292341a8a59c43e7b7850882)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:54.132936 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:54.180704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eac47bc2292341a8a59c43e7b7850882'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.192955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eac47bc2292341a8a59c43e7b7850882'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.193637 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eac47bc2292341a8a59c43e7b7850882'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.200990 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eac47bc2292341a8a59c43e7b7850882'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.207974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eac47bc2292341a8a59c43e7b7850882'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.215112 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4339/8679] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:55:54 2022] DELETE /identity/v3/users/eac47bc2292341a8a59c43e7b7850882 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:55:54.219761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f3741-e75d-40b1-8b19-706d1131fc9d None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.220247 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f3741-e75d-40b1-8b19-706d1131fc9d None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.220359 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f3741-e75d-40b1-8b19-706d1131fc9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.239514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-025f3741-e75d-40b1-8b19-706d1131fc9d None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:54.240725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-025f3741-e75d-40b1-8b19-706d1131fc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:54.297864 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4341/8680] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:54.307622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:54.308997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:54.364666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9986b0-8d6e-46ae-b246-f6546dff04c7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:54.368291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2655573-33fc-4375-9375-f4a3448418d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:54.368883 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2655573-33fc-4375-9375-f4a3448418d1 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.369160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2655573-33fc-4375-9375-f4a3448418d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.369471 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2655573-33fc-4375-9375-f4a3448418d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.378273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2655573-33fc-4375-9375-f4a3448418d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:54.379694 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2655573-33fc-4375-9375-f4a3448418d1 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:54.389623 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4340/8681] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:54.560601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f3741-e75d-40b1-8b19-706d1131fc9d None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:54.562033 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-025f3741-e75d-40b1-8b19-706d1131fc9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:54.577490 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f3741-e75d-40b1-8b19-706d1131fc9d None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:54.582192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:54.582825 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.583110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.583385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] PATH_INFO: `/v3/projects/ccdf35030598464cb37fac8b99be1c80` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.584509 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdf35030598464cb37fac8b99be1c80)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:54.586456 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:54.633888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdf35030598464cb37fac8b99be1c80', 'request_id': 'req-28f8ec24-377e-4c9b-a443-077ea85e64fb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.639888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdf35030598464cb37fac8b99be1c80', 'request_id': 'req-28f8ec24-377e-4c9b-a443-077ea85e64fb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.647531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdf35030598464cb37fac8b99be1c80', 'request_id': 'req-28f8ec24-377e-4c9b-a443-077ea85e64fb'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.657893 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] The token cache is being invalidate because project ccdf35030598464cb37fac8b99be1c80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:55:54.658183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.658813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-28f8ec24-377e-4c9b-a443-077ea85e64fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:55:54.660273 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4342/8682] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:55:54 2022] DELETE /identity/v3/projects/ccdf35030598464cb37fac8b99be1c80 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:55:54.665928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3154e-d0f6-4356-af85-0a6c0f501a84 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.666242 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3154e-d0f6-4356-af85-0a6c0f501a84 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.666520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3154e-d0f6-4356-af85-0a6c0f501a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.685547 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-60e3154e-d0f6-4356-af85-0a6c0f501a84 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:54.686731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60e3154e-d0f6-4356-af85-0a6c0f501a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:54.705098 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:54.747122 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4341/8683] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:54.755932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764747d-06e6-4259-af6f-6288be65daf7 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.756249 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764747d-06e6-4259-af6f-6288be65daf7 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.756529 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c764747d-06e6-4259-af6f-6288be65daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.776657 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-c764747d-06e6-4259-af6f-6288be65daf7 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:54.777900 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c764747d-06e6-4259-af6f-6288be65daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:54.786051 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4343/8684] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:54.790796 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3154e-d0f6-4356-af85-0a6c0f501a84 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:54.800482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3154e-d0f6-4356-af85-0a6c0f501a84 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:54.805173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6908d-61c3-48ec-a7b0-b212b836ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:54.805743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6908d-61c3-48ec-a7b0-b212b836ba1a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.806024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6908d-61c3-48ec-a7b0-b212b836ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.806299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6908d-61c3-48ec-a7b0-b212b836ba1a admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.806982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6908d-61c3-48ec-a7b0-b212b836ba1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:55:54.807287 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6908d-61c3-48ec-a7b0-b212b836ba1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:54.808877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6908d-61c3-48ec-a7b0-b212b836ba1a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:54.821113 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4342/8685] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:55:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:55:54.825452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764747d-06e6-4259-af6f-6288be65daf7 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:54.835416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c764747d-06e6-4259-af6f-6288be65daf7 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:54.840068 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bebaaf-2f93-4819-a994-8296d3ec3ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:54.840664 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bebaaf-2f93-4819-a994-8296d3ec3ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.840947 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bebaaf-2f93-4819-a994-8296d3ec3ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.841225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bebaaf-2f93-4819-a994-8296d3ec3ec8 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.841895 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bebaaf-2f93-4819-a994-8296d3ec3ec8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:54.843798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bebaaf-2f93-4819-a994-8296d3ec3ec8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:54.871611 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4344/8686] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:55:54 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:55:54.875718 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6908d-61c3-48ec-a7b0-b212b836ba1a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:54.885761 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6908d-61c3-48ec-a7b0-b212b836ba1a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:54.941184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de5bb3-8813-46e9-8834-d50b51c4eab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:54.941810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de5bb3-8813-46e9-8834-d50b51c4eab7 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.942095 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de5bb3-8813-46e9-8834-d50b51c4eab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.942371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43de5bb3-8813-46e9-8834-d50b51c4eab7 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.942989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de5bb3-8813-46e9-8834-d50b51c4eab7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:54.944956 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43de5bb3-8813-46e9-8834-d50b51c4eab7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:54.965848 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4343/8687] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:55:54 2022] POST /identity/v3/users => generated 295 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:55:54.970206 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bebaaf-2f93-4819-a994-8296d3ec3ec8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:54.976196 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:54.983058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bebaaf-2f93-4819-a994-8296d3ec3ec8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:54.988853 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6c45e-9738-4a34-affa-11bcf48a7f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:54.989557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6c45e-9738-4a34-affa-11bcf48a7f06 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:54.989836 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6c45e-9738-4a34-affa-11bcf48a7f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:54.990106 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6c45e-9738-4a34-affa-11bcf48a7f06 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:54.990734 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6c45e-9738-4a34-affa-11bcf48a7f06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:54.992314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6c45e-9738-4a34-affa-11bcf48a7f06 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:55.002244 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4345/8688] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:55:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:55:55.006921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de5bb3-8813-46e9-8834-d50b51c4eab7 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:55.016788 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43de5bb3-8813-46e9-8834-d50b51c4eab7 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:55.021732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8252e65-9976-423f-bb84-2d91dcc650c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:55.022905 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8252e65-9976-423f-bb84-2d91dcc650c2 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:55.023184 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8252e65-9976-423f-bb84-2d91dcc650c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:55.023477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8252e65-9976-423f-bb84-2d91dcc650c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:55.024113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8252e65-9976-423f-bb84-2d91dcc650c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:55.025743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8252e65-9976-423f-bb84-2d91dcc650c2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:55.036520 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4344/8689] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:55:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:55:55.040591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6c45e-9738-4a34-affa-11bcf48a7f06 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:55.050903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6c45e-9738-4a34-affa-11bcf48a7f06 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:55.055847 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2870d-7ff6-46c9-9f13-1c37867b59ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:55.056446 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2870d-7ff6-46c9-9f13-1c37867b59ab admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:55.056726 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2870d-7ff6-46c9-9f13-1c37867b59ab admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:55.057002 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de2870d-7ff6-46c9-9f13-1c37867b59ab admin admin] PATH_INFO: `/v3/projects/f0f1d38b43d74ef0b8b3e40b8260e9fd/users/ce547983f5274f288dfc88a36e234e19/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:55.072674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2870d-7ff6-46c9-9f13-1c37867b59ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f1d38b43d74ef0b8b3e40b8260e9fd, user_id=ce547983f5274f288dfc88a36e234e19, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:55.075342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de2870d-7ff6-46c9-9f13-1c37867b59ab admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:55.088117 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4346/8690] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:55:55 2022] PUT /identity/v3/projects/f0f1d38b43d74ef0b8b3e40b8260e9fd/users/ce547983f5274f288dfc88a36e234e19/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:55:55.093179 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee8dce-e426-4376-bf1a-a164fa30431f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:55.093713 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee8dce-e426-4376-bf1a-a164fa30431f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:55.093817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ee8dce-e426-4376-bf1a-a164fa30431f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:55.113589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-19ee8dce-e426-4376-bf1a-a164fa30431f None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:55.114778 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-19ee8dce-e426-4376-bf1a-a164fa30431f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:55.172549 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4345/8691] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 09:55:55.182290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2870d-7ff6-46c9-9f13-1c37867b59ab admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:55.183991 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8de2870d-7ff6-46c9-9f13-1c37867b59ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:55.242526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de2870d-7ff6-46c9-9f13-1c37867b59ab admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:55.246428 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edeee67-32bb-4dc2-85b2-482e71e2b238 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:55.247042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edeee67-32bb-4dc2-85b2-482e71e2b238 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:55.247327 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edeee67-32bb-4dc2-85b2-482e71e2b238 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:55.247604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edeee67-32bb-4dc2-85b2-482e71e2b238 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:55.257680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edeee67-32bb-4dc2-85b2-482e71e2b238 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:55.259117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edeee67-32bb-4dc2-85b2-482e71e2b238 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:55.269016 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4347/8692] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:55:59.271838 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a78b5-419a-4a7e-bf8c-9d263052a33f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:59.272299 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a78b5-419a-4a7e-bf8c-9d263052a33f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:59.272575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a78b5-419a-4a7e-bf8c-9d263052a33f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:59.305733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e81a78b5-419a-4a7e-bf8c-9d263052a33f None None] MFA Rules not processed for user `ce547983f5274f288dfc88a36e234e19`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:55:59.306961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e81a78b5-419a-4a7e-bf8c-9d263052a33f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:55:59.330812 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:55:59.388890 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4346/8693] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:55:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:55:59.393504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edeee67-32bb-4dc2-85b2-482e71e2b238 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:59.404225 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edeee67-32bb-4dc2-85b2-482e71e2b238 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:59.409088 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421020-df55-42a7-a44d-5f6c95451757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:59.409879 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421020-df55-42a7-a44d-5f6c95451757 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:59.410374 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421020-df55-42a7-a44d-5f6c95451757 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:59.410944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36421020-df55-42a7-a44d-5f6c95451757 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:59.411728 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36421020-df55-42a7-a44d-5f6c95451757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:59.414013 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36421020-df55-42a7-a44d-5f6c95451757 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:59.449695 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4348/8694] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:55:59 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:55:59.451407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a78b5-419a-4a7e-bf8c-9d263052a33f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:59.464069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a78b5-419a-4a7e-bf8c-9d263052a33f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:59.535284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166746f-ac48-41cc-9ce9-3a420163edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:59.535909 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166746f-ac48-41cc-9ce9-3a420163edf1 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:59.536198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166746f-ac48-41cc-9ce9-3a420163edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:59.536460 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4166746f-ac48-41cc-9ce9-3a420163edf1 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:59.537116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166746f-ac48-41cc-9ce9-3a420163edf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:59.540531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4166746f-ac48-41cc-9ce9-3a420163edf1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:59.564924 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4347/8695] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:55:59 2022] POST /identity/v3/users => generated 300 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:55:59.568775 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421020-df55-42a7-a44d-5f6c95451757 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:59.579955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36421020-df55-42a7-a44d-5f6c95451757 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:59.584608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f880a2-6465-4b96-a694-61b827cfc624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:59.585210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f880a2-6465-4b96-a694-61b827cfc624 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:59.585530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f880a2-6465-4b96-a694-61b827cfc624 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:59.585810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f880a2-6465-4b96-a694-61b827cfc624 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:59.586438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f880a2-6465-4b96-a694-61b827cfc624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:59.588047 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f880a2-6465-4b96-a694-61b827cfc624 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:59.599236 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4349/8696] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:55:59.604032 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166746f-ac48-41cc-9ce9-3a420163edf1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:59.616426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4166746f-ac48-41cc-9ce9-3a420163edf1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:59.622119 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb636-310a-421b-ab17-f78a3e184eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:59.622913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb636-310a-421b-ab17-f78a3e184eb9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:59.623652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb636-310a-421b-ab17-f78a3e184eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:59.623955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcbb636-310a-421b-ab17-f78a3e184eb9 admin admin] PATH_INFO: `/v3/projects/8669fb7c9100480db298f35f66267ec5/users/2ee6320877084e7f8affad7a173345d5/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:59.646482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbb636-310a-421b-ab17-f78a3e184eb9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8669fb7c9100480db298f35f66267ec5, user_id=2ee6320877084e7f8affad7a173345d5, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:59.650140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcbb636-310a-421b-ab17-f78a3e184eb9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:59.669688 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4348/8697] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:55:59 2022] PUT /identity/v3/projects/8669fb7c9100480db298f35f66267ec5/users/2ee6320877084e7f8affad7a173345d5/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:55:59.674210 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f880a2-6465-4b96-a694-61b827cfc624 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:59.687960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f880a2-6465-4b96-a694-61b827cfc624 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:59.746628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb8e9e0-6067-4007-9258-a4137f876114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:59.747174 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8e9e0-6067-4007-9258-a4137f876114 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:59.747464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8e9e0-6067-4007-9258-a4137f876114 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:59.747738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb8e9e0-6067-4007-9258-a4137f876114 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:59.748369 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8e9e0-6067-4007-9258-a4137f876114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:59.750008 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb8e9e0-6067-4007-9258-a4137f876114 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:59.759714 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4350/8698] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:55:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:55:59.763857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb636-310a-421b-ab17-f78a3e184eb9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:55:59.774174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcbb636-310a-421b-ab17-f78a3e184eb9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:55:59.778729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb14df-5ead-4cf5-815d-5bbb968da953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:55:59.779368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb14df-5ead-4cf5-815d-5bbb968da953 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:55:59.779646 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb14df-5ead-4cf5-815d-5bbb968da953 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:55:59.780163 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb14df-5ead-4cf5-815d-5bbb968da953 admin admin] PATH_INFO: `/v3/projects/8669fb7c9100480db298f35f66267ec5/users/2ee6320877084e7f8affad7a173345d5/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:55:59.782081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb14df-5ead-4cf5-815d-5bbb968da953 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8669fb7c9100480db298f35f66267ec5, user_id=2ee6320877084e7f8affad7a173345d5, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:55:59.784705 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb14df-5ead-4cf5-815d-5bbb968da953 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:55:59.795302 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4349/8699] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:55:59 2022] PUT /identity/v3/projects/8669fb7c9100480db298f35f66267ec5/users/2ee6320877084e7f8affad7a173345d5/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:56:03.893894 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fcaf3-2784-4817-97d0-eecdd9f63d50 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:56:03.895598 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fcaf3-2784-4817-97d0-eecdd9f63d50 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:56:03.896512 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fcaf3-2784-4817-97d0-eecdd9f63d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:56:03.958270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-781fcaf3-2784-4817-97d0-eecdd9f63d50 None None] MFA Rules not processed for user `2ee6320877084e7f8affad7a173345d5`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:56:03.960072 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-781fcaf3-2784-4817-97d0-eecdd9f63d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:56:04.001661 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:04.105904 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4351/8700] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:56:03 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:56:04.134606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb14df-5ead-4cf5-815d-5bbb968da953 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:56:04.138714 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-60eb14df-5ead-4cf5-815d-5bbb968da953 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:56:04.291609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb14df-5ead-4cf5-815d-5bbb968da953 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:56:04.299760 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a8da8-b925-47eb-8b71-1df1d6419f01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:56:04.300458 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a8da8-b925-47eb-8b71-1df1d6419f01 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:56:04.300811 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a8da8-b925-47eb-8b71-1df1d6419f01 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:56:04.301169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a8da8-b925-47eb-8b71-1df1d6419f01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:56:04.311476 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:04.380104 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a8da8-b925-47eb-8b71-1df1d6419f01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:56:04.382300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a8da8-b925-47eb-8b71-1df1d6419f01 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:56:04.409513 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4350/8701] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:56:04 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:56:04.486469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5bbdf-5f29-4e30-b87b-eaee92870dbf None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:56:04.486761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5bbdf-5f29-4e30-b87b-eaee92870dbf None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:56:04.487040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5bbdf-5f29-4e30-b87b-eaee92870dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:56:04.510121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-5ef5bbdf-5f29-4e30-b87b-eaee92870dbf None None] MFA Rules not processed for user `ce547983f5274f288dfc88a36e234e19`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:56:04.511387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5ef5bbdf-5f29-4e30-b87b-eaee92870dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:56:04.519548 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4352/8702] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:56:04 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:56:14.401721 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=23 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:14.503617 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=22 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:14.833235 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a5353-59d5-47f7-a849-e863772e81b9 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:56:14.833554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a5353-59d5-47f7-a849-e863772e81b9 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:56:14.833863 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a5353-59d5-47f7-a849-e863772e81b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:56:14.883178 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-130a5353-59d5-47f7-a849-e863772e81b9 None None] MFA Rules not processed for user `ed628f1d565e440792f530dd97512cf7`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:56:14.884370 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-130a5353-59d5-47f7-a849-e863772e81b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:56:14.943885 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4351/8703] 10.222.0.25 () {58 vars in 1060 bytes} [Mon Oct 24 09:56:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:56:14.950570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5bbdf-5f29-4e30-b87b-eaee92870dbf None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:56:14.960319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5bbdf-5f29-4e30-b87b-eaee92870dbf None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:56:14.964230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1433a-8660-4579-ab02-21e6ef974038 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ed628f1d565e440792f530dd97512cf7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:56:14.964818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1433a-8660-4579-ab02-21e6ef974038 service cinder] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:56:14.965092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1433a-8660-4579-ab02-21e6ef974038 service cinder] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:56:14.965397 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db1433a-8660-4579-ab02-21e6ef974038 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:56:14.975696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1433a-8660-4579-ab02-21e6ef974038 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:56:14.977717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db1433a-8660-4579-ab02-21e6ef974038 service cinder] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:56:14.989234 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4353/8704] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:56:14 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:56:24.940502 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=38 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:24.984763 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:40.182481 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d139f3-48ef-478c-a865-84fcee85f1a3 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:56:40.183019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d139f3-48ef-478c-a865-84fcee85f1a3 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:56:40.183019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d139f3-48ef-478c-a865-84fcee85f1a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:56:40.204755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-35d139f3-48ef-478c-a865-84fcee85f1a3 None None] MFA Rules not processed for user `ce547983f5274f288dfc88a36e234e19`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:56:40.205482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-35d139f3-48ef-478c-a865-84fcee85f1a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:56:40.213990 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4352/8705] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:56:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:56:50.197175 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:56:59.534669 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1433a-8660-4579-ab02-21e6ef974038 service cinder] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:56:59.536634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1db1433a-8660-4579-ab02-21e6ef974038 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:56:59.606597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db1433a-8660-4579-ab02-21e6ef974038 service cinder] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:56:59.611662 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:56:59.612258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:56:59.612541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:56:59.612817 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:56:59.614581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:56:59.625626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:56:59.627201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:56:59.636936 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4354/8706] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:56:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:57:09.632961 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=32 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:14.422571 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ecf6d-b502-4d8c-a678-82ca451e93aa None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:14.423087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ecf6d-b502-4d8c-a678-82ca451e93aa None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:14.423087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168ecf6d-b502-4d8c-a678-82ca451e93aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:14.442925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-168ecf6d-b502-4d8c-a678-82ca451e93aa None None] MFA Rules not processed for user `ce547983f5274f288dfc88a36e234e19`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:57:14.444734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-168ecf6d-b502-4d8c-a678-82ca451e93aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:57:14.451993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4353/8707] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:57:14 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:57:24.436790 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:47.278920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:47.280882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:57:47.293863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ec983e-1270-4ee8-90f8-ebcbf3bb2e29 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:47.299219 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7772b7c-9ec5-49c8-81ae-1bb248863b28 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:47.299810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772b7c-9ec5-49c8-81ae-1bb248863b28 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:47.300089 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772b7c-9ec5-49c8-81ae-1bb248863b28 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:47.300364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7772b7c-9ec5-49c8-81ae-1bb248863b28 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:47.302053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-b7772b7c-9ec5-49c8-81ae-1bb248863b28 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:57:47.313859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7772b7c-9ec5-49c8-81ae-1bb248863b28 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:47.315398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7772b7c-9ec5-49c8-81ae-1bb248863b28 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:47.325523 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4355/8708] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:57:47 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:57:55.015174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ecf6d-b502-4d8c-a678-82ca451e93aa None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:55.100663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168ecf6d-b502-4d8c-a678-82ca451e93aa None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:55.105190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:55.105849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:55.106129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:55.106404 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] PATH_INFO: `/v3/users/ce547983f5274f288dfc88a36e234e19` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:55.107520 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce547983f5274f288dfc88a36e234e19)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:55.109582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:55.159844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce547983f5274f288dfc88a36e234e19'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.173588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce547983f5274f288dfc88a36e234e19'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.174319 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce547983f5274f288dfc88a36e234e19'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.181841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce547983f5274f288dfc88a36e234e19'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.188711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce547983f5274f288dfc88a36e234e19'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.194575 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4354/8709] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:57:55 2022] DELETE /identity/v3/users/ce547983f5274f288dfc88a36e234e19 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:57:55.369202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7772b7c-9ec5-49c8-81ae-1bb248863b28 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:55.381767 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7772b7c-9ec5-49c8-81ae-1bb248863b28 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:55.442912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:55.443541 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:55.443818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:55.444093 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] PATH_INFO: `/v3/projects/f0f1d38b43d74ef0b8b3e40b8260e9fd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:55.445220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f1d38b43d74ef0b8b3e40b8260e9fd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:55.447171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:55.493171 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'request_id': 'req-7b465eb4-253f-40e1-8b48-cf7f2083e408'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.499172 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'request_id': 'req-7b465eb4-253f-40e1-8b48-cf7f2083e408'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.506958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f1d38b43d74ef0b8b3e40b8260e9fd', 'request_id': 'req-7b465eb4-253f-40e1-8b48-cf7f2083e408'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.517323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] The token cache is being invalidate because project f0f1d38b43d74ef0b8b3e40b8260e9fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:57:55.517643 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.518269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.520356 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4356/8710] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:57:55 2022] DELETE /identity/v3/projects/f0f1d38b43d74ef0b8b3e40b8260e9fd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:57:55.524398 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:55.525822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:57:55.539086 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c295440-5ed0-4afd-9558-6d8e5e8db8b4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:55.594802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:55.595426 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:55.595735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:55.596030 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] PATH_INFO: `/v3/users/2ee6320877084e7f8affad7a173345d5` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:55.597180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ee6320877084e7f8affad7a173345d5)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:55.599123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:55.619998 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:55.646717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ee6320877084e7f8affad7a173345d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.659048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ee6320877084e7f8affad7a173345d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.659731 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ee6320877084e7f8affad7a173345d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.666684 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ee6320877084e7f8affad7a173345d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.673624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-a52b9bc7-b06b-4229-8e7f-f85d2fed497f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ee6320877084e7f8affad7a173345d5'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.679687 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4355/8711] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 09:57:55 2022] DELETE /identity/v3/users/2ee6320877084e7f8affad7a173345d5 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:57:55.848227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:55.849691 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:57:55.863514 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b465eb4-253f-40e1-8b48-cf7f2083e408 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:55.920622 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:55.921242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:55.921557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:55.921827 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] PATH_INFO: `/v3/projects/8669fb7c9100480db298f35f66267ec5` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:55.922921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8669fb7c9100480db298f35f66267ec5)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:55.924805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:55.946072 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:55.972346 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8669fb7c9100480db298f35f66267ec5', 'request_id': 'req-d21fad49-fe27-4421-9370-a63c46a8879a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.978459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8669fb7c9100480db298f35f66267ec5', 'request_id': 'req-d21fad49-fe27-4421-9370-a63c46a8879a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.985366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8669fb7c9100480db298f35f66267ec5', 'request_id': 'req-d21fad49-fe27-4421-9370-a63c46a8879a'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.996530 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] The token cache is being invalidate because project 8669fb7c9100480db298f35f66267ec5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 09:57:55.996823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.997494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d21fad49-fe27-4421-9370-a63c46a8879a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 09:57:55.998971 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4357/8712] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 09:57:55 2022] DELETE /identity/v3/projects/8669fb7c9100480db298f35f66267ec5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:57:56.004593 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1e5cb-4c2c-47a2-838b-4ddf1fac1db2 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.004870 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1e5cb-4c2c-47a2-838b-4ddf1fac1db2 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.005144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1e5cb-4c2c-47a2-838b-4ddf1fac1db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.024305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-56b1e5cb-4c2c-47a2-838b-4ddf1fac1db2 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:57:56.025517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-56b1e5cb-4c2c-47a2-838b-4ddf1fac1db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:57:56.085161 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4356/8713] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:57:56.093912 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d52d1-8fd3-42a3-93a0-9b3963223eb8 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.094199 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d52d1-8fd3-42a3-93a0-9b3963223eb8 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.094475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608d52d1-8fd3-42a3-93a0-9b3963223eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.114583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-608d52d1-8fd3-42a3-93a0-9b3963223eb8 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:57:56.115774 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-608d52d1-8fd3-42a3-93a0-9b3963223eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:57:56.123704 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4358/8714] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:57:56.127818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1e5cb-4c2c-47a2-838b-4ddf1fac1db2 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:56.138073 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1e5cb-4c2c-47a2-838b-4ddf1fac1db2 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:56.142828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7152f-09d6-4c54-97fc-0a935d9240b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:56.143452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7152f-09d6-4c54-97fc-0a935d9240b1 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.143732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7152f-09d6-4c54-97fc-0a935d9240b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.144002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7152f-09d6-4c54-97fc-0a935d9240b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.144641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7152f-09d6-4c54-97fc-0a935d9240b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 09:57:56.144942 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7152f-09d6-4c54-97fc-0a935d9240b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:56.146575 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7152f-09d6-4c54-97fc-0a935d9240b1 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:56.158446 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4357/8715] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 09:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 09:57:56.163277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d52d1-8fd3-42a3-93a0-9b3963223eb8 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:56.172653 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608d52d1-8fd3-42a3-93a0-9b3963223eb8 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:56.177948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c8167-407e-4a7c-b873-b45fcbce673a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:56.178540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c8167-407e-4a7c-b873-b45fcbce673a admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.178823 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c8167-407e-4a7c-b873-b45fcbce673a admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.179099 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c8167-407e-4a7c-b873-b45fcbce673a admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.179725 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c8167-407e-4a7c-b873-b45fcbce673a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:56.181654 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c8167-407e-4a7c-b873-b45fcbce673a admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:56.208294 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4359/8716] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:57:56 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:57:56.212349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7152f-09d6-4c54-97fc-0a935d9240b1 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:56.222800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7152f-09d6-4c54-97fc-0a935d9240b1 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:56.277758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7534c7-8179-4b50-91d5-e29f8bc92cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:56.278344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7534c7-8179-4b50-91d5-e29f8bc92cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.278623 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7534c7-8179-4b50-91d5-e29f8bc92cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.278897 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7534c7-8179-4b50-91d5-e29f8bc92cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.279509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7534c7-8179-4b50-91d5-e29f8bc92cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:56.281726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7534c7-8179-4b50-91d5-e29f8bc92cf5 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:56.302352 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4358/8717] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:57:56 2022] POST /identity/v3/users => generated 293 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:57:56.306474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c8167-407e-4a7c-b873-b45fcbce673a admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:56.317480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c8167-407e-4a7c-b873-b45fcbce673a admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:56.321969 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24f5d9-2428-4056-959e-d9cad5abf465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:56.322582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24f5d9-2428-4056-959e-d9cad5abf465 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.322861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24f5d9-2428-4056-959e-d9cad5abf465 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.323134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a24f5d9-2428-4056-959e-d9cad5abf465 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.323763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24f5d9-2428-4056-959e-d9cad5abf465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:56.325385 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a24f5d9-2428-4056-959e-d9cad5abf465 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:56.335654 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4360/8718] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:57:56.339375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7534c7-8179-4b50-91d5-e29f8bc92cf5 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:56.349741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7534c7-8179-4b50-91d5-e29f8bc92cf5 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:56.354310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ce2d17-014a-48be-9170-29ef389ff2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:56.354890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce2d17-014a-48be-9170-29ef389ff2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.355168 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce2d17-014a-48be-9170-29ef389ff2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.355440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ce2d17-014a-48be-9170-29ef389ff2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.356069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce2d17-014a-48be-9170-29ef389ff2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:56.357675 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ce2d17-014a-48be-9170-29ef389ff2f7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:56.367985 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4359/8719] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:57:56 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:57:56.371964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24f5d9-2428-4056-959e-d9cad5abf465 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:56.382423 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a24f5d9-2428-4056-959e-d9cad5abf465 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:56.387077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46432829-cc33-4766-bb65-6f86fcb8216e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:56.387716 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46432829-cc33-4766-bb65-6f86fcb8216e admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.387995 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46432829-cc33-4766-bb65-6f86fcb8216e admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.388270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46432829-cc33-4766-bb65-6f86fcb8216e admin admin] PATH_INFO: `/v3/projects/3cf4715cd28d40d08c2527be9671e8ca/users/b99b86166ef34409910f6102dc49589e/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.403059 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46432829-cc33-4766-bb65-6f86fcb8216e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cf4715cd28d40d08c2527be9671e8ca, user_id=b99b86166ef34409910f6102dc49589e, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:56.406011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46432829-cc33-4766-bb65-6f86fcb8216e admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:56.418687 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4361/8720] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:57:56 2022] PUT /identity/v3/projects/3cf4715cd28d40d08c2527be9671e8ca/users/b99b86166ef34409910f6102dc49589e/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:57:56.423641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6d305-818c-4394-893f-ebc664066d69 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.423932 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6d305-818c-4394-893f-ebc664066d69 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.424228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e6d305-818c-4394-893f-ebc664066d69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.432318 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:57:56.444231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-c4e6d305-818c-4394-893f-ebc664066d69 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:57:56.445886 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c4e6d305-818c-4394-893f-ebc664066d69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:57:56.502091 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4360/8721] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:57:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:57:56.512142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46432829-cc33-4766-bb65-6f86fcb8216e admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:57:56.513986 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-46432829-cc33-4766-bb65-6f86fcb8216e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:57:56.571560 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46432829-cc33-4766-bb65-6f86fcb8216e admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:57:56.575187 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b246e-3984-4bf1-aea6-580c3d892124 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:57:56.575783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b246e-3984-4bf1-aea6-580c3d892124 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:57:56.576064 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b246e-3984-4bf1-aea6-580c3d892124 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:57:56.576339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b246e-3984-4bf1-aea6-580c3d892124 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:57:56.585743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b246e-3984-4bf1-aea6-580c3d892124 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:57:56.587162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b246e-3984-4bf1-aea6-580c3d892124 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:57:56.596459 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4362/8722] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:58:00.537420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424cb48-e9ac-457e-ad9d-19ec1f4c6a20 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:00.537955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424cb48-e9ac-457e-ad9d-19ec1f4c6a20 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:00.537955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424cb48-e9ac-457e-ad9d-19ec1f4c6a20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:00.569858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-d424cb48-e9ac-457e-ad9d-19ec1f4c6a20 None None] MFA Rules not processed for user `b99b86166ef34409910f6102dc49589e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:58:00.571064 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d424cb48-e9ac-457e-ad9d-19ec1f4c6a20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:00.640601 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4361/8723] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:58:00 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:58:00.645347 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b246e-3984-4bf1-aea6-580c3d892124 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:00.655537 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b246e-3984-4bf1-aea6-580c3d892124 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:00.661288 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1006a5-865d-4914-8e3a-93595c0dc265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:00.661930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1006a5-865d-4914-8e3a-93595c0dc265 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:00.662209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1006a5-865d-4914-8e3a-93595c0dc265 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:00.662484 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1006a5-865d-4914-8e3a-93595c0dc265 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:00.663125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1006a5-865d-4914-8e3a-93595c0dc265 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:00.665102 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1006a5-865d-4914-8e3a-93595c0dc265 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:00.699497 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424cb48-e9ac-457e-ad9d-19ec1f4c6a20 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:00.700378 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4363/8724] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 09:58:00 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:58:00.710821 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424cb48-e9ac-457e-ad9d-19ec1f4c6a20 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:00.770190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954426-24e8-4238-908d-bc417e0221e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:00.770986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954426-24e8-4238-908d-bc417e0221e8 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:00.771098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954426-24e8-4238-908d-bc417e0221e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:00.771317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56954426-24e8-4238-908d-bc417e0221e8 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:00.771943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56954426-24e8-4238-908d-bc417e0221e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:00.773887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56954426-24e8-4238-908d-bc417e0221e8 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:00.797571 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4362/8725] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 09:58:00 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 09:58:00.801852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1006a5-865d-4914-8e3a-93595c0dc265 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:00.812925 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1006a5-865d-4914-8e3a-93595c0dc265 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:00.818810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597f5b-f2c7-4ca5-ab4e-6373d265fe90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:00.819592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597f5b-f2c7-4ca5-ab4e-6373d265fe90 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:00.819888 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597f5b-f2c7-4ca5-ab4e-6373d265fe90 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:00.820161 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53597f5b-f2c7-4ca5-ab4e-6373d265fe90 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:00.820808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53597f5b-f2c7-4ca5-ab4e-6373d265fe90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:00.822457 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53597f5b-f2c7-4ca5-ab4e-6373d265fe90 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:00.834148 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4364/8726] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:58:00.838312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954426-24e8-4238-908d-bc417e0221e8 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:00.849523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56954426-24e8-4238-908d-bc417e0221e8 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:00.854635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428024bd-cdb0-41b5-8240-766f4ce41a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:00.855375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428024bd-cdb0-41b5-8240-766f4ce41a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:00.855752 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428024bd-cdb0-41b5-8240-766f4ce41a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:00.856084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428024bd-cdb0-41b5-8240-766f4ce41a77 admin admin] PATH_INFO: `/v3/projects/1e06da362a1f4e0093432e5b68882ecd/users/3852f7231ed348e885cfbbda6a0482fc/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:00.872981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428024bd-cdb0-41b5-8240-766f4ce41a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e06da362a1f4e0093432e5b68882ecd, user_id=3852f7231ed348e885cfbbda6a0482fc, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:00.875722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428024bd-cdb0-41b5-8240-766f4ce41a77 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:00.886143 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:00.891993 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4363/8727] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:58:00 2022] PUT /identity/v3/projects/1e06da362a1f4e0093432e5b68882ecd/users/3852f7231ed348e885cfbbda6a0482fc/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 09:58:00.896707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597f5b-f2c7-4ca5-ab4e-6373d265fe90 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:00.907650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53597f5b-f2c7-4ca5-ab4e-6373d265fe90 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:00.917779 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:00.971058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b11b78-7e89-4230-b5be-f4d6be68d0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:00.971660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11b78-7e89-4230-b5be-f4d6be68d0ca admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:00.971958 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11b78-7e89-4230-b5be-f4d6be68d0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:00.972240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b11b78-7e89-4230-b5be-f4d6be68d0ca admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:00.972858 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b11b78-7e89-4230-b5be-f4d6be68d0ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:00.974469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b11b78-7e89-4230-b5be-f4d6be68d0ca admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:00.984902 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4365/8728] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 09:58:00 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 09:58:00.989132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428024bd-cdb0-41b5-8240-766f4ce41a77 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:00.999624 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428024bd-cdb0-41b5-8240-766f4ce41a77 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:01.004665 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6c6a3-b3e5-4e3d-a20e-afb26ce1cea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:01.005315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6c6a3-b3e5-4e3d-a20e-afb26ce1cea2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:01.005606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6c6a3-b3e5-4e3d-a20e-afb26ce1cea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:01.005880 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a6c6a3-b3e5-4e3d-a20e-afb26ce1cea2 admin admin] PATH_INFO: `/v3/projects/1e06da362a1f4e0093432e5b68882ecd/users/3852f7231ed348e885cfbbda6a0482fc/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:01.007782 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6c6a3-b3e5-4e3d-a20e-afb26ce1cea2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e06da362a1f4e0093432e5b68882ecd, user_id=3852f7231ed348e885cfbbda6a0482fc, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:01.010463 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a6c6a3-b3e5-4e3d-a20e-afb26ce1cea2 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:01.021028 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4364/8729] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 09:58:00 2022] PUT /identity/v3/projects/1e06da362a1f4e0093432e5b68882ecd/users/3852f7231ed348e885cfbbda6a0482fc/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 09:58:05.571246 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a7094-06d7-46e2-901f-34601d2af824 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:05.571761 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a7094-06d7-46e2-901f-34601d2af824 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:05.571852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a7094-06d7-46e2-901f-34601d2af824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:05.609640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-f21a7094-06d7-46e2-901f-34601d2af824 None None] MFA Rules not processed for user `3852f7231ed348e885cfbbda6a0482fc`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:58:05.610956 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-f21a7094-06d7-46e2-901f-34601d2af824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:05.695752 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4366/8730] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:58:05 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:58:05.724695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6c6a3-b3e5-4e3d-a20e-afb26ce1cea2 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:05.727187 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-30a6c6a3-b3e5-4e3d-a20e-afb26ce1cea2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:05.794477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a6c6a3-b3e5-4e3d-a20e-afb26ce1cea2 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:05.798619 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7cdd0-0c70-4aab-a9a1-37a07200a02e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:05.799246 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7cdd0-0c70-4aab-a9a1-37a07200a02e service glance] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:05.799528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7cdd0-0c70-4aab-a9a1-37a07200a02e service glance] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:05.799837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7cdd0-0c70-4aab-a9a1-37a07200a02e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:05.863812 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7cdd0-0c70-4aab-a9a1-37a07200a02e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:05.865031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7cdd0-0c70-4aab-a9a1-37a07200a02e service glance] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:05.875605 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4365/8731] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:58:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:58:06.047513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791222d-5095-4715-aaca-1025a4e25a51 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:06.047808 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791222d-5095-4715-aaca-1025a4e25a51 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:06.048090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791222d-5095-4715-aaca-1025a4e25a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:06.131593 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-0791222d-5095-4715-aaca-1025a4e25a51 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:58:06.132820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0791222d-5095-4715-aaca-1025a4e25a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:06.203751 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=100 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:06.210134 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4367/8732] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:58:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:58:06.254881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c995-d22b-45de-b3a1-031dd71560d8 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:06.255170 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c995-d22b-45de-b3a1-031dd71560d8 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:06.255445 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7874c995-d22b-45de-b3a1-031dd71560d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:06.304726 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-7874c995-d22b-45de-b3a1-031dd71560d8 None None] MFA Rules not processed for user `fc41482005be496f822a3118839674c9`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:58:06.305865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-7874c995-d22b-45de-b3a1-031dd71560d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:06.376095 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4366/8733] 10.222.0.25 () {58 vars in 1040 bytes} [Mon Oct 24 09:58:06 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:58:06.383009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791222d-5095-4715-aaca-1025a4e25a51 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:06.394846 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791222d-5095-4715-aaca-1025a4e25a51 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:06.399731 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8026-eddb-4a2d-8311-be629f62b6b7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:06.400317 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8026-eddb-4a2d-8311-be629f62b6b7 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:06.400596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8026-eddb-4a2d-8311-be629f62b6b7 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:06.400870 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e8026-eddb-4a2d-8311-be629f62b6b7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:06.408949 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e8026-eddb-4a2d-8311-be629f62b6b7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:06.410572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084e8026-eddb-4a2d-8311-be629f62b6b7 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:06.418390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4368/8734] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:58:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:58:15.565248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1713126-ca7e-4037-9314-2e8576108310 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:15.566273 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1713126-ca7e-4037-9314-2e8576108310 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:15.566375 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1713126-ca7e-4037-9314-2e8576108310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:15.574529 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:15.586440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e1713126-ca7e-4037-9314-2e8576108310 None None] MFA Rules not processed for user `b99b86166ef34409910f6102dc49589e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:58:15.587648 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e1713126-ca7e-4037-9314-2e8576108310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:15.594472 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4367/8735] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 09:58:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:58:15.850499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8026-eddb-4a2d-8311-be629f62b6b7 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:15.904051 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e8026-eddb-4a2d-8311-be629f62b6b7 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:15.907931 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ca067-2d93-4b3c-9016-2092283de834 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:15.908524 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ca067-2d93-4b3c-9016-2092283de834 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:15.908803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ca067-2d93-4b3c-9016-2092283de834 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:15.909607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ca067-2d93-4b3c-9016-2092283de834 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:15.911302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8b1ca067-2d93-4b3c-9016-2092283de834 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:15.920574 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ca067-2d93-4b3c-9016-2092283de834 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:15.922044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ca067-2d93-4b3c-9016-2092283de834 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:15.930409 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4369/8736] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:58:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:58:16.249214 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1713126-ca7e-4037-9314-2e8576108310 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:16.250740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e1713126-ca7e-4037-9314-2e8576108310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:16.321441 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1713126-ca7e-4037-9314-2e8576108310 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:16.326305 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a83468-a790-4bd8-bb39-2c1f3e63bd9c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:16.326901 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a83468-a790-4bd8-bb39-2c1f3e63bd9c service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:16.327180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a83468-a790-4bd8-bb39-2c1f3e63bd9c service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:16.327479 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a83468-a790-4bd8-bb39-2c1f3e63bd9c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:16.329156 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d9a83468-a790-4bd8-bb39-2c1f3e63bd9c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:16.340484 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a83468-a790-4bd8-bb39-2c1f3e63bd9c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:16.342083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a83468-a790-4bd8-bb39-2c1f3e63bd9c service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:16.352140 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4368/8737] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:58:16 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:58:17.637409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c225a4-5b0a-444c-a074-7971b761460e None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:17.637873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c225a4-5b0a-444c-a074-7971b761460e None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:17.637967 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c225a4-5b0a-444c-a074-7971b761460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:17.657197 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-13c225a4-5b0a-444c-a074-7971b761460e None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 09:58:17.658437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-13c225a4-5b0a-444c-a074-7971b761460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:17.665666 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4370/8738] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 09:58:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 09:58:17.678286 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a83468-a790-4bd8-bb39-2c1f3e63bd9c service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:17.690142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a83468-a790-4bd8-bb39-2c1f3e63bd9c service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:17.696310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d332-0ed1-4d36-9bea-e8a47c385e7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:17.696913 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d332-0ed1-4d36-9bea-e8a47c385e7b service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:17.697199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d332-0ed1-4d36-9bea-e8a47c385e7b service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:17.697512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4961d332-0ed1-4d36-9bea-e8a47c385e7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:17.706176 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961d332-0ed1-4d36-9bea-e8a47c385e7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:17.707771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4961d332-0ed1-4d36-9bea-e8a47c385e7b service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:17.716363 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4369/8739] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 09:58:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 09:58:27.651393 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=36 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:27.712843 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=39 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:58:48.325409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c225a4-5b0a-444c-a074-7971b761460e None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:58:48.326792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-13c225a4-5b0a-444c-a074-7971b761460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:58:48.339032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c225a4-5b0a-444c-a074-7971b761460e None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:58:48.342546 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbe466-2175-4981-9ac3-440a8fd0f854 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:58:48.343128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbe466-2175-4981-9ac3-440a8fd0f854 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:58:48.343403 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbe466-2175-4981-9ac3-440a8fd0f854 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:58:48.343675 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dbe466-2175-4981-9ac3-440a8fd0f854 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:58:48.352835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbe466-2175-4981-9ac3-440a8fd0f854 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:58:48.354293 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09dbe466-2175-4981-9ac3-440a8fd0f854 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:58:48.364131 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4371/8740] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:58:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 09:58:58.359398 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 09:59:57.446402 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d332-0ed1-4d36-9bea-e8a47c385e7b service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 09:59:57.455455 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4961d332-0ed1-4d36-9bea-e8a47c385e7b service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 09:59:57.459112 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d6763-e464-4d8c-a98b-f163f0ebd28d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 09:59:57.459695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d6763-e464-4d8c-a98b-f163f0ebd28d service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 09:59:57.459975 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d6763-e464-4d8c-a98b-f163f0ebd28d service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 09:59:57.460250 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210d6763-e464-4d8c-a98b-f163f0ebd28d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 09:59:57.461973 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-210d6763-e464-4d8c-a98b-f163f0ebd28d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 09:59:57.471123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d6763-e464-4d8c-a98b-f163f0ebd28d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 09:59:57.472544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210d6763-e464-4d8c-a98b-f163f0ebd28d service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 09:59:57.480332 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4370/8741] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 09:59:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:00:07.476954 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:00:30.016264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbe466-2175-4981-9ac3-440a8fd0f854 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:00:30.024721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dbe466-2175-4981-9ac3-440a8fd0f854 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:00:30.028315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:00:30.028904 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:00:30.029181 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:00:30.029486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:00:30.032044 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:00:30.111813 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:00:30.113628 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:00:30.124033 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4372/8742] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:00:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:00:31.324216 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d6763-e464-4d8c-a98b-f163f0ebd28d service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:00:31.332759 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210d6763-e464-4d8c-a98b-f163f0ebd28d service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:00:31.336475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d8b584-d7b6-4019-8120-0f54817211c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:00:31.337069 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8b584-d7b6-4019-8120-0f54817211c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:00:31.337374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8b584-d7b6-4019-8120-0f54817211c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:00:31.337651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d8b584-d7b6-4019-8120-0f54817211c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:00:31.339387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-88d8b584-d7b6-4019-8120-0f54817211c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:00:31.353264 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8b584-d7b6-4019-8120-0f54817211c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:00:31.354717 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d8b584-d7b6-4019-8120-0f54817211c7 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:00:31.366073 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4371/8743] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:00:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:00:40.119293 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=34 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:00:41.361238 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:01:42.824506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:01:42.826251 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:01:42.861154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef114440-a7fc-4e18-8f5c-039d63295880 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:01:42.868610 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05781c-59b7-4dbc-b7d5-4af7c53b881f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:01:42.869281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05781c-59b7-4dbc-b7d5-4af7c53b881f service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:01:42.869810 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05781c-59b7-4dbc-b7d5-4af7c53b881f service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:01:42.870203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a05781c-59b7-4dbc-b7d5-4af7c53b881f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:01:42.872709 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a05781c-59b7-4dbc-b7d5-4af7c53b881f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:01:42.889528 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05781c-59b7-4dbc-b7d5-4af7c53b881f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:01:42.891404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a05781c-59b7-4dbc-b7d5-4af7c53b881f service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:01:42.905263 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4373/8744] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:01:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:01:52.899416 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:01:56.748892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3ffed-ad0c-49b7-8311-fc074a11d24e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:01:56.749392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3ffed-ad0c-49b7-8311-fc074a11d24e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:01:56.749531 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d3ffed-ad0c-49b7-8311-fc074a11d24e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:01:56.769431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-e8d3ffed-ad0c-49b7-8311-fc074a11d24e None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:01:56.770617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e8d3ffed-ad0c-49b7-8311-fc074a11d24e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:01:56.798221 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4372/8745] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 10:01:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:01:56.837444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05781c-59b7-4dbc-b7d5-4af7c53b881f service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:01:56.879203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a05781c-59b7-4dbc-b7d5-4af7c53b881f service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:01:56.884277 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa27f1-153a-458d-831f-a9d3bf511022 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:01:56.884869 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa27f1-153a-458d-831f-a9d3bf511022 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:01:56.885152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa27f1-153a-458d-831f-a9d3bf511022 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:01:56.885466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fa27f1-153a-458d-831f-a9d3bf511022 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:01:56.893576 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa27f1-153a-458d-831f-a9d3bf511022 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:01:56.895203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fa27f1-153a-458d-831f-a9d3bf511022 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:01:56.903212 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4374/8746] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:01:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:01:57.391272 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8e8e-c003-42cb-9245-fa7bc4d76c59 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:01:57.391559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8e8e-c003-42cb-9245-fa7bc4d76c59 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:01:57.391831 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5b8e8e-c003-42cb-9245-fa7bc4d76c59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:01:57.412130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-9a5b8e8e-c003-42cb-9245-fa7bc4d76c59 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:01:57.413368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9a5b8e8e-c003-42cb-9245-fa7bc4d76c59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:01:57.421906 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4373/8747] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 10:01:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:01:57.433935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa27f1-153a-458d-831f-a9d3bf511022 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:01:57.444292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fa27f1-153a-458d-831f-a9d3bf511022 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:01:57.449504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0b1b-0b3b-41a3-a4d9-58e7dbbeffc6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:01:57.450583 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0b1b-0b3b-41a3-a4d9-58e7dbbeffc6 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:01:57.450873 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0b1b-0b3b-41a3-a4d9-58e7dbbeffc6 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:01:57.451145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf0b1b-0b3b-41a3-a4d9-58e7dbbeffc6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:01:57.459281 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf0b1b-0b3b-41a3-a4d9-58e7dbbeffc6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:01:57.460860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf0b1b-0b3b-41a3-a4d9-58e7dbbeffc6 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:01:57.469816 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4375/8748] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:01:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:02:05.812193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160674c-894d-4d1a-b07f-05a622d6b8ee None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:02:05.812668 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160674c-894d-4d1a-b07f-05a622d6b8ee None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:02:05.812773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5160674c-894d-4d1a-b07f-05a622d6b8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:02:05.831928 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5160674c-894d-4d1a-b07f-05a622d6b8ee None None] MFA Rules not processed for user `b99b86166ef34409910f6102dc49589e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:02:05.833102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5160674c-894d-4d1a-b07f-05a622d6b8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:02:05.839905 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4374/8749] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:02:05 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:02:06.528443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0b1b-0b3b-41a3-a4d9-58e7dbbeffc6 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:02:06.529824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4abf0b1b-0b3b-41a3-a4d9-58e7dbbeffc6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:02:06.567157 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf0b1b-0b3b-41a3-a4d9-58e7dbbeffc6 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:02:06.572177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03467cc4-99be-4531-8f97-c03ca4a48cde service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:02:06.572773 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467cc4-99be-4531-8f97-c03ca4a48cde service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:02:06.573058 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467cc4-99be-4531-8f97-c03ca4a48cde service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:02:06.573357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03467cc4-99be-4531-8f97-c03ca4a48cde service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:02:06.575086 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-03467cc4-99be-4531-8f97-c03ca4a48cde service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:02:06.587778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03467cc4-99be-4531-8f97-c03ca4a48cde service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:02:06.589395 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03467cc4-99be-4531-8f97-c03ca4a48cde service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:02:06.599109 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4376/8750] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:02:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:02:08.426559 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160674c-894d-4d1a-b07f-05a622d6b8ee None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:02:08.438734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5160674c-894d-4d1a-b07f-05a622d6b8ee None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:02:08.443599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbde7b-f9bd-402a-9098-3e5113de795c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:02:08.444193 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbde7b-f9bd-402a-9098-3e5113de795c service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:02:08.444470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbde7b-f9bd-402a-9098-3e5113de795c service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:02:08.444741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fbde7b-f9bd-402a-9098-3e5113de795c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:02:08.446435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-21fbde7b-f9bd-402a-9098-3e5113de795c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:02:08.458103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbde7b-f9bd-402a-9098-3e5113de795c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:02:08.459678 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fbde7b-f9bd-402a-9098-3e5113de795c service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:02:08.469242 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4375/8751] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:02:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:02:12.767036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340e00-67e1-4193-a370-a01e07386b6c None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:02:12.767536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340e00-67e1-4193-a370-a01e07386b6c None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:02:12.767651 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42340e00-67e1-4193-a370-a01e07386b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:02:12.787100 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-42340e00-67e1-4193-a370-a01e07386b6c None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:02:12.788336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42340e00-67e1-4193-a370-a01e07386b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:02:12.795517 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4377/8752] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 10:02:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 10:02:12.807896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbde7b-f9bd-402a-9098-3e5113de795c service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:02:12.819345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fbde7b-f9bd-402a-9098-3e5113de795c service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:02:12.824300 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105f169-5d99-45a2-a6ce-c4603f0ac0ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:02:12.824943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105f169-5d99-45a2-a6ce-c4603f0ac0ba service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:02:12.825223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105f169-5d99-45a2-a6ce-c4603f0ac0ba service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:02:12.825530 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1105f169-5d99-45a2-a6ce-c4603f0ac0ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:02:12.834142 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105f169-5d99-45a2-a6ce-c4603f0ac0ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:02:12.835745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1105f169-5d99-45a2-a6ce-c4603f0ac0ba service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:02:12.844750 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4376/8753] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:02:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 24 10:02:22.781134 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=44 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:22.841825 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=30 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:30.660694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42340e00-67e1-4193-a370-a01e07386b6c None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:02:30.662352 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-42340e00-67e1-4193-a370-a01e07386b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:02:30.689354 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42340e00-67e1-4193-a370-a01e07386b6c None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:02:30.695134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd8d8c-e8b0-4bd3-ace3-a0850e28cc9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:02:30.695766 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd8d8c-e8b0-4bd3-ace3-a0850e28cc9d service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:02:30.696015 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd8d8c-e8b0-4bd3-ace3-a0850e28cc9d service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:02:30.696289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecd8d8c-e8b0-4bd3-ace3-a0850e28cc9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:02:30.698083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1ecd8d8c-e8b0-4bd3-ace3-a0850e28cc9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:02:30.710998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd8d8c-e8b0-4bd3-ace3-a0850e28cc9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:02:30.712591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecd8d8c-e8b0-4bd3-ace3-a0850e28cc9d service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:02:30.724790 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4378/8754] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:02:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:02:40.719453 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=10 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:02:48.827861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105f169-5d99-45a2-a6ce-c4603f0ac0ba service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:02:48.842723 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1105f169-5d99-45a2-a6ce-c4603f0ac0ba service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:02:48.848581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df127e7-0353-4998-befd-1b0975dc5d59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:02:48.849466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df127e7-0353-4998-befd-1b0975dc5d59 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:02:48.849917 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df127e7-0353-4998-befd-1b0975dc5d59 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:02:48.850349 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df127e7-0353-4998-befd-1b0975dc5d59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:02:48.852268 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9df127e7-0353-4998-befd-1b0975dc5d59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:02:48.877651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df127e7-0353-4998-befd-1b0975dc5d59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:02:48.879510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df127e7-0353-4998-befd-1b0975dc5d59 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:02:48.893716 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4377/8755] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:02:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:02:55.736993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd8d8c-e8b0-4bd3-ace3-a0850e28cc9d service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:02:55.748822 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecd8d8c-e8b0-4bd3-ace3-a0850e28cc9d service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:02:55.753835 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52db84-3c1a-4824-ba46-b07aaab12331 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:02:55.754426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52db84-3c1a-4824-ba46-b07aaab12331 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:02:55.754707 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52db84-3c1a-4824-ba46-b07aaab12331 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:02:55.754982 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52db84-3c1a-4824-ba46-b07aaab12331 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:02:55.756680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0b52db84-3c1a-4824-ba46-b07aaab12331 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:02:55.768540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52db84-3c1a-4824-ba46-b07aaab12331 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:02:55.770140 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52db84-3c1a-4824-ba46-b07aaab12331 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:02:55.779767 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4379/8756] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:02:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:02:58.888023 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:05.775836 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:03:06.131728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df127e7-0353-4998-befd-1b0975dc5d59 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:03:06.143459 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df127e7-0353-4998-befd-1b0975dc5d59 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:03:06.149207 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cf0e7-1a81-46cc-b4bf-492aca7a3b22 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:03:06.149853 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cf0e7-1a81-46cc-b4bf-492aca7a3b22 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:03:06.150134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cf0e7-1a81-46cc-b4bf-492aca7a3b22 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:03:06.150406 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8cf0e7-1a81-46cc-b4bf-492aca7a3b22 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:03:06.158736 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cf0e7-1a81-46cc-b4bf-492aca7a3b22 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:03:06.160311 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8cf0e7-1a81-46cc-b4bf-492aca7a3b22 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:03:06.169071 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4378/8757] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:03:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:03:16.165062 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:03.295918 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa2ab1-8772-4ea7-afe0-9dfd7f7cd867 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:03.296426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa2ab1-8772-4ea7-afe0-9dfd7f7cd867 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:03.296542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbfa2ab1-8772-4ea7-afe0-9dfd7f7cd867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:03.315700 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-fbfa2ab1-8772-4ea7-afe0-9dfd7f7cd867 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:04:03.316892 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fbfa2ab1-8772-4ea7-afe0-9dfd7f7cd867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:03.330451 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4380/8758] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 10:04:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:04:03.370685 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cf0e7-1a81-46cc-b4bf-492aca7a3b22 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:03.381669 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8cf0e7-1a81-46cc-b4bf-492aca7a3b22 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:03.386701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508e1a4-0802-4b2a-93dc-9662af10cc5a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:03.387282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508e1a4-0802-4b2a-93dc-9662af10cc5a service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:03.387561 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508e1a4-0802-4b2a-93dc-9662af10cc5a service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:03.387835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f508e1a4-0802-4b2a-93dc-9662af10cc5a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:03.395822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508e1a4-0802-4b2a-93dc-9662af10cc5a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:03.397427 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f508e1a4-0802-4b2a-93dc-9662af10cc5a service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:03.405267 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4379/8759] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:04:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:04:03.753626 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa2ab1-8772-4ea7-afe0-9dfd7f7cd867 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:03.772233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbfa2ab1-8772-4ea7-afe0-9dfd7f7cd867 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:03.776366 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd498dd-48ab-47a4-94bc-88a1a4b4151f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:03.776959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd498dd-48ab-47a4-94bc-88a1a4b4151f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:03.777244 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd498dd-48ab-47a4-94bc-88a1a4b4151f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:03.777550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd498dd-48ab-47a4-94bc-88a1a4b4151f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:03.838596 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd498dd-48ab-47a4-94bc-88a1a4b4151f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:03.840038 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd498dd-48ab-47a4-94bc-88a1a4b4151f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:03.849607 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4381/8760] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:04:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:04:06.955740 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508e1a4-0802-4b2a-93dc-9662af10cc5a service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:06.968236 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f508e1a4-0802-4b2a-93dc-9662af10cc5a service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:06.973908 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde40ad-a23d-4784-bff1-8f6b5930105d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:06.974508 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde40ad-a23d-4784-bff1-8f6b5930105d service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:06.974785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde40ad-a23d-4784-bff1-8f6b5930105d service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:06.975057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde40ad-a23d-4784-bff1-8f6b5930105d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:06.976776 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9dde40ad-a23d-4784-bff1-8f6b5930105d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:06.993027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde40ad-a23d-4784-bff1-8f6b5930105d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:06.995297 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde40ad-a23d-4784-bff1-8f6b5930105d service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:07.007245 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4380/8761] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:04:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:04:09.871513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd498dd-48ab-47a4-94bc-88a1a4b4151f service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:09.885444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd498dd-48ab-47a4-94bc-88a1a4b4151f service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:09.892837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350e560-7375-451a-b1a7-2786b84c77e9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:09.893506 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350e560-7375-451a-b1a7-2786b84c77e9 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:09.893792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350e560-7375-451a-b1a7-2786b84c77e9 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:09.894071 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350e560-7375-451a-b1a7-2786b84c77e9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:09.896441 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4350e560-7375-451a-b1a7-2786b84c77e9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:09.909743 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350e560-7375-451a-b1a7-2786b84c77e9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:09.911689 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4350e560-7375-451a-b1a7-2786b84c77e9 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:09.923032 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4382/8762] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:04:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:04:09.935525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde40ad-a23d-4784-bff1-8f6b5930105d service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:09.962635 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde40ad-a23d-4784-bff1-8f6b5930105d service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:09.967888 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:09.968528 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:09.968807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:09.969079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] PATH_INFO: `/v3/users/b99b86166ef34409910f6102dc49589e` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:09.970295 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b99b86166ef34409910f6102dc49589e)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:09.972238 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:10.022978 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b99b86166ef34409910f6102dc49589e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.035121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b99b86166ef34409910f6102dc49589e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.035814 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b99b86166ef34409910f6102dc49589e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.045027 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b99b86166ef34409910f6102dc49589e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.052146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b99b86166ef34409910f6102dc49589e'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.059123 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4381/8763] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 10:04:09 2022] DELETE /identity/v3/users/b99b86166ef34409910f6102dc49589e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:04:10.233081 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350e560-7375-451a-b1a7-2786b84c77e9 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:10.246909 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4350e560-7375-451a-b1a7-2786b84c77e9 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:10.309284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:10.309977 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:10.310258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:10.310536 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] PATH_INFO: `/v3/projects/3cf4715cd28d40d08c2527be9671e8ca` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:10.311805 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cf4715cd28d40d08c2527be9671e8ca)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:10.313799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:10.359660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cf4715cd28d40d08c2527be9671e8ca', 'request_id': 'req-d7ffdcaa-499d-4313-abbd-64731d186179'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.365820 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cf4715cd28d40d08c2527be9671e8ca', 'request_id': 'req-d7ffdcaa-499d-4313-abbd-64731d186179'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.373859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cf4715cd28d40d08c2527be9671e8ca', 'request_id': 'req-d7ffdcaa-499d-4313-abbd-64731d186179'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.375049 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:10.386762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] The token cache is being invalidate because project 3cf4715cd28d40d08c2527be9671e8ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 10:04:10.387052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.387683 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.389160 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4383/8764] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 10:04:10 2022] DELETE /identity/v3/projects/3cf4715cd28d40d08c2527be9671e8ca => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:04:10.393199 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:10.394649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:10.408055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44cdf1e-360a-43f3-b6c4-aed92b9df01d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:10.464719 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:10.465382 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:10.465670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:10.465945 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] PATH_INFO: `/v3/users/3852f7231ed348e885cfbbda6a0482fc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:10.467071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3852f7231ed348e885cfbbda6a0482fc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:10.468994 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:10.514367 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3852f7231ed348e885cfbbda6a0482fc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.515388 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:10.528269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3852f7231ed348e885cfbbda6a0482fc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.528921 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3852f7231ed348e885cfbbda6a0482fc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.536294 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3852f7231ed348e885cfbbda6a0482fc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.543330 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-126bf275-26f7-4ae9-ab74-375e8329eb28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3852f7231ed348e885cfbbda6a0482fc'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.549338 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4382/8765] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 10:04:10 2022] DELETE /identity/v3/users/3852f7231ed348e885cfbbda6a0482fc => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:04:10.721617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:10.723080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:10.736342 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ffdcaa-499d-4313-abbd-64731d186179 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:10.797373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:10.797930 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:10.798209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:10.798483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] PATH_INFO: `/v3/projects/1e06da362a1f4e0093432e5b68882ecd` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:10.799613 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e06da362a1f4e0093432e5b68882ecd)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:10.801562 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:10.986165 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e06da362a1f4e0093432e5b68882ecd', 'request_id': 'req-0c9d172b-1017-486e-85ef-8ed7b2c39327'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:10.992984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e06da362a1f4e0093432e5b68882ecd', 'request_id': 'req-0c9d172b-1017-486e-85ef-8ed7b2c39327'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:11.001426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e06da362a1f4e0093432e5b68882ecd', 'request_id': 'req-0c9d172b-1017-486e-85ef-8ed7b2c39327'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:11.012556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] The token cache is being invalidate because project 1e06da362a1f4e0093432e5b68882ecd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 10:04:11.012841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:11.013498 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-0c9d172b-1017-486e-85ef-8ed7b2c39327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:04:11.015083 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4384/8766] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 10:04:10 2022] DELETE /identity/v3/projects/1e06da362a1f4e0093432e5b68882ecd => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:04:11.020198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07492331-fef6-468d-bc0c-3f157a99874e None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.020658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07492331-fef6-468d-bc0c-3f157a99874e None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.020789 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07492331-fef6-468d-bc0c-3f157a99874e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.050955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-07492331-fef6-468d-bc0c-3f157a99874e None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:04:11.052079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-07492331-fef6-468d-bc0c-3f157a99874e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:11.112879 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4383/8767] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 10:04:11.122128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eabf1-fa6d-49a2-8d57-78637394d2fb None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.122410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eabf1-fa6d-49a2-8d57-78637394d2fb None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.122681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557eabf1-fa6d-49a2-8d57-78637394d2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.142001 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-557eabf1-fa6d-49a2-8d57-78637394d2fb None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:04:11.143207 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-557eabf1-fa6d-49a2-8d57-78637394d2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:11.152767 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4385/8768] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:04:11.157136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07492331-fef6-468d-bc0c-3f157a99874e None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.167677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07492331-fef6-468d-bc0c-3f157a99874e None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.172209 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12878f-6fd9-4f42-b19f-54e8ebd6971a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.172803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12878f-6fd9-4f42-b19f-54e8ebd6971a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.173084 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12878f-6fd9-4f42-b19f-54e8ebd6971a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.173387 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c12878f-6fd9-4f42-b19f-54e8ebd6971a admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.174031 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12878f-6fd9-4f42-b19f-54e8ebd6971a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 10:04:11.174332 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12878f-6fd9-4f42-b19f-54e8ebd6971a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.175930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c12878f-6fd9-4f42-b19f-54e8ebd6971a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.187970 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4384/8769] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 10:04:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 10:04:11.192470 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eabf1-fa6d-49a2-8d57-78637394d2fb None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.201715 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557eabf1-fa6d-49a2-8d57-78637394d2fb None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.206324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736e7c-6d5e-471d-a709-2d720ccd96eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.206914 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736e7c-6d5e-471d-a709-2d720ccd96eb admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.207194 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736e7c-6d5e-471d-a709-2d720ccd96eb admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.207466 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3736e7c-6d5e-471d-a709-2d720ccd96eb admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.208095 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3736e7c-6d5e-471d-a709-2d720ccd96eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.210112 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3736e7c-6d5e-471d-a709-2d720ccd96eb admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.238557 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4386/8770] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 10:04:11 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 10:04:11.242833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12878f-6fd9-4f42-b19f-54e8ebd6971a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.253769 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c12878f-6fd9-4f42-b19f-54e8ebd6971a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.312390 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06b2b2-461f-4bc9-8b65-e80bbe436984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.312920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06b2b2-461f-4bc9-8b65-e80bbe436984 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.313203 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06b2b2-461f-4bc9-8b65-e80bbe436984 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.313509 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06b2b2-461f-4bc9-8b65-e80bbe436984 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.314136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06b2b2-461f-4bc9-8b65-e80bbe436984 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.316058 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f06b2b2-461f-4bc9-8b65-e80bbe436984 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.336191 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4385/8771] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 10:04:11 2022] POST /identity/v3/users => generated 297 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 10:04:11.340997 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736e7c-6d5e-471d-a709-2d720ccd96eb admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.351326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3736e7c-6d5e-471d-a709-2d720ccd96eb admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.356416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224bf46-ec86-42ff-af8f-4db81b47c4d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.357007 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224bf46-ec86-42ff-af8f-4db81b47c4d4 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.357283 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224bf46-ec86-42ff-af8f-4db81b47c4d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.357578 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6224bf46-ec86-42ff-af8f-4db81b47c4d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.358203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224bf46-ec86-42ff-af8f-4db81b47c4d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.359777 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6224bf46-ec86-42ff-af8f-4db81b47c4d4 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.369957 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4387/8772] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:04:11.374002 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06b2b2-461f-4bc9-8b65-e80bbe436984 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.383954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06b2b2-461f-4bc9-8b65-e80bbe436984 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.388670 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d66b0d2-a744-4a15-a466-62d85a634fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.389262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66b0d2-a744-4a15-a466-62d85a634fee admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.389563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66b0d2-a744-4a15-a466-62d85a634fee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.389839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d66b0d2-a744-4a15-a466-62d85a634fee admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.390468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66b0d2-a744-4a15-a466-62d85a634fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.392050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d66b0d2-a744-4a15-a466-62d85a634fee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.403790 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4386/8773] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:04:11.408680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224bf46-ec86-42ff-af8f-4db81b47c4d4 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.419080 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6224bf46-ec86-42ff-af8f-4db81b47c4d4 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.423882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07083e71-f4e5-448f-8b20-729c1376320f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.424579 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07083e71-f4e5-448f-8b20-729c1376320f admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.424862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07083e71-f4e5-448f-8b20-729c1376320f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.425139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07083e71-f4e5-448f-8b20-729c1376320f admin admin] PATH_INFO: `/v3/projects/fb905347dd6e4086ace6b3acb35ef30b/users/8291b3fbb6324df8a1111509a3b39d2d/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.439422 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07083e71-f4e5-448f-8b20-729c1376320f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb905347dd6e4086ace6b3acb35ef30b, user_id=8291b3fbb6324df8a1111509a3b39d2d, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.446882 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07083e71-f4e5-448f-8b20-729c1376320f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.459920 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4388/8774] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 10:04:11 2022] PUT /identity/v3/projects/fb905347dd6e4086ace6b3acb35ef30b/users/8291b3fbb6324df8a1111509a3b39d2d/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:04:11.470617 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe8ad7-6796-474d-9e2a-61ef06f0ab23 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.470896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe8ad7-6796-474d-9e2a-61ef06f0ab23 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.471206 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40fe8ad7-6796-474d-9e2a-61ef06f0ab23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.501738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-40fe8ad7-6796-474d-9e2a-61ef06f0ab23 None None] MFA Rules not processed for user `8291b3fbb6324df8a1111509a3b39d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:04:11.502957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-40fe8ad7-6796-474d-9e2a-61ef06f0ab23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:11.512387 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:11.568467 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4387/8775] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 10:04:11.573027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07083e71-f4e5-448f-8b20-729c1376320f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.591800 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:11.637389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07083e71-f4e5-448f-8b20-729c1376320f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.642073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426dc64-f21e-4b6c-8ee5-60d9049f1ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.642674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426dc64-f21e-4b6c-8ee5-60d9049f1ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.642952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426dc64-f21e-4b6c-8ee5-60d9049f1ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.643223 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a426dc64-f21e-4b6c-8ee5-60d9049f1ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.643852 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426dc64-f21e-4b6c-8ee5-60d9049f1ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.645803 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a426dc64-f21e-4b6c-8ee5-60d9049f1ef3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.673390 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4389/8776] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 10:04:11 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 10:04:11.677442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe8ad7-6796-474d-9e2a-61ef06f0ab23 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.688334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40fe8ad7-6796-474d-9e2a-61ef06f0ab23 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.747315 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a86313-7d33-4999-bf9f-109aa07f6efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.747926 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a86313-7d33-4999-bf9f-109aa07f6efd admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.748227 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a86313-7d33-4999-bf9f-109aa07f6efd admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.748496 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a86313-7d33-4999-bf9f-109aa07f6efd admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.749180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a86313-7d33-4999-bf9f-109aa07f6efd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.751414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a86313-7d33-4999-bf9f-109aa07f6efd admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.773342 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4388/8777] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 10:04:11 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 10:04:11.778054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426dc64-f21e-4b6c-8ee5-60d9049f1ef3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.790014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a426dc64-f21e-4b6c-8ee5-60d9049f1ef3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.794713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9632fe-93c9-428a-be54-3f295ced9a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.795310 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9632fe-93c9-428a-be54-3f295ced9a0f admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.795587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9632fe-93c9-428a-be54-3f295ced9a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.795859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9632fe-93c9-428a-be54-3f295ced9a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.796499 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9632fe-93c9-428a-be54-3f295ced9a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.798121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9632fe-93c9-428a-be54-3f295ced9a0f admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.808559 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4390/8778] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:04:11.812727 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a86313-7d33-4999-bf9f-109aa07f6efd admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.824666 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a86313-7d33-4999-bf9f-109aa07f6efd admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.829394 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018aed2-4fa5-4070-8e15-be9ad8831d06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.830041 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018aed2-4fa5-4070-8e15-be9ad8831d06 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.830321 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018aed2-4fa5-4070-8e15-be9ad8831d06 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.830597 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018aed2-4fa5-4070-8e15-be9ad8831d06 admin admin] PATH_INFO: `/v3/projects/bd92848c62b74354940a8c09ffae087c/users/a2b9f8e7b0e448a7932e5133a0b49870/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.847129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018aed2-4fa5-4070-8e15-be9ad8831d06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd92848c62b74354940a8c09ffae087c, user_id=a2b9f8e7b0e448a7932e5133a0b49870, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.849837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018aed2-4fa5-4070-8e15-be9ad8831d06 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.863073 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4389/8779] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 10:04:11 2022] PUT /identity/v3/projects/bd92848c62b74354940a8c09ffae087c/users/a2b9f8e7b0e448a7932e5133a0b49870/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:04:11.867077 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9632fe-93c9-428a-be54-3f295ced9a0f admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.876989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9632fe-93c9-428a-be54-3f295ced9a0f admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.933438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2be3d3-bfef-4530-b837-06b9409e5bc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.934035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2be3d3-bfef-4530-b837-06b9409e5bc6 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.934312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2be3d3-bfef-4530-b837-06b9409e5bc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.934582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2be3d3-bfef-4530-b837-06b9409e5bc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.935208 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2be3d3-bfef-4530-b837-06b9409e5bc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.936787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2be3d3-bfef-4530-b837-06b9409e5bc6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.949745 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4391/8780] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:04:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:04:11.950887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018aed2-4fa5-4070-8e15-be9ad8831d06 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:11.961116 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018aed2-4fa5-4070-8e15-be9ad8831d06 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:11.966308 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d84d9-35a0-4682-8840-d42d7762ec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:11.966943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d84d9-35a0-4682-8840-d42d7762ec31 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.967222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d84d9-35a0-4682-8840-d42d7762ec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.967495 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d84d9-35a0-4682-8840-d42d7762ec31 admin admin] PATH_INFO: `/v3/projects/bd92848c62b74354940a8c09ffae087c/users/a2b9f8e7b0e448a7932e5133a0b49870/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:11.969468 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d84d9-35a0-4682-8840-d42d7762ec31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd92848c62b74354940a8c09ffae087c, user_id=a2b9f8e7b0e448a7932e5133a0b49870, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:11.972093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d84d9-35a0-4682-8840-d42d7762ec31 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:11.982463 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4390/8781] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 10:04:11 2022] PUT /identity/v3/projects/bd92848c62b74354940a8c09ffae087c/users/a2b9f8e7b0e448a7932e5133a0b49870/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:04:11.994046 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ccaae-0102-40e8-abf7-cc8660888534 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:11.994561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ccaae-0102-40e8-abf7-cc8660888534 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:11.994670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429ccaae-0102-40e8-abf7-cc8660888534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:12.022020 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-429ccaae-0102-40e8-abf7-cc8660888534 None None] MFA Rules not processed for user `a2b9f8e7b0e448a7932e5133a0b49870`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:04:12.023209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-429ccaae-0102-40e8-abf7-cc8660888534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:12.090480 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4392/8782] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:04:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:04:12.104605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d84d9-35a0-4682-8840-d42d7762ec31 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:12.106357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-103d84d9-35a0-4682-8840-d42d7762ec31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:12.173553 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:12.181739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d84d9-35a0-4682-8840-d42d7762ec31 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:12.187596 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5ecde8-947a-4655-a857-579102c0ba93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:12.188197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ecde8-947a-4655-a857-579102c0ba93 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:12.188482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ecde8-947a-4655-a857-579102c0ba93 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:12.188754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5ecde8-947a-4655-a857-579102c0ba93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:12.242141 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ecde8-947a-4655-a857-579102c0ba93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:12.244223 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5ecde8-947a-4655-a857-579102c0ba93 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:12.253051 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4391/8783] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:04:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:04:15.187595 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ccaae-0102-40e8-abf7-cc8660888534 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:15.189119 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-429ccaae-0102-40e8-abf7-cc8660888534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:15.203355 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:15.267376 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429ccaae-0102-40e8-abf7-cc8660888534 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:15.271357 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f993a-5139-4650-aeb4-41dfd1818ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:15.272149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f993a-5139-4650-aeb4-41dfd1818ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:15.272617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f993a-5139-4650-aeb4-41dfd1818ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:15.273054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6f993a-5139-4650-aeb4-41dfd1818ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:15.285824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f993a-5139-4650-aeb4-41dfd1818ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:15.287264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6f993a-5139-4650-aeb4-41dfd1818ad8 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:15.297750 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4393/8784] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:04:15 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:04:18.346943 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64ea1-1ab1-49d4-88b1-6e6d16ebd035 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:18.347457 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64ea1-1ab1-49d4-88b1-6e6d16ebd035 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:18.347576 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b64ea1-1ab1-49d4-88b1-6e6d16ebd035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:18.367414 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-f7b64ea1-1ab1-49d4-88b1-6e6d16ebd035 None None] MFA Rules not processed for user `8291b3fbb6324df8a1111509a3b39d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:04:18.369810 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7b64ea1-1ab1-49d4-88b1-6e6d16ebd035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:18.377651 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4392/8785] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:04:18 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:04:18.730139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f993a-5139-4650-aeb4-41dfd1818ad8 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:18.732297 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2b6f993a-5139-4650-aeb4-41dfd1818ad8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:18.745328 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6f993a-5139-4650-aeb4-41dfd1818ad8 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:18.749511 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d141c-583a-4c35-abe7-16e4bf3a3878 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:18.750486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d141c-583a-4c35-abe7-16e4bf3a3878 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:18.750966 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d141c-583a-4c35-abe7-16e4bf3a3878 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:18.751424 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d141c-583a-4c35-abe7-16e4bf3a3878 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:18.753177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-799d141c-583a-4c35-abe7-16e4bf3a3878 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:18.763978 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d141c-583a-4c35-abe7-16e4bf3a3878 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:18.765480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d141c-583a-4c35-abe7-16e4bf3a3878 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:18.775816 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4394/8786] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:04:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:04:19.116847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b64ea1-1ab1-49d4-88b1-6e6d16ebd035 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:19.119350 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f7b64ea1-1ab1-49d4-88b1-6e6d16ebd035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:19.196899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b64ea1-1ab1-49d4-88b1-6e6d16ebd035 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:19.201953 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920a722b-c283-4a45-976d-88f4b243889f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:19.202940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a722b-c283-4a45-976d-88f4b243889f service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:19.203219 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a722b-c283-4a45-976d-88f4b243889f service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:19.203494 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920a722b-c283-4a45-976d-88f4b243889f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:19.205230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-920a722b-c283-4a45-976d-88f4b243889f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:19.217805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a722b-c283-4a45-976d-88f4b243889f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:19.219472 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920a722b-c283-4a45-976d-88f4b243889f service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:19.231621 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4393/8787] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:04:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:04:21.175585 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d141c-583a-4c35-abe7-16e4bf3a3878 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:04:21.185450 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d141c-583a-4c35-abe7-16e4bf3a3878 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:04:21.189516 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb52c1-9ffc-4d6d-ac13-4e0b24719f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:04:21.190133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb52c1-9ffc-4d6d-ac13-4e0b24719f5c service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:04:21.190413 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb52c1-9ffc-4d6d-ac13-4e0b24719f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:04:21.190687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb52c1-9ffc-4d6d-ac13-4e0b24719f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:04:21.192447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-13bb52c1-9ffc-4d6d-ac13-4e0b24719f5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:04:21.203474 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb52c1-9ffc-4d6d-ac13-4e0b24719f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:04:21.204920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb52c1-9ffc-4d6d-ac13-4e0b24719f5c service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:04:21.213975 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4395/8788] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:04:21 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:04:29.225489 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=62 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:04:31.209769 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=38 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:24.628607 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638a9b5-aeaf-4f04-a3b8-431c6da3677a None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:05:24.629113 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638a9b5-aeaf-4f04-a3b8-431c6da3677a None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:05:24.629208 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8638a9b5-aeaf-4f04-a3b8-431c6da3677a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:05:24.649180 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-8638a9b5-aeaf-4f04-a3b8-431c6da3677a None None] MFA Rules not processed for user `8291b3fbb6324df8a1111509a3b39d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:05:24.650986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8638a9b5-aeaf-4f04-a3b8-431c6da3677a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:05:24.658322 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4394/8789] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:05:24 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:05:24.996069 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb52c1-9ffc-4d6d-ac13-4e0b24719f5c service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:05:25.006467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb52c1-9ffc-4d6d-ac13-4e0b24719f5c service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:05:25.012067 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598715ea-810f-407f-8012-e2617b471186 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:05:25.012688 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598715ea-810f-407f-8012-e2617b471186 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:05:25.013209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598715ea-810f-407f-8012-e2617b471186 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:05:25.013520 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598715ea-810f-407f-8012-e2617b471186 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:05:25.015584 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-598715ea-810f-407f-8012-e2617b471186 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:05:25.031948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598715ea-810f-407f-8012-e2617b471186 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:05:25.033876 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598715ea-810f-407f-8012-e2617b471186 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:05:25.044018 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4396/8790] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:05:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:05:27.491753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638a9b5-aeaf-4f04-a3b8-431c6da3677a None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:05:27.501999 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8638a9b5-aeaf-4f04-a3b8-431c6da3677a None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:05:27.506160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae133e-1748-4061-b110-2e4d9640d926 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:05:27.507010 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae133e-1748-4061-b110-2e4d9640d926 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:05:27.507288 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae133e-1748-4061-b110-2e4d9640d926 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:05:27.507565 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aae133e-1748-4061-b110-2e4d9640d926 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:05:27.509919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-8aae133e-1748-4061-b110-2e4d9640d926 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:05:27.520640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae133e-1748-4061-b110-2e4d9640d926 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:05:27.522130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aae133e-1748-4061-b110-2e4d9640d926 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:05:27.545886 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4395/8791] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:05:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:05:30.384334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598715ea-810f-407f-8012-e2617b471186 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:05:30.392754 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598715ea-810f-407f-8012-e2617b471186 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:05:30.396363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:05:30.396948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:05:30.397227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:05:30.397539 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:05:30.399284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:05:30.424933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:05:30.426398 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:05:30.437600 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4397/8792] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:05:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:05:31.615473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae133e-1748-4061-b110-2e4d9640d926 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:05:31.624589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aae133e-1748-4061-b110-2e4d9640d926 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:05:31.628281 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ef7698-b321-4e67-913c-276f1626b663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:05:31.628872 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef7698-b321-4e67-913c-276f1626b663 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:05:31.629148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef7698-b321-4e67-913c-276f1626b663 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:05:31.629446 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef7698-b321-4e67-913c-276f1626b663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:05:31.632222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-95ef7698-b321-4e67-913c-276f1626b663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:05:31.646502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef7698-b321-4e67-913c-276f1626b663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:05:31.647930 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ef7698-b321-4e67-913c-276f1626b663 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:05:31.659002 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4396/8793] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:05:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:05:40.432384 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=17 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:05:41.653999 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=15 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:08.541121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:07:08.543759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:07:08.570553 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e3b7de-97d6-4489-af7a-35115ed375d2 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:07:08.577235 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac01576-1ee4-4f62-93f0-74ece632c306 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:07:08.578473 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac01576-1ee4-4f62-93f0-74ece632c306 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:07:08.578923 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac01576-1ee4-4f62-93f0-74ece632c306 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:07:08.579361 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac01576-1ee4-4f62-93f0-74ece632c306 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:07:08.581416 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fac01576-1ee4-4f62-93f0-74ece632c306 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:07:08.594795 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac01576-1ee4-4f62-93f0-74ece632c306 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:07:08.596690 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac01576-1ee4-4f62-93f0-74ece632c306 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:07:08.618349 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4398/8794] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:07:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:07:10.128663 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76fbf-1696-41b6-8b64-ea6119c5fabd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:07:10.129845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76fbf-1696-41b6-8b64-ea6119c5fabd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:07:10.130153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f76fbf-1696-41b6-8b64-ea6119c5fabd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:07:10.156136 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-31f76fbf-1696-41b6-8b64-ea6119c5fabd None None] MFA Rules not processed for user `8291b3fbb6324df8a1111509a3b39d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:07:10.157488 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-31f76fbf-1696-41b6-8b64-ea6119c5fabd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:07:10.165322 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4397/8795] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:07:10 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:07:14.168451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac01576-1ee4-4f62-93f0-74ece632c306 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:07:14.183921 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac01576-1ee4-4f62-93f0-74ece632c306 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:07:14.189903 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa8cb4-e5c9-43bd-bdf1-a9ca17b104a7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:07:14.190582 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa8cb4-e5c9-43bd-bdf1-a9ca17b104a7 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:07:14.190926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa8cb4-e5c9-43bd-bdf1-a9ca17b104a7 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:07:14.191270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aa8cb4-e5c9-43bd-bdf1-a9ca17b104a7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:07:14.193121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c4aa8cb4-e5c9-43bd-bdf1-a9ca17b104a7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:07:14.208323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa8cb4-e5c9-43bd-bdf1-a9ca17b104a7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:07:14.210973 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aa8cb4-e5c9-43bd-bdf1-a9ca17b104a7 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:07:14.223657 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4399/8796] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:07:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:07:20.150894 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:24.219519 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=12 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:07:56.357129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335fff-9e56-43a6-b988-fafa65fa61ee None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:07:56.358728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335fff-9e56-43a6-b988-fafa65fa61ee None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:07:56.359213 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20335fff-9e56-43a6-b988-fafa65fa61ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:07:56.396443 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-20335fff-9e56-43a6-b988-fafa65fa61ee None None] MFA Rules not processed for user `9ea1478025654b729f707edbaeff4e2b`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:07:56.397755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-20335fff-9e56-43a6-b988-fafa65fa61ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:07:56.405040 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4398/8797] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:07:56.416883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa8cb4-e5c9-43bd-bdf1-a9ca17b104a7 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:07:56.426866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aa8cb4-e5c9-43bd-bdf1-a9ca17b104a7 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:07:56.430632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5184da6-3df2-4371-8fbf-aaba779f58cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:07:56.431261 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5184da6-3df2-4371-8fbf-aaba779f58cb service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:07:56.431542 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5184da6-3df2-4371-8fbf-aaba779f58cb service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:07:56.431818 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5184da6-3df2-4371-8fbf-aaba779f58cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:07:56.439289 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5184da6-3df2-4371-8fbf-aaba779f58cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:07:56.440984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5184da6-3df2-4371-8fbf-aaba779f58cb service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:07:56.449602 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4400/8798] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:07:56 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:07:56.528837 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed799-f994-4b68-a305-9b20ef936985 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:07:56.529154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed799-f994-4b68-a305-9b20ef936985 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:07:56.530040 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ed799-f994-4b68-a305-9b20ef936985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:07:56.566550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-1d8ed799-f994-4b68-a305-9b20ef936985 None None] MFA Rules not processed for user `dc17e1ac24064752b59ca2438dfdac4c`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:07:56.567743 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-1d8ed799-f994-4b68-a305-9b20ef936985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:07:56.576179 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4399/8799] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 10:07:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:07:56.588134 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5184da6-3df2-4371-8fbf-aaba779f58cb service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:07:56.600407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5184da6-3df2-4371-8fbf-aaba779f58cb service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:07:56.605227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed43649-3cc3-4388-8986-0ba1ff41e230 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:07:56.605837 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed43649-3cc3-4388-8986-0ba1ff41e230 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:07:56.606110 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed43649-3cc3-4388-8986-0ba1ff41e230 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:07:56.606377 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed43649-3cc3-4388-8986-0ba1ff41e230 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:07:56.614386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed43649-3cc3-4388-8986-0ba1ff41e230 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:07:56.616264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed43649-3cc3-4388-8986-0ba1ff41e230 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:07:56.625667 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4401/8800] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:07:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:07:56.799185 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ed799-f994-4b68-a305-9b20ef936985 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:07:56.808567 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ed799-f994-4b68-a305-9b20ef936985 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:07:56.812149 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a29fd-2311-4cb7-afe9-bb6f653db9c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:07:56.812741 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a29fd-2311-4cb7-afe9-bb6f653db9c4 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:07:56.813022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a29fd-2311-4cb7-afe9-bb6f653db9c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:07:56.813314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a29fd-2311-4cb7-afe9-bb6f653db9c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:07:56.815055 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cd2a29fd-2311-4cb7-afe9-bb6f653db9c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:07:56.830563 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a29fd-2311-4cb7-afe9-bb6f653db9c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:07:56.831989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a29fd-2311-4cb7-afe9-bb6f653db9c4 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:07:56.844764 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4400/8801] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:07:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:07:56.904314 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed43649-3cc3-4388-8986-0ba1ff41e230 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:07:56.915017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed43649-3cc3-4388-8986-0ba1ff41e230 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:07:56.919989 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c937a0c-0da8-457c-b935-30225c85db63 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:07:56.920572 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c937a0c-0da8-457c-b935-30225c85db63 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:07:56.920848 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c937a0c-0da8-457c-b935-30225c85db63 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:07:56.921145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c937a0c-0da8-457c-b935-30225c85db63 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:07:56.922851 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7c937a0c-0da8-457c-b935-30225c85db63 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:07:56.933861 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c937a0c-0da8-457c-b935-30225c85db63 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:07:56.935426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c937a0c-0da8-457c-b935-30225c85db63 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:07:56.945492 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4402/8802] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:07:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:08:01.740051 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a29fd-2311-4cb7-afe9-bb6f653db9c4 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:08:01.751155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a29fd-2311-4cb7-afe9-bb6f653db9c4 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:08:01.756018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:08:01.756604 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:08:01.756881 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:08:01.757153 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:08:01.758865 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:08:01.770325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:08:01.771877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:08:01.781882 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4401/8803] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:08:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:08:06.941424 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=18 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:08:11.777275 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=30 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:08:21.899557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c937a0c-0da8-457c-b935-30225c85db63 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:08:21.912796 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c937a0c-0da8-457c-b935-30225c85db63 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:08:21.918784 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5670bc-449d-42f7-86fe-f85f67de39e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:08:21.919387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5670bc-449d-42f7-86fe-f85f67de39e9 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:08:21.919717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5670bc-449d-42f7-86fe-f85f67de39e9 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:08:21.919994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5670bc-449d-42f7-86fe-f85f67de39e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:08:21.921771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5e5670bc-449d-42f7-86fe-f85f67de39e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:08:21.934019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5670bc-449d-42f7-86fe-f85f67de39e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:08:21.935939 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5670bc-449d-42f7-86fe-f85f67de39e9 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:08:21.946649 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4403/8804] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:08:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:08:31.941927 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:08:53.247487 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:08:53.248972 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:08:53.266023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b33c75-e633-424c-9bdc-4d7509ef027d service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:08:53.272371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09af06-e93d-44a2-b958-ddd971ff2181 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:08:53.273068 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09af06-e93d-44a2-b958-ddd971ff2181 service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:08:53.273452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09af06-e93d-44a2-b958-ddd971ff2181 service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:08:53.273797 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d09af06-e93d-44a2-b958-ddd971ff2181 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:08:53.275706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4d09af06-e93d-44a2-b958-ddd971ff2181 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:08:53.290720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09af06-e93d-44a2-b958-ddd971ff2181 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:08:53.292020 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d09af06-e93d-44a2-b958-ddd971ff2181 service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:08:53.304198 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4402/8805] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:08:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:09:03.299639 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:04.677952 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ca852-c9e5-4d2e-a11c-52afb0348bfa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:09:04.678443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ca852-c9e5-4d2e-a11c-52afb0348bfa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:09:04.678636 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108ca852-c9e5-4d2e-a11c-52afb0348bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:09:04.698173 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-108ca852-c9e5-4d2e-a11c-52afb0348bfa None None] MFA Rules not processed for user `8291b3fbb6324df8a1111509a3b39d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:09:04.699300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-108ca852-c9e5-4d2e-a11c-52afb0348bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:09:04.707302 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4404/8806] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:09:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:09:12.466735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09af06-e93d-44a2-b958-ddd971ff2181 service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:09:12.486525 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d09af06-e93d-44a2-b958-ddd971ff2181 service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:09:12.493785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06980b53-b69f-47fc-a751-719656f5044f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:09:12.494393 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06980b53-b69f-47fc-a751-719656f5044f service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:09:12.494673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06980b53-b69f-47fc-a751-719656f5044f service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:09:12.494949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06980b53-b69f-47fc-a751-719656f5044f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:09:12.503407 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06980b53-b69f-47fc-a751-719656f5044f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:09:12.505008 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06980b53-b69f-47fc-a751-719656f5044f service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:09:12.523932 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4403/8807] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:09:12 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 10:09:14.692580 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:16.417334 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ca852-c9e5-4d2e-a11c-52afb0348bfa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:09:16.426891 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108ca852-c9e5-4d2e-a11c-52afb0348bfa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:09:16.430454 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc23dd6-eeb9-47db-802e-1fbb06a69e19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:09:16.431036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc23dd6-eeb9-47db-802e-1fbb06a69e19 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:09:16.431312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc23dd6-eeb9-47db-802e-1fbb06a69e19 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:09:16.431586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc23dd6-eeb9-47db-802e-1fbb06a69e19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:09:16.440840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc23dd6-eeb9-47db-802e-1fbb06a69e19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:09:16.442325 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc23dd6-eeb9-47db-802e-1fbb06a69e19 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:09:16.452278 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4405/8808] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:09:16 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:09:22.510431 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:09:26.447597 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:30.333890 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06980b53-b69f-47fc-a751-719656f5044f service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:10:30.345927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06980b53-b69f-47fc-a751-719656f5044f service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:10:30.350011 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064a5e6-b927-47b6-afa8-9af8bd8c911e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:10:30.350773 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064a5e6-b927-47b6-afa8-9af8bd8c911e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:10:30.351083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064a5e6-b927-47b6-afa8-9af8bd8c911e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:10:30.351989 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064a5e6-b927-47b6-afa8-9af8bd8c911e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:10:30.361673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064a5e6-b927-47b6-afa8-9af8bd8c911e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:10:30.363661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4064a5e6-b927-47b6-afa8-9af8bd8c911e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:10:30.378486 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4404/8809] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:10:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:10:31.624127 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc23dd6-eeb9-47db-802e-1fbb06a69e19 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:10:31.632703 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc23dd6-eeb9-47db-802e-1fbb06a69e19 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:10:31.636253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc25dc13-9613-41c9-b201-16eb93f0fc68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:10:31.636840 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25dc13-9613-41c9-b201-16eb93f0fc68 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:10:31.637114 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25dc13-9613-41c9-b201-16eb93f0fc68 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:10:31.637408 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc25dc13-9613-41c9-b201-16eb93f0fc68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:10:31.647493 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25dc13-9613-41c9-b201-16eb93f0fc68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:10:31.648911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc25dc13-9613-41c9-b201-16eb93f0fc68 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:10:31.660164 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4406/8810] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:10:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:10:36.977683 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064a5e6-b927-47b6-afa8-9af8bd8c911e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:10:36.994173 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4064a5e6-b927-47b6-afa8-9af8bd8c911e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:10:36.999632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b52718-14d0-44a4-8164-49326d69d99c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:10:37.000249 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b52718-14d0-44a4-8164-49326d69d99c service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:10:37.000524 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b52718-14d0-44a4-8164-49326d69d99c service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:10:37.000794 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b52718-14d0-44a4-8164-49326d69d99c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:10:37.006539 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-c8b52718-14d0-44a4-8164-49326d69d99c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:10:37.021653 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b52718-14d0-44a4-8164-49326d69d99c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:10:37.023282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b52718-14d0-44a4-8164-49326d69d99c service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:10:37.036010 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4405/8811] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:10:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:10:41.656064 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:42.766631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f0a68-adca-4327-9dec-26a631a34ae2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:10:42.767257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f0a68-adca-4327-9dec-26a631a34ae2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:10:42.767257 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413f0a68-adca-4327-9dec-26a631a34ae2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:10:42.787116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-413f0a68-adca-4327-9dec-26a631a34ae2 None None] MFA Rules not processed for user `8291b3fbb6324df8a1111509a3b39d2d`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:10:42.788326 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-413f0a68-adca-4327-9dec-26a631a34ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:10:42.795917 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4407/8812] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:10:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:10:43.159423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b52718-14d0-44a4-8164-49326d69d99c service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:10:43.169949 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b52718-14d0-44a4-8164-49326d69d99c service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:10:43.173640 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853093e-7f5c-4217-9168-db9293c516fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:10:43.174248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853093e-7f5c-4217-9168-db9293c516fb service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:10:43.174529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853093e-7f5c-4217-9168-db9293c516fb service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:10:43.174805 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853093e-7f5c-4217-9168-db9293c516fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:10:43.183742 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853093e-7f5c-4217-9168-db9293c516fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:10:43.185240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853093e-7f5c-4217-9168-db9293c516fb service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:10:43.193999 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4406/8813] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:10:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:10:43.551396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f0a68-adca-4327-9dec-26a631a34ae2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:10:43.561558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413f0a68-adca-4327-9dec-26a631a34ae2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:10:43.565240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12862e66-ec91-481e-a356-3b19f74c2d22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:10:43.565886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12862e66-ec91-481e-a356-3b19f74c2d22 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:10:43.566164 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12862e66-ec91-481e-a356-3b19f74c2d22 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:10:43.566437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12862e66-ec91-481e-a356-3b19f74c2d22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:10:43.578237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12862e66-ec91-481e-a356-3b19f74c2d22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:10:43.579751 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12862e66-ec91-481e-a356-3b19f74c2d22 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:10:43.592197 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4408/8814] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:10:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:10:49.453826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853093e-7f5c-4217-9168-db9293c516fb service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:10:49.462550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853093e-7f5c-4217-9168-db9293c516fb service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:10:49.466316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c39a3-3694-40c0-a40e-ff503ce4536e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:10:49.466922 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c39a3-3694-40c0-a40e-ff503ce4536e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:10:49.467204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c39a3-3694-40c0-a40e-ff503ce4536e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:10:49.467477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23c39a3-3694-40c0-a40e-ff503ce4536e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:10:49.475470 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c39a3-3694-40c0-a40e-ff503ce4536e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:10:49.476912 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23c39a3-3694-40c0-a40e-ff503ce4536e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:10:49.485502 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4407/8815] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:10:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:10:53.586660 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=9 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:10:59.481759 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=24 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:45.716721 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12862e66-ec91-481e-a356-3b19f74c2d22 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:45.731082 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12862e66-ec91-481e-a356-3b19f74c2d22 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:45.737153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec6861-22be-4e0a-98f8-04a73cb1799d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:45.738052 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6861-22be-4e0a-98f8-04a73cb1799d service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:45.738762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6861-22be-4e0a-98f8-04a73cb1799d service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:45.739245 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec6861-22be-4e0a-98f8-04a73cb1799d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:45.744783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a9ec6861-22be-4e0a-98f8-04a73cb1799d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:45.777254 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec6861-22be-4e0a-98f8-04a73cb1799d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:45.779220 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec6861-22be-4e0a-98f8-04a73cb1799d service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:45.792078 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4409/8816] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:11:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:11:46.034902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c39a3-3694-40c0-a40e-ff503ce4536e service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:46.121733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23c39a3-3694-40c0-a40e-ff503ce4536e service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:46.126384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:46.127071 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:46.127357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:46.127634 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] PATH_INFO: `/v3/users/8291b3fbb6324df8a1111509a3b39d2d` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:46.129006 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8291b3fbb6324df8a1111509a3b39d2d)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:46.130879 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:46.199686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8291b3fbb6324df8a1111509a3b39d2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.215132 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8291b3fbb6324df8a1111509a3b39d2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.215896 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8291b3fbb6324df8a1111509a3b39d2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.233337 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8291b3fbb6324df8a1111509a3b39d2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.243269 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8291b3fbb6324df8a1111509a3b39d2d'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.250146 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4408/8817] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 10:11:46 2022] DELETE /identity/v3/users/8291b3fbb6324df8a1111509a3b39d2d => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:11:46.254772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57f763-7119-4173-91ef-e500dd3986fa None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:46.255129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57f763-7119-4173-91ef-e500dd3986fa None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:46.255468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a57f763-7119-4173-91ef-e500dd3986fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:46.297687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-1a57f763-7119-4173-91ef-e500dd3986fa None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:11:46.299006 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a57f763-7119-4173-91ef-e500dd3986fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:46.357844 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4410/8818] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:11:46.368059 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:46.369589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:46.427739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2b0c43-cb1f-435d-8c99-857534be83bb admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:46.431358 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138ff64-4843-4e7c-8fd4-07ed9f81c16f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:46.431961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138ff64-4843-4e7c-8fd4-07ed9f81c16f service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:46.432240 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138ff64-4843-4e7c-8fd4-07ed9f81c16f service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:46.432514 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138ff64-4843-4e7c-8fd4-07ed9f81c16f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:46.441450 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138ff64-4843-4e7c-8fd4-07ed9f81c16f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:46.442877 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138ff64-4843-4e7c-8fd4-07ed9f81c16f service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:46.452278 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4409/8819] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:11:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:11:46.625216 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57f763-7119-4173-91ef-e500dd3986fa None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:46.627113 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-1a57f763-7119-4173-91ef-e500dd3986fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:46.646009 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a57f763-7119-4173-91ef-e500dd3986fa None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:46.652782 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:46.653580 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:46.653863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:46.654141 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] PATH_INFO: `/v3/projects/fb905347dd6e4086ace6b3acb35ef30b` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:46.655339 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb905347dd6e4086ace6b3acb35ef30b)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:46.657378 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:46.704344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb905347dd6e4086ace6b3acb35ef30b', 'request_id': 'req-7c95ef49-a56e-4769-9f82-67165d9af6e3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.710445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb905347dd6e4086ace6b3acb35ef30b', 'request_id': 'req-7c95ef49-a56e-4769-9f82-67165d9af6e3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.718533 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb905347dd6e4086ace6b3acb35ef30b', 'request_id': 'req-7c95ef49-a56e-4769-9f82-67165d9af6e3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.728821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] The token cache is being invalidate because project fb905347dd6e4086ace6b3acb35ef30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 10:11:46.729108 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.729788 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.731256 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4411/8820] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 10:11:46 2022] DELETE /identity/v3/projects/fb905347dd6e4086ace6b3acb35ef30b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:11:46.735344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138ff64-4843-4e7c-8fd4-07ed9f81c16f service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:46.751158 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:46.756042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138ff64-4843-4e7c-8fd4-07ed9f81c16f service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:46.819616 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:46.820282 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:46.820564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:46.820839 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] PATH_INFO: `/v3/users/a2b9f8e7b0e448a7932e5133a0b49870` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:46.822517 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2b9f8e7b0e448a7932e5133a0b49870)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:46.824523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:46.870848 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2b9f8e7b0e448a7932e5133a0b49870'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.882800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2b9f8e7b0e448a7932e5133a0b49870'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.883478 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2b9f8e7b0e448a7932e5133a0b49870'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.890735 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2b9f8e7b0e448a7932e5133a0b49870'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.897815 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-4bbe8cb1-b936-40b1-9a06-366a7de477d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2b9f8e7b0e448a7932e5133a0b49870'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:46.904513 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4410/8821] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 10:11:46 2022] DELETE /identity/v3/users/a2b9f8e7b0e448a7932e5133a0b49870 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:11:47.454525 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:47.455990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:47.471841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c95ef49-a56e-4769-9f82-67165d9af6e3 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:47.518295 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:47.535968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:47.536591 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:47.536871 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:47.537149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] PATH_INFO: `/v3/projects/bd92848c62b74354940a8c09ffae087c` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:47.538302 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd92848c62b74354940a8c09ffae087c)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:47.540242 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:47.585404 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd92848c62b74354940a8c09ffae087c', 'request_id': 'req-1341ffdb-e926-46fb-8619-30a9e6301c6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:47.591932 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd92848c62b74354940a8c09ffae087c', 'request_id': 'req-1341ffdb-e926-46fb-8619-30a9e6301c6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:47.599311 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd92848c62b74354940a8c09ffae087c', 'request_id': 'req-1341ffdb-e926-46fb-8619-30a9e6301c6b'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:47.609459 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] The token cache is being invalidate because project bd92848c62b74354940a8c09ffae087c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88311) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 10:11:47.609759 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:47.610389 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-1341ffdb-e926-46fb-8619-30a9e6301c6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:11:47.611834 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4412/8822] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 10:11:47 2022] DELETE /identity/v3/projects/bd92848c62b74354940a8c09ffae087c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:11:47.617148 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8631a-ab0e-4b9c-b0dc-2a0b7d764661 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:47.617677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8631a-ab0e-4b9c-b0dc-2a0b7d764661 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:47.619280 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d8631a-ab0e-4b9c-b0dc-2a0b7d764661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:47.661802 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-70d8631a-ab0e-4b9c-b0dc-2a0b7d764661 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:11:47.663022 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-70d8631a-ab0e-4b9c-b0dc-2a0b7d764661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:47.721652 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4411/8823] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:11:47.731083 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8b0ba-4beb-4129-be33-54bae4229aa4 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:47.731561 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8b0ba-4beb-4129-be33-54bae4229aa4 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:47.731790 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d8b0ba-4beb-4129-be33-54bae4229aa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:47.752575 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-38d8b0ba-4beb-4129-be33-54bae4229aa4 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:11:47.753815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-38d8b0ba-4beb-4129-be33-54bae4229aa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:47.761658 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4413/8824] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:11:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:11:47.766036 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8631a-ab0e-4b9c-b0dc-2a0b7d764661 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:47.776453 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d8631a-ab0e-4b9c-b0dc-2a0b7d764661 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:47.781028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba69ca-861c-48fe-a1ca-d5b6a1faa93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:47.781661 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba69ca-861c-48fe-a1ca-d5b6a1faa93d admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:47.781938 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba69ca-861c-48fe-a1ca-d5b6a1faa93d admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:47.782212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba69ca-861c-48fe-a1ca-d5b6a1faa93d admin admin] PATH_INFO: `/v3/domains` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:47.782849 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba69ca-861c-48fe-a1ca-d5b6a1faa93d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88312) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 10:11:47.783152 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba69ca-861c-48fe-a1ca-d5b6a1faa93d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:47.784753 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba69ca-861c-48fe-a1ca-d5b6a1faa93d admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:47.787384 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:47.801726 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4412/8825] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 10:11:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 10:11:47.802799 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8b0ba-4beb-4129-be33-54bae4229aa4 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:47.812259 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d8b0ba-4beb-4129-be33-54bae4229aa4 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:47.816867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e68b-6d6e-48f0-bfb5-8373ae431051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:47.817483 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e68b-6d6e-48f0-bfb5-8373ae431051 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:47.817762 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e68b-6d6e-48f0-bfb5-8373ae431051 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:47.818031 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a998e68b-6d6e-48f0-bfb5-8373ae431051 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:47.818660 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e68b-6d6e-48f0-bfb5-8373ae431051 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:47.820558 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a998e68b-6d6e-48f0-bfb5-8373ae431051 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:47.857927 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4414/8826] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 10:11:47 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 10:11:47.862659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba69ca-861c-48fe-a1ca-d5b6a1faa93d admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:47.872657 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba69ca-861c-48fe-a1ca-d5b6a1faa93d admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:47.927892 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524d90-cb73-440b-a944-45a4dc265794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:47.928492 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524d90-cb73-440b-a944-45a4dc265794 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:47.928772 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524d90-cb73-440b-a944-45a4dc265794 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:47.929048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a524d90-cb73-440b-a944-45a4dc265794 admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:47.929702 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524d90-cb73-440b-a944-45a4dc265794 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:47.931658 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a524d90-cb73-440b-a944-45a4dc265794 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:47.953413 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4413/8827] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 10:11:47 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 10:11:47.957592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e68b-6d6e-48f0-bfb5-8373ae431051 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:47.968191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a998e68b-6d6e-48f0-bfb5-8373ae431051 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:47.972670 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985da1f-db70-40c4-a264-973638c352f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:47.973252 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985da1f-db70-40c4-a264-973638c352f9 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:47.973570 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985da1f-db70-40c4-a264-973638c352f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:47.973842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b985da1f-db70-40c4-a264-973638c352f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:47.974467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985da1f-db70-40c4-a264-973638c352f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:47.976039 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b985da1f-db70-40c4-a264-973638c352f9 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:47.986202 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4415/8828] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:11:47.990146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524d90-cb73-440b-a944-45a4dc265794 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:48.000127 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a524d90-cb73-440b-a944-45a4dc265794 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:48.004677 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d350ed-2182-4de1-b05a-c4966ef8d3c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:48.005252 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d350ed-2182-4de1-b05a-c4966ef8d3c7 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:48.005558 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d350ed-2182-4de1-b05a-c4966ef8d3c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:48.005828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d350ed-2182-4de1-b05a-c4966ef8d3c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:48.006477 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d350ed-2182-4de1-b05a-c4966ef8d3c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:48.008083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d350ed-2182-4de1-b05a-c4966ef8d3c7 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:48.019154 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4414/8829] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:11:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:11:48.023188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985da1f-db70-40c4-a264-973638c352f9 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:48.033191 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b985da1f-db70-40c4-a264-973638c352f9 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:48.038105 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262ca9-b6f9-43da-98b0-dee7dc69b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:48.038738 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262ca9-b6f9-43da-98b0-dee7dc69b868 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:48.039019 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262ca9-b6f9-43da-98b0-dee7dc69b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:48.039294 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60262ca9-b6f9-43da-98b0-dee7dc69b868 admin admin] PATH_INFO: `/v3/projects/d30e6c02e2054515bc5fd59980095a56/users/c95d0d21edd647efb08b5491688ffd86/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:48.054030 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262ca9-b6f9-43da-98b0-dee7dc69b868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30e6c02e2054515bc5fd59980095a56, user_id=c95d0d21edd647efb08b5491688ffd86, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:48.057265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60262ca9-b6f9-43da-98b0-dee7dc69b868 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:48.070990 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4416/8830] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 10:11:48 2022] PUT /identity/v3/projects/d30e6c02e2054515bc5fd59980095a56/users/c95d0d21edd647efb08b5491688ffd86/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:11:48.076021 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64304d2-da7c-47cd-881f-5999789b5c0c None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:48.076335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64304d2-da7c-47cd-881f-5999789b5c0c None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:48.076610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64304d2-da7c-47cd-881f-5999789b5c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:48.095018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a64304d2-da7c-47cd-881f-5999789b5c0c None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:11:48.096200 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a64304d2-da7c-47cd-881f-5999789b5c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:48.155246 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4415/8831] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:11:48.165444 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262ca9-b6f9-43da-98b0-dee7dc69b868 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:48.167641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-60262ca9-b6f9-43da-98b0-dee7dc69b868 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:48.223062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60262ca9-b6f9-43da-98b0-dee7dc69b868 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:48.226614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ebbd5-cf12-4d0a-9809-84df76ad0fee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:48.227200 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ebbd5-cf12-4d0a-9809-84df76ad0fee service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:48.227476 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ebbd5-cf12-4d0a-9809-84df76ad0fee service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:48.227745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ebbd5-cf12-4d0a-9809-84df76ad0fee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:48.237193 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ebbd5-cf12-4d0a-9809-84df76ad0fee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:48.238676 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ebbd5-cf12-4d0a-9809-84df76ad0fee service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:48.248731 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4417/8832] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:11:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 10:11:51.964832 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9690b-0ac8-4394-8a7c-3b1f659f1dfb None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:51.965420 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9690b-0ac8-4394-8a7c-3b1f659f1dfb None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:51.965835 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d9690b-0ac8-4394-8a7c-3b1f659f1dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:51.994061 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b7d9690b-0ac8-4394-8a7c-3b1f659f1dfb None None] MFA Rules not processed for user `c95d0d21edd647efb08b5491688ffd86`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:11:51.995258 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b7d9690b-0ac8-4394-8a7c-3b1f659f1dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:52.064032 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4416/8833] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:11:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:11:52.068540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ebbd5-cf12-4d0a-9809-84df76ad0fee service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:52.075239 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:52.079831 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ebbd5-cf12-4d0a-9809-84df76ad0fee service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:52.087034 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c333407-ea77-442b-a0b5-d4720ec31605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:52.088551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c333407-ea77-442b-a0b5-d4720ec31605 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:52.089597 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c333407-ea77-442b-a0b5-d4720ec31605 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:52.090867 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c333407-ea77-442b-a0b5-d4720ec31605 admin admin] PATH_INFO: `/v3/projects` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:52.091592 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c333407-ea77-442b-a0b5-d4720ec31605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:52.093944 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c333407-ea77-442b-a0b5-d4720ec31605 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:52.126552 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4418/8834] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 10:11:52 2022] POST /identity/v3/projects => generated 371 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 10:11:52.127785 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9690b-0ac8-4394-8a7c-3b1f659f1dfb None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:52.135169 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:52.139603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d9690b-0ac8-4394-8a7c-3b1f659f1dfb None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:52.224833 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e36e-4abd-4272-a289-03864f7b1bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:52.225475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e36e-4abd-4272-a289-03864f7b1bbe admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:52.225754 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e36e-4abd-4272-a289-03864f7b1bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:52.226028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4034e36e-4abd-4272-a289-03864f7b1bbe admin admin] PATH_INFO: `/v3/users` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:52.226651 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034e36e-4abd-4272-a289-03864f7b1bbe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:52.229130 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4034e36e-4abd-4272-a289-03864f7b1bbe admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:52.252558 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4417/8835] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 10:11:52 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 10:11:52.256480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c333407-ea77-442b-a0b5-d4720ec31605 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:52.267907 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c333407-ea77-442b-a0b5-d4720ec31605 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:52.272443 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed529af-b9d0-4334-8b52-c3c097b29276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:52.273035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed529af-b9d0-4334-8b52-c3c097b29276 admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:52.273356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed529af-b9d0-4334-8b52-c3c097b29276 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:52.273631 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed529af-b9d0-4334-8b52-c3c097b29276 admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:52.274253 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed529af-b9d0-4334-8b52-c3c097b29276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:52.276383 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed529af-b9d0-4334-8b52-c3c097b29276 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:52.287718 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4419/8836] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 24 10:11:52.292781 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e36e-4abd-4272-a289-03864f7b1bbe admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:52.303164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4034e36e-4abd-4272-a289-03864f7b1bbe admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:52.307957 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8222c-23d6-4336-9bc8-d82b0a97b5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:52.308695 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8222c-23d6-4336-9bc8-d82b0a97b5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:52.308976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8222c-23d6-4336-9bc8-d82b0a97b5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:52.309248 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb8222c-23d6-4336-9bc8-d82b0a97b5a9 admin admin] PATH_INFO: `/v3/projects/0c0c3e0b9e9246a38e2cbd4f313d6851/users/4a31227ef1554a7ab2c7924a423d92f3/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:52.324986 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8222c-23d6-4336-9bc8-d82b0a97b5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0c3e0b9e9246a38e2cbd4f313d6851, user_id=4a31227ef1554a7ab2c7924a423d92f3, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:52.327817 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb8222c-23d6-4336-9bc8-d82b0a97b5a9 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:52.360770 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4418/8837] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 10:11:52 2022] PUT /identity/v3/projects/0c0c3e0b9e9246a38e2cbd4f313d6851/users/4a31227ef1554a7ab2c7924a423d92f3/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:11:52.364843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed529af-b9d0-4334-8b52-c3c097b29276 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:52.374964 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed529af-b9d0-4334-8b52-c3c097b29276 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:52.443265 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162d447-e73f-4dd3-b19f-29f9960b8c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:52.444014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162d447-e73f-4dd3-b19f-29f9960b8c1d admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:52.444356 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162d447-e73f-4dd3-b19f-29f9960b8c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:52.444694 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162d447-e73f-4dd3-b19f-29f9960b8c1d admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:52.445447 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162d447-e73f-4dd3-b19f-29f9960b8c1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:52.447183 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162d447-e73f-4dd3-b19f-29f9960b8c1d admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:52.457710 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4420/8838] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:11:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:11:52.462852 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8222c-23d6-4336-9bc8-d82b0a97b5a9 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:52.473701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb8222c-23d6-4336-9bc8-d82b0a97b5a9 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:52.478522 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be34bd5-8ea6-4cd8-8e6a-48cf7bca2f24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:52.479183 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34bd5-8ea6-4cd8-8e6a-48cf7bca2f24 admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:52.479461 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34bd5-8ea6-4cd8-8e6a-48cf7bca2f24 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:52.479733 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be34bd5-8ea6-4cd8-8e6a-48cf7bca2f24 admin admin] PATH_INFO: `/v3/projects/0c0c3e0b9e9246a38e2cbd4f313d6851/users/4a31227ef1554a7ab2c7924a423d92f3/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:52.481806 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be34bd5-8ea6-4cd8-8e6a-48cf7bca2f24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c0c3e0b9e9246a38e2cbd4f313d6851, user_id=4a31227ef1554a7ab2c7924a423d92f3, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:52.484436 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be34bd5-8ea6-4cd8-8e6a-48cf7bca2f24 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:52.499397 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4419/8839] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 10:11:52 2022] PUT /identity/v3/projects/0c0c3e0b9e9246a38e2cbd4f313d6851/users/4a31227ef1554a7ab2c7924a423d92f3/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:11:57.041933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff0e8f-90fa-40a4-945a-876ec4d0f934 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:57.042461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff0e8f-90fa-40a4-945a-876ec4d0f934 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:57.042461 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ff0e8f-90fa-40a4-945a-876ec4d0f934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:57.074926 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-a2ff0e8f-90fa-40a4-945a-876ec4d0f934 None None] MFA Rules not processed for user `4a31227ef1554a7ab2c7924a423d92f3`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:11:57.076508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a2ff0e8f-90fa-40a4-945a-876ec4d0f934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:57.179864 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4421/8840] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:11:57 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:11:57.197229 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be34bd5-8ea6-4cd8-8e6a-48cf7bca2f24 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:57.199102 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4be34bd5-8ea6-4cd8-8e6a-48cf7bca2f24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:57.321431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be34bd5-8ea6-4cd8-8e6a-48cf7bca2f24 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:57.327087 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453f7e1-af58-4e61-8318-4931f059bbbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:57.327701 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453f7e1-af58-4e61-8318-4931f059bbbc service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:57.327982 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453f7e1-af58-4e61-8318-4931f059bbbc service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:57.328254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e453f7e1-af58-4e61-8318-4931f059bbbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:57.341131 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:11:57.388099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453f7e1-af58-4e61-8318-4931f059bbbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:57.389745 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e453f7e1-af58-4e61-8318-4931f059bbbc service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:57.399352 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4420/8841] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:11:57 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:11:58.732438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd47eb-b680-4f08-80ea-0990250a4085 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:58.732961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd47eb-b680-4f08-80ea-0990250a4085 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:58.732961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fd47eb-b680-4f08-80ea-0990250a4085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:58.752004 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-29fd47eb-b680-4f08-80ea-0990250a4085 None None] MFA Rules not processed for user `c95d0d21edd647efb08b5491688ffd86`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:11:58.753185 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-29fd47eb-b680-4f08-80ea-0990250a4085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:58.760481 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4422/8842] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:11:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:11:59.076944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453f7e1-af58-4e61-8318-4931f059bbbc service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:11:59.078371 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-e453f7e1-af58-4e61-8318-4931f059bbbc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:59.137191 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e453f7e1-af58-4e61-8318-4931f059bbbc service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:11:59.143582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d939f-ad17-466f-95d4-29aeba9e1bec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:11:59.144204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d939f-ad17-466f-95d4-29aeba9e1bec service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:11:59.144483 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d939f-ad17-466f-95d4-29aeba9e1bec service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:11:59.144756 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d939f-ad17-466f-95d4-29aeba9e1bec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:11:59.146529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f82d939f-ad17-466f-95d4-29aeba9e1bec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:11:59.156659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d939f-ad17-466f-95d4-29aeba9e1bec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:11:59.158121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d939f-ad17-466f-95d4-29aeba9e1bec service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:11:59.166861 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4421/8843] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:11:59 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:12:00.499633 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd47eb-b680-4f08-80ea-0990250a4085 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:12:00.501229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-29fd47eb-b680-4f08-80ea-0990250a4085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:12:00.534893 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:12:00.585096 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fd47eb-b680-4f08-80ea-0990250a4085 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:12:00.590868 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:12:00.591482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:12:00.591763 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:12:00.592036 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:12:00.593860 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:12:00.606142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:12:00.607746 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:12:00.618299 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4423/8844] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:12:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:12:09.163126 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=47 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:12:10.613845 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=22 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:12:11.372263 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d939f-ad17-466f-95d4-29aeba9e1bec service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:12:11.380747 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d939f-ad17-466f-95d4-29aeba9e1bec service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:12:11.384335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2032fd6-d4a7-4be8-8b3e-66e895257cca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:12:11.384923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2032fd6-d4a7-4be8-8b3e-66e895257cca service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:12:11.385439 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2032fd6-d4a7-4be8-8b3e-66e895257cca service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:12:11.385720 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2032fd6-d4a7-4be8-8b3e-66e895257cca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:12:11.394686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2032fd6-d4a7-4be8-8b3e-66e895257cca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:12:11.396098 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2032fd6-d4a7-4be8-8b3e-66e895257cca service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:12:11.405339 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4422/8845] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:12:11 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:12:11.462581 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:12:11.463934 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:12:11.500975 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d9ee55-25fd-471e-be67-a8080287d0a0 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:12:11.506756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86ba5ef-d686-46bc-b2d1-c21e28a2a6e2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:12:11.507365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ba5ef-d686-46bc-b2d1-c21e28a2a6e2 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:12:11.507665 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ba5ef-d686-46bc-b2d1-c21e28a2a6e2 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:12:11.508091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86ba5ef-d686-46bc-b2d1-c21e28a2a6e2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:12:11.509990 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-a86ba5ef-d686-46bc-b2d1-c21e28a2a6e2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:12:11.522811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ba5ef-d686-46bc-b2d1-c21e28a2a6e2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:12:11.524412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86ba5ef-d686-46bc-b2d1-c21e28a2a6e2 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:12:11.534697 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4424/8846] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:12:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:12:21.401226 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:12:21.530815 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=15 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:13:10.704079 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2032fd6-d4a7-4be8-8b3e-66e895257cca service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:13:10.715050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2032fd6-d4a7-4be8-8b3e-66e895257cca service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:13:10.720000 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:13:10.720581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:13:10.720858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:13:10.721129 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:13:10.722844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:13:10.734384 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:13:10.735935 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:13:10.746167 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4423/8847] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:13:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:13:20.741534 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:20.696887 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe0b63-1727-4243-988d-6fd9aa695486 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:20.697429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe0b63-1727-4243-988d-6fd9aa695486 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:20.697544 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbe0b63-1727-4243-988d-6fd9aa695486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:20.757014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-2bbe0b63-1727-4243-988d-6fd9aa695486 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:14:20.758269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-2bbe0b63-1727-4243-988d-6fd9aa695486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:20.836119 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4425/8848] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 10:14:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:14:20.884473 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:14:20.885911 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:20.981094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ec8e07-0894-4969-b896-550ccf91fcf9 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:14:20.986172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93eb50fe-0ffe-45db-aeac-24e1bbd9bbe7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:14:20.986771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb50fe-0ffe-45db-aeac-24e1bbd9bbe7 service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:20.987049 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb50fe-0ffe-45db-aeac-24e1bbd9bbe7 service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:20.987323 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93eb50fe-0ffe-45db-aeac-24e1bbd9bbe7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:20.996605 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb50fe-0ffe-45db-aeac-24e1bbd9bbe7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:14:20.998256 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93eb50fe-0ffe-45db-aeac-24e1bbd9bbe7 service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:14:21.007051 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4424/8849] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:14:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:14:22.134984 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe0b63-1727-4243-988d-6fd9aa695486 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:14:22.171375 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbe0b63-1727-4243-988d-6fd9aa695486 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:14:22.178480 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:14:22.179084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:22.179365 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:22.179639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:22.181634 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:22.195747 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:14:22.197696 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:14:22.224747 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4426/8850] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:14:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:14:31.003317 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=41 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:32.206623 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=57 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:32.757841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc79f2c-bc62-4d1e-a15c-54e3e5c59199 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:32.758423 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc79f2c-bc62-4d1e-a15c-54e3e5c59199 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:32.758984 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc79f2c-bc62-4d1e-a15c-54e3e5c59199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:32.809160 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5bc79f2c-bc62-4d1e-a15c-54e3e5c59199 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:14:32.810431 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5bc79f2c-bc62-4d1e-a15c-54e3e5c59199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:32.820386 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4425/8851] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 10:14:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 24 10:14:32.832055 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:14:32.833568 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:32.914070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8237e8-e1d5-4421-8940-9ccee3acd3ff service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:14:32.917678 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d01de-9980-4b98-b024-3b506949b58c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a1cba9ba74946de8c58da91e59ddcfc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:14:32.918271 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d01de-9980-4b98-b024-3b506949b58c service glance] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:32.918551 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d01de-9980-4b98-b024-3b506949b58c service glance] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:32.918821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933d01de-9980-4b98-b024-3b506949b58c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:32.929211 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d01de-9980-4b98-b024-3b506949b58c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:14:32.930659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933d01de-9980-4b98-b024-3b506949b58c service glance] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:14:32.941219 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4427/8852] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:14:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:14:33.006503 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc79f2c-bc62-4d1e-a15c-54e3e5c59199 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:14:33.024813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc79f2c-bc62-4d1e-a15c-54e3e5c59199 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:14:33.028625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a56fa-6122-454d-ad2f-c4ef56717190 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:14:33.029230 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a56fa-6122-454d-ad2f-c4ef56717190 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:33.029544 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a56fa-6122-454d-ad2f-c4ef56717190 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:33.029824 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5a56fa-6122-454d-ad2f-c4ef56717190 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:33.031554 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9a5a56fa-6122-454d-ad2f-c4ef56717190 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:33.057103 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a56fa-6122-454d-ad2f-c4ef56717190 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:14:33.058588 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5a56fa-6122-454d-ad2f-c4ef56717190 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:14:33.066694 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4426/8853] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:14:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:14:33.144659 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d01de-9980-4b98-b024-3b506949b58c service glance] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:14:33.154786 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933d01de-9980-4b98-b024-3b506949b58c service glance] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:14:33.158401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8460d-cb35-44e3-8fb4-68942d5aadd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:14:33.158992 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8460d-cb35-44e3-8fb4-68942d5aadd9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:33.159272 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8460d-cb35-44e3-8fb4-68942d5aadd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:33.159543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8460d-cb35-44e3-8fb4-68942d5aadd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:33.161240 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-8ad8460d-cb35-44e3-8fb4-68942d5aadd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:33.176054 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8460d-cb35-44e3-8fb4-68942d5aadd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:14:33.177501 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8460d-cb35-44e3-8fb4-68942d5aadd9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:14:33.189763 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4428/8854] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:14:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:14:33.250345 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a56fa-6122-454d-ad2f-c4ef56717190 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:14:33.262844 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5a56fa-6122-454d-ad2f-c4ef56717190 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:14:33.267861 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa42c0cc-c070-4cbf-a986-95e73bf1c663 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:14:33.268456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c0cc-c070-4cbf-a986-95e73bf1c663 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:33.268737 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c0cc-c070-4cbf-a986-95e73bf1c663 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:33.269014 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa42c0cc-c070-4cbf-a986-95e73bf1c663 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:33.270768 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-fa42c0cc-c070-4cbf-a986-95e73bf1c663 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:33.282572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c0cc-c070-4cbf-a986-95e73bf1c663 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:14:33.284143 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa42c0cc-c070-4cbf-a986-95e73bf1c663 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:14:33.294223 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4427/8855] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:14:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:14:34.982360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8460d-cb35-44e3-8fb4-68942d5aadd9 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:14:34.995449 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8460d-cb35-44e3-8fb4-68942d5aadd9 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:14:35.002452 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808f915-3f5d-481a-adcb-93347add32bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:14:35.003125 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808f915-3f5d-481a-adcb-93347add32bc service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:35.003475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808f915-3f5d-481a-adcb-93347add32bc service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:35.003841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808f915-3f5d-481a-adcb-93347add32bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:35.006373 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-c808f915-3f5d-481a-adcb-93347add32bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:35.018877 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808f915-3f5d-481a-adcb-93347add32bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:14:35.020248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808f915-3f5d-481a-adcb-93347add32bc service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:14:35.030930 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4429/8856] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:14:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:14:35.738135 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333b66-882b-4be6-af95-cea941b587ad None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:35.738650 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333b66-882b-4be6-af95-cea941b587ad None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:35.738755 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4333b66-882b-4be6-af95-cea941b587ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:35.759907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-a4333b66-882b-4be6-af95-cea941b587ad None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:14:35.761432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a4333b66-882b-4be6-af95-cea941b587ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:35.768521 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4428/8857] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 10:14:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:14:35.780804 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808f915-3f5d-481a-adcb-93347add32bc service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:14:35.792116 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808f915-3f5d-481a-adcb-93347add32bc service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:14:35.797188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b164dc-df05-4829-a449-952d215406f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:14:35.797811 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b164dc-df05-4829-a449-952d215406f9 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:35.798084 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b164dc-df05-4829-a449-952d215406f9 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:35.798353 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b164dc-df05-4829-a449-952d215406f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:35.807556 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b164dc-df05-4829-a449-952d215406f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:14:35.809155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b164dc-df05-4829-a449-952d215406f9 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:14:35.818151 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4430/8858] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:14:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:14:45.752940 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=37 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:45.814540 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=53 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:14:50.865094 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25426129-a31b-4611-94ef-450e7d48092f None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:50.865582 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25426129-a31b-4611-94ef-450e7d48092f None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:50.865697 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25426129-a31b-4611-94ef-450e7d48092f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:50.884758 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-25426129-a31b-4611-94ef-450e7d48092f None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:14:50.885961 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-25426129-a31b-4611-94ef-450e7d48092f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:14:50.893148 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4429/8859] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 10:14:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:14:50.906040 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b164dc-df05-4829-a449-952d215406f9 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:14:50.916807 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b164dc-df05-4829-a449-952d215406f9 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:14:50.922717 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acde88-5b8b-4428-a735-a764489f9da1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:14:50.923502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acde88-5b8b-4428-a735-a764489f9da1 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:14:50.923824 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acde88-5b8b-4428-a735-a764489f9da1 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:14:50.924147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6acde88-5b8b-4428-a735-a764489f9da1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:14:50.933196 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acde88-5b8b-4428-a735-a764489f9da1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:14:50.934791 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6acde88-5b8b-4428-a735-a764489f9da1 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:14:50.942775 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4431/8860] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:14:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:15:00.879045 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=3 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:15:00.939390 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:06.645018 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25426129-a31b-4611-94ef-450e7d48092f None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:16:06.660836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25426129-a31b-4611-94ef-450e7d48092f None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:16:06.668328 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b31d0d-ed58-44b6-922b-76dc4bc07a8a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:16:06.668946 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b31d0d-ed58-44b6-922b-76dc4bc07a8a service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:16:06.669221 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b31d0d-ed58-44b6-922b-76dc4bc07a8a service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:16:06.669523 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b31d0d-ed58-44b6-922b-76dc4bc07a8a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:16:06.671415 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-f9b31d0d-ed58-44b6-922b-76dc4bc07a8a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:16:06.700410 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b31d0d-ed58-44b6-922b-76dc4bc07a8a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:16:06.702053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b31d0d-ed58-44b6-922b-76dc4bc07a8a service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:16:06.713031 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4430/8861] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:16:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:16:06.796331 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acde88-5b8b-4428-a735-a764489f9da1 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:16:06.807360 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6acde88-5b8b-4428-a735-a764489f9da1 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:16:06.811349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cbc52-b25e-40de-984f-69f9aa02cc28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:16:06.812190 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cbc52-b25e-40de-984f-69f9aa02cc28 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:16:06.812641 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cbc52-b25e-40de-984f-69f9aa02cc28 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:16:06.813145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5cbc52-b25e-40de-984f-69f9aa02cc28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:16:06.815387 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-0a5cbc52-b25e-40de-984f-69f9aa02cc28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:16:06.826740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cbc52-b25e-40de-984f-69f9aa02cc28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:16:06.829462 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5cbc52-b25e-40de-984f-69f9aa02cc28 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:16:06.839722 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4432/8862] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:16:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:16:06.852706 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b31d0d-ed58-44b6-922b-76dc4bc07a8a service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:16:06.863312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b31d0d-ed58-44b6-922b-76dc4bc07a8a service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:16:06.867078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b36fb-61ec-4c53-b5b1-1f64bebedeb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:16:06.867914 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b36fb-61ec-4c53-b5b1-1f64bebedeb0 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:16:06.868050 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b36fb-61ec-4c53-b5b1-1f64bebedeb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:16:06.868373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b36fb-61ec-4c53-b5b1-1f64bebedeb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:16:06.870316 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-bd2b36fb-61ec-4c53-b5b1-1f64bebedeb0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:16:06.888083 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b36fb-61ec-4c53-b5b1-1f64bebedeb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:16:06.889550 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b36fb-61ec-4c53-b5b1-1f64bebedeb0 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:16:06.901156 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4431/8863] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:16:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:16:08.106123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cbc52-b25e-40de-984f-69f9aa02cc28 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:16:08.115414 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5cbc52-b25e-40de-984f-69f9aa02cc28 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:16:08.119145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b194da-01ec-4dbe-ac75-3cc6214706e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:16:08.119680 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b194da-01ec-4dbe-ac75-3cc6214706e4 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:16:08.119960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b194da-01ec-4dbe-ac75-3cc6214706e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:16:08.120233 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b194da-01ec-4dbe-ac75-3cc6214706e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:16:08.122587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-69b194da-01ec-4dbe-ac75-3cc6214706e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:16:08.136687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b194da-01ec-4dbe-ac75-3cc6214706e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:16:08.138143 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b194da-01ec-4dbe-ac75-3cc6214706e4 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:16:08.150221 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4433/8864] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:16:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:16:11.587212 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db01f44-65de-4182-ae3f-6769cc0415ee None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:16:11.587728 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db01f44-65de-4182-ae3f-6769cc0415ee None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:16:11.587845 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db01f44-65de-4182-ae3f-6769cc0415ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:16:11.607078 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-5db01f44-65de-4182-ae3f-6769cc0415ee None None] MFA Rules not processed for user `c95d0d21edd647efb08b5491688ffd86`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:16:11.608262 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5db01f44-65de-4182-ae3f-6769cc0415ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:16:11.615696 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4432/8865] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:16:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:16:18.144547 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=12 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:21.601822 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=20 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:16:29.339032 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b194da-01ec-4dbe-ac75-3cc6214706e4 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:16:29.348532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b194da-01ec-4dbe-ac75-3cc6214706e4 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:16:29.352237 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23b6d5-9f70-4195-b1d3-3c5ae9c1e042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:16:29.352843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23b6d5-9f70-4195-b1d3-3c5ae9c1e042 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:16:29.353147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23b6d5-9f70-4195-b1d3-3c5ae9c1e042 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:16:29.353455 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce23b6d5-9f70-4195-b1d3-3c5ae9c1e042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:16:29.355324 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-ce23b6d5-9f70-4195-b1d3-3c5ae9c1e042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:16:29.366620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23b6d5-9f70-4195-b1d3-3c5ae9c1e042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:16:29.368154 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce23b6d5-9f70-4195-b1d3-3c5ae9c1e042 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:16:29.377684 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4434/8866] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:16:29 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:16:39.373542 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:17:14.517167 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db01f44-65de-4182-ae3f-6769cc0415ee None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:17:14.528734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db01f44-65de-4182-ae3f-6769cc0415ee None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:17:14.534125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192849b-c54b-4206-a6ad-461b6bd822be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:17:14.534722 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192849b-c54b-4206-a6ad-461b6bd822be service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:17:14.535001 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192849b-c54b-4206-a6ad-461b6bd822be service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:17:14.535278 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1192849b-c54b-4206-a6ad-461b6bd822be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:17:14.543983 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192849b-c54b-4206-a6ad-461b6bd822be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:17:14.545606 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1192849b-c54b-4206-a6ad-461b6bd822be service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:17:14.556474 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4433/8867] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:17:14 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:17:24.551966 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:18:17.684323 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23b6d5-9f70-4195-b1d3-3c5ae9c1e042 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:18:17.696239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce23b6d5-9f70-4195-b1d3-3c5ae9c1e042 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:18:17.701264 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cc5eaf-47e2-42d1-a02b-486b32662a29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:18:17.701924 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc5eaf-47e2-42d1-a02b-486b32662a29 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:18:17.702201 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc5eaf-47e2-42d1-a02b-486b32662a29 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:18:17.702500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cc5eaf-47e2-42d1-a02b-486b32662a29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:18:17.711547 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc5eaf-47e2-42d1-a02b-486b32662a29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:18:17.713145 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cc5eaf-47e2-42d1-a02b-486b32662a29 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:18:17.723506 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4435/8868] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:18:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:18:27.718702 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=6 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:18:41.946510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192849b-c54b-4206-a6ad-461b6bd822be service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:18:41.958704 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1192849b-c54b-4206-a6ad-461b6bd822be service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:18:41.964053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b2d2f-b571-4a36-8ee2-3e62cddb138e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:18:41.964641 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b2d2f-b571-4a36-8ee2-3e62cddb138e service nova] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:18:41.964920 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b2d2f-b571-4a36-8ee2-3e62cddb138e service nova] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:18:41.965190 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933b2d2f-b571-4a36-8ee2-3e62cddb138e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:18:41.972751 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b2d2f-b571-4a36-8ee2-3e62cddb138e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:18:41.974894 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933b2d2f-b571-4a36-8ee2-3e62cddb138e service nova] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:18:41.983600 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4434/8869] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:18:41 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:18:51.979605 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:18:56.723364 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e67d3-cca1-41be-aa69-bce467686182 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:18:56.723843 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e67d3-cca1-41be-aa69-bce467686182 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:18:56.723948 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e67d3-cca1-41be-aa69-bce467686182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:18:56.744935 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-aa0e67d3-cca1-41be-aa69-bce467686182 None None] MFA Rules not processed for user `b31aac6142684a039f9de2051fe42989`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:18:56.746178 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-aa0e67d3-cca1-41be-aa69-bce467686182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:18:56.755922 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4436/8870] 10.222.0.25 () {58 vars in 1018 bytes} [Mon Oct 24 10:18:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:18:56.765841 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b2d2f-b571-4a36-8ee2-3e62cddb138e service nova] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:18:56.776502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933b2d2f-b571-4a36-8ee2-3e62cddb138e service nova] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:18:56.780231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d0c07-5a89-49bf-8684-0ca898f1580a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:18:56.780830 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d0c07-5a89-49bf-8684-0ca898f1580a service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:18:56.781105 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d0c07-5a89-49bf-8684-0ca898f1580a service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:18:56.781421 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84d0c07-5a89-49bf-8684-0ca898f1580a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:18:56.792686 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d0c07-5a89-49bf-8684-0ca898f1580a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:18:56.794164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a84d0c07-5a89-49bf-8684-0ca898f1580a service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:18:56.806271 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4435/8871] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:18:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:19:06.739809 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:19:06.800711 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:41.988563 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e67d3-cca1-41be-aa69-bce467686182 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:41.998685 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e67d3-cca1-41be-aa69-bce467686182 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:42.002227 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db47fc-5e12-46cd-89b1-6261361ed991 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:42.002874 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db47fc-5e12-46cd-89b1-6261361ed991 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:42.003341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db47fc-5e12-46cd-89b1-6261361ed991 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:42.003614 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91db47fc-5e12-46cd-89b1-6261361ed991 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:42.069863 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db47fc-5e12-46cd-89b1-6261361ed991 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:42.071419 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91db47fc-5e12-46cd-89b1-6261361ed991 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:42.082138 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4437/8872] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:20:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:20:45.368997 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d0c07-5a89-49bf-8684-0ca898f1580a service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:45.382322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84d0c07-5a89-49bf-8684-0ca898f1580a service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:45.387560 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec047159-ff50-48fd-856b-979ffde74088 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:45.388228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec047159-ff50-48fd-856b-979ffde74088 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:45.389028 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec047159-ff50-48fd-856b-979ffde74088 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:45.389368 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec047159-ff50-48fd-856b-979ffde74088 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:45.391099 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-ec047159-ff50-48fd-856b-979ffde74088 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:45.402748 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec047159-ff50-48fd-856b-979ffde74088 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:45.404385 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec047159-ff50-48fd-856b-979ffde74088 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:45.414946 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4436/8873] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:20:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:20:48.449538 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db47fc-5e12-46cd-89b1-6261361ed991 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:48.460620 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91db47fc-5e12-46cd-89b1-6261361ed991 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:48.465505 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:48.466142 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:48.466959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:48.467230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] PATH_INFO: `/v3/users/c95d0d21edd647efb08b5491688ffd86` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:48.468437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c95d0d21edd647efb08b5491688ffd86)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:48.470412 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:48.519878 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c95d0d21edd647efb08b5491688ffd86'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.533117 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c95d0d21edd647efb08b5491688ffd86'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.534011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c95d0d21edd647efb08b5491688ffd86'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.542663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c95d0d21edd647efb08b5491688ffd86'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.551003 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c95d0d21edd647efb08b5491688ffd86'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.557451 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4438/8874] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 10:20:48 2022] DELETE /identity/v3/users/c95d0d21edd647efb08b5491688ffd86 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:20:48.730603 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec047159-ff50-48fd-856b-979ffde74088 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:48.746826 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec047159-ff50-48fd-856b-979ffde74088 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:48.809681 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:48.810304 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:48.810581 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:48.810859 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] PATH_INFO: `/v3/projects/d30e6c02e2054515bc5fd59980095a56` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:48.811952 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30e6c02e2054515bc5fd59980095a56)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:48.813887 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:48.860123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30e6c02e2054515bc5fd59980095a56', 'request_id': 'req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.866649 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30e6c02e2054515bc5fd59980095a56', 'request_id': 'req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.872767 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30e6c02e2054515bc5fd59980095a56', 'request_id': 'req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.883128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] The token cache is being invalidate because project d30e6c02e2054515bc5fd59980095a56 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 10:20:48.883413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.884035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:48.885508 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4437/8875] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 10:20:48 2022] DELETE /identity/v3/projects/d30e6c02e2054515bc5fd59980095a56 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:20:48.890043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:48.891410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:48.904648 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300b5084-9f89-4fda-ae1e-318aa04f8cf6 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:48.959945 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:48.960586 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:48.960866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:48.961133 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] PATH_INFO: `/v3/users/4a31227ef1554a7ab2c7924a423d92f3` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:48.962290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a31227ef1554a7ab2c7924a423d92f3)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:48.964188 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:48.970090 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:49.011014 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a31227ef1554a7ab2c7924a423d92f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.023177 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a31227ef1554a7ab2c7924a423d92f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.023841 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a31227ef1554a7ab2c7924a423d92f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.031917 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a31227ef1554a7ab2c7924a423d92f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.038954 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-75c70871-b2d5-4f3b-9d9f-bf95a49adf23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a31227ef1554a7ab2c7924a423d92f3'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.045328 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4439/8876] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 10:20:48 2022] DELETE /identity/v3/users/4a31227ef1554a7ab2c7924a423d92f3 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:20:49.212676 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:49.214128 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:49.229400 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d955f31-f88b-4ac8-b861-29fe45c3f6a4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:49.285405 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:49.286039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.286325 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.286625 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] PATH_INFO: `/v3/projects/0c0c3e0b9e9246a38e2cbd4f313d6851` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.287738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c0c3e0b9e9246a38e2cbd4f313d6851)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:49.289955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:49.310793 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:49.339440 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c0c3e0b9e9246a38e2cbd4f313d6851', 'request_id': 'req-cae249cf-a7d7-4be7-8b08-97c741180662'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.346529 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c0c3e0b9e9246a38e2cbd4f313d6851', 'request_id': 'req-cae249cf-a7d7-4be7-8b08-97c741180662'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.352899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c0c3e0b9e9246a38e2cbd4f313d6851', 'request_id': 'req-cae249cf-a7d7-4be7-8b08-97c741180662'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.363506 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] The token cache is being invalidate because project 0c0c3e0b9e9246a38e2cbd4f313d6851 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 10:20:49.363791 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.364419 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-cae249cf-a7d7-4be7-8b08-97c741180662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:20:49.365967 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4438/8877] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 10:20:49 2022] DELETE /identity/v3/projects/0c0c3e0b9e9246a38e2cbd4f313d6851 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:20:49.370996 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc9c3-08d3-45f7-b494-2b58d5d476a5 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.371285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc9c3-08d3-45f7-b494-2b58d5d476a5 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.371566 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2cc9c3-08d3-45f7-b494-2b58d5d476a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.392123 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-4a2cc9c3-08d3-45f7-b494-2b58d5d476a5 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:20:49.393349 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4a2cc9c3-08d3-45f7-b494-2b58d5d476a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:49.451463 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4440/8878] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:20:49.459344 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f97b1-b9d7-447d-89a8-ad431845a7de None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.459621 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f97b1-b9d7-447d-89a8-ad431845a7de None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.459925 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36f97b1-b9d7-447d-89a8-ad431845a7de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.479322 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-b36f97b1-b9d7-447d-89a8-ad431845a7de None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:20:49.480510 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b36f97b1-b9d7-447d-89a8-ad431845a7de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:49.488284 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4439/8879] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:20:49.492394 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cc9c3-08d3-45f7-b494-2b58d5d476a5 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:49.503757 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2cc9c3-08d3-45f7-b494-2b58d5d476a5 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:49.508427 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba77abf-2ea7-45b6-a5aa-43c69a512dad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:49.509018 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba77abf-2ea7-45b6-a5aa-43c69a512dad admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.509321 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba77abf-2ea7-45b6-a5aa-43c69a512dad admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.509608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba77abf-2ea7-45b6-a5aa-43c69a512dad admin admin] PATH_INFO: `/v3/domains` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.510248 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba77abf-2ea7-45b6-a5aa-43c69a512dad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88311) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 24 10:20:49.510554 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba77abf-2ea7-45b6-a5aa-43c69a512dad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:49.512137 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba77abf-2ea7-45b6-a5aa-43c69a512dad admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:49.524076 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4441/8880] 10.222.0.25 () {58 vars in 1153 bytes} [Mon Oct 24 10:20:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 24 10:20:49.528144 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f97b1-b9d7-447d-89a8-ad431845a7de None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:49.537412 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36f97b1-b9d7-447d-89a8-ad431845a7de None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:49.542261 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8550d-3eb2-45bd-8494-dad8e7edfe94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:49.542843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8550d-3eb2-45bd-8494-dad8e7edfe94 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.543120 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8550d-3eb2-45bd-8494-dad8e7edfe94 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.543392 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae8550d-3eb2-45bd-8494-dad8e7edfe94 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.544005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8550d-3eb2-45bd-8494-dad8e7edfe94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:49.546466 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae8550d-3eb2-45bd-8494-dad8e7edfe94 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:49.573193 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4440/8881] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 10:20:49 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 10:20:49.577410 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba77abf-2ea7-45b6-a5aa-43c69a512dad admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:49.587494 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba77abf-2ea7-45b6-a5aa-43c69a512dad admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:49.644617 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740516-38aa-4ee0-9b9f-813ac6146276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:49.645203 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740516-38aa-4ee0-9b9f-813ac6146276 admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.645508 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740516-38aa-4ee0-9b9f-813ac6146276 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.646010 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a740516-38aa-4ee0-9b9f-813ac6146276 admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.646388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a740516-38aa-4ee0-9b9f-813ac6146276 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:49.648287 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a740516-38aa-4ee0-9b9f-813ac6146276 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:49.669011 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4442/8882] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 10:20:49 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 24 10:20:49.673652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8550d-3eb2-45bd-8494-dad8e7edfe94 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:49.683927 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae8550d-3eb2-45bd-8494-dad8e7edfe94 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:49.727428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ca57-ef39-4477-9734-c1ff0c898931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:49.727428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ca57-ef39-4477-9734-c1ff0c898931 admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.727428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ca57-ef39-4477-9734-c1ff0c898931 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.727428 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a26ca57-ef39-4477-9734-c1ff0c898931 admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.728799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ca57-ef39-4477-9734-c1ff0c898931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:49.728799 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a26ca57-ef39-4477-9734-c1ff0c898931 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:49.728799 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4441/8883] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:20:49.729864 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740516-38aa-4ee0-9b9f-813ac6146276 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:49.729864 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:49.730600 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a740516-38aa-4ee0-9b9f-813ac6146276 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:49.737011 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73989472-3417-4a65-aa41-1fa6942fc3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:49.737650 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73989472-3417-4a65-aa41-1fa6942fc3db admin admin] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.737960 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73989472-3417-4a65-aa41-1fa6942fc3db admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.738230 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73989472-3417-4a65-aa41-1fa6942fc3db admin admin] PATH_INFO: `/v3/roles` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.738862 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73989472-3417-4a65-aa41-1fa6942fc3db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:49.740453 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73989472-3417-4a65-aa41-1fa6942fc3db admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:49.751711 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4443/8884] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:20:49 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:20:49.755955 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ca57-ef39-4477-9734-c1ff0c898931 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:49.766110 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a26ca57-ef39-4477-9734-c1ff0c898931 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:49.770711 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568e198-0fef-4370-8a6a-16b7b0c1196f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:49.771351 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568e198-0fef-4370-8a6a-16b7b0c1196f admin admin] REQUEST_METHOD: `PUT` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.771632 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568e198-0fef-4370-8a6a-16b7b0c1196f admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.771907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a568e198-0fef-4370-8a6a-16b7b0c1196f admin admin] PATH_INFO: `/v3/projects/a2cf6a6ff48d4f66a4ae9af2f2d93eda/users/2b49aefb7bfd4dffb2a4bf39f88c1177/roles/62bc91fd2a7048c3ad90e2802bdc487f` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.786396 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568e198-0fef-4370-8a6a-16b7b0c1196f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2cf6a6ff48d4f66a4ae9af2f2d93eda, user_id=2b49aefb7bfd4dffb2a4bf39f88c1177, role_id=62bc91fd2a7048c3ad90e2802bdc487f)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:49.788969 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a568e198-0fef-4370-8a6a-16b7b0c1196f admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:49.802198 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4442/8885] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 10:20:49 2022] PUT /identity/v3/projects/a2cf6a6ff48d4f66a4ae9af2f2d93eda/users/2b49aefb7bfd4dffb2a4bf39f88c1177/roles/62bc91fd2a7048c3ad90e2802bdc487f => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:20:49.807299 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039cb82-1e2c-41a9-a518-f074c7001989 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.807607 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039cb82-1e2c-41a9-a518-f074c7001989 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.807886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6039cb82-1e2c-41a9-a518-f074c7001989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.827152 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-6039cb82-1e2c-41a9-a518-f074c7001989 None None] MFA Rules not processed for user `382bba280be9494c8775eed19488896e`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:20:49.828344 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6039cb82-1e2c-41a9-a518-f074c7001989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:49.887045 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4444/8886] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:20:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:20:49.896800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568e198-0fef-4370-8a6a-16b7b0c1196f admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:49.898574 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a568e198-0fef-4370-8a6a-16b7b0c1196f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:49.955284 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a568e198-0fef-4370-8a6a-16b7b0c1196f admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:49.958858 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4f6b9-753a-4e10-9125-fac43c6a69a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:49.959456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4f6b9-753a-4e10-9125-fac43c6a69a7 service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:49.959739 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4f6b9-753a-4e10-9125-fac43c6a69a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:49.960019 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e4f6b9-753a-4e10-9125-fac43c6a69a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:49.969707 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4f6b9-753a-4e10-9125-fac43c6a69a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:49.971162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e4f6b9-753a-4e10-9125-fac43c6a69a7 service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:49.980804 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4443/8887] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:20:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:20:53.911842 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b269d1-4d10-49d1-a1e9-cbedb975e943 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:53.912315 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b269d1-4d10-49d1-a1e9-cbedb975e943 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:53.912393 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b269d1-4d10-49d1-a1e9-cbedb975e943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:53.941821 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-44b269d1-4d10-49d1-a1e9-cbedb975e943 None None] MFA Rules not processed for user `2b49aefb7bfd4dffb2a4bf39f88c1177`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:20:53.942800 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-44b269d1-4d10-49d1-a1e9-cbedb975e943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:54.008831 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4445/8888] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:20:53 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:20:54.013774 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4f6b9-753a-4e10-9125-fac43c6a69a7 service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:54.023967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e4f6b9-753a-4e10-9125-fac43c6a69a7 service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:54.031732 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba1581-0909-451c-9b2d-dd3bab886bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:54.032480 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba1581-0909-451c-9b2d-dd3bab886bd4 admin admin] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:54.032771 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba1581-0909-451c-9b2d-dd3bab886bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:54.033053 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ba1581-0909-451c-9b2d-dd3bab886bd4 admin admin] PATH_INFO: `/v3/projects` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:54.033738 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba1581-0909-451c-9b2d-dd3bab886bd4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:54.035836 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ba1581-0909-451c-9b2d-dd3bab886bd4 admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:54.076402 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4444/8889] 10.222.0.25 () {60 vars in 1153 bytes} [Mon Oct 24 10:20:54 2022] POST /identity/v3/projects => generated 375 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 10:20:54.080792 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b269d1-4d10-49d1-a1e9-cbedb975e943 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:54.093548 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b269d1-4d10-49d1-a1e9-cbedb975e943 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:54.161500 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39278a9-bcf3-4b4f-9f94-56ba4fa85f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:54.162144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39278a9-bcf3-4b4f-9f94-56ba4fa85f0b admin admin] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:54.162420 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39278a9-bcf3-4b4f-9f94-56ba4fa85f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:54.162708 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39278a9-bcf3-4b4f-9f94-56ba4fa85f0b admin admin] PATH_INFO: `/v3/users` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:54.163590 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39278a9-bcf3-4b4f-9f94-56ba4fa85f0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:54.165550 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39278a9-bcf3-4b4f-9f94-56ba4fa85f0b admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:54.191971 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4446/8890] 10.222.0.25 () {60 vars in 1144 bytes} [Mon Oct 24 10:20:54 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 24 10:20:54.195962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba1581-0909-451c-9b2d-dd3bab886bd4 admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:54.207204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ba1581-0909-451c-9b2d-dd3bab886bd4 admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:54.213162 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00f0e7-298f-4f08-a8b3-ee12e603a02a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:54.214589 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00f0e7-298f-4f08-a8b3-ee12e603a02a admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:54.215057 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00f0e7-298f-4f08-a8b3-ee12e603a02a admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:54.215334 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00f0e7-298f-4f08-a8b3-ee12e603a02a admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:54.215981 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00f0e7-298f-4f08-a8b3-ee12e603a02a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:54.219312 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00f0e7-298f-4f08-a8b3-ee12e603a02a admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:54.232853 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4445/8891] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:20:54.237504 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39278a9-bcf3-4b4f-9f94-56ba4fa85f0b admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:54.248407 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39278a9-bcf3-4b4f-9f94-56ba4fa85f0b admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:54.253128 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac04e1-ea40-4eef-9ee8-bf1388ad64c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:54.253816 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac04e1-ea40-4eef-9ee8-bf1388ad64c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:54.254104 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac04e1-ea40-4eef-9ee8-bf1388ad64c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:54.254381 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac04e1-ea40-4eef-9ee8-bf1388ad64c2 admin admin] PATH_INFO: `/v3/projects/d2fb0fc7d83a458784c2caed88679fcc/users/64741b6860df4056b78f9afe6fd32558/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:54.268763 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:54.293212 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac04e1-ea40-4eef-9ee8-bf1388ad64c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fb0fc7d83a458784c2caed88679fcc, user_id=64741b6860df4056b78f9afe6fd32558, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:54.296341 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac04e1-ea40-4eef-9ee8-bf1388ad64c2 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:54.311682 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4447/8892] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 10:20:54 2022] PUT /identity/v3/projects/d2fb0fc7d83a458784c2caed88679fcc/users/64741b6860df4056b78f9afe6fd32558/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 10:20:54.315809 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00f0e7-298f-4f08-a8b3-ee12e603a02a admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:54.331931 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00f0e7-298f-4f08-a8b3-ee12e603a02a admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:54.342735 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:20:54.394622 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b27268-33cb-46fc-ae23-1c888060423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:54.395042 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27268-33cb-46fc-ae23-1c888060423c admin admin] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:54.395317 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27268-33cb-46fc-ae23-1c888060423c admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:54.395590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b27268-33cb-46fc-ae23-1c888060423c admin admin] PATH_INFO: `/v3/roles` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:54.396222 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b27268-33cb-46fc-ae23-1c888060423c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:54.397851 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b27268-33cb-46fc-ae23-1c888060423c admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:54.408228 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4446/8893] 10.222.0.25 () {58 vars in 1122 bytes} [Mon Oct 24 10:20:54 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 24 10:20:54.412467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac04e1-ea40-4eef-9ee8-bf1388ad64c2 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:54.423531 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac04e1-ea40-4eef-9ee8-bf1388ad64c2 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:54.428815 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbe883-eb3c-432a-8eb6-0c07545d4215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:54.429532 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbe883-eb3c-432a-8eb6-0c07545d4215 admin admin] REQUEST_METHOD: `PUT` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:54.429812 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbe883-eb3c-432a-8eb6-0c07545d4215 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:54.430091 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5afbe883-eb3c-432a-8eb6-0c07545d4215 admin admin] PATH_INFO: `/v3/projects/d2fb0fc7d83a458784c2caed88679fcc/users/64741b6860df4056b78f9afe6fd32558/roles/d266f03406d94df8bb9cad19b577978f` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:54.432043 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbe883-eb3c-432a-8eb6-0c07545d4215 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2fb0fc7d83a458784c2caed88679fcc, user_id=64741b6860df4056b78f9afe6fd32558, role_id=d266f03406d94df8bb9cad19b577978f)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:54.434740 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5afbe883-eb3c-432a-8eb6-0c07545d4215 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:54.446839 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4448/8894] 10.222.0.25 () {60 vars in 1483 bytes} [Mon Oct 24 10:20:54 2022] PUT /identity/v3/projects/d2fb0fc7d83a458784c2caed88679fcc/users/64741b6860df4056b78f9afe6fd32558/roles/d266f03406d94df8bb9cad19b577978f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 24 10:20:59.113764 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4dcd-a69e-410b-aca5-5499850a5693 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:59.114572 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4dcd-a69e-410b-aca5-5499850a5693 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:59.115037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100e4dcd-a69e-410b-aca5-5499850a5693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:59.145024 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-100e4dcd-a69e-410b-aca5-5499850a5693 None None] MFA Rules not processed for user `64741b6860df4056b78f9afe6fd32558`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:20:59.146291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-100e4dcd-a69e-410b-aca5-5499850a5693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:59.233503 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4447/8895] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:20:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:20:59.253959 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbe883-eb3c-432a-8eb6-0c07545d4215 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:20:59.256771 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5afbe883-eb3c-432a-8eb6-0c07545d4215 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:20:59.338845 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5afbe883-eb3c-432a-8eb6-0c07545d4215 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:20:59.345801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527e3f6-cbf2-485d-995c-04781b985ba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:20:59.346437 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527e3f6-cbf2-485d-995c-04781b985ba6 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:20:59.346778 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527e3f6-cbf2-485d-995c-04781b985ba6 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:20:59.347070 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527e3f6-cbf2-485d-995c-04781b985ba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:20:59.408382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527e3f6-cbf2-485d-995c-04781b985ba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:20:59.410026 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4527e3f6-cbf2-485d-995c-04781b985ba6 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:20:59.421023 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4449/8896] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:20:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:21:00.398940 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ba513-8c73-4c87-b2ae-e895eb9c42da None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:21:00.399373 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ba513-8c73-4c87-b2ae-e895eb9c42da None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:21:00.399512 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2ba513-8c73-4c87-b2ae-e895eb9c42da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:21:00.432599 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-cc2ba513-8c73-4c87-b2ae-e895eb9c42da None None] MFA Rules not processed for user `2b49aefb7bfd4dffb2a4bf39f88c1177`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:21:00.433898 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc2ba513-8c73-4c87-b2ae-e895eb9c42da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:00.441452 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4448/8897] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:21:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:21:00.779464 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527e3f6-cbf2-485d-995c-04781b985ba6 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:21:00.781062 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-4527e3f6-cbf2-485d-995c-04781b985ba6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:00.842783 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527e3f6-cbf2-485d-995c-04781b985ba6 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:21:00.846492 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:21:00.847169 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:21:00.847517 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:21:00.847859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:21:00.849604 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:00.859750 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:21:00.861312 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:21:00.870078 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4450/8898] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:21:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:21:01.209417 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ba513-8c73-4c87-b2ae-e895eb9c42da None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:21:01.210843 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-cc2ba513-8c73-4c87-b2ae-e895eb9c42da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:01.286205 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2ba513-8c73-4c87-b2ae-e895eb9c42da None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:21:01.291452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0845a4c-0a36-4ef4-8e7e-c8bddfe6f357 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:21:01.292081 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0845a4c-0a36-4ef4-8e7e-c8bddfe6f357 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:21:01.292357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0845a4c-0a36-4ef4-8e7e-c8bddfe6f357 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:21:01.292627 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0845a4c-0a36-4ef4-8e7e-c8bddfe6f357 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:21:01.294475 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a0845a4c-0a36-4ef4-8e7e-c8bddfe6f357 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:01.305857 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0845a4c-0a36-4ef4-8e7e-c8bddfe6f357 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:21:01.307444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0845a4c-0a36-4ef4-8e7e-c8bddfe6f357 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:21:01.317888 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4449/8899] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:21:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:21:08.017961 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:21:08.019756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:08.036587 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ddb57a-efbb-4c9d-b21a-60dfc228163d service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:21:08.042340 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dd88a-59eb-48dc-b1bc-c59503b143c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:21:08.042933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dd88a-59eb-48dc-b1bc-c59503b143c1 service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:21:08.043213 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dd88a-59eb-48dc-b1bc-c59503b143c1 service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:21:08.043489 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dd88a-59eb-48dc-b1bc-c59503b143c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:21:08.045214 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-5d8dd88a-59eb-48dc-b1bc-c59503b143c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:08.057284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dd88a-59eb-48dc-b1bc-c59503b143c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:21:08.058906 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dd88a-59eb-48dc-b1bc-c59503b143c1 service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:21:08.065536 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:21:08.071035 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4451/8900] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:21:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:21:08.208181 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0845a4c-0a36-4ef4-8e7e-c8bddfe6f357 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:21:08.217734 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0845a4c-0a36-4ef4-8e7e-c8bddfe6f357 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:21:08.221357 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3db591-ba8b-4b58-b3e1-7a000fbcd20b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:21:08.221962 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3db591-ba8b-4b58-b3e1-7a000fbcd20b service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:21:08.222247 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3db591-ba8b-4b58-b3e1-7a000fbcd20b service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:21:08.222526 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3db591-ba8b-4b58-b3e1-7a000fbcd20b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:21:08.224432 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-5a3db591-ba8b-4b58-b3e1-7a000fbcd20b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:08.238519 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3db591-ba8b-4b58-b3e1-7a000fbcd20b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:21:08.239954 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3db591-ba8b-4b58-b3e1-7a000fbcd20b service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:21:08.251983 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4450/8901] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:21:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:21:09.437469 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dd88a-59eb-48dc-b1bc-c59503b143c1 service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:21:09.446687 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dd88a-59eb-48dc-b1bc-c59503b143c1 service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:21:09.450363 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf3c2e-868f-4ae2-a12c-4d68a4b616c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:21:09.450994 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf3c2e-868f-4ae2-a12c-4d68a4b616c9 service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:21:09.451275 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf3c2e-868f-4ae2-a12c-4d68a4b616c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:21:09.451543 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbf3c2e-868f-4ae2-a12c-4d68a4b616c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:21:09.453266 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-3cbf3c2e-868f-4ae2-a12c-4d68a4b616c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:09.467078 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf3c2e-868f-4ae2-a12c-4d68a4b616c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:21:09.468486 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbf3c2e-868f-4ae2-a12c-4d68a4b616c9 service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:21:09.479140 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4452/8902] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:21:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:21:09.786847 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3db591-ba8b-4b58-b3e1-7a000fbcd20b service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:21:09.792496 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=100 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:21:09.796590 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3db591-ba8b-4b58-b3e1-7a000fbcd20b service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:21:09.800444 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f5545-3104-4ad1-86e9-5c693168a79c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:21:09.801039 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f5545-3104-4ad1-86e9-5c693168a79c service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:21:09.801340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f5545-3104-4ad1-86e9-5c693168a79c service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:21:09.801620 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9f5545-3104-4ad1-86e9-5c693168a79c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:21:09.810693 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f5545-3104-4ad1-86e9-5c693168a79c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:21:09.812121 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9f5545-3104-4ad1-86e9-5c693168a79c service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:21:09.821565 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4451/8903] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:21:09 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:21:11.386745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf3c2e-868f-4ae2-a12c-4d68a4b616c9 service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:21:11.398663 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbf3c2e-868f-4ae2-a12c-4d68a4b616c9 service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:21:11.405540 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34a803-d75b-4e80-a4e2-e959f09cc9dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:21:11.406148 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a803-d75b-4e80-a4e2-e959f09cc9dc service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:21:11.406429 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a803-d75b-4e80-a4e2-e959f09cc9dc service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:21:11.406701 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a803-d75b-4e80-a4e2-e959f09cc9dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:21:11.408438 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-7b34a803-d75b-4e80-a4e2-e959f09cc9dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:21:11.421017 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34a803-d75b-4e80-a4e2-e959f09cc9dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:21:11.422681 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34a803-d75b-4e80-a4e2-e959f09cc9dc service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:21:11.433447 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4453/8904] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:21:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:21:19.817247 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=4 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:21:21.428809 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=12 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:22:19.481456 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f5545-3104-4ad1-86e9-5c693168a79c service neutron] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:22:19.482818 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-4b9f5545-3104-4ad1-86e9-5c693168a79c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:22:19.567609 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9f5545-3104-4ad1-86e9-5c693168a79c service neutron] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:22:19.573174 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ca9219-9db5-4e1b-8aed-3e768aafd0d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:22:19.573827 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca9219-9db5-4e1b-8aed-3e768aafd0d0 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:22:19.574106 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca9219-9db5-4e1b-8aed-3e768aafd0d0 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:22:19.574378 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ca9219-9db5-4e1b-8aed-3e768aafd0d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:22:19.576093 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-22ca9219-9db5-4e1b-8aed-3e768aafd0d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:22:19.587391 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca9219-9db5-4e1b-8aed-3e768aafd0d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:22:19.589271 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ca9219-9db5-4e1b-8aed-3e768aafd0d0 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:22:19.598880 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4452/8905] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:22:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:22:25.378336 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34a803-d75b-4e80-a4e2-e959f09cc9dc service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:22:25.397221 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34a803-d75b-4e80-a4e2-e959f09cc9dc service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:22:25.401139 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:22:25.401719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:22:25.402005 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:22:25.402285 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:22:25.404012 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:22:25.414111 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:22:25.415802 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:22:25.423506 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4454/8906] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:22:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:22:29.594876 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=37 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:22:35.420159 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=11 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:07.768919 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0c12c-6e1e-48f1-8369-bf96d9bb23dd None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:07.769395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0c12c-6e1e-48f1-8369-bf96d9bb23dd None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:07.769482 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a0c12c-6e1e-48f1-8369-bf96d9bb23dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:07.789452 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-61a0c12c-6e1e-48f1-8369-bf96d9bb23dd None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:23:07.790923 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-61a0c12c-6e1e-48f1-8369-bf96d9bb23dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:23:07.845848 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4453/8907] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 10:23:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:23:07.895092 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:23:07.896521 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:23:07.966270 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5751a6-c305-4cda-8322-8d22c6e4cc1f service neutron] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:23:07.971269 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598ded0-f130-4178-8f0d-33c3720e72e0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:23:07.971866 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598ded0-f130-4178-8f0d-33c3720e72e0 service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:07.972147 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598ded0-f130-4178-8f0d-33c3720e72e0 service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:07.972426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0598ded0-f130-4178-8f0d-33c3720e72e0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:07.980557 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598ded0-f130-4178-8f0d-33c3720e72e0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:23:07.982642 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0598ded0-f130-4178-8f0d-33c3720e72e0 service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:23:07.990588 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4455/8908] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:23:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:23:17.082422 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2de8-f404-486d-99b6-b5575f861490 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:17.082907 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2de8-f404-486d-99b6-b5575f861490 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:17.083005 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358d2de8-f404-486d-99b6-b5575f861490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:17.101902 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-358d2de8-f404-486d-99b6-b5575f861490 None None] MFA Rules not processed for user `2b49aefb7bfd4dffb2a4bf39f88c1177`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:23:17.103169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-358d2de8-f404-486d-99b6-b5575f861490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:23:17.110030 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4454/8909] 10.222.0.25 () {58 vars in 958 bytes} [Mon Oct 24 10:23:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:23:17.430577 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598ded0-f130-4178-8f0d-33c3720e72e0 service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:23:17.440482 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0598ded0-f130-4178-8f0d-33c3720e72e0 service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:23:17.444027 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd6f410-551d-437d-9666-a08dabc4973b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:23:17.444608 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f410-551d-437d-9666-a08dabc4973b service neutron] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:17.444883 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f410-551d-437d-9666-a08dabc4973b service neutron] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:17.445153 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd6f410-551d-437d-9666-a08dabc4973b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:17.446859 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-afd6f410-551d-437d-9666-a08dabc4973b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:23:17.456079 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6f410-551d-437d-9666-a08dabc4973b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:23:17.457515 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd6f410-551d-437d-9666-a08dabc4973b service neutron] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:23:17.465079 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4456/8910] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:23:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:23:17.780944 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d2de8-f404-486d-99b6-b5575f861490 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:23:17.794552 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358d2de8-f404-486d-99b6-b5575f861490 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:23:17.800255 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b653-c271-4cdf-bfef-c5373af0b5a1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:23:17.800856 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b653-c271-4cdf-bfef-c5373af0b5a1 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:17.801134 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b653-c271-4cdf-bfef-c5373af0b5a1 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:17.801442 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a537b653-c271-4cdf-bfef-c5373af0b5a1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:17.803198 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-a537b653-c271-4cdf-bfef-c5373af0b5a1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:23:17.815169 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537b653-c271-4cdf-bfef-c5373af0b5a1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:23:17.816800 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a537b653-c271-4cdf-bfef-c5373af0b5a1 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:23:17.827536 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4455/8911] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:23:17 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:23:19.129713 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984acc2-c7d6-4014-8f89-df92a4a76bf2 None None] REQUEST_METHOD: `POST` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:19.130202 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984acc2-c7d6-4014-8f89-df92a4a76bf2 None None] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:19.130386 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984acc2-c7d6-4014-8f89-df92a4a76bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:19.150103 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.auth.core [None req-d984acc2-c7d6-4014-8f89-df92a4a76bf2 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88311) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:23:19.151300 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-d984acc2-c7d6-4014-8f89-df92a4a76bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:23:19.158387 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4457/8912] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 10:23:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:23:19.171070 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b653-c271-4cdf-bfef-c5373af0b5a1 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:23:19.182254 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a537b653-c271-4cdf-bfef-c5373af0b5a1 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:23:19.188967 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f03bc-f7ee-40d6-aebb-ae7f4477b06b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:23:19.189610 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f03bc-f7ee-40d6-aebb-ae7f4477b06b service swift] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:19.189895 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f03bc-f7ee-40d6-aebb-ae7f4477b06b service swift] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:19.190172 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745f03bc-f7ee-40d6-aebb-ae7f4477b06b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:19.199283 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f03bc-f7ee-40d6-aebb-ae7f4477b06b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:23:19.200882 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745f03bc-f7ee-40d6-aebb-ae7f4477b06b service swift] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:23:19.209776 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4456/8913] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:23:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:23:21.678035 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984acc2-c7d6-4014-8f89-df92a4a76bf2 None None] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:23:21.691362 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984acc2-c7d6-4014-8f89-df92a4a76bf2 None None] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:23:21.696797 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616870d-0d58-4517-983e-1eb33566ccdd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:23:21.697439 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616870d-0d58-4517-983e-1eb33566ccdd service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:21.697722 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616870d-0d58-4517-983e-1eb33566ccdd service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:21.697998 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616870d-0d58-4517-983e-1eb33566ccdd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:21.699798 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-e616870d-0d58-4517-983e-1eb33566ccdd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:23:21.713162 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616870d-0d58-4517-983e-1eb33566ccdd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:23:21.715656 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616870d-0d58-4517-983e-1eb33566ccdd service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:23:21.727623 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4458/8914] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:23:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:23:27.180763 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f03bc-f7ee-40d6-aebb-ae7f4477b06b service swift] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:23:27.191038 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745f03bc-f7ee-40d6-aebb-ae7f4477b06b service swift] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:23:27.195228 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ec55a5-33d1-432f-b150-ee7e0de0615e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9ea1478025654b729f707edbaeff4e2b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:23:27.195868 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec55a5-33d1-432f-b150-ee7e0de0615e service neutron] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:27.196125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec55a5-33d1-432f-b150-ee7e0de0615e service neutron] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:27.196395 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ec55a5-33d1-432f-b150-ee7e0de0615e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:27.198146 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-b8ec55a5-33d1-432f-b150-ee7e0de0615e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:23:27.207822 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec55a5-33d1-432f-b150-ee7e0de0615e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:23:27.209231 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ec55a5-33d1-432f-b150-ee7e0de0615e service neutron] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:23:27.217069 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4457/8915] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:23:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 24 10:23:27.860258 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616870d-0d58-4517-983e-1eb33566ccdd service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:23:27.874886 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616870d-0d58-4517-983e-1eb33566ccdd service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:23:27.883409 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e58a-4200-4d2b-acdb-e48d8cabf56c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b31aac6142684a039f9de2051fe42989', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'member', 'admin', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:23:27.884292 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e58a-4200-4d2b-acdb-e48d8cabf56c service nova] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:23:27.884571 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e58a-4200-4d2b-acdb-e48d8cabf56c service nova] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:23:27.884911 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9418e58a-4200-4d2b-acdb-e48d8cabf56c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:23:27.887382 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-9418e58a-4200-4d2b-acdb-e48d8cabf56c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:23:27.902513 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418e58a-4200-4d2b-acdb-e48d8cabf56c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:23:27.904601 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9418e58a-4200-4d2b-acdb-e48d8cabf56c service nova] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:23:27.916031 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4459/8916] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:23:27 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:23:37.213573 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=46 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:23:37.911073 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=53 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:09.118746 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b8ae3-8e1f-4369-89e9-7b7c8fd28443 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:09.119335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b8ae3-8e1f-4369-89e9-7b7c8fd28443 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:09.119335 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b8ae3-8e1f-4369-89e9-7b7c8fd28443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:09.180290 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-010b8ae3-8e1f-4369-89e9-7b7c8fd28443 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:25:09.181515 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-010b8ae3-8e1f-4369-89e9-7b7c8fd28443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:25:09.205649 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4458/8917] 10.222.0.25 () {58 vars in 1009 bytes} [Mon Oct 24 10:25:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:25:09.249569 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e58a-4200-4d2b-acdb-e48d8cabf56c service nova] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:25:09.269756 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9418e58a-4200-4d2b-acdb-e48d8cabf56c service nova] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:25:09.276290 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad2f03-e59e-42ae-ac18-a1bbb29fa20e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:25:09.276880 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad2f03-e59e-42ae-ac18-a1bbb29fa20e service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:09.277156 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad2f03-e59e-42ae-ac18-a1bbb29fa20e service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:09.277468 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ad2f03-e59e-42ae-ac18-a1bbb29fa20e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:09.285599 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad2f03-e59e-42ae-ac18-a1bbb29fa20e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:25:09.287155 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ad2f03-e59e-42ae-ac18-a1bbb29fa20e service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:25:09.295918 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4460/8918] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:25:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:18.169435 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e794-1df2-4707-87ae-ab6c52350d38 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:18.169900 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e794-1df2-4707-87ae-ab6c52350d38 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:18.169996 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6021e794-1df2-4707-87ae-ab6c52350d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:18.188976 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-6021e794-1df2-4707-87ae-ab6c52350d38 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:25:18.190197 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6021e794-1df2-4707-87ae-ab6c52350d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:25:18.198620 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4459/8919] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 10:25:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:25:18.210933 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad2f03-e59e-42ae-ac18-a1bbb29fa20e service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:25:18.221176 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ad2f03-e59e-42ae-ac18-a1bbb29fa20e service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:25:18.226179 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c583c-b325-4a00-8895-7ea36d381f2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:25:18.227229 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c583c-b325-4a00-8895-7ea36d381f2d service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:18.227502 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c583c-b325-4a00-8895-7ea36d381f2d service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:18.227772 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c583c-b325-4a00-8895-7ea36d381f2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:18.235854 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c583c-b325-4a00-8895-7ea36d381f2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:25:18.237451 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c583c-b325-4a00-8895-7ea36d381f2d service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:25:18.245810 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4461/8920] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:25:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:23.068340 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18675fb6-b1d3-46ca-b7d8-59d185fcec09 None None] REQUEST_METHOD: `POST` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:23.068803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18675fb6-b1d3-46ca-b7d8-59d185fcec09 None None] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:23.068899 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18675fb6-b1d3-46ca-b7d8-59d185fcec09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:23.088577 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.auth.core [None req-18675fb6-b1d3-46ca-b7d8-59d185fcec09 None None] MFA Rules not processed for user `0e9492df0cf34fd0b1e6a0ac2f77cd37`. Rule list: `[]` (Enabled: `True`). {{(pid=88312) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 24 10:25:23.089801 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-18675fb6-b1d3-46ca-b7d8-59d185fcec09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:25:23.096819 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4460/8921] 10.222.0.25 () {58 vars in 967 bytes} [Mon Oct 24 10:25:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 24 10:25:23.108724 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c583c-b325-4a00-8895-7ea36d381f2d service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:25:23.119629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c583c-b325-4a00-8895-7ea36d381f2d service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:25:23.124475 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d998a-15e3-4b30-8501-2272e1d9de4c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fc41482005be496f822a3118839674c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:25:23.125053 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d998a-15e3-4b30-8501-2272e1d9de4c service swift] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:23.125358 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d998a-15e3-4b30-8501-2272e1d9de4c service swift] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:23.125635 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d998a-15e3-4b30-8501-2272e1d9de4c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:23.133968 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d998a-15e3-4b30-8501-2272e1d9de4c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:25:23.135526 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34d998a-15e3-4b30-8501-2272e1d9de4c service swift] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:25:23.143712 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4462/8922] 10.222.0.25 () {60 vars in 1384 bytes} [Mon Oct 24 10:25:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 24 10:25:31.392085 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18675fb6-b1d3-46ca-b7d8-59d185fcec09 None None] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:25:31.405502 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18675fb6-b1d3-46ca-b7d8-59d185fcec09 None None] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:25:31.410807 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8f590-d3db-4b13-868b-c777e58e9568 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:25:31.411505 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8f590-d3db-4b13-868b-c777e58e9568 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:31.411974 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8f590-d3db-4b13-868b-c777e58e9568 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:31.412259 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c8f590-d3db-4b13-868b-c777e58e9568 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:31.414035 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-10c8f590-d3db-4b13-868b-c777e58e9568 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:25:31.426977 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8f590-d3db-4b13-868b-c777e58e9568 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:25:31.428579 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c8f590-d3db-4b13-868b-c777e58e9568 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:25:31.438923 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4461/8923] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:25:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:25:33.140228 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=22 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:34.459284 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d998a-15e3-4b30-8501-2272e1d9de4c service swift] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:25:34.540667 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d998a-15e3-4b30-8501-2272e1d9de4c service swift] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:25:34.545527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:25:34.546144 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:34.546426 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:34.546699 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] PATH_INFO: `/v3/users/2b49aefb7bfd4dffb2a4bf39f88c1177` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:34.547801 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2b49aefb7bfd4dffb2a4bf39f88c1177)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:25:34.549745 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:25:34.596209 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2b49aefb7bfd4dffb2a4bf39f88c1177'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.608085 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2b49aefb7bfd4dffb2a4bf39f88c1177'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.608752 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2b49aefb7bfd4dffb2a4bf39f88c1177'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.627129 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2b49aefb7bfd4dffb2a4bf39f88c1177'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.634993 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2b49aefb7bfd4dffb2a4bf39f88c1177'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.640873 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4463/8924] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 10:25:34 2022] DELETE /identity/v3/users/2b49aefb7bfd4dffb2a4bf39f88c1177 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:25:34.814947 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8f590-d3db-4b13-868b-c777e58e9568 service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:25:34.826123 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c8f590-d3db-4b13-868b-c777e58e9568 service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:25:34.882538 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:25:34.883164 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:34.883454 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:34.883729 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] PATH_INFO: `/v3/projects/a2cf6a6ff48d4f66a4ae9af2f2d93eda` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:34.884855 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2cf6a6ff48d4f66a4ae9af2f2d93eda)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:25:34.886803 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:25:34.933155 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'request_id': 'req-d7637371-1892-42fd-9981-a61d24bdadee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.940842 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'request_id': 'req-d7637371-1892-42fd-9981-a61d24bdadee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.947007 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2cf6a6ff48d4f66a4ae9af2f2d93eda', 'request_id': 'req-d7637371-1892-42fd-9981-a61d24bdadee'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.966522 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:34.970813 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] The token cache is being invalidate because project a2cf6a6ff48d4f66a4ae9af2f2d93eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 10:25:34.971310 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.972374 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:34.974130 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4462/8925] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 10:25:34 2022] DELETE /identity/v3/projects/a2cf6a6ff48d4f66a4ae9af2f2d93eda => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:25:34.978435 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:25:34.979826 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:25:34.993319 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38460656-20f1-4b83-929d-dfb19a07d5f8 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:25:35.049467 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:25:35.050090 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:35.050388 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:35.050658 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] PATH_INFO: `/v3/users/64741b6860df4056b78f9afe6fd32558` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:35.051770 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64741b6860df4056b78f9afe6fd32558)` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:25:35.053719 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:25:35.056107 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:35.101418 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64741b6860df4056b78f9afe6fd32558'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.113955 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64741b6860df4056b78f9afe6fd32558'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.114632 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64741b6860df4056b78f9afe6fd32558'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.122308 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64741b6860df4056b78f9afe6fd32558'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.129149 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.notifications [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64741b6860df4056b78f9afe6fd32558'} {{(pid=88311) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.135053 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4464/8926] 10.222.0.25 () {58 vars in 1224 bytes} [Mon Oct 24 10:25:34 2022] DELETE /identity/v3/users/64741b6860df4056b78f9afe6fd32558 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:25:35.308089 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:25:35.309564 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:25:35.322602 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637371-1892-42fd-9981-a61d24bdadee admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:25:35.378413 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '382bba280be9494c8775eed19488896e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd5d57fb385334787a7547e0f12982788', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:25:35.379037 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] REQUEST_METHOD: `DELETE` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:25:35.379314 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:25:35.379585 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] PATH_INFO: `/v3/projects/d2fb0fc7d83a458784c2caed88679fcc` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:25:35.380687 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2fb0fc7d83a458784c2caed88679fcc)` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:25:35.382626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:25:35.428140 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2fb0fc7d83a458784c2caed88679fcc', 'request_id': 'req-440256f0-1a23-4f25-b1b7-e629483557af'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.435828 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2fb0fc7d83a458784c2caed88679fcc', 'request_id': 'req-440256f0-1a23-4f25-b1b7-e629483557af'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.442060 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2fb0fc7d83a458784c2caed88679fcc', 'request_id': 'req-440256f0-1a23-4f25-b1b7-e629483557af'} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.452626 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] The token cache is being invalidate because project d2fb0fc7d83a458784c2caed88679fcc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88312) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 24 10:25:35.452915 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.453573 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.notifications [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88312) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 24 10:25:35.455031 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4463/8927] 10.222.0.25 () {58 vars in 1233 bytes} [Mon Oct 24 10:25:35 2022] DELETE /identity/v3/projects/d2fb0fc7d83a458784c2caed88679fcc => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 24 10:25:45.131644 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:25:45.449759 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:27:24.484787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:27:24.486239 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:27:24.554629 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb81f67-0bdd-4879-b82c-0345592a5441 admin admin] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:27:24.614042 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd104ce-0667-41ea-ad25-cd48cad5d7b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:27:24.614640 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd104ce-0667-41ea-ad25-cd48cad5d7b5 service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:27:24.614920 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd104ce-0667-41ea-ad25-cd48cad5d7b5 service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:27:24.615192 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd104ce-0667-41ea-ad25-cd48cad5d7b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:27:24.616910 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.fernet_utils [None req-abd104ce-0667-41ea-ad25-cd48cad5d7b5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88311) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:27:24.627787 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd104ce-0667-41ea-ad25-cd48cad5d7b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:27:24.629396 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd104ce-0667-41ea-ad25-cd48cad5d7b5 service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:27:24.640472 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4465/8928] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:27:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:27:34.634899 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=58 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:28:25.614204 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:28:25.615673 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:28:25.630291 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440256f0-1a23-4f25-b1b7-e629483557af admin admin] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:28:25.635154 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4167d-7f52-458a-8864-f95df64e4b9b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:28:25.635744 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4167d-7f52-458a-8864-f95df64e4b9b service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:28:25.636023 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4167d-7f52-458a-8864-f95df64e4b9b service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:28:25.636451 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4167d-7f52-458a-8864-f95df64e4b9b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:28:25.638125 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.fernet_utils [None req-6ae4167d-7f52-458a-8864-f95df64e4b9b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88312) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 24 10:28:25.649048 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4167d-7f52-458a-8864-f95df64e4b9b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:28:25.650652 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4167d-7f52-458a-8864-f95df64e4b9b service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:28:25.660976 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4464/8929] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:28:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:28:35.656773 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=6 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:32:30.489491 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd104ce-0667-41ea-ad25-cd48cad5d7b5 service placement] Authenticating user token {{(pid=88311) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:32:30.548445 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd104ce-0667-41ea-ad25-cd48cad5d7b5 service placement] Validating token access rules against request {{(pid=88311) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:32:30.553527 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d2d08a-2538-48e7-9a63-7015b18b3aeb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88311) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:32:30.554121 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d08a-2538-48e7-9a63-7015b18b3aeb service placement] REQUEST_METHOD: `GET` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:32:30.554401 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d08a-2538-48e7-9a63-7015b18b3aeb service placement] SCRIPT_NAME: `/identity` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:32:30.554674 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d2d08a-2538-48e7-9a63-7015b18b3aeb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88311) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:32:30.563073 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2d08a-2538-48e7-9a63-7015b18b3aeb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:32:30.564639 n-d-master-1 devstack@keystone.service[88311]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d2d08a-2538-48e7-9a63-7015b18b3aeb service placement] RBAC: Authorization granted {{(pid=88311) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:32:30.574863 n-d-master-1 devstack@keystone.service[88311]: [pid: 88311|app: 0|req: 4466/8930] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:32:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:32:40.570311 n-d-master-1 devstack@keystone.service[88311]: DEBUG dbcounter [-] [88311] Writing DB stats keystone:SELECT=27 {{(pid=88311) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 24 10:33:31.658792 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4167d-7f52-458a-8864-f95df64e4b9b service placement] Authenticating user token {{(pid=88312) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 24 10:33:31.718499 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4167d-7f52-458a-8864-f95df64e4b9b service placement] Validating token access rules against request {{(pid=88312) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 24 10:33:31.724063 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7495fee-e12b-4727-9af5-f95f54611c64 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'dc17e1ac24064752b59ca2438dfdac4c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'de695f740e9e4a4f8197694b0f0db773', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88312) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 24 10:33:31.724659 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495fee-e12b-4727-9af5-f95f54611c64 service placement] REQUEST_METHOD: `GET` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 24 10:33:31.724933 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495fee-e12b-4727-9af5-f95f54611c64 service placement] SCRIPT_NAME: `/identity` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 24 10:33:31.725201 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7495fee-e12b-4727-9af5-f95f54611c64 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88312) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 24 10:33:31.734003 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495fee-e12b-4727-9af5-f95f54611c64 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 24 10:33:31.735570 n-d-master-1 devstack@keystone.service[88312]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7495fee-e12b-4727-9af5-f95f54611c64 service placement] RBAC: Authorization granted {{(pid=88312) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 24 10:33:31.745337 n-d-master-1 devstack@keystone.service[88312]: [pid: 88312|app: 0|req: 4465/8931] 10.222.0.25 () {60 vars in 1365 bytes} [Mon Oct 24 10:33:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 24 10:33:41.741235 n-d-master-1 devstack@keystone.service[88312]: DEBUG dbcounter [-] [88312] Writing DB stats keystone:SELECT=27 {{(pid=88312) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}